2024-09-19T09:19:23.070 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T09:19:23.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:19:23.191 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911919' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEHc6HxsOPvb3fEZkkYmhAsS9wrKCi0TdQ8ZQQpkswtMWhgG6cNNuuV+RZBJ3Xx0+jZ7OFUqFroy/0s/4oqmDkk= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPv8PdjD/kSV6mniW9le7jdRFLm0z0QLFK+DShGnIuYZyZvH4oOIPPu/4uIaYcr0RNVJicB1jGNy4KBnKdLf4fw= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK0ttQbJ0RGAlAU4XAdMCOMdSLG21mp/cN5fGaU3jE6UiIhRq9dab8s7278Kn0cLmATJ/eB0LUmRVfedOBeQO7Q= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T09:19:23.192 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T09:19:23.192 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T09:19:23.193 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T09:19:23.194 INFO:teuthology.task.internal:Checking packages... 2024-09-19T09:19:23.216 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T09:19:23.216 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:19:23.216 INFO:teuthology.packaging:ref: None 2024-09-19T09:19:23.216 INFO:teuthology.packaging:tag: None 2024-09-19T09:19:23.216 INFO:teuthology.packaging:branch: squid 2024-09-19T09:19:23.216 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:19:23.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T09:19:23.430 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T09:19:23.432 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T09:19:23.439 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T09:19:23.439 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T09:19:23.445 INFO:teuthology.task.internal:Saving configuration 2024-09-19T09:19:23.470 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T09:19:23.477 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T09:19:23.496 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:14:18.731949', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEHc6HxsOPvb3fEZkkYmhAsS9wrKCi0TdQ8ZQQpkswtMWhgG6cNNuuV+RZBJ3Xx0+jZ7OFUqFroy/0s/4oqmDkk='} 2024-09-19T09:19:23.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:14:18.729992', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPv8PdjD/kSV6mniW9le7jdRFLm0z0QLFK+DShGnIuYZyZvH4oOIPPu/4uIaYcr0RNVJicB1jGNy4KBnKdLf4fw='} 2024-09-19T09:19:23.530 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:14:18.733695', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK0ttQbJ0RGAlAU4XAdMCOMdSLG21mp/cN5fGaU3jE6UiIhRq9dab8s7278Kn0cLmATJ/eB0LUmRVfedOBeQO7Q='} 2024-09-19T09:19:23.530 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T09:19:23.537 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T09:19:23.537 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T09:19:23.537 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T09:19:23.537 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T09:19:23.620 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f61c2dcc5e0>, signals=[15]) 2024-09-19T09:19:23.621 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T09:19:23.627 INFO:teuthology.task.internal:Opening connections... 2024-09-19T09:19:23.627 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-09-19T09:19:23.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:19:23.750 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-09-19T09:19:23.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:19:23.828 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-09-19T09:19:23.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:19:23.915 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T09:19:23.922 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-09-19T09:19:23.941 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-09-19T09:19:23.942 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-09-19T09:19:23.999 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-09-19T09:19:24.000 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-09-19T09:19:24.000 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-09-19T09:19:24.000 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:19:24.000 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-09-19T09:19:24.000 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:19:24.000 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:19:24.000 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-09-19T09:19:24.000 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:19:24.000 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:19:24.001 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:19:24.001 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:19:24.001 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:19:24.001 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:19:24.002 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-09-19T09:19:24.026 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-09-19T09:19:24.045 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-09-19T09:19:24.046 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-09-19T09:19:24.105 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-09-19T09:19:24.106 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-09-19T09:19:24.106 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-09-19T09:19:24.106 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:19:24.106 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-09-19T09:19:24.106 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:19:24.106 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:19:24.107 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-09-19T09:19:24.107 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:19:24.107 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:19:24.107 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:19:24.107 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:19:24.107 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:19:24.107 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:19:24.108 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-09-19T09:19:24.125 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-09-19T09:19:24.144 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-09-19T09:19:24.145 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-09-19T09:19:24.202 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:19:24.203 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:19:24.204 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:19:24.204 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-09-19T09:19:24.225 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T09:19:24.236 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T09:19:24.242 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T09:19:24.242 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:19:24.244 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:19:24.247 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:19:24.263 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T09:19:24.269 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T09:19:24.269 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:19:24.301 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:19:24.304 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:19:24.406 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T09:19:24.483 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T09:19:24.498 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T09:19:24.498 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T09:19:24.498 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T09:19:24.499 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:19:24.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:19:24.516 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-19T09:19:24.574 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-503.el9.x86_64 2024-09-19T09:19:24.574 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.14.0-503.el9.x86_64 2024-09-19T09:19:24.574 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2024-09-19T09:19:28.910 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.3 MB 00:02 2024-09-19T09:19:30.628 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-19T09:19:36.212 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-19T09:19:37.746 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-19T09:19:38.683 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T09:19:44.364 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T09:19:46.338 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T09:19:46.338 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T09:19:46.433 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-19T09:19:46.444 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-19T09:19:46.444 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-19T09:19:46.444 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-19T09:19:46.444 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-19T09:19:46.444 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T09:19:46.444 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 79 M 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 126 M 2024-09-19T09:19:46.445 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-19T09:19:47.033 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 64 kB/s | 36 kB 00:00 2024-09-19T09:19:47.874 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T09:19:48.542 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-19T09:19:49.208 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-19T09:19:49.209 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:19:49.209 INFO:teuthology.orchestra.run.smithi042.stdout:Total 29 MB/s | 79 MB 00:02 2024-09-19T09:19:49.917 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-19T09:19:50.312 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-19T09:19:50.312 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-19T09:19:51.298 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-19T09:19:51.298 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-19T09:19:53.879 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-19T09:19:54.537 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:19:54.627 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:19:57.390 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:19:57.523 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:20:02.699 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:20:07.841 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:20:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:20:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:20:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:20:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:20:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:20:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:20:48.182 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:20:48.182 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:20:48.182 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-19T09:20:48.182 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T09:20:48.182 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T09:20:48.182 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T09:20:48.182 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T09:20:48.183 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:20:48.183 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-19T09:20:48.510 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:20:48.594 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:20:48.595 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:20:48.595 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T09:20:48.595 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T09:20:48.595 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T09:20:48.596 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T09:20:48.596 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T09:20:48.596 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:20:48.654 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:20:48.654 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:20:48.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-09-19T09:20:48.686 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-09-19T09:20:48.686 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-09-19T09:20:48.686 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-09-19T09:20:48.686 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 82.el9 2024-09-19T09:20:48.686 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-09-19T09:20:48.686 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T09:20:48.686 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-09-19T09:20:48.686 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8274670 2024-09-19T09:20:48.686 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-09-19T09:20:48.686 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-09-19T09:20:48.687 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:20:48.688 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T09:20:48.688 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T09:20:48.689 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 5.14.0-508.el9.x86_64 2024-09-19T09:20:48.689 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T09:20:49.366 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-09-19T09:20:50.604 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T09:20:50.634 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-09-19T09:20:50.636 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-19T09:20:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.ygiT9jnzg5 2024-09-19T09:20:50.680 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ygiT9jnzg5 2024-09-19T09:20:50.745 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.ygiT9jnzg5 2024-09-19T09:20:50.887 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.ygiT9jnzg5 is 6KB 2024-09-19T09:20:50.936 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.ygiT9jnzg5 2024-09-19T09:20:50.951 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T09:20:51.013 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T09:20:51.013 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T09:20:51.013 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T09:20:51.013 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T09:20:51.014 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T09:20:51.167 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-09-19T09:21:21.170 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T09:21:21.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-19T09:21:21.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:21:39.645 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-09-19T09:21:48.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-19T09:21:48.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:22:48.654 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T09:23:00.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-19T09:23:00.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:23:01.015 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-19T09:23:01.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-19T09:23:01.369 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T09:23:01.370 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-19T09:23:01.387 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-508.el9.x86_64 2024-09-19T09:23:01.387 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T09:23:01.388 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T09:23:01.388 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T09:23:02.388 DEBUG:teuthology.parallel:result is None 2024-09-19T09:23:02.389 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T09:23:02.396 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T09:23:02.396 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:23:02.399 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:23:02.402 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:23:02.421 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T09:23:02.436 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T09:23:02.447 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T09:23:02.447 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:23:02.458 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:23:02.461 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:23:02.601 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T09:23:02.608 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T09:23:02.608 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:23:02.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:23:02.625 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:23:02.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:23:02.643 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:23:02.645 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:23:02.668 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:23:02.709 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:23:02.727 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:23:02.741 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:23:02.751 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:23:02.763 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:23:02.765 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:23:02.767 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T09:23:02.774 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T09:23:02.775 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:23:02.777 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:23:02.779 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:23:02.808 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T09:23:02.819 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T09:23:02.819 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:23:02.847 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:23:02.850 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:23:02.867 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:23:02.952 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:23:03.004 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:23:03.088 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:23:03.134 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:23:03.134 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:23:03.201 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:23:03.246 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:23:03.302 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:23:03.387 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:23:03.431 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:23:03.431 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:23:03.499 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:23:03.544 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:23:03.602 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:23:03.691 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:23:03.730 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:23:03.730 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:23:03.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-09-19T09:23:03.799 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-09-19T09:23:03.802 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-09-19T09:23:03.837 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:23:03.848 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:23:03.877 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:23:04.385 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T09:23:04.392 INFO:teuthology.task.internal:Starting timer... 2024-09-19T09:23:04.392 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T09:23:04.403 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T09:23:04.411 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T09:23:04.411 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-09-19T09:23:04.497 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-09-19T09:23:04.499 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-09-19T09:23:04.547 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-09-19T09:23:04.549 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-09-19T09:23:04.621 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-09-19T09:23:04.623 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T09:23:04.624 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-09-19T09:23:04.647 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-09-19T09:23:04.647 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-09-19T09:23:04.672 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-09-19T09:23:04.672 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-09-19T09:23:04.693 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-09-19T09:23:04.693 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-09-19T09:23:04.693 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:23:04.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:23:04.723 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:23:04.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:23:04.750 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:23:04.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:23:04.778 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T09:23:04.778 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:23:04.812 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:23:04.844 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:23:04.874 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T09:23:04.883 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T09:23:04.897 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T09:23:04.898 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi136.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T09:27:05.108 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-09-19T09:27:05.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-19T09:27:05.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:27:05.190 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-19T09:27:05.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-19T09:27:05.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-19T09:27:05.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:27:05.348 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-09-19T09:27:05.425 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-19T09:27:05.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-19T09:27:05.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:27:05.502 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-19T09:27:05.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-19T09:27:05.582 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T09:27:05.595 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T09:27:05.595 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:27:05.596 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:27:05.598 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:27:05.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:27:05.601 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:27:05.601 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:27:05.629 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:27:05.629 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:27:05.645 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:27:05.645 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:27:05.653 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:27:05.668 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:27:05.669 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-09-19T09:27:05.672 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-09-19T09:27:05.681 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-09-19T09:27:05.684 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-09-19T09:27:05.692 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-09-19T09:27:05.695 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:27:05.700 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:27:05.703 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-09-19T09:27:05.709 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:27:05.715 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:27:05.720 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:27:05.732 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:27:05.765 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:27:05.769 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:27:05.769 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-09-19T09:27:05.770 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.770 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.770 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.770 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.773 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:27:05.776 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:27:05.777 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-19T09:27:05.777 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.777 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.777 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.777 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.792 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:27:05.795 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:27:05.795 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-09-19T09:27:05.795 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.795 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.795 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.795 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:27:05.796 INFO:teuthology.run_tasks:Running task install... 2024-09-19T09:27:05.807 DEBUG:teuthology.task.install:project ceph 2024-09-19T09:27:05.807 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T09:27:05.807 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T09:27:05.807 INFO:teuthology.task.install:Using flavor: default 2024-09-19T09:27:05.812 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T09:27:05.812 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T09:27:05.813 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:27:05.813 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:27:05.815 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:27:05.816 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:27:05.816 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:27:05.817 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:27:05.971 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:27:05.971 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:27:05.987 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:27:05.988 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:27:05.991 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:27:05.991 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:27:06.085 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:27:06.085 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:27:06.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:27:06.101 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:27:06.101 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:27:06.102 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:27:06.105 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:27:06.105 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:27:06.105 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:27:06.113 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:27:06.114 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:27:06.127 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:27:06.128 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:27:06.132 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:27:06.132 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:27:06.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:27:06.193 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:27:06.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:27:06.258 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:27:06.268 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:27:06.273 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:27:06.323 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-09-19T09:27:06.325 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-09-19T09:27:06.332 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-09-19T09:27:06.333 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-09-19T09:27:06.337 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-09-19T09:27:06.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-09-19T09:27:06.557 INFO:teuthology.orchestra.run.smithi042.stdout:45 files removed 2024-09-19T09:27:06.559 INFO:teuthology.orchestra.run.smithi171.stdout:45 files removed 2024-09-19T09:27:06.563 INFO:teuthology.orchestra.run.smithi136.stdout:45 files removed 2024-09-19T09:27:06.585 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:27:06.587 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:27:06.590 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:27:07.140 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-19T09:27:07.162 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 282 kB/s | 84 kB 00:00 2024-09-19T09:27:07.164 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-09-19T09:27:07.432 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T09:27:07.446 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T09:27:07.448 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T09:27:07.700 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T09:27:07.716 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-19T09:27:07.722 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T09:27:08.867 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.3 MB 00:01 2024-09-19T09:27:08.880 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.3 MB 00:01 2024-09-19T09:27:09.116 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.3 MB 00:01 2024-09-19T09:27:11.559 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-19T09:27:11.924 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-19T09:27:13.719 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 20 MB 00:03 2024-09-19T09:27:17.035 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-19T09:27:17.574 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-19T09:27:18.145 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-19T09:27:18.527 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 19 kB 00:00 2024-09-19T09:27:19.341 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-19T09:27:19.673 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T09:27:19.996 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 19 kB 00:00 2024-09-19T09:27:20.112 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-19T09:27:21.117 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-19T09:27:25.320 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T09:27:25.593 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T09:27:26.507 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-19T09:27:27.568 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:27:27.569 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:27:27.583 INFO:teuthology.orchestra.run.smithi042.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:27:27.584 INFO:teuthology.orchestra.run.smithi042.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:27:27.585 INFO:teuthology.orchestra.run.smithi042.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:27:27.586 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:27:27.588 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:27:27.591 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:27:27.592 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:27:27.660 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-19T09:27:27.673 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-09-19T09:27:27.673 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-19T09:27:27.673 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-09-19T09:27:27.673 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-19T09:27:27.673 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:27:27.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:27:27.675 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:27:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:27:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:27:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:27:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:27:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:27:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:27:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:27:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:27:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:27:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:27:27.677 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:27:27.677 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:27:27.677 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:27:27.677 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-09-19T09:27:27.677 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:27:27.677 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:27:27.678 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:27:27.679 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:27:27.680 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:27:27.680 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:27:27.680 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:27:27.680 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:27:27.680 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:27:27.680 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:27:27.680 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:27:27.680 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:27:27.681 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:27:27.681 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:27:27.681 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:27:27.681 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:27:27.681 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:27:27.681 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:27:27.681 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:27:27.681 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:27:27.681 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:27:27.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:27:27.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:27:27.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:27:27.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:27:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:27:27.687 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:27:27.688 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:27:27.688 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-09-19T09:27:27.688 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:27:27.688 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:27:27.688 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-19T09:27:27.688 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-09-19T09:27:27.688 INFO:teuthology.orchestra.run.smithi042.stdout:Install 148 Packages 2024-09-19T09:27:27.688 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 8 Packages 2024-09-19T09:27:27.688 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:27:27.689 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 226 M 2024-09-19T09:27:27.689 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-19T09:27:27.746 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:27:27.747 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:27:27.760 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:27:27.761 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:27:27.762 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:27:27.763 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:27:27.765 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:27:27.767 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:27:27.768 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:27:27.830 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-19T09:27:27.860 INFO:teuthology.orchestra.run.smithi136.stdout:====================================================================================== 2024-09-19T09:27:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-19T09:27:27.860 INFO:teuthology.orchestra.run.smithi136.stdout:====================================================================================== 2024-09-19T09:27:27.860 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-19T09:27:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:27:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:27:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:27:27.860 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:27:27.861 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:27:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:27:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:27:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:27:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:27:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:27:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:27:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:27:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:27:27.862 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-09-19T09:27:27.863 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:27:27.864 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:27:27.865 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:27:27.866 INFO:teuthology.orchestra.run.smithi136.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:27:27.867 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:27:27.868 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:27:27.869 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:27:27.870 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:27:27.871 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:27:27.872 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:27:27.873 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-19T09:27:27.873 INFO:teuthology.orchestra.run.smithi136.stdout:====================================================================================== 2024-09-19T09:27:27.873 INFO:teuthology.orchestra.run.smithi136.stdout:Install 148 Packages 2024-09-19T09:27:27.873 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 8 Packages 2024-09-19T09:27:27.873 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:27:27.873 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 226 M 2024-09-19T09:27:27.874 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-19T09:27:28.097 INFO:teuthology.orchestra.run.smithi042.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 52 kB/s | 6.6 kB 00:00 2024-09-19T09:27:28.280 INFO:teuthology.orchestra.run.smithi042.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.8 MB/s | 896 kB 00:00 2024-09-19T09:27:28.372 INFO:teuthology.orchestra.run.smithi042.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.5 MB/s | 145 kB 00:00 2024-09-19T09:27:28.456 INFO:teuthology.orchestra.run.smithi042.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T09:27:28.540 INFO:teuthology.orchestra.run.smithi042.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 1.5 MB 00:00 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi042.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 10 MB/s | 2.4 MB 00:00 2024-09-19T09:27:28.633 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:27:28.634 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:27:28.645 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:27:28.646 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:27:28.647 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:27:28.647 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:27:28.649 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:27:28.651 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:27:28.652 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:27:28.715 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-09-19T09:27:28.724 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================== 2024-09-19T09:27:28.724 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================== 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:27:28.725 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:27:28.726 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:27:28.726 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:27:28.726 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:27:28.726 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:27:28.726 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:27:28.726 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:27:28.726 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:27:28.726 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:27:28.726 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:27:28.726 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:27:28.727 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:27:28.727 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:27:28.727 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:27:28.727 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:27:28.727 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:27:28.727 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:27:28.727 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:27:28.727 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:27:28.727 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:27:28.728 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:27:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:27:28.730 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:27:28.731 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:27:28.732 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:27:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:27:28.734 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:27:28.735 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:27:28.736 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:27:28.737 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:27:28.738 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-09-19T09:27:28.738 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:27:28.738 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:27:28.738 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-09-19T09:27:28.738 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================== 2024-09-19T09:27:28.738 INFO:teuthology.orchestra.run.smithi171.stdout:Install 148 Packages 2024-09-19T09:27:28.738 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 8 Packages 2024-09-19T09:27:28.738 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:27:28.739 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 226 M 2024-09-19T09:27:28.739 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-09-19T09:27:28.786 INFO:teuthology.orchestra.run.smithi136.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 23 kB/s | 6.6 kB 00:00 2024-09-19T09:27:29.153 INFO:teuthology.orchestra.run.smithi136.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.4 MB/s | 896 kB 00:00 2024-09-19T09:27:29.157 INFO:teuthology.orchestra.run.smithi042.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T09:27:29.224 INFO:teuthology.orchestra.run.smithi042.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 6.9 MB/s | 4.7 MB 00:00 2024-09-19T09:27:29.236 INFO:teuthology.orchestra.run.smithi136.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.7 MB/s | 145 kB 00:00 2024-09-19T09:27:29.274 INFO:teuthology.orchestra.run.smithi042.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 505 kB/s | 25 kB 00:00 2024-09-19T09:27:29.437 INFO:teuthology.orchestra.run.smithi136.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 5.8 MB/s | 5.4 MB 00:00 2024-09-19T09:27:29.617 INFO:teuthology.orchestra.run.smithi171.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 20 kB/s | 6.6 kB 00:00 2024-09-19T09:27:29.779 INFO:teuthology.orchestra.run.smithi136.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.5 MB/s | 1.5 MB 00:00 2024-09-19T09:27:29.900 INFO:teuthology.orchestra.run.smithi042.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 13 MB/s | 17 MB 00:01 2024-09-19T09:27:30.091 INFO:teuthology.orchestra.run.smithi042.stdout:(11/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 11 MB/s | 11 MB 00:00 2024-09-19T09:27:30.117 INFO:teuthology.orchestra.run.smithi042.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.0 MB/s | 228 kB 00:00 2024-09-19T09:27:30.126 INFO:teuthology.orchestra.run.smithi171.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 896 kB 00:00 2024-09-19T09:27:30.184 INFO:teuthology.orchestra.run.smithi042.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 294 kB/s | 27 kB 00:00 2024-09-19T09:27:30.209 INFO:teuthology.orchestra.run.smithi042.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 345 kB/s | 32 kB 00:00 2024-09-19T09:27:30.226 INFO:teuthology.orchestra.run.smithi171.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.4 MB/s | 145 kB 00:00 2024-09-19T09:27:30.317 INFO:teuthology.orchestra.run.smithi042.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.5 MB/s | 163 kB 00:00 2024-09-19T09:27:30.418 INFO:teuthology.orchestra.run.smithi042.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.2 MB/s | 127 kB 00:00 2024-09-19T09:27:30.485 INFO:teuthology.orchestra.run.smithi171.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 4.5 MB/s | 5.4 MB 00:01 2024-09-19T09:27:30.493 INFO:teuthology.orchestra.run.smithi042.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T09:27:30.504 INFO:teuthology.orchestra.run.smithi136.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 1.9 MB/s | 2.4 MB 00:01 2024-09-19T09:27:30.710 INFO:teuthology.orchestra.run.smithi171.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 6.8 MB/s | 1.5 MB 00:00 2024-09-19T09:27:30.758 INFO:teuthology.orchestra.run.smithi136.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 9.4 MB/s | 21 MB 00:02 2024-09-19T09:27:30.810 INFO:teuthology.orchestra.run.smithi042.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-19T09:27:30.835 INFO:teuthology.orchestra.run.smithi042.stdout:(19/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 1.1 MB/s | 751 kB 00:00 2024-09-19T09:27:30.863 INFO:teuthology.orchestra.run.smithi136.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 4.3 MB/s | 4.7 MB 00:01 2024-09-19T09:27:30.869 INFO:teuthology.orchestra.run.smithi042.stdout:(20/156): python3-ceph-argparse-19.1.1-361.g2f5 773 kB/s | 45 kB 00:00 2024-09-19T09:27:30.894 INFO:teuthology.orchestra.run.smithi042.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 2.3 MB/s | 136 kB 00:00 2024-09-19T09:27:30.938 INFO:teuthology.orchestra.run.smithi136.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 337 kB/s | 25 kB 00:00 2024-09-19T09:27:30.961 INFO:teuthology.orchestra.run.smithi042.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.7 MB/s | 161 kB 00:00 2024-09-19T09:27:30.987 INFO:teuthology.orchestra.run.smithi042.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 3.4 MB/s | 320 kB 00:00 2024-09-19T09:27:31.045 INFO:teuthology.orchestra.run.smithi042.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.5 MB/s | 300 kB 00:00 2024-09-19T09:27:31.070 INFO:teuthology.orchestra.run.smithi042.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.2 MB/s | 99 kB 00:00 2024-09-19T09:27:31.121 INFO:teuthology.orchestra.run.smithi042.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-19T09:27:31.221 INFO:teuthology.orchestra.run.smithi042.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-19T09:27:31.294 INFO:teuthology.orchestra.run.smithi171.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 8.1 MB/s | 4.7 MB 00:00 2024-09-19T09:27:31.304 INFO:teuthology.orchestra.run.smithi042.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 382 kB/s | 32 kB 00:00 2024-09-19T09:27:31.344 INFO:teuthology.orchestra.run.smithi171.stdout:(7/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.1 MB/s | 2.4 MB 00:01 2024-09-19T09:27:31.396 INFO:teuthology.orchestra.run.smithi042.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.6 MB/s | 146 kB 00:00 2024-09-19T09:27:31.513 INFO:teuthology.orchestra.run.smithi042.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 7.0 MB/s | 3.1 MB 00:00 2024-09-19T09:27:31.655 INFO:teuthology.orchestra.run.smithi136.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 12 MB/s | 11 MB 00:00 2024-09-19T09:27:31.755 INFO:teuthology.orchestra.run.smithi136.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 2.2 MB/s | 228 kB 00:00 2024-09-19T09:27:31.780 INFO:teuthology.orchestra.run.smithi042.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.3 MB/s | 3.6 MB 00:00 2024-09-19T09:27:31.814 INFO:teuthology.orchestra.run.smithi136.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 465 kB/s | 27 kB 00:00 2024-09-19T09:27:31.864 INFO:teuthology.orchestra.run.smithi042.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T09:27:31.905 INFO:teuthology.orchestra.run.smithi136.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 346 kB/s | 32 kB 00:00 2024-09-19T09:27:31.948 INFO:teuthology.orchestra.run.smithi042.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 592 kB/s | 49 kB 00:00 2024-09-19T09:27:31.997 INFO:teuthology.orchestra.run.smithi136.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T09:27:32.031 INFO:teuthology.orchestra.run.smithi042.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 197 kB/s | 16 kB 00:00 2024-09-19T09:27:32.073 INFO:teuthology.orchestra.run.smithi136.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T09:27:32.115 INFO:teuthology.orchestra.run.smithi042.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.3 MB/s | 285 kB 00:00 2024-09-19T09:27:32.165 INFO:teuthology.orchestra.run.smithi136.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.4 MB/s | 127 kB 00:00 2024-09-19T09:27:32.207 INFO:teuthology.orchestra.run.smithi042.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-19T09:27:32.265 INFO:teuthology.orchestra.run.smithi136.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 4.9 MB/s | 506 kB 00:00 2024-09-19T09:27:32.290 INFO:teuthology.orchestra.run.smithi042.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 219 kB/s | 18 kB 00:00 2024-09-19T09:27:32.432 INFO:teuthology.orchestra.run.smithi042.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 8.1 MB/s | 7.4 MB 00:00 2024-09-19T09:27:32.483 INFO:teuthology.orchestra.run.smithi042.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-19T09:27:32.519 INFO:teuthology.orchestra.run.smithi171.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 6.6 MB/s | 21 MB 00:03 2024-09-19T09:27:32.586 INFO:teuthology.orchestra.run.smithi171.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 379 kB/s | 25 kB 00:00 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi042.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-19T09:27:32.615 INFO:teuthology.orchestra.run.smithi136.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-19T09:27:32.674 INFO:teuthology.orchestra.run.smithi136.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 776 kB/s | 45 kB 00:00 2024-09-19T09:27:32.724 INFO:teuthology.orchestra.run.smithi136.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T09:27:32.775 INFO:teuthology.orchestra.run.smithi136.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.1 MB/s | 161 kB 00:00 2024-09-19T09:27:32.842 INFO:teuthology.orchestra.run.smithi136.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.7 MB/s | 320 kB 00:00 2024-09-19T09:27:32.900 INFO:teuthology.orchestra.run.smithi136.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T09:27:32.950 INFO:teuthology.orchestra.run.smithi136.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T09:27:33.001 INFO:teuthology.orchestra.run.smithi136.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T09:27:33.083 INFO:teuthology.orchestra.run.smithi042.stdout:(41/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 13 MB/s | 49 MB 00:03 2024-09-19T09:27:33.108 INFO:teuthology.orchestra.run.smithi042.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 498 kB/s | 253 kB 00:00 2024-09-19T09:27:33.167 INFO:teuthology.orchestra.run.smithi042.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T09:27:33.201 INFO:teuthology.orchestra.run.smithi042.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-19T09:27:33.209 INFO:teuthology.orchestra.run.smithi136.stdout:(26/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-19T09:27:33.226 INFO:teuthology.orchestra.run.smithi042.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T09:27:33.260 INFO:teuthology.orchestra.run.smithi042.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T09:27:33.268 INFO:teuthology.orchestra.run.smithi136.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T09:27:33.285 INFO:teuthology.orchestra.run.smithi042.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-19T09:27:33.295 INFO:teuthology.orchestra.run.smithi171.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 8.4 MB/s | 17 MB 00:02 2024-09-19T09:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 635 kB/s | 32 kB 00:00 2024-09-19T09:27:33.345 INFO:teuthology.orchestra.run.smithi171.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T09:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T09:27:33.396 INFO:teuthology.orchestra.run.smithi171.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 541 kB/s | 27 kB 00:00 2024-09-19T09:27:33.402 INFO:teuthology.orchestra.run.smithi042.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 3.9 MB/s | 1.2 MB 00:00 2024-09-19T09:27:33.446 INFO:teuthology.orchestra.run.smithi171.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 636 kB/s | 32 kB 00:00 2024-09-19T09:27:33.519 INFO:teuthology.orchestra.run.smithi042.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-19T09:27:33.554 INFO:teuthology.orchestra.run.smithi171.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-19T09:27:33.569 INFO:teuthology.orchestra.run.smithi042.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-19T09:27:33.577 INFO:teuthology.orchestra.run.smithi136.stdout:(30/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 17 MB/s | 3.6 MB 00:00 2024-09-19T09:27:33.594 INFO:teuthology.orchestra.run.smithi042.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 289 kB/s | 22 kB 00:00 2024-09-19T09:27:33.605 INFO:teuthology.orchestra.run.smithi171.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T09:27:33.611 INFO:teuthology.orchestra.run.smithi042.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 512 kB/s | 107 kB 00:00 2024-09-19T09:27:33.637 INFO:teuthology.orchestra.run.smithi042.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-19T09:27:33.654 INFO:teuthology.orchestra.run.smithi042.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 555 kB/s | 33 kB 00:00 2024-09-19T09:27:33.679 INFO:teuthology.orchestra.run.smithi042.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 435 kB/s | 18 kB 00:00 2024-09-19T09:27:33.695 INFO:teuthology.orchestra.run.smithi042.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-19T09:27:33.697 INFO:teuthology.orchestra.run.smithi171.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.4 MB/s | 127 kB 00:00 2024-09-19T09:27:33.729 INFO:teuthology.orchestra.run.smithi042.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T09:27:33.746 INFO:teuthology.orchestra.run.smithi042.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-19T09:27:33.813 INFO:teuthology.orchestra.run.smithi042.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-19T09:27:33.822 INFO:teuthology.orchestra.run.smithi171.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 3.9 MB/s | 506 kB 00:00 2024-09-19T09:27:33.872 INFO:teuthology.orchestra.run.smithi042.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-19T09:27:33.897 INFO:teuthology.orchestra.run.smithi042.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 294 kB/s | 24 kB 00:00 2024-09-19T09:27:33.922 INFO:teuthology.orchestra.run.smithi042.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-19T09:27:33.945 INFO:teuthology.orchestra.run.smithi136.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 20 MB/s | 7.4 MB 00:00 2024-09-19T09:27:33.993 INFO:teuthology.orchestra.run.smithi136.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 5.4 MB/s | 249 kB 00:00 2024-09-19T09:27:33.993 INFO:teuthology.orchestra.run.smithi171.stdout:(18/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 4.0 MB/s | 11 MB 00:02 2024-09-19T09:27:34.031 INFO:teuthology.orchestra.run.smithi042.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-19T09:27:34.031 INFO:teuthology.orchestra.run.smithi171.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.1 MB/s | 45 kB 00:00 2024-09-19T09:27:34.041 INFO:teuthology.orchestra.run.smithi136.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 985 kB/s | 49 kB 00:00 2024-09-19T09:27:34.081 INFO:teuthology.orchestra.run.smithi042.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-19T09:27:34.082 INFO:teuthology.orchestra.run.smithi171.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T09:27:34.091 INFO:teuthology.orchestra.run.smithi136.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 329 kB/s | 16 kB 00:00 2024-09-19T09:27:34.106 INFO:teuthology.orchestra.run.smithi042.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 512 kB/s | 38 kB 00:00 2024-09-19T09:27:34.132 INFO:teuthology.orchestra.run.smithi171.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.1 MB/s | 161 kB 00:00 2024-09-19T09:27:34.150 INFO:teuthology.orchestra.run.smithi136.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.8 MB/s | 285 kB 00:00 2024-09-19T09:27:34.209 INFO:teuthology.orchestra.run.smithi136.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T09:27:34.224 INFO:teuthology.orchestra.run.smithi171.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.4 MB/s | 320 kB 00:00 2024-09-19T09:27:34.259 INFO:teuthology.orchestra.run.smithi136.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 365 kB/s | 18 kB 00:00 2024-09-19T09:27:34.350 INFO:teuthology.orchestra.run.smithi171.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-19T09:27:34.375 INFO:teuthology.orchestra.run.smithi171.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.0 MB/s | 300 kB 00:00 2024-09-19T09:27:34.392 INFO:teuthology.orchestra.run.smithi136.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-19T09:27:34.400 INFO:teuthology.orchestra.run.smithi171.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T09:27:34.418 INFO:teuthology.orchestra.run.smithi171.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 2.0 MB/s | 85 kB 00:00 2024-09-19T09:27:34.468 INFO:teuthology.orchestra.run.smithi171.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T09:27:34.518 INFO:teuthology.orchestra.run.smithi171.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 638 kB/s | 32 kB 00:00 2024-09-19T09:27:34.524 INFO:teuthology.orchestra.run.smithi042.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-19T09:27:34.534 INFO:teuthology.orchestra.run.smithi136.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 5.5 MB/s | 801 kB 00:00 2024-09-19T09:27:34.569 INFO:teuthology.orchestra.run.smithi171.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T09:27:34.669 INFO:teuthology.orchestra.run.smithi171.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-19T09:27:34.718 INFO:teuthology.orchestra.run.smithi136.stdout:(40/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 4.0 MB/s | 17 MB 00:04 2024-09-19T09:27:34.743 INFO:teuthology.orchestra.run.smithi136.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 916 kB/s | 191 kB 00:00 2024-09-19T09:27:34.827 INFO:teuthology.orchestra.run.smithi136.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-19T09:27:34.877 INFO:teuthology.orchestra.run.smithi136.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T09:27:34.928 INFO:teuthology.orchestra.run.smithi136.stdout:(44/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-19T09:27:34.953 INFO:teuthology.orchestra.run.smithi136.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.7 MB/s | 135 kB 00:00 2024-09-19T09:27:34.987 INFO:teuthology.orchestra.run.smithi136.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T09:27:35.012 INFO:teuthology.orchestra.run.smithi136.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-19T09:27:35.078 INFO:teuthology.orchestra.run.smithi171.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.0 MB/s | 3.6 MB 00:00 2024-09-19T09:27:35.163 INFO:teuthology.orchestra.run.smithi136.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-19T09:27:35.943 INFO:teuthology.orchestra.run.smithi042.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-19T09:27:35.943 INFO:teuthology.orchestra.run.smithi042.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.6 MB/s | 4.4 MB 00:01 2024-09-19T09:27:35.943 INFO:teuthology.orchestra.run.smithi042.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 1.7 MB/s | 910 kB 00:00 2024-09-19T09:27:35.943 INFO:teuthology.orchestra.run.smithi042.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-19T09:27:35.946 INFO:teuthology.orchestra.run.smithi171.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-19T09:27:35.946 INFO:teuthology.orchestra.run.smithi171.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.1 MB/s | 249 kB 00:00 2024-09-19T09:27:35.946 INFO:teuthology.orchestra.run.smithi171.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 1.0 MB/s | 49 kB 00:00 2024-09-19T09:27:35.946 INFO:teuthology.orchestra.run.smithi171.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 325 kB/s | 16 kB 00:00 2024-09-19T09:27:35.946 INFO:teuthology.orchestra.run.smithi171.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T09:27:35.946 INFO:teuthology.orchestra.run.smithi171.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 364 kB/s | 18 kB 00:00 2024-09-19T09:27:35.946 INFO:teuthology.orchestra.run.smithi171.stdout:(38/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.9 MB/s | 765 kB 00:00 2024-09-19T09:27:35.946 INFO:teuthology.orchestra.run.smithi171.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 735 kB/s | 80 kB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 3.1 MB/s | 135 kB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 943 kB 00:00 2024-09-19T09:27:35.947 INFO:teuthology.orchestra.run.smithi171.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 369 kB/s | 22 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T09:27:35.948 INFO:teuthology.orchestra.run.smithi136.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-19T09:27:35.949 INFO:teuthology.orchestra.run.smithi136.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 486 kB/s | 24 kB 00:00 2024-09-19T09:27:35.949 INFO:teuthology.orchestra.run.smithi136.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T09:27:35.949 INFO:teuthology.orchestra.run.smithi136.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T09:27:35.949 INFO:teuthology.orchestra.run.smithi136.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-19T09:27:35.949 INFO:teuthology.orchestra.run.smithi136.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 918 kB/s | 38 kB 00:00 2024-09-19T09:27:35.949 INFO:teuthology.orchestra.run.smithi136.stdout:(66/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-19T09:27:35.949 INFO:teuthology.orchestra.run.smithi136.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-19T09:27:35.949 INFO:teuthology.orchestra.run.smithi136.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-19T09:27:35.949 INFO:teuthology.orchestra.run.smithi136.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-19T09:27:35.961 INFO:teuthology.orchestra.run.smithi136.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T09:27:35.967 INFO:teuthology.orchestra.run.smithi171.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-19T09:27:36.009 INFO:teuthology.orchestra.run.smithi171.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-19T09:27:36.020 INFO:teuthology.orchestra.run.smithi136.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-19T09:27:36.034 INFO:teuthology.orchestra.run.smithi171.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 487 kB/s | 33 kB 00:00 2024-09-19T09:27:36.096 INFO:teuthology.orchestra.run.smithi136.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-09-19T09:27:36.121 INFO:teuthology.orchestra.run.smithi136.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 873 kB/s | 87 kB 00:00 2024-09-19T09:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T09:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-09-19T09:27:36.272 INFO:teuthology.orchestra.run.smithi136.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-19T09:27:36.305 INFO:teuthology.orchestra.run.smithi136.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-19T09:27:36.330 INFO:teuthology.orchestra.run.smithi136.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-19T09:27:36.356 INFO:teuthology.orchestra.run.smithi136.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-19T09:27:36.390 INFO:teuthology.orchestra.run.smithi136.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T09:27:36.415 INFO:teuthology.orchestra.run.smithi136.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-09-19T09:27:36.457 INFO:teuthology.orchestra.run.smithi136.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-19T09:27:36.493 INFO:teuthology.orchestra.run.smithi171.stdout:(54/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 12 MB/s | 49 MB 00:03 2024-09-19T09:27:36.505 INFO:teuthology.orchestra.run.smithi042.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.0 MB/s | 4.9 MB 00:02 2024-09-19T09:27:36.527 INFO:teuthology.orchestra.run.smithi171.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 37 kB/s | 18 kB 00:00 2024-09-19T09:27:36.532 INFO:teuthology.orchestra.run.smithi136.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-19T09:27:36.558 INFO:teuthology.orchestra.run.smithi136.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-19T09:27:36.566 INFO:teuthology.orchestra.run.smithi042.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.4 MB/s | 87 kB 00:00 2024-09-19T09:27:36.583 INFO:teuthology.orchestra.run.smithi136.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T09:27:36.594 INFO:teuthology.orchestra.run.smithi171.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.1 MB/s | 3.0 MB 00:00 2024-09-19T09:27:36.600 INFO:teuthology.orchestra.run.smithi042.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2024-09-19T09:27:36.608 INFO:teuthology.orchestra.run.smithi136.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-09-19T09:27:36.619 INFO:teuthology.orchestra.run.smithi171.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-19T09:27:36.633 INFO:teuthology.orchestra.run.smithi136.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-19T09:27:36.645 INFO:teuthology.orchestra.run.smithi171.stdout:(58/156): libaio-devel-0.3.111-13.el9.x86_64.rp 74 kB/s | 11 kB 00:00 2024-09-19T09:27:36.659 INFO:teuthology.orchestra.run.smithi042.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-19T09:27:36.659 INFO:teuthology.orchestra.run.smithi136.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T09:27:36.670 INFO:teuthology.orchestra.run.smithi171.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-19T09:27:36.684 INFO:teuthology.orchestra.run.smithi136.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T09:27:36.703 INFO:teuthology.orchestra.run.smithi171.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-19T09:27:36.709 INFO:teuthology.orchestra.run.smithi136.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T09:27:36.735 INFO:teuthology.orchestra.run.smithi136.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T09:27:36.745 INFO:teuthology.orchestra.run.smithi171.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-19T09:27:36.777 INFO:teuthology.orchestra.run.smithi136.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-19T09:27:36.779 INFO:teuthology.orchestra.run.smithi171.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-19T09:27:36.804 INFO:teuthology.orchestra.run.smithi171.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 471 kB/s | 47 kB 00:00 2024-09-19T09:27:36.809 INFO:teuthology.orchestra.run.smithi042.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-09-19T09:27:36.819 INFO:teuthology.orchestra.run.smithi136.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-19T09:27:36.830 INFO:teuthology.orchestra.run.smithi171.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-19T09:27:36.855 INFO:teuthology.orchestra.run.smithi171.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-19T09:27:36.859 INFO:teuthology.orchestra.run.smithi042.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-19T09:27:36.860 INFO:teuthology.orchestra.run.smithi136.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-19T09:27:36.880 INFO:teuthology.orchestra.run.smithi171.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 508 kB/s | 38 kB 00:00 2024-09-19T09:27:36.884 INFO:teuthology.orchestra.run.smithi042.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-19T09:27:36.910 INFO:teuthology.orchestra.run.smithi042.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-19T09:27:36.935 INFO:teuthology.orchestra.run.smithi042.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-19T09:27:36.985 INFO:teuthology.orchestra.run.smithi042.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-19T09:27:36.989 INFO:teuthology.orchestra.run.smithi171.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T09:27:37.027 INFO:teuthology.orchestra.run.smithi042.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-19T09:27:37.073 INFO:teuthology.orchestra.run.smithi171.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-19T09:27:37.140 INFO:teuthology.orchestra.run.smithi171.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-19T09:27:37.144 INFO:teuthology.orchestra.run.smithi042.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-19T09:27:37.165 INFO:teuthology.orchestra.run.smithi171.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T09:27:37.199 INFO:teuthology.orchestra.run.smithi171.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.2 MB/s | 910 kB 00:00 2024-09-19T09:27:37.203 INFO:teuthology.orchestra.run.smithi042.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-19T09:27:37.228 INFO:teuthology.orchestra.run.smithi042.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 250 kB 00:00 2024-09-19T09:27:37.241 INFO:teuthology.orchestra.run.smithi171.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-19T09:27:37.253 INFO:teuthology.orchestra.run.smithi042.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T09:27:37.276 INFO:teuthology.orchestra.run.smithi171.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-19T09:27:37.278 INFO:teuthology.orchestra.run.smithi136.stdout:(95/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 7.7 MB/s | 49 MB 00:06 2024-09-19T09:27:37.279 INFO:teuthology.orchestra.run.smithi042.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-19T09:27:37.295 INFO:teuthology.orchestra.run.smithi136.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 83 kB/s | 36 kB 00:00 2024-09-19T09:27:37.312 INFO:teuthology.orchestra.run.smithi042.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T09:27:37.337 INFO:teuthology.orchestra.run.smithi136.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-19T09:27:37.371 INFO:teuthology.orchestra.run.smithi042.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-19T09:27:37.375 INFO:teuthology.orchestra.run.smithi171.stdout:(74/156): python3-babel-2.9.1-2.el9.noarch.rpm 45 MB/s | 6.0 MB 00:00 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi042.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi171.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 488 kB/s | 61 kB 00:00 2024-09-19T09:27:37.422 INFO:teuthology.orchestra.run.smithi042.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T09:27:37.447 INFO:teuthology.orchestra.run.smithi042.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T09:27:37.476 INFO:teuthology.orchestra.run.smithi171.stdout:(76/156): postgresql-server-13.16-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-09-19T09:27:37.496 INFO:teuthology.orchestra.run.smithi136.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-19T09:27:37.501 INFO:teuthology.orchestra.run.smithi171.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-19T09:27:37.505 INFO:teuthology.orchestra.run.smithi042.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 714 kB/s | 42 kB 00:00 2024-09-19T09:27:37.521 INFO:teuthology.orchestra.run.smithi136.stdout:(99/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 196 kB/s | 47 kB 00:00 2024-09-19T09:27:37.526 INFO:teuthology.orchestra.run.smithi171.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-19T09:27:37.546 INFO:teuthology.orchestra.run.smithi136.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 277 kB/s | 58 kB 00:00 2024-09-19T09:27:37.552 INFO:teuthology.orchestra.run.smithi171.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 339 kB/s | 26 kB 00:00 2024-09-19T09:27:37.555 INFO:teuthology.orchestra.run.smithi042.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 887 kB/s | 44 kB 00:00 2024-09-19T09:27:37.571 INFO:teuthology.orchestra.run.smithi136.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-19T09:27:37.594 INFO:teuthology.orchestra.run.smithi171.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-09-19T09:27:37.597 INFO:teuthology.orchestra.run.smithi136.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 843 kB/s | 64 kB 00:00 2024-09-19T09:27:37.611 INFO:teuthology.orchestra.run.smithi171.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-19T09:27:37.622 INFO:teuthology.orchestra.run.smithi136.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 593 kB/s | 45 kB 00:00 2024-09-19T09:27:37.636 INFO:teuthology.orchestra.run.smithi171.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-19T09:27:37.681 INFO:teuthology.orchestra.run.smithi136.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T09:27:37.714 INFO:teuthology.orchestra.run.smithi136.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T09:27:37.720 INFO:teuthology.orchestra.run.smithi171.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 5.1 MB 00:00 2024-09-19T09:27:37.739 INFO:teuthology.orchestra.run.smithi136.stdout:(106/156): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-09-19T09:27:37.745 INFO:teuthology.orchestra.run.smithi171.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-19T09:27:37.765 INFO:teuthology.orchestra.run.smithi136.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-19T09:27:37.798 INFO:teuthology.orchestra.run.smithi042.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-09-19T09:27:37.798 INFO:teuthology.orchestra.run.smithi136.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:27:37.804 INFO:teuthology.orchestra.run.smithi171.stdout:(85/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-09-19T09:27:37.823 INFO:teuthology.orchestra.run.smithi042.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 827 kB/s | 221 kB 00:00 2024-09-19T09:27:37.823 INFO:teuthology.orchestra.run.smithi136.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-19T09:27:37.829 INFO:teuthology.orchestra.run.smithi171.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 505 kB/s | 42 kB 00:00 2024-09-19T09:27:37.840 INFO:teuthology.orchestra.run.smithi042.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 856 kB/s | 36 kB 00:00 2024-09-19T09:27:37.849 INFO:teuthology.orchestra.run.smithi136.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-19T09:27:37.854 INFO:teuthology.orchestra.run.smithi171.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 575 kB/s | 77 kB 00:00 2024-09-19T09:27:37.865 INFO:teuthology.orchestra.run.smithi042.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T09:27:37.874 INFO:teuthology.orchestra.run.smithi136.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-19T09:27:37.880 INFO:teuthology.orchestra.run.smithi171.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-19T09:27:37.899 INFO:teuthology.orchestra.run.smithi042.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-19T09:27:37.905 INFO:teuthology.orchestra.run.smithi171.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 159 kB 00:00 2024-09-19T09:27:37.924 INFO:teuthology.orchestra.run.smithi042.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-19T09:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T09:27:37.931 INFO:teuthology.orchestra.run.smithi171.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-19T09:27:37.949 INFO:teuthology.orchestra.run.smithi042.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T09:27:37.956 INFO:teuthology.orchestra.run.smithi171.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 672 kB/s | 51 kB 00:00 2024-09-19T09:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout:(113/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-19T09:27:37.981 INFO:teuthology.orchestra.run.smithi171.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 709 kB/s | 54 kB 00:00 2024-09-19T09:27:38.000 INFO:teuthology.orchestra.run.smithi042.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-19T09:27:38.000 INFO:teuthology.orchestra.run.smithi136.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-19T09:27:38.023 INFO:teuthology.orchestra.run.smithi171.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 621 kB/s | 42 kB 00:00 2024-09-19T09:27:38.025 INFO:teuthology.orchestra.run.smithi042.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 633 kB/s | 64 kB 00:00 2024-09-19T09:27:38.034 INFO:teuthology.orchestra.run.smithi136.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.0 MB/s | 32 kB 00:00 2024-09-19T09:27:38.049 INFO:teuthology.orchestra.run.smithi171.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 658 kB/s | 44 kB 00:00 2024-09-19T09:27:38.059 INFO:teuthology.orchestra.run.smithi136.stdout:(116/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 471 kB/s | 43 kB 00:00 2024-09-19T09:27:38.084 INFO:teuthology.orchestra.run.smithi136.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-19T09:27:38.092 INFO:teuthology.orchestra.run.smithi042.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-19T09:27:38.099 INFO:teuthology.orchestra.run.smithi171.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-19T09:27:38.118 INFO:teuthology.orchestra.run.smithi136.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-19T09:27:38.125 INFO:teuthology.orchestra.run.smithi171.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 475 kB/s | 36 kB 00:00 2024-09-19T09:27:38.150 INFO:teuthology.orchestra.run.smithi171.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-19T09:27:38.159 INFO:teuthology.orchestra.run.smithi042.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-19T09:27:38.160 INFO:teuthology.orchestra.run.smithi136.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-19T09:27:38.185 INFO:teuthology.orchestra.run.smithi136.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-19T09:27:38.193 INFO:teuthology.orchestra.run.smithi042.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.0 MB/s | 863 kB 00:00 2024-09-19T09:27:38.211 INFO:teuthology.orchestra.run.smithi136.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T09:27:38.226 INFO:teuthology.orchestra.run.smithi042.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.5 MB/s | 308 kB 00:00 2024-09-19T09:27:38.244 INFO:teuthology.orchestra.run.smithi136.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T09:27:38.251 INFO:teuthology.orchestra.run.smithi042.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-19T09:27:38.270 INFO:teuthology.orchestra.run.smithi136.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-19T09:27:38.277 INFO:teuthology.orchestra.run.smithi042.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:27:38.295 INFO:teuthology.orchestra.run.smithi136.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-19T09:27:38.302 INFO:teuthology.orchestra.run.smithi042.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:27:38.321 INFO:teuthology.orchestra.run.smithi136.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-09-19T09:27:38.325 INFO:teuthology.orchestra.run.smithi171.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-09-19T09:27:38.327 INFO:teuthology.orchestra.run.smithi042.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T09:27:38.351 INFO:teuthology.orchestra.run.smithi171.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 288 kB/s | 58 kB 00:00 2024-09-19T09:27:38.376 INFO:teuthology.orchestra.run.smithi171.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-19T09:27:38.387 INFO:teuthology.orchestra.run.smithi136.stdout:(126/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-19T09:27:38.402 INFO:teuthology.orchestra.run.smithi171.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-19T09:27:38.402 INFO:teuthology.orchestra.run.smithi042.stdout:(111/156): postgresql-server-13.16-1.el9.x86_64 2.2 MB/s | 5.8 MB 00:02 2024-09-19T09:27:38.413 INFO:teuthology.orchestra.run.smithi136.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-09-19T09:27:38.427 INFO:teuthology.orchestra.run.smithi171.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 842 kB/s | 64 kB 00:00 2024-09-19T09:27:38.428 INFO:teuthology.orchestra.run.smithi042.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-19T09:27:38.438 INFO:teuthology.orchestra.run.smithi136.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T09:27:38.452 INFO:teuthology.orchestra.run.smithi171.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 593 kB/s | 45 kB 00:00 2024-09-19T09:27:38.463 INFO:teuthology.orchestra.run.smithi136.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:27:38.489 INFO:teuthology.orchestra.run.smithi042.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.6 MB/s | 548 kB 00:00 2024-09-19T09:27:38.489 INFO:teuthology.orchestra.run.smithi136.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:27:38.503 INFO:teuthology.orchestra.run.smithi171.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T09:27:38.512 INFO:teuthology.orchestra.run.smithi042.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:27:38.530 INFO:teuthology.orchestra.run.smithi136.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-09-19T09:27:38.537 INFO:teuthology.orchestra.run.smithi171.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T09:27:38.537 INFO:teuthology.orchestra.run.smithi042.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T09:27:38.561 INFO:teuthology.orchestra.run.smithi171.stdout:(106/156): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-09-19T09:27:38.562 INFO:teuthology.orchestra.run.smithi042.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-19T09:27:38.572 INFO:teuthology.orchestra.run.smithi136.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 690 kB/s | 58 kB 00:00 2024-09-19T09:27:38.587 INFO:teuthology.orchestra.run.smithi171.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-19T09:27:38.596 INFO:teuthology.orchestra.run.smithi042.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.3 MB/s | 839 kB 00:00 2024-09-19T09:27:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-19T09:27:38.620 INFO:teuthology.orchestra.run.smithi171.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:27:38.621 INFO:teuthology.orchestra.run.smithi042.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-19T09:27:38.623 INFO:teuthology.orchestra.run.smithi136.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-19T09:27:38.649 INFO:teuthology.orchestra.run.smithi136.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-19T09:27:38.654 INFO:teuthology.orchestra.run.smithi171.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-19T09:27:38.655 INFO:teuthology.orchestra.run.smithi042.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T09:27:38.665 INFO:teuthology.orchestra.run.smithi136.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-09-19T09:27:38.679 INFO:teuthology.orchestra.run.smithi171.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T09:27:38.680 INFO:teuthology.orchestra.run.smithi042.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T09:27:38.682 INFO:teuthology.orchestra.run.smithi136.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 922 kB/s | 31 kB 00:00 2024-09-19T09:27:38.705 INFO:teuthology.orchestra.run.smithi171.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-19T09:27:38.708 INFO:teuthology.orchestra.run.smithi136.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-19T09:27:38.713 INFO:teuthology.orchestra.run.smithi042.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T09:27:38.733 INFO:teuthology.orchestra.run.smithi136.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T09:27:38.756 INFO:teuthology.orchestra.run.smithi171.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-19T09:27:38.758 INFO:teuthology.orchestra.run.smithi136.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T09:27:38.783 INFO:teuthology.orchestra.run.smithi136.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-19T09:27:38.789 INFO:teuthology.orchestra.run.smithi042.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.9 MB/s | 4.4 MB 00:00 2024-09-19T09:27:38.797 INFO:teuthology.orchestra.run.smithi171.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-19T09:27:38.809 INFO:teuthology.orchestra.run.smithi136.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-19T09:27:38.814 INFO:teuthology.orchestra.run.smithi042.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-09-19T09:27:38.822 INFO:teuthology.orchestra.run.smithi171.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.9 MB/s | 43 kB 00:00 2024-09-19T09:27:38.834 INFO:teuthology.orchestra.run.smithi136.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T09:27:38.839 INFO:teuthology.orchestra.run.smithi042.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-19T09:27:38.839 INFO:teuthology.orchestra.run.smithi171.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T09:27:38.857 INFO:teuthology.orchestra.run.smithi171.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 842 kB/s | 14 kB 00:00 2024-09-19T09:27:38.859 INFO:teuthology.orchestra.run.smithi136.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-19T09:27:38.864 INFO:teuthology.orchestra.run.smithi042.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-19T09:27:38.890 INFO:teuthology.orchestra.run.smithi042.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-19T09:27:38.891 INFO:teuthology.orchestra.run.smithi171.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-19T09:27:38.893 INFO:teuthology.orchestra.run.smithi136.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-19T09:27:38.915 INFO:teuthology.orchestra.run.smithi042.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2024-09-19T09:27:38.916 INFO:teuthology.orchestra.run.smithi171.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.8 MB/s | 172 kB 00:00 2024-09-19T09:27:38.918 INFO:teuthology.orchestra.run.smithi136.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi042.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T09:27:38.950 INFO:teuthology.orchestra.run.smithi171.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.9 MB/s | 358 kB 00:00 2024-09-19T09:27:38.952 INFO:teuthology.orchestra.run.smithi136.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-19T09:27:38.966 INFO:teuthology.orchestra.run.smithi042.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:27:38.975 INFO:teuthology.orchestra.run.smithi171.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T09:27:38.991 INFO:teuthology.orchestra.run.smithi042.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:27:39.000 INFO:teuthology.orchestra.run.smithi171.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T09:27:39.002 INFO:teuthology.orchestra.run.smithi136.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T09:27:39.016 INFO:teuthology.orchestra.run.smithi042.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:27:39.034 INFO:teuthology.orchestra.run.smithi171.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T09:27:39.050 INFO:teuthology.orchestra.run.smithi042.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T09:27:39.075 INFO:teuthology.orchestra.run.smithi042.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-19T09:27:39.093 INFO:teuthology.orchestra.run.smithi171.stdout:(123/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-09-19T09:27:39.094 INFO:teuthology.orchestra.run.smithi136.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 25 MB/s | 2.3 MB 00:00 2024-09-19T09:27:39.101 INFO:teuthology.orchestra.run.smithi042.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T09:27:39.118 INFO:teuthology.orchestra.run.smithi171.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-09-19T09:27:39.126 INFO:teuthology.orchestra.run.smithi042.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T09:27:39.144 INFO:teuthology.orchestra.run.smithi171.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 350 kB/s | 18 kB 00:00 2024-09-19T09:27:39.151 INFO:teuthology.orchestra.run.smithi042.stdout:(136/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-19T09:27:39.169 INFO:teuthology.orchestra.run.smithi171.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-19T09:27:39.170 INFO:teuthology.orchestra.run.smithi136.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-19T09:27:39.185 INFO:teuthology.orchestra.run.smithi042.stdout:(137/156): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-09-19T09:27:39.194 INFO:teuthology.orchestra.run.smithi171.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T09:27:39.210 INFO:teuthology.orchestra.run.smithi042.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:27:39.212 INFO:teuthology.orchestra.run.smithi136.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 986 kB/s | 41 kB 00:00 2024-09-19T09:27:39.220 INFO:teuthology.orchestra.run.smithi171.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-19T09:27:39.235 INFO:teuthology.orchestra.run.smithi042.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T09:27:39.245 INFO:teuthology.orchestra.run.smithi171.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:27:39.252 INFO:teuthology.orchestra.run.smithi042.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T09:27:39.262 INFO:teuthology.orchestra.run.smithi136.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-19T09:27:39.270 INFO:teuthology.orchestra.run.smithi171.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:27:39.277 INFO:teuthology.orchestra.run.smithi042.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-19T09:27:39.296 INFO:teuthology.orchestra.run.smithi171.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:27:39.305 INFO:teuthology.orchestra.run.smithi042.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T09:27:39.321 INFO:teuthology.orchestra.run.smithi136.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-19T09:27:39.328 INFO:teuthology.orchestra.run.smithi042.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T09:27:39.329 INFO:teuthology.orchestra.run.smithi171.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T09:27:39.345 INFO:teuthology.orchestra.run.smithi042.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-19T09:27:39.363 INFO:teuthology.orchestra.run.smithi171.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-19T09:27:39.388 INFO:teuthology.orchestra.run.smithi171.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-19T09:27:39.395 INFO:teuthology.orchestra.run.smithi042.stdout:(145/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.8 MB/s | 2.0 MB 00:00 2024-09-19T09:27:39.396 INFO:teuthology.orchestra.run.smithi136.stdout:(154/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.1 MB/s | 3.2 MB 00:00 2024-09-19T09:27:39.429 INFO:teuthology.orchestra.run.smithi042.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-19T09:27:39.430 INFO:teuthology.orchestra.run.smithi171.stdout:(135/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-09-19T09:27:39.446 INFO:teuthology.orchestra.run.smithi136.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-09-19T09:27:39.454 INFO:teuthology.orchestra.run.smithi042.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-19T09:27:39.455 INFO:teuthology.orchestra.run.smithi171.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2024-09-19T09:27:39.481 INFO:teuthology.orchestra.run.smithi171.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 765 kB/s | 90 kB 00:00 2024-09-19T09:27:39.505 INFO:teuthology.orchestra.run.smithi042.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T09:27:39.506 INFO:teuthology.orchestra.run.smithi171.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-19T09:27:39.532 INFO:teuthology.orchestra.run.smithi171.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T09:27:39.538 INFO:teuthology.orchestra.run.smithi136.stdout:(156/156): librados2-19.1.1-361.g2f599a46.el9.x 5.5 MB/s | 3.4 MB 00:00 2024-09-19T09:27:39.545 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:27:39.545 INFO:teuthology.orchestra.run.smithi136.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-19T09:27:39.557 INFO:teuthology.orchestra.run.smithi171.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T09:27:39.583 INFO:teuthology.orchestra.run.smithi171.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-19T09:27:39.608 INFO:teuthology.orchestra.run.smithi171.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 983 kB/s | 74 kB 00:00 2024-09-19T09:27:39.625 INFO:teuthology.orchestra.run.smithi171.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 5.3 MB/s | 90 kB 00:00 2024-09-19T09:27:39.650 INFO:teuthology.orchestra.run.smithi171.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-19T09:27:39.676 INFO:teuthology.orchestra.run.smithi171.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-19T09:27:39.688 INFO:teuthology.orchestra.run.smithi042.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-19T09:27:39.701 INFO:teuthology.orchestra.run.smithi171.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T09:27:39.726 INFO:teuthology.orchestra.run.smithi171.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-19T09:27:39.777 INFO:teuthology.orchestra.run.smithi171.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T09:27:39.830 INFO:teuthology.orchestra.run.smithi042.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 7.3 MB/s | 2.3 MB 00:00 2024-09-19T09:27:39.889 INFO:teuthology.orchestra.run.smithi042.stdout:(151/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.3 MB/s | 3.2 MB 00:00 2024-09-19T09:27:39.916 INFO:teuthology.orchestra.run.smithi042.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 490 kB/s | 41 kB 00:00 2024-09-19T09:27:39.969 INFO:teuthology.orchestra.run.smithi171.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-19T09:27:39.989 INFO:teuthology.orchestra.run.smithi042.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 6.0 MB/s | 1.8 MB 00:00 2024-09-19T09:27:40.036 INFO:teuthology.orchestra.run.smithi171.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-19T09:27:40.048 INFO:teuthology.orchestra.run.smithi042.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-19T09:27:40.086 INFO:teuthology.orchestra.run.smithi171.stdout:(151/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.8 MB/s | 3.2 MB 00:00 2024-09-19T09:27:40.098 INFO:teuthology.orchestra.run.smithi042.stdout:(155/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.2 MB/s | 249 kB 00:00 2024-09-19T09:27:40.111 INFO:teuthology.orchestra.run.smithi171.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 543 kB/s | 41 kB 00:00 2024-09-19T09:27:40.170 INFO:teuthology.orchestra.run.smithi171.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-19T09:27:40.195 INFO:teuthology.orchestra.run.smithi171.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.2 MB/s | 249 kB 00:00 2024-09-19T09:27:40.206 INFO:teuthology.orchestra.run.smithi042.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-19T09:27:40.212 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:27:40.212 INFO:teuthology.orchestra.run.smithi042.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-19T09:27:40.262 INFO:teuthology.orchestra.run.smithi171.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-19T09:27:40.329 INFO:teuthology.orchestra.run.smithi171.stdout:(156/156): librados2-19.1.1-361.g2f599a46.el9.x 5.4 MB/s | 3.4 MB 00:00 2024-09-19T09:27:40.336 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:27:40.336 INFO:teuthology.orchestra.run.smithi171.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-19T09:27:40.741 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-19T09:27:40.893 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-19T09:27:40.893 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-19T09:27:41.469 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-19T09:27:41.581 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-09-19T09:27:41.640 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-19T09:27:41.640 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-19T09:27:41.733 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-09-19T09:27:41.734 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-09-19T09:27:42.704 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-19T09:27:42.705 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-19T09:27:43.536 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-09-19T09:27:43.537 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-09-19T09:27:43.973 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-19T09:27:43.973 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-19T09:27:48.940 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-19T09:27:49.058 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:27:49.188 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:27:49.359 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:27:49.392 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:27:49.418 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:27:49.818 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:27:49.859 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-09-19T09:27:49.936 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:27:49.958 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:27:50.058 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:27:50.081 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:27:50.087 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:27:50.179 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:27:50.216 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:27:50.253 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:27:50.294 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:27:50.319 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:27:50.364 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:27:50.371 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:27:50.421 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:27:50.450 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:27:50.537 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:27:50.559 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:27:50.623 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:27:50.642 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-19T09:27:50.653 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:27:50.675 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:27:50.702 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:27:50.737 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:27:50.787 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:27:50.822 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:27:50.830 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:27:50.831 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:27:50.880 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:27:50.904 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:27:50.935 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:27:50.964 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:27:50.971 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:27:50.971 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:27:51.093 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:27:51.132 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:27:51.175 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:27:51.311 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:27:51.312 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:27:51.438 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:27:51.443 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:27:51.500 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:27:51.528 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:27:51.563 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:27:51.589 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:27:51.624 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:27:51.627 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:27:51.646 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:27:51.665 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:27:51.691 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:27:51.694 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:27:51.714 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:27:51.740 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:27:51.850 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:27:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:27:51.933 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:27:51.940 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:27:51.945 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:27:51.960 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:27:51.978 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:27:52.021 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:27:52.066 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:27:52.078 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:27:52.085 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:27:52.094 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:27:52.131 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:27:52.157 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:27:52.171 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:27:52.187 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:27:52.208 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:27:52.214 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:27:52.222 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:27:52.247 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:27:52.275 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:27:52.318 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:27:52.351 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:27:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:27:52.383 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:27:52.413 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:27:52.444 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:27:52.480 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:27:52.537 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:27:52.555 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:27:52.591 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:27:52.614 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:27:52.634 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:27:52.663 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:27:52.694 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:27:52.730 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:27:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:27:52.778 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:27:52.815 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:27:52.826 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:27:52.855 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:27:52.860 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:27:52.887 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:27:52.890 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:27:52.963 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:27:52.999 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:27:53.016 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:27:53.048 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:27:53.055 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:27:53.097 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:27:53.130 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:27:53.136 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:27:53.158 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:27:53.235 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:27:53.247 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:27:53.289 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:27:53.320 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:27:53.347 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:27:53.352 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:27:53.383 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:27:53.420 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:27:53.423 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:27:53.458 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:27:53.494 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:27:53.501 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:27:53.530 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:27:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:27:53.572 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:27:53.585 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:27:53.601 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:27:53.629 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:27:53.645 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:27:53.659 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:27:53.661 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:27:53.688 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:27:53.697 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:27:53.740 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:27:53.760 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:27:53.778 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:27:53.817 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:27:53.820 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:27:53.850 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:27:53.870 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:27:53.893 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:27:53.924 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:27:53.970 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:27:53.972 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:27:54.004 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:27:54.029 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:27:54.047 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:27:54.075 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:27:54.084 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:27:54.151 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:27:54.164 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:27:54.206 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:27:54.207 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:27:54.242 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:27:54.287 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:27:54.288 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:27:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:27:54.445 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:27:54.486 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:27:54.491 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:27:54.530 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:27:54.535 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:27:54.566 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:27:54.577 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:27:54.609 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:27:54.647 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:27:54.705 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:27:54.712 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:27:54.762 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:27:54.803 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:27:54.863 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:27:54.904 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:27:54.918 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:27:54.945 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:27:54.973 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:27:54.985 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:27:55.011 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:27:55.036 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:27:55.051 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:27:55.055 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:27:55.087 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:27:55.109 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:27:55.123 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:27:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:27:55.170 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:27:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:27:55.219 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:27:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:27:55.277 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:27:55.299 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:27:55.305 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:27:55.339 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:27:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:27:55.398 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:27:55.410 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:27:55.443 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:27:55.448 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:27:55.469 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:27:55.483 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:27:55.484 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:27:55.516 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:27:55.534 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:27:55.557 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:27:55.591 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:27:55.592 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:27:55.623 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:27:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:27:55.669 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:27:55.678 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:27:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:27:55.711 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:27:55.722 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:27:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:27:55.754 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:27:55.794 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:27:55.823 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:27:55.829 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:27:55.856 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:27:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:27:55.873 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:27:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:27:55.914 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:27:55.915 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:27:55.927 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:27:55.952 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:27:56.026 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:27:56.059 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:27:56.099 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:27:56.141 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:27:56.155 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:27:56.194 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:27:56.223 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:27:56.250 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:27:56.257 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:27:56.296 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:27:56.336 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:27:56.367 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:27:56.401 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:27:56.435 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:27:56.485 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:27:56.519 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:27:56.594 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:27:56.608 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:27:56.639 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:27:56.650 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:27:56.659 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:27:56.685 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:27:56.686 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:27:56.689 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:27:56.714 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:27:56.720 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:27:56.786 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:27:56.818 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:27:56.819 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:27:56.841 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:27:56.867 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:27:56.913 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:27:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:27:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:27:57.000 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:27:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:27:57.056 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:27:57.075 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:27:57.115 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:27:57.146 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:27:57.176 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:27:57.210 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:27:57.242 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:27:57.243 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:27:57.271 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:27:57.294 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:27:57.323 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:27:57.348 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:27:57.413 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:27:57.463 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:27:57.493 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:27:57.571 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:27:57.604 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:27:57.623 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:27:57.653 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:27:57.657 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:27:57.757 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:27:57.813 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:27:57.858 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:27:57.946 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:27:57.986 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:27:57.991 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:27:58.111 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:27:58.172 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:27:58.201 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:27:58.278 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:27:58.428 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:27:58.474 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:27:58.508 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:27:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:27:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:27:58.709 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:27:58.808 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:27:58.852 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:27:58.929 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:27:59.035 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:27:59.044 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:27:59.074 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:27:59.155 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:27:59.337 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:27:59.476 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:27:59.554 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:27:59.587 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:27:59.851 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:27:59.898 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:27:59.942 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:27:59.971 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:28:00.031 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:28:00.064 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:28:00.100 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:28:00.281 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:28:00.394 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:28:00.422 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:28:00.455 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:28:00.589 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:28:00.637 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:28:00.691 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:28:00.722 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:28:00.765 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:28:00.918 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:28:01.010 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:28:01.040 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:28:01.085 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:28:01.325 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:28:01.412 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:28:01.432 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:28:01.456 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:28:01.568 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:28:01.606 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:28:01.677 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:28:01.708 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:28:01.793 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:28:01.836 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:28:01.945 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:28:01.974 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:28:02.016 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:28:02.531 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:28:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:28:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:28:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:28:03.054 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:28:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:28:03.646 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:28:03.681 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:28:03.774 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:28:03.774 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:28:03.774 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:28:03.774 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:03.807 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:28:04.035 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:28:04.072 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:28:04.617 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:28:04.660 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:28:04.761 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:28:04.761 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:28:04.761 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:28:04.761 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:04.796 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:28:05.126 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:28:05.164 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:28:05.772 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:28:05.809 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:28:05.908 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:28:05.908 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:28:05.908 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:28:05.908 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:05.943 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:28:15.621 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:28:15.621 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-09-19T09:28:15.621 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-09-19T09:28:15.621 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-09-19T09:28:15.621 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-09-19T09:28:15.621 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-09-19T09:28:15.621 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /root 2024-09-19T09:28:15.621 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-09-19T09:28:15.621 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:15.802 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:28:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:28:15.819 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:15.819 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:28:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:16.873 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:28:16.873 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-09-19T09:28:16.873 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-09-19T09:28:16.873 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-09-19T09:28:16.873 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-09-19T09:28:16.873 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-09-19T09:28:16.874 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-09-19T09:28:16.874 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-09-19T09:28:16.874 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:17.043 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:28:17.059 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:28:17.059 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:17.059 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:28:17.059 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:17.307 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:28:17.334 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:28:17.334 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:17.334 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:28:17.334 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:28:17.334 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:28:17.335 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:17.558 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:28:17.581 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:28:17.581 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:17.581 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:28:17.581 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:28:17.581 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:28:17.581 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:18.025 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:28:18.048 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:28:18.048 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:18.048 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:28:18.048 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:28:18.048 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:28:18.048 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:18.147 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:28:18.195 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:28:18.250 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:28:18.430 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:28:18.431 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-09-19T09:28:18.431 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-09-19T09:28:18.431 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-09-19T09:28:18.431 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-09-19T09:28:18.431 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-09-19T09:28:18.431 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-09-19T09:28:18.431 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-09-19T09:28:18.431 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:18.435 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:28:18.485 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:28:18.546 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:28:18.562 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:28:18.573 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:28:18.573 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:18.574 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:28:18.574 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:28:18.574 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:28:18.574 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:18.622 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:28:18.640 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:28:18.640 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:18.640 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:28:18.640 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:18.650 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:28:18.781 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:28:18.806 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:28:18.831 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:28:18.831 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:18.831 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:28:18.831 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:28:18.831 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:28:18.831 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:18.835 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:28:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:28:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:28:19.292 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:28:19.316 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:28:19.316 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:19.317 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:28:19.317 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:28:19.317 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:28:19.317 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:19.341 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:28:19.369 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:28:19.400 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:28:19.422 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:28:19.462 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:28:19.479 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:28:19.492 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:28:19.535 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:28:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:28:19.792 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:28:19.864 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:28:19.953 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:28:20.084 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:28:20.129 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:28:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:28:20.175 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:28:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:28:20.203 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:28:20.203 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:20.203 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:28:20.203 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:28:20.203 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:28:20.203 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:28:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:28:20.468 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:20.468 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:28:20.468 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:28:20.468 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:28:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:20.531 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:28:20.560 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:28:20.586 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:28:20.614 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:28:20.646 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:28:20.708 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:28:20.738 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:28:20.926 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:28:20.951 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:28:20.951 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:20.951 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:28:20.951 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:28:20.951 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:28:20.951 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:28:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:28:21.179 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:28:21.376 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:28:21.419 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:28:21.502 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:28:21.519 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:28:21.544 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:28:21.599 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:28:21.645 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:28:21.743 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:28:21.784 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:28:21.799 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:28:21.815 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:28:21.823 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:28:21.834 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:28:21.849 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:28:21.870 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:28:21.871 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:28:21.871 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:21.871 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:28:21.871 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:28:21.871 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:28:21.871 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:21.939 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:28:21.951 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:28:22.052 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:28:22.113 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:28:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:28:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:28:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:28:22.383 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:28:22.408 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:28:22.786 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:28:22.815 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:28:22.918 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:28:23.051 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:28:23.078 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:28:23.083 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:28:23.107 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:28:23.107 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:23.108 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:28:23.108 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:28:23.108 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:28:23.108 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:23.109 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:28:23.134 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:28:23.134 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:23.134 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:28:23.134 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:28:23.135 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:28:23.135 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:23.151 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:28:23.173 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:28:23.174 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:23.174 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:28:23.174 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:23.186 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:28:23.198 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:28:23.218 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:28:23.240 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:28:23.241 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:23.241 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:28:23.241 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:28:23.241 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:28:23.241 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:23.294 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:28:23.342 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:28:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:28:23.544 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:28:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:28:23.567 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:28:23.567 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:23.567 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:28:23.567 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:28:23.567 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:28:23.568 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:24.268 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:28:24.298 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:28:24.322 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:28:24.323 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:24.323 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:28:24.323 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:28:24.323 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:28:24.323 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:24.365 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:28:24.388 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:28:24.388 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:24.389 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:28:24.389 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:24.441 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:28:24.464 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:28:24.465 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:24.465 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:28:24.465 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:28:24.465 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:28:24.465 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:24.576 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:28:24.602 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:28:24.714 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:28:24.783 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:28:24.807 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:28:24.807 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:24.807 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:28:24.807 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:28:24.807 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:28:24.808 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:24.881 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:28:24.904 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:28:24.930 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:28:24.930 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:24.930 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:28:24.931 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:28:24.931 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:28:24.931 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:24.980 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:28:24.993 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:28:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:28:25.164 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:28:26.139 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:28:26.167 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:28:26.191 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:28:26.191 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:26.191 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:28:26.192 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:28:26.192 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:28:26.192 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:28:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:28:26.257 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:26.257 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:28:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:28:26.334 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:28:26.334 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:26.334 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:28:26.334 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:28:26.334 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:28:26.334 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:26.659 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:28:26.685 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:28:26.685 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:28:26.685 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:28:26.685 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:28:26.685 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:28:26.685 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:28.097 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:28:28.147 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:28:28.196 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:28:28.228 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:28:28.256 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:28:28.439 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:28:28.478 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:28:28.508 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:28:28.538 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:28:28.584 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:28:29.182 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:28:29.216 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:28:29.236 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:28:29.364 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:28:29.405 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:28:29.446 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:28:29.478 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:28:29.506 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:28:29.686 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:28:29.729 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:28:29.759 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:28:29.789 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:28:29.836 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:28:30.060 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:28:30.155 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:28:30.196 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:28:30.277 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:28:30.308 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:28:30.333 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:28:30.360 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:28:30.360 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:28:30.502 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:28:30.523 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:28:30.536 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:28:30.561 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:28:30.566 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:28:30.566 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:28:30.755 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:28:30.755 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:28:30.839 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:28:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:28:31.371 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:28:31.469 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:28:31.518 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:28:31.539 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:28:31.580 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:28:31.601 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:28:31.621 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:28:31.632 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:28:31.653 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:28:31.657 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:28:31.680 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:28:31.683 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:28:31.683 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:28:31.759 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:28:31.759 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:28:31.844 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:28:31.869 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:28:31.874 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:28:31.875 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:28:31.892 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:28:31.943 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:28:31.973 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:28:32.003 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:28:32.041 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:28:32.079 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:28:32.079 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:28:32.163 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:28:32.236 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:28:32.687 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:28:32.730 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:28:32.753 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:28:33.776 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:28:33.829 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:28:33.933 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:28:33.963 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:28:33.989 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:28:34.022 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:28:34.023 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:28:34.107 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:28:34.107 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:28:34.174 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:28:34.199 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:28:34.205 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:28:34.205 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:28:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:28:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:28:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:28:34.536 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:28:37.149 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:28:37.149 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:28:37.150 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:28:37.151 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:28:37.152 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:28:37.152 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:28:37.152 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:28:37.169 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:28:37.169 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:28:37.169 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:28:37.169 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:28:37.169 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:28:37.169 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:28:37.169 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:28:37.170 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:28:37.171 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:28:37.172 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:28:37.173 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:28:37.174 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:28:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:28:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:28:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:28:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:28:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:28:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:28:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:28:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:28:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:28:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:28:37.176 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:28:37.176 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:28:37.176 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:28:37.176 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:28:37.176 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:28:37.176 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:28:37.176 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:28:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:28:37.178 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:28:37.178 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:28:37.178 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:28:37.178 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:28:37.178 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:28:37.178 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:28:37.178 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:28:37.178 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:28:37.179 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:28:37.179 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:28:37.179 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:28:37.179 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:28:37.179 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:28:37.179 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:28:37.180 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:28:37.180 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:28:37.180 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:28:37.180 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:28:37.180 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:28:37.181 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:28:37.181 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:28:37.181 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:28:37.181 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:28:37.182 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:28:37.182 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:28:37.182 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:28:37.182 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:28:37.182 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:28:37.182 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:28:37.183 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:28:37.183 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:28:37.183 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:28:38.114 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:28:38.114 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:28:38.114 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:28:38.114 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:28:38.114 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:28:38.115 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:28:38.116 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:28:38.134 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:28:38.134 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:28:38.134 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:28:38.134 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:28:38.135 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:28:38.135 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:28:38.135 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:28:38.135 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:28:38.135 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:28:38.135 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:28:38.135 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:28:38.136 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:28:38.136 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:28:38.136 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:28:38.136 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:28:38.136 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:28:38.136 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:28:38.137 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:28:38.137 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:28:38.137 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:28:38.137 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:28:38.137 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:28:38.137 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:28:38.137 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:28:38.138 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:28:38.139 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:28:38.140 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:28:38.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:28:38.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:28:38.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:28:38.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:28:38.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:28:38.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:28:38.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:28:38.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:28:38.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:28:38.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:28:38.142 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:28:38.142 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:28:38.142 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:28:38.142 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:28:38.142 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:28:38.142 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:28:38.142 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:28:38.143 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:28:38.143 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:28:38.143 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:28:38.143 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:28:38.143 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:28:38.143 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:28:38.144 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:28:38.145 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:28:38.146 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:28:38.147 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:28:38.147 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:28:38.147 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:28:38.147 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:28:38.147 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:28:38.147 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:28:38.147 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:28:38.147 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:28:38.147 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:28:39.894 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:28:39.894 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:39.894 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-09-19T09:28:39.894 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:28:39.895 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:39.896 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:28:39.897 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:28:39.898 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:28:39.899 INFO:teuthology.orchestra.run.smithi136.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:28:39.900 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:28:39.901 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:28:39.902 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:28:39.902 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:28:39.902 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:28:39.902 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:28:39.902 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:28:39.903 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:28:39.904 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:28:39.905 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.906 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:39.907 INFO:teuthology.orchestra.run.smithi136.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:28:39.907 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:28:39.907 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:28:39.907 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:28:39.907 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:28:39.907 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:28:39.907 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:28:39.907 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:28:39.908 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-19T09:28:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:28:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:28:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:28:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:28:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:28:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:28:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:28:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:28:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:28:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:28:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:28:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:28:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:28:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:28:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:28:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:28:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:28:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:28:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:28:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:28:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:28:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:28:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:28:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:28:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:28:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:28:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:28:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:28:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:28:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:28:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:28:40.318 DEBUG:teuthology.parallel:result is None 2024-09-19T09:28:40.701 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:28:40.701 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:40.701 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-09-19T09:28:40.701 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:40.701 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:28:40.702 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:40.703 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:40.704 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:28:40.705 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.706 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:28:40.707 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.708 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:28:40.709 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:28:40.709 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:28:40.709 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:28:40.709 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:28:40.709 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:28:40.710 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:28:40.710 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:28:40.710 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:28:40.710 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:28:40.710 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:28:40.710 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:28:40.710 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:28:40.710 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:28:40.710 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:28:40.711 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:28:40.712 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:28:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:28:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:28:40.715 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:28:40.715 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:28:40.715 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:28:40.715 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:28:40.715 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-09-19T09:28:41.170 DEBUG:teuthology.parallel:result is None 2024-09-19T09:28:42.672 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:28:42.673 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.674 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:42.675 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:28:42.676 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.677 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:28:42.678 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.678 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:28:42.678 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:28:42.678 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:28:42.678 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:28:42.678 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:28:42.678 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:28:42.678 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:28:42.678 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:28:42.679 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:28:42.680 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:28:42.681 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:28:42.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:28:42.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:28:42.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:28:42.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:28:42.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:28:42.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:28:42.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:28:42.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:28:42.682 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.683 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:28:42.684 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:28:42.685 INFO:teuthology.orchestra.run.smithi042.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:28:42.686 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:28:42.686 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:28:42.686 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:28:42.686 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:28:42.686 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-19T09:28:43.061 DEBUG:teuthology.parallel:result is None 2024-09-19T09:28:43.062 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:28:43.218 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:28:43.241 INFO:teuthology.orchestra.run.smithi042.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:28:43.242 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:28:43.242 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:28:43.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:28:43.397 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:28:43.424 INFO:teuthology.orchestra.run.smithi136.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:28:43.425 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:28:43.425 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:28:43.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:28:43.566 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:28:43.593 INFO:teuthology.orchestra.run.smithi171.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:28:43.593 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:28:43.593 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:28:43.595 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T09:28:43.595 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:28:43.595 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:28:43.625 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:28:43.625 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:28:43.658 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:28:43.658 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:28:43.690 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T09:28:43.691 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:28:43.691 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:28:43.719 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:28:43.788 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:28:43.788 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:28:43.818 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:28:43.887 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:28:43.887 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:28:43.918 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:28:43.987 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T09:28:43.987 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:28:43.987 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:28:44.016 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:28:44.084 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:28:44.084 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:28:44.113 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:28:44.181 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:28:44.181 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:28:44.211 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:28:44.281 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T09:28:44.281 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:28:44.281 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:28:44.311 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:28:44.382 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:28:44.382 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:28:44.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:28:44.480 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:28:44.480 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:28:44.510 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:28:44.581 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T09:28:44.684 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2}} 2024-09-19T09:28:44.685 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:28:44.685 INFO:tasks.cephadm:Cluster fsid is 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:44.685 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T09:28:44.685 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.42', 'mon.b': '172.21.15.136', 'mon.c': '172.21.15.171'} 2024-09-19T09:28:44.686 INFO:tasks.cephadm:First mon is mon.a on smithi042 2024-09-19T09:28:44.686 INFO:tasks.cephadm:First mgr is x 2024-09-19T09:28:44.686 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T09:28:44.686 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname $(hostname -s) 2024-09-19T09:28:44.717 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname $(hostname -s) 2024-09-19T09:28:44.747 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname $(hostname -s) 2024-09-19T09:28:44.777 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T09:28:44.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:28:44.919 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T09:28:45.056 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:28:45.058 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T09:28:45.058 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T09:28:45.058 DEBUG:teuthology.orchestra.run.smithi042:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:45.419 INFO:teuthology.orchestra.run.smithi042.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:28 /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:45.420 DEBUG:teuthology.orchestra.run.smithi136:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:45.805 INFO:teuthology.orchestra.run.smithi136.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:28 /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:45.806 DEBUG:teuthology.orchestra.run.smithi171:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:46.193 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:28 /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:46.194 DEBUG:teuthology.orchestra.run.smithi042:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:46.214 DEBUG:teuthology.orchestra.run.smithi136:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:46.234 DEBUG:teuthology.orchestra.run.smithi171:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:46.270 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T09:28:46.270 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:28:46.273 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:28:46.277 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:28:47.813 INFO:teuthology.orchestra.run.smithi171.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:28:47.855 INFO:teuthology.orchestra.run.smithi042.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:28:47.941 INFO:teuthology.orchestra.run.smithi136.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:29:17.126 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-19T09:29:17.127 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:29:17.127 INFO:teuthology.orchestra.run.smithi136.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:29:17.127 INFO:teuthology.orchestra.run.smithi136.stdout: "repo_digests": [ 2024-09-19T09:29:17.127 INFO:teuthology.orchestra.run.smithi136.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:29:17.127 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-09-19T09:29:17.127 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-19T09:29:17.588 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-09-19T09:29:17.588 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:29:17.588 INFO:teuthology.orchestra.run.smithi171.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:29:17.588 INFO:teuthology.orchestra.run.smithi171.stdout: "repo_digests": [ 2024-09-19T09:29:17.589 INFO:teuthology.orchestra.run.smithi171.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:29:17.589 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-09-19T09:29:17.589 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-09-19T09:29:17.770 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:29:17.770 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:29:17.770 INFO:teuthology.orchestra.run.smithi042.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:29:17.770 INFO:teuthology.orchestra.run.smithi042.stdout: "repo_digests": [ 2024-09-19T09:29:17.770 INFO:teuthology.orchestra.run.smithi042.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:29:17.770 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-19T09:29:17.770 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:29:17.799 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph 2024-09-19T09:29:17.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph 2024-09-19T09:29:17.867 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph 2024-09-19T09:29:17.896 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /etc/ceph 2024-09-19T09:29:17.922 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /etc/ceph 2024-09-19T09:29:17.949 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /etc/ceph 2024-09-19T09:29:17.973 INFO:tasks.cephadm:Writing seed config... 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T09:29:17.975 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T09:29:17.976 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T09:29:17.977 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T09:29:17.978 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T09:29:17.978 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T09:29:17.978 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T09:29:17.978 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T09:29:17.978 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T09:29:17.978 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T09:29:17.978 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T09:29:17.978 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T09:29:17.978 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T09:29:17.978 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T09:29:17.979 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:29:17.979 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T09:29:17.995 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 90ecc87a-7669-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T09:29:17.995 DEBUG:teuthology.orchestra.run.smithi042:mon.a> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T09:29:18.037 DEBUG:teuthology.orchestra.run.smithi042:mgr.x> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T09:29:18.079 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T09:29:18.080 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.42 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:29:18.290 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:29:18.291 INFO:teuthology.orchestra.run.smithi042.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '90ecc87a-7669-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.42', '--skip-admin-label'] 2024-09-19T09:29:18.291 INFO:teuthology.orchestra.run.smithi042.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T09:29:18.291 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying podman|docker is present... 2024-09-19T09:29:18.316 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:29:18.316 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying lvm2 is present... 2024-09-19T09:29:18.316 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying time synchronization is in place... 2024-09-19T09:29:18.324 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:29:18.324 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:29:18.330 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:29:18.330 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-19T09:29:18.337 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout enabled 2024-09-19T09:29:18.344 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout active 2024-09-19T09:29:18.344 INFO:teuthology.orchestra.run.smithi042.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:29:18.344 INFO:teuthology.orchestra.run.smithi042.stdout:Repeating the final host check... 2024-09-19T09:29:18.366 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:29:18.366 INFO:teuthology.orchestra.run.smithi042.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T09:29:18.366 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl is present 2024-09-19T09:29:18.366 INFO:teuthology.orchestra.run.smithi042.stdout:lvcreate is present 2024-09-19T09:29:18.373 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:29:18.373 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:29:18.379 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:29:18.379 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-19T09:29:18.386 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout enabled 2024-09-19T09:29:18.393 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout active 2024-09-19T09:29:18.393 INFO:teuthology.orchestra.run.smithi042.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:29:18.393 INFO:teuthology.orchestra.run.smithi042.stdout:Host looks OK 2024-09-19T09:29:18.393 INFO:teuthology.orchestra.run.smithi042.stdout:Cluster fsid: 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:18.393 INFO:teuthology.orchestra.run.smithi042.stdout:Acquiring lock 140573123290112 on /run/cephadm/90ecc87a-7669-11ef-bceb-c7b262605968.lock 2024-09-19T09:29:18.394 INFO:teuthology.orchestra.run.smithi042.stdout:Lock 140573123290112 acquired on /run/cephadm/90ecc87a-7669-11ef-bceb-c7b262605968.lock 2024-09-19T09:29:18.394 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying IP 172.21.15.42 port 3300 ... 2024-09-19T09:29:18.394 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying IP 172.21.15.42 port 6789 ... 2024-09-19T09:29:18.394 INFO:teuthology.orchestra.run.smithi042.stdout:Base mon IP(s) is [172.21.15.42:3300, 172.21.15.42:6789], mon addrv is [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-09-19T09:29:18.398 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.42 metric 100 2024-09-19T09:29:18.398 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.42 metric 100 2024-09-19T09:29:18.400 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T09:29:18.401 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T09:29:18.401 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1753sec hoplimit 64 pref medium 2024-09-19T09:29:18.403 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T09:29:18.403 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T09:29:18.403 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:29:18.403 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T09:29:18.403 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-19T09:29:18.403 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:29:18.404 INFO:teuthology.orchestra.run.smithi042.stdout:Mon IP `172.21.15.42` is in CIDR network `172.21.0.0/20` 2024-09-19T09:29:18.404 INFO:teuthology.orchestra.run.smithi042.stdout:Mon IP `172.21.15.42` is in CIDR network `172.21.0.0/20` 2024-09-19T09:29:18.404 INFO:teuthology.orchestra.run.smithi042.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T09:29:18.405 INFO:teuthology.orchestra.run.smithi042.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T09:29:18.405 INFO:teuthology.orchestra.run.smithi042.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:29:19.123 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T09:29:19.123 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:29:19.123 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T09:29:19.123 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T09:29:19.123 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T09:29:19.123 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T09:29:19.123 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T09:29:20.053 INFO:teuthology.orchestra.run.smithi042.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T09:29:20.053 INFO:teuthology.orchestra.run.smithi042.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T09:29:20.053 INFO:teuthology.orchestra.run.smithi042.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T09:29:24.204 INFO:teuthology.orchestra.run.smithi042.stdout:stat: stdout 167 167 2024-09-19T09:29:24.204 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial keys... 2024-09-19T09:29:33.326 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQD37utm/vMRChAA7P7vuK8u4DJlAfzB9gOxtQ== 2024-09-19T09:29:34.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQD97utmyr8CMxAANHN4v04ww1Nsh30uMtZP+Q== 2024-09-19T09:29:35.508 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQD+7utmfOBcNBAAtVvJoWPR3e9RrbMNktje+g== 2024-09-19T09:29:35.509 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial monmap... 2024-09-19T09:29:36.465 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:29:36.465 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T09:29:36.465 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:36.466 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:29:36.466 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool for a [v2:172.21.15.42:3300,v1:172.21.15.42:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:29:36.466 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = quincy 2024-09-19T09:29:36.466 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: set fsid to 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:36.466 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:29:36.466 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:29:36.466 INFO:teuthology.orchestra.run.smithi042.stdout:Creating mon... 2024-09-19T09:29:37.335 INFO:teuthology.orchestra.run.smithi042.stdout:create mon.a on 2024-09-19T09:29:37.550 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T09:29:37.703 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T09:29:37.892 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-90ecc87a-7669-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-90ecc87a-7669-11ef-bceb-c7b262605968.target. 2024-09-19T09:29:37.892 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-90ecc87a-7669-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-90ecc87a-7669-11ef-bceb-c7b262605968.target. 2024-09-19T09:29:38.150 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:29:38.151 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to reset failed state of unit ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T09:29:38.318 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-90ecc87a-7669-11ef-bceb-c7b262605968.target.wants/ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-90ecc87a-7669-11ef-bceb-c7b262605968@.service. 2024-09-19T09:29:39.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:39 smithi042 ceph-mon[30859]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:29:39.936 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:29:39.936 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-19T09:29:39.943 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:29:39.943 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-19T09:29:39.943 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-19T09:29:39.944 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:29:39.944 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mon to start... 2024-09-19T09:29:39.944 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mon... 2024-09-19T09:29:40.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:39 smithi042 bash[30829]: de60179b2667882d786316b100a9ea57785ede305d53fb0dbf75b0b0d5008b6c 2024-09-19T09:29:40.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:39 smithi042 systemd[1]: Started Ceph mon.a for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:29:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:29:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: monmap epoch 1 2024-09-19T09:29:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: last_changed 2024-09-19T09:29:35.871137+0000 2024-09-19T09:29:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: created 2024-09-19T09:29:35.871137+0000 2024-09-19T09:29:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: min_mon_release 19 (squid) 2024-09-19T09:29:40.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: election_strategy: 1 2024-09-19T09:29:40.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-19T09:29:40.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: fsmap 2024-09-19T09:29:40.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:29:40.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: mgrmap e1: no daemons active 2024-09-19T09:29:40.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:40 smithi042 ceph-mon[30859]: from='client.? 172.21.15.42:0/874924179' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T09:29:41.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T09:29:41.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout id: 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:41.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T09:29:41.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:41.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout services: 2024-09-19T09:29:41.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.974109s) 2024-09-19T09:29:41.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T09:29:41.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T09:29:41.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:41.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout data: 2024-09-19T09:29:41.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T09:29:41.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T09:29:41.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T09:29:41.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T09:29:41.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:41.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.480+0000 7f40591a3640 1 Processor -- start 2024-09-19T09:29:41.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.480+0000 7f40591a3640 1 -- start start 2024-09-19T09:29:41.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.480+0000 7f40591a3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f4054105e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:41.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.480+0000 7f40591a3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4054106430 con 0x7f4054105a60 2024-09-19T09:29:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.481+0000 7f4052d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f4054105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.481+0000 7f4052d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f4054105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39814/0 (socket says 172.21.15.42:39814) 2024-09-19T09:29:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.481+0000 7f4052d9d640 1 -- 172.21.15.42:0/3117343225 learned_addr learned my addr 172.21.15.42:0/3117343225 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.481+0000 7f4052d9d640 1 -- 172.21.15.42:0/3117343225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40541067d0 con 0x7f4054105a60 2024-09-19T09:29:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.483+0000 7f4052d9d640 1 --2- 172.21.15.42:0/3117343225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f4054105e60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4044009820 tx=0x7f404402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2b05fac680f63e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.483+0000 7f4051d9b640 1 -- 172.21.15.42:0/3117343225 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4044037070 con 0x7f4054105a60 2024-09-19T09:29:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.483+0000 7f4051d9b640 1 -- 172.21.15.42:0/3117343225 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4044032440 con 0x7f4054105a60 2024-09-19T09:29:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.483+0000 7f4051d9b640 1 -- 172.21.15.42:0/3117343225 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4044032740 con 0x7f4054105a60 2024-09-19T09:29:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.484+0000 7f40591a3640 1 -- 172.21.15.42:0/3117343225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 msgr2=0x7f4054105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:41.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.484+0000 7f40591a3640 1 --2- 172.21.15.42:0/3117343225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f4054105e60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4044009820 tx=0x7f404402a270 comp rx=0 tx=0).stop 2024-09-19T09:29:41.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.484+0000 7f40591a3640 1 -- 172.21.15.42:0/3117343225 shutdown_connections 2024-09-19T09:29:41.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.484+0000 7f40591a3640 1 --2- 172.21.15.42:0/3117343225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f4054105e60 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:41.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.484+0000 7f40591a3640 1 -- 172.21.15.42:0/3117343225 >> 172.21.15.42:0/3117343225 conn(0x7f40541015f0 msgr2=0x7f4054103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:41.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.484+0000 7f40591a3640 1 -- 172.21.15.42:0/3117343225 shutdown_connections 2024-09-19T09:29:41.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.484+0000 7f40591a3640 1 -- 172.21.15.42:0/3117343225 wait complete. 2024-09-19T09:29:41.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.484+0000 7f40591a3640 1 Processor -- start 2024-09-19T09:29:41.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.485+0000 7f40591a3640 1 -- start start 2024-09-19T09:29:41.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.485+0000 7f40591a3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f405419d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:41.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.485+0000 7f40591a3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4054106b20 con 0x7f4054105a60 2024-09-19T09:29:41.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.485+0000 7f4052d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f405419d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:41.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.485+0000 7f4052d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f405419d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39826/0 (socket says 172.21.15.42:39826) 2024-09-19T09:29:41.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.485+0000 7f4052d9d640 1 -- 172.21.15.42:0/874924179 learned_addr learned my addr 172.21.15.42:0/874924179 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:41.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.485+0000 7f4052d9d640 1 -- 172.21.15.42:0/874924179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405419d670 con 0x7f4054105a60 2024-09-19T09:29:41.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.485+0000 7f4052d9d640 1 --2- 172.21.15.42:0/874924179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f405419d130 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f40440090b0 tx=0x7f40440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:41.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.486+0000 7f403bfff640 1 -- 172.21.15.42:0/874924179 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4044041070 con 0x7f4054105a60 2024-09-19T09:29:41.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.486+0000 7f403bfff640 1 -- 172.21.15.42:0/874924179 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404403c7a0 con 0x7f4054105a60 2024-09-19T09:29:41.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.486+0000 7f40591a3640 1 -- 172.21.15.42:0/874924179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405419d900 con 0x7f4054105a60 2024-09-19T09:29:41.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.486+0000 7f403bfff640 1 -- 172.21.15.42:0/874924179 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4044037040 con 0x7f4054105a60 2024-09-19T09:29:41.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.486+0000 7f40591a3640 1 -- 172.21.15.42:0/874924179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40541a05f0 con 0x7f4054105a60 2024-09-19T09:29:41.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.486+0000 7f403bfff640 1 -- 172.21.15.42:0/874924179 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4044044070 con 0x7f4054105a60 2024-09-19T09:29:41.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.486+0000 7f403bfff640 1 -- 172.21.15.42:0/874924179 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f404403d3f0 con 0x7f4054105a60 2024-09-19T09:29:41.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.487+0000 7f40591a3640 1 -- 172.21.15.42:0/874924179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4054105ee0 con 0x7f4054105a60 2024-09-19T09:29:41.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.489+0000 7f403bfff640 1 -- 172.21.15.42:0/874924179 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4044046450 con 0x7f4054105a60 2024-09-19T09:29:41.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.551+0000 7f40591a3640 1 -- 172.21.15.42:0/874924179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f405402d940 con 0x7f4054105a60 2024-09-19T09:29:41.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.551+0000 7f403bfff640 1 -- 172.21.15.42:0/874924179 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f4044046630 con 0x7f4054105a60 2024-09-19T09:29:41.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.552+0000 7f40591a3640 1 -- 172.21.15.42:0/874924179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 msgr2=0x7f405419d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:41.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.552+0000 7f40591a3640 1 --2- 172.21.15.42:0/874924179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f405419d130 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f40440090b0 tx=0x7f40440046c0 comp rx=0 tx=0).stop 2024-09-19T09:29:41.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.552+0000 7f40591a3640 1 -- 172.21.15.42:0/874924179 shutdown_connections 2024-09-19T09:29:41.093 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.552+0000 7f40591a3640 1 --2- 172.21.15.42:0/874924179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4054105a60 0x7f405419d130 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:41.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.552+0000 7f40591a3640 1 -- 172.21.15.42:0/874924179 >> 172.21.15.42:0/874924179 conn(0x7f40541015f0 msgr2=0x7f40541037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:41.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.552+0000 7f40591a3640 1 -- 172.21.15.42:0/874924179 shutdown_connections 2024-09-19T09:29:41.094 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:40.552+0000 7f40591a3640 1 -- 172.21.15.42:0/874924179 wait complete. 2024-09-19T09:29:41.094 INFO:teuthology.orchestra.run.smithi042.stdout:mon is available 2024-09-19T09:29:41.094 INFO:teuthology.orchestra.run.smithi042.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T09:29:41.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:41 smithi042 ceph-mon[30859]: from='client.? 172.21.15.42:0/3647941925' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:29:41.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:41 smithi042 ceph-mon[30859]: from='client.? 172.21.15.42:0/3647941925' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T09:29:42.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:42.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:29:42.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout fsid = 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:42.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-09-19T09:29:42.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:29:42.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:29:42.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:29:42.026 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.486+0000 7f3a3c05e640 1 Processor -- start 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.486+0000 7f3a3c05e640 1 -- start start 2024-09-19T09:29:42.027 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.486+0000 7f3a3c05e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a34107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.486+0000 7f3a3c05e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34108170 con 0x7f3a341077a0 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.486+0000 7f3a39dfa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a34107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.487+0000 7f3a39dfa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a34107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39830/0 (socket says 172.21.15.42:39830) 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.487+0000 7f3a39dfa640 1 -- 172.21.15.42:0/2972371102 learned_addr learned my addr 172.21.15.42:0/2972371102 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.487+0000 7f3a39dfa640 1 -- 172.21.15.42:0/2972371102 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a341089a0 con 0x7f3a341077a0 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.487+0000 7f3a39dfa640 1 --2- 172.21.15.42:0/2972371102 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a34107ba0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009820 tx=0x7f3a3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8d194dd2bea9c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.488+0000 7f3a38df8640 1 -- 172.21.15.42:0/2972371102 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a30037070 con 0x7f3a341077a0 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.488+0000 7f3a38df8640 1 -- 172.21.15.42:0/2972371102 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a30032440 con 0x7f3a341077a0 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.488+0000 7f3a38df8640 1 -- 172.21.15.42:0/2972371102 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a30032740 con 0x7f3a341077a0 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.488+0000 7f3a3c05e640 1 -- 172.21.15.42:0/2972371102 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 msgr2=0x7f3a34107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.488+0000 7f3a3c05e640 1 --2- 172.21.15.42:0/2972371102 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a34107ba0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009820 tx=0x7f3a3002a270 comp rx=0 tx=0).stop 2024-09-19T09:29:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.488+0000 7f3a3c05e640 1 -- 172.21.15.42:0/2972371102 shutdown_connections 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.488+0000 7f3a3c05e640 1 --2- 172.21.15.42:0/2972371102 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a34107ba0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.488+0000 7f3a3c05e640 1 -- 172.21.15.42:0/2972371102 >> 172.21.15.42:0/2972371102 conn(0x7f3a34102f70 msgr2=0x7f3a34105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.488+0000 7f3a3c05e640 1 -- 172.21.15.42:0/2972371102 shutdown_connections 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.488+0000 7f3a3c05e640 1 -- 172.21.15.42:0/2972371102 wait complete. 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.489+0000 7f3a3c05e640 1 Processor -- start 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.489+0000 7f3a3c05e640 1 -- start start 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.489+0000 7f3a3c05e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a3419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.489+0000 7f3a3c05e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34108ed0 con 0x7f3a341077a0 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.489+0000 7f3a39dfa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a3419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.489+0000 7f3a39dfa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a3419aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39836/0 (socket says 172.21.15.42:39836) 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.489+0000 7f3a39dfa640 1 -- 172.21.15.42:0/3647941925 learned_addr learned my addr 172.21.15.42:0/3647941925 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.489+0000 7f3a39dfa640 1 -- 172.21.15.42:0/3647941925 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3419b430 con 0x7f3a341077a0 2024-09-19T09:29:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.490+0000 7f3a39dfa640 1 --2- 172.21.15.42:0/3647941925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a3419aef0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3a300090b0 tx=0x7f3a300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.490+0000 7f3a2affd640 1 -- 172.21.15.42:0/3647941925 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a30041070 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.490+0000 7f3a2affd640 1 -- 172.21.15.42:0/3647941925 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a3003c7a0 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.490+0000 7f3a3c05e640 1 -- 172.21.15.42:0/3647941925 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3419b6c0 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.490+0000 7f3a2affd640 1 -- 172.21.15.42:0/3647941925 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a30037040 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.490+0000 7f3a3c05e640 1 -- 172.21.15.42:0/3647941925 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3419e3b0 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.490+0000 7f3a2affd640 1 -- 172.21.15.42:0/3647941925 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a30044070 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.490+0000 7f3a2affd640 1 -- 172.21.15.42:0/3647941925 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3a3003d3f0 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.491+0000 7f3a3c05e640 1 -- 172.21.15.42:0/3647941925 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a34109520 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.493+0000 7f3a2affd640 1 -- 172.21.15.42:0/3647941925 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3a30046450 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.553+0000 7f3a3c05e640 1 -- 172.21.15.42:0/3647941925 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3a3419fa80 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.556+0000 7f3a2affd640 1 -- 172.21.15.42:0/3647941925 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f3a30046630 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.557+0000 7f3a2affd640 1 -- 172.21.15.42:0/3647941925 <== mon.0 v2:172.21.15.42:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a30056070 con 0x7f3a341077a0 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.557+0000 7f3a3c05e640 1 -- 172.21.15.42:0/3647941925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 msgr2=0x7f3a3419aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.557+0000 7f3a3c05e640 1 --2- 172.21.15.42:0/3647941925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a3419aef0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3a300090b0 tx=0x7f3a300046c0 comp rx=0 tx=0).stop 2024-09-19T09:29:42.030 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.557+0000 7f3a3c05e640 1 -- 172.21.15.42:0/3647941925 shutdown_connections 2024-09-19T09:29:42.031 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.557+0000 7f3a3c05e640 1 --2- 172.21.15.42:0/3647941925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a341077a0 0x7f3a3419aef0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:42.031 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.557+0000 7f3a3c05e640 1 -- 172.21.15.42:0/3647941925 >> 172.21.15.42:0/3647941925 conn(0x7f3a34102f70 msgr2=0x7f3a3418f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:42.031 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.558+0000 7f3a3c05e640 1 -- 172.21.15.42:0/3647941925 shutdown_connections 2024-09-19T09:29:42.031 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:41.558+0000 7f3a3c05e640 1 -- 172.21.15.42:0/3647941925 wait complete. 2024-09-19T09:29:42.031 INFO:teuthology.orchestra.run.smithi042.stdout:Generating new minimal ceph.conf... 2024-09-19T09:29:42.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:42 smithi042 ceph-mon[30859]: from='client.? 172.21.15.42:0/3597288909' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:43.046 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.380+0000 7f9ff9edc640 1 Processor -- start 2024-09-19T09:29:43.046 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.380+0000 7f9ff9edc640 1 -- start start 2024-09-19T09:29:43.046 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.381+0000 7f9ff9edc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff410a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:43.046 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.381+0000 7f9ff9edc640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff407be30 con 0x7f9ff4108140 2024-09-19T09:29:43.046 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.381+0000 7f9ff37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff410a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.381+0000 7f9ff37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff410a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39838/0 (socket says 172.21.15.42:39838) 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.381+0000 7f9ff37fe640 1 -- 172.21.15.42:0/2313412776 learned_addr learned my addr 172.21.15.42:0/2313412776 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.381+0000 7f9ff37fe640 1 -- 172.21.15.42:0/2313412776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff410aa70 con 0x7f9ff4108140 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.382+0000 7f9ff37fe640 1 --2- 172.21.15.42:0/2313412776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff410a530 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009820 tx=0x7f9fe402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6941175abbc5c3de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.382+0000 7f9ff27fc640 1 -- 172.21.15.42:0/2313412776 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe4037070 con 0x7f9ff4108140 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.382+0000 7f9ff27fc640 1 -- 172.21.15.42:0/2313412776 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fe4032900 con 0x7f9ff4108140 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.382+0000 7f9ff27fc640 1 -- 172.21.15.42:0/2313412776 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe4030850 con 0x7f9ff4108140 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.382+0000 7f9ff9edc640 1 -- 172.21.15.42:0/2313412776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 msgr2=0x7f9ff410a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.382+0000 7f9ff9edc640 1 --2- 172.21.15.42:0/2313412776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff410a530 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009820 tx=0x7f9fe402a270 comp rx=0 tx=0).stop 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.383+0000 7f9ff9edc640 1 -- 172.21.15.42:0/2313412776 shutdown_connections 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.383+0000 7f9ff9edc640 1 --2- 172.21.15.42:0/2313412776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff410a530 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.383+0000 7f9ff9edc640 1 -- 172.21.15.42:0/2313412776 >> 172.21.15.42:0/2313412776 conn(0x7f9ff4101e20 msgr2=0x7f9ff4104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.383+0000 7f9ff9edc640 1 -- 172.21.15.42:0/2313412776 shutdown_connections 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.383+0000 7f9ff9edc640 1 -- 172.21.15.42:0/2313412776 wait complete. 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.383+0000 7f9ff9edc640 1 Processor -- start 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.383+0000 7f9ff9edc640 1 -- start start 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff9edc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff419d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff9edc640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff410bb10 con 0x7f9ff4108140 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff419d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff419d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39852/0 (socket says 172.21.15.42:39852) 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff37fe640 1 -- 172.21.15.42:0/3597288909 learned_addr learned my addr 172.21.15.42:0/3597288909 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff37fe640 1 -- 172.21.15.42:0/3597288909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff419de00 con 0x7f9ff4108140 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff37fe640 1 --2- 172.21.15.42:0/3597288909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff419d8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40097f0 tx=0x7f9fe4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff0ff9640 1 -- 172.21.15.42:0/3597288909 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe4037040 con 0x7f9ff4108140 2024-09-19T09:29:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff0ff9640 1 -- 172.21.15.42:0/3597288909 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fe4040070 con 0x7f9ff4108140 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff9edc640 1 -- 172.21.15.42:0/3597288909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff419e090 con 0x7f9ff4108140 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff0ff9640 1 -- 172.21.15.42:0/3597288909 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe403a390 con 0x7f9ff4108140 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.384+0000 7f9ff9edc640 1 -- 172.21.15.42:0/3597288909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff41a0d80 con 0x7f9ff4108140 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.385+0000 7f9ff0ff9640 1 -- 172.21.15.42:0/3597288909 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9fe403a5e0 con 0x7f9ff4108140 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.385+0000 7f9ff0ff9640 1 -- 172.21.15.42:0/3597288909 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9fe4045950 con 0x7f9ff4108140 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.385+0000 7f9ff9edc640 1 -- 172.21.15.42:0/3597288909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff41085a0 con 0x7f9ff4108140 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.388+0000 7f9ff0ff9640 1 -- 172.21.15.42:0/3597288909 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9fe4045460 con 0x7f9ff4108140 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.447+0000 7f9ff9edc640 1 -- 172.21.15.42:0/3597288909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f9ff41a0f50 con 0x7f9ff4108140 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.447+0000 7f9ff0ff9640 1 -- 172.21.15.42:0/3597288909 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f9fe403b430 con 0x7f9ff4108140 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.448+0000 7f9ff9edc640 1 -- 172.21.15.42:0/3597288909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 msgr2=0x7f9ff419d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.448+0000 7f9ff9edc640 1 --2- 172.21.15.42:0/3597288909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff419d8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40097f0 tx=0x7f9fe4030d80 comp rx=0 tx=0).stop 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.448+0000 7f9ff9edc640 1 -- 172.21.15.42:0/3597288909 shutdown_connections 2024-09-19T09:29:43.049 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.448+0000 7f9ff9edc640 1 --2- 172.21.15.42:0/3597288909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ff4108140 0x7f9ff419d8c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:43.050 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.448+0000 7f9ff9edc640 1 -- 172.21.15.42:0/3597288909 >> 172.21.15.42:0/3597288909 conn(0x7f9ff4101e20 msgr2=0x7f9ff4102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:43.050 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.448+0000 7f9ff9edc640 1 -- 172.21.15.42:0/3597288909 shutdown_connections 2024-09-19T09:29:43.050 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:42.448+0000 7f9ff9edc640 1 -- 172.21.15.42:0/3597288909 wait complete. 2024-09-19T09:29:43.050 INFO:teuthology.orchestra.run.smithi042.stdout:Restarting the monitor... 2024-09-19T09:29:43.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:43 smithi042 systemd[1]: Stopping Ceph mon.a for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:29:43.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:43 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a[30852]: 2024-09-19T09:29:43.316+0000 7f8213ddd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:29:43.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:43 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a[30852]: 2024-09-19T09:29:43.316+0000 7f8213ddd640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T09:29:43.700 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:43 smithi042 podman[31104]: 2024-09-19 09:29:43.439749297 +0000 UTC m=+0.223159466 container died de60179b2667882d786316b100a9ea57785ede305d53fb0dbf75b0b0d5008b6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:29:43.700 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:43 smithi042 podman[31104]: 2024-09-19 09:29:43.699667138 +0000 UTC m=+0.483077303 container cleanup de60179b2667882d786316b100a9ea57785ede305d53fb0dbf75b0b0d5008b6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:29:43.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:43 smithi042 bash[31104]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:29:44.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:43 smithi042 podman[31118]: 2024-09-19 09:29:43.975727685 +0000 UTC m=+0.528768844 container remove de60179b2667882d786316b100a9ea57785ede305d53fb0dbf75b0b0d5008b6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T09:29:44.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 systemd[1]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T09:29:44.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 systemd[1]: Stopped Ceph mon.a for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:29:44.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 systemd[1]: Starting Ceph mon.a for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:29:44.689 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 podman[31205]: 2024-09-19 09:29:44.246425383 +0000 UTC m=+0.016605726 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:29:44.689 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 podman[31205]: 2024-09-19 09:29:44.568525409 +0000 UTC m=+0.338705808 container create 40a0eaaef04c925594f01910871152f30e217cc188c9e7db7f4ac56bdbc33397 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:29:44.901 INFO:teuthology.orchestra.run.smithi042.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T09:29:44.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 podman[31205]: 2024-09-19 09:29:44.812253749 +0000 UTC m=+0.582434092 container init 40a0eaaef04c925594f01910871152f30e217cc188c9e7db7f4ac56bdbc33397 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:29:44.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 podman[31205]: 2024-09-19 09:29:44.815803805 +0000 UTC m=+0.585984128 container start 40a0eaaef04c925594f01910871152f30e217cc188c9e7db7f4ac56bdbc33397 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:29:44.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: pidfile_write: ignore empty --pid-file 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: load: jerasure load: lrc 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Git sha 0 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: DB SUMMARY 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: DB Session ID: DW3DF14XGYKMSQN1OWMJ 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106216 ; 2024-09-19T09:29:44.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:29:44.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:29:44.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:29:44.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:29:44.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:29:44.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:29:44.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.env: 0x5567244b0940 2024-09-19T09:29:44.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:29:44.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.info_log: 0x5567261f16e0 2024-09-19T09:29:44.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:29:44.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.statistics: (nil) 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.use_fsync: 0 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:29:44.958 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.db_log_dir: 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.wal_dir: 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.write_buffer_manager: 0x556726200dc0 2024-09-19T09:29:44.959 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.unordered_write: 0 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:29:44.960 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.row_cache: None 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.wal_filter: None 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.wal_compression: 0 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:29:44.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:29:44.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:29:44.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:29:44.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:29:44.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_open_files: -1 2024-09-19T09:29:44.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:29:44.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:29:44.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:29:44.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:29:44.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:29:44.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Compression algorithms supported: 2024-09-19T09:29:44.963 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: kZSTD supported: 0 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:29:44.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.merge_operator: 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_filter: None 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5567261f1320) 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_type: 0 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout: data_block_index_type: 0 2024-09-19T09:29:44.965 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_shortening: 1 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: checksum: 4 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: no_block_cache: 0 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache: 0x5567261e51f0 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_options: 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: capacity : 536870912 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: num_shard_bits : 4 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: strict_capacity_limit : 0 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_compressed: (nil) 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: persistent_cache: (nil) 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_size: 4096 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_size_deviation: 10 2024-09-19T09:29:44.966 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_restart_interval: 16 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_block_restart_interval: 1 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: metadata_block_size: 4096 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: partition_filters: 0 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: use_delta_encoding: 1 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: filter_policy: bloomfilter 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: whole_key_filtering: 1 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: verify_compression: 0 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: format_version: 5 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: enable_index_compression: 1 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_align: 0 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: max_auto_readahead_size: 262144 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: prepopulate_block_cache: 0 2024-09-19T09:29:44.967 INFO:journalctl@ceph.mon.a.smithi042.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compression: NoCompression 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.num_levels: 7 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:29:44.968 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:29:44.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:29:44.970 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:29:44.971 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:29:44.972 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.ttl: 2592000 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:29:44.973 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2c6dfac0-7f02-4ffd-a953-90ee61471a81 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738184844513, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738184845785, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101172, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 332, "table_properties": {"data_size": 99057, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14538, "raw_average_key_size": 49, "raw_value_size": 91213, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 291, "num_filter_entries": 291, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726738184, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2c6dfac0-7f02-4ffd-a953-90ee61471a81", "db_session_id": "DW3DF14XGYKMSQN1OWMJ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738184845896, "job": 1, "event": "recovery_finished"} 2024-09-19T09:29:44.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556726212e00 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: DB pointer 0x55672630e000 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** DB Stats ** 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:29:44.975 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** Compaction Stats [default] ** 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: L0 2/0 100.66 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 113.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: Sum 2/0 100.66 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 113.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 113.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** Compaction Stats [default] ** 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:29:44.976 INFO:journalctl@ceph.mon.a.smithi042.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 113.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative compaction: 0.00 GB write, 25.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval compaction: 0.00 GB write, 25.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: Block cache BinnedLRUCache@0x5567261e51f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T09:29:44.977 INFO:journalctl@ceph.mon.a.smithi042.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: starting mon.a rank 0 at public addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] at bind addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: mon.a@-1(???) e1 preinit fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: mon.a@-1(???).mds e1 new map 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: mon.a@-1(???).mds e1 print_map 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout: e1 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout: btime 2024-09-19T09:29:39:578853+0000 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout: legacy client fscid: -1 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout: No filesystems configured 2024-09-19T09:29:44.978 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 bash[31205]: 40a0eaaef04c925594f01910871152f30e217cc188c9e7db7f4ac56bdbc33397 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 systemd[1]: Started Ceph mon.a for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: monmap epoch 1 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: last_changed 2024-09-19T09:29:35.871137+0000 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: created 2024-09-19T09:29:35.871137+0000 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: min_mon_release 19 (squid) 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: election_strategy: 1 2024-09-19T09:29:44.979 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-19T09:29:44.980 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: fsmap 2024-09-19T09:29:44.980 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:29:44.980 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:44 smithi042 ceph-mon[31223]: mgrmap e1: no daemons active 2024-09-19T09:29:45.993 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.374+0000 7fc041146640 1 Processor -- start 2024-09-19T09:29:45.993 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.374+0000 7fc041146640 1 -- start start 2024-09-19T09:29:45.993 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.374+0000 7fc041146640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c1069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:45.994 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.374+0000 7fc041146640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c106fa0 con 0x7fc03c1065d0 2024-09-19T09:29:45.994 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.375+0000 7fc03ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c1069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:45.994 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.375+0000 7fc03ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c1069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39854/0 (socket says 172.21.15.42:39854) 2024-09-19T09:29:45.994 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.375+0000 7fc03ad9d640 1 -- 172.21.15.42:0/682232401 learned_addr learned my addr 172.21.15.42:0/682232401 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:45.994 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.375+0000 7fc03ad9d640 1 -- 172.21.15.42:0/682232401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c1077d0 con 0x7fc03c1065d0 2024-09-19T09:29:45.994 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.377+0000 7fc03ad9d640 1 --2- 172.21.15.42:0/682232401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c1069d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc02c009e80 tx=0x7fc02c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc1fad2696ffc50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:45.994 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.378+0000 7fc039d9b640 1 -- 172.21.15.42:0/682232401 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc02c036070 con 0x7fc03c1065d0 2024-09-19T09:29:45.994 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.378+0000 7fc039d9b640 1 -- 172.21.15.42:0/682232401 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc02c0318c0 con 0x7fc03c1065d0 2024-09-19T09:29:45.995 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.378+0000 7fc039d9b640 1 -- 172.21.15.42:0/682232401 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc02c007ab0 con 0x7fc03c1065d0 2024-09-19T09:29:45.995 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.378+0000 7fc041146640 1 -- 172.21.15.42:0/682232401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 msgr2=0x7fc03c1069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:45.995 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.378+0000 7fc041146640 1 --2- 172.21.15.42:0/682232401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c1069d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc02c009e80 tx=0x7fc02c02a7a0 comp rx=0 tx=0).stop 2024-09-19T09:29:45.995 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.378+0000 7fc041146640 1 -- 172.21.15.42:0/682232401 shutdown_connections 2024-09-19T09:29:45.995 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.378+0000 7fc041146640 1 --2- 172.21.15.42:0/682232401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c1069d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:45.995 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.378+0000 7fc041146640 1 -- 172.21.15.42:0/682232401 >> 172.21.15.42:0/682232401 conn(0x7fc03c101e20 msgr2=0x7fc03c104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.378+0000 7fc041146640 1 -- 172.21.15.42:0/682232401 shutdown_connections 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.378+0000 7fc041146640 1 -- 172.21.15.42:0/682232401 wait complete. 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.379+0000 7fc041146640 1 Processor -- start 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.379+0000 7fc041146640 1 -- start start 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.379+0000 7fc041146640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c191800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.379+0000 7fc041146640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c10ab80 con 0x7fc03c1065d0 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.380+0000 7fc03ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c191800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.380+0000 7fc03ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c191800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39862/0 (socket says 172.21.15.42:39862) 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.380+0000 7fc03ad9d640 1 -- 172.21.15.42:0/1413657283 learned_addr learned my addr 172.21.15.42:0/1413657283 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.380+0000 7fc03ad9d640 1 -- 172.21.15.42:0/1413657283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c191d40 con 0x7fc03c1065d0 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.380+0000 7fc03ad9d640 1 --2- 172.21.15.42:0/1413657283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c191800 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc02c02ad90 tx=0x7fc02c031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:45.996 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.380+0000 7fc023fff640 1 -- 172.21.15.42:0/1413657283 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc02c036050 con 0x7fc03c1065d0 2024-09-19T09:29:45.997 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.380+0000 7fc023fff640 1 -- 172.21.15.42:0/1413657283 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc02c042070 con 0x7fc03c1065d0 2024-09-19T09:29:45.997 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.380+0000 7fc023fff640 1 -- 172.21.15.42:0/1413657283 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc02c03d7e0 con 0x7fc03c1065d0 2024-09-19T09:29:45.997 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.380+0000 7fc041146640 1 -- 172.21.15.42:0/1413657283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03c18ff30 con 0x7fc03c1065d0 2024-09-19T09:29:45.997 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.380+0000 7fc041146640 1 -- 172.21.15.42:0/1413657283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03c190470 con 0x7fc03c1065d0 2024-09-19T09:29:45.997 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.381+0000 7fc023fff640 1 -- 172.21.15.42:0/1413657283 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc02c03dae0 con 0x7fc03c1065d0 2024-09-19T09:29:45.997 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.381+0000 7fc023fff640 1 -- 172.21.15.42:0/1413657283 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc02c007e00 con 0x7fc03c1065d0 2024-09-19T09:29:45.997 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.382+0000 7fc041146640 1 -- 172.21.15.42:0/1413657283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03c10ad00 con 0x7fc03c1065d0 2024-09-19T09:29:45.997 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.384+0000 7fc023fff640 1 -- 172.21.15.42:0/1413657283 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc02c0072f0 con 0x7fc03c1065d0 2024-09-19T09:29:45.997 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.443+0000 7fc041146640 1 -- 172.21.15.42:0/1413657283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fc03c106a50 con 0x7fc03c1065d0 2024-09-19T09:29:45.998 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.445+0000 7fc023fff640 1 -- 172.21.15.42:0/1413657283 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fc02c047460 con 0x7fc03c1065d0 2024-09-19T09:29:45.998 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.445+0000 7fc041146640 1 -- 172.21.15.42:0/1413657283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 msgr2=0x7fc03c191800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:45.998 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.445+0000 7fc041146640 1 --2- 172.21.15.42:0/1413657283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c191800 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc02c02ad90 tx=0x7fc02c031ca0 comp rx=0 tx=0).stop 2024-09-19T09:29:45.998 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.446+0000 7fc041146640 1 -- 172.21.15.42:0/1413657283 shutdown_connections 2024-09-19T09:29:45.998 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.446+0000 7fc041146640 1 --2- 172.21.15.42:0/1413657283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc03c1065d0 0x7fc03c191800 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:45.998 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.446+0000 7fc041146640 1 -- 172.21.15.42:0/1413657283 >> 172.21.15.42:0/1413657283 conn(0x7fc03c101e20 msgr2=0x7fc03c102d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:45.998 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.446+0000 7fc041146640 1 -- 172.21.15.42:0/1413657283 shutdown_connections 2024-09-19T09:29:45.998 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:45.446+0000 7fc041146640 1 -- 172.21.15.42:0/1413657283 wait complete. 2024-09-19T09:29:45.998 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T09:29:46.019 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:29:46.019 INFO:teuthology.orchestra.run.smithi042.stdout:Creating mgr... 2024-09-19T09:29:46.020 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T09:29:46.020 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T09:29:46.278 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:29:46.278 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to reset failed state of unit ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T09:29:46.433 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-90ecc87a-7669-11ef-bceb-c7b262605968.target.wants/ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-90ecc87a-7669-11ef-bceb-c7b262605968@.service. 2024-09-19T09:29:46.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:46 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1413657283' entity='client.admin' 2024-09-19T09:29:46.704 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:46 smithi042 podman[31429]: 2024-09-19 09:29:46.679697212 +0000 UTC m=+0.119691491 container create 9fce6cbb9abf6dea84ceaab0ee276dd37a933a276975c9cd0d4573649691134e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:29:47.005 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:29:47.005 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-19T09:29:47.013 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:29:47.013 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-19T09:29:47.013 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-19T09:29:47.013 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:29:47.022 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:29:47.022 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-19T09:29:47.029 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:29:47.029 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-19T09:29:47.030 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-19T09:29:47.030 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T09:29:47.030 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr to start... 2024-09-19T09:29:47.030 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr... 2024-09-19T09:29:47.056 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:46 smithi042 podman[31429]: 2024-09-19 09:29:46.924026177 +0000 UTC m=+0.364020427 container init 9fce6cbb9abf6dea84ceaab0ee276dd37a933a276975c9cd0d4573649691134e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T09:29:47.057 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:46 smithi042 podman[31429]: 2024-09-19 09:29:46.926888855 +0000 UTC m=+0.366883091 container start 9fce6cbb9abf6dea84ceaab0ee276dd37a933a276975c9cd0d4573649691134e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:29:47.057 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:46 smithi042 bash[31429]: 9fce6cbb9abf6dea84ceaab0ee276dd37a933a276975c9cd0d4573649691134e 2024-09-19T09:29:47.057 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:46 smithi042 systemd[1]: Started Ceph mgr.x for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:29:47.345 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:47 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:47.055+0000 7fa8adedb040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:29:47.345 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:47 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:47.114+0000 7fa8adedb040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:29:47.345 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:47 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:47.274+0000 7fa8adedb040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:29:47.659 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:47 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2929225631' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:29:47.659 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:47 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:47.344+0000 7fa8adedb040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:29:47.660 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:47 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:47.503+0000 7fa8adedb040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:29:47.660 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:47 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:47.658+0000 7fa8adedb040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:29:48.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:48.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:29:48.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:29:48.104 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:29:48.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:29:48.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:29:48.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:29:48.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:48.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:29:48.105 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:29:48.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:29:48.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:29:48.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:29:48.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:29:48.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:29:48.106 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T09:29:48.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:29:48.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:48.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:29:48.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:29:48.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:48.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:29:48.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:48.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:29:48.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:29:48.107 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:29:48.108 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:29:48.108 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:29:48.108 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:29:48.108 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:48.108 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:29:48.108 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:29:48.108 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:29:48.108 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:29:39:578853+0000", 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:29:48.109 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:29:39.579495+0000", 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:29:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:48.111 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:29:48.111 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:29:48.111 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.423+0000 7fd6b194d640 1 Processor -- start 2024-09-19T09:29:48.111 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.423+0000 7fd6b194d640 1 -- start start 2024-09-19T09:29:48.111 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.423+0000 7fd6b194d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac107b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:48.111 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.423+0000 7fd6b194d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac108150 con 0x7fd6ac107780 2024-09-19T09:29:48.111 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.424+0000 7fd6aaffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac107b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:48.111 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.424+0000 7fd6aaffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac107b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39890/0 (socket says 172.21.15.42:39890) 2024-09-19T09:29:48.111 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.424+0000 7fd6aaffd640 1 -- 172.21.15.42:0/2239405739 learned_addr learned my addr 172.21.15.42:0/2239405739 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:48.112 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.424+0000 7fd6aaffd640 1 -- 172.21.15.42:0/2239405739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ac108980 con 0x7fd6ac107780 2024-09-19T09:29:48.112 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.425+0000 7fd6aaffd640 1 --2- 172.21.15.42:0/2239405739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac107b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009820 tx=0x7fd69c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54e835815ebcd32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:48.112 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.425+0000 7fd6aa7fc640 1 -- 172.21.15.42:0/2239405739 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd69c037070 con 0x7fd6ac107780 2024-09-19T09:29:48.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.425+0000 7fd6aa7fc640 1 -- 172.21.15.42:0/2239405739 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd69c032900 con 0x7fd6ac107780 2024-09-19T09:29:48.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.425+0000 7fd6aa7fc640 1 -- 172.21.15.42:0/2239405739 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd69c030850 con 0x7fd6ac107780 2024-09-19T09:29:48.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.426+0000 7fd6b194d640 1 -- 172.21.15.42:0/2239405739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 msgr2=0x7fd6ac107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:48.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.426+0000 7fd6b194d640 1 --2- 172.21.15.42:0/2239405739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac107b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009820 tx=0x7fd69c02a270 comp rx=0 tx=0).stop 2024-09-19T09:29:48.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.426+0000 7fd6b194d640 1 -- 172.21.15.42:0/2239405739 shutdown_connections 2024-09-19T09:29:48.113 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.426+0000 7fd6b194d640 1 --2- 172.21.15.42:0/2239405739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac107b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:48.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.426+0000 7fd6b194d640 1 -- 172.21.15.42:0/2239405739 >> 172.21.15.42:0/2239405739 conn(0x7fd6ac102f30 msgr2=0x7fd6ac105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:48.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.426+0000 7fd6b194d640 1 -- 172.21.15.42:0/2239405739 shutdown_connections 2024-09-19T09:29:48.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.426+0000 7fd6b194d640 1 -- 172.21.15.42:0/2239405739 wait complete. 2024-09-19T09:29:48.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.426+0000 7fd6b194d640 1 Processor -- start 2024-09-19T09:29:48.114 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.426+0000 7fd6b194d640 1 -- start start 2024-09-19T09:29:48.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.427+0000 7fd6b194d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:48.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.427+0000 7fd6b194d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac10bd30 con 0x7fd6ac107780 2024-09-19T09:29:48.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.427+0000 7fd6aaffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:48.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.427+0000 7fd6aaffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac19b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39904/0 (socket says 172.21.15.42:39904) 2024-09-19T09:29:48.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.427+0000 7fd6aaffd640 1 -- 172.21.15.42:0/2929225631 learned_addr learned my addr 172.21.15.42:0/2929225631 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:48.115 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.427+0000 7fd6aaffd640 1 -- 172.21.15.42:0/2929225631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ac19bc50 con 0x7fd6ac107780 2024-09-19T09:29:48.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.427+0000 7fd6aaffd640 1 --2- 172.21.15.42:0/2929225631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac19b710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009940 tx=0x7fd69c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:48.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.427+0000 7fd6b094b640 1 -- 172.21.15.42:0/2929225631 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd69c042070 con 0x7fd6ac107780 2024-09-19T09:29:48.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.427+0000 7fd6b194d640 1 -- 172.21.15.42:0/2929225631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ac19bee0 con 0x7fd6ac107780 2024-09-19T09:29:48.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.427+0000 7fd6b094b640 1 -- 172.21.15.42:0/2929225631 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd69c0308c0 con 0x7fd6ac107780 2024-09-19T09:29:48.116 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.428+0000 7fd6b094b640 1 -- 172.21.15.42:0/2929225631 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd69c037040 con 0x7fd6ac107780 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.428+0000 7fd6b194d640 1 -- 172.21.15.42:0/2929225631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ac19ebd0 con 0x7fd6ac107780 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.428+0000 7fd6b094b640 1 -- 172.21.15.42:0/2929225631 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd69c045070 con 0x7fd6ac107780 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.428+0000 7fd6b094b640 1 -- 172.21.15.42:0/2929225631 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd69c047b70 con 0x7fd6ac107780 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.428+0000 7fd6b194d640 1 -- 172.21.15.42:0/2929225631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6ac107c00 con 0x7fd6ac107780 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.431+0000 7fd6b094b640 1 -- 172.21.15.42:0/2929225631 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd69c0327b0 con 0x7fd6ac107780 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.493+0000 7fd6b194d640 1 -- 172.21.15.42:0/2929225631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd6ac19f140 con 0x7fd6ac107780 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.493+0000 7fd6b094b640 1 -- 172.21.15.42:0/2929225631 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fd69c03c760 con 0x7fd6ac107780 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.494+0000 7fd6b194d640 1 -- 172.21.15.42:0/2929225631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 msgr2=0x7fd6ac19b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.494+0000 7fd6b194d640 1 --2- 172.21.15.42:0/2929225631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac19b710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009940 tx=0x7fd69c032ce0 comp rx=0 tx=0).stop 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.494+0000 7fd6b194d640 1 -- 172.21.15.42:0/2929225631 shutdown_connections 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.494+0000 7fd6b194d640 1 --2- 172.21.15.42:0/2929225631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6ac107780 0x7fd6ac19b710 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.494+0000 7fd6b194d640 1 -- 172.21.15.42:0/2929225631 >> 172.21.15.42:0/2929225631 conn(0x7fd6ac102f30 msgr2=0x7fd6ac103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:48.117 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.494+0000 7fd6b194d640 1 -- 172.21.15.42:0/2929225631 shutdown_connections 2024-09-19T09:29:48.118 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:47.494+0000 7fd6b194d640 1 -- 172.21.15.42:0/2929225631 wait complete. 2024-09-19T09:29:48.118 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (1/15)... 2024-09-19T09:29:48.253 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:47 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:47.993+0000 7fa8adedb040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:29:48.253 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:48 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:48.057+0000 7fa8adedb040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:29:48.253 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:48 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:48.251+0000 7fa8adedb040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:29:49.454 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:49 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:49.177+0000 7fa8adedb040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:29:49.454 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:49 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:49.247+0000 7fa8adedb040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:29:50.282 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:50.006+0000 7fa8adedb040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:29:50.282 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:50.130+0000 7fa8adedb040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:29:50.575 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:50.280+0000 7fa8adedb040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:29:50.762 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:50.344+0000 7fa8adedb040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:29:50.762 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:50.502+0000 7fa8adedb040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:29:50.762 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:50.573+0000 7fa8adedb040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:29:50.870 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:50.636+0000 7fa8adedb040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:29:50.870 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:50.801+0000 7fa8adedb040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:29:50.870 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:50.869+0000 7fa8adedb040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:29:51.134 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:50.939+0000 7fa8adedb040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:29:51.134 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:51 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:51.029+0000 7fa8adedb040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:29:51.135 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:51 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:51.092+0000 7fa8adedb040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:29:51.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:51 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1569765424' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:29:51.430 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:51 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:51.160+0000 7fa8adedb040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:29:51.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:51.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:29:51.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:29:51.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:29:51.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:29:51.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:29:51.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:29:51.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:51.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:29:51.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:29:51.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:29:51.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:29:51.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:29:39:578853+0000", 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:29:51.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:29:51.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:51.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:29:51.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:29:51.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:29:51.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:29:51.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:29:51.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:29:51.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:29:51.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:29:51.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:29:51.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:51.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:29:51.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:51.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:29:39.579495+0000", 2024-09-19T09:29:51.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:29:51.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:51.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:29:51.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:29:51.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.012+0000 7fd61ad2c640 1 Processor -- start 2024-09-19T09:29:51.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.012+0000 7fd61ad2c640 1 -- start start 2024-09-19T09:29:51.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.012+0000 7fd61ad2c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd614107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:51.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.012+0000 7fd61ad2c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141080b0 con 0x7fd6141076e0 2024-09-19T09:29:51.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.012+0000 7fd618ac8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd614107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:51.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.012+0000 7fd618ac8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd614107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36828/0 (socket says 172.21.15.42:36828) 2024-09-19T09:29:51.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.012+0000 7fd618ac8640 1 -- 172.21.15.42:0/514607612 learned_addr learned my addr 172.21.15.42:0/514607612 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:51.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.013+0000 7fd618ac8640 1 -- 172.21.15.42:0/514607612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6141088e0 con 0x7fd6141076e0 2024-09-19T09:29:51.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.013+0000 7fd618ac8640 1 --2- 172.21.15.42:0/514607612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd614107ae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd608009820 tx=0x7fd60802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327f9b72e56f7f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.014+0000 7fd6137fe640 1 -- 172.21.15.42:0/514607612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd608037070 con 0x7fd6141076e0 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.014+0000 7fd6137fe640 1 -- 172.21.15.42:0/514607612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd608032900 con 0x7fd6141076e0 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.014+0000 7fd6137fe640 1 -- 172.21.15.42:0/514607612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd608030850 con 0x7fd6141076e0 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.014+0000 7fd61ad2c640 1 -- 172.21.15.42:0/514607612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 msgr2=0x7fd614107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.014+0000 7fd61ad2c640 1 --2- 172.21.15.42:0/514607612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd614107ae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd608009820 tx=0x7fd60802a270 comp rx=0 tx=0).stop 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.014+0000 7fd61ad2c640 1 -- 172.21.15.42:0/514607612 shutdown_connections 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.014+0000 7fd61ad2c640 1 --2- 172.21.15.42:0/514607612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd614107ae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.014+0000 7fd61ad2c640 1 -- 172.21.15.42:0/514607612 >> 172.21.15.42:0/514607612 conn(0x7fd614102e90 msgr2=0x7fd6141052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.014+0000 7fd61ad2c640 1 -- 172.21.15.42:0/514607612 shutdown_connections 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.014+0000 7fd61ad2c640 1 -- 172.21.15.42:0/514607612 wait complete. 2024-09-19T09:29:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.015+0000 7fd61ad2c640 1 Processor -- start 2024-09-19T09:29:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.015+0000 7fd61ad2c640 1 -- start start 2024-09-19T09:29:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.015+0000 7fd61ad2c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd61407daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.015+0000 7fd61ad2c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd61410bc90 con 0x7fd6141076e0 2024-09-19T09:29:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.015+0000 7fd618ac8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd61407daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.015+0000 7fd618ac8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd61407daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36832/0 (socket says 172.21.15.42:36832) 2024-09-19T09:29:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.015+0000 7fd618ac8640 1 -- 172.21.15.42:0/1569765424 learned_addr learned my addr 172.21.15.42:0/1569765424 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.016+0000 7fd618ac8640 1 -- 172.21.15.42:0/1569765424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61407e030 con 0x7fd6141076e0 2024-09-19T09:29:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.016+0000 7fd618ac8640 1 --2- 172.21.15.42:0/1569765424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd61407daf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd608009940 tx=0x7fd608032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.016+0000 7fd611ffb640 1 -- 172.21.15.42:0/1569765424 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd608042070 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.016+0000 7fd611ffb640 1 -- 172.21.15.42:0/1569765424 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd6080308c0 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.016+0000 7fd61ad2c640 1 -- 172.21.15.42:0/1569765424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61407c220 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.016+0000 7fd611ffb640 1 -- 172.21.15.42:0/1569765424 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd608037040 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.016+0000 7fd61ad2c640 1 -- 172.21.15.42:0/1569765424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61407c760 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.016+0000 7fd611ffb640 1 -- 172.21.15.42:0/1569765424 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd608045070 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.017+0000 7fd611ffb640 1 -- 172.21.15.42:0/1569765424 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd608046c30 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.017+0000 7fd61ad2c640 1 -- 172.21.15.42:0/1569765424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd614107b60 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.019+0000 7fd611ffb640 1 -- 172.21.15.42:0/1569765424 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd6080327b0 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.082+0000 7fd61ad2c640 1 -- 172.21.15.42:0/1569765424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd61407d060 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.082+0000 7fd611ffb640 1 -- 172.21.15.42:0/1569765424 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fd60803c760 con 0x7fd6141076e0 2024-09-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.083+0000 7fd61ad2c640 1 -- 172.21.15.42:0/1569765424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 msgr2=0x7fd61407daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:51.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.083+0000 7fd61ad2c640 1 --2- 172.21.15.42:0/1569765424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd61407daf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd608009940 tx=0x7fd608032ce0 comp rx=0 tx=0).stop 2024-09-19T09:29:51.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.083+0000 7fd61ad2c640 1 -- 172.21.15.42:0/1569765424 shutdown_connections 2024-09-19T09:29:51.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.083+0000 7fd61ad2c640 1 --2- 172.21.15.42:0/1569765424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6141076e0 0x7fd61407daf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:51.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.083+0000 7fd61ad2c640 1 -- 172.21.15.42:0/1569765424 >> 172.21.15.42:0/1569765424 conn(0x7fd614102e90 msgr2=0x7fd614103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:51.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.083+0000 7fd61ad2c640 1 -- 172.21.15.42:0/1569765424 shutdown_connections 2024-09-19T09:29:51.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:51.083+0000 7fd61ad2c640 1 -- 172.21.15.42:0/1569765424 wait complete. 2024-09-19T09:29:51.698 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (2/15)... 2024-09-19T09:29:52.454 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:51 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:51.998+0000 7fa8adedb040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: Activating manager daemon x 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: mgrmap e2: x(active, starting, since 0.00331664s) 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: from='mgr.14100 172.21.15.42:0/1784269917' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: from='mgr.14100 172.21.15.42:0/1784269917' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: from='mgr.14100 172.21.15.42:0/1784269917' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: from='mgr.14100 172.21.15.42:0/1784269917' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: from='mgr.14100 172.21.15.42:0/1784269917' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: Manager daemon x is now available 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: from='mgr.14100 172.21.15.42:0/1784269917' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: from='mgr.14100 172.21.15.42:0/1784269917' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:29:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: from='mgr.14100 172.21.15.42:0/1784269917' entity='mgr.x' 2024-09-19T09:29:52.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: from='mgr.14100 172.21.15.42:0/1784269917' entity='mgr.x' 2024-09-19T09:29:52.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:52 smithi042 ceph-mon[31223]: from='mgr.14100 172.21.15.42:0/1784269917' entity='mgr.x' 2024-09-19T09:29:54.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:54 smithi042 ceph-mon[31223]: mgrmap e3: x(active, since 1.00762s) 2024-09-19T09:29:54.891 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:54.891 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:29:54.891 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:29:54.891 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:29:54.891 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:29:54.891 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:29:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:29:54.893 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:54.893 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:29:54.893 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:54.893 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:29:54.897 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:29:54.897 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:29:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:29:54.905 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:29:54.906 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:29:39:578853+0000", 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:29:54.907 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:29:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:29:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:29:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:29:39.579495+0000", 2024-09-19T09:29:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:29:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:29:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:29:54.908 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.033+0000 7f8decb94640 1 Processor -- start 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.033+0000 7f8decb94640 1 -- start start 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.033+0000 7f8decb94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de807c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.033+0000 7f8decb94640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8de807c870 con 0x7f8de807de40 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.033+0000 7f8de659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de807c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.034+0000 7f8de659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de807c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36916/0 (socket says 172.21.15.42:36916) 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.034+0000 7f8de659c640 1 -- 172.21.15.42:0/2793211259 learned_addr learned my addr 172.21.15.42:0/2793211259 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.034+0000 7f8de659c640 1 -- 172.21.15.42:0/2793211259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de807c9f0 con 0x7f8de807de40 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.035+0000 7f8de659c640 1 --2- 172.21.15.42:0/2793211259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de807c2a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009820 tx=0x7f8dd802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921f01089a800762 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.035+0000 7f8de559a640 1 -- 172.21.15.42:0/2793211259 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dd8037070 con 0x7f8de807de40 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.035+0000 7f8de559a640 1 -- 172.21.15.42:0/2793211259 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8dd8032900 con 0x7f8de807de40 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.035+0000 7f8de559a640 1 -- 172.21.15.42:0/2793211259 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dd8030850 con 0x7f8de807de40 2024-09-19T09:29:54.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.035+0000 7f8decb94640 1 -- 172.21.15.42:0/2793211259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 msgr2=0x7f8de807c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.035+0000 7f8decb94640 1 --2- 172.21.15.42:0/2793211259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de807c2a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009820 tx=0x7f8dd802a270 comp rx=0 tx=0).stop 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.035+0000 7f8decb94640 1 -- 172.21.15.42:0/2793211259 shutdown_connections 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.035+0000 7f8decb94640 1 --2- 172.21.15.42:0/2793211259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de807c2a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.035+0000 7f8decb94640 1 -- 172.21.15.42:0/2793211259 >> 172.21.15.42:0/2793211259 conn(0x7f8de8102f30 msgr2=0x7f8de8105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.036+0000 7f8decb94640 1 -- 172.21.15.42:0/2793211259 shutdown_connections 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.036+0000 7f8decb94640 1 -- 172.21.15.42:0/2793211259 wait complete. 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.036+0000 7f8decb94640 1 Processor -- start 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.036+0000 7f8decb94640 1 -- start start 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.036+0000 7f8decb94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de819d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8decb94640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8de810dd70 con 0x7f8de807de40 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8de659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de819d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8de659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de819d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36918/0 (socket says 172.21.15.42:36918) 2024-09-19T09:29:54.910 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8de659c640 1 -- 172.21.15.42:0/104525413 learned_addr learned my addr 172.21.15.42:0/104525413 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8de659c640 1 -- 172.21.15.42:0/104525413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de819de60 con 0x7f8de807de40 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8de659c640 1 --2- 172.21.15.42:0/104525413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de819d920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009940 tx=0x7f8dd8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8dd77fe640 1 -- 172.21.15.42:0/104525413 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dd8042070 con 0x7f8de807de40 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8decb94640 1 -- 172.21.15.42:0/104525413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de819e0f0 con 0x7f8de807de40 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8dd77fe640 1 -- 172.21.15.42:0/104525413 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8dd80308c0 con 0x7f8de807de40 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8dd77fe640 1 -- 172.21.15.42:0/104525413 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dd8037040 con 0x7f8de807de40 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.037+0000 7f8decb94640 1 -- 172.21.15.42:0/104525413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de81a0de0 con 0x7f8de807de40 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.038+0000 7f8dd77fe640 1 -- 172.21.15.42:0/104525413 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f8dd8045070 con 0x7f8de807de40 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.039+0000 7f8decb94640 1 -- 172.21.15.42:0/104525413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de807c320 con 0x7f8de807de40 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.039+0000 7f8dd77fe640 1 --2- 172.21.15.42:0/104525413 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f8dd0039160 0x7f8dd003b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.039+0000 7f8dd77fe640 1 -- 172.21.15.42:0/104525413 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8dd806c230 con 0x7f8de807de40 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.039+0000 7f8de5d9b640 1 --2- 172.21.15.42:0/104525413 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f8dd0039160 0x7f8dd003b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:54.911 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.040+0000 7f8de5d9b640 1 --2- 172.21.15.42:0/104525413 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f8dd0039160 0x7f8dd003b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0098c0 tx=0x7f8ddc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.046+0000 7f8dd77fe640 1 -- 172.21.15.42:0/104525413 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8dd803cd90 con 0x7f8de807de40 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.292+0000 7f8decb94640 1 -- 172.21.15.42:0/104525413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8de81a1520 con 0x7f8de807de40 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.292+0000 7f8dd77fe640 1 -- 172.21.15.42:0/104525413 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f8dd8045360 con 0x7f8de807de40 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.295+0000 7f8decb94640 1 -- 172.21.15.42:0/104525413 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f8dd0039160 msgr2=0x7f8dd003b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.295+0000 7f8decb94640 1 --2- 172.21.15.42:0/104525413 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f8dd0039160 0x7f8dd003b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0098c0 tx=0x7f8ddc006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.295+0000 7f8decb94640 1 -- 172.21.15.42:0/104525413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 msgr2=0x7f8de819d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.295+0000 7f8decb94640 1 --2- 172.21.15.42:0/104525413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de819d920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009940 tx=0x7f8dd8032ce0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.295+0000 7f8decb94640 1 -- 172.21.15.42:0/104525413 shutdown_connections 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.295+0000 7f8decb94640 1 --2- 172.21.15.42:0/104525413 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f8dd0039160 0x7f8dd003b620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.295+0000 7f8decb94640 1 --2- 172.21.15.42:0/104525413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de807de40 0x7f8de819d920 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.295+0000 7f8decb94640 1 -- 172.21.15.42:0/104525413 >> 172.21.15.42:0/104525413 conn(0x7f8de8102f30 msgr2=0x7f8de8103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.295+0000 7f8decb94640 1 -- 172.21.15.42:0/104525413 shutdown_connections 2024-09-19T09:29:54.912 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:54.295+0000 7f8decb94640 1 -- 172.21.15.42:0/104525413 wait complete. 2024-09-19T09:29:54.913 INFO:teuthology.orchestra.run.smithi042.stdout:mgr is available 2024-09-19T09:29:55.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:55 smithi042 ceph-mon[31223]: mgrmap e4: x(active, since 2s) 2024-09-19T09:29:55.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:55 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/104525413' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:29:56.076 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:56 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2107619416' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:29:56.085 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:56.085 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:29:56.085 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout fsid = 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:56.085 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:29:56.086 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.319+0000 7fe6b8a07640 1 Processor -- start 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.319+0000 7fe6b8a07640 1 -- start start 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.319+0000 7fe6b8a07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b410a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.319+0000 7fe6b8a07640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b407bdb0 con 0x7fe6b41081c0 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.320+0000 7fe6b259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b410a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.320+0000 7fe6b259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b410a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36922/0 (socket says 172.21.15.42:36922) 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.320+0000 7fe6b259c640 1 -- 172.21.15.42:0/2372770749 learned_addr learned my addr 172.21.15.42:0/2372770749 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.320+0000 7fe6b259c640 1 -- 172.21.15.42:0/2372770749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b410aaf0 con 0x7fe6b41081c0 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.320+0000 7fe6b259c640 1 --2- 172.21.15.42:0/2372770749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b410a5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009820 tx=0x7fe6a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba23f7a23648482 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.087 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.321+0000 7fe6b159a640 1 -- 172.21.15.42:0/2372770749 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a4037070 con 0x7fe6b41081c0 2024-09-19T09:29:56.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.321+0000 7fe6b159a640 1 -- 172.21.15.42:0/2372770749 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6a4032900 con 0x7fe6b41081c0 2024-09-19T09:29:56.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.321+0000 7fe6b159a640 1 -- 172.21.15.42:0/2372770749 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a4030850 con 0x7fe6b41081c0 2024-09-19T09:29:56.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.321+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2372770749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 msgr2=0x7fe6b410a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.088 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.321+0000 7fe6b8a07640 1 --2- 172.21.15.42:0/2372770749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b410a5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009820 tx=0x7fe6a402a270 comp rx=0 tx=0).stop 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.322+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2372770749 shutdown_connections 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.322+0000 7fe6b8a07640 1 --2- 172.21.15.42:0/2372770749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b410a5b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.322+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2372770749 >> 172.21.15.42:0/2372770749 conn(0x7fe6b4101e20 msgr2=0x7fe6b4104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.322+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2372770749 shutdown_connections 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.322+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2372770749 wait complete. 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.322+0000 7fe6b8a07640 1 Processor -- start 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.322+0000 7fe6b8a07640 1 -- start start 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.323+0000 7fe6b8a07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b419b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.323+0000 7fe6b8a07640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b410bad0 con 0x7fe6b41081c0 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.323+0000 7fe6b259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b419b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.323+0000 7fe6b259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b419b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36928/0 (socket says 172.21.15.42:36928) 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.323+0000 7fe6b259c640 1 -- 172.21.15.42:0/2107619416 learned_addr learned my addr 172.21.15.42:0/2107619416 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.323+0000 7fe6b259c640 1 -- 172.21.15.42:0/2107619416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b419bc90 con 0x7fe6b41081c0 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.323+0000 7fe6b259c640 1 --2- 172.21.15.42:0/2107619416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b419b750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40097f0 tx=0x7fe6a4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.323+0000 7fe6a37fe640 1 -- 172.21.15.42:0/2107619416 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a4037040 con 0x7fe6b41081c0 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.324+0000 7fe6a37fe640 1 -- 172.21.15.42:0/2107619416 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6a4040070 con 0x7fe6b41081c0 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.324+0000 7fe6a37fe640 1 -- 172.21.15.42:0/2107619416 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a403a390 con 0x7fe6b41081c0 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.324+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2107619416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b419bf20 con 0x7fe6b41081c0 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.324+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2107619416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b419ec10 con 0x7fe6b41081c0 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.325+0000 7fe6a37fe640 1 -- 172.21.15.42:0/2107619416 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fe6a403a5e0 con 0x7fe6b41081c0 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.325+0000 7fe6a37fe640 1 --2- 172.21.15.42:0/2107619416 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fe69c0391b0 0x7fe69c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.325+0000 7fe6a37fe640 1 -- 172.21.15.42:0/2107619416 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe6a406c3d0 con 0x7fe6b41081c0 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.325+0000 7fe6b1d9b640 1 --2- 172.21.15.42:0/2107619416 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fe69c0391b0 0x7fe69c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.325+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2107619416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b4108620 con 0x7fe6b41081c0 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.326+0000 7fe6b1d9b640 1 --2- 172.21.15.42:0/2107619416 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fe69c0391b0 0x7fe69c03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80098c0 tx=0x7fe6a8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.330+0000 7fe6a37fe640 1 -- 172.21.15.42:0/2107619416 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe6a406c130 con 0x7fe6b41081c0 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.504+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2107619416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe6b41a0210 con 0x7fe6b41081c0 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.505+0000 7fe6a37fe640 1 -- 172.21.15.42:0/2107619416 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fe6a403a8d0 con 0x7fe6b41081c0 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.507+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2107619416 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fe69c0391b0 msgr2=0x7fe69c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.507+0000 7fe6b8a07640 1 --2- 172.21.15.42:0/2107619416 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fe69c0391b0 0x7fe69c03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80098c0 tx=0x7fe6a8006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.507+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2107619416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 msgr2=0x7fe6b419b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.507+0000 7fe6b8a07640 1 --2- 172.21.15.42:0/2107619416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b419b750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40097f0 tx=0x7fe6a4030d80 comp rx=0 tx=0).stop 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.507+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2107619416 shutdown_connections 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.507+0000 7fe6b8a07640 1 --2- 172.21.15.42:0/2107619416 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fe69c0391b0 0x7fe69c03b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.507+0000 7fe6b8a07640 1 --2- 172.21.15.42:0/2107619416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b41081c0 0x7fe6b419b750 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.091 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.507+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2107619416 >> 172.21.15.42:0/2107619416 conn(0x7fe6b4101e20 msgr2=0x7fe6b41029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:56.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.507+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2107619416 shutdown_connections 2024-09-19T09:29:56.092 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:55.507+0000 7fe6b8a07640 1 -- 172.21.15.42:0/2107619416 wait complete. 2024-09-19T09:29:56.092 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling cephadm module... 2024-09-19T09:29:57.315 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:57 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/134418737' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T09:29:57.315 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:57 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: ignoring --setuser ceph since I am not root 2024-09-19T09:29:57.315 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:57 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: ignoring --setgroup ceph since I am not root 2024-09-19T09:29:57.315 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:57 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:57.155+0000 7fef65209040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:29:57.315 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:57 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:57.215+0000 7fef65209040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:29:57.599 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:57 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:57.372+0000 7fef65209040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:29:57.599 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:57 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:57.443+0000 7fef65209040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:29:57.599 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:57 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:57.597+0000 7fef65209040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:29:57.628 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.490+0000 7f9700a31640 1 Processor -- start 2024-09-19T09:29:57.633 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.490+0000 7f9700a31640 1 -- start start 2024-09-19T09:29:57.633 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.490+0000 7f9700a31640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc10a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.633 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.490+0000 7f9700a31640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc07be30 con 0x7f96fc108180 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.491+0000 7f96fa59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc10a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.491+0000 7f96fa59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc10a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36934/0 (socket says 172.21.15.42:36934) 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.491+0000 7f96fa59c640 1 -- 172.21.15.42:0/1202238131 learned_addr learned my addr 172.21.15.42:0/1202238131 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.491+0000 7f96fa59c640 1 -- 172.21.15.42:0/1202238131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96fc10aab0 con 0x7f96fc108180 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.492+0000 7f96fa59c640 1 --2- 172.21.15.42:0/1202238131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc10a570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009820 tx=0x7f96ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2515efa571f99fae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.492+0000 7f96f959a640 1 -- 172.21.15.42:0/1202238131 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec037070 con 0x7f96fc108180 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.492+0000 7f96f959a640 1 -- 172.21.15.42:0/1202238131 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96ec032900 con 0x7f96fc108180 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.492+0000 7f96f959a640 1 -- 172.21.15.42:0/1202238131 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec030850 con 0x7f96fc108180 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.493+0000 7f9700a31640 1 -- 172.21.15.42:0/1202238131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 msgr2=0x7f96fc10a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.493+0000 7f9700a31640 1 --2- 172.21.15.42:0/1202238131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc10a570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009820 tx=0x7f96ec02a270 comp rx=0 tx=0).stop 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.493+0000 7f9700a31640 1 -- 172.21.15.42:0/1202238131 shutdown_connections 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.493+0000 7f9700a31640 1 --2- 172.21.15.42:0/1202238131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc10a570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.634 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.493+0000 7f9700a31640 1 -- 172.21.15.42:0/1202238131 >> 172.21.15.42:0/1202238131 conn(0x7f96fc101e20 msgr2=0x7f96fc104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.493+0000 7f9700a31640 1 -- 172.21.15.42:0/1202238131 shutdown_connections 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.493+0000 7f9700a31640 1 -- 172.21.15.42:0/1202238131 wait complete. 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.494+0000 7f9700a31640 1 Processor -- start 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.494+0000 7f9700a31640 1 -- start start 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.494+0000 7f9700a31640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.494+0000 7f9700a31640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc10bb50 con 0x7f96fc108180 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.494+0000 7f96fa59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.494+0000 7f96fa59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc19b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36948/0 (socket says 172.21.15.42:36948) 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.494+0000 7f96fa59c640 1 -- 172.21.15.42:0/134418737 learned_addr learned my addr 172.21.15.42:0/134418737 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.494+0000 7f96fa59c640 1 -- 172.21.15.42:0/134418737 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96fc19bc50 con 0x7f96fc108180 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.494+0000 7f96fa59c640 1 --2- 172.21.15.42:0/134418737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc19b710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0097f0 tx=0x7f96ec030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.494+0000 7f96eb7fe640 1 -- 172.21.15.42:0/134418737 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec037040 con 0x7f96fc108180 2024-09-19T09:29:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.495+0000 7f96eb7fe640 1 -- 172.21.15.42:0/134418737 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96ec040070 con 0x7f96fc108180 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.495+0000 7f9700a31640 1 -- 172.21.15.42:0/134418737 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96fc19bee0 con 0x7f96fc108180 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.495+0000 7f96eb7fe640 1 -- 172.21.15.42:0/134418737 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec03a390 con 0x7f96fc108180 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.495+0000 7f9700a31640 1 -- 172.21.15.42:0/134418737 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96fc19ebd0 con 0x7f96fc108180 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.495+0000 7f96eb7fe640 1 -- 172.21.15.42:0/134418737 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f96ec03a630 con 0x7f96fc108180 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.496+0000 7f9700a31640 1 -- 172.21.15.42:0/134418737 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96fc1085e0 con 0x7f96fc108180 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.496+0000 7f96eb7fe640 1 --2- 172.21.15.42:0/134418737 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f96e4039160 0x7f96e403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.496+0000 7f96eb7fe640 1 -- 172.21.15.42:0/134418737 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f96ec06c400 con 0x7f96fc108180 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.496+0000 7f96f9d9b640 1 --2- 172.21.15.42:0/134418737 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f96e4039160 0x7f96e403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.496+0000 7f96f9d9b640 1 --2- 172.21.15.42:0/134418737 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f96e4039160 0x7f96e403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f96f00098c0 tx=0x7f96f0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.501+0000 7f96eb7fe640 1 -- 172.21.15.42:0/134418737 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f96ec03a9a0 con 0x7f96fc108180 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:56.725+0000 7f9700a31640 1 -- 172.21.15.42:0/134418737 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f96fc19c360 con 0x7f96fc108180 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.010+0000 7f96eb7fe640 1 -- 172.21.15.42:0/134418737 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f96ec06c160 con 0x7f96fc108180 2024-09-19T09:29:57.636 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.011+0000 7f96eb7fe640 1 -- 172.21.15.42:0/134418737 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f96ec02fd60 con 0x7f96fc108180 2024-09-19T09:29:57.637 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.013+0000 7f9700a31640 1 -- 172.21.15.42:0/134418737 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f96e4039160 msgr2=0x7f96e403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.637 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.013+0000 7f9700a31640 1 --2- 172.21.15.42:0/134418737 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f96e4039160 0x7f96e403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f96f00098c0 tx=0x7f96f0006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.637 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.013+0000 7f9700a31640 1 -- 172.21.15.42:0/134418737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 msgr2=0x7f96fc19b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.637 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.013+0000 7f9700a31640 1 --2- 172.21.15.42:0/134418737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc19b710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0097f0 tx=0x7f96ec030d80 comp rx=0 tx=0).stop 2024-09-19T09:29:57.637 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.013+0000 7f9700a31640 1 -- 172.21.15.42:0/134418737 shutdown_connections 2024-09-19T09:29:57.637 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.013+0000 7f9700a31640 1 --2- 172.21.15.42:0/134418737 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f96e4039160 0x7f96e403b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.637 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.013+0000 7f9700a31640 1 --2- 172.21.15.42:0/134418737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96fc108180 0x7f96fc19b710 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.637 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.013+0000 7f9700a31640 1 -- 172.21.15.42:0/134418737 >> 172.21.15.42:0/134418737 conn(0x7f96fc101e20 msgr2=0x7f96fc1029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:57.637 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.013+0000 7f9700a31640 1 -- 172.21.15.42:0/134418737 shutdown_connections 2024-09-19T09:29:57.637 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:57.013+0000 7f9700a31640 1 -- 172.21.15.42:0/134418737 wait complete. 2024-09-19T09:29:57.876 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:57 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:57.758+0000 7fef65209040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:29:58.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:58 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/134418737' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T09:29:58.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:58 smithi042 ceph-mon[31223]: mgrmap e5: x(active, since 5s) 2024-09-19T09:29:58.162 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:58.095+0000 7fef65209040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:29:58.162 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:58.160+0000 7fef65209040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:29:58.454 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:58.359+0000 7fef65209040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:29:58.822 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:29:58.822 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T09:29:58.822 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:29:58.822 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T09:29:58.822 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:29:58.822 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:29:58.823 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.047+0000 7fb4c79b4640 1 Processor -- start 2024-09-19T09:29:58.823 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.047+0000 7fb4c79b4640 1 -- start start 2024-09-19T09:29:58.823 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.047+0000 7fb4c79b4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c01063d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:58.823 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.047+0000 7fb4c79b4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c007bd90 con 0x7fb4c0105fd0 2024-09-19T09:29:58.823 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.047+0000 7fb4c5750640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c01063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:58.823 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.047+0000 7fb4c5750640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c01063d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36964/0 (socket says 172.21.15.42:36964) 2024-09-19T09:29:58.823 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.047+0000 7fb4c5750640 1 -- 172.21.15.42:0/890127401 learned_addr learned my addr 172.21.15.42:0/890127401 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:58.823 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.048+0000 7fb4c5750640 1 -- 172.21.15.42:0/890127401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c0106910 con 0x7fb4c0105fd0 2024-09-19T09:29:58.823 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.048+0000 7fb4c5750640 1 --2- 172.21.15.42:0/890127401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c01063d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009820 tx=0x7fb4bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdf228c852e9684 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:58.823 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.048+0000 7fb4b7fff640 1 -- 172.21.15.42:0/890127401 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc037070 con 0x7fb4c0105fd0 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.048+0000 7fb4b7fff640 1 -- 172.21.15.42:0/890127401 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4bc032900 con 0x7fb4c0105fd0 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.048+0000 7fb4b7fff640 1 -- 172.21.15.42:0/890127401 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc030850 con 0x7fb4c0105fd0 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.049+0000 7fb4c79b4640 1 -- 172.21.15.42:0/890127401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 msgr2=0x7fb4c01063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.049+0000 7fb4c79b4640 1 --2- 172.21.15.42:0/890127401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c01063d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009820 tx=0x7fb4bc02a270 comp rx=0 tx=0).stop 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.049+0000 7fb4c79b4640 1 -- 172.21.15.42:0/890127401 shutdown_connections 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.049+0000 7fb4c79b4640 1 --2- 172.21.15.42:0/890127401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c01063d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.049+0000 7fb4c79b4640 1 -- 172.21.15.42:0/890127401 >> 172.21.15.42:0/890127401 conn(0x7fb4c0101e20 msgr2=0x7fb4c0104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.049+0000 7fb4c79b4640 1 -- 172.21.15.42:0/890127401 shutdown_connections 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.049+0000 7fb4c79b4640 1 -- 172.21.15.42:0/890127401 wait complete. 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.050+0000 7fb4c79b4640 1 Processor -- start 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.050+0000 7fb4c79b4640 1 -- start start 2024-09-19T09:29:58.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.050+0000 7fb4c79b4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c019d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.050+0000 7fb4c79b4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c0107a10 con 0x7fb4c0105fd0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.050+0000 7fb4c5750640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c019d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.050+0000 7fb4c5750640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c019d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36968/0 (socket says 172.21.15.42:36968) 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.050+0000 7fb4c5750640 1 -- 172.21.15.42:0/152856426 learned_addr learned my addr 172.21.15.42:0/152856426 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.051+0000 7fb4c5750640 1 -- 172.21.15.42:0/152856426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c019de00 con 0x7fb4c0105fd0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.051+0000 7fb4c5750640 1 --2- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c019d8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0097f0 tx=0x7fb4bc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.051+0000 7fb4b67fc640 1 -- 172.21.15.42:0/152856426 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc037040 con 0x7fb4c0105fd0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.051+0000 7fb4b67fc640 1 -- 172.21.15.42:0/152856426 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4bc040070 con 0x7fb4c0105fd0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.051+0000 7fb4b67fc640 1 -- 172.21.15.42:0/152856426 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc03a390 con 0x7fb4c0105fd0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.051+0000 7fb4c79b4640 1 -- 172.21.15.42:0/152856426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c019e090 con 0x7fb4c0105fd0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.051+0000 7fb4c79b4640 1 -- 172.21.15.42:0/152856426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c01a0d80 con 0x7fb4c0105fd0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.052+0000 7fb4b67fc640 1 -- 172.21.15.42:0/152856426 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fb4bc03b430 con 0x7fb4c0105fd0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.052+0000 7fb4c79b4640 1 -- 172.21.15.42:0/152856426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c01063d0 con 0x7fb4c0105fd0 2024-09-19T09:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.052+0000 7fb4b67fc640 1 --2- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fb4ac039200 0x7fb4ac03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.052+0000 7fb4b67fc640 1 -- 172.21.15.42:0/152856426 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb4bc06c430 con 0x7fb4c0105fd0 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.052+0000 7fb4c4f4f640 1 -- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fb4ac039200 msgr2=0x7fb4ac03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2557927084 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.052+0000 7fb4c4f4f640 1 --2- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fb4ac039200 0x7fb4ac03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.057+0000 7fb4b67fc640 1 -- 172.21.15.42:0/152856426 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb4bc06c190 con 0x7fb4c0105fd0 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.253+0000 7fb4c4f4f640 1 -- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fb4ac039200 msgr2=0x7fb4ac03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2557927084 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.253+0000 7fb4c4f4f640 1 --2- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fb4ac039200 0x7fb4ac03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.280+0000 7fb4c79b4640 1 -- 172.21.15.42:0/152856426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb4c0196d30 con 0x7fb4c0105fd0 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.280+0000 7fb4b67fc640 1 -- 172.21.15.42:0/152856426 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fb4bc032900 con 0x7fb4c0105fd0 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.282+0000 7fb4c79b4640 1 -- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fb4ac039200 msgr2=0x7fb4ac03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.282+0000 7fb4c79b4640 1 --2- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fb4ac039200 0x7fb4ac03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.282+0000 7fb4c79b4640 1 -- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 msgr2=0x7fb4c019d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.282+0000 7fb4c79b4640 1 --2- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c019d8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0097f0 tx=0x7fb4bc030d80 comp rx=0 tx=0).stop 2024-09-19T09:29:58.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.282+0000 7fb4c79b4640 1 -- 172.21.15.42:0/152856426 shutdown_connections 2024-09-19T09:29:58.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.282+0000 7fb4c79b4640 1 --2- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7fb4ac039200 0x7fb4ac03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:58.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.282+0000 7fb4c79b4640 1 --2- 172.21.15.42:0/152856426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c0105fd0 0x7fb4c019d8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:58.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.282+0000 7fb4c79b4640 1 -- 172.21.15.42:0/152856426 >> 172.21.15.42:0/152856426 conn(0x7fb4c0101e20 msgr2=0x7fb4c0191bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:58.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.283+0000 7fb4c79b4640 1 -- 172.21.15.42:0/152856426 shutdown_connections 2024-09-19T09:29:58.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:58.283+0000 7fb4c79b4640 1 -- 172.21.15.42:0/152856426 wait complete. 2024-09-19T09:29:58.827 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for the mgr to restart... 2024-09-19T09:29:58.827 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr epoch 5... 2024-09-19T09:29:59.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:29:59 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/152856426' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:29:59.704 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:59 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:59.304+0000 7fef65209040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:29:59.704 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:29:59 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:29:59.375+0000 7fef65209040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:30:00.135 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:00.133+0000 7fef65209040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:30:00.406 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:00.255+0000 7fef65209040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:30:00.699 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:00.405+0000 7fef65209040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:30:00.699 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:00.469+0000 7fef65209040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:30:00.700 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:00.626+0000 7fef65209040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:30:00.700 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:00.698+0000 7fef65209040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:30:00.954 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:00.761+0000 7fef65209040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:30:00.954 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:00.928+0000 7fef65209040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:30:01.279 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:00.996+0000 7fef65209040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:30:01.279 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:01 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:01.066+0000 7fef65209040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:30:01.279 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:01 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:01.153+0000 7fef65209040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:30:01.279 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:01 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:01.215+0000 7fef65209040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:30:01.279 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:01 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:01.277+0000 7fef65209040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:30:02.454 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:02.109+0000 7fef65209040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:30:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: Active manager daemon x restarted 2024-09-19T09:30:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: Activating manager daemon x 2024-09-19T09:30:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T09:30:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: mgrmap e6: x(active, starting, since 0.00326805s) 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: Manager daemon x is now available 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:30:02.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:02 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:30:03.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:03 smithi042 ceph-mon[31223]: Found migration_current of "None". Setting to last migration. 2024-09-19T09:30:03.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:03 smithi042 ceph-mon[31223]: mgrmap e7: x(active, since 1.00548s) 2024-09-19T09:30:03.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:30:03.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T09:30:03.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:30:03.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:30:03.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.221+0000 7f1e50e86640 1 Processor -- start 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.221+0000 7f1e50e86640 1 -- start start 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.221+0000 7f1e50e86640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c1069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.221+0000 7f1e50e86640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c106fb0 con 0x7f1e4c1065e0 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.221+0000 7f1e4a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c1069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.221+0000 7f1e4a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c1069e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36978/0 (socket says 172.21.15.42:36978) 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.221+0000 7f1e4a59c640 1 -- 172.21.15.42:0/3268427792 learned_addr learned my addr 172.21.15.42:0/3268427792 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.222+0000 7f1e4a59c640 1 -- 172.21.15.42:0/3268427792 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c1077e0 con 0x7f1e4c1065e0 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.222+0000 7f1e4a59c640 1 --2- 172.21.15.42:0/3268427792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c1069e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009820 tx=0x7f1e3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a3ad12a2e335f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.222+0000 7f1e49d9b640 1 -- 172.21.15.42:0/3268427792 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3c037070 con 0x7f1e4c1065e0 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.223+0000 7f1e49d9b640 1 -- 172.21.15.42:0/3268427792 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e3c032900 con 0x7f1e4c1065e0 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.223+0000 7f1e49d9b640 1 -- 172.21.15.42:0/3268427792 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3c030850 con 0x7f1e4c1065e0 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.223+0000 7f1e50e86640 1 -- 172.21.15.42:0/3268427792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 msgr2=0x7f1e4c1069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.223+0000 7f1e50e86640 1 --2- 172.21.15.42:0/3268427792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c1069e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009820 tx=0x7f1e3c02a270 comp rx=0 tx=0).stop 2024-09-19T09:30:03.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.223+0000 7f1e50e86640 1 -- 172.21.15.42:0/3268427792 shutdown_connections 2024-09-19T09:30:03.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.223+0000 7f1e50e86640 1 --2- 172.21.15.42:0/3268427792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c1069e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.223+0000 7f1e50e86640 1 -- 172.21.15.42:0/3268427792 >> 172.21.15.42:0/3268427792 conn(0x7f1e4c101d90 msgr2=0x7f1e4c1041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:03.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.223+0000 7f1e50e86640 1 -- 172.21.15.42:0/3268427792 shutdown_connections 2024-09-19T09:30:03.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.223+0000 7f1e50e86640 1 -- 172.21.15.42:0/3268427792 wait complete. 2024-09-19T09:30:03.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.224+0000 7f1e50e86640 1 Processor -- start 2024-09-19T09:30:03.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.224+0000 7f1e50e86640 1 -- start start 2024-09-19T09:30:03.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.224+0000 7f1e50e86640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c07ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.224+0000 7f1e50e86640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10ab90 con 0x7f1e4c1065e0 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.225+0000 7f1e4a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c07ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.225+0000 7f1e4a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c07ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36994/0 (socket says 172.21.15.42:36994) 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.225+0000 7f1e4a59c640 1 -- 172.21.15.42:0/1097968046 learned_addr learned my addr 172.21.15.42:0/1097968046 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.225+0000 7f1e4a59c640 1 -- 172.21.15.42:0/1097968046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c19e420 con 0x7f1e4c1065e0 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.225+0000 7f1e4a59c640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c07ba10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0097f0 tx=0x7f1e3c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.225+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3c037040 con 0x7f1e4c1065e0 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.225+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e3c040070 con 0x7f1e4c1065e0 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.225+0000 7f1e50e86640 1 -- 172.21.15.42:0/1097968046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c19e5f0 con 0x7f1e4c1065e0 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.225+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3c03a390 con 0x7f1e4c1065e0 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.225+0000 7f1e50e86640 1 -- 172.21.15.42:0/1097968046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c19e990 con 0x7f1e4c1065e0 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.226+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f1e3c03a5e0 con 0x7f1e4c1065e0 2024-09-19T09:30:03.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.226+0000 7f1e437fe640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 0x7f1e3803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.226+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 --> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1e3803bdd0 con 0x7f1e38039200 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.227+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1e3c06c400 con 0x7f1e4c1065e0 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.226+0000 7f1e43fff640 1 -- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 msgr2=0x7f1e3803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2557927084 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.227+0000 7f1e43fff640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 0x7f1e3803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.428+0000 7f1e43fff640 1 -- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 msgr2=0x7f1e3803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2557927084 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.428+0000 7f1e43fff640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 0x7f1e3803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.829+0000 7f1e43fff640 1 -- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 msgr2=0x7f1e3803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2557927084 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:59.829+0000 7f1e43fff640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 0x7f1e3803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:00.630+0000 7f1e43fff640 1 -- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 msgr2=0x7f1e3803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/2557927084 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:00.630+0000 7f1e43fff640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 0x7f1e3803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:02.113+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f1e3c06b200 con 0x7f1e4c1065e0 2024-09-19T09:30:03.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:02.113+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 msgr2=0x7f1e3803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:02.113+0000 7f1e437fe640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 0x7f1e3803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.114+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f1e3c03b430 con 0x7f1e4c1065e0 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.114+0000 7f1e437fe640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f1e3803cb30 0x7f1e3803ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.115+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 --> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1e3c037e50 con 0x7f1e3803cb30 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.115+0000 7f1e43fff640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f1e3803cb30 0x7f1e3803ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.116+0000 7f1e43fff640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f1e3803cb30 0x7f1e3803ef20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1e34003980 tx=0x7f1e340092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.117+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 <== mgr.14118 v2:172.21.15.42:6800/203737163 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f1e3c037e50 con 0x7f1e3803cb30 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 -- 172.21.15.42:0/1097968046 --> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f1e4c10ad10 con 0x7f1e3803cb30 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e437fe640 1 -- 172.21.15.42:0/1097968046 <== mgr.14118 v2:172.21.15.42:6800/203737163 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f1e4c10ad10 con 0x7f1e3803cb30 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 -- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f1e3803cb30 msgr2=0x7f1e3803ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f1e3803cb30 0x7f1e3803ef20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1e34003980 tx=0x7f1e340092b0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 -- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 msgr2=0x7f1e4c07ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c07ba10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0097f0 tx=0x7f1e3c030d80 comp rx=0 tx=0).stop 2024-09-19T09:30:03.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 -- 172.21.15.42:0/1097968046 shutdown_connections 2024-09-19T09:30:03.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f1e3803cb30 0x7f1e3803ef20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:6800/2557927084,v1:172.21.15.42:6801/2557927084] conn(0x7f1e38039200 0x7f1e3803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 --2- 172.21.15.42:0/1097968046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4c1065e0 0x7f1e4c07ba10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 -- 172.21.15.42:0/1097968046 >> 172.21.15.42:0/1097968046 conn(0x7f1e4c101d90 msgr2=0x7f1e4c102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:03.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 -- 172.21.15.42:0/1097968046 shutdown_connections 2024-09-19T09:30:03.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:03.124+0000 7f1e50e86640 1 -- 172.21.15.42:0/1097968046 wait complete. 2024-09-19T09:30:03.697 INFO:teuthology.orchestra.run.smithi042.stdout:mgr epoch 5 is available 2024-09-19T09:30:03.697 INFO:teuthology.orchestra.run.smithi042.stdout:Setting orchestrator backend to cephadm... 2024-09-19T09:30:04.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:04 smithi042 ceph-mon[31223]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T09:30:04.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:04 smithi042 ceph-mon[31223]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T09:30:04.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:04 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:04.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:04 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:04.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.036+0000 7f0a2ee3f640 1 Processor -- start 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.036+0000 7f0a2ee3f640 1 -- start start 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.036+0000 7f0a2ee3f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a281063d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.036+0000 7f0a2ee3f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2807bd90 con 0x7f0a28105fd0 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.037+0000 7f0a2cbdb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a281063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.037+0000 7f0a2cbdb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a281063d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34920/0 (socket says 172.21.15.42:34920) 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.037+0000 7f0a2cbdb640 1 -- 172.21.15.42:0/2000572532 learned_addr learned my addr 172.21.15.42:0/2000572532 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.037+0000 7f0a2cbdb640 1 -- 172.21.15.42:0/2000572532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a28106910 con 0x7f0a28105fd0 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a2cbdb640 1 --2- 172.21.15.42:0/2000572532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a281063d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009820 tx=0x7f0a1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b9a6d6dc0ca653 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a277fe640 1 -- 172.21.15.42:0/2000572532 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1c037070 con 0x7f0a28105fd0 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a277fe640 1 -- 172.21.15.42:0/2000572532 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a1c032900 con 0x7f0a28105fd0 2024-09-19T09:30:04.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a277fe640 1 -- 172.21.15.42:0/2000572532 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1c030850 con 0x7f0a28105fd0 2024-09-19T09:30:04.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/2000572532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 msgr2=0x7f0a281063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:04.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a2ee3f640 1 --2- 172.21.15.42:0/2000572532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a281063d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009820 tx=0x7f0a1c02a270 comp rx=0 tx=0).stop 2024-09-19T09:30:04.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/2000572532 shutdown_connections 2024-09-19T09:30:04.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a2ee3f640 1 --2- 172.21.15.42:0/2000572532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a281063d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/2000572532 >> 172.21.15.42:0/2000572532 conn(0x7f0a28101e20 msgr2=0x7f0a28104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:04.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/2000572532 shutdown_connections 2024-09-19T09:30:04.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.038+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/2000572532 wait complete. 2024-09-19T09:30:04.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.039+0000 7f0a2ee3f640 1 Processor -- start 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.039+0000 7f0a2ee3f640 1 -- start start 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.039+0000 7f0a2ee3f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a2819d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.039+0000 7f0a2ee3f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28107a10 con 0x7f0a28105fd0 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.039+0000 7f0a2cbdb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a2819d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.039+0000 7f0a2cbdb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a2819d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34926/0 (socket says 172.21.15.42:34926) 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.039+0000 7f0a2cbdb640 1 -- 172.21.15.42:0/225878303 learned_addr learned my addr 172.21.15.42:0/225878303 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.040+0000 7f0a2cbdb640 1 -- 172.21.15.42:0/225878303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2819de00 con 0x7f0a28105fd0 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.040+0000 7f0a2cbdb640 1 --2- 172.21.15.42:0/225878303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a2819d8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0097f0 tx=0x7f0a1c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.040+0000 7f0a25ffb640 1 -- 172.21.15.42:0/225878303 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1c037040 con 0x7f0a28105fd0 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.040+0000 7f0a25ffb640 1 -- 172.21.15.42:0/225878303 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a1c040070 con 0x7f0a28105fd0 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.040+0000 7f0a25ffb640 1 -- 172.21.15.42:0/225878303 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1c03a390 con 0x7f0a28105fd0 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.040+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/225878303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2819e090 con 0x7f0a28105fd0 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.040+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/225878303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a281a0d80 con 0x7f0a28105fd0 2024-09-19T09:30:04.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.041+0000 7f0a25ffb640 1 -- 172.21.15.42:0/225878303 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f0a1c03b430 con 0x7f0a28105fd0 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.041+0000 7f0a25ffb640 1 --2- 172.21.15.42:0/225878303 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f0a180390f0 0x7f0a1803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.041+0000 7f0a25ffb640 1 -- 172.21.15.42:0/225878303 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0a1c06c570 con 0x7f0a28105fd0 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.042+0000 7f0a27fff640 1 --2- 172.21.15.42:0/225878303 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f0a180390f0 0x7f0a1803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.041+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/225878303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a281063d0 con 0x7f0a28105fd0 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.042+0000 7f0a27fff640 1 --2- 172.21.15.42:0/225878303 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f0a180390f0 0x7f0a1803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0a140098c0 tx=0x7f0a14006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.051+0000 7f0a25ffb640 1 -- 172.21.15.42:0/225878303 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a1c0371e0 con 0x7f0a28105fd0 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.202+0000 7f0a25ffb640 1 -- 172.21.15.42:0/225878303 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0a1c04acf0 con 0x7f0a28105fd0 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.244+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/225878303 --> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f0a28074c10 con 0x7f0a180390f0 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.248+0000 7f0a25ffb640 1 -- 172.21.15.42:0/225878303 <== mgr.14118 v2:172.21.15.42:6800/203737163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0a28074c10 con 0x7f0a180390f0 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.250+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/225878303 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f0a180390f0 msgr2=0x7f0a1803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.250+0000 7f0a2ee3f640 1 --2- 172.21.15.42:0/225878303 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f0a180390f0 0x7f0a1803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0a140098c0 tx=0x7f0a14006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.250+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/225878303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 msgr2=0x7f0a2819d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.250+0000 7f0a2ee3f640 1 --2- 172.21.15.42:0/225878303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a2819d8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0097f0 tx=0x7f0a1c030d80 comp rx=0 tx=0).stop 2024-09-19T09:30:04.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.250+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/225878303 shutdown_connections 2024-09-19T09:30:04.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.250+0000 7f0a2ee3f640 1 --2- 172.21.15.42:0/225878303 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f0a180390f0 0x7f0a1803b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.250+0000 7f0a2ee3f640 1 --2- 172.21.15.42:0/225878303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a28105fd0 0x7f0a2819d8c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.250+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/225878303 >> 172.21.15.42:0/225878303 conn(0x7f0a28101e20 msgr2=0x7f0a28191bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:04.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.251+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/225878303 shutdown_connections 2024-09-19T09:30:04.831 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:04.251+0000 7f0a2ee3f640 1 -- 172.21.15.42:0/225878303 wait complete. 2024-09-19T09:30:05.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-mon[31223]: mgrmap e8: x(active, since 2s) 2024-09-19T09:30:05.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-mon[31223]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:05.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:05.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:05.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-mon[31223]: [19/Sep/2024:09:30:04] ENGINE Bus STARTING 2024-09-19T09:30:05.366 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:05.366 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:05.090+0000 7feed1d2e640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:30:05] ENGINE Error in HTTPServer.serve 2024-09-19T09:30:05.366 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: Traceback (most recent call last): 2024-09-19T09:30:05.366 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:30:05.366 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: self._connections.run(self.expiration_interval) 2024-09-19T09:30:05.366 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:30:05.366 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: self._run(expiration_interval) 2024-09-19T09:30:05.366 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:30:05.366 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:30:05.366 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: s = self.context.wrap_socket( 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: return self.sslsocket_class._create( 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: self.do_handshake() 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: self._sslobj.do_handshake() 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:30:05.367 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:06.033 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T09:30:06.033 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.174+0000 7f6c03d61640 1 Processor -- start 2024-09-19T09:30:06.033 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.174+0000 7f6c03d61640 1 -- start start 2024-09-19T09:30:06.033 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.175+0000 7f6c03d61640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc10a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.033 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.175+0000 7f6c03d61640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc07be30 con 0x7f6bfc108150 2024-09-19T09:30:06.033 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.175+0000 7f6c01afd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc10a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.033 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.175+0000 7f6c01afd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc10a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34938/0 (socket says 172.21.15.42:34938) 2024-09-19T09:30:06.033 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.175+0000 7f6c01afd640 1 -- 172.21.15.42:0/846919812 learned_addr learned my addr 172.21.15.42:0/846919812 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.175+0000 7f6c01afd640 1 -- 172.21.15.42:0/846919812 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bfc10aa80 con 0x7f6bfc108150 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.176+0000 7f6c01afd640 1 --2- 172.21.15.42:0/846919812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc10a540 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009820 tx=0x7f6bf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb02ae946e3590e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.176+0000 7f6c00afb640 1 -- 172.21.15.42:0/846919812 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf8037070 con 0x7f6bfc108150 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.176+0000 7f6c00afb640 1 -- 172.21.15.42:0/846919812 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6bf8032900 con 0x7f6bfc108150 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.176+0000 7f6c00afb640 1 -- 172.21.15.42:0/846919812 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf8030850 con 0x7f6bfc108150 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.176+0000 7f6c03d61640 1 -- 172.21.15.42:0/846919812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 msgr2=0x7f6bfc10a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.176+0000 7f6c03d61640 1 --2- 172.21.15.42:0/846919812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc10a540 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009820 tx=0x7f6bf802a270 comp rx=0 tx=0).stop 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.176+0000 7f6c03d61640 1 -- 172.21.15.42:0/846919812 shutdown_connections 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.176+0000 7f6c03d61640 1 --2- 172.21.15.42:0/846919812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc10a540 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.176+0000 7f6c03d61640 1 -- 172.21.15.42:0/846919812 >> 172.21.15.42:0/846919812 conn(0x7f6bfc101d90 msgr2=0x7f6bfc1041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.177+0000 7f6c03d61640 1 -- 172.21.15.42:0/846919812 shutdown_connections 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.177+0000 7f6c03d61640 1 -- 172.21.15.42:0/846919812 wait complete. 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.177+0000 7f6c03d61640 1 Processor -- start 2024-09-19T09:30:06.034 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.177+0000 7f6c03d61640 1 -- start start 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.177+0000 7f6c03d61640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc1079d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.177+0000 7f6c03d61640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc10bb20 con 0x7f6bfc108150 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.177+0000 7f6c01afd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc1079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.177+0000 7f6c01afd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc1079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34940/0 (socket says 172.21.15.42:34940) 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.177+0000 7f6c01afd640 1 -- 172.21.15.42:0/3428989756 learned_addr learned my addr 172.21.15.42:0/3428989756 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.178+0000 7f6c01afd640 1 -- 172.21.15.42:0/3428989756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bfc107f10 con 0x7f6bfc108150 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.178+0000 7f6c01afd640 1 --2- 172.21.15.42:0/3428989756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc1079d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8032ce0 tx=0x7f6bf8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.178+0000 7f6bf2ffd640 1 -- 172.21.15.42:0/3428989756 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf8042070 con 0x7f6bfc108150 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.178+0000 7f6bf2ffd640 1 -- 172.21.15.42:0/3428989756 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6bf80308c0 con 0x7f6bfc108150 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.178+0000 7f6c03d61640 1 -- 172.21.15.42:0/3428989756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bfc106100 con 0x7f6bfc108150 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.178+0000 7f6bf2ffd640 1 -- 172.21.15.42:0/3428989756 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf8037040 con 0x7f6bfc108150 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.178+0000 7f6c03d61640 1 -- 172.21.15.42:0/3428989756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bfc106640 con 0x7f6bfc108150 2024-09-19T09:30:06.035 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.179+0000 7f6bf2ffd640 1 -- 172.21.15.42:0/3428989756 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6bf8045070 con 0x7f6bfc108150 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.179+0000 7f6bf2ffd640 1 --2- 172.21.15.42:0/3428989756 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f6be80391b0 0x7f6be803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.179+0000 7f6bf2ffd640 1 -- 172.21.15.42:0/3428989756 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6bf806c350 con 0x7f6bfc108150 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.179+0000 7f6c03d61640 1 -- 172.21.15.42:0/3428989756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bfc1085b0 con 0x7f6bfc108150 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.179+0000 7f6c012fc640 1 --2- 172.21.15.42:0/3428989756 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f6be80391b0 0x7f6be803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.180+0000 7f6c012fc640 1 --2- 172.21.15.42:0/3428989756 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f6be80391b0 0x7f6be803b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0098c0 tx=0x7f6bec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.184+0000 7f6bf2ffd640 1 -- 172.21.15.42:0/3428989756 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6bf803cd00 con 0x7f6bfc108150 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.363+0000 7f6c03d61640 1 -- 172.21.15.42:0/3428989756 --> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f6bfc106e50 con 0x7f6be80391b0 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.364+0000 7f6bf2ffd640 1 -- 172.21.15.42:0/3428989756 <== mgr.14118 v2:172.21.15.42:6800/203737163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f6bfc106e50 con 0x7f6be80391b0 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.367+0000 7f6c03d61640 1 -- 172.21.15.42:0/3428989756 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f6be80391b0 msgr2=0x7f6be803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.367+0000 7f6c03d61640 1 --2- 172.21.15.42:0/3428989756 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f6be80391b0 0x7f6be803b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0098c0 tx=0x7f6bec006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.367+0000 7f6c03d61640 1 -- 172.21.15.42:0/3428989756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 msgr2=0x7f6bfc1079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.367+0000 7f6c03d61640 1 --2- 172.21.15.42:0/3428989756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc1079d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8032ce0 tx=0x7f6bf8032d10 comp rx=0 tx=0).stop 2024-09-19T09:30:06.036 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.367+0000 7f6c03d61640 1 -- 172.21.15.42:0/3428989756 shutdown_connections 2024-09-19T09:30:06.037 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.367+0000 7f6c03d61640 1 --2- 172.21.15.42:0/3428989756 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f6be80391b0 0x7f6be803b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.037 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.367+0000 7f6c03d61640 1 --2- 172.21.15.42:0/3428989756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bfc108150 0x7f6bfc1079d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.037 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.367+0000 7f6c03d61640 1 -- 172.21.15.42:0/3428989756 >> 172.21.15.42:0/3428989756 conn(0x7f6bfc101d90 msgr2=0x7f6bfc102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.037 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.367+0000 7f6c03d61640 1 -- 172.21.15.42:0/3428989756 shutdown_connections 2024-09-19T09:30:06.037 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:05.367+0000 7f6c03d61640 1 -- 172.21.15.42:0/3428989756 wait complete. 2024-09-19T09:30:06.037 INFO:teuthology.orchestra.run.smithi042.stdout:Generating ssh key... 2024-09-19T09:30:06.311 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-mon[31223]: [19/Sep/2024:09:30:05] ENGINE Serving on https://172.21.15.42:7150 2024-09-19T09:30:06.311 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-mon[31223]: [19/Sep/2024:09:30:05] ENGINE Error in HTTPServer.serve 2024-09-19T09:30:06.311 INFO:journalctl@ceph.mon.a.smithi042.stdout: Traceback (most recent call last): 2024-09-19T09:30:06.311 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:30:06.311 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:30:06.311 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:30:06.311 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._run(expiration_interval) 2024-09-19T09:30:06.311 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:30:06.311 INFO:journalctl@ceph.mon.a.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: s = self.context.wrap_socket( 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: return self.sslsocket_class._create( 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: self.do_handshake() 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._sslobj.do_handshake() 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-mon[31223]: [19/Sep/2024:09:30:05] ENGINE Serving on http://172.21.15.42:8765 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-mon[31223]: [19/Sep/2024:09:30:05] ENGINE Bus STARTED 2024-09-19T09:30:06.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-mon[31223]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:06.940 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: Generating public/private rsa key pair. 2024-09-19T09:30:06.940 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: Your identification has been saved in /tmp/tmppzqjjsox/key 2024-09-19T09:30:06.940 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: Your public key has been saved in /tmp/tmppzqjjsox/key.pub 2024-09-19T09:30:06.940 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: The key fingerprint is: 2024-09-19T09:30:06.940 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: SHA256:JfV+KH0t8dxDNkFkvXU8HLLilO7kJYcK1X3XA05QKTM ceph-90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:30:06.940 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: The key's randomart image is: 2024-09-19T09:30:06.940 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: +---[RSA 3072]----+ 2024-09-19T09:30:06.940 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: | ..o==Bo| 2024-09-19T09:30:06.940 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: | ..E=.=oB| 2024-09-19T09:30:06.941 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: | ...==+.*B| 2024-09-19T09:30:06.941 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: | .o+oo.+*=| 2024-09-19T09:30:06.941 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: | .S .*+o+.=| 2024-09-19T09:30:06.941 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: | . =.+o ..| 2024-09-19T09:30:06.941 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: | . o | 2024-09-19T09:30:06.941 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: | | 2024-09-19T09:30:06.941 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: | | 2024-09-19T09:30:06.941 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: +----[SHA256]-----+ 2024-09-19T09:30:07.230 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.392+0000 7fa35c3c6640 1 Processor -- start 2024-09-19T09:30:07.230 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.392+0000 7fa35c3c6640 1 -- start start 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.392+0000 7fa35c3c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35410a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.392+0000 7fa35c3c6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa35407bdb0 con 0x7fa354108200 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.393+0000 7fa35a162640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35410a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.393+0000 7fa35a162640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35410a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34942/0 (socket says 172.21.15.42:34942) 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.393+0000 7fa35a162640 1 -- 172.21.15.42:0/2906430375 learned_addr learned my addr 172.21.15.42:0/2906430375 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.393+0000 7fa35a162640 1 -- 172.21.15.42:0/2906430375 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35410ab30 con 0x7fa354108200 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.394+0000 7fa35a162640 1 --2- 172.21.15.42:0/2906430375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35410a5f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa350009820 tx=0x7fa35002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd98a3a629e0f56c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.394+0000 7fa359160640 1 -- 172.21.15.42:0/2906430375 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa350037070 con 0x7fa354108200 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.394+0000 7fa359160640 1 -- 172.21.15.42:0/2906430375 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa350032900 con 0x7fa354108200 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.394+0000 7fa359160640 1 -- 172.21.15.42:0/2906430375 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa350030850 con 0x7fa354108200 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.394+0000 7fa35c3c6640 1 -- 172.21.15.42:0/2906430375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 msgr2=0x7fa35410a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.394+0000 7fa35c3c6640 1 --2- 172.21.15.42:0/2906430375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35410a5f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa350009820 tx=0x7fa35002a270 comp rx=0 tx=0).stop 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.394+0000 7fa35c3c6640 1 -- 172.21.15.42:0/2906430375 shutdown_connections 2024-09-19T09:30:07.231 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.394+0000 7fa35c3c6640 1 --2- 172.21.15.42:0/2906430375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35410a5f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.394+0000 7fa35c3c6640 1 -- 172.21.15.42:0/2906430375 >> 172.21.15.42:0/2906430375 conn(0x7fa354101e20 msgr2=0x7fa354104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.395+0000 7fa35c3c6640 1 -- 172.21.15.42:0/2906430375 shutdown_connections 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.395+0000 7fa35c3c6640 1 -- 172.21.15.42:0/2906430375 wait complete. 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.395+0000 7fa35c3c6640 1 Processor -- start 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.395+0000 7fa35c3c6640 1 -- start start 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.395+0000 7fa35c3c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35419b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.395+0000 7fa35c3c6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa35410bb10 con 0x7fa354108200 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.395+0000 7fa35a162640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35419b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.396+0000 7fa35a162640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35419b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34956/0 (socket says 172.21.15.42:34956) 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.396+0000 7fa35a162640 1 -- 172.21.15.42:0/3543496185 learned_addr learned my addr 172.21.15.42:0/3543496185 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.396+0000 7fa35a162640 1 -- 172.21.15.42:0/3543496185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35419bc50 con 0x7fa354108200 2024-09-19T09:30:07.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.396+0000 7fa35a162640 1 --2- 172.21.15.42:0/3543496185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35419b710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa350032ce0 tx=0x7fa350032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.396+0000 7fa34b7fe640 1 -- 172.21.15.42:0/3543496185 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa350042070 con 0x7fa354108200 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.396+0000 7fa35c3c6640 1 -- 172.21.15.42:0/3543496185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa35419bee0 con 0x7fa354108200 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.396+0000 7fa34b7fe640 1 -- 172.21.15.42:0/3543496185 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3500308c0 con 0x7fa354108200 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.396+0000 7fa34b7fe640 1 -- 172.21.15.42:0/3543496185 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa350037040 con 0x7fa354108200 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.396+0000 7fa35c3c6640 1 -- 172.21.15.42:0/3543496185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa35419ebd0 con 0x7fa354108200 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.397+0000 7fa34b7fe640 1 -- 172.21.15.42:0/3543496185 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa350045070 con 0x7fa354108200 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.397+0000 7fa35c3c6640 1 -- 172.21.15.42:0/3543496185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa354108660 con 0x7fa354108200 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.397+0000 7fa34b7fe640 1 --2- 172.21.15.42:0/3543496185 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fa3400391b0 0x7fa34003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.397+0000 7fa34b7fe640 1 -- 172.21.15.42:0/3543496185 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa35006c3b0 con 0x7fa354108200 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.397+0000 7fa359961640 1 --2- 172.21.15.42:0/3543496185 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fa3400391b0 0x7fa34003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.398+0000 7fa359961640 1 --2- 172.21.15.42:0/3543496185 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fa3400391b0 0x7fa34003b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa3440098c0 tx=0x7fa344006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.402+0000 7fa34b7fe640 1 -- 172.21.15.42:0/3543496185 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa35004b170 con 0x7fa354108200 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.580+0000 7fa35c3c6640 1 -- 172.21.15.42:0/3543496185 --> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fa354103100 con 0x7fa3400391b0 2024-09-19T09:30:07.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.647+0000 7fa34b7fe640 1 -- 172.21.15.42:0/3543496185 <== mgr.14118 v2:172.21.15.42:6800/203737163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa354103100 con 0x7fa3400391b0 2024-09-19T09:30:07.234 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.649+0000 7fa35c3c6640 1 -- 172.21.15.42:0/3543496185 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fa3400391b0 msgr2=0x7fa34003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.234 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.649+0000 7fa35c3c6640 1 --2- 172.21.15.42:0/3543496185 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fa3400391b0 0x7fa34003b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa3440098c0 tx=0x7fa344006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.234 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.649+0000 7fa35c3c6640 1 -- 172.21.15.42:0/3543496185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 msgr2=0x7fa35419b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.234 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.649+0000 7fa35c3c6640 1 --2- 172.21.15.42:0/3543496185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35419b710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa350032ce0 tx=0x7fa350032d10 comp rx=0 tx=0).stop 2024-09-19T09:30:07.234 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.649+0000 7fa35c3c6640 1 -- 172.21.15.42:0/3543496185 shutdown_connections 2024-09-19T09:30:07.234 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.649+0000 7fa35c3c6640 1 --2- 172.21.15.42:0/3543496185 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fa3400391b0 0x7fa34003b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.234 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.649+0000 7fa35c3c6640 1 --2- 172.21.15.42:0/3543496185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354108200 0x7fa35419b710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.234 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.649+0000 7fa35c3c6640 1 -- 172.21.15.42:0/3543496185 >> 172.21.15.42:0/3543496185 conn(0x7fa354101e20 msgr2=0x7fa3541029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:07.234 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.649+0000 7fa35c3c6640 1 -- 172.21.15.42:0/3543496185 shutdown_connections 2024-09-19T09:30:07.234 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:06.649+0000 7fa35c3c6640 1 -- 172.21.15.42:0/3543496185 wait complete. 2024-09-19T09:30:07.796 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:07 smithi042 ceph-mon[31223]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:07.796 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:07 smithi042 ceph-mon[31223]: Generating ssh key... 2024-09-19T09:30:07.796 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:07 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:07.796 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:07 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:08.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/olNa1mqltkzCLEPopq/SEkBNYSCqzcola5ljPidI+N2bW96mt2BTqzRJpTQW68bV4/Xoh4NfII5ESXSutks/VbRfux+5tH6hdJvB6ablykl0A4gLQo586wfRMw9IpPBGD0MIMPf87Q0UP5MGOHFPpt4/KKutQB2xJt9wc6bh691jfVQW/PJt073XxzF2HW39T/c6L64IG/cdRfaXsi0WevBWo22ZjfWcOC6i8WvwYv2A2gK4gZ3NQl0I29QRAZ/LiydDe4S2ECtDqVFdzErTn7I3i9kuUv/bGFLaJ3NFQX3H49/oTCYoxsyck3fIbt5Tafiiqe/t5qRbYHHUBoEUA7yCVsi3KZsQvEcBzCtncNShymC6UrEY3xRyZucgLzKlfIzrewiq1mX6IUzfOvkA3IDw7ZXeK6oXPzri2TIRgvp/mat7cx/1+FJM87XVQh1YJCmdXACbUKCUJOlgR0iUomFPkwkhnSfCH89I+DWIXx7GlW2WfaVM9V6vMF8ICkk= ceph-90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:30:08.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.606+0000 7ff95fbf4640 1 Processor -- start 2024-09-19T09:30:08.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.606+0000 7ff95fbf4640 1 -- start start 2024-09-19T09:30:08.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.606+0000 7ff95fbf4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff958106220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:08.346 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.606+0000 7ff95fbf4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff958106760 con 0x7ff958105e20 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.607+0000 7ff95d990640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff958106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.607+0000 7ff95d990640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff958106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34964/0 (socket says 172.21.15.42:34964) 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.607+0000 7ff95d990640 1 -- 172.21.15.42:0/512026412 learned_addr learned my addr 172.21.15.42:0/512026412 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.607+0000 7ff95d990640 1 -- 172.21.15.42:0/512026412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff958106f80 con 0x7ff958105e20 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.608+0000 7ff95d990640 1 --2- 172.21.15.42:0/512026412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff958106220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff95400a9c0 tx=0x7ff95402b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466cbfe001a06596 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.608+0000 7ff95c98e640 1 -- 172.21.15.42:0/512026412 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff95400b040 con 0x7ff958105e20 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.608+0000 7ff95c98e640 1 -- 172.21.15.42:0/512026412 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff954030b00 con 0x7ff958105e20 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.608+0000 7ff95c98e640 1 -- 172.21.15.42:0/512026412 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff954032cb0 con 0x7ff958105e20 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.608+0000 7ff95fbf4640 1 -- 172.21.15.42:0/512026412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 msgr2=0x7ff958106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.608+0000 7ff95fbf4640 1 --2- 172.21.15.42:0/512026412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff958106220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff95400a9c0 tx=0x7ff95402b610 comp rx=0 tx=0).stop 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.609+0000 7ff95fbf4640 1 -- 172.21.15.42:0/512026412 shutdown_connections 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.609+0000 7ff95fbf4640 1 --2- 172.21.15.42:0/512026412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff958106220 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:08.347 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.609+0000 7ff95fbf4640 1 -- 172.21.15.42:0/512026412 >> 172.21.15.42:0/512026412 conn(0x7ff9581015f0 msgr2=0x7ff958103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:08.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.609+0000 7ff95fbf4640 1 -- 172.21.15.42:0/512026412 shutdown_connections 2024-09-19T09:30:08.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.609+0000 7ff95fbf4640 1 -- 172.21.15.42:0/512026412 wait complete. 2024-09-19T09:30:08.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.609+0000 7ff95fbf4640 1 Processor -- start 2024-09-19T09:30:08.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.609+0000 7ff95fbf4640 1 -- start start 2024-09-19T09:30:08.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.609+0000 7ff95fbf4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff95818e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:08.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.609+0000 7ff95fbf4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff958107640 con 0x7ff958105e20 2024-09-19T09:30:08.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.610+0000 7ff95d990640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff95818e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:08.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.610+0000 7ff95d990640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff95818e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34966/0 (socket says 172.21.15.42:34966) 2024-09-19T09:30:08.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.610+0000 7ff95d990640 1 -- 172.21.15.42:0/1074635580 learned_addr learned my addr 172.21.15.42:0/1074635580 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:08.348 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.610+0000 7ff95d990640 1 -- 172.21.15.42:0/1074635580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95818ef10 con 0x7ff958105e20 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.610+0000 7ff95d990640 1 --2- 172.21.15.42:0/1074635580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff95818e9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff95400a1c0 tx=0x7ff954030740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.610+0000 7ff94effd640 1 -- 172.21.15.42:0/1074635580 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff95403f070 con 0x7ff958105e20 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.610+0000 7ff94effd640 1 -- 172.21.15.42:0/1074635580 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9540325d0 con 0x7ff958105e20 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.610+0000 7ff95fbf4640 1 -- 172.21.15.42:0/1074635580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95818d100 con 0x7ff958105e20 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.610+0000 7ff94effd640 1 -- 172.21.15.42:0/1074635580 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff95403a970 con 0x7ff958105e20 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.610+0000 7ff95fbf4640 1 -- 172.21.15.42:0/1074635580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff95818d640 con 0x7ff958105e20 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.611+0000 7ff94effd640 1 -- 172.21.15.42:0/1074635580 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff954042070 con 0x7ff958105e20 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.611+0000 7ff95fbf4640 1 -- 172.21.15.42:0/1074635580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff958107cc0 con 0x7ff958105e20 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.611+0000 7ff94effd640 1 --2- 172.21.15.42:0/1074635580 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7ff944039200 0x7ff94403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.611+0000 7ff94effd640 1 -- 172.21.15.42:0/1074635580 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff95406ce80 con 0x7ff958105e20 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.612+0000 7ff95d18f640 1 --2- 172.21.15.42:0/1074635580 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7ff944039200 0x7ff94403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.612+0000 7ff95d18f640 1 --2- 172.21.15.42:0/1074635580 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7ff944039200 0x7ff94403b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9480098c0 tx=0x7ff948006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:08.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.616+0000 7ff94effd640 1 -- 172.21.15.42:0/1074635580 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9540412c0 con 0x7ff958105e20 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.795+0000 7ff95fbf4640 1 -- 172.21.15.42:0/1074635580 --> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7ff958195120 con 0x7ff944039200 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.795+0000 7ff94effd640 1 -- 172.21.15.42:0/1074635580 <== mgr.14118 v2:172.21.15.42:6800/203737163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7ff958195120 con 0x7ff944039200 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.798+0000 7ff95fbf4640 1 -- 172.21.15.42:0/1074635580 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7ff944039200 msgr2=0x7ff94403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.798+0000 7ff95fbf4640 1 --2- 172.21.15.42:0/1074635580 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7ff944039200 0x7ff94403b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9480098c0 tx=0x7ff948006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.798+0000 7ff95fbf4640 1 -- 172.21.15.42:0/1074635580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 msgr2=0x7ff95818e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.798+0000 7ff95fbf4640 1 --2- 172.21.15.42:0/1074635580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff95818e9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff95400a1c0 tx=0x7ff954030740 comp rx=0 tx=0).stop 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.798+0000 7ff95fbf4640 1 -- 172.21.15.42:0/1074635580 shutdown_connections 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.798+0000 7ff95fbf4640 1 --2- 172.21.15.42:0/1074635580 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7ff944039200 0x7ff94403b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.798+0000 7ff95fbf4640 1 --2- 172.21.15.42:0/1074635580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff958105e20 0x7ff95818e9d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.798+0000 7ff95fbf4640 1 -- 172.21.15.42:0/1074635580 >> 172.21.15.42:0/1074635580 conn(0x7ff9581015f0 msgr2=0x7ff958192360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.798+0000 7ff95fbf4640 1 -- 172.21.15.42:0/1074635580 shutdown_connections 2024-09-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:07.798+0000 7ff95fbf4640 1 -- 172.21.15.42:0/1074635580 wait complete. 2024-09-19T09:30:08.351 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:30:08.351 INFO:teuthology.orchestra.run.smithi042.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T09:30:08.351 INFO:teuthology.orchestra.run.smithi042.stdout:Adding host smithi042... 2024-09-19T09:30:08.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:08 smithi042 ceph-mon[31223]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:09.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:09 smithi042 ceph-mon[31223]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi042", "addr": "172.21.15.42", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:11.173 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:11 smithi042 ceph-mon[31223]: Deploying cephadm binary to smithi042 2024-09-19T09:30:13.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Added host 'smithi042' with addr '172.21.15.42' 2024-09-19T09:30:13.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.748+0000 7fc78ae70640 1 Processor -- start 2024-09-19T09:30:13.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.748+0000 7fc78ae70640 1 -- start start 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.748+0000 7fc78ae70640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc784107b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.748+0000 7fc78ae70640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc784108150 con 0x7fc784107780 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.748+0000 7fc788c0c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc784107b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.748+0000 7fc788c0c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc784107b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34976/0 (socket says 172.21.15.42:34976) 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.748+0000 7fc788c0c640 1 -- 172.21.15.42:0/3333056779 learned_addr learned my addr 172.21.15.42:0/3333056779 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.748+0000 7fc788c0c640 1 -- 172.21.15.42:0/3333056779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc784108980 con 0x7fc784107780 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.749+0000 7fc788c0c640 1 --2- 172.21.15.42:0/3333056779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc784107b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc780009820 tx=0x7fc78002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496e4a57a9ed95b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.749+0000 7fc77b7fe640 1 -- 172.21.15.42:0/3333056779 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc780037070 con 0x7fc784107780 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.749+0000 7fc77b7fe640 1 -- 172.21.15.42:0/3333056779 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc780032900 con 0x7fc784107780 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.749+0000 7fc77b7fe640 1 -- 172.21.15.42:0/3333056779 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc780030850 con 0x7fc784107780 2024-09-19T09:30:13.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.750+0000 7fc78ae70640 1 -- 172.21.15.42:0/3333056779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 msgr2=0x7fc784107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.750+0000 7fc78ae70640 1 --2- 172.21.15.42:0/3333056779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc784107b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc780009820 tx=0x7fc78002a270 comp rx=0 tx=0).stop 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.750+0000 7fc78ae70640 1 -- 172.21.15.42:0/3333056779 shutdown_connections 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.750+0000 7fc78ae70640 1 --2- 172.21.15.42:0/3333056779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc784107b80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.750+0000 7fc78ae70640 1 -- 172.21.15.42:0/3333056779 >> 172.21.15.42:0/3333056779 conn(0x7fc784102f30 msgr2=0x7fc784105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.750+0000 7fc78ae70640 1 -- 172.21.15.42:0/3333056779 shutdown_connections 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.750+0000 7fc78ae70640 1 -- 172.21.15.42:0/3333056779 wait complete. 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.750+0000 7fc78ae70640 1 Processor -- start 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.750+0000 7fc78ae70640 1 -- start start 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc78ae70640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc78407daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc78ae70640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc78410bd30 con 0x7fc784107780 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc788c0c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc78407daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc788c0c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc78407daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34990/0 (socket says 172.21.15.42:34990) 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc788c0c640 1 -- 172.21.15.42:0/3867548987 learned_addr learned my addr 172.21.15.42:0/3867548987 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc788c0c640 1 -- 172.21.15.42:0/3867548987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78407e030 con 0x7fc784107780 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc788c0c640 1 --2- 172.21.15.42:0/3867548987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc78407daf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc780009940 tx=0x7fc780032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc779ffb640 1 -- 172.21.15.42:0/3867548987 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc780042070 con 0x7fc784107780 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc779ffb640 1 -- 172.21.15.42:0/3867548987 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc7800308c0 con 0x7fc784107780 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc78ae70640 1 -- 172.21.15.42:0/3867548987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc78407c220 con 0x7fc784107780 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc779ffb640 1 -- 172.21.15.42:0/3867548987 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc780037040 con 0x7fc784107780 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.751+0000 7fc78ae70640 1 -- 172.21.15.42:0/3867548987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc78407c760 con 0x7fc784107780 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.752+0000 7fc779ffb640 1 -- 172.21.15.42:0/3867548987 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc780045070 con 0x7fc784107780 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.753+0000 7fc78ae70640 1 -- 172.21.15.42:0/3867548987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc784107c00 con 0x7fc784107780 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.753+0000 7fc779ffb640 1 --2- 172.21.15.42:0/3867548987 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fc76c0391b0 0x7fc76c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.753+0000 7fc779ffb640 1 -- 172.21.15.42:0/3867548987 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc78006c330 con 0x7fc784107780 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.753+0000 7fc77bfff640 1 --2- 172.21.15.42:0/3867548987 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fc76c0391b0 0x7fc76c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.753+0000 7fc77bfff640 1 --2- 172.21.15.42:0/3867548987 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fc76c0391b0 0x7fc76c03b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7740098c0 tx=0x7fc774006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.758+0000 7fc779ffb640 1 -- 172.21.15.42:0/3867548987 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc78003cd90 con 0x7fc784107780 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:08.937+0000 7fc78ae70640 1 -- 172.21.15.42:0/3867548987 --> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi042", "addr": "172.21.15.42", "target": ["mon-mgr", ""]}) -- 0x7fc78407d0b0 con 0x7fc76c0391b0 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.806+0000 7fc779ffb640 1 -- 172.21.15.42:0/3867548987 <== mgr.14118 v2:172.21.15.42:6800/203737163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fc78407d0b0 con 0x7fc76c0391b0 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.810+0000 7fc78ae70640 1 -- 172.21.15.42:0/3867548987 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fc76c0391b0 msgr2=0x7fc76c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.810+0000 7fc78ae70640 1 --2- 172.21.15.42:0/3867548987 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fc76c0391b0 0x7fc76c03b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7740098c0 tx=0x7fc774006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.810+0000 7fc78ae70640 1 -- 172.21.15.42:0/3867548987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 msgr2=0x7fc78407daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.810+0000 7fc78ae70640 1 --2- 172.21.15.42:0/3867548987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc78407daf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc780009940 tx=0x7fc780032ce0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.810+0000 7fc78ae70640 1 -- 172.21.15.42:0/3867548987 shutdown_connections 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.810+0000 7fc78ae70640 1 --2- 172.21.15.42:0/3867548987 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fc76c0391b0 0x7fc76c03b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.810+0000 7fc78ae70640 1 --2- 172.21.15.42:0/3867548987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc784107780 0x7fc78407daf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.451 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.810+0000 7fc78ae70640 1 -- 172.21.15.42:0/3867548987 >> 172.21.15.42:0/3867548987 conn(0x7fc784102f30 msgr2=0x7fc784103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:13.452 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.810+0000 7fc78ae70640 1 -- 172.21.15.42:0/3867548987 shutdown_connections 2024-09-19T09:30:13.452 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:12.810+0000 7fc78ae70640 1 -- 172.21.15.42:0/3867548987 wait complete. 2024-09-19T09:30:13.452 INFO:teuthology.orchestra.run.smithi042.stdout:Deploying unmanaged mon service... 2024-09-19T09:30:14.047 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:13 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:14.047 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:13 smithi042 ceph-mon[31223]: Added host smithi042 2024-09-19T09:30:14.047 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:13 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:14.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T09:30:14.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.825+0000 7f30633a1640 1 Processor -- start 2024-09-19T09:30:14.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.825+0000 7f30633a1640 1 -- start start 2024-09-19T09:30:14.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.825+0000 7f30633a1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c10a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:14.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.825+0000 7f30633a1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f305c07be30 con 0x7f305c107fc0 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.825+0000 7f306239f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c10a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.825+0000 7f306239f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c10a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51098/0 (socket says 172.21.15.42:51098) 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.825+0000 7f306239f640 1 -- 172.21.15.42:0/2028763069 learned_addr learned my addr 172.21.15.42:0/2028763069 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.826+0000 7f306239f640 1 -- 172.21.15.42:0/2028763069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305c10a8f0 con 0x7f305c107fc0 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.826+0000 7f306239f640 1 --2- 172.21.15.42:0/2028763069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c10a3b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3058009820 tx=0x7f305802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5a4ea6085b655f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.826+0000 7f306139d640 1 -- 172.21.15.42:0/2028763069 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3058037070 con 0x7f305c107fc0 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.827+0000 7f306139d640 1 -- 172.21.15.42:0/2028763069 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3058032900 con 0x7f305c107fc0 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.827+0000 7f306139d640 1 -- 172.21.15.42:0/2028763069 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3058030850 con 0x7f305c107fc0 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.827+0000 7f30633a1640 1 -- 172.21.15.42:0/2028763069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 msgr2=0x7f305c10a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.827+0000 7f30633a1640 1 --2- 172.21.15.42:0/2028763069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c10a3b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3058009820 tx=0x7f305802a270 comp rx=0 tx=0).stop 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.827+0000 7f30633a1640 1 -- 172.21.15.42:0/2028763069 shutdown_connections 2024-09-19T09:30:14.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.827+0000 7f30633a1640 1 --2- 172.21.15.42:0/2028763069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c10a3b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.827+0000 7f30633a1640 1 -- 172.21.15.42:0/2028763069 >> 172.21.15.42:0/2028763069 conn(0x7f305c101c60 msgr2=0x7f305c104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.827+0000 7f30633a1640 1 -- 172.21.15.42:0/2028763069 shutdown_connections 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.827+0000 7f30633a1640 1 -- 172.21.15.42:0/2028763069 wait complete. 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.828+0000 7f30633a1640 1 Processor -- start 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.828+0000 7f30633a1640 1 -- start start 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.828+0000 7f30633a1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c19d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.828+0000 7f30633a1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f305c10b990 con 0x7f305c107fc0 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.828+0000 7f306239f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c19d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.828+0000 7f306239f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c19d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51108/0 (socket says 172.21.15.42:51108) 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.828+0000 7f306239f640 1 -- 172.21.15.42:0/1831967210 learned_addr learned my addr 172.21.15.42:0/1831967210 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.828+0000 7f306239f640 1 -- 172.21.15.42:0/1831967210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305c19dce0 con 0x7f305c107fc0 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.829+0000 7f306239f640 1 --2- 172.21.15.42:0/1831967210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c19d7a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3058031000 tx=0x7f30580326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:14.817 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.829+0000 7f30537fe640 1 -- 172.21.15.42:0/1831967210 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3058042070 con 0x7f305c107fc0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.829+0000 7f30633a1640 1 -- 172.21.15.42:0/1831967210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305c19df70 con 0x7f305c107fc0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.829+0000 7f30537fe640 1 -- 172.21.15.42:0/1831967210 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3058032be0 con 0x7f305c107fc0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.829+0000 7f30537fe640 1 -- 172.21.15.42:0/1831967210 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3058037040 con 0x7f305c107fc0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.829+0000 7f30633a1640 1 -- 172.21.15.42:0/1831967210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305c1a0c60 con 0x7f305c107fc0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.830+0000 7f30537fe640 1 -- 172.21.15.42:0/1831967210 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3058045070 con 0x7f305c107fc0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.830+0000 7f30633a1640 1 -- 172.21.15.42:0/1831967210 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f305c108420 con 0x7f305c107fc0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.830+0000 7f30537fe640 1 --2- 172.21.15.42:0/1831967210 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3048039200 0x7f304803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.830+0000 7f30537fe640 1 -- 172.21.15.42:0/1831967210 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f305806c1e0 con 0x7f305c107fc0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.830+0000 7f3061b9e640 1 --2- 172.21.15.42:0/1831967210 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3048039200 0x7f304803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.831+0000 7f3061b9e640 1 --2- 172.21.15.42:0/1831967210 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3048039200 0x7f304803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f304c0098c0 tx=0x7f304c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:13.835+0000 7f30537fe640 1 -- 172.21.15.42:0/1831967210 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f305804b170 con 0x7f305c107fc0 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.045+0000 7f30633a1640 1 -- 172.21.15.42:0/1831967210 --> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f305c102ee0 con 0x7f3048039200 2024-09-19T09:30:14.818 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.050+0000 7f30537fe640 1 -- 172.21.15.42:0/1831967210 <== mgr.14118 v2:172.21.15.42:6800/203737163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f305c102ee0 con 0x7f3048039200 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.052+0000 7f30633a1640 1 -- 172.21.15.42:0/1831967210 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3048039200 msgr2=0x7f304803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.052+0000 7f30633a1640 1 --2- 172.21.15.42:0/1831967210 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3048039200 0x7f304803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f304c0098c0 tx=0x7f304c006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.052+0000 7f30633a1640 1 -- 172.21.15.42:0/1831967210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 msgr2=0x7f305c19d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.052+0000 7f30633a1640 1 --2- 172.21.15.42:0/1831967210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c19d7a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3058031000 tx=0x7f30580326e0 comp rx=0 tx=0).stop 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.052+0000 7f30633a1640 1 -- 172.21.15.42:0/1831967210 shutdown_connections 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.052+0000 7f30633a1640 1 --2- 172.21.15.42:0/1831967210 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3048039200 0x7f304803b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.052+0000 7f30633a1640 1 --2- 172.21.15.42:0/1831967210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f305c107fc0 0x7f305c19d7a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.052+0000 7f30633a1640 1 -- 172.21.15.42:0/1831967210 >> 172.21.15.42:0/1831967210 conn(0x7f305c101c60 msgr2=0x7f305c1027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.052+0000 7f30633a1640 1 -- 172.21.15.42:0/1831967210 shutdown_connections 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:14.052+0000 7f30633a1640 1 -- 172.21.15.42:0/1831967210 wait complete. 2024-09-19T09:30:14.819 INFO:teuthology.orchestra.run.smithi042.stdout:Deploying unmanaged mgr service... 2024-09-19T09:30:15.135 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:15 smithi042 ceph-mon[31223]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:15.135 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:15 smithi042 ceph-mon[31223]: Saving service mon spec with placement count:5 2024-09-19T09:30:15.135 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:15 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:16.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:16 smithi042 ceph-mon[31223]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:16.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:16 smithi042 ceph-mon[31223]: Saving service mgr spec with placement count:2 2024-09-19T09:30:16.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:16 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.218+0000 7f3e0c26c640 1 Processor -- start 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.218+0000 7f3e0c26c640 1 -- start start 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.219+0000 7f3e0c26c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0410a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.219+0000 7f3e0c26c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0407bdd0 con 0x7f3e041081a0 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.219+0000 7f3e0a008640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0410a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.219+0000 7f3e0a008640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0410a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51116/0 (socket says 172.21.15.42:51116) 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.219+0000 7f3e0a008640 1 -- 172.21.15.42:0/1150391358 learned_addr learned my addr 172.21.15.42:0/1150391358 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.219+0000 7f3e0a008640 1 -- 172.21.15.42:0/1150391358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0410aad0 con 0x7f3e041081a0 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.220+0000 7f3e0a008640 1 --2- 172.21.15.42:0/1150391358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0410a590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009820 tx=0x7f3e0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c406f10cb75e6cad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.220+0000 7f3e09006640 1 -- 172.21.15.42:0/1150391358 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e00037070 con 0x7f3e041081a0 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.220+0000 7f3e09006640 1 -- 172.21.15.42:0/1150391358 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e00032900 con 0x7f3e041081a0 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.220+0000 7f3e09006640 1 -- 172.21.15.42:0/1150391358 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e00030850 con 0x7f3e041081a0 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.220+0000 7f3e0c26c640 1 -- 172.21.15.42:0/1150391358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 msgr2=0x7f3e0410a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.220+0000 7f3e0c26c640 1 --2- 172.21.15.42:0/1150391358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0410a590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009820 tx=0x7f3e0002a270 comp rx=0 tx=0).stop 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.221+0000 7f3e0c26c640 1 -- 172.21.15.42:0/1150391358 shutdown_connections 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.221+0000 7f3e0c26c640 1 --2- 172.21.15.42:0/1150391358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0410a590 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.221+0000 7f3e0c26c640 1 -- 172.21.15.42:0/1150391358 >> 172.21.15.42:0/1150391358 conn(0x7f3e04101e20 msgr2=0x7f3e04104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.221+0000 7f3e0c26c640 1 -- 172.21.15.42:0/1150391358 shutdown_connections 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.221+0000 7f3e0c26c640 1 -- 172.21.15.42:0/1150391358 wait complete. 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.221+0000 7f3e0c26c640 1 Processor -- start 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.221+0000 7f3e0c26c640 1 -- start start 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3e0c26c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:16.847 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3e0c26c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0410bb10 con 0x7f3e041081a0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3e0a008640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3e0a008640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0419b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51120/0 (socket says 172.21.15.42:51120) 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3e0a008640 1 -- 172.21.15.42:0/811516858 learned_addr learned my addr 172.21.15.42:0/811516858 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3e0a008640 1 -- 172.21.15.42:0/811516858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0419bc10 con 0x7f3e041081a0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3e0a008640 1 --2- 172.21.15.42:0/811516858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0419b6d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e000097f0 tx=0x7f3e00030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3dfb7fe640 1 -- 172.21.15.42:0/811516858 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e00037040 con 0x7f3e041081a0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3dfb7fe640 1 -- 172.21.15.42:0/811516858 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e00040070 con 0x7f3e041081a0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3e0c26c640 1 -- 172.21.15.42:0/811516858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0419bea0 con 0x7f3e041081a0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3dfb7fe640 1 -- 172.21.15.42:0/811516858 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e0003a390 con 0x7f3e041081a0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.222+0000 7f3e0c26c640 1 -- 172.21.15.42:0/811516858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0419eb90 con 0x7f3e041081a0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.223+0000 7f3e0c26c640 1 -- 172.21.15.42:0/811516858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e04108600 con 0x7f3e041081a0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.223+0000 7f3dfb7fe640 1 -- 172.21.15.42:0/811516858 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3e0003b430 con 0x7f3e041081a0 2024-09-19T09:30:16.848 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.224+0000 7f3dfb7fe640 1 --2- 172.21.15.42:0/811516858 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3df00391b0 0x7f3df003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.224+0000 7f3dfb7fe640 1 -- 172.21.15.42:0/811516858 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3e0006c790 con 0x7f3e041081a0 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.224+0000 7f3e09807640 1 --2- 172.21.15.42:0/811516858 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3df00391b0 0x7f3df003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.224+0000 7f3e09807640 1 --2- 172.21.15.42:0/811516858 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3df00391b0 0x7f3df003b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3df40098c0 tx=0x7f3df4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.229+0000 7f3dfb7fe640 1 -- 172.21.15.42:0/811516858 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e00032900 con 0x7f3e041081a0 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.420+0000 7f3e0c26c640 1 -- 172.21.15.42:0/811516858 --> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f3e041030f0 con 0x7f3df00391b0 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.425+0000 7f3dfb7fe640 1 -- 172.21.15.42:0/811516858 <== mgr.14118 v2:172.21.15.42:6800/203737163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3e041030f0 con 0x7f3df00391b0 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.427+0000 7f3e0c26c640 1 -- 172.21.15.42:0/811516858 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3df00391b0 msgr2=0x7f3df003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.427+0000 7f3e0c26c640 1 --2- 172.21.15.42:0/811516858 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3df00391b0 0x7f3df003b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3df40098c0 tx=0x7f3df4006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.427+0000 7f3e0c26c640 1 -- 172.21.15.42:0/811516858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 msgr2=0x7f3e0419b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.427+0000 7f3e0c26c640 1 --2- 172.21.15.42:0/811516858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0419b6d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e000097f0 tx=0x7f3e00030d80 comp rx=0 tx=0).stop 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.427+0000 7f3e0c26c640 1 -- 172.21.15.42:0/811516858 shutdown_connections 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.427+0000 7f3e0c26c640 1 --2- 172.21.15.42:0/811516858 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f3df00391b0 0x7f3df003b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:16.849 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.427+0000 7f3e0c26c640 1 --2- 172.21.15.42:0/811516858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e041081a0 0x7f3e0419b6d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:16.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.427+0000 7f3e0c26c640 1 -- 172.21.15.42:0/811516858 >> 172.21.15.42:0/811516858 conn(0x7f3e04101e20 msgr2=0x7f3e041029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:16.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.427+0000 7f3e0c26c640 1 -- 172.21.15.42:0/811516858 shutdown_connections 2024-09-19T09:30:16.850 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:15.427+0000 7f3e0c26c640 1 -- 172.21.15.42:0/811516858 wait complete. 2024-09-19T09:30:17.528 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:17 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:17.528 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:17 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:18.748 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:18 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/34964204' entity='client.admin' 2024-09-19T09:30:18.749 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:18 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:18.756 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.327+0000 7f2c74106640 1 Processor -- start 2024-09-19T09:30:18.756 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.327+0000 7f2c74106640 1 -- start start 2024-09-19T09:30:18.756 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.327+0000 7f2c74106640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c10a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:18.756 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.327+0000 7f2c74106640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c07bd70 con 0x7f2c6c108200 2024-09-19T09:30:18.756 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.327+0000 7f2c71ea2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c10a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.327+0000 7f2c71ea2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c10a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51136/0 (socket says 172.21.15.42:51136) 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.327+0000 7f2c71ea2640 1 -- 172.21.15.42:0/3586201445 learned_addr learned my addr 172.21.15.42:0/3586201445 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.327+0000 7f2c71ea2640 1 -- 172.21.15.42:0/3586201445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c10ab30 con 0x7f2c6c108200 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.328+0000 7f2c71ea2640 1 --2- 172.21.15.42:0/3586201445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c10a5f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009820 tx=0x7f2c6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb264809cff1101d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.328+0000 7f2c70ea0640 1 -- 172.21.15.42:0/3586201445 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c68037070 con 0x7f2c6c108200 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.328+0000 7f2c70ea0640 1 -- 172.21.15.42:0/3586201445 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c68032920 con 0x7f2c6c108200 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.328+0000 7f2c70ea0640 1 -- 172.21.15.42:0/3586201445 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c68030810 con 0x7f2c6c108200 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.329+0000 7f2c74106640 1 -- 172.21.15.42:0/3586201445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 msgr2=0x7f2c6c10a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.329+0000 7f2c74106640 1 --2- 172.21.15.42:0/3586201445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c10a5f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009820 tx=0x7f2c6802a270 comp rx=0 tx=0).stop 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.330+0000 7f2c74106640 1 -- 172.21.15.42:0/3586201445 shutdown_connections 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.330+0000 7f2c74106640 1 --2- 172.21.15.42:0/3586201445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c10a5f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.330+0000 7f2c74106640 1 -- 172.21.15.42:0/3586201445 >> 172.21.15.42:0/3586201445 conn(0x7f2c6c101e20 msgr2=0x7f2c6c104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.330+0000 7f2c74106640 1 -- 172.21.15.42:0/3586201445 shutdown_connections 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.330+0000 7f2c74106640 1 -- 172.21.15.42:0/3586201445 wait complete. 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.330+0000 7f2c74106640 1 Processor -- start 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.330+0000 7f2c74106640 1 -- start start 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.330+0000 7f2c74106640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.330+0000 7f2c74106640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c10bb50 con 0x7f2c6c108200 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.331+0000 7f2c71ea2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.331+0000 7f2c71ea2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c19b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51142/0 (socket says 172.21.15.42:51142) 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.331+0000 7f2c71ea2640 1 -- 172.21.15.42:0/34964204 learned_addr learned my addr 172.21.15.42:0/34964204 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.331+0000 7f2c71ea2640 1 -- 172.21.15.42:0/34964204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c19bc50 con 0x7f2c6c108200 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.331+0000 7f2c71ea2640 1 --2- 172.21.15.42:0/34964204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c19b710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c68030380 tx=0x7f2c68032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.331+0000 7f2c62ffd640 1 -- 172.21.15.42:0/34964204 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c68037040 con 0x7f2c6c108200 2024-09-19T09:30:18.758 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.331+0000 7f2c62ffd640 1 -- 172.21.15.42:0/34964204 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c68040070 con 0x7f2c6c108200 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.331+0000 7f2c74106640 1 -- 172.21.15.42:0/34964204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c19bee0 con 0x7f2c6c108200 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.331+0000 7f2c62ffd640 1 -- 172.21.15.42:0/34964204 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6803a7b0 con 0x7f2c6c108200 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.332+0000 7f2c74106640 1 -- 172.21.15.42:0/34964204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c19ebd0 con 0x7f2c6c108200 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.333+0000 7f2c74106640 1 -- 172.21.15.42:0/34964204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c108660 con 0x7f2c6c108200 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.333+0000 7f2c62ffd640 1 -- 172.21.15.42:0/34964204 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f2c6803a9e0 con 0x7f2c6c108200 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.333+0000 7f2c62ffd640 1 --2- 172.21.15.42:0/34964204 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f2c58039200 0x7f2c5803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.333+0000 7f2c62ffd640 1 -- 172.21.15.42:0/34964204 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2c6806c900 con 0x7f2c6c108200 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.333+0000 7f2c716a1640 1 --2- 172.21.15.42:0/34964204 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f2c58039200 0x7f2c5803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.334+0000 7f2c716a1640 1 --2- 172.21.15.42:0/34964204 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f2c58039200 0x7f2c5803b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0098c0 tx=0x7f2c5c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.338+0000 7f2c62ffd640 1 -- 172.21.15.42:0/34964204 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c68044c70 con 0x7f2c6c108200 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.527+0000 7f2c74106640 1 -- 172.21.15.42:0/34964204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f2c6c19f200 con 0x7f2c6c108200 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.529+0000 7f2c62ffd640 1 -- 172.21.15.42:0/34964204 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f2c68041270 con 0x7f2c6c108200 2024-09-19T09:30:18.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.532+0000 7f2c74106640 1 -- 172.21.15.42:0/34964204 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f2c58039200 msgr2=0x7f2c5803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:18.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.532+0000 7f2c74106640 1 --2- 172.21.15.42:0/34964204 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f2c58039200 0x7f2c5803b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0098c0 tx=0x7f2c5c006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:18.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.532+0000 7f2c74106640 1 -- 172.21.15.42:0/34964204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 msgr2=0x7f2c6c19b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:18.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.532+0000 7f2c74106640 1 --2- 172.21.15.42:0/34964204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c19b710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c68030380 tx=0x7f2c68032670 comp rx=0 tx=0).stop 2024-09-19T09:30:18.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.532+0000 7f2c74106640 1 -- 172.21.15.42:0/34964204 shutdown_connections 2024-09-19T09:30:18.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.532+0000 7f2c74106640 1 --2- 172.21.15.42:0/34964204 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f2c58039200 0x7f2c5803b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:18.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.532+0000 7f2c74106640 1 --2- 172.21.15.42:0/34964204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c6c108200 0x7f2c6c19b710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:18.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.532+0000 7f2c74106640 1 -- 172.21.15.42:0/34964204 >> 172.21.15.42:0/34964204 conn(0x7f2c6c101e20 msgr2=0x7f2c6c102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:18.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.532+0000 7f2c74106640 1 -- 172.21.15.42:0/34964204 shutdown_connections 2024-09-19T09:30:18.760 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:17.532+0000 7f2c74106640 1 -- 172.21.15.42:0/34964204 wait complete. 2024-09-19T09:30:19.955 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.145+0000 7f7677e8a640 1 Processor -- start 2024-09-19T09:30:19.956 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.145+0000 7f7677e8a640 1 -- start start 2024-09-19T09:30:19.956 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.145+0000 7f7677e8a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767010a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.956 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.145+0000 7f7677e8a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f767007bdb0 con 0x7f76701081c0 2024-09-19T09:30:19.956 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.146+0000 7f7675c26640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767010a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.956 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.146+0000 7f7675c26640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767010a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51144/0 (socket says 172.21.15.42:51144) 2024-09-19T09:30:19.956 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.146+0000 7f7675c26640 1 -- 172.21.15.42:0/1655386492 learned_addr learned my addr 172.21.15.42:0/1655386492 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:19.956 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.146+0000 7f7675c26640 1 -- 172.21.15.42:0/1655386492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767010aaf0 con 0x7f76701081c0 2024-09-19T09:30:19.956 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.147+0000 7f7675c26640 1 --2- 172.21.15.42:0/1655386492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767010a5b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f766c009820 tx=0x7f766c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7a3d5a34bd75a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:19.956 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.147+0000 7f7674c24640 1 -- 172.21.15.42:0/1655386492 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c037070 con 0x7f76701081c0 2024-09-19T09:30:19.956 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.147+0000 7f7674c24640 1 -- 172.21.15.42:0/1655386492 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f766c032920 con 0x7f76701081c0 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.147+0000 7f7674c24640 1 -- 172.21.15.42:0/1655386492 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c030810 con 0x7f76701081c0 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.147+0000 7f7677e8a640 1 -- 172.21.15.42:0/1655386492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 msgr2=0x7f767010a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.147+0000 7f7677e8a640 1 --2- 172.21.15.42:0/1655386492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767010a5b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f766c009820 tx=0x7f766c02a270 comp rx=0 tx=0).stop 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.147+0000 7f7677e8a640 1 -- 172.21.15.42:0/1655386492 shutdown_connections 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.147+0000 7f7677e8a640 1 --2- 172.21.15.42:0/1655386492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767010a5b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.148+0000 7f7677e8a640 1 -- 172.21.15.42:0/1655386492 >> 172.21.15.42:0/1655386492 conn(0x7f7670101e20 msgr2=0x7f7670104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.148+0000 7f7677e8a640 1 -- 172.21.15.42:0/1655386492 shutdown_connections 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.148+0000 7f7677e8a640 1 -- 172.21.15.42:0/1655386492 wait complete. 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.148+0000 7f7677e8a640 1 Processor -- start 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.148+0000 7f7677e8a640 1 -- start start 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.148+0000 7f7677e8a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767019b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.148+0000 7f7677e8a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f767010bb10 con 0x7f76701081c0 2024-09-19T09:30:19.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.149+0000 7f7675c26640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767019b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.149+0000 7f7675c26640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767019b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51148/0 (socket says 172.21.15.42:51148) 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.149+0000 7f7675c26640 1 -- 172.21.15.42:0/667622519 learned_addr learned my addr 172.21.15.42:0/667622519 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.149+0000 7f7675c26640 1 -- 172.21.15.42:0/667622519 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767019bcb0 con 0x7f76701081c0 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.149+0000 7f7675c26640 1 --2- 172.21.15.42:0/667622519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767019b770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f766c030380 tx=0x7f766c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.149+0000 7f7666ffd640 1 -- 172.21.15.42:0/667622519 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c037040 con 0x7f76701081c0 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.149+0000 7f7677e8a640 1 -- 172.21.15.42:0/667622519 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767019bf40 con 0x7f76701081c0 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.149+0000 7f7666ffd640 1 -- 172.21.15.42:0/667622519 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f766c040070 con 0x7f76701081c0 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.149+0000 7f7666ffd640 1 -- 172.21.15.42:0/667622519 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c03a7b0 con 0x7f76701081c0 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.149+0000 7f7677e8a640 1 -- 172.21.15.42:0/667622519 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767019ec30 con 0x7f76701081c0 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.150+0000 7f7666ffd640 1 -- 172.21.15.42:0/667622519 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f766c03bc00 con 0x7f76701081c0 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.150+0000 7f7666ffd640 1 --2- 172.21.15.42:0/667622519 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f765c0391b0 0x7f765c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.958 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.150+0000 7f7677e8a640 1 -- 172.21.15.42:0/667622519 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7670108620 con 0x7f76701081c0 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.150+0000 7f7666ffd640 1 -- 172.21.15.42:0/667622519 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f766c06c900 con 0x7f76701081c0 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.151+0000 7f7675425640 1 --2- 172.21.15.42:0/667622519 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f765c0391b0 0x7f765c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.151+0000 7f7675425640 1 --2- 172.21.15.42:0/667622519 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f765c0391b0 0x7f765c03b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f76600098c0 tx=0x7f7660006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.155+0000 7f7666ffd640 1 -- 172.21.15.42:0/667622519 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f766c040220 con 0x7f76701081c0 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.331+0000 7f7677e8a640 1 -- 172.21.15.42:0/667622519 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f767019ee00 con 0x7f76701081c0 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.333+0000 7f7666ffd640 1 -- 172.21.15.42:0/667622519 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f766c042d80 con 0x7f76701081c0 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.336+0000 7f7677e8a640 1 -- 172.21.15.42:0/667622519 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f765c0391b0 msgr2=0x7f765c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.336+0000 7f7677e8a640 1 --2- 172.21.15.42:0/667622519 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f765c0391b0 0x7f765c03b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f76600098c0 tx=0x7f7660006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.336+0000 7f7677e8a640 1 -- 172.21.15.42:0/667622519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 msgr2=0x7f767019b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.336+0000 7f7677e8a640 1 --2- 172.21.15.42:0/667622519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767019b770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f766c030380 tx=0x7f766c032670 comp rx=0 tx=0).stop 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.336+0000 7f7677e8a640 1 -- 172.21.15.42:0/667622519 shutdown_connections 2024-09-19T09:30:19.959 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.336+0000 7f7677e8a640 1 --2- 172.21.15.42:0/667622519 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f765c0391b0 0x7f765c03b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.960 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.336+0000 7f7677e8a640 1 --2- 172.21.15.42:0/667622519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76701081c0 0x7f767019b770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.960 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.336+0000 7f7677e8a640 1 -- 172.21.15.42:0/667622519 >> 172.21.15.42:0/667622519 conn(0x7f7670101e20 msgr2=0x7f76701029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:19.960 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.336+0000 7f7677e8a640 1 -- 172.21.15.42:0/667622519 shutdown_connections 2024-09-19T09:30:19.960 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:19.336+0000 7f7677e8a640 1 -- 172.21.15.42:0/667622519 wait complete. 2024-09-19T09:30:19.960 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling the dashboard module... 2024-09-19T09:30:20.560 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:20 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/667622519' entity='client.admin' 2024-09-19T09:30:20.560 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:20 smithi042 ceph-mon[31223]: from='mgr.14118 172.21.15.42:0/562519745' entity='mgr.x' 2024-09-19T09:30:21.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:21 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2763864620' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T09:30:21.704 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: ignoring --setuser ceph since I am not root 2024-09-19T09:30:21.704 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: ignoring --setgroup ceph since I am not root 2024-09-19T09:30:21.704 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:21.498+0000 7ffab2e1b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:30:21.704 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:21.558+0000 7ffab2e1b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:30:22.085 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:21.714+0000 7ffab2e1b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:30:22.085 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:21.783+0000 7ffab2e1b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:30:22.085 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:21.938+0000 7ffab2e1b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:30:22.086 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:22 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:22.084+0000 7ffab2e1b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:30:22.143 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.367+0000 7fcdec2c5640 1 Processor -- start 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.367+0000 7fcdec2c5640 1 -- start start 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.367+0000 7fcdec2c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde407c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.367+0000 7fcdec2c5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcde407c850 con 0x7fcde407de20 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.367+0000 7fcdea061640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde407c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.367+0000 7fcdea061640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde407c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48392/0 (socket says 172.21.15.42:48392) 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.367+0000 7fcdea061640 1 -- 172.21.15.42:0/643586834 learned_addr learned my addr 172.21.15.42:0/643586834 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.368+0000 7fcdea061640 1 -- 172.21.15.42:0/643586834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde407c9d0 con 0x7fcde407de20 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.368+0000 7fcdea061640 1 --2- 172.21.15.42:0/643586834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde407c280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009820 tx=0x7fcde002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4271f5df85ee0be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.368+0000 7fcde905f640 1 -- 172.21.15.42:0/643586834 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcde0037070 con 0x7fcde407de20 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.369+0000 7fcde905f640 1 -- 172.21.15.42:0/643586834 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcde0032920 con 0x7fcde407de20 2024-09-19T09:30:22.144 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.369+0000 7fcde905f640 1 -- 172.21.15.42:0/643586834 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcde0030810 con 0x7fcde407de20 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.369+0000 7fcdec2c5640 1 -- 172.21.15.42:0/643586834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 msgr2=0x7fcde407c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.369+0000 7fcdec2c5640 1 --2- 172.21.15.42:0/643586834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde407c280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009820 tx=0x7fcde002a270 comp rx=0 tx=0).stop 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.369+0000 7fcdec2c5640 1 -- 172.21.15.42:0/643586834 shutdown_connections 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.369+0000 7fcdec2c5640 1 --2- 172.21.15.42:0/643586834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde407c280 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.369+0000 7fcdec2c5640 1 -- 172.21.15.42:0/643586834 >> 172.21.15.42:0/643586834 conn(0x7fcde4102f30 msgr2=0x7fcde4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.369+0000 7fcdec2c5640 1 -- 172.21.15.42:0/643586834 shutdown_connections 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.369+0000 7fcdec2c5640 1 -- 172.21.15.42:0/643586834 wait complete. 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.370+0000 7fcdec2c5640 1 Processor -- start 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.370+0000 7fcdec2c5640 1 -- start start 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.370+0000 7fcdec2c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde419d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.370+0000 7fcdec2c5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcde410dde0 con 0x7fcde407de20 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.370+0000 7fcdea061640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde419d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.370+0000 7fcdea061640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde419d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48408/0 (socket says 172.21.15.42:48408) 2024-09-19T09:30:22.145 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.370+0000 7fcdea061640 1 -- 172.21.15.42:0/2763864620 learned_addr learned my addr 172.21.15.42:0/2763864620 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.370+0000 7fcdea061640 1 -- 172.21.15.42:0/2763864620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde419de40 con 0x7fcde407de20 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.370+0000 7fcdea061640 1 --2- 172.21.15.42:0/2763864620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde419d900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcde00097f0 tx=0x7fcde00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.371+0000 7fcddb7fe640 1 -- 172.21.15.42:0/2763864620 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcde0037040 con 0x7fcde407de20 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.371+0000 7fcddb7fe640 1 -- 172.21.15.42:0/2763864620 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcde0030cc0 con 0x7fcde407de20 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.371+0000 7fcdec2c5640 1 -- 172.21.15.42:0/2763864620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde419e0d0 con 0x7fcde407de20 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.371+0000 7fcddb7fe640 1 -- 172.21.15.42:0/2763864620 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcde003a6b0 con 0x7fcde407de20 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.371+0000 7fcdec2c5640 1 -- 172.21.15.42:0/2763864620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde41a0dc0 con 0x7fcde407de20 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.372+0000 7fcddb7fe640 1 -- 172.21.15.42:0/2763864620 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fcde003baf0 con 0x7fcde407de20 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.372+0000 7fcdec2c5640 1 -- 172.21.15.42:0/2763864620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde407c300 con 0x7fcde407de20 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.372+0000 7fcddb7fe640 1 --2- 172.21.15.42:0/2763864620 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fcdd0039200 0x7fcdd003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.372+0000 7fcddb7fe640 1 -- 172.21.15.42:0/2763864620 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcde006c7a0 con 0x7fcde407de20 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.372+0000 7fcde9860640 1 --2- 172.21.15.42:0/2763864620 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fcdd0039200 0x7fcdd003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:22.146 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.373+0000 7fcde9860640 1 --2- 172.21.15.42:0/2763864620 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fcdd0039200 0x7fcdd003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40098c0 tx=0x7fcdd4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.377+0000 7fcddb7fe640 1 -- 172.21.15.42:0/2763864620 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcde0042dc0 con 0x7fcde407de20 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:20.625+0000 7fcdec2c5640 1 -- 172.21.15.42:0/2763864620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fcde41a0f90 con 0x7fcde407de20 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.336+0000 7fcddb7fe640 1 -- 172.21.15.42:0/2763864620 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fcde003b4a0 con 0x7fcde407de20 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.338+0000 7fcddb7fe640 1 -- 172.21.15.42:0/2763864620 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fcde003a850 con 0x7fcde407de20 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.340+0000 7fcdec2c5640 1 -- 172.21.15.42:0/2763864620 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fcdd0039200 msgr2=0x7fcdd003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.340+0000 7fcdec2c5640 1 --2- 172.21.15.42:0/2763864620 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fcdd0039200 0x7fcdd003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40098c0 tx=0x7fcdd4006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.340+0000 7fcdec2c5640 1 -- 172.21.15.42:0/2763864620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 msgr2=0x7fcde419d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.340+0000 7fcdec2c5640 1 --2- 172.21.15.42:0/2763864620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde419d900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcde00097f0 tx=0x7fcde00327b0 comp rx=0 tx=0).stop 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.340+0000 7fcdec2c5640 1 -- 172.21.15.42:0/2763864620 shutdown_connections 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.340+0000 7fcdec2c5640 1 --2- 172.21.15.42:0/2763864620 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7fcdd0039200 0x7fcdd003b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.340+0000 7fcdec2c5640 1 --2- 172.21.15.42:0/2763864620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcde407de20 0x7fcde419d900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.340+0000 7fcdec2c5640 1 -- 172.21.15.42:0/2763864620 >> 172.21.15.42:0/2763864620 conn(0x7fcde4102f30 msgr2=0x7fcde4103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.340+0000 7fcdec2c5640 1 -- 172.21.15.42:0/2763864620 shutdown_connections 2024-09-19T09:30:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:21.340+0000 7fcdec2c5640 1 -- 172.21.15.42:0/2763864620 wait complete. 2024-09-19T09:30:22.679 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:22 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2763864620' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T09:30:22.679 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:22 smithi042 ceph-mon[31223]: mgrmap e9: x(active, since 19s) 2024-09-19T09:30:22.680 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:22 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:22.416+0000 7ffab2e1b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:30:22.680 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:22 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:22.481+0000 7ffab2e1b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:30:22.680 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:22 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:22.678+0000 7ffab2e1b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:30:23.235 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:30:23.235 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T09:30:23.235 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:30:23.235 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T09:30:23.235 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:30:23.235 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.527+0000 7f77d7e2d640 1 Processor -- start 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.527+0000 7f77d7e2d640 1 -- start start 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.527+0000 7f77d7e2d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d010a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.527+0000 7f77d7e2d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77d007be30 con 0x7f77d0108140 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.528+0000 7f77d5bc9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d010a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.528+0000 7f77d5bc9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d010a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48450/0 (socket says 172.21.15.42:48450) 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.528+0000 7f77d5bc9640 1 -- 172.21.15.42:0/3908703510 learned_addr learned my addr 172.21.15.42:0/3908703510 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.528+0000 7f77d5bc9640 1 -- 172.21.15.42:0/3908703510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d010aa70 con 0x7f77d0108140 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.529+0000 7f77d5bc9640 1 --2- 172.21.15.42:0/3908703510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d010a530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009820 tx=0x7f77cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd1b7ad1ba0b518 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.529+0000 7f77d4bc7640 1 -- 172.21.15.42:0/3908703510 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77cc037070 con 0x7f77d0108140 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.529+0000 7f77d4bc7640 1 -- 172.21.15.42:0/3908703510 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77cc032920 con 0x7f77d0108140 2024-09-19T09:30:23.236 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.529+0000 7f77d4bc7640 1 -- 172.21.15.42:0/3908703510 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77cc030810 con 0x7f77d0108140 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.529+0000 7f77d7e2d640 1 -- 172.21.15.42:0/3908703510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 msgr2=0x7f77d010a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.529+0000 7f77d7e2d640 1 --2- 172.21.15.42:0/3908703510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d010a530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009820 tx=0x7f77cc02a270 comp rx=0 tx=0).stop 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.530+0000 7f77d7e2d640 1 -- 172.21.15.42:0/3908703510 shutdown_connections 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.530+0000 7f77d7e2d640 1 --2- 172.21.15.42:0/3908703510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d010a530 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.530+0000 7f77d7e2d640 1 -- 172.21.15.42:0/3908703510 >> 172.21.15.42:0/3908703510 conn(0x7f77d0101e20 msgr2=0x7f77d0104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.530+0000 7f77d7e2d640 1 -- 172.21.15.42:0/3908703510 shutdown_connections 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.530+0000 7f77d7e2d640 1 -- 172.21.15.42:0/3908703510 wait complete. 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.530+0000 7f77d7e2d640 1 Processor -- start 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.530+0000 7f77d7e2d640 1 -- start start 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77d7e2d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77d7e2d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77d010bb50 con 0x7f77d0108140 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77d5bc9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77d5bc9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d019d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48454/0 (socket says 172.21.15.42:48454) 2024-09-19T09:30:23.237 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77d5bc9640 1 -- 172.21.15.42:0/1132146166 learned_addr learned my addr 172.21.15.42:0/1132146166 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77d5bc9640 1 -- 172.21.15.42:0/1132146166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d019de20 con 0x7f77d0108140 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77d5bc9640 1 --2- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d019d8e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f77cc030380 tx=0x7f77cc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77c6ffd640 1 -- 172.21.15.42:0/1132146166 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77cc037040 con 0x7f77d0108140 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77c6ffd640 1 -- 172.21.15.42:0/1132146166 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77cc040070 con 0x7f77d0108140 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77c6ffd640 1 -- 172.21.15.42:0/1132146166 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77cc03a7b0 con 0x7f77d0108140 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77d7e2d640 1 -- 172.21.15.42:0/1132146166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d019e0b0 con 0x7f77d0108140 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.531+0000 7f77d7e2d640 1 -- 172.21.15.42:0/1132146166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d01a0da0 con 0x7f77d0108140 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.532+0000 7f77c6ffd640 1 -- 172.21.15.42:0/1132146166 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f77cc03aa30 con 0x7f77d0108140 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.533+0000 7f77c6ffd640 1 --2- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f77bc039200 0x7f77bc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.533+0000 7f77d7e2d640 1 -- 172.21.15.42:0/1132146166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d01085a0 con 0x7f77d0108140 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.533+0000 7f77d53c8640 1 -- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f77bc039200 msgr2=0x7f77bc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/203737163 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.533+0000 7f77c6ffd640 1 -- 172.21.15.42:0/1132146166 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f77cc06cb30 con 0x7f77d0108140 2024-09-19T09:30:23.238 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.533+0000 7f77d53c8640 1 --2- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f77bc039200 0x7f77bc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.537+0000 7f77c6ffd640 1 -- 172.21.15.42:0/1132146166 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f77cc02e200 con 0x7f77d0108140 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.734+0000 7f77d53c8640 1 -- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f77bc039200 msgr2=0x7f77bc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/203737163 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.734+0000 7f77d53c8640 1 --2- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f77bc039200 0x7f77bc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.761+0000 7f77d7e2d640 1 -- 172.21.15.42:0/1132146166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f77d01a1390 con 0x7f77d0108140 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.761+0000 7f77c6ffd640 1 -- 172.21.15.42:0/1132146166 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f77cc02e630 con 0x7f77d0108140 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.763+0000 7f77d7e2d640 1 -- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f77bc039200 msgr2=0x7f77bc03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.763+0000 7f77d7e2d640 1 --2- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f77bc039200 0x7f77bc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.763+0000 7f77d7e2d640 1 -- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 msgr2=0x7f77d019d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.763+0000 7f77d7e2d640 1 --2- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d019d8e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f77cc030380 tx=0x7f77cc032670 comp rx=0 tx=0).stop 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.763+0000 7f77d7e2d640 1 -- 172.21.15.42:0/1132146166 shutdown_connections 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.763+0000 7f77d7e2d640 1 --2- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f77bc039200 0x7f77bc03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.763+0000 7f77d7e2d640 1 --2- 172.21.15.42:0/1132146166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77d0108140 0x7f77d019d8e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.763+0000 7f77d7e2d640 1 -- 172.21.15.42:0/1132146166 >> 172.21.15.42:0/1132146166 conn(0x7f77d0101e20 msgr2=0x7f77d0102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:23.239 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.764+0000 7f77d7e2d640 1 -- 172.21.15.42:0/1132146166 shutdown_connections 2024-09-19T09:30:23.240 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:22.764+0000 7f77d7e2d640 1 -- 172.21.15.42:0/1132146166 wait complete. 2024-09-19T09:30:23.240 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for the mgr to restart... 2024-09-19T09:30:23.240 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr epoch 9... 2024-09-19T09:30:23.604 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:23 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1132146166' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:30:23.892 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:23 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:23.616+0000 7ffab2e1b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:30:23.892 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:23 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:23.688+0000 7ffab2e1b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:30:24.552 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:24.431+0000 7ffab2e1b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:30:24.552 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:24.551+0000 7ffab2e1b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:30:24.830 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:24.702+0000 7ffab2e1b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:30:24.830 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:24.767+0000 7ffab2e1b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:30:25.095 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:24.928+0000 7ffab2e1b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:30:25.095 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:25.001+0000 7ffab2e1b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:30:25.095 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:25.065+0000 7ffab2e1b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:30:25.374 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:25.234+0000 7ffab2e1b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:30:25.374 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:25.303+0000 7ffab2e1b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:30:25.374 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:25.372+0000 7ffab2e1b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:30:25.704 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:25.459+0000 7ffab2e1b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:30:25.704 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:25.521+0000 7ffab2e1b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:30:25.704 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:25.583+0000 7ffab2e1b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:30:26.685 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:26.410+0000 7ffab2e1b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:30:26.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: Active manager daemon x restarted 2024-09-19T09:30:26.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: Activating manager daemon x 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: mgrmap e10: x(active, starting, since 0.00334506s) 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: Manager daemon x is now available 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:30:26.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:30:28.254 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:30:28.254 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T09:30:28.254 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:30:28.254 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:30:28.254 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.685+0000 7f9ad9081640 1 Processor -- start 2024-09-19T09:30:28.254 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.685+0000 7f9ad9081640 1 -- start start 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.685+0000 7f9ad9081640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad4107b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.685+0000 7f9ad9081640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad4108100 con 0x7f9ad4107730 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.686+0000 7f9ad2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad4107b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.686+0000 7f9ad2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad4107b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48464/0 (socket says 172.21.15.42:48464) 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.686+0000 7f9ad2d9d640 1 -- 172.21.15.42:0/656468603 learned_addr learned my addr 172.21.15.42:0/656468603 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.686+0000 7f9ad2d9d640 1 -- 172.21.15.42:0/656468603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad4108930 con 0x7f9ad4107730 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.687+0000 7f9ad2d9d640 1 --2- 172.21.15.42:0/656468603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad4107b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009820 tx=0x7f9ac402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79a8525c4d2dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.687+0000 7f9ad259c640 1 -- 172.21.15.42:0/656468603 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4037070 con 0x7f9ad4107730 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.687+0000 7f9ad259c640 1 -- 172.21.15.42:0/656468603 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ac4032920 con 0x7f9ad4107730 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.687+0000 7f9ad259c640 1 -- 172.21.15.42:0/656468603 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4030810 con 0x7f9ad4107730 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.687+0000 7f9ad9081640 1 -- 172.21.15.42:0/656468603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 msgr2=0x7f9ad4107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.687+0000 7f9ad9081640 1 --2- 172.21.15.42:0/656468603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad4107b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009820 tx=0x7f9ac402a270 comp rx=0 tx=0).stop 2024-09-19T09:30:28.255 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.687+0000 7f9ad9081640 1 -- 172.21.15.42:0/656468603 shutdown_connections 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.687+0000 7f9ad9081640 1 --2- 172.21.15.42:0/656468603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad4107b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.688+0000 7f9ad9081640 1 -- 172.21.15.42:0/656468603 >> 172.21.15.42:0/656468603 conn(0x7f9ad4102ec0 msgr2=0x7f9ad4105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.688+0000 7f9ad9081640 1 -- 172.21.15.42:0/656468603 shutdown_connections 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.688+0000 7f9ad9081640 1 -- 172.21.15.42:0/656468603 wait complete. 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.688+0000 7f9ad9081640 1 Processor -- start 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.688+0000 7f9ad9081640 1 -- start start 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad9081640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad407daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad9081640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad410bce0 con 0x7f9ad4107730 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad407daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad407daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48472/0 (socket says 172.21.15.42:48472) 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad2d9d640 1 -- 172.21.15.42:0/983266565 learned_addr learned my addr 172.21.15.42:0/983266565 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:28.256 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad2d9d640 1 -- 172.21.15.42:0/983266565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad407e030 con 0x7f9ad4107730 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad2d9d640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad407daf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40097f0 tx=0x7f9ac40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4037040 con 0x7f9ad4107730 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ac4030c40 con 0x7f9ad4107730 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad9081640 1 -- 172.21.15.42:0/983266565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad407c220 con 0x7f9ad4107730 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac403a5b0 con 0x7f9ad4107730 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.689+0000 7f9ad9081640 1 -- 172.21.15.42:0/983266565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad407c760 con 0x7f9ad4107730 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.690+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f9ac403a7f0 con 0x7f9ad4107730 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.690+0000 7f9ad0d99640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 0x7f9ac003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.690+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 --> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9ac003bdd0 con 0x7f9ac0039200 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.690+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9ac406d760 con 0x7f9ad4107730 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.690+0000 7f9acbfff640 1 -- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 msgr2=0x7f9ac003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/203737163 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.690+0000 7f9acbfff640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 0x7f9ac003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:30:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.891+0000 7f9acbfff640 1 -- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 msgr2=0x7f9ac003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/203737163 2024-09-19T09:30:28.258 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:23.891+0000 7f9acbfff640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 0x7f9ac003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:30:28.258 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:24.292+0000 7f9acbfff640 1 -- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 msgr2=0x7f9ac003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/203737163 2024-09-19T09:30:28.258 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:24.292+0000 7f9acbfff640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 0x7f9ac003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:30:28.258 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:25.093+0000 7f9acbfff640 1 -- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 msgr2=0x7f9ac003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/203737163 2024-09-19T09:30:28.258 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:25.093+0000 7f9acbfff640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 0x7f9ac003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:30:28.258 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:26.413+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f9ac402fd60 con 0x7f9ad4107730 2024-09-19T09:30:28.258 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:26.413+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 msgr2=0x7f9ac003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:30:28.258 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:26.413+0000 7f9ad0d99640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 0x7f9ac003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:28.258 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.415+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f9ac4044920 con 0x7f9ad4107730 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.415+0000 7f9ad0d99640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac003ccc0 0x7f9ac003f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.415+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9ac4066880 con 0x7f9ac003ccc0 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.416+0000 7f9acbfff640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac003ccc0 0x7f9ac003f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.416+0000 7f9acbfff640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac003ccc0 0x7f9ac003f0b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9abc003980 tx=0x7f9abc006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.417+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f9ac4066880 con 0x7f9ac003ccc0 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.424+0000 7f9ad9081640 1 -- 172.21.15.42:0/983266565 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9ad410be60 con 0x7f9ac003ccc0 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.424+0000 7f9ad0d99640 1 -- 172.21.15.42:0/983266565 <== mgr.14150 v2:172.21.15.42:6800/117232266 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f9ad410be60 con 0x7f9ac003ccc0 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 -- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac003ccc0 msgr2=0x7f9ac003f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac003ccc0 0x7f9ac003f0b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9abc003980 tx=0x7f9abc006e10 comp rx=0 tx=0).stop 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 -- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 msgr2=0x7f9ad407daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad407daf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40097f0 tx=0x7f9ac40327b0 comp rx=0 tx=0).stop 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 -- 172.21.15.42:0/983266565 shutdown_connections 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac003ccc0 0x7f9ac003f0b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:28.259 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:6800/203737163,v1:172.21.15.42:6801/203737163] conn(0x7f9ac0039200 0x7f9ac003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:28.260 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 --2- 172.21.15.42:0/983266565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad4107730 0x7f9ad407daf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:28.260 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 -- 172.21.15.42:0/983266565 >> 172.21.15.42:0/983266565 conn(0x7f9ad4102ec0 msgr2=0x7f9ad4103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:28.260 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 -- 172.21.15.42:0/983266565 shutdown_connections 2024-09-19T09:30:28.260 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:27.425+0000 7f9ad9081640 1 -- 172.21.15.42:0/983266565 wait complete. 2024-09-19T09:30:28.260 INFO:teuthology.orchestra.run.smithi042.stdout:mgr epoch 9 is available 2024-09-19T09:30:28.260 INFO:teuthology.orchestra.run.smithi042.stdout:Generating a dashboard self-signed certificate... 2024-09-19T09:30:28.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:28 smithi042 ceph-mon[31223]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T09:30:28.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:28 smithi042 ceph-mon[31223]: mgrmap e11: x(active, since 1.0062s) 2024-09-19T09:30:28.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:28 smithi042 ceph-mon[31223]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T09:30:28.520 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:29.386 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:29.199+0000 7ffa18724640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:30:29] ENGINE Error in HTTPServer.serve 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: Traceback (most recent call last): 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: self._connections.run(self.expiration_interval) 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: self._run(expiration_interval) 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: s = self.context.wrap_socket( 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:30:29.387 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: return self.sslsocket_class._create( 2024-09-19T09:30:29.388 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:30:29.388 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: self.do_handshake() 2024-09-19T09:30:29.388 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:30:29.388 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: self._sslobj.do_handshake() 2024-09-19T09:30:29.388 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:30:29.388 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:30:29.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T09:30:29.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.737+0000 7fd5cbd67640 1 Processor -- start 2024-09-19T09:30:29.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.737+0000 7fd5cbd67640 1 -- start start 2024-09-19T09:30:29.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.738+0000 7fd5cbd67640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c410a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:29.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.738+0000 7fd5cbd67640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c407bdf0 con 0x7fd5c4108180 2024-09-19T09:30:29.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.738+0000 7fd5c9b03640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c410a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:29.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.738+0000 7fd5c9b03640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c410a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48574/0 (socket says 172.21.15.42:48574) 2024-09-19T09:30:29.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.738+0000 7fd5c9b03640 1 -- 172.21.15.42:0/2935039355 learned_addr learned my addr 172.21.15.42:0/2935039355 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:29.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.738+0000 7fd5c9b03640 1 -- 172.21.15.42:0/2935039355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c410aab0 con 0x7fd5c4108180 2024-09-19T09:30:29.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.739+0000 7fd5c9b03640 1 --2- 172.21.15.42:0/2935039355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c410a570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009820 tx=0x7fd5c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448f566e2aaa92b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:29.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.739+0000 7fd5c8b01640 1 -- 172.21.15.42:0/2935039355 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5c0037070 con 0x7fd5c4108180 2024-09-19T09:30:29.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.739+0000 7fd5c8b01640 1 -- 172.21.15.42:0/2935039355 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5c0032920 con 0x7fd5c4108180 2024-09-19T09:30:29.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.739+0000 7fd5c8b01640 1 -- 172.21.15.42:0/2935039355 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5c0030810 con 0x7fd5c4108180 2024-09-19T09:30:29.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.740+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2935039355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 msgr2=0x7fd5c410a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.740+0000 7fd5cbd67640 1 --2- 172.21.15.42:0/2935039355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c410a570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009820 tx=0x7fd5c002a270 comp rx=0 tx=0).stop 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.740+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2935039355 shutdown_connections 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.740+0000 7fd5cbd67640 1 --2- 172.21.15.42:0/2935039355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c410a570 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.740+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2935039355 >> 172.21.15.42:0/2935039355 conn(0x7fd5c4101e20 msgr2=0x7fd5c4104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.740+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2935039355 shutdown_connections 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.740+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2935039355 wait complete. 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.740+0000 7fd5cbd67640 1 Processor -- start 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5cbd67640 1 -- start start 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5cbd67640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5cbd67640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c410bb30 con 0x7fd5c4108180 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5c9b03640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5c9b03640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c419b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48588/0 (socket says 172.21.15.42:48588) 2024-09-19T09:30:29.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5c9b03640 1 -- 172.21.15.42:0/2626504673 learned_addr learned my addr 172.21.15.42:0/2626504673 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5c9b03640 1 -- 172.21.15.42:0/2626504673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c419bc30 con 0x7fd5c4108180 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5c9b03640 1 --2- 172.21.15.42:0/2626504673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c419b6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0030380 tx=0x7fd5c0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5baffd640 1 -- 172.21.15.42:0/2626504673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5c0037040 con 0x7fd5c4108180 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5baffd640 1 -- 172.21.15.42:0/2626504673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5c0040070 con 0x7fd5c4108180 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.741+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2626504673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c419bec0 con 0x7fd5c4108180 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.742+0000 7fd5baffd640 1 -- 172.21.15.42:0/2626504673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5c003a7b0 con 0x7fd5c4108180 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.742+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2626504673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c419ebb0 con 0x7fd5c4108180 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.742+0000 7fd5baffd640 1 -- 172.21.15.42:0/2626504673 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fd5c003a9e0 con 0x7fd5c4108180 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.743+0000 7fd5baffd640 1 --2- 172.21.15.42:0/2626504673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5b0039140 0x7fd5b003b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.743+0000 7fd5baffd640 1 -- 172.21.15.42:0/2626504673 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd5c006c830 con 0x7fd5c4108180 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.743+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2626504673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c41085e0 con 0x7fd5c4108180 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.743+0000 7fd5c9302640 1 --2- 172.21.15.42:0/2626504673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5b0039140 0x7fd5b003b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:29.690 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.743+0000 7fd5c9302640 1 --2- 172.21.15.42:0/2626504673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5b0039140 0x7fd5b003b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40098c0 tx=0x7fd5b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:29.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.748+0000 7fd5baffd640 1 -- 172.21.15.42:0/2626504673 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5c004a200 con 0x7fd5c4108180 2024-09-19T09:30:29.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.774+0000 7fd5baffd640 1 -- 172.21.15.42:0/2626504673 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fd5c0045d00 con 0x7fd5c4108180 2024-09-19T09:30:29.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:28.932+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2626504673 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fd5c4103120 con 0x7fd5b0039140 2024-09-19T09:30:29.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.091+0000 7fd5baffd640 1 -- 172.21.15.42:0/2626504673 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fd5c4103120 con 0x7fd5b0039140 2024-09-19T09:30:29.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.093+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2626504673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5b0039140 msgr2=0x7fd5b003b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:29.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.093+0000 7fd5cbd67640 1 --2- 172.21.15.42:0/2626504673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5b0039140 0x7fd5b003b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40098c0 tx=0x7fd5b4006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:29.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.093+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2626504673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 msgr2=0x7fd5c419b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:29.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.093+0000 7fd5cbd67640 1 --2- 172.21.15.42:0/2626504673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c419b6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0030380 tx=0x7fd5c0032670 comp rx=0 tx=0).stop 2024-09-19T09:30:29.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.093+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2626504673 shutdown_connections 2024-09-19T09:30:29.691 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.093+0000 7fd5cbd67640 1 --2- 172.21.15.42:0/2626504673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5b0039140 0x7fd5b003b600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:29.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.093+0000 7fd5cbd67640 1 --2- 172.21.15.42:0/2626504673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c4108180 0x7fd5c419b6f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:29.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.093+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2626504673 >> 172.21.15.42:0/2626504673 conn(0x7fd5c4101e20 msgr2=0x7fd5c4102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:29.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.093+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2626504673 shutdown_connections 2024-09-19T09:30:29.692 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:29.093+0000 7fd5cbd67640 1 -- 172.21.15.42:0/2626504673 wait complete. 2024-09-19T09:30:29.692 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial admin user... 2024-09-19T09:30:29.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-mon[31223]: mgrmap e12: x(active, since 2s) 2024-09-19T09:30:29.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:29.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-mon[31223]: [19/Sep/2024:09:30:28] ENGINE Bus STARTING 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-mon[31223]: [19/Sep/2024:09:30:29] ENGINE Serving on http://172.21.15.42:8765 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-mon[31223]: [19/Sep/2024:09:30:29] ENGINE Serving on https://172.21.15.42:7150 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-mon[31223]: [19/Sep/2024:09:30:29] ENGINE Bus STARTED 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:29 smithi042 ceph-mon[31223]: [19/Sep/2024:09:30:29] ENGINE Error in HTTPServer.serve 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout: Traceback (most recent call last): 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:30:29.955 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._run(expiration_interval) 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: s = self.context.wrap_socket( 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: return self.sslsocket_class._create( 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: self.do_handshake() 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._sslobj.do_handshake() 2024-09-19T09:30:29.956 INFO:journalctl@ceph.mon.a.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:30:30.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:30 smithi042 ceph-mon[31223]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:30.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:30 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:31.783 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$oZttneeGpSgvG9Ou2oxdPeP0G5mdgUswIKrhK.jernxb7lSOMmxvW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726738230, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T09:30:31.783 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.096+0000 7f27170a4640 1 Processor -- start 2024-09-19T09:30:31.783 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.096+0000 7f27170a4640 1 -- start start 2024-09-19T09:30:31.783 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.096+0000 7f27170a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f271010a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:31.783 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.096+0000 7f27170a4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f271007bdb0 con 0x7f2710108200 2024-09-19T09:30:31.783 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.096+0000 7f2714e40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f271010a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:31.783 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.096+0000 7f2714e40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f271010a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48602/0 (socket says 172.21.15.42:48602) 2024-09-19T09:30:31.783 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.096+0000 7f2714e40640 1 -- 172.21.15.42:0/2651222547 learned_addr learned my addr 172.21.15.42:0/2651222547 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.096+0000 7f2714e40640 1 -- 172.21.15.42:0/2651222547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271010ab30 con 0x7f2710108200 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.097+0000 7f2714e40640 1 --2- 172.21.15.42:0/2651222547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f271010a5f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2700009820 tx=0x7f270002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb9c4ad135b1487 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.097+0000 7f270f7fe640 1 -- 172.21.15.42:0/2651222547 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2700037070 con 0x7f2710108200 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.097+0000 7f270f7fe640 1 -- 172.21.15.42:0/2651222547 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2700032920 con 0x7f2710108200 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.097+0000 7f270f7fe640 1 -- 172.21.15.42:0/2651222547 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2700030810 con 0x7f2710108200 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.098+0000 7f27170a4640 1 -- 172.21.15.42:0/2651222547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 msgr2=0x7f271010a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.098+0000 7f27170a4640 1 --2- 172.21.15.42:0/2651222547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f271010a5f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2700009820 tx=0x7f270002a270 comp rx=0 tx=0).stop 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.098+0000 7f27170a4640 1 -- 172.21.15.42:0/2651222547 shutdown_connections 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.098+0000 7f27170a4640 1 --2- 172.21.15.42:0/2651222547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f271010a5f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.098+0000 7f27170a4640 1 -- 172.21.15.42:0/2651222547 >> 172.21.15.42:0/2651222547 conn(0x7f2710101e20 msgr2=0x7f2710104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.098+0000 7f27170a4640 1 -- 172.21.15.42:0/2651222547 shutdown_connections 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.098+0000 7f27170a4640 1 -- 172.21.15.42:0/2651222547 wait complete. 2024-09-19T09:30:31.784 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.099+0000 7f27170a4640 1 Processor -- start 2024-09-19T09:30:31.785 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.099+0000 7f27170a4640 1 -- start start 2024-09-19T09:30:31.785 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.099+0000 7f27170a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f2710107a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:31.785 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.099+0000 7f27170a4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f271010bb50 con 0x7f2710108200 2024-09-19T09:30:31.785 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.099+0000 7f2714e40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f2710107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:31.785 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.099+0000 7f2714e40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f2710107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48612/0 (socket says 172.21.15.42:48612) 2024-09-19T09:30:31.785 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.099+0000 7f2714e40640 1 -- 172.21.15.42:0/1127457004 learned_addr learned my addr 172.21.15.42:0/1127457004 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:31.785 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.099+0000 7f2714e40640 1 -- 172.21.15.42:0/1127457004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2710107fc0 con 0x7f2710108200 2024-09-19T09:30:31.785 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.100+0000 7f2714e40640 1 --2- 172.21.15.42:0/1127457004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f2710107a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27000097f0 tx=0x7f27000327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:31.785 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.100+0000 7f270dffb640 1 -- 172.21.15.42:0/1127457004 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2700037040 con 0x7f2710108200 2024-09-19T09:30:31.785 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.100+0000 7f270dffb640 1 -- 172.21.15.42:0/1127457004 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2700030cc0 con 0x7f2710108200 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.100+0000 7f27170a4640 1 -- 172.21.15.42:0/1127457004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27101061b0 con 0x7f2710108200 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.100+0000 7f270dffb640 1 -- 172.21.15.42:0/1127457004 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f270003a6b0 con 0x7f2710108200 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.100+0000 7f27170a4640 1 -- 172.21.15.42:0/1127457004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27101066f0 con 0x7f2710108200 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.101+0000 7f270dffb640 1 -- 172.21.15.42:0/1127457004 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f270003a850 con 0x7f2710108200 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.101+0000 7f270dffb640 1 --2- 172.21.15.42:0/1127457004 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26fc039260 0x7f26fc03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.101+0000 7f270dffb640 1 -- 172.21.15.42:0/1127457004 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f270006c8d0 con 0x7f2710108200 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.101+0000 7f270ffff640 1 --2- 172.21.15.42:0/1127457004 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26fc039260 0x7f26fc03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.101+0000 7f27170a4640 1 -- 172.21.15.42:0/1127457004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2710108660 con 0x7f2710108200 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.102+0000 7f270ffff640 1 --2- 172.21.15.42:0/1127457004 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26fc039260 0x7f26fc03b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26f80098c0 tx=0x7f26f8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.106+0000 7f270dffb640 1 -- 172.21.15.42:0/1127457004 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2700044920 con 0x7f2710108200 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.301+0000 7f27170a4640 1 -- 172.21.15.42:0/1127457004 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f2710106d70 con 0x7f26fc039260 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.551+0000 7f270dffb640 1 -- 172.21.15.42:0/1127457004 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f2710106d70 con 0x7f26fc039260 2024-09-19T09:30:31.786 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.553+0000 7f27170a4640 1 -- 172.21.15.42:0/1127457004 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26fc039260 msgr2=0x7f26fc03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:31.787 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.553+0000 7f27170a4640 1 --2- 172.21.15.42:0/1127457004 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26fc039260 0x7f26fc03b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26f80098c0 tx=0x7f26f8006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:31.787 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.553+0000 7f27170a4640 1 -- 172.21.15.42:0/1127457004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 msgr2=0x7f2710107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:31.787 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.553+0000 7f27170a4640 1 --2- 172.21.15.42:0/1127457004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f2710107a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27000097f0 tx=0x7f27000327b0 comp rx=0 tx=0).stop 2024-09-19T09:30:31.787 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.553+0000 7f27170a4640 1 -- 172.21.15.42:0/1127457004 shutdown_connections 2024-09-19T09:30:31.787 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.553+0000 7f27170a4640 1 --2- 172.21.15.42:0/1127457004 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26fc039260 0x7f26fc03b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:31.787 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.553+0000 7f27170a4640 1 --2- 172.21.15.42:0/1127457004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2710108200 0x7f2710107a80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:31.787 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.553+0000 7f27170a4640 1 -- 172.21.15.42:0/1127457004 >> 172.21.15.42:0/1127457004 conn(0x7f2710101e20 msgr2=0x7f27101029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:31.787 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.553+0000 7f27170a4640 1 -- 172.21.15.42:0/1127457004 shutdown_connections 2024-09-19T09:30:31.787 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:30.553+0000 7f27170a4640 1 -- 172.21.15.42:0/1127457004 wait complete. 2024-09-19T09:30:31.787 INFO:teuthology.orchestra.run.smithi042.stdout:Fetching dashboard port number... 2024-09-19T09:30:32.673 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:32 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3081885838' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T09:30:32.923 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.175+0000 7f10ac4a6640 1 Processor -- start 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.175+0000 7f10ac4a6640 1 -- start start 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.176+0000 7f10ac4a6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a407c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.176+0000 7f10ac4a6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f10a407c870 con 0x7f10a407de40 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.176+0000 7f10aa242640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a407c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.176+0000 7f10aa242640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a407c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33312/0 (socket says 172.21.15.42:33312) 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.176+0000 7f10aa242640 1 -- 172.21.15.42:0/2776696589 learned_addr learned my addr 172.21.15.42:0/2776696589 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.176+0000 7f10aa242640 1 -- 172.21.15.42:0/2776696589 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a407c9f0 con 0x7f10a407de40 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.177+0000 7f10aa242640 1 --2- 172.21.15.42:0/2776696589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a407c2a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009820 tx=0x7f10a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88209a7088768d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.177+0000 7f10a9240640 1 -- 172.21.15.42:0/2776696589 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10a0037070 con 0x7f10a407de40 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.177+0000 7f10a9240640 1 -- 172.21.15.42:0/2776696589 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a0032920 con 0x7f10a407de40 2024-09-19T09:30:32.924 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.177+0000 7f10a9240640 1 -- 172.21.15.42:0/2776696589 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10a0030810 con 0x7f10a407de40 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.177+0000 7f10ac4a6640 1 -- 172.21.15.42:0/2776696589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 msgr2=0x7f10a407c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.177+0000 7f10ac4a6640 1 --2- 172.21.15.42:0/2776696589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a407c2a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009820 tx=0x7f10a002a270 comp rx=0 tx=0).stop 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.178+0000 7f10ac4a6640 1 -- 172.21.15.42:0/2776696589 shutdown_connections 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.178+0000 7f10ac4a6640 1 --2- 172.21.15.42:0/2776696589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a407c2a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.178+0000 7f10ac4a6640 1 -- 172.21.15.42:0/2776696589 >> 172.21.15.42:0/2776696589 conn(0x7f10a4102f30 msgr2=0x7f10a4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.178+0000 7f10ac4a6640 1 -- 172.21.15.42:0/2776696589 shutdown_connections 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.178+0000 7f10ac4a6640 1 -- 172.21.15.42:0/2776696589 wait complete. 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.178+0000 7f10ac4a6640 1 Processor -- start 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.178+0000 7f10ac4a6640 1 -- start start 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f10ac4a6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f10ac4a6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f10a410ddc0 con 0x7f10a407de40 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f10aa242640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f10aa242640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a419d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33326/0 (socket says 172.21.15.42:33326) 2024-09-19T09:30:32.925 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f10aa242640 1 -- 172.21.15.42:0/3081885838 learned_addr learned my addr 172.21.15.42:0/3081885838 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f10aa242640 1 -- 172.21.15.42:0/3081885838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a419de80 con 0x7f10a407de40 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f10aa242640 1 --2- 172.21.15.42:0/3081885838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a419d940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10a0030560 tx=0x7f10a0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f109b7fe640 1 -- 172.21.15.42:0/3081885838 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10a0037040 con 0x7f10a407de40 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f109b7fe640 1 -- 172.21.15.42:0/3081885838 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a0040070 con 0x7f10a407de40 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f10ac4a6640 1 -- 172.21.15.42:0/3081885838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a419e110 con 0x7f10a407de40 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f109b7fe640 1 -- 172.21.15.42:0/3081885838 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10a003a740 con 0x7f10a407de40 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.179+0000 7f10ac4a6640 1 -- 172.21.15.42:0/3081885838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a41a0e00 con 0x7f10a407de40 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.180+0000 7f109b7fe640 1 -- 172.21.15.42:0/3081885838 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f10a003a9b0 con 0x7f10a407de40 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.180+0000 7f10ac4a6640 1 -- 172.21.15.42:0/3081885838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a407c320 con 0x7f10a407de40 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.180+0000 7f109b7fe640 1 --2- 172.21.15.42:0/3081885838 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1090039200 0x7f109003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.181+0000 7f109b7fe640 1 -- 172.21.15.42:0/3081885838 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f10a006c9b0 con 0x7f10a407de40 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.181+0000 7f10a9a41640 1 --2- 172.21.15.42:0/3081885838 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1090039200 0x7f109003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.181+0000 7f10a9a41640 1 --2- 172.21.15.42:0/3081885838 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1090039200 0x7f109003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f10940098c0 tx=0x7f1094006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.185+0000 7f109b7fe640 1 -- 172.21.15.42:0/3081885838 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10a004a200 con 0x7f10a407de40 2024-09-19T09:30:32.926 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.362+0000 7f10ac4a6640 1 -- 172.21.15.42:0/3081885838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f10a41a0fd0 con 0x7f10a407de40 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.362+0000 7f109b7fe640 1 -- 172.21.15.42:0/3081885838 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f10a0031e80 con 0x7f10a407de40 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.365+0000 7f10ac4a6640 1 -- 172.21.15.42:0/3081885838 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1090039200 msgr2=0x7f109003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.365+0000 7f10ac4a6640 1 --2- 172.21.15.42:0/3081885838 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1090039200 0x7f109003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f10940098c0 tx=0x7f1094006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.365+0000 7f10ac4a6640 1 -- 172.21.15.42:0/3081885838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 msgr2=0x7f10a419d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.365+0000 7f10ac4a6640 1 --2- 172.21.15.42:0/3081885838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a419d940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10a0030560 tx=0x7f10a0032670 comp rx=0 tx=0).stop 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.365+0000 7f10ac4a6640 1 -- 172.21.15.42:0/3081885838 shutdown_connections 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.365+0000 7f10ac4a6640 1 --2- 172.21.15.42:0/3081885838 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1090039200 0x7f109003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.365+0000 7f10ac4a6640 1 --2- 172.21.15.42:0/3081885838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10a407de40 0x7f10a419d940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.365+0000 7f10ac4a6640 1 -- 172.21.15.42:0/3081885838 >> 172.21.15.42:0/3081885838 conn(0x7f10a4102f30 msgr2=0x7f10a4103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.365+0000 7f10ac4a6640 1 -- 172.21.15.42:0/3081885838 shutdown_connections 2024-09-19T09:30:32.927 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:32.365+0000 7f10ac4a6640 1 -- 172.21.15.42:0/3081885838 wait complete. 2024-09-19T09:30:32.931 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:30:32.932 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-19T09:30:32.940 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:30:32.940 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-19T09:30:32.940 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-19T09:30:32.940 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T09:30:32.942 INFO:teuthology.orchestra.run.smithi042.stdout:Ceph Dashboard is now available at: 2024-09-19T09:30:32.942 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:32.942 INFO:teuthology.orchestra.run.smithi042.stdout: URL: https://smithi042.front.sepia.ceph.com:8443/ 2024-09-19T09:30:32.942 INFO:teuthology.orchestra.run.smithi042.stdout: User: admin 2024-09-19T09:30:32.942 INFO:teuthology.orchestra.run.smithi042.stdout: Password: g2urmxwyt7 2024-09-19T09:30:32.942 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:32.943 INFO:teuthology.orchestra.run.smithi042.stdout:Saving cluster configuration to /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/config directory 2024-09-19T09:30:33.615 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:33 smithi042 ceph-mon[31223]: mgrmap e13: x(active, since 6s) 2024-09-19T09:30:34.189 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.336+0000 7f74faca9640 1 Processor -- start 2024-09-19T09:30:34.189 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.336+0000 7f74faca9640 1 -- start start 2024-09-19T09:30:34.189 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.336+0000 7f74faca9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f4107b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:34.189 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.336+0000 7f74faca9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f74f4108150 con 0x7f74f4107780 2024-09-19T09:30:34.189 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.337+0000 7f74f8a45640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f4107b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.337+0000 7f74f8a45640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f4107b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33340/0 (socket says 172.21.15.42:33340) 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.337+0000 7f74f8a45640 1 -- 172.21.15.42:0/1568734777 learned_addr learned my addr 172.21.15.42:0/1568734777 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.337+0000 7f74f8a45640 1 -- 172.21.15.42:0/1568734777 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f4108980 con 0x7f74f4107780 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.338+0000 7f74f8a45640 1 --2- 172.21.15.42:0/1568734777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f4107b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009820 tx=0x7f74e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d2d01e05713256 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.338+0000 7f74f37fe640 1 -- 172.21.15.42:0/1568734777 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e4037070 con 0x7f74f4107780 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.338+0000 7f74f37fe640 1 -- 172.21.15.42:0/1568734777 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74e4032920 con 0x7f74f4107780 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.338+0000 7f74f37fe640 1 -- 172.21.15.42:0/1568734777 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e4030810 con 0x7f74f4107780 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 -- 172.21.15.42:0/1568734777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 msgr2=0x7f74f4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 --2- 172.21.15.42:0/1568734777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f4107b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009820 tx=0x7f74e402a270 comp rx=0 tx=0).stop 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 -- 172.21.15.42:0/1568734777 shutdown_connections 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 --2- 172.21.15.42:0/1568734777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f4107b80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:34.190 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 -- 172.21.15.42:0/1568734777 >> 172.21.15.42:0/1568734777 conn(0x7f74f4102f30 msgr2=0x7f74f4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 -- 172.21.15.42:0/1568734777 shutdown_connections 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 -- 172.21.15.42:0/1568734777 wait complete. 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 Processor -- start 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 -- start start 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f419d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.339+0000 7f74faca9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f74f410bd30 con 0x7f74f4107780 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.340+0000 7f74f8a45640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f419d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.340+0000 7f74f8a45640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f419d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33350/0 (socket says 172.21.15.42:33350) 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.340+0000 7f74f8a45640 1 -- 172.21.15.42:0/219962373 learned_addr learned my addr 172.21.15.42:0/219962373 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.340+0000 7f74f8a45640 1 -- 172.21.15.42:0/219962373 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f419deb0 con 0x7f74f4107780 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.340+0000 7f74f8a45640 1 --2- 172.21.15.42:0/219962373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f419d970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f74e40097f0 tx=0x7f74e40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.340+0000 7f74f1ffb640 1 -- 172.21.15.42:0/219962373 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e4037040 con 0x7f74f4107780 2024-09-19T09:30:34.191 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.340+0000 7f74f1ffb640 1 -- 172.21.15.42:0/219962373 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74e4030cc0 con 0x7f74f4107780 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.340+0000 7f74faca9640 1 -- 172.21.15.42:0/219962373 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f419e140 con 0x7f74f4107780 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.340+0000 7f74f1ffb640 1 -- 172.21.15.42:0/219962373 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e403a640 con 0x7f74f4107780 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.341+0000 7f74faca9640 1 -- 172.21.15.42:0/219962373 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f41a0e30 con 0x7f74f4107780 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.341+0000 7f74f1ffb640 1 -- 172.21.15.42:0/219962373 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f74e403a940 con 0x7f74f4107780 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.342+0000 7f74f1ffb640 1 --2- 172.21.15.42:0/219962373 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f74dc0392a0 0x7f74dc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.342+0000 7f74f1ffb640 1 -- 172.21.15.42:0/219962373 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f74e406c9e0 con 0x7f74f4107780 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.342+0000 7f74f3fff640 1 --2- 172.21.15.42:0/219962373 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f74dc0392a0 0x7f74dc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.342+0000 7f74faca9640 1 -- 172.21.15.42:0/219962373 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f4107c00 con 0x7f74f4107780 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.342+0000 7f74f3fff640 1 --2- 172.21.15.42:0/219962373 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f74dc0392a0 0x7f74dc03b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098c0 tx=0x7f74e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.347+0000 7f74f1ffb640 1 -- 172.21.15.42:0/219962373 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f74e4039740 con 0x7f74f4107780 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.613+0000 7f74faca9640 1 -- 172.21.15.42:0/219962373 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f74f41a1250 con 0x7f74f4107780 2024-09-19T09:30:34.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.616+0000 7f74f1ffb640 1 -- 172.21.15.42:0/219962373 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f74e403ba40 con 0x7f74f4107780 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.618+0000 7f74faca9640 1 -- 172.21.15.42:0/219962373 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f74dc0392a0 msgr2=0x7f74dc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.618+0000 7f74faca9640 1 --2- 172.21.15.42:0/219962373 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f74dc0392a0 0x7f74dc03b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098c0 tx=0x7f74e8006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.618+0000 7f74faca9640 1 -- 172.21.15.42:0/219962373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 msgr2=0x7f74f419d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.618+0000 7f74faca9640 1 --2- 172.21.15.42:0/219962373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f419d970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f74e40097f0 tx=0x7f74e40327b0 comp rx=0 tx=0).stop 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.618+0000 7f74faca9640 1 -- 172.21.15.42:0/219962373 shutdown_connections 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.618+0000 7f74faca9640 1 --2- 172.21.15.42:0/219962373 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f74dc0392a0 0x7f74dc03b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.618+0000 7f74faca9640 1 --2- 172.21.15.42:0/219962373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f4107780 0x7f74f419d970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.618+0000 7f74faca9640 1 -- 172.21.15.42:0/219962373 >> 172.21.15.42:0/219962373 conn(0x7f74f4102f30 msgr2=0x7f74f4103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.618+0000 7f74faca9640 1 -- 172.21.15.42:0/219962373 shutdown_connections 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-09-19T09:30:33.618+0000 7f74faca9640 1 -- 172.21.15.42:0/219962373 wait complete. 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T09:30:34.193 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout: ceph telemetry on 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout:For more information see: 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:34.194 INFO:teuthology.orchestra.run.smithi042.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T09:30:34.195 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:34.195 INFO:teuthology.orchestra.run.smithi042.stdout:Bootstrap complete. 2024-09-19T09:30:34.235 INFO:tasks.cephadm:Fetching config... 2024-09-19T09:30:34.235 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:30:34.235 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T09:30:34.254 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T09:30:34.254 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:30:34.254 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T09:30:34.312 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T09:30:34.313 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:30:34.313 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T09:30:34.381 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T09:30:34.381 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:30:34.381 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T09:30:34.438 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T09:30:34.438 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/olNa1mqltkzCLEPopq/SEkBNYSCqzcola5ljPidI+N2bW96mt2BTqzRJpTQW68bV4/Xoh4NfII5ESXSutks/VbRfux+5tH6hdJvB6ablykl0A4gLQo586wfRMw9IpPBGD0MIMPf87Q0UP5MGOHFPpt4/KKutQB2xJt9wc6bh691jfVQW/PJt073XxzF2HW39T/c6L64IG/cdRfaXsi0WevBWo22ZjfWcOC6i8WvwYv2A2gK4gZ3NQl0I29QRAZ/LiydDe4S2ECtDqVFdzErTn7I3i9kuUv/bGFLaJ3NFQX3H49/oTCYoxsyck3fIbt5Tafiiqe/t5qRbYHHUBoEUA7yCVsi3KZsQvEcBzCtncNShymC6UrEY3xRyZucgLzKlfIzrewiq1mX6IUzfOvkA3IDw7ZXeK6oXPzri2TIRgvp/mat7cx/1+FJM87XVQh1YJCmdXACbUKCUJOlgR0iUomFPkwkhnSfCH89I+DWIXx7GlW2WfaVM9V6vMF8ICkk= ceph-90ecc87a-7669-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:30:34.527 INFO:teuthology.orchestra.run.smithi042.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/olNa1mqltkzCLEPopq/SEkBNYSCqzcola5ljPidI+N2bW96mt2BTqzRJpTQW68bV4/Xoh4NfII5ESXSutks/VbRfux+5tH6hdJvB6ablykl0A4gLQo586wfRMw9IpPBGD0MIMPf87Q0UP5MGOHFPpt4/KKutQB2xJt9wc6bh691jfVQW/PJt073XxzF2HW39T/c6L64IG/cdRfaXsi0WevBWo22ZjfWcOC6i8WvwYv2A2gK4gZ3NQl0I29QRAZ/LiydDe4S2ECtDqVFdzErTn7I3i9kuUv/bGFLaJ3NFQX3H49/oTCYoxsyck3fIbt5Tafiiqe/t5qRbYHHUBoEUA7yCVsi3KZsQvEcBzCtncNShymC6UrEY3xRyZucgLzKlfIzrewiq1mX6IUzfOvkA3IDw7ZXeK6oXPzri2TIRgvp/mat7cx/1+FJM87XVQh1YJCmdXACbUKCUJOlgR0iUomFPkwkhnSfCH89I+DWIXx7GlW2WfaVM9V6vMF8ICkk= ceph-90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:30:34.540 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/olNa1mqltkzCLEPopq/SEkBNYSCqzcola5ljPidI+N2bW96mt2BTqzRJpTQW68bV4/Xoh4NfII5ESXSutks/VbRfux+5tH6hdJvB6ablykl0A4gLQo586wfRMw9IpPBGD0MIMPf87Q0UP5MGOHFPpt4/KKutQB2xJt9wc6bh691jfVQW/PJt073XxzF2HW39T/c6L64IG/cdRfaXsi0WevBWo22ZjfWcOC6i8WvwYv2A2gK4gZ3NQl0I29QRAZ/LiydDe4S2ECtDqVFdzErTn7I3i9kuUv/bGFLaJ3NFQX3H49/oTCYoxsyck3fIbt5Tafiiqe/t5qRbYHHUBoEUA7yCVsi3KZsQvEcBzCtncNShymC6UrEY3xRyZucgLzKlfIzrewiq1mX6IUzfOvkA3IDw7ZXeK6oXPzri2TIRgvp/mat7cx/1+FJM87XVQh1YJCmdXACbUKCUJOlgR0iUomFPkwkhnSfCH89I+DWIXx7GlW2WfaVM9V6vMF8ICkk= ceph-90ecc87a-7669-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:30:34.582 INFO:teuthology.orchestra.run.smithi136.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/olNa1mqltkzCLEPopq/SEkBNYSCqzcola5ljPidI+N2bW96mt2BTqzRJpTQW68bV4/Xoh4NfII5ESXSutks/VbRfux+5tH6hdJvB6ablykl0A4gLQo586wfRMw9IpPBGD0MIMPf87Q0UP5MGOHFPpt4/KKutQB2xJt9wc6bh691jfVQW/PJt073XxzF2HW39T/c6L64IG/cdRfaXsi0WevBWo22ZjfWcOC6i8WvwYv2A2gK4gZ3NQl0I29QRAZ/LiydDe4S2ECtDqVFdzErTn7I3i9kuUv/bGFLaJ3NFQX3H49/oTCYoxsyck3fIbt5Tafiiqe/t5qRbYHHUBoEUA7yCVsi3KZsQvEcBzCtncNShymC6UrEY3xRyZucgLzKlfIzrewiq1mX6IUzfOvkA3IDw7ZXeK6oXPzri2TIRgvp/mat7cx/1+FJM87XVQh1YJCmdXACbUKCUJOlgR0iUomFPkwkhnSfCH89I+DWIXx7GlW2WfaVM9V6vMF8ICkk= ceph-90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:30:34.595 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/olNa1mqltkzCLEPopq/SEkBNYSCqzcola5ljPidI+N2bW96mt2BTqzRJpTQW68bV4/Xoh4NfII5ESXSutks/VbRfux+5tH6hdJvB6ablykl0A4gLQo586wfRMw9IpPBGD0MIMPf87Q0UP5MGOHFPpt4/KKutQB2xJt9wc6bh691jfVQW/PJt073XxzF2HW39T/c6L64IG/cdRfaXsi0WevBWo22ZjfWcOC6i8WvwYv2A2gK4gZ3NQl0I29QRAZ/LiydDe4S2ECtDqVFdzErTn7I3i9kuUv/bGFLaJ3NFQX3H49/oTCYoxsyck3fIbt5Tafiiqe/t5qRbYHHUBoEUA7yCVsi3KZsQvEcBzCtncNShymC6UrEY3xRyZucgLzKlfIzrewiq1mX6IUzfOvkA3IDw7ZXeK6oXPzri2TIRgvp/mat7cx/1+FJM87XVQh1YJCmdXACbUKCUJOlgR0iUomFPkwkhnSfCH89I+DWIXx7GlW2WfaVM9V6vMF8ICkk= ceph-90ecc87a-7669-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:30:34.637 INFO:teuthology.orchestra.run.smithi171.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/olNa1mqltkzCLEPopq/SEkBNYSCqzcola5ljPidI+N2bW96mt2BTqzRJpTQW68bV4/Xoh4NfII5ESXSutks/VbRfux+5tH6hdJvB6ablykl0A4gLQo586wfRMw9IpPBGD0MIMPf87Q0UP5MGOHFPpt4/KKutQB2xJt9wc6bh691jfVQW/PJt073XxzF2HW39T/c6L64IG/cdRfaXsi0WevBWo22ZjfWcOC6i8WvwYv2A2gK4gZ3NQl0I29QRAZ/LiydDe4S2ECtDqVFdzErTn7I3i9kuUv/bGFLaJ3NFQX3H49/oTCYoxsyck3fIbt5Tafiiqe/t5qRbYHHUBoEUA7yCVsi3KZsQvEcBzCtncNShymC6UrEY3xRyZucgLzKlfIzrewiq1mX6IUzfOvkA3IDw7ZXeK6oXPzri2TIRgvp/mat7cx/1+FJM87XVQh1YJCmdXACbUKCUJOlgR0iUomFPkwkhnSfCH89I+DWIXx7GlW2WfaVM9V6vMF8ICkk= ceph-90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:30:34.650 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T09:30:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:34.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:34 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/219962373' entity='client.admin' 2024-09-19T09:30:35.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.380+0000 7f3bbddda640 1 -- 172.21.15.42:0/1305376486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb81020a0 msgr2=0x7f3bb8104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.380+0000 7f3bbddda640 1 --2- 172.21.15.42:0/1305376486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb81020a0 0x7f3bb8104490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009880 tx=0x7f3ba802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.381+0000 7f3bbddda640 1 -- 172.21.15.42:0/1305376486 shutdown_connections 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.381+0000 7f3bbddda640 1 --2- 172.21.15.42:0/1305376486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb81020a0 0x7f3bb8104490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.381+0000 7f3bbddda640 1 -- 172.21.15.42:0/1305376486 >> 172.21.15.42:0/1305376486 conn(0x7f3bb80fbc80 msgr2=0x7f3bb80fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.381+0000 7f3bbddda640 1 -- 172.21.15.42:0/1305376486 shutdown_connections 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.381+0000 7f3bbddda640 1 -- 172.21.15.42:0/1305376486 wait complete. 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.381+0000 7f3bbddda640 1 Processor -- start 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.381+0000 7f3bbddda640 1 -- start start 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.381+0000 7f3bbddda640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb81020a0 0x7f3bb8101920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.381+0000 7f3bbddda640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb81076b0 con 0x7f3bb81020a0 2024-09-19T09:30:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.382+0000 7f3bb77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb81020a0 0x7f3bb8101920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.382+0000 7f3bb77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb81020a0 0x7f3bb8101920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33374/0 (socket says 172.21.15.42:33374) 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.382+0000 7f3bb77fe640 1 -- 172.21.15.42:0/3501952014 learned_addr learned my addr 172.21.15.42:0/3501952014 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.382+0000 7f3bb77fe640 1 -- 172.21.15.42:0/3501952014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb8101e60 con 0x7f3bb81020a0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.382+0000 7f3bb77fe640 1 --2- 172.21.15.42:0/3501952014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb81020a0 0x7f3bb8101920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8004f60 tx=0x7f3ba80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.382+0000 7f3bb4ff9640 1 -- 172.21.15.42:0/3501952014 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba803f070 con 0x7f3bb81020a0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.382+0000 7f3bbddda640 1 -- 172.21.15.42:0/3501952014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb8100050 con 0x7f3bb81020a0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.382+0000 7f3bb4ff9640 1 -- 172.21.15.42:0/3501952014 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ba8003ad0 con 0x7f3bb81020a0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.382+0000 7f3bb4ff9640 1 -- 172.21.15.42:0/3501952014 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba8035030 con 0x7f3bb81020a0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.382+0000 7f3bbddda640 1 -- 172.21.15.42:0/3501952014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb8100590 con 0x7f3bb81020a0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.383+0000 7f3bb4ff9640 1 -- 172.21.15.42:0/3501952014 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3ba8042070 con 0x7f3bb81020a0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.383+0000 7f3bbddda640 1 -- 172.21.15.42:0/3501952014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb8107e30 con 0x7f3bb81020a0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.384+0000 7f3bb4ff9640 1 --2- 172.21.15.42:0/3501952014 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3ba00392a0 0x7f3ba003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.384+0000 7f3bb4ff9640 1 -- 172.21.15.42:0/3501952014 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3ba806d280 con 0x7f3bb81020a0 2024-09-19T09:30:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.384+0000 7f3bb6ffd640 1 --2- 172.21.15.42:0/3501952014 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3ba00392a0 0x7f3ba003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.384+0000 7f3bb6ffd640 1 --2- 172.21.15.42:0/3501952014 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3ba00392a0 0x7f3ba003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0098c0 tx=0x7f3bac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.388+0000 7f3bb4ff9640 1 -- 172.21.15.42:0/3501952014 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ba80433b0 con 0x7f3bb81020a0 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.567+0000 7f3bbddda640 1 -- 172.21.15.42:0/3501952014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f3bb8190390 con 0x7f3bb81020a0 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.570+0000 7f3bb4ff9640 1 -- 172.21.15.42:0/3501952014 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f3ba8039350 con 0x7f3bb81020a0 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.572+0000 7f3bbddda640 1 -- 172.21.15.42:0/3501952014 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3ba00392a0 msgr2=0x7f3ba003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.572+0000 7f3bbddda640 1 --2- 172.21.15.42:0/3501952014 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3ba00392a0 0x7f3ba003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0098c0 tx=0x7f3bac006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.572+0000 7f3bbddda640 1 -- 172.21.15.42:0/3501952014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb81020a0 msgr2=0x7f3bb8101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.572+0000 7f3bbddda640 1 --2- 172.21.15.42:0/3501952014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb81020a0 0x7f3bb8101920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8004f60 tx=0x7f3ba80048f0 comp rx=0 tx=0).stop 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.572+0000 7f3bbddda640 1 -- 172.21.15.42:0/3501952014 shutdown_connections 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.572+0000 7f3bbddda640 1 --2- 172.21.15.42:0/3501952014 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3ba00392a0 0x7f3ba003b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.572+0000 7f3bbddda640 1 --2- 172.21.15.42:0/3501952014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb81020a0 0x7f3bb8101920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.572+0000 7f3bbddda640 1 -- 172.21.15.42:0/3501952014 >> 172.21.15.42:0/3501952014 conn(0x7f3bb80fbc80 msgr2=0x7f3bb80fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.572+0000 7f3bbddda640 1 -- 172.21.15.42:0/3501952014 shutdown_connections 2024-09-19T09:30:35.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:35.572+0000 7f3bbddda640 1 -- 172.21.15.42:0/3501952014 wait complete. 2024-09-19T09:30:36.303 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T09:30:36.303 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T09:30:36.675 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:36.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:36 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3501952014' entity='client.admin' 2024-09-19T09:30:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.136+0000 7f8be9572640 1 -- 172.21.15.42:0/2652230412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be41020a0 msgr2=0x7f8be4104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.136+0000 7f8be9572640 1 --2- 172.21.15.42:0/2652230412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be41020a0 0x7f8be4104490 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009880 tx=0x7f8bd402a5d0 comp rx=0 tx=0).stop 2024-09-19T09:30:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.136+0000 7f8be9572640 1 -- 172.21.15.42:0/2652230412 shutdown_connections 2024-09-19T09:30:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.136+0000 7f8be9572640 1 --2- 172.21.15.42:0/2652230412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be41020a0 0x7f8be4104490 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.136+0000 7f8be9572640 1 -- 172.21.15.42:0/2652230412 >> 172.21.15.42:0/2652230412 conn(0x7f8be40fbc80 msgr2=0x7f8be40fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.136+0000 7f8be9572640 1 -- 172.21.15.42:0/2652230412 shutdown_connections 2024-09-19T09:30:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.136+0000 7f8be9572640 1 -- 172.21.15.42:0/2652230412 wait complete. 2024-09-19T09:30:37.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.137+0000 7f8be9572640 1 Processor -- start 2024-09-19T09:30:37.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.137+0000 7f8be9572640 1 -- start start 2024-09-19T09:30:37.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.137+0000 7f8be9572640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be41020a0 0x7f8be4101920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:37.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.137+0000 7f8be9572640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41076b0 con 0x7f8be41020a0 2024-09-19T09:30:37.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.137+0000 7f8be2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be41020a0 0x7f8be4101920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:37.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.137+0000 7f8be2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be41020a0 0x7f8be4101920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33400/0 (socket says 172.21.15.42:33400) 2024-09-19T09:30:37.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.137+0000 7f8be2ffd640 1 -- 172.21.15.42:0/3089525668 learned_addr learned my addr 172.21.15.42:0/3089525668 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:37.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.138+0000 7f8be2ffd640 1 -- 172.21.15.42:0/3089525668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be4101e60 con 0x7f8be41020a0 2024-09-19T09:30:37.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.138+0000 7f8be2ffd640 1 --2- 172.21.15.42:0/3089525668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be41020a0 0x7f8be4101920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4004f60 tx=0x7f8bd40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:37.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.138+0000 7f8be0ff9640 1 -- 172.21.15.42:0/3089525668 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bd403f070 con 0x7f8be41020a0 2024-09-19T09:30:37.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.138+0000 7f8be0ff9640 1 -- 172.21.15.42:0/3089525668 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd4003ad0 con 0x7f8be41020a0 2024-09-19T09:30:37.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.138+0000 7f8be9572640 1 -- 172.21.15.42:0/3089525668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be4100050 con 0x7f8be41020a0 2024-09-19T09:30:37.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.138+0000 7f8be0ff9640 1 -- 172.21.15.42:0/3089525668 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bd4035030 con 0x7f8be41020a0 2024-09-19T09:30:37.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.138+0000 7f8be9572640 1 -- 172.21.15.42:0/3089525668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be4100590 con 0x7f8be41020a0 2024-09-19T09:30:37.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.139+0000 7f8be0ff9640 1 -- 172.21.15.42:0/3089525668 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f8bd4042070 con 0x7f8be41020a0 2024-09-19T09:30:37.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.139+0000 7f8be9572640 1 -- 172.21.15.42:0/3089525668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be4107e30 con 0x7f8be41020a0 2024-09-19T09:30:37.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.139+0000 7f8be0ff9640 1 --2- 172.21.15.42:0/3089525668 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bd0039300 0x7f8bd003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:37.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.139+0000 7f8be0ff9640 1 -- 172.21.15.42:0/3089525668 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8bd406d0c0 con 0x7f8be41020a0 2024-09-19T09:30:37.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.139+0000 7f8bda7fc640 1 --2- 172.21.15.42:0/3089525668 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bd0039300 0x7f8bd003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:37.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.140+0000 7f8bda7fc640 1 --2- 172.21.15.42:0/3089525668 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bd0039300 0x7f8bd003b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0098c0 tx=0x7f8bcc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:37.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.144+0000 7f8be0ff9640 1 -- 172.21.15.42:0/3089525668 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8bd40433b0 con 0x7f8be41020a0 2024-09-19T09:30:37.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.328+0000 7f8be9572640 1 -- 172.21.15.42:0/3089525668 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f8be4190390 con 0x7f8bd0039300 2024-09-19T09:30:37.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.331+0000 7f8be0ff9640 1 -- 172.21.15.42:0/3089525668 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8be4190390 con 0x7f8bd0039300 2024-09-19T09:30:37.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.333+0000 7f8be9572640 1 -- 172.21.15.42:0/3089525668 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bd0039300 msgr2=0x7f8bd003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:37.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.333+0000 7f8be9572640 1 --2- 172.21.15.42:0/3089525668 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bd0039300 0x7f8bd003b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0098c0 tx=0x7f8bcc006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:37.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.333+0000 7f8be9572640 1 -- 172.21.15.42:0/3089525668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be41020a0 msgr2=0x7f8be4101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:37.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.333+0000 7f8be9572640 1 --2- 172.21.15.42:0/3089525668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be41020a0 0x7f8be4101920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4004f60 tx=0x7f8bd40048f0 comp rx=0 tx=0).stop 2024-09-19T09:30:37.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.333+0000 7f8be9572640 1 -- 172.21.15.42:0/3089525668 shutdown_connections 2024-09-19T09:30:37.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.333+0000 7f8be9572640 1 --2- 172.21.15.42:0/3089525668 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bd0039300 0x7f8bd003b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:37.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.333+0000 7f8be9572640 1 --2- 172.21.15.42:0/3089525668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be41020a0 0x7f8be4101920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:37.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.333+0000 7f8be9572640 1 -- 172.21.15.42:0/3089525668 >> 172.21.15.42:0/3089525668 conn(0x7f8be40fbc80 msgr2=0x7f8be40fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:37.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.334+0000 7f8be9572640 1 -- 172.21.15.42:0/3089525668 shutdown_connections 2024-09-19T09:30:37.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:37.334+0000 7f8be9572640 1 -- 172.21.15.42:0/3089525668 wait complete. 2024-09-19T09:30:37.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:37.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:37.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:37.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:37 smithi042 ceph-mon[31223]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-19T09:30:38.339 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi136 2024-09-19T09:30:38.340 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:30:38.340 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:30:38.359 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:30:38.359 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:30:38.418 INFO:tasks.cephadm:Adding host smithi136 to orchestrator... 2024-09-19T09:30:38.418 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch host add smithi136 2024-09-19T09:30:38.979 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.359+0000 7fd61ed4d640 1 -- 172.21.15.42:0/36939416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd618102730 msgr2=0x7fd618102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.359+0000 7fd61ed4d640 1 --2- 172.21.15.42:0/36939416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd618102730 0x7fd618102b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd600009810 tx=0x7fd60002a540 comp rx=0 tx=0).stop 2024-09-19T09:30:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.359+0000 7fd61ed4d640 1 -- 172.21.15.42:0/36939416 shutdown_connections 2024-09-19T09:30:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.359+0000 7fd61ed4d640 1 --2- 172.21.15.42:0/36939416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd618102730 0x7fd618102b10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.359+0000 7fd61ed4d640 1 -- 172.21.15.42:0/36939416 >> 172.21.15.42:0/36939416 conn(0x7fd618077310 msgr2=0x7fd6180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.359+0000 7fd61ed4d640 1 -- 172.21.15.42:0/36939416 shutdown_connections 2024-09-19T09:30:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.359+0000 7fd61ed4d640 1 -- 172.21.15.42:0/36939416 wait complete. 2024-09-19T09:30:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.360+0000 7fd61ed4d640 1 Processor -- start 2024-09-19T09:30:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.360+0000 7fd61ed4d640 1 -- start start 2024-09-19T09:30:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.360+0000 7fd61ed4d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd618102730 0x7fd6181971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.360+0000 7fd61ed4d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd61810bc80 con 0x7fd618102730 2024-09-19T09:30:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.360+0000 7fd61cae9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd618102730 0x7fd6181971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.360+0000 7fd61cae9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd618102730 0x7fd6181971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33416/0 (socket says 172.21.15.42:33416) 2024-09-19T09:30:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.360+0000 7fd61cae9640 1 -- 172.21.15.42:0/1758861581 learned_addr learned my addr 172.21.15.42:0/1758861581 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.360+0000 7fd61cae9640 1 -- 172.21.15.42:0/1758861581 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6181976f0 con 0x7fd618102730 2024-09-19T09:30:39.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.360+0000 7fd61cae9640 1 --2- 172.21.15.42:0/1758861581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd618102730 0x7fd6181971b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6000045e0 tx=0x7fd600004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.361+0000 7fd615ffb640 1 -- 172.21.15.42:0/1758861581 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600030e70 con 0x7fd618102730 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.361+0000 7fd615ffb640 1 -- 172.21.15.42:0/1758861581 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6000318e0 con 0x7fd618102730 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.361+0000 7fd61ed4d640 1 -- 172.21.15.42:0/1758861581 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd618197980 con 0x7fd618102730 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.361+0000 7fd615ffb640 1 -- 172.21.15.42:0/1758861581 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000049c0 con 0x7fd618102730 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.361+0000 7fd61ed4d640 1 -- 172.21.15.42:0/1758861581 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd618197de0 con 0x7fd618102730 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.362+0000 7fd615ffb640 1 -- 172.21.15.42:0/1758861581 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fd600039040 con 0x7fd618102730 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.362+0000 7fd615ffb640 1 --2- 172.21.15.42:0/1758861581 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd604039300 0x7fd60403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.362+0000 7fd61ed4d640 1 -- 172.21.15.42:0/1758861581 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd618069f90 con 0x7fd618102730 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.362+0000 7fd615ffb640 1 -- 172.21.15.42:0/1758861581 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd60006d550 con 0x7fd618102730 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.362+0000 7fd617fff640 1 --2- 172.21.15.42:0/1758861581 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd604039300 0x7fd60403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.362+0000 7fd617fff640 1 --2- 172.21.15.42:0/1758861581 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd604039300 0x7fd60403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd60800ad30 tx=0x7fd6080093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.367+0000 7fd615ffb640 1 -- 172.21.15.42:0/1758861581 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd600040030 con 0x7fd618102730 2024-09-19T09:30:39.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:39.545+0000 7fd61ed4d640 1 -- 172.21.15.42:0/1758861581 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}) -- 0x7fd618198570 con 0x7fd604039300 2024-09-19T09:30:39.548 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:39 smithi042 ceph-mon[31223]: Updating smithi042:/var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:39.548 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:39 smithi042 ceph-mon[31223]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:30:39.548 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:39 smithi042 ceph-mon[31223]: Updating smithi042:/var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:30:39.548 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:39 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:39.548 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:39 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:39.548 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:39 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:40.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:40 smithi042 ceph-mon[31223]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:41.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:41 smithi042 ceph-mon[31223]: Deploying cephadm binary to smithi136 2024-09-19T09:30:43.397 INFO:teuthology.orchestra.run.smithi042.stdout:Added host 'smithi136' with addr '172.21.15.136' 2024-09-19T09:30:43.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.395+0000 7fd615ffb640 1 -- 172.21.15.42:0/1758861581 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd618198570 con 0x7fd604039300 2024-09-19T09:30:43.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.398+0000 7fd61ed4d640 1 -- 172.21.15.42:0/1758861581 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd604039300 msgr2=0x7fd60403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:43.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.398+0000 7fd61ed4d640 1 --2- 172.21.15.42:0/1758861581 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd604039300 0x7fd60403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd60800ad30 tx=0x7fd6080093f0 comp rx=0 tx=0).stop 2024-09-19T09:30:43.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.398+0000 7fd61ed4d640 1 -- 172.21.15.42:0/1758861581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd618102730 msgr2=0x7fd6181971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:43.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.398+0000 7fd61ed4d640 1 --2- 172.21.15.42:0/1758861581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd618102730 0x7fd6181971b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6000045e0 tx=0x7fd600004610 comp rx=0 tx=0).stop 2024-09-19T09:30:43.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.398+0000 7fd61ed4d640 1 -- 172.21.15.42:0/1758861581 shutdown_connections 2024-09-19T09:30:43.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.398+0000 7fd61ed4d640 1 --2- 172.21.15.42:0/1758861581 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd604039300 0x7fd60403b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:43.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.398+0000 7fd61ed4d640 1 --2- 172.21.15.42:0/1758861581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd618102730 0x7fd6181971b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:43.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.398+0000 7fd61ed4d640 1 -- 172.21.15.42:0/1758861581 >> 172.21.15.42:0/1758861581 conn(0x7fd618077310 msgr2=0x7fd6181054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:43.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.398+0000 7fd61ed4d640 1 -- 172.21.15.42:0/1758861581 shutdown_connections 2024-09-19T09:30:43.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:43.398+0000 7fd61ed4d640 1 -- 172.21.15.42:0/1758861581 wait complete. 2024-09-19T09:30:43.968 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:30:44.217 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:44.625 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:44.625 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:44 smithi042 ceph-mon[31223]: Added host smithi136 2024-09-19T09:30:44.625 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:44.625 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:44.625 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:44.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.632+0000 7fce25aea640 1 -- 172.21.15.42:0/3111167339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20106560 msgr2=0x7fce20106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.632+0000 7fce25aea640 1 --2- 172.21.15.42:0/3111167339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20106560 0x7fce20106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce10009880 tx=0x7fce1002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.632+0000 7fce25aea640 1 -- 172.21.15.42:0/3111167339 shutdown_connections 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.632+0000 7fce25aea640 1 --2- 172.21.15.42:0/3111167339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20106560 0x7fce20106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.632+0000 7fce25aea640 1 -- 172.21.15.42:0/3111167339 >> 172.21.15.42:0/3111167339 conn(0x7fce200fc1b0 msgr2=0x7fce200fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.632+0000 7fce25aea640 1 -- 172.21.15.42:0/3111167339 shutdown_connections 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.632+0000 7fce25aea640 1 -- 172.21.15.42:0/3111167339 wait complete. 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.632+0000 7fce25aea640 1 Processor -- start 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.633+0000 7fce25aea640 1 -- start start 2024-09-19T09:30:44.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.633+0000 7fce25aea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20106560 0x7fce20197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.633+0000 7fce25aea640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce2010ab90 con 0x7fce20106560 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.633+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20106560 0x7fce20197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.633+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20106560 0x7fce20197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37534/0 (socket says 172.21.15.42:37534) 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.633+0000 7fce1f7fe640 1 -- 172.21.15.42:0/2284625963 learned_addr learned my addr 172.21.15.42:0/2284625963 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.633+0000 7fce1f7fe640 1 -- 172.21.15.42:0/2284625963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce20197640 con 0x7fce20106560 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.633+0000 7fce1f7fe640 1 --2- 172.21.15.42:0/2284625963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20106560 0x7fce20197100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce10009230 tx=0x7fce10003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.634+0000 7fce1cff9640 1 -- 172.21.15.42:0/2284625963 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1003f070 con 0x7fce20106560 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.634+0000 7fce25aea640 1 -- 172.21.15.42:0/2284625963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce201978d0 con 0x7fce20106560 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.634+0000 7fce1cff9640 1 -- 172.21.15.42:0/2284625963 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce1003bc80 con 0x7fce20106560 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.634+0000 7fce1cff9640 1 -- 172.21.15.42:0/2284625963 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce10035030 con 0x7fce20106560 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.634+0000 7fce25aea640 1 -- 172.21.15.42:0/2284625963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2019b9d0 con 0x7fce20106560 2024-09-19T09:30:44.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.635+0000 7fce1cff9640 1 -- 172.21.15.42:0/2284625963 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fce10042070 con 0x7fce20106560 2024-09-19T09:30:44.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.635+0000 7fce1cff9640 1 --2- 172.21.15.42:0/2284625963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce080392a0 0x7fce0803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.635+0000 7fce1cff9640 1 -- 172.21.15.42:0/2284625963 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fce100314c0 con 0x7fce20106560 2024-09-19T09:30:44.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.635+0000 7fce1effd640 1 --2- 172.21.15.42:0/2284625963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce080392a0 0x7fce0803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.635+0000 7fce25aea640 1 -- 172.21.15.42:0/2284625963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce20101bd0 con 0x7fce20106560 2024-09-19T09:30:44.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.635+0000 7fce1effd640 1 --2- 172.21.15.42:0/2284625963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce080392a0 0x7fce0803b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fce140098c0 tx=0x7fce14006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.640+0000 7fce1cff9640 1 -- 172.21.15.42:0/2284625963 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce1004c350 con 0x7fce20106560 2024-09-19T09:30:44.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.821+0000 7fce25aea640 1 -- 172.21.15.42:0/2284625963 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce201069c0 con 0x7fce080392a0 2024-09-19T09:30:44.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.822+0000 7fce1cff9640 1 -- 172.21.15.42:0/2284625963 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fce201069c0 con 0x7fce080392a0 2024-09-19T09:30:44.823 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:44.823 INFO:teuthology.orchestra.run.smithi042.stdout:[{"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}] 2024-09-19T09:30:44.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.824+0000 7fce25aea640 1 -- 172.21.15.42:0/2284625963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce080392a0 msgr2=0x7fce0803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.824+0000 7fce25aea640 1 --2- 172.21.15.42:0/2284625963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce080392a0 0x7fce0803b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fce140098c0 tx=0x7fce14006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.824+0000 7fce25aea640 1 -- 172.21.15.42:0/2284625963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20106560 msgr2=0x7fce20197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.824+0000 7fce25aea640 1 --2- 172.21.15.42:0/2284625963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20106560 0x7fce20197100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce10009230 tx=0x7fce10003d40 comp rx=0 tx=0).stop 2024-09-19T09:30:44.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.824+0000 7fce25aea640 1 -- 172.21.15.42:0/2284625963 shutdown_connections 2024-09-19T09:30:44.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.824+0000 7fce25aea640 1 --2- 172.21.15.42:0/2284625963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce080392a0 0x7fce0803b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.824+0000 7fce25aea640 1 --2- 172.21.15.42:0/2284625963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20106560 0x7fce20197100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.824+0000 7fce25aea640 1 -- 172.21.15.42:0/2284625963 >> 172.21.15.42:0/2284625963 conn(0x7fce200fc1b0 msgr2=0x7fce20069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:44.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.824+0000 7fce25aea640 1 -- 172.21.15.42:0/2284625963 shutdown_connections 2024-09-19T09:30:44.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:44.824+0000 7fce25aea640 1 -- 172.21.15.42:0/2284625963 wait complete. 2024-09-19T09:30:45.439 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi171 2024-09-19T09:30:45.439 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:30:45.439 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:30:45.459 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:30:45.459 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:30:45.518 INFO:tasks.cephadm:Adding host smithi171 to orchestrator... 2024-09-19T09:30:45.518 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch host add smithi171 2024-09-19T09:30:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:46.002 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:46.002 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:45 smithi042 ceph-mon[31223]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:30:46.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.189+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3404351725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf84102750 msgr2=0x7fcf84102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:46.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.189+0000 7fcf8b4d8640 1 --2- 172.21.15.42:0/3404351725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf84102750 0x7fcf84102b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009880 tx=0x7fcf8002a670 comp rx=0 tx=0).stop 2024-09-19T09:30:46.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.189+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3404351725 shutdown_connections 2024-09-19T09:30:46.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.189+0000 7fcf8b4d8640 1 --2- 172.21.15.42:0/3404351725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf84102750 0x7fcf84102b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.189+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3404351725 >> 172.21.15.42:0/3404351725 conn(0x7fcf840fc1b0 msgr2=0x7fcf840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:46.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.189+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3404351725 shutdown_connections 2024-09-19T09:30:46.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.189+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3404351725 wait complete. 2024-09-19T09:30:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.189+0000 7fcf8b4d8640 1 Processor -- start 2024-09-19T09:30:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.190+0000 7fcf8b4d8640 1 -- start start 2024-09-19T09:30:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.190+0000 7fcf8b4d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf84102750 0x7fcf841971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:46.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.190+0000 7fcf8b4d8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8410bcc0 con 0x7fcf84102750 2024-09-19T09:30:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.190+0000 7fcf89274640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf84102750 0x7fcf841971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.190+0000 7fcf89274640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf84102750 0x7fcf841971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37540/0 (socket says 172.21.15.42:37540) 2024-09-19T09:30:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.190+0000 7fcf89274640 1 -- 172.21.15.42:0/3385580725 learned_addr learned my addr 172.21.15.42:0/3385580725 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.190+0000 7fcf89274640 1 -- 172.21.15.42:0/3385580725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf84197700 con 0x7fcf84102750 2024-09-19T09:30:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.190+0000 7fcf89274640 1 --2- 172.21.15.42:0/3385580725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf84102750 0x7fcf841971c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009230 tx=0x7fcf80003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.190+0000 7fcf7a7fc640 1 -- 172.21.15.42:0/3385580725 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8003f070 con 0x7fcf84102750 2024-09-19T09:30:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.191+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3385580725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf84197990 con 0x7fcf84102750 2024-09-19T09:30:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.191+0000 7fcf7a7fc640 1 -- 172.21.15.42:0/3385580725 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf8003bc80 con 0x7fcf84102750 2024-09-19T09:30:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.191+0000 7fcf7a7fc640 1 -- 172.21.15.42:0/3385580725 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf80035030 con 0x7fcf84102750 2024-09-19T09:30:46.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.191+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3385580725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf84197df0 con 0x7fcf84102750 2024-09-19T09:30:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.192+0000 7fcf7a7fc640 1 -- 172.21.15.42:0/3385580725 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fcf80042070 con 0x7fcf84102750 2024-09-19T09:30:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.192+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3385580725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8406a7b0 con 0x7fcf84102750 2024-09-19T09:30:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.192+0000 7fcf7a7fc640 1 --2- 172.21.15.42:0/3385580725 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf700392a0 0x7fcf7003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.192+0000 7fcf7a7fc640 1 -- 172.21.15.42:0/3385580725 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcf8006d0d0 con 0x7fcf84102750 2024-09-19T09:30:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.192+0000 7fcf88a73640 1 --2- 172.21.15.42:0/3385580725 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf700392a0 0x7fcf7003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.192+0000 7fcf88a73640 1 --2- 172.21.15.42:0/3385580725 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf700392a0 0x7fcf7003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcf740098c0 tx=0x7fcf74006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:46.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.197+0000 7fcf7a7fc640 1 -- 172.21.15.42:0/3385580725 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf8003a8e0 con 0x7fcf84102750 2024-09-19T09:30:46.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:46.375+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3385580725 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}) -- 0x7fcf84198520 con 0x7fcf700392a0 2024-09-19T09:30:47.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:46 smithi042 ceph-mon[31223]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:47 smithi042 ceph-mon[31223]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:49.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:48 smithi042 ceph-mon[31223]: Deploying cephadm binary to smithi171 2024-09-19T09:30:49.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:48 smithi042 ceph-mon[31223]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-19T09:30:49.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:48 smithi042 ceph-mon[31223]: Updating smithi136:/var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:49.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:48 smithi042 ceph-mon[31223]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:30:49.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:48 smithi042 ceph-mon[31223]: Updating smithi136:/var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:30:49.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:48 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:49.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:48 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:49.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:48 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:50.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:49 smithi042 ceph-mon[31223]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:50.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.344+0000 7fcf7a7fc640 1 -- 172.21.15.42:0/3385580725 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fcf84198520 con 0x7fcf700392a0 2024-09-19T09:30:50.346 INFO:teuthology.orchestra.run.smithi042.stdout:Added host 'smithi171' with addr '172.21.15.171' 2024-09-19T09:30:50.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.346+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3385580725 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf700392a0 msgr2=0x7fcf7003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.346+0000 7fcf8b4d8640 1 --2- 172.21.15.42:0/3385580725 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf700392a0 0x7fcf7003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcf740098c0 tx=0x7fcf74006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.346+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3385580725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf84102750 msgr2=0x7fcf841971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.346+0000 7fcf8b4d8640 1 --2- 172.21.15.42:0/3385580725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf84102750 0x7fcf841971c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009230 tx=0x7fcf80003d40 comp rx=0 tx=0).stop 2024-09-19T09:30:50.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.346+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3385580725 shutdown_connections 2024-09-19T09:30:50.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.346+0000 7fcf8b4d8640 1 --2- 172.21.15.42:0/3385580725 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf700392a0 0x7fcf7003b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.346+0000 7fcf8b4d8640 1 --2- 172.21.15.42:0/3385580725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf84102750 0x7fcf841971c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.346+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3385580725 >> 172.21.15.42:0/3385580725 conn(0x7fcf840fc1b0 msgr2=0x7fcf84103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:50.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.347+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3385580725 shutdown_connections 2024-09-19T09:30:50.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:50.347+0000 7fcf8b4d8640 1 -- 172.21.15.42:0/3385580725 wait complete. 2024-09-19T09:30:50.900 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:30:51.161 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:51.572 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:51.572 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:51 smithi042 ceph-mon[31223]: Added host smithi171 2024-09-19T09:30:51.572 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:51.572 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:51.572 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:51.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.653+0000 7fc606bcb640 1 -- 172.21.15.42:0/2381112251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc600107660 msgr2=0x7fc600107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.653+0000 7fc606bcb640 1 --2- 172.21.15.42:0/2381112251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc600107660 0x7fc600107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009880 tx=0x7fc5f402a5d0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.653+0000 7fc606bcb640 1 -- 172.21.15.42:0/2381112251 shutdown_connections 2024-09-19T09:30:51.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.653+0000 7fc606bcb640 1 --2- 172.21.15.42:0/2381112251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc600107660 0x7fc600107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.653+0000 7fc606bcb640 1 -- 172.21.15.42:0/2381112251 >> 172.21.15.42:0/2381112251 conn(0x7fc6000fd290 msgr2=0x7fc6000ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.653+0000 7fc606bcb640 1 -- 172.21.15.42:0/2381112251 shutdown_connections 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.653+0000 7fc606bcb640 1 -- 172.21.15.42:0/2381112251 wait complete. 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.654+0000 7fc606bcb640 1 Processor -- start 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.654+0000 7fc606bcb640 1 -- start start 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.654+0000 7fc606bcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc600107660 0x7fc6001970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.654+0000 7fc606bcb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc60010bc90 con 0x7fc600107660 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.654+0000 7fc604967640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc600107660 0x7fc6001970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.654+0000 7fc604967640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc600107660 0x7fc6001970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34092/0 (socket says 172.21.15.42:34092) 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.654+0000 7fc604967640 1 -- 172.21.15.42:0/1162776498 learned_addr learned my addr 172.21.15.42:0/1162776498 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.654+0000 7fc604967640 1 -- 172.21.15.42:0/1162776498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc600197630 con 0x7fc600107660 2024-09-19T09:30:51.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.654+0000 7fc604967640 1 --2- 172.21.15.42:0/1162776498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc600107660 0x7fc6001970f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009230 tx=0x7fc5f4003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.655+0000 7fc5fdffb640 1 -- 172.21.15.42:0/1162776498 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5f403f070 con 0x7fc600107660 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.655+0000 7fc5fdffb640 1 -- 172.21.15.42:0/1162776498 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5f403bd40 con 0x7fc600107660 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.655+0000 7fc606bcb640 1 -- 172.21.15.42:0/1162776498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6001978c0 con 0x7fc600107660 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.655+0000 7fc5fdffb640 1 -- 172.21.15.42:0/1162776498 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5f4035030 con 0x7fc600107660 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.655+0000 7fc606bcb640 1 -- 172.21.15.42:0/1162776498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60019b9c0 con 0x7fc600107660 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.656+0000 7fc5fdffb640 1 -- 172.21.15.42:0/1162776498 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc5f4042070 con 0x7fc600107660 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.656+0000 7fc5fdffb640 1 --2- 172.21.15.42:0/1162776498 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f00392a0 0x7fc5f003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.656+0000 7fc5fdffb640 1 -- 172.21.15.42:0/1162776498 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc5f406d170 con 0x7fc600107660 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.656+0000 7fc5fffff640 1 --2- 172.21.15.42:0/1162776498 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f00392a0 0x7fc5f003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.656+0000 7fc606bcb640 1 -- 172.21.15.42:0/1162776498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc600102cd0 con 0x7fc600107660 2024-09-19T09:30:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.656+0000 7fc5fffff640 1 --2- 172.21.15.42:0/1162776498 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f00392a0 0x7fc5f003b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0098c0 tx=0x7fc5ec006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.661+0000 7fc5fdffb640 1 -- 172.21.15.42:0/1162776498 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc5f4031de0 con 0x7fc600107660 2024-09-19T09:30:51.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.841+0000 7fc606bcb640 1 -- 172.21.15.42:0/1162776498 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc600198450 con 0x7fc5f00392a0 2024-09-19T09:30:51.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.843+0000 7fc5fdffb640 1 -- 172.21.15.42:0/1162776498 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7fc600198450 con 0x7fc5f00392a0 2024-09-19T09:30:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:30:51.844 INFO:teuthology.orchestra.run.smithi042.stdout:[{"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}, {"addr": "172.21.15.171", "hostname": "smithi171", "labels": [], "status": ""}] 2024-09-19T09:30:51.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.845+0000 7fc606bcb640 1 -- 172.21.15.42:0/1162776498 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f00392a0 msgr2=0x7fc5f003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.845+0000 7fc606bcb640 1 --2- 172.21.15.42:0/1162776498 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f00392a0 0x7fc5f003b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0098c0 tx=0x7fc5ec006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.845+0000 7fc606bcb640 1 -- 172.21.15.42:0/1162776498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc600107660 msgr2=0x7fc6001970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.845+0000 7fc606bcb640 1 --2- 172.21.15.42:0/1162776498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc600107660 0x7fc6001970f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009230 tx=0x7fc5f4003d80 comp rx=0 tx=0).stop 2024-09-19T09:30:51.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.845+0000 7fc606bcb640 1 -- 172.21.15.42:0/1162776498 shutdown_connections 2024-09-19T09:30:51.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.845+0000 7fc606bcb640 1 --2- 172.21.15.42:0/1162776498 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f00392a0 0x7fc5f003b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.845+0000 7fc606bcb640 1 --2- 172.21.15.42:0/1162776498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc600107660 0x7fc6001970f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.845+0000 7fc606bcb640 1 -- 172.21.15.42:0/1162776498 >> 172.21.15.42:0/1162776498 conn(0x7fc6000fd290 msgr2=0x7fc6000febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:51.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.845+0000 7fc606bcb640 1 -- 172.21.15.42:0/1162776498 shutdown_connections 2024-09-19T09:30:51.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:51.845+0000 7fc606bcb640 1 -- 172.21.15.42:0/1162776498 wait complete. 2024-09-19T09:30:52.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:52 smithi042 ceph-mon[31223]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:52.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:52 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:52.471 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T09:30:52.471 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T09:30:52.719 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:53.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.136+0000 7fed3251b640 1 -- 172.21.15.42:0/2423788636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c102750 msgr2=0x7fed2c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.136+0000 7fed3251b640 1 --2- 172.21.15.42:0/2423788636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c102750 0x7fed2c102b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009880 tx=0x7fed1c02a670 comp rx=0 tx=0).stop 2024-09-19T09:30:53.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.136+0000 7fed3251b640 1 -- 172.21.15.42:0/2423788636 shutdown_connections 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.136+0000 7fed3251b640 1 --2- 172.21.15.42:0/2423788636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c102750 0x7fed2c102b30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.136+0000 7fed3251b640 1 -- 172.21.15.42:0/2423788636 >> 172.21.15.42:0/2423788636 conn(0x7fed2c0fc1b0 msgr2=0x7fed2c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.136+0000 7fed3251b640 1 -- 172.21.15.42:0/2423788636 shutdown_connections 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.136+0000 7fed3251b640 1 -- 172.21.15.42:0/2423788636 wait complete. 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.137+0000 7fed3251b640 1 Processor -- start 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.137+0000 7fed3251b640 1 -- start start 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.137+0000 7fed3251b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c102750 0x7fed2c1003b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.137+0000 7fed3251b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c10bcc0 con 0x7fed2c102750 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.137+0000 7fed2bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c102750 0x7fed2c1003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.137+0000 7fed2bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c102750 0x7fed2c1003b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34110/0 (socket says 172.21.15.42:34110) 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.137+0000 7fed2bfff640 1 -- 172.21.15.42:0/1559565911 learned_addr learned my addr 172.21.15.42:0/1559565911 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:30:53.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.138+0000 7fed2bfff640 1 -- 172.21.15.42:0/1559565911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c1022a0 con 0x7fed2c102750 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.138+0000 7fed2bfff640 1 --2- 172.21.15.42:0/1559565911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c102750 0x7fed2c1003b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009230 tx=0x7fed1c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.138+0000 7fed297fa640 1 -- 172.21.15.42:0/1559565911 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c03f070 con 0x7fed2c102750 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.138+0000 7fed3251b640 1 -- 172.21.15.42:0/1559565911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2c1008f0 con 0x7fed2c102750 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.138+0000 7fed297fa640 1 -- 172.21.15.42:0/1559565911 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed1c03bd40 con 0x7fed2c102750 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.138+0000 7fed297fa640 1 -- 172.21.15.42:0/1559565911 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c035030 con 0x7fed2c102750 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.138+0000 7fed3251b640 1 -- 172.21.15.42:0/1559565911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2c100db0 con 0x7fed2c102750 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.139+0000 7fed297fa640 1 -- 172.21.15.42:0/1559565911 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fed1c042070 con 0x7fed2c102750 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.139+0000 7fed3251b640 1 -- 172.21.15.42:0/1559565911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2c06a7b0 con 0x7fed2c102750 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.139+0000 7fed297fa640 1 --2- 172.21.15.42:0/1559565911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed140392a0 0x7fed1403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.139+0000 7fed297fa640 1 -- 172.21.15.42:0/1559565911 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fed1c06cf50 con 0x7fed2c102750 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.139+0000 7fed2b7fe640 1 --2- 172.21.15.42:0/1559565911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed140392a0 0x7fed1403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.140+0000 7fed2b7fe640 1 --2- 172.21.15.42:0/1559565911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed140392a0 0x7fed1403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fed200098c0 tx=0x7fed20006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:53.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.144+0000 7fed297fa640 1 -- 172.21.15.42:0/1559565911 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed1c030d60 con 0x7fed2c102750 2024-09-19T09:30:53.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.325+0000 7fed3251b640 1 -- 172.21.15.42:0/1559565911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fed2c1018e0 con 0x7fed2c102750 2024-09-19T09:30:53.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.348+0000 7fed297fa640 1 -- 172.21.15.42:0/1559565911 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fed1c03b860 con 0x7fed2c102750 2024-09-19T09:30:53.349 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-09-19T09:30:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.350+0000 7fed3251b640 1 -- 172.21.15.42:0/1559565911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed140392a0 msgr2=0x7fed1403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.350+0000 7fed3251b640 1 --2- 172.21.15.42:0/1559565911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed140392a0 0x7fed1403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fed200098c0 tx=0x7fed20006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.350+0000 7fed3251b640 1 -- 172.21.15.42:0/1559565911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c102750 msgr2=0x7fed2c1003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.350+0000 7fed3251b640 1 --2- 172.21.15.42:0/1559565911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c102750 0x7fed2c1003b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009230 tx=0x7fed1c003d80 comp rx=0 tx=0).stop 2024-09-19T09:30:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.350+0000 7fed3251b640 1 -- 172.21.15.42:0/1559565911 shutdown_connections 2024-09-19T09:30:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.350+0000 7fed3251b640 1 --2- 172.21.15.42:0/1559565911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed140392a0 0x7fed1403b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.350+0000 7fed3251b640 1 --2- 172.21.15.42:0/1559565911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c102750 0x7fed2c1003b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.350+0000 7fed3251b640 1 -- 172.21.15.42:0/1559565911 >> 172.21.15.42:0/1559565911 conn(0x7fed2c0fc1b0 msgr2=0x7fed2c103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.350+0000 7fed3251b640 1 -- 172.21.15.42:0/1559565911 shutdown_connections 2024-09-19T09:30:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:30:53.350+0000 7fed3251b640 1 -- 172.21.15.42:0/1559565911 wait complete. 2024-09-19T09:30:53.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:53 smithi042 ceph-mon[31223]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:30:53.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:53 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1559565911' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T09:30:53.911 INFO:tasks.cephadm:Adding mon.a on smithi042 2024-09-19T09:30:53.911 INFO:tasks.cephadm:Adding mon.b on smithi136 2024-09-19T09:30:53.911 INFO:tasks.cephadm:Adding mon.c on smithi171 2024-09-19T09:30:53.912 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi042:172.21.15.42=a;smithi136:172.21.15.136=b;smithi171:172.21.15.171=c' 2024-09-19T09:30:54.389 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:30:54.444 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:30:54.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:54 smithi042 ceph-mon[31223]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:54.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:54 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1559565911' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T09:30:54.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:54 smithi042 ceph-mon[31223]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:30:54.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.937+0000 7f696af35640 1 -- 172.21.15.171:0/3379259666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6964100510 msgr2=0x7f6964100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.937+0000 7f696af35640 1 --2- 172.21.15.171:0/3379259666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6964100510 0x7f6964100910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6958009880 tx=0x7f695802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.937+0000 7f696af35640 1 -- 172.21.15.171:0/3379259666 shutdown_connections 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.937+0000 7f696af35640 1 --2- 172.21.15.171:0/3379259666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6964100510 0x7f6964100910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.937+0000 7f696af35640 1 -- 172.21.15.171:0/3379259666 >> 172.21.15.171:0/3379259666 conn(0x7f69640fbc80 msgr2=0x7f69640fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.938+0000 7f696af35640 1 -- 172.21.15.171:0/3379259666 shutdown_connections 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.938+0000 7f696af35640 1 -- 172.21.15.171:0/3379259666 wait complete. 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.938+0000 7f696af35640 1 Processor -- start 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.938+0000 7f696af35640 1 -- start start 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.938+0000 7f696af35640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6964100510 0x7f696406a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.938+0000 7f696af35640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6964106620 con 0x7f6964100510 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.939+0000 7f6968cd1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6964100510 0x7f696406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:54.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.939+0000 7f6968cd1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6964100510 0x7f696406a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.171:36506/0 (socket says 172.21.15.171:36506) 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.939+0000 7f6968cd1640 1 -- 172.21.15.171:0/3572914137 learned_addr learned my addr 172.21.15.171:0/3572914137 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.939+0000 7f6968cd1640 1 -- 172.21.15.171:0/3572914137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6964199aa0 con 0x7f6964100510 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.939+0000 7f6968cd1640 1 --2- 172.21.15.171:0/3572914137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6964100510 0x7f696406a990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6958004f60 tx=0x7f69580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.939+0000 7f6961ffb640 1 -- 172.21.15.171:0/3572914137 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f695803f070 con 0x7f6964100510 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.939+0000 7f696af35640 1 -- 172.21.15.171:0/3572914137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6964199c70 con 0x7f6964100510 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.939+0000 7f6961ffb640 1 -- 172.21.15.171:0/3572914137 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6958004d40 con 0x7f6964100510 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.939+0000 7f6961ffb640 1 -- 172.21.15.171:0/3572914137 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6958035030 con 0x7f6964100510 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.940+0000 7f696af35640 1 -- 172.21.15.171:0/3572914137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696419a090 con 0x7f6964100510 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.940+0000 7f6961ffb640 1 -- 172.21.15.171:0/3572914137 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f6958042070 con 0x7f6964100510 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.941+0000 7f696af35640 1 -- 172.21.15.171:0/3572914137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6964106da0 con 0x7f6964100510 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.941+0000 7f6961ffb640 1 --2- 172.21.15.171:0/3572914137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6954039300 0x7f695403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.941+0000 7f6961ffb640 1 -- 172.21.15.171:0/3572914137 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6958003ae0 con 0x7f6964100510 2024-09-19T09:30:54.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.941+0000 7f6963fff640 1 --2- 172.21.15.171:0/3572914137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6954039300 0x7f695403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:54.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.941+0000 7f6963fff640 1 --2- 172.21.15.171:0/3572914137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6954039300 0x7f695403b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f69500098c0 tx=0x7f6950006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:54.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:54.946+0000 7f6961ffb640 1 -- 172.21.15.171:0/3572914137 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6958042360 con 0x7f6964100510 2024-09-19T09:30:55.137 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.135+0000 7f696af35640 1 -- 172.21.15.171:0/3572914137 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi136:172.21.15.136=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}) -- 0x7f696402db40 con 0x7f6954039300 2024-09-19T09:30:55.142 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.141+0000 7f6961ffb640 1 -- 172.21.15.171:0/3572914137 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f696402db40 con 0x7f6954039300 2024-09-19T09:30:55.142 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mon update... 2024-09-19T09:30:55.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.143+0000 7f696af35640 1 -- 172.21.15.171:0/3572914137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6954039300 msgr2=0x7f695403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.143+0000 7f696af35640 1 --2- 172.21.15.171:0/3572914137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6954039300 0x7f695403b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f69500098c0 tx=0x7f6950006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.143+0000 7f696af35640 1 -- 172.21.15.171:0/3572914137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6964100510 msgr2=0x7f696406a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.143+0000 7f696af35640 1 --2- 172.21.15.171:0/3572914137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6964100510 0x7f696406a990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6958004f60 tx=0x7f69580048f0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.143+0000 7f696af35640 1 -- 172.21.15.171:0/3572914137 shutdown_connections 2024-09-19T09:30:55.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.143+0000 7f696af35640 1 --2- 172.21.15.171:0/3572914137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6954039300 0x7f695403b7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.143+0000 7f696af35640 1 --2- 172.21.15.171:0/3572914137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6964100510 0x7f696406a990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.143+0000 7f696af35640 1 -- 172.21.15.171:0/3572914137 >> 172.21.15.171:0/3572914137 conn(0x7f69640fbc80 msgr2=0x7f69640fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:55.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.143+0000 7f696af35640 1 -- 172.21.15.171:0/3572914137 shutdown_connections 2024-09-19T09:30:55.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:55.143+0000 7f696af35640 1 -- 172.21.15.171:0/3572914137 wait complete. 2024-09-19T09:30:55.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:55.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:55.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:55.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:55.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi171", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:55.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:55.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:55.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: Updating smithi171:/etc/ceph/ceph.conf 2024-09-19T09:30:55.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:55.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:55.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:55.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:30:55.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:30:55.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:55.743 DEBUG:teuthology.orchestra.run.smithi136:mon.b> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T09:30:55.746 DEBUG:teuthology.orchestra.run.smithi171:mon.c> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T09:30:55.750 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:30:55.751 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:30:56.404 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:56 smithi042 ceph-mon[31223]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:56 smithi042 ceph-mon[31223]: Updating smithi171:/var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:56 smithi042 ceph-mon[31223]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:30:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:56 smithi042 ceph-mon[31223]: Updating smithi171:/var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:30:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:56 smithi042 ceph-mon[31223]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi136:172.21.15.136=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:56.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:56 smithi042 ceph-mon[31223]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi136:172.21.15.136=b;smithi171:172.21.15.171=c;count:3 2024-09-19T09:30:56.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:56 smithi042 ceph-mon[31223]: Deploying daemon mon.c on smithi171 2024-09-19T09:30:57.097 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.095+0000 7fec823a2640 1 -- 172.21.15.171:0/2513530521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec7c107660 msgr2=0x7fec7c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.097 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.095+0000 7fec823a2640 1 --2- 172.21.15.171:0/2513530521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec7c107660 0x7fec7c107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009880 tx=0x7fec6c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.095+0000 7fec823a2640 1 -- 172.21.15.171:0/2513530521 shutdown_connections 2024-09-19T09:30:57.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.095+0000 7fec823a2640 1 --2- 172.21.15.171:0/2513530521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec7c107660 0x7fec7c107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.095+0000 7fec823a2640 1 -- 172.21.15.171:0/2513530521 >> 172.21.15.171:0/2513530521 conn(0x7fec7c0fd2b0 msgr2=0x7fec7c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:57.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.095+0000 7fec823a2640 1 -- 172.21.15.171:0/2513530521 shutdown_connections 2024-09-19T09:30:57.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.095+0000 7fec823a2640 1 -- 172.21.15.171:0/2513530521 wait complete. 2024-09-19T09:30:57.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.096+0000 7fec823a2640 1 Processor -- start 2024-09-19T09:30:57.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.096+0000 7fec823a2640 1 -- start start 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.096+0000 7fec823a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec7c107660 0x7fec7c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec823a2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c10bc90 con 0x7fec7c107660 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec7bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec7c107660 0x7fec7c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec7bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec7c107660 0x7fec7c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.171:36530/0 (socket says 172.21.15.171:36530) 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec7bfff640 1 -- 172.21.15.171:0/1789229476 learned_addr learned my addr 172.21.15.171:0/1789229476 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec7bfff640 1 -- 172.21.15.171:0/1789229476 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c0763e0 con 0x7fec7c107660 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec7bfff640 1 --2- 172.21.15.171:0/1789229476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec7c107660 0x7fec7c0744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009230 tx=0x7fec6c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec797fa640 1 -- 172.21.15.171:0/1789229476 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec6c03f070 con 0x7fec7c107660 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec797fa640 1 -- 172.21.15.171:0/1789229476 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec6c03bc80 con 0x7fec7c107660 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec823a2640 1 -- 172.21.15.171:0/1789229476 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c074a30 con 0x7fec7c107660 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec797fa640 1 -- 172.21.15.171:0/1789229476 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec6c035030 con 0x7fec7c107660 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.097+0000 7fec823a2640 1 -- 172.21.15.171:0/1789229476 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c074ef0 con 0x7fec7c107660 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.098+0000 7fec797fa640 1 -- 172.21.15.171:0/1789229476 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fec6c042070 con 0x7fec7c107660 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.098+0000 7fec823a2640 1 -- 172.21.15.171:0/1789229476 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c102cd0 con 0x7fec7c107660 2024-09-19T09:30:57.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.098+0000 7fec797fa640 1 --2- 172.21.15.171:0/1789229476 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec640392a0 0x7fec6403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.099+0000 7fec797fa640 1 -- 172.21.15.171:0/1789229476 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fec6c06d200 con 0x7fec7c107660 2024-09-19T09:30:57.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.099+0000 7fec7b7fe640 1 --2- 172.21.15.171:0/1789229476 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec640392a0 0x7fec6403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.099+0000 7fec7b7fe640 1 --2- 172.21.15.171:0/1789229476 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec640392a0 0x7fec6403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fec700098c0 tx=0x7fec70006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:57.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.104+0000 7fec797fa640 1 -- 172.21.15.171:0/1789229476 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fec6c04c350 con 0x7fec7c107660 2024-09-19T09:30:57.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.347+0000 7fec823a2640 1 -- 172.21.15.171:0/1789229476 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fec7c075a20 con 0x7fec7c107660 2024-09-19T09:30:57.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.348+0000 7fec797fa640 1 -- 172.21.15.171:0/1789229476 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fec6c031e20 con 0x7fec7c107660 2024-09-19T09:30:57.350 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:30:57.350 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":1,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:29:35.871137Z","created":"2024-09-19T09:29:35.871137Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:30:57.350 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 1 2024-09-19T09:30:57.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.350+0000 7fec823a2640 1 -- 172.21.15.171:0/1789229476 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec640392a0 msgr2=0x7fec6403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.350+0000 7fec823a2640 1 --2- 172.21.15.171:0/1789229476 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec640392a0 0x7fec6403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fec700098c0 tx=0x7fec70006db0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.350+0000 7fec823a2640 1 -- 172.21.15.171:0/1789229476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec7c107660 msgr2=0x7fec7c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.350+0000 7fec823a2640 1 --2- 172.21.15.171:0/1789229476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec7c107660 0x7fec7c0744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009230 tx=0x7fec6c003d40 comp rx=0 tx=0).stop 2024-09-19T09:30:57.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.350+0000 7fec823a2640 1 -- 172.21.15.171:0/1789229476 shutdown_connections 2024-09-19T09:30:57.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.350+0000 7fec823a2640 1 --2- 172.21.15.171:0/1789229476 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec640392a0 0x7fec6403b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.350+0000 7fec823a2640 1 --2- 172.21.15.171:0/1789229476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec7c107660 0x7fec7c0744f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.350+0000 7fec823a2640 1 -- 172.21.15.171:0/1789229476 >> 172.21.15.171:0/1789229476 conn(0x7fec7c0fd2b0 msgr2=0x7fec7c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:57.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.350+0000 7fec823a2640 1 -- 172.21.15.171:0/1789229476 shutdown_connections 2024-09-19T09:30:57.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:30:57.350+0000 7fec823a2640 1 -- 172.21.15.171:0/1789229476 wait complete. 2024-09-19T09:30:57.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:57 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/1789229476' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:30:58.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:30:58 smithi042 ceph-mon[31223]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:59.266 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:30:59.267 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:30:59.534 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:31:00.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.027+0000 7f590ac10640 1 -- 172.21.15.171:0/2583553348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5904106630 msgr2=0x7f5904106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:00.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.027+0000 7f590ac10640 1 --2- 172.21.15.171:0/2583553348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5904106630 0x7f5904106a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009880 tx=0x7f58f802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:31:00.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.027+0000 7f590ac10640 1 -- 172.21.15.171:0/2583553348 shutdown_connections 2024-09-19T09:31:00.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.027+0000 7f590ac10640 1 --2- 172.21.15.171:0/2583553348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5904106630 0x7f5904106a10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:00.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.027+0000 7f590ac10640 1 -- 172.21.15.171:0/2583553348 >> 172.21.15.171:0/2583553348 conn(0x7f59040fc220 msgr2=0x7f59040fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:00.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.027+0000 7f590ac10640 1 -- 172.21.15.171:0/2583553348 shutdown_connections 2024-09-19T09:31:00.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.027+0000 7f590ac10640 1 -- 172.21.15.171:0/2583553348 wait complete. 2024-09-19T09:31:00.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.028+0000 7f590ac10640 1 Processor -- start 2024-09-19T09:31:00.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.028+0000 7f590ac10640 1 -- start start 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.028+0000 7f590ac10640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5904106630 0x7f5904197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.028+0000 7f590ac10640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f590410ac60 con 0x7f5904106630 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.028+0000 7f59089ac640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5904106630 0x7f5904197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.029+0000 7f59089ac640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5904106630 0x7f5904197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.171:36560/0 (socket says 172.21.15.171:36560) 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.029+0000 7f59089ac640 1 -- 172.21.15.171:0/4082743335 learned_addr learned my addr 172.21.15.171:0/4082743335 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.029+0000 7f59089ac640 1 -- 172.21.15.171:0/4082743335 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5904198520 con 0x7f5904106630 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.029+0000 7f59089ac640 1 --2- 172.21.15.171:0/4082743335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5904106630 0x7f5904197fe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009230 tx=0x7f58f8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.029+0000 7f5901ffb640 1 -- 172.21.15.171:0/4082743335 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f803f070 con 0x7f5904106630 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.029+0000 7f590ac10640 1 -- 172.21.15.171:0/4082743335 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59041987b0 con 0x7f5904106630 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.029+0000 7f5901ffb640 1 -- 172.21.15.171:0/4082743335 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58f803bc80 con 0x7f5904106630 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.029+0000 7f5901ffb640 1 -- 172.21.15.171:0/4082743335 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f8035030 con 0x7f5904106630 2024-09-19T09:31:00.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.030+0000 7f590ac10640 1 -- 172.21.15.171:0/4082743335 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5904198c10 con 0x7f5904106630 2024-09-19T09:31:00.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.030+0000 7f590ac10640 1 -- 172.21.15.171:0/4082743335 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5904101ca0 con 0x7f5904106630 2024-09-19T09:31:00.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.030+0000 7f5901ffb640 1 -- 172.21.15.171:0/4082743335 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f58f8042070 con 0x7f5904106630 2024-09-19T09:31:00.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.031+0000 7f5901ffb640 1 --2- 172.21.15.171:0/4082743335 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58f40392a0 0x7f58f403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:00.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.031+0000 7f5901ffb640 1 -- 172.21.15.171:0/4082743335 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f58f806cff0 con 0x7f5904106630 2024-09-19T09:31:00.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.031+0000 7f5903fff640 1 --2- 172.21.15.171:0/4082743335 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58f40392a0 0x7f58f403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:00.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.031+0000 7f5903fff640 1 --2- 172.21.15.171:0/4082743335 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58f40392a0 0x7f58f403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f58f00098c0 tx=0x7f58f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:00.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.036+0000 7f5901ffb640 1 -- 172.21.15.171:0/4082743335 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58f8031e20 con 0x7f5904106630 2024-09-19T09:31:00.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.285+0000 7f590ac10640 1 -- 172.21.15.171:0/4082743335 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5904106a90 con 0x7f5904106630 2024-09-19T09:31:00.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.285+0000 7f5901ffb640 1 -- 172.21.15.171:0/4082743335 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f58f8031570 con 0x7f5904106630 2024-09-19T09:31:00.286 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:31:00.286 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":1,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:29:35.871137Z","created":"2024-09-19T09:29:35.871137Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:31:00.286 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 1 2024-09-19T09:31:00.288 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.287+0000 7f590ac10640 1 -- 172.21.15.171:0/4082743335 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58f40392a0 msgr2=0x7f58f403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:00.288 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.287+0000 7f590ac10640 1 --2- 172.21.15.171:0/4082743335 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58f40392a0 0x7f58f403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f58f00098c0 tx=0x7f58f0006db0 comp rx=0 tx=0).stop 2024-09-19T09:31:00.288 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.287+0000 7f590ac10640 1 -- 172.21.15.171:0/4082743335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5904106630 msgr2=0x7f5904197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:00.288 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.287+0000 7f590ac10640 1 --2- 172.21.15.171:0/4082743335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5904106630 0x7f5904197fe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009230 tx=0x7f58f8003d40 comp rx=0 tx=0).stop 2024-09-19T09:31:00.288 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.287+0000 7f590ac10640 1 -- 172.21.15.171:0/4082743335 shutdown_connections 2024-09-19T09:31:00.288 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.287+0000 7f590ac10640 1 --2- 172.21.15.171:0/4082743335 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58f40392a0 0x7f58f403b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:00.288 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.287+0000 7f590ac10640 1 --2- 172.21.15.171:0/4082743335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5904106630 0x7f5904197fe0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:00.288 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.287+0000 7f590ac10640 1 -- 172.21.15.171:0/4082743335 >> 172.21.15.171:0/4082743335 conn(0x7f59040fc220 msgr2=0x7f59040fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:00.288 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.287+0000 7f590ac10640 1 -- 172.21.15.171:0/4082743335 shutdown_connections 2024-09-19T09:31:00.288 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:00.287+0000 7f590ac10640 1 -- 172.21.15.171:0/4082743335 wait complete. 2024-09-19T09:31:00.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:00 smithi042 ceph-mon[31223]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:00.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:00 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/4082743335' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:31:00.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:00 smithi171 systemd[1]: Started Ceph mon.c for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:31:02.106 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:31:02.106 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:31:02.371 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:31:05.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.813+0000 7ff99f5ec640 1 -- 172.21.15.171:0/1446178606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff984003530 msgr2=0x7ff9840059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:05.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.813+0000 7ff99f5ec640 1 --2- 172.21.15.171:0/1446178606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff984003530 0x7ff9840059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff99806aa60 tx=0x7ff99402bce0 comp rx=0 tx=0).stop 2024-09-19T09:31:05.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.813+0000 7ff99f5ec640 1 -- 172.21.15.171:0/1446178606 shutdown_connections 2024-09-19T09:31:05.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.813+0000 7ff99f5ec640 1 --2- 172.21.15.171:0/1446178606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff984003530 0x7ff9840059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:05.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.813+0000 7ff99f5ec640 1 -- 172.21.15.171:0/1446178606 >> 172.21.15.171:0/1446178606 conn(0x7ff9980fc220 msgr2=0x7ff9980fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:05.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.813+0000 7ff99f5ec640 1 -- 172.21.15.171:0/1446178606 shutdown_connections 2024-09-19T09:31:05.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.813+0000 7ff99f5ec640 1 -- 172.21.15.171:0/1446178606 wait complete. 2024-09-19T09:31:05.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99f5ec640 1 Processor -- start 2024-09-19T09:31:05.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99f5ec640 1 -- start start 2024-09-19T09:31:05.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99f5ec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff984003530 0x7ff998199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99f5ec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff998199a90 0x7ff99819de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99f5ec640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff998109780 con 0x7ff998199a90 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99f5ec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff998109600 con 0x7ff984003530 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99d388640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff984003530 0x7ff998199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99d388640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff984003530 0x7ff998199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:51480/0 (socket says 172.21.15.171:51480) 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99d388640 1 -- 172.21.15.171:0/3779930727 learned_addr learned my addr 172.21.15.171:0/3779930727 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99d388640 1 -- 172.21.15.171:0/3779930727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff984003530 msgr2=0x7ff998199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99d388640 1 -- 172.21.15.171:0/3779930727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff984003530 msgr2=0x7ff998199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99d388640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff984003530 0x7ff998199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99d388640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff984003530 0x7ff998199550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.814+0000 7ff99cb87640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff998199a90 0x7ff99819de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:05.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.815+0000 7ff99cb87640 1 -- 172.21.15.171:0/3779930727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff984003530 msgr2=0x7ff998199550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.815+0000 7ff99cb87640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff984003530 0x7ff998199550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.815+0000 7ff99cb87640 1 -- 172.21.15.171:0/3779930727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99819a0b0 con 0x7ff998199a90 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.815+0000 7ff99cb87640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff998199a90 0x7ff99819de20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff98800b3d0 tx=0x7ff98800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.815+0000 7ff98e7fc640 1 -- 172.21.15.171:0/3779930727 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff988011630 con 0x7ff998199a90 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.815+0000 7ff98e7fc640 1 -- 172.21.15.171:0/3779930727 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff988011cb0 con 0x7ff998199a90 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.815+0000 7ff99f5ec640 1 -- 172.21.15.171:0/3779930727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99819e360 con 0x7ff998199a90 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.815+0000 7ff98e7fc640 1 -- 172.21.15.171:0/3779930727 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff988010df0 con 0x7ff998199a90 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.815+0000 7ff99f5ec640 1 -- 172.21.15.171:0/3779930727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99819e8a0 con 0x7ff998199a90 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.816+0000 7ff98e7fc640 1 -- 172.21.15.171:0/3779930727 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ff988018020 con 0x7ff998199a90 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.816+0000 7ff98e7fc640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff97c039040 0x7ff97c03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:05.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.817+0000 7ff98e7fc640 1 -- 172.21.15.171:0/3779930727 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff98804c080 con 0x7ff998199a90 2024-09-19T09:31:05.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.817+0000 7ff99f5ec640 1 -- 172.21.15.171:0/3779930727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99806ad10 con 0x7ff998199a90 2024-09-19T09:31:05.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.817+0000 7ff99d388640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff97c039040 0x7ff97c03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:05.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.817+0000 7ff99d388640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff97c039040 0x7ff97c03b500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff994005940 tx=0x7ff9940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:05.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:05.822+0000 7ff98e7fc640 1 -- 172.21.15.171:0/3779930727 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff98801f020 con 0x7ff998199a90 2024-09-19T09:31:06.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.057+0000 7ff99f5ec640 1 -- 172.21.15.171:0/3779930727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff998106470 con 0x7ff998199a90 2024-09-19T09:31:06.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:06.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:06.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: mon.a calling monitor election 2024-09-19T09:31:06.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:06.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: mon.c calling monitor election 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: monmap epoch 2 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: last_changed 2024-09-19T09:31:00.648554+0000 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: created 2024-09-19T09:29:35.871137+0000 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: min_mon_release 19 (squid) 2024-09-19T09:31:06.060 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: election_strategy: 1 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: fsmap 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: mgrmap e13: x(active, since 39s) 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: overall HEALTH_OK 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:31:06.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:06.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.058+0000 7ff98e7fc640 1 -- 172.21.15.171:0/3779930727 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7ff988018310 con 0x7ff998199a90 2024-09-19T09:31:06.062 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:31:06.062 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":2,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:31:00.648554Z","created":"2024-09-19T09:29:35.871137Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:31:06.063 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 2 2024-09-19T09:31:06.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 -- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff97c039040 msgr2=0x7ff97c03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:06.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff97c039040 0x7ff97c03b500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff994005940 tx=0x7ff9940058d0 comp rx=0 tx=0).stop 2024-09-19T09:31:06.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 -- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff998199a90 msgr2=0x7ff99819de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:06.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff998199a90 0x7ff99819de20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff98800b3d0 tx=0x7ff98800b890 comp rx=0 tx=0).stop 2024-09-19T09:31:06.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 -- 172.21.15.171:0/3779930727 shutdown_connections 2024-09-19T09:31:06.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff97c039040 0x7ff97c03b500 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:06.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff998199a90 0x7ff99819de20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:06.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 --2- 172.21.15.171:0/3779930727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff984003530 0x7ff998199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:06.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 -- 172.21.15.171:0/3779930727 >> 172.21.15.171:0/3779930727 conn(0x7ff9980fc220 msgr2=0x7ff9980fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:06.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 -- 172.21.15.171:0/3779930727 shutdown_connections 2024-09-19T09:31:06.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:06.060+0000 7ff99f5ec640 1 -- 172.21.15.171:0/3779930727 wait complete. 2024-09-19T09:31:06.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:06.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: mon.a calling monitor election 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: mon.c calling monitor election 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:31:06.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: monmap epoch 2 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: last_changed 2024-09-19T09:31:00.648554+0000 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: created 2024-09-19T09:29:35.871137+0000 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: min_mon_release 19 (squid) 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: election_strategy: 1 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: fsmap 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: mgrmap e13: x(active, since 39s) 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: overall HEALTH_OK 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:06.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:06.207 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:06.207 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:31:06.207 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:06.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:06 smithi042 ceph-mon[31223]: Deploying daemon mon.b on smithi136 2024-09-19T09:31:06.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:06 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/3779930727' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:31:06.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:07.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:06 smithi171 ceph-mon[35803]: Deploying daemon mon.b on smithi136 2024-09-19T09:31:07.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:06 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/3779930727' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:31:07.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:07.724 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:31:07.724 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:31:07.976 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:31:08.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:07 smithi171 ceph-mon[35803]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:08.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:07 smithi042 ceph-mon[31223]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:08.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.374+0000 7f95856ab640 1 -- 172.21.15.171:0/3793715746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95801028a0 msgr2=0x7f9580102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:08.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.374+0000 7f95856ab640 1 --2- 172.21.15.171:0/3793715746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95801028a0 0x7f9580102c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9570009c20 tx=0x7f957002ab20 comp rx=0 tx=0).stop 2024-09-19T09:31:08.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.375+0000 7f95856ab640 1 -- 172.21.15.171:0/3793715746 shutdown_connections 2024-09-19T09:31:08.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.375+0000 7f95856ab640 1 --2- 172.21.15.171:0/3793715746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95801028a0 0x7f9580102c80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.375+0000 7f95856ab640 1 -- 172.21.15.171:0/3793715746 >> 172.21.15.171:0/3793715746 conn(0x7f95800fc280 msgr2=0x7f95800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:08.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.375+0000 7f95856ab640 1 -- 172.21.15.171:0/3793715746 shutdown_connections 2024-09-19T09:31:08.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.375+0000 7f95856ab640 1 -- 172.21.15.171:0/3793715746 wait complete. 2024-09-19T09:31:08.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.375+0000 7f95856ab640 1 Processor -- start 2024-09-19T09:31:08.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.375+0000 7f95856ab640 1 -- start start 2024-09-19T09:31:08.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f95856ab640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95801028a0 0x7f95801973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:08.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f95856ab640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95801978f0 0x7f958019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f95856ab640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f958010bda0 con 0x7f95801978f0 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f95856ab640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f958010bc20 con 0x7f95801028a0 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95801978f0 0x7f958019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957effd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95801028a0 0x7f95801973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95801978f0 0x7f958019bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.171:49236/0 (socket says 172.21.15.171:49236) 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957e7fc640 1 -- 172.21.15.171:0/3281050637 learned_addr learned my addr 172.21.15.171:0/3281050637 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957effd640 1 -- 172.21.15.171:0/3281050637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95801028a0 msgr2=0x7f95801973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957effd640 1 -- 172.21.15.171:0/3281050637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95801028a0 msgr2=0x7f95801973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957effd640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95801028a0 0x7f95801973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957effd640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95801028a0 0x7f95801973b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957e7fc640 1 -- 172.21.15.171:0/3281050637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95801028a0 msgr2=0x7f95801973b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957e7fc640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95801028a0 0x7f95801973b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957e7fc640 1 -- 172.21.15.171:0/3281050637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9580197f10 con 0x7f95801978f0 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.376+0000 7f957e7fc640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95801978f0 0x7f958019bc80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f956800b4a0 tx=0x7f956800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.377+0000 7f9577fff640 1 -- 172.21.15.171:0/3281050637 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9568010610 con 0x7f95801978f0 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.377+0000 7f9577fff640 1 -- 172.21.15.171:0/3281050637 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9568010c90 con 0x7f95801978f0 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.377+0000 7f9577fff640 1 -- 172.21.15.171:0/3281050637 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9568017e60 con 0x7f95801978f0 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.377+0000 7f95856ab640 1 -- 172.21.15.171:0/3281050637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958019c1c0 con 0x7f95801978f0 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.377+0000 7f95856ab640 1 -- 172.21.15.171:0/3281050637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958019c6b0 con 0x7f95801978f0 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.378+0000 7f9577fff640 1 -- 172.21.15.171:0/3281050637 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9568017070 con 0x7f95801978f0 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.378+0000 7f95856ab640 1 -- 172.21.15.171:0/3281050637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958006a490 con 0x7f95801978f0 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.378+0000 7f9577fff640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f956c038ff0 0x7f956c03b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.378+0000 7f9577fff640 1 -- 172.21.15.171:0/3281050637 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f956800d040 con 0x7f95801978f0 2024-09-19T09:31:08.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.378+0000 7f957effd640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f956c038ff0 0x7f956c03b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:08.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.379+0000 7f957effd640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f956c038ff0 0x7f956c03b4b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9570009a60 tx=0x7f9570005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:08.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.383+0000 7f9577fff640 1 -- 172.21.15.171:0/3281050637 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f956801e030 con 0x7f95801978f0 2024-09-19T09:31:08.616 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.615+0000 7f95856ab640 1 -- 172.21.15.171:0/3281050637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f958019c9c0 con 0x7f95801978f0 2024-09-19T09:31:08.617 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.615+0000 7f9577fff640 1 -- 172.21.15.171:0/3281050637 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f956801faf0 con 0x7f95801978f0 2024-09-19T09:31:08.617 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:31:08.617 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":2,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:31:00.648554Z","created":"2024-09-19T09:29:35.871137Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:31:08.617 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 2 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.617+0000 7f95856ab640 1 -- 172.21.15.171:0/3281050637 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f956c038ff0 msgr2=0x7f956c03b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.617+0000 7f95856ab640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f956c038ff0 0x7f956c03b4b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9570009a60 tx=0x7f9570005da0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.617+0000 7f95856ab640 1 -- 172.21.15.171:0/3281050637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95801978f0 msgr2=0x7f958019bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.617+0000 7f95856ab640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95801978f0 0x7f958019bc80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f956800b4a0 tx=0x7f956800b960 comp rx=0 tx=0).stop 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.617+0000 7f95856ab640 1 -- 172.21.15.171:0/3281050637 shutdown_connections 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.617+0000 7f95856ab640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f956c038ff0 0x7f956c03b4b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.617+0000 7f95856ab640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95801978f0 0x7f958019bc80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.617+0000 7f95856ab640 1 --2- 172.21.15.171:0/3281050637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95801028a0 0x7f95801973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.617+0000 7f95856ab640 1 -- 172.21.15.171:0/3281050637 >> 172.21.15.171:0/3281050637 conn(0x7f95800fc280 msgr2=0x7f9580105660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.618+0000 7f95856ab640 1 -- 172.21.15.171:0/3281050637 shutdown_connections 2024-09-19T09:31:08.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:08.618+0000 7f95856ab640 1 -- 172.21.15.171:0/3281050637 wait complete. 2024-09-19T09:31:09.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:08 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/3281050637' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:31:09.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:08 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/3281050637' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:31:10.235 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:31:10.235 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:31:10.486 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:31:14.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: mon.c calling monitor election 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: mon.a calling monitor election 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:14.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: monmap epoch 3 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: last_changed 2024-09-19T09:31:09.539146+0000 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: created 2024-09-19T09:29:35.871137+0000 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: min_mon_release 19 (squid) 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: election_strategy: 1 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: fsmap 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:31:14.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: mgrmap e13: x(active, since 48s) 2024-09-19T09:31:14.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: overall HEALTH_OK 2024-09-19T09:31:14.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:14.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:14.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:14.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:15.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:15.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: mon.c calling monitor election 2024-09-19T09:31:15.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: mon.a calling monitor election 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: monmap epoch 3 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:31:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: last_changed 2024-09-19T09:31:09.539146+0000 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: created 2024-09-19T09:29:35.871137+0000 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: min_mon_release 19 (squid) 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: election_strategy: 1 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: fsmap 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: mgrmap e13: x(active, since 48s) 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: overall HEALTH_OK 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:15.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:15.099 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:15.099 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:15.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.333+0000 7fcfe9e05640 1 -- 172.21.15.171:0/823664037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfd0003530 msgr2=0x7fcfd00059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:15.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.334+0000 7fcfe9e05640 1 --2- 172.21.15.171:0/823664037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfd0003530 0x7fcfd00059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfe41016c0 tx=0x7fcfd402c490 comp rx=0 tx=0).stop 2024-09-19T09:31:15.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.334+0000 7fcfe9e05640 1 -- 172.21.15.171:0/823664037 shutdown_connections 2024-09-19T09:31:15.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.334+0000 7fcfe9e05640 1 --2- 172.21.15.171:0/823664037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfd0003530 0x7fcfd00059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:15.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.334+0000 7fcfe9e05640 1 -- 172.21.15.171:0/823664037 >> 172.21.15.171:0/823664037 conn(0x7fcfe40fc280 msgr2=0x7fcfe40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:15.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.334+0000 7fcfe9e05640 1 -- 172.21.15.171:0/823664037 shutdown_connections 2024-09-19T09:31:15.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.334+0000 7fcfe9e05640 1 -- 172.21.15.171:0/823664037 wait complete. 2024-09-19T09:31:15.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.334+0000 7fcfe9e05640 1 Processor -- start 2024-09-19T09:31:15.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.334+0000 7fcfe9e05640 1 -- start start 2024-09-19T09:31:15.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe9e05640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfd0003530 0x7fcfe4195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:15.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe9e05640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfe4196530 0x7fcfe4196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:15.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe9e05640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe419b040 0x7fcfe419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:15.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe9e05640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4108680 con 0x7fcfd0003530 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe9e05640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4108500 con 0x7fcfe4196530 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe9e05640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4108800 con 0x7fcfe419b040 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe419b040 0x7fcfe419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe419b040 0x7fcfe419b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:37150/0 (socket says 172.21.15.171:37150) 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfd0003530 0x7fcfe4195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe3fff640 1 -- 172.21.15.171:0/2748392868 learned_addr learned my addr 172.21.15.171:0/2748392868 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe2ffd640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfe4196530 0x7fcfe4196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe3fff640 1 -- 172.21.15.171:0/2748392868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe419b040 msgr2=0x7fcfe419b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe3fff640 1 -- 172.21.15.171:0/2748392868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe419b040 msgr2=0x7fcfe419b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe3fff640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe419b040 0x7fcfe419b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe3fff640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe419b040 0x7fcfe419b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:31:15.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe2ffd640 1 -- 172.21.15.171:0/2748392868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfe4196530 msgr2=0x7fcfe4196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe2ffd640 1 -- 172.21.15.171:0/2748392868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfe4196530 msgr2=0x7fcfe4196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe2ffd640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfe4196530 0x7fcfe4196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe2ffd640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfe4196530 0x7fcfe4196990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe37fe640 1 -- 172.21.15.171:0/2748392868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe419b040 msgr2=0x7fcfe419b4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe37fe640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe419b040 0x7fcfe419b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe37fe640 1 -- 172.21.15.171:0/2748392868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfe4196530 msgr2=0x7fcfe4196990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe37fe640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfe4196530 0x7fcfe4196990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.335+0000 7fcfe37fe640 1 -- 172.21.15.171:0/2748392868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe419bc00 con 0x7fcfd0003530 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.336+0000 7fcfe37fe640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfd0003530 0x7fcfe4195ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfd402ca80 tx=0x7fcfd4033a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.336+0000 7fcfe0ff9640 1 -- 172.21.15.171:0/2748392868 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4038040 con 0x7fcfd0003530 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.336+0000 7fcfe9e05640 1 -- 172.21.15.171:0/2748392868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe419be90 con 0x7fcfd0003530 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.336+0000 7fcfe0ff9640 1 -- 172.21.15.171:0/2748392868 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfd4005550 con 0x7fcfd0003530 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.336+0000 7fcfe0ff9640 1 -- 172.21.15.171:0/2748392868 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4004e30 con 0x7fcfd0003530 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.336+0000 7fcfe9e05640 1 -- 172.21.15.171:0/2748392868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe419c420 con 0x7fcfd0003530 2024-09-19T09:31:15.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.337+0000 7fcfe0ff9640 1 -- 172.21.15.171:0/2748392868 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fcfd4045400 con 0x7fcfd0003530 2024-09-19T09:31:15.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.337+0000 7fcfe0ff9640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcfc4039730 0x7fcfc403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:15.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.337+0000 7fcfe0ff9640 1 -- 172.21.15.171:0/2748392868 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcfd406e6d0 con 0x7fcfd0003530 2024-09-19T09:31:15.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.337+0000 7fcfe9e05640 1 -- 172.21.15.171:0/2748392868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe41097f0 con 0x7fcfd0003530 2024-09-19T09:31:15.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.338+0000 7fcfe2ffd640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcfc4039730 0x7fcfc403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:15.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.338+0000 7fcfe2ffd640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcfc4039730 0x7fcfc403bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc006fd0 tx=0x7fcfcc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:15.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.343+0000 7fcfe0ff9640 1 -- 172.21.15.171:0/2748392868 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcfd4033a90 con 0x7fcfd0003530 2024-09-19T09:31:15.579 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.577+0000 7fcfe9e05640 1 -- 172.21.15.171:0/2748392868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fcfe41aaee0 con 0x7fcfd0003530 2024-09-19T09:31:15.579 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.578+0000 7fcfe0ff9640 1 -- 172.21.15.171:0/2748392868 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7fcfd4032c60 con 0x7fcfd0003530 2024-09-19T09:31:15.579 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:31:15.579 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":3,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:31:09.539146Z","created":"2024-09-19T09:29:35.871137Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:31:15.580 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 3 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 -- 172.21.15.171:0/2748392868 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcfc4039730 msgr2=0x7fcfc403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcfc4039730 0x7fcfc403bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc006fd0 tx=0x7fcfcc008040 comp rx=0 tx=0).stop 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 -- 172.21.15.171:0/2748392868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfd0003530 msgr2=0x7fcfe4195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfd0003530 0x7fcfe4195ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfd402ca80 tx=0x7fcfd4033a20 comp rx=0 tx=0).stop 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 -- 172.21.15.171:0/2748392868 shutdown_connections 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcfc4039730 0x7fcfc403bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe419b040 0x7fcfe419b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfe4196530 0x7fcfe4196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 --2- 172.21.15.171:0/2748392868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfd0003530 0x7fcfe4195ff0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 -- 172.21.15.171:0/2748392868 >> 172.21.15.171:0/2748392868 conn(0x7fcfe40fc280 msgr2=0x7fcfe40fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 -- 172.21.15.171:0/2748392868 shutdown_connections 2024-09-19T09:31:15.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:15.580+0000 7fcfe9e05640 1 -- 172.21.15.171:0/2748392868 wait complete. 2024-09-19T09:31:15.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:15 smithi171 ceph-mon[35803]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:15.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:15.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:15.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:15 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/2748392868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:31:15.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:15 smithi042 ceph-mon[31223]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:15.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:15.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:15.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:15 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/2748392868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:31:16.395 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T09:31:16.395 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T09:31:16.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:16 smithi136 ceph-mon[34840]: from='client.? 172.21.15.171:0/2748392868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:31:17.609 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:17.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: mon.b calling monitor election 2024-09-19T09:31:17.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:17.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: mon.b calling monitor election 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: mon.c calling monitor election 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: mon.a calling monitor election 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: monmap epoch 3 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: last_changed 2024-09-19T09:31:09.539146+0000 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: created 2024-09-19T09:29:35.871137+0000 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: min_mon_release 19 (squid) 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: election_strategy: 1 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-19T09:31:17.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-09-19T09:31:17.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: fsmap 2024-09-19T09:31:17.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:31:17.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: mgrmap e13: x(active, since 50s) 2024-09-19T09:31:17.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:17 smithi042 ceph-mon[31223]: overall HEALTH_OK 2024-09-19T09:31:17.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: mon.b calling monitor election 2024-09-19T09:31:17.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:17.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: mon.b calling monitor election 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: mon.c calling monitor election 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: mon.a calling monitor election 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: monmap epoch 3 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: last_changed 2024-09-19T09:31:09.539146+0000 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: created 2024-09-19T09:29:35.871137+0000 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: min_mon_release 19 (squid) 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: election_strategy: 1 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-09-19T09:31:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: fsmap 2024-09-19T09:31:17.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:31:17.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: mgrmap e13: x(active, since 50s) 2024-09-19T09:31:17.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:17 smithi171 ceph-mon[35803]: overall HEALTH_OK 2024-09-19T09:31:17.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: mon.b calling monitor election 2024-09-19T09:31:17.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: mon.b calling monitor election 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: mon.c calling monitor election 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: mon.a calling monitor election 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: monmap epoch 3 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: last_changed 2024-09-19T09:31:09.539146+0000 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: created 2024-09-19T09:29:35.871137+0000 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: min_mon_release 19 (squid) 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: election_strategy: 1 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-09-19T09:31:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: fsmap 2024-09-19T09:31:17.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:31:17.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: mgrmap e13: x(active, since 50s) 2024-09-19T09:31:17.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:17 smithi136 ceph-mon[34840]: overall HEALTH_OK 2024-09-19T09:31:18.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.073+0000 7fc075388640 1 -- 172.21.15.42:0/1979252406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc070106f10 msgr2=0x7fc07010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:18.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.073+0000 7fc075388640 1 --2- 172.21.15.42:0/1979252406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc070106f10 0x7fc07010ea90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc068009ca0 tx=0x7fc06802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.073+0000 7fc075388640 1 -- 172.21.15.42:0/1979252406 shutdown_connections 2024-09-19T09:31:18.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.073+0000 7fc075388640 1 --2- 172.21.15.42:0/1979252406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc070106f10 0x7fc07010ea90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.073+0000 7fc075388640 1 --2- 172.21.15.42:0/1979252406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc070102790 0x7fc0701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.073+0000 7fc075388640 1 --2- 172.21.15.42:0/1979252406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070101de0 0x7fc0701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.073+0000 7fc075388640 1 -- 172.21.15.42:0/1979252406 >> 172.21.15.42:0/1979252406 conn(0x7fc0700fd8c0 msgr2=0x7fc0700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:18.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.074+0000 7fc075388640 1 -- 172.21.15.42:0/1979252406 shutdown_connections 2024-09-19T09:31:18.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.074+0000 7fc075388640 1 -- 172.21.15.42:0/1979252406 wait complete. 2024-09-19T09:31:18.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.074+0000 7fc075388640 1 Processor -- start 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.074+0000 7fc075388640 1 -- start start 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.074+0000 7fc075388640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc070101de0 0x7fc07019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.074+0000 7fc075388640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc070102790 0x7fc07019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.074+0000 7fc075388640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070106f10 0x7fc07019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.074+0000 7fc075388640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc070111f70 con 0x7fc070102790 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.074+0000 7fc075388640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc070111df0 con 0x7fc070101de0 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.074+0000 7fc075388640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc0701120f0 con 0x7fc070106f10 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc067fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc070102790 0x7fc07019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc067fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc070102790 0x7fc07019ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56996/0 (socket says 172.21.15.42:56996) 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc067fff640 1 -- 172.21.15.42:0/3209415569 learned_addr learned my addr 172.21.15.42:0/3209415569 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:31:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc06effd640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc070101de0 0x7fc07019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc06f7fe640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070106f10 0x7fc07019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc067fff640 1 -- 172.21.15.42:0/3209415569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070106f10 msgr2=0x7fc07019ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc067fff640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070106f10 0x7fc07019ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc067fff640 1 -- 172.21.15.42:0/3209415569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc070101de0 msgr2=0x7fc07019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc067fff640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc070101de0 0x7fc07019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc067fff640 1 -- 172.21.15.42:0/3209415569 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07019f570 con 0x7fc070102790 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc06f7fe640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070106f10 0x7fc07019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc067fff640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc070102790 0x7fc07019ab00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc05800d950 tx=0x7fc05800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc06cff9640 1 -- 172.21.15.42:0/3209415569 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058017030 con 0x7fc070102790 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc06cff9640 1 -- 172.21.15.42:0/3209415569 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc058004020 con 0x7fc070102790 2024-09-19T09:31:18.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc075388640 1 -- 172.21.15.42:0/3209415569 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07019f860 con 0x7fc070102790 2024-09-19T09:31:18.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc06cff9640 1 -- 172.21.15.42:0/3209415569 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0580047a0 con 0x7fc070102790 2024-09-19T09:31:18.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.075+0000 7fc075388640 1 -- 172.21.15.42:0/3209415569 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0701a7140 con 0x7fc070102790 2024-09-19T09:31:18.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.076+0000 7fc06cff9640 1 -- 172.21.15.42:0/3209415569 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc058004940 con 0x7fc070102790 2024-09-19T09:31:18.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.076+0000 7fc06cff9640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc05c0394d0 0x7fc05c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:18.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.076+0000 7fc075388640 1 -- 172.21.15.42:0/3209415569 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0701021c0 con 0x7fc070102790 2024-09-19T09:31:18.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.076+0000 7fc06cff9640 1 -- 172.21.15.42:0/3209415569 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc05804c0c0 con 0x7fc070102790 2024-09-19T09:31:18.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.076+0000 7fc06effd640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc05c0394d0 0x7fc05c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:18.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.077+0000 7fc06effd640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc05c0394d0 0x7fc05c03b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc0600058c0 tx=0x7fc06000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:18.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.081+0000 7fc06cff9640 1 -- 172.21.15.42:0/3209415569 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc058009a30 con 0x7fc070102790 2024-09-19T09:31:18.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.255+0000 7fc075388640 1 -- 172.21.15.42:0/3209415569 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc07019b920 con 0x7fc070102790 2024-09-19T09:31:18.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.256+0000 7fc06cff9640 1 -- 172.21.15.42:0/3209415569 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7fc07019b920 con 0x7fc070102790 2024-09-19T09:31:18.257 INFO:teuthology.orchestra.run.smithi042.stdout:# minimal ceph.conf for 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:31:18.257 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-19T09:31:18.258 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:31:18.258 INFO:teuthology.orchestra.run.smithi042.stdout: mon_host = [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-19T09:31:18.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 -- 172.21.15.42:0/3209415569 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc05c0394d0 msgr2=0x7fc05c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:18.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc05c0394d0 0x7fc05c03b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc0600058c0 tx=0x7fc06000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 -- 172.21.15.42:0/3209415569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc070102790 msgr2=0x7fc07019ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:18.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc070102790 0x7fc07019ab00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc05800d950 tx=0x7fc05800de10 comp rx=0 tx=0).stop 2024-09-19T09:31:18.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 -- 172.21.15.42:0/3209415569 shutdown_connections 2024-09-19T09:31:18.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc05c0394d0 0x7fc05c03b990 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070106f10 0x7fc07019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc070102790 0x7fc07019ab00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 --2- 172.21.15.42:0/3209415569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc070101de0 0x7fc07019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 -- 172.21.15.42:0/3209415569 >> 172.21.15.42:0/3209415569 conn(0x7fc0700fd8c0 msgr2=0x7fc0700fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:18.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 -- 172.21.15.42:0/3209415569 shutdown_connections 2024-09-19T09:31:18.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:18.258+0000 7fc075388640 1 -- 172.21.15.42:0/3209415569 wait complete. 2024-09-19T09:31:18.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:18.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:18.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:18.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:18 smithi042 ceph-mon[31223]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:31:18.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:31:18.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:31:18.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:18.541 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:18 smithi042 ceph-mon[31223]: Reconfiguring daemon mon.b on smithi136 2024-09-19T09:31:18.542 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:18 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3209415569' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:18.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:18.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:18.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:18.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:18 smithi136 ceph-mon[34840]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:31:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:31:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:31:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:18 smithi136 ceph-mon[34840]: Reconfiguring daemon mon.b on smithi136 2024-09-19T09:31:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:18 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3209415569' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:18.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:18.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:18.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:18.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:18 smithi171 ceph-mon[35803]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:31:18.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:31:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:31:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:18 smithi171 ceph-mon[35803]: Reconfiguring daemon mon.b on smithi136 2024-09-19T09:31:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:18 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3209415569' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:18.864 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:31:18 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:31:18.538+0000 7ffa51b24640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T09:31:18.892 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T09:31:18.892 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:31:18.892 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:31:18.921 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:31:18.921 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:31:18.987 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:31:18.987 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:31:19.016 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:31:19.017 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:31:19.084 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:31:19.084 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:31:19.112 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:31:19.112 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:31:19.177 INFO:tasks.cephadm:Adding mgr.x on smithi042 2024-09-19T09:31:19.177 INFO:tasks.cephadm:Adding mgr.y on smithi136 2024-09-19T09:31:19.177 INFO:tasks.cephadm:Adding mgr.z on smithi171 2024-09-19T09:31:19.178 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi042=x;smithi136=y;smithi171=z' 2024-09-19T09:31:20.202 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:19 smithi171 ceph-mon[35803]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:20.202 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:19 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:20.202 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:19 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:20.202 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:19 smithi171 ceph-mon[35803]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:31:20.202 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:19 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:31:20.202 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:19 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:31:20.202 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:19 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:20.202 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:19 smithi171 ceph-mon[35803]: Reconfiguring daemon mon.c on smithi171 2024-09-19T09:31:20.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:19 smithi042 ceph-mon[31223]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:20.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:19 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:20.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:19 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:20.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:19 smithi042 ceph-mon[31223]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:31:20.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:19 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:31:20.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:19 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:31:20.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:19 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:20.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:19 smithi042 ceph-mon[31223]: Reconfiguring daemon mon.c on smithi171 2024-09-19T09:31:20.274 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:31:20.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:19 smithi136 ceph-mon[34840]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:20.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:19 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:20.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:19 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:20.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:19 smithi136 ceph-mon[34840]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:31:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:19 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:31:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:19 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:31:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:19 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:19 smithi136 ceph-mon[34840]: Reconfiguring daemon mon.c on smithi171 2024-09-19T09:31:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 -- 172.21.15.171:0/3073485099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9201037b0 msgr2=0x7fb92010a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 --2- 172.21.15.171:0/3073485099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9201037b0 0x7fb92010a040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb918009ca0 tx=0x7fb91802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 -- 172.21.15.171:0/3073485099 shutdown_connections 2024-09-19T09:31:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 --2- 172.21.15.171:0/3073485099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9201037b0 0x7fb92010a040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 --2- 172.21.15.171:0/3073485099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb920102df0 0x7fb920103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 --2- 172.21.15.171:0/3073485099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb920101bf0 0x7fb920101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 -- 172.21.15.171:0/3073485099 >> 172.21.15.171:0/3073485099 conn(0x7fb9200fd3c0 msgr2=0x7fb9200ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 -- 172.21.15.171:0/3073485099 shutdown_connections 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 -- 172.21.15.171:0/3073485099 wait complete. 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 Processor -- start 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.659+0000 7fb926ea3640 1 -- start start 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb926ea3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb920101bf0 0x7fb920197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb926ea3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb920102df0 0x7fb920198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb926ea3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9201037b0 0x7fb92019f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb926ea3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb92010d8f0 con 0x7fb920102df0 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb926ea3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb92010d770 con 0x7fb9201037b0 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb926ea3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb92010da70 con 0x7fb920101bf0 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb924c3f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb920101bf0 0x7fb920197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb924c3f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb920101bf0 0x7fb920197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:37158/0 (socket says 172.21.15.171:37158) 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb924c3f640 1 -- 172.21.15.171:0/2630050346 learned_addr learned my addr 172.21.15.171:0/2630050346 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb925440640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9201037b0 0x7fb92019f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb91ffff640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb920102df0 0x7fb920198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb924c3f640 1 -- 172.21.15.171:0/2630050346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9201037b0 msgr2=0x7fb92019f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb924c3f640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9201037b0 0x7fb92019f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb924c3f640 1 -- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb920102df0 msgr2=0x7fb920198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb924c3f640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb920102df0 0x7fb920198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb924c3f640 1 -- 172.21.15.171:0/2630050346 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92019fb20 con 0x7fb920101bf0 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb91ffff640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb920102df0 0x7fb920198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb924c3f640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb920101bf0 0x7fb920197ef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb91400b450 tx=0x7fb91400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb91dffb640 1 -- 172.21.15.171:0/2630050346 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914015020 con 0x7fb920101bf0 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb91dffb640 1 -- 172.21.15.171:0/2630050346 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb914011d70 con 0x7fb920101bf0 2024-09-19T09:31:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb926ea3640 1 -- 172.21.15.171:0/2630050346 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92019fe10 con 0x7fb920101bf0 2024-09-19T09:31:20.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.660+0000 7fb91dffb640 1 -- 172.21.15.171:0/2630050346 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91400f340 con 0x7fb920101bf0 2024-09-19T09:31:20.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.661+0000 7fb926ea3640 1 -- 172.21.15.171:0/2630050346 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9201a02e0 con 0x7fb920101bf0 2024-09-19T09:31:20.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.661+0000 7fb91dffb640 1 -- 172.21.15.171:0/2630050346 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb914018020 con 0x7fb920101bf0 2024-09-19T09:31:20.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.662+0000 7fb91dffb640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb910039500 0x7fb91003b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.662+0000 7fb91dffb640 1 -- 172.21.15.171:0/2630050346 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb91404c140 con 0x7fb920101bf0 2024-09-19T09:31:20.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.662+0000 7fb926ea3640 1 -- 172.21.15.171:0/2630050346 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb920108ff0 con 0x7fb920101bf0 2024-09-19T09:31:20.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.662+0000 7fb91ffff640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb910039500 0x7fb91003b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.662+0000 7fb91ffff640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb910039500 0x7fb91003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb920199410 tx=0x7fb90c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:20.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.667+0000 7fb91dffb640 1 -- 172.21.15.171:0/2630050346 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb91401f020 con 0x7fb920101bf0 2024-09-19T09:31:20.847 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.845+0000 7fb926ea3640 1 -- 172.21.15.171:0/2630050346 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi136=y;smithi171=z", "target": ["mon-mgr", ""]}) -- 0x7fb9200626c0 con 0x7fb910039500 2024-09-19T09:31:20.853 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.852+0000 7fb91dffb640 1 -- 172.21.15.171:0/2630050346 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb9200626c0 con 0x7fb910039500 2024-09-19T09:31:20.853 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mgr update... 2024-09-19T09:31:20.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 -- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb910039500 msgr2=0x7fb91003b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb910039500 0x7fb91003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb920199410 tx=0x7fb90c005e50 comp rx=0 tx=0).stop 2024-09-19T09:31:20.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 -- 172.21.15.171:0/2630050346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb920101bf0 msgr2=0x7fb920197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb920101bf0 0x7fb920197ef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb91400b450 tx=0x7fb91400b910 comp rx=0 tx=0).stop 2024-09-19T09:31:20.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 -- 172.21.15.171:0/2630050346 shutdown_connections 2024-09-19T09:31:20.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb910039500 0x7fb91003b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9201037b0 0x7fb92019f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb920102df0 0x7fb920198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 --2- 172.21.15.171:0/2630050346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb920101bf0 0x7fb920197ef0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 -- 172.21.15.171:0/2630050346 >> 172.21.15.171:0/2630050346 conn(0x7fb9200fd3c0 msgr2=0x7fb9201061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:20.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 -- 172.21.15.171:0/2630050346 shutdown_connections 2024-09-19T09:31:20.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:31:20.854+0000 7fb926ea3640 1 -- 172.21.15.171:0/2630050346 wait complete. 2024-09-19T09:31:21.390 DEBUG:teuthology.orchestra.run.smithi136:mgr.y> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T09:31:21.393 DEBUG:teuthology.orchestra.run.smithi171:mgr.z> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T09:31:21.395 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T09:31:21.395 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:31:21.395 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:31:21.415 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:31:21.416 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-09-19T09:31:21.475 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:31:21.476 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:21.476 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T09:31:21.476 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:21.476 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:21.476 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-19 09:30:37.858728305 +0000 2024-09-19T09:31:21.476 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-19 09:26:34.087736821 +0000 2024-09-19T09:31:21.476 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-19 09:26:34.087736821 +0000 2024-09-19T09:31:21.476 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-19 09:26:34.087736821 +0000 2024-09-19T09:31:21.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:31:21.543 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.543 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.543 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:21.543 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:21.543 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:21.543 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.544 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.544 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:21.544 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:21.544 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:21.544 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.544 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:31:21.544 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:31:21.544 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:31:21.544 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-19T09:31:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-19T09:31:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000122088 s, 4.2 MB/s 2024-09-19T09:31:21.548 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:31:21.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:31:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:21.608 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-09-19T09:31:21.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:31:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:31:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:21.666 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T09:31:21.666 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:21.667 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:21.667 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-19 09:30:37.888728004 +0000 2024-09-19T09:31:21.667 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-19 09:26:34.404733945 +0000 2024-09-19T09:31:21.667 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-19 09:26:34.404733945 +0000 2024-09-19T09:31:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-19 09:26:34.404733945 +0000 2024-09-19T09:31:21.667 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:31:21.734 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-19T09:31:21.734 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-19T09:31:21.734 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000124726 s, 4.1 MB/s 2024-09-19T09:31:21.736 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:31:21.795 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-09-19T09:31:21.852 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:31:21.852 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:21.852 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T09:31:21.853 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:21.853 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:21.853 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-19 09:30:37.920727684 +0000 2024-09-19T09:31:21.853 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-19 09:26:34.742730879 +0000 2024-09-19T09:31:21.853 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-19 09:26:34.742730879 +0000 2024-09-19T09:31:21.853 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-19 09:26:34.742730879 +0000 2024-09-19T09:31:21.853 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:31:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-19T09:31:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-19T09:31:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000121975 s, 4.2 MB/s 2024-09-19T09:31:21.921 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:31:21.979 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-09-19T09:31:22.037 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:31:22.037 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:22.037 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T09:31:22.037 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:22.037 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:22.037 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-19 09:30:37.950727383 +0000 2024-09-19T09:31:22.037 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-19 09:26:35.065727949 +0000 2024-09-19T09:31:22.037 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-19 09:26:35.065727949 +0000 2024-09-19T09:31:22.038 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-19 09:26:35.065727949 +0000 2024-09-19T09:31:22.038 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:31:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-19T09:31:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-19T09:31:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000120983 s, 4.2 MB/s 2024-09-19T09:31:22.104 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:31:22.163 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-19T09:31:22.163 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:31:22.182 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:31:22.182 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-09-19T09:31:22.241 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:31:22.241 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:22.242 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T09:31:22.242 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:22.242 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:22.242 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-19 09:31:08.938450443 +0000 2024-09-19T09:31:22.242 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-19 09:26:45.001934244 +0000 2024-09-19T09:31:22.242 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-19 09:26:45.001934244 +0000 2024-09-19T09:31:22.242 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-19 09:26:45.001934244 +0000 2024-09-19T09:31:22.242 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:31:22.309 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-19T09:31:22.309 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-19T09:31:22.309 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000237271 s, 2.2 MB/s 2024-09-19T09:31:22.310 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:31:22.369 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-09-19T09:31:22.425 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:31:22.426 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:22.426 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T09:31:22.426 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:22.426 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:22.426 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-19 09:31:08.939450420 +0000 2024-09-19T09:31:22.426 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-19 09:26:45.337926219 +0000 2024-09-19T09:31:22.426 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-19 09:26:45.337926219 +0000 2024-09-19T09:31:22.426 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-19 09:26:45.337926219 +0000 2024-09-19T09:31:22.426 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:31:22.492 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-19T09:31:22.492 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-19T09:31:22.492 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.00025293 s, 2.0 MB/s 2024-09-19T09:31:22.493 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:31:22.515 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:22 smithi171 ceph-mon[35803]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:22.515 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:22 smithi171 ceph-mon[35803]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi136=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:22.515 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:22 smithi171 ceph-mon[35803]: Saving service mgr spec with placement smithi042=x;smithi136=y;smithi171=z;count:3 2024-09-19T09:31:22.515 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:22 smithi171 ceph-mon[35803]: Deploying daemon mgr.z on smithi171 2024-09-19T09:31:22.551 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-09-19T09:31:22.608 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:31:22.608 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:22.608 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T09:31:22.608 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:22.608 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:22.608 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-19 09:31:08.939450420 +0000 2024-09-19T09:31:22.608 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-19 09:26:45.671918241 +0000 2024-09-19T09:31:22.608 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-19 09:26:45.671918241 +0000 2024-09-19T09:31:22.608 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-19 09:26:45.671918241 +0000 2024-09-19T09:31:22.609 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:31:22.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:22 smithi136 ceph-mon[34840]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:22.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:22 smithi136 ceph-mon[34840]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi136=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:22.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:22 smithi136 ceph-mon[34840]: Saving service mgr spec with placement smithi042=x;smithi136=y;smithi171=z;count:3 2024-09-19T09:31:22.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:22 smithi136 ceph-mon[34840]: Deploying daemon mgr.z on smithi171 2024-09-19T09:31:22.658 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-19T09:31:22.659 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-19T09:31:22.659 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000214517 s, 2.4 MB/s 2024-09-19T09:31:22.660 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:31:22.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:22 smithi042 ceph-mon[31223]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:22.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:22 smithi042 ceph-mon[31223]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi136=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:22.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:22 smithi042 ceph-mon[31223]: Saving service mgr spec with placement smithi042=x;smithi136=y;smithi171=z;count:3 2024-09-19T09:31:22.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:22 smithi042 ceph-mon[31223]: Deploying daemon mgr.z on smithi171 2024-09-19T09:31:22.718 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-09-19T09:31:22.774 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:31:22.774 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:22.774 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T09:31:22.774 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:22.774 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:22.774 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-19 09:31:08.939450420 +0000 2024-09-19T09:31:22.774 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-19 09:26:45.996910479 +0000 2024-09-19T09:31:22.774 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-19 09:26:45.996910479 +0000 2024-09-19T09:31:22.774 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-19 09:26:45.996910479 +0000 2024-09-19T09:31:22.775 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:31:22.839 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-19T09:31:22.839 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-19T09:31:22.839 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000196234 s, 2.6 MB/s 2024-09-19T09:31:22.840 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:31:22.898 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-19T09:31:22.898 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:31:22.915 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:31:22.915 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-09-19T09:31:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:31:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:22.971 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-19T09:31:22.972 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:22.972 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:22.972 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-19 09:31:22.908545570 +0000 2024-09-19T09:31:22.972 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-19 09:26:42.840947351 +0000 2024-09-19T09:31:22.972 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-19 09:26:42.840947351 +0000 2024-09-19T09:31:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-19 09:26:42.840947351 +0000 2024-09-19T09:31:22.972 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:31:23.041 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-19T09:31:23.041 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-19T09:31:23.041 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000250175 s, 2.0 MB/s 2024-09-19T09:31:23.042 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:31:23.100 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-09-19T09:31:23.242 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:31:23.242 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:23.242 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T09:31:23.242 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:23.242 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:23.242 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-19 09:31:22.909545550 +0000 2024-09-19T09:31:23.242 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-19 09:26:43.156940957 +0000 2024-09-19T09:31:23.242 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-19 09:26:43.156940957 +0000 2024-09-19T09:31:23.242 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-19 09:26:43.156940957 +0000 2024-09-19T09:31:23.243 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:31:23.323 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-19T09:31:23.323 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-19T09:31:23.323 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.0160544 s, 31.9 kB/s 2024-09-19T09:31:23.324 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:31:23.381 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-09-19T09:31:23.436 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:31:23.436 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:23.437 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T09:31:23.437 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:23.437 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:23.437 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-19 09:31:22.909545550 +0000 2024-09-19T09:31:23.437 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-19 09:26:43.490934199 +0000 2024-09-19T09:31:23.437 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-19 09:26:43.490934199 +0000 2024-09-19T09:31:23.437 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-19 09:26:43.490934199 +0000 2024-09-19T09:31:23.437 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:31:23.459 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:23 smithi171 ceph-mgr[37541]: -- 172.21.15.171:0/1659013805 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d24a8a30e0 con 0x55d24a881400 2024-09-19T09:31:23.485 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-19T09:31:23.485 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-19T09:31:23.485 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.00028902 s, 1.8 MB/s 2024-09-19T09:31:23.486 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:31:23.543 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-09-19T09:31:23.599 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:31:23.600 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:31:23.600 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T09:31:23.600 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:31:23.600 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:31:23.600 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-19 09:31:22.910545529 +0000 2024-09-19T09:31:23.600 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-19 09:26:43.842927076 +0000 2024-09-19T09:31:23.600 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-19 09:26:43.842927076 +0000 2024-09-19T09:31:23.600 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-19 09:26:43.842927076 +0000 2024-09-19T09:31:23.600 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:31:23.664 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-19T09:31:23.664 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-19T09:31:23.664 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000176428 s, 2.9 MB/s 2024-09-19T09:31:23.665 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:31:23.721 INFO:tasks.cephadm:Deploying osd.0 on smithi042 with /dev/vg_nvme/lv_4... 2024-09-19T09:31:23.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:31:23.740 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:23 smithi171 bash[37450]: 363a73a2b2e788b81633fcf65a9ebcc9e9503de26b6df09c67bb1b759ec0f1f7 2024-09-19T09:31:23.740 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:23 smithi171 systemd[1]: Started Ceph mgr.z for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:31:23.740 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:23.522+0000 7f9c16dad040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:31:23.741 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:23.582+0000 7f9c16dad040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:31:23.741 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:23.739+0000 7f9c16dad040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:31:23.985 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:24.092 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:23.806+0000 7f9c16dad040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:31:24.092 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:23.952+0000 7f9c16dad040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:31:24.092 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:24.090+0000 7f9c16dad040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:31:24.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-mon[35803]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:24.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:24.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:24.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:24.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:31:24.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:31:24.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:31:24.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:24.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:24 smithi042 ceph-mon[31223]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:24.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:24 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:24.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:24 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:24.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:24 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:24.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:24 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:31:24.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:24 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:31:24.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:24 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:31:24.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:24 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:24.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:24 smithi136 ceph-mon[34840]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:24 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:24 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:24 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:24 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:31:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:24 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:31:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:24 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:31:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:24 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:24.846 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:24.408+0000 7f9c16dad040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:31:24.846 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:24.469+0000 7f9c16dad040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:31:24.846 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:24.653+0000 7f9c16dad040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:31:25.308 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:25 smithi042 ceph-mon[31223]: Deploying daemon mgr.y on smithi136 2024-09-19T09:31:25.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:25 smithi136 ceph-mon[34840]: Deploying daemon mgr.y on smithi136 2024-09-19T09:31:25.385 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:25 smithi136 systemd[1]: Starting Ceph mgr.y for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:31:25.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:25 smithi171 ceph-mon[35803]: Deploying daemon mgr.y on smithi136 2024-09-19T09:31:25.782 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:25 smithi136 podman[36224]: 2024-09-19 09:31:25.503872859 +0000 UTC m=+0.094837076 container create 2e09be71da8f4e73ad26a837eae60416d6811424143e3adf3d81ce7fc4b58308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:31:25.782 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:25 smithi136 podman[36224]: 2024-09-19 09:31:25.424722416 +0000 UTC m=+0.015686638 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:31:25.782 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:25 smithi136 podman[36224]: 2024-09-19 09:31:25.781354775 +0000 UTC m=+0.372318994 container init 2e09be71da8f4e73ad26a837eae60416d6811424143e3adf3d81ce7fc4b58308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:31:25.846 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:25 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:25.540+0000 7f9c16dad040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:31:25.846 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:25 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:25.608+0000 7f9c16dad040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:31:26.127 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:25 smithi136 podman[36224]: 2024-09-19 09:31:25.784477311 +0000 UTC m=+0.375441534 container start 2e09be71da8f4e73ad26a837eae60416d6811424143e3adf3d81ce7fc4b58308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:31:26.127 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:25 smithi136 ceph-mgr[36243]: -- 172.21.15.136:0/2217256327 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7dcd010e0 con 0x55e7dccdf400 2024-09-19T09:31:26.127 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:25 smithi136 bash[36224]: 2e09be71da8f4e73ad26a837eae60416d6811424143e3adf3d81ce7fc4b58308 2024-09-19T09:31:26.128 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:25 smithi136 systemd[1]: Started Ceph mgr.y for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:31:26.128 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:25 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:25.905+0000 7efdfd0c2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:31:26.128 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:25 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:25.965+0000 7efdfd0c2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:31:26.128 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:26.125+0000 7efdfd0c2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:31:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:31:26.314 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi042:vg_nvme/lv_4 2024-09-19T09:31:26.384 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:26.195+0000 7efdfd0c2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:31:26.385 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:26.365+0000 7efdfd0c2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:31:26.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-mon[34840]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:26.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:26.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:26 smithi042 ceph-mon[31223]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:26.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:26.565 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:26.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-mon[35803]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:26.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:26.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:26.597 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:26.363+0000 7f9c16dad040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:31:26.597 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:26.491+0000 7f9c16dad040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:31:26.785 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:26.516+0000 7efdfd0c2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:31:26.931 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:26.639+0000 7f9c16dad040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:31:26.931 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:26.704+0000 7f9c16dad040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:31:26.931 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:26.860+0000 7f9c16dad040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:31:26.931 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:26.929+0000 7f9c16dad040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:31:26.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.971+0000 7f2c51f05640 1 -- 172.21.15.42:0/3215981317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c4c1037c0 msgr2=0x7f2c4c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:26.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.971+0000 7f2c51f05640 1 --2- 172.21.15.42:0/3215981317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c4c1037c0 0x7f2c4c10a050 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009ca0 tx=0x7f2c4402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:31:26.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.971+0000 7f2c51f05640 1 -- 172.21.15.42:0/3215981317 shutdown_connections 2024-09-19T09:31:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.971+0000 7f2c51f05640 1 --2- 172.21.15.42:0/3215981317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c4c1037c0 0x7f2c4c10a050 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.971+0000 7f2c51f05640 1 --2- 172.21.15.42:0/3215981317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c4c102e00 0x7f2c4c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.971+0000 7f2c51f05640 1 --2- 172.21.15.42:0/3215981317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c4c101c00 0x7f2c4c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.971+0000 7f2c51f05640 1 -- 172.21.15.42:0/3215981317 >> 172.21.15.42:0/3215981317 conn(0x7f2c4c0fd390 msgr2=0x7f2c4c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.972+0000 7f2c51f05640 1 -- 172.21.15.42:0/3215981317 shutdown_connections 2024-09-19T09:31:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.972+0000 7f2c51f05640 1 -- 172.21.15.42:0/3215981317 wait complete. 2024-09-19T09:31:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.972+0000 7f2c51f05640 1 Processor -- start 2024-09-19T09:31:26.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.972+0000 7f2c51f05640 1 -- start start 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c51f05640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c4c101c00 0x7f2c4c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c51f05640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c4c102e00 0x7f2c4c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c51f05640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c4c1037c0 0x7f2c4c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c51f05640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c10d880 con 0x7f2c4c101c00 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c51f05640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c10d700 con 0x7f2c4c1037c0 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c51f05640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c10da00 con 0x7f2c4c102e00 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c4c101c00 0x7f2c4c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c4c101c00 0x7f2c4c197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58968/0 (socket says 172.21.15.42:58968) 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4b7fe640 1 -- 172.21.15.42:0/295769540 learned_addr learned my addr 172.21.15.42:0/295769540 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4affd640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c4c102e00 0x7f2c4c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4bfff640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c4c1037c0 0x7f2c4c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4b7fe640 1 -- 172.21.15.42:0/295769540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c4c102e00 msgr2=0x7f2c4c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4b7fe640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c4c102e00 0x7f2c4c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4b7fe640 1 -- 172.21.15.42:0/295769540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c4c1037c0 msgr2=0x7f2c4c19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4b7fe640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c4c1037c0 0x7f2c4c19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4b7fe640 1 -- 172.21.15.42:0/295769540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4c19fad0 con 0x7f2c4c101c00 2024-09-19T09:31:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c4b7fe640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c4c101c00 0x7f2c4c197ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00d950 tx=0x7f2c3c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.973+0000 7f2c48ff9640 1 -- 172.21.15.42:0/295769540 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c017020 con 0x7f2c4c101c00 2024-09-19T09:31:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.974+0000 7f2c51f05640 1 -- 172.21.15.42:0/295769540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4c19fdc0 con 0x7f2c4c101c00 2024-09-19T09:31:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.974+0000 7f2c48ff9640 1 -- 172.21.15.42:0/295769540 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c3c009c30 con 0x7f2c4c101c00 2024-09-19T09:31:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.974+0000 7f2c48ff9640 1 -- 172.21.15.42:0/295769540 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c00f740 con 0x7f2c4c101c00 2024-09-19T09:31:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.974+0000 7f2c51f05640 1 -- 172.21.15.42:0/295769540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4c1a0220 con 0x7f2c4c101c00 2024-09-19T09:31:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.974+0000 7f2c48ff9640 1 -- 172.21.15.42:0/295769540 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2c3c01a020 con 0x7f2c4c101c00 2024-09-19T09:31:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.975+0000 7f2c51f05640 1 -- 172.21.15.42:0/295769540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4c108f80 con 0x7f2c4c101c00 2024-09-19T09:31:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.975+0000 7f2c48ff9640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2c34039500 0x7f2c3403b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.975+0000 7f2c48ff9640 1 -- 172.21.15.42:0/295769540 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2c3c04c010 con 0x7f2c4c101c00 2024-09-19T09:31:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.975+0000 7f2c4affd640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2c34039500 0x7f2c3403b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.975+0000 7f2c4affd640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2c34039500 0x7f2c3403b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c1993c0 tx=0x7f2c4000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:26.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:26.980+0000 7f2c48ff9640 1 -- 172.21.15.42:0/295769540 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c3c021070 con 0x7f2c4c101c00 2024-09-19T09:31:27.089 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:26.839+0000 7efdfd0c2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:31:27.089 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:26.902+0000 7efdfd0c2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:31:27.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:27.166+0000 7f2c51f05640 1 -- 172.21.15.42:0/295769540 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2c4c062630 con 0x7f2c34039500 2024-09-19T09:31:27.230 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:26.991+0000 7f9c16dad040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:31:27.230 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:27.162+0000 7f9c16dad040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:31:27.230 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:27.228+0000 7f9c16dad040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:31:27.378 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:27.087+0000 7efdfd0c2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:31:27.504 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:27.298+0000 7f9c16dad040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:31:27.505 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:27.381+0000 7f9c16dad040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:31:27.505 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:27.442+0000 7f9c16dad040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:31:27.505 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:27.503+0000 7f9c16dad040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:31:27.505 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:27.505 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.505 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.505 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.505 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.505 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.505 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:27.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:27 smithi171 ceph-mon[35803]: Reconfiguring daemon mgr.x on smithi042 2024-09-19T09:31:27.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:27.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:31:27.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:31:27.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:27.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:27 smithi136 ceph-mon[34840]: Reconfiguring daemon mgr.x on smithi042 2024-09-19T09:31:27.717 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:27.717 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:31:27.718 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:31:27.719 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:31:27.719 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:27.719 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:27 smithi042 ceph-mon[31223]: Reconfiguring daemon mgr.x on smithi042 2024-09-19T09:31:28.357 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:28 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:28.031+0000 7efdfd0c2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:31:28.357 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:28 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:28.100+0000 7efdfd0c2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:31:28.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:28.463+0000 7f2c48ff9640 1 -- 172.21.15.42:0/295769540 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f2c3c01c790 con 0x7f2c4c101c00 2024-09-19T09:31:28.596 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:31:28 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z[37516]: 2024-09-19T09:31:28.291+0000 7f9c16dad040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:31:28.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:28 smithi171 ceph-mon[35803]: Standby manager daemon z started 2024-09-19T09:31:28.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:28 smithi171 ceph-mon[35803]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:31:28.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:28 smithi171 ceph-mon[35803]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:31:28.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:28 smithi171 ceph-mon[35803]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:31:28.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:28 smithi171 ceph-mon[35803]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:31:28.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:28 smithi136 ceph-mon[34840]: Standby manager daemon z started 2024-09-19T09:31:28.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:28 smithi136 ceph-mon[34840]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:31:28.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:28 smithi136 ceph-mon[34840]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:31:28.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:28 smithi136 ceph-mon[34840]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:31:28.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:28 smithi136 ceph-mon[34840]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:31:28.799 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:28 smithi042 ceph-mon[31223]: Standby manager daemon z started 2024-09-19T09:31:28.799 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:28 smithi042 ceph-mon[31223]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:31:28.799 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:28 smithi042 ceph-mon[31223]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:31:28.799 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:28 smithi042 ceph-mon[31223]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:31:28.799 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:28 smithi042 ceph-mon[31223]: from='mgr.? 172.21.15.171:0/733096129' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:31:29.082 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:28 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:28.825+0000 7efdfd0c2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:31:29.082 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:28 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:28.939+0000 7efdfd0c2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:31:29.082 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.079+0000 7efdfd0c2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:31:29.356 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.141+0000 7efdfd0c2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:31:29.357 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.287+0000 7efdfd0c2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:31:29.357 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.354+0000 7efdfd0c2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:31:29.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-mon[34840]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:29.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-mon[34840]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T09:31:29.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:31:29.635 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.413+0000 7efdfd0c2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:31:29.635 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.572+0000 7efdfd0c2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:31:29.771 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:29 smithi171 ceph-mon[35803]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:29.772 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:29 smithi171 ceph-mon[35803]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T09:31:29.772 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:31:29.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:29 smithi042 ceph-mon[31223]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:29.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:29 smithi042 ceph-mon[31223]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T09:31:29.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:31:29.907 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.637+0000 7efdfd0c2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:31:29.907 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.706+0000 7efdfd0c2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:31:29.907 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.787+0000 7efdfd0c2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:31:29.907 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.846+0000 7efdfd0c2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:31:29.907 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:29.904+0000 7efdfd0c2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:31:30.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:30 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:30.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:30 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:30.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:30 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:30.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:30 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:30.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:30 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:30.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:30 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:30.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:30 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1329954560' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "706a099a-50d4-4bf6-aeec-397188b1607e"}]: dispatch 2024-09-19T09:31:30.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:30 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1329954560' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "706a099a-50d4-4bf6-aeec-397188b1607e"}]': finished 2024-09-19T09:31:30.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:30 smithi042 ceph-mon[31223]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:31:30.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:30 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:31.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:30 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:31.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:30 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:31.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:30 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:31.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:30 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:31.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:30 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:31.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:30 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:31.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:30 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1329954560' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "706a099a-50d4-4bf6-aeec-397188b1607e"}]: dispatch 2024-09-19T09:31:31.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:30 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1329954560' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "706a099a-50d4-4bf6-aeec-397188b1607e"}]': finished 2024-09-19T09:31:31.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:30 smithi171 ceph-mon[35803]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:31:31.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:30 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:31.134 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y[36239]: 2024-09-19T09:31:30.696+0000 7efdfd0c2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:31:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1329954560' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "706a099a-50d4-4bf6-aeec-397188b1607e"}]: dispatch 2024-09-19T09:31:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1329954560' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "706a099a-50d4-4bf6-aeec-397188b1607e"}]': finished 2024-09-19T09:31:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-mon[34840]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:31:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:30 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:31.660+0000 7f2c48ff9640 1 -- 172.21.15.42:0/295769540 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f2c3c007c80 con 0x7f2c4c101c00 2024-09-19T09:31:31.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:31 smithi042 ceph-mon[31223]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:31.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:31 smithi042 ceph-mon[31223]: Standby manager daemon y started 2024-09-19T09:31:31.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:31 smithi042 ceph-mon[31223]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:31:31.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:31 smithi042 ceph-mon[31223]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:31:31.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:31 smithi042 ceph-mon[31223]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:31:31.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:31 smithi042 ceph-mon[31223]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:31:31.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:31 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1322112887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:31 smithi171 ceph-mon[35803]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:31 smithi171 ceph-mon[35803]: Standby manager daemon y started 2024-09-19T09:31:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:31 smithi171 ceph-mon[35803]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:31:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:31 smithi171 ceph-mon[35803]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:31:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:31 smithi171 ceph-mon[35803]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:31:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:31 smithi171 ceph-mon[35803]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:31:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:31 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1322112887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:31 smithi136 ceph-mon[34840]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:31 smithi136 ceph-mon[34840]: Standby manager daemon y started 2024-09-19T09:31:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:31 smithi136 ceph-mon[34840]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:31:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:31 smithi136 ceph-mon[34840]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:31:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:31 smithi136 ceph-mon[34840]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:31:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:31 smithi136 ceph-mon[34840]: from='mgr.? 172.21.15.136:0/2330009000' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:31:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:31 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1322112887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:32.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:32 smithi042 ceph-mon[31223]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T09:31:32.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:31:33.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:32 smithi171 ceph-mon[35803]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T09:31:33.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:31:33.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:32 smithi136 ceph-mon[34840]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T09:31:33.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:31:33.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:33 smithi042 ceph-mon[31223]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:34.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:33 smithi171 ceph-mon[35803]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:34.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:33 smithi136 ceph-mon[34840]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:35.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:35 smithi042 ceph-mon[31223]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:36.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:35 smithi171 ceph-mon[35803]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:35 smithi136 ceph-mon[34840]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:37.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:37 smithi042 ceph-mon[31223]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:38.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:37 smithi171 ceph-mon[35803]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:37 smithi136 ceph-mon[34840]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:39.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:39 smithi042 ceph-mon[31223]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:39.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:39 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:31:39.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:39 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:39.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:39 smithi042 ceph-mon[31223]: Deploying daemon osd.0 on smithi042 2024-09-19T09:31:40.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:39 smithi171 ceph-mon[35803]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:40.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:39 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:31:40.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:39 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:40.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:39 smithi171 ceph-mon[35803]: Deploying daemon osd.0 on smithi042 2024-09-19T09:31:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:39 smithi136 ceph-mon[34840]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:39 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:31:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:39 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:39 smithi136 ceph-mon[34840]: Deploying daemon osd.0 on smithi042 2024-09-19T09:31:41.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:41 smithi042 ceph-mon[31223]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:42.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:41 smithi171 ceph-mon[35803]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:42.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:41 smithi136 ceph-mon[34840]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:43.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:43 smithi042 ceph-mon[31223]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:44.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:43 smithi171 ceph-mon[35803]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:43 smithi136 ceph-mon[34840]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:45.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:45 smithi042 ceph-mon[31223]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:45.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:45.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:45.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:46.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:45 smithi171 ceph-mon[35803]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:46.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:46.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:46.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:45 smithi136 ceph-mon[34840]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:47.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:47 smithi042 ceph-mon[31223]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:48.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:47 smithi171 ceph-mon[35803]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:47 smithi136 ceph-mon[34840]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:49.383 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:49.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:49.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:49.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:49.384 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:49.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:49.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:49.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:49.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:49.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.698+0000 7f2c48ff9640 1 -- 172.21.15.42:0/295769540 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2c4c062630 con 0x7f2c34039500 2024-09-19T09:31:49.700 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 0 on host 'smithi042' 2024-09-19T09:31:49.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.700+0000 7f2c51f05640 1 -- 172.21.15.42:0/295769540 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2c34039500 msgr2=0x7f2c3403b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.700+0000 7f2c51f05640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2c34039500 0x7f2c3403b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c1993c0 tx=0x7f2c4000b390 comp rx=0 tx=0).stop 2024-09-19T09:31:49.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.700+0000 7f2c51f05640 1 -- 172.21.15.42:0/295769540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c4c101c00 msgr2=0x7f2c4c197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.700+0000 7f2c51f05640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c4c101c00 0x7f2c4c197ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00d950 tx=0x7f2c3c00de10 comp rx=0 tx=0).stop 2024-09-19T09:31:49.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.700+0000 7f2c51f05640 1 -- 172.21.15.42:0/295769540 shutdown_connections 2024-09-19T09:31:49.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.700+0000 7f2c51f05640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2c34039500 0x7f2c3403b9c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.700+0000 7f2c51f05640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c4c1037c0 0x7f2c4c19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.700+0000 7f2c51f05640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c4c102e00 0x7f2c4c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.700+0000 7f2c51f05640 1 --2- 172.21.15.42:0/295769540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c4c101c00 0x7f2c4c197ea0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.700+0000 7f2c51f05640 1 -- 172.21.15.42:0/295769540 >> 172.21.15.42:0/295769540 conn(0x7f2c4c0fd390 msgr2=0x7f2c4c106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:49.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.701+0000 7f2c51f05640 1 -- 172.21.15.42:0/295769540 shutdown_connections 2024-09-19T09:31:49.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:31:49.701+0000 7f2c51f05640 1 -- 172.21.15.42:0/295769540 wait complete. 2024-09-19T09:31:50.355 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:50 smithi042 ceph-mon[31223]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:50.355 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:50 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:50.355 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:50 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:50.355 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:50 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:50.384 DEBUG:teuthology.orchestra.run.smithi042:osd.0> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T09:31:50.387 INFO:tasks.cephadm:Deploying osd.1 on smithi136 with /dev/vg_nvme/lv_4... 2024-09-19T09:31:50.387 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:31:50.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:50 smithi171 ceph-mon[35803]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:50.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:50 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:50.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:50 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:50.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:50 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:50 smithi136 ceph-mon[34840]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:50 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:50 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:50 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:50.640 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:31:51.697 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:31:51 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0[45050]: 2024-09-19T09:31:51.589+0000 7f684c0ff640 -1 osd.0 0 log_to_monitors true 2024-09-19T09:31:52.313 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:52 smithi136 ceph-mon[34840]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:52.313 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:52 smithi136 ceph-mon[34840]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:31:52.447 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:52 smithi042 ceph-mon[31223]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:52.448 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:52 smithi042 ceph-mon[31223]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:31:52.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:52 smithi171 ceph-mon[35803]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:52.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:52 smithi171 ceph-mon[35803]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:31:52.889 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:31:52.914 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_4 2024-09-19T09:31:53.166 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:31:53.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:31:53.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:31:53.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:53.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:31:53.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:31:53.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:31:53.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:53.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:53.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:53.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:53.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:31:53.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:31:53.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:53.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:31:53.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:31:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:53.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 -- 172.21.15.136:0/3810593914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe384102df0 msgr2=0x7fe384103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 --2- 172.21.15.136:0/3810593914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe384102df0 0x7fe384103270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe378009900 tx=0x7fe37802a410 comp rx=0 tx=0).stop 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 -- 172.21.15.136:0/3810593914 shutdown_connections 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 --2- 172.21.15.136:0/3810593914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3841037b0 0x7fe38410a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 --2- 172.21.15.136:0/3810593914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe384102df0 0x7fe384103270 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 --2- 172.21.15.136:0/3810593914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe384101bf0 0x7fe384101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 -- 172.21.15.136:0/3810593914 >> 172.21.15.136:0/3810593914 conn(0x7fe3840fd3c0 msgr2=0x7fe3840ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 -- 172.21.15.136:0/3810593914 shutdown_connections 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 -- 172.21.15.136:0/3810593914 wait complete. 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 Processor -- start 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.596+0000 7fe38a937640 1 -- start start 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe38a937640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe384101bf0 0x7fe384197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe38a937640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe384102df0 0x7fe3841983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe38a937640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3841037b0 0x7fe38419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe38a937640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe38410d850 con 0x7fe384101bf0 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe38a937640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe38410d6d0 con 0x7fe384102df0 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe38a937640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe38410d9d0 con 0x7fe3841037b0 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe3837fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe384102df0 0x7fe3841983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe3837fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe384102df0 0x7fe3841983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50372/0 (socket says 172.21.15.136:50372) 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe3837fe640 1 -- 172.21.15.136:0/113210145 learned_addr learned my addr 172.21.15.136:0/113210145 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe383fff640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe384101bf0 0x7fe384197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe388ed4640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3841037b0 0x7fe38419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe3837fe640 1 -- 172.21.15.136:0/113210145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3841037b0 msgr2=0x7fe38419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe3837fe640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3841037b0 0x7fe38419f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe3837fe640 1 -- 172.21.15.136:0/113210145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe384101bf0 msgr2=0x7fe384197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe3837fe640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe384101bf0 0x7fe384197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe3837fe640 1 -- 172.21.15.136:0/113210145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38419fad0 con 0x7fe384102df0 2024-09-19T09:31:53.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.597+0000 7fe3837fe640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe384102df0 0x7fe3841983e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe378009230 tx=0x7fe378004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:53.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.598+0000 7fe3817fa640 1 -- 172.21.15.136:0/113210145 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37803f030 con 0x7fe384102df0 2024-09-19T09:31:53.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.598+0000 7fe3817fa640 1 -- 172.21.15.136:0/113210145 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe378003ce0 con 0x7fe384102df0 2024-09-19T09:31:53.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.598+0000 7fe3817fa640 1 -- 172.21.15.136:0/113210145 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378035070 con 0x7fe384102df0 2024-09-19T09:31:53.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.598+0000 7fe38a937640 1 -- 172.21.15.136:0/113210145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38419fd60 con 0x7fe384102df0 2024-09-19T09:31:53.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.598+0000 7fe38a937640 1 -- 172.21.15.136:0/113210145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3841a0230 con 0x7fe384102df0 2024-09-19T09:31:53.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.599+0000 7fe38a937640 1 -- 172.21.15.136:0/113210145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe384108fe0 con 0x7fe384102df0 2024-09-19T09:31:53.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.600+0000 7fe3817fa640 1 -- 172.21.15.136:0/113210145 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fe378042030 con 0x7fe384102df0 2024-09-19T09:31:53.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.601+0000 7fe3817fa640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe36c0a3260 0x7fe36c0a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.601+0000 7fe383fff640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe36c0a3260 0x7fe36c0a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.601+0000 7fe3817fa640 1 -- 172.21.15.136:0/113210145 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fe3780edee0 con 0x7fe384102df0 2024-09-19T09:31:53.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.601+0000 7fe383fff640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe36c0a3260 0x7fe36c0a5720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe384102c50 tx=0x7fe37400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:53.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.605+0000 7fe3817fa640 1 -- 172.21.15.136:0/113210145 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3780bc140 con 0x7fe384102df0 2024-09-19T09:31:53.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:31:53.782+0000 7fe38a937640 1 -- 172.21.15.136:0/113210145 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe384062630 con 0x7fe36c0a3260 2024-09-19T09:31:54.204 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0[45050]: 2024-09-19T09:31:53.891+0000 7f6848896640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T09:31:54.204 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:31:53 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0[45050]: 2024-09-19T09:31:53.894+0000 7f683fe91640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:31:54.491 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:54 smithi136 ceph-mon[34840]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:54.491 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:54 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi042 2024-09-19T09:31:54.492 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:54 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi042 to 17092M 2024-09-19T09:31:54.492 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:54.492 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:54.492 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:54.492 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:54.492 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:54 smithi136 ceph-mon[34840]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' 2024-09-19T09:31:54.492 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:54.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:54 smithi171 ceph-mon[35803]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:54.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:54 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi042 2024-09-19T09:31:54.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:54 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi042 to 17092M 2024-09-19T09:31:54.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:54.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:54.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:54.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:54.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:54 smithi171 ceph-mon[35803]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' 2024-09-19T09:31:54.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:54.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:54 smithi042 ceph-mon[31223]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:54.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:54 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi042 2024-09-19T09:31:54.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:54 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi042 to 17092M 2024-09-19T09:31:54.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:54.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:54.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:54.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:54.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:54 smithi042 ceph-mon[31223]: from='osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265]' entity='osd.0' 2024-09-19T09:31:54.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:55.321 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:55 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:31:55.321 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:55 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:31:55.322 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:55 smithi136 ceph-mon[34840]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:55.322 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:55 smithi136 ceph-mon[34840]: osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] boot 2024-09-19T09:31:55.322 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:55 smithi136 ceph-mon[34840]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:31:55.322 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:55.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:55 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:31:55.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:55 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:31:55.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:55 smithi171 ceph-mon[35803]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:55.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:55 smithi171 ceph-mon[35803]: osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] boot 2024-09-19T09:31:55.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:55 smithi171 ceph-mon[35803]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:31:55.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:55.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:55 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:31:55.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:55 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:31:55.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:55 smithi042 ceph-mon[31223]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:55.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:55 smithi042 ceph-mon[31223]: osd.0 [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] boot 2024-09-19T09:31:55.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:55 smithi042 ceph-mon[31223]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:31:55.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:31:56.564 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:56 smithi136 ceph-mon[34840]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:56.564 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:56 smithi136 ceph-mon[34840]: from='client.? 172.21.15.136:0/3962278606' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "675db66c-0434-4791-bb50-8c598eefd010"}]: dispatch 2024-09-19T09:31:56.564 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:56 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "675db66c-0434-4791-bb50-8c598eefd010"}]: dispatch 2024-09-19T09:31:56.565 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:56 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "675db66c-0434-4791-bb50-8c598eefd010"}]': finished 2024-09-19T09:31:56.565 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:56 smithi136 ceph-mon[34840]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T09:31:56.565 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:56 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:56.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:56 smithi171 ceph-mon[35803]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:56.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:56 smithi171 ceph-mon[35803]: from='client.? 172.21.15.136:0/3962278606' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "675db66c-0434-4791-bb50-8c598eefd010"}]: dispatch 2024-09-19T09:31:56.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:56 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "675db66c-0434-4791-bb50-8c598eefd010"}]: dispatch 2024-09-19T09:31:56.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:56 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "675db66c-0434-4791-bb50-8c598eefd010"}]': finished 2024-09-19T09:31:56.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:56 smithi171 ceph-mon[35803]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T09:31:56.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:56 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:56 smithi042 ceph-mon[31223]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:31:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:56 smithi042 ceph-mon[31223]: from='client.? 172.21.15.136:0/3962278606' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "675db66c-0434-4791-bb50-8c598eefd010"}]: dispatch 2024-09-19T09:31:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:56 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "675db66c-0434-4791-bb50-8c598eefd010"}]: dispatch 2024-09-19T09:31:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:56 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "675db66c-0434-4791-bb50-8c598eefd010"}]': finished 2024-09-19T09:31:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:56 smithi042 ceph-mon[31223]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T09:31:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:56 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:57.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:57 smithi171 ceph-mon[35803]: from='client.? 172.21.15.136:0/2223039904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:57.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:57 smithi136 ceph-mon[34840]: from='client.? 172.21.15.136:0/2223039904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:57.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:57 smithi042 ceph-mon[31223]: from='client.? 172.21.15.136:0/2223039904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:58.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:31:58 smithi171 ceph-mon[35803]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:58.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:31:58 smithi136 ceph-mon[34840]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:58.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:31:58 smithi042 ceph-mon[31223]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:00.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:00 smithi171 ceph-mon[35803]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:00.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:00 smithi136 ceph-mon[34840]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:00.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:00 smithi042 ceph-mon[31223]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:02.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:02 smithi136 ceph-mon[34840]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:02.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:02 smithi171 ceph-mon[35803]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:02.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:02 smithi042 ceph-mon[31223]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:04.493 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:04 smithi136 ceph-mon[34840]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:04.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:04 smithi171 ceph-mon[35803]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:04.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:04 smithi042 ceph-mon[31223]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:05.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:32:05.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:05.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:05 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:32:05.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:05 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:05.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:32:05.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:06.409 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:06 smithi136 ceph-mon[34840]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:06.409 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:06 smithi136 ceph-mon[34840]: Deploying daemon osd.1 on smithi136 2024-09-19T09:32:06.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:06 smithi171 ceph-mon[35803]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:06 smithi171 ceph-mon[35803]: Deploying daemon osd.1 on smithi136 2024-09-19T09:32:06.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:06 smithi042 ceph-mon[31223]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:06.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:06 smithi042 ceph-mon[31223]: Deploying daemon osd.1 on smithi136 2024-09-19T09:32:08.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:08 smithi171 ceph-mon[35803]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:08.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:08 smithi136 ceph-mon[34840]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:08.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:08 smithi042 ceph-mon[31223]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:10.501 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:10 smithi136 ceph-mon[34840]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:10.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:10 smithi171 ceph-mon[35803]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:10.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:10 smithi042 ceph-mon[31223]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:11.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:11 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:11.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:11 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:11.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:11 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:11.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:11 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:11.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:11 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:11.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:11 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:11.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:11 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:11.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:11 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:11.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:11 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:12.371 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:12 smithi136 ceph-mon[34840]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:12.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:12 smithi171 ceph-mon[35803]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:12.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:12 smithi042 ceph-mon[31223]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:14.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:14 smithi136 ceph-mon[34840]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:14 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:14 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:14 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:14 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:14 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:14.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:14 smithi171 ceph-mon[35803]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:14.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:14.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:14.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:14.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:14.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:14.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.699+0000 7fe3817fa640 1 -- 172.21.15.136:0/113210145 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe384062630 con 0x7fe36c0a3260 2024-09-19T09:32:14.701 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 1 on host 'smithi136' 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 -- 172.21.15.136:0/113210145 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe36c0a3260 msgr2=0x7fe36c0a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe36c0a3260 0x7fe36c0a5720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe384102c50 tx=0x7fe37400b390 comp rx=0 tx=0).stop 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 -- 172.21.15.136:0/113210145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe384102df0 msgr2=0x7fe3841983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe384102df0 0x7fe3841983e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe378009230 tx=0x7fe378004360 comp rx=0 tx=0).stop 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 -- 172.21.15.136:0/113210145 shutdown_connections 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe36c0a3260 0x7fe36c0a5720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3841037b0 0x7fe38419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe384102df0 0x7fe3841983e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 --2- 172.21.15.136:0/113210145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe384101bf0 0x7fe384197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 -- 172.21.15.136:0/113210145 >> 172.21.15.136:0/113210145 conn(0x7fe3840fd3c0 msgr2=0x7fe3841061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 -- 172.21.15.136:0/113210145 shutdown_connections 2024-09-19T09:32:14.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:32:14.701+0000 7fe38a937640 1 -- 172.21.15.136:0/113210145 wait complete. 2024-09-19T09:32:14.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:14 smithi042 ceph-mon[31223]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:14.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:14.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:14.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:14.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:14.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:15.323 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:15 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:15.323 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:15 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:15.323 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:15 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:15.350 DEBUG:teuthology.orchestra.run.smithi136:osd.1> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T09:32:15.353 INFO:tasks.cephadm:Deploying osd.2 on smithi171 with /dev/vg_nvme/lv_4... 2024-09-19T09:32:15.353 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:32:15.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:15.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:15.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:15.606 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:32:15.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:15.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:15.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:16.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:16 smithi171 ceph-mon[35803]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:16.536 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:16 smithi136 ceph-mon[34840]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:16.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:16 smithi042 ceph-mon[31223]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:17.135 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:16 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1[39366]: 2024-09-19T09:32:16.811+0000 7fe322fd1640 -1 osd.1 0 log_to_monitors true 2024-09-19T09:32:17.485 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:17 smithi171 ceph-mon[35803]: from='osd.1 [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:32:17.485 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:17 smithi171 ceph-mon[35803]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:32:17.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:17 smithi136 ceph-mon[34840]: from='osd.1 [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:32:17.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:17 smithi136 ceph-mon[34840]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:32:17.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:17 smithi042 ceph-mon[31223]: from='osd.1 [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:32:17.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:17 smithi042 ceph-mon[31223]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:32:17.999 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:32:18.026 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_4 2024-09-19T09:32:18.282 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:32:18.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:18.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:32:18.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:32:18.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='osd.1 [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:32:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:32:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:18.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='osd.1 [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:18.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:32:18.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:32:18.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:18.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='osd.1 [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:32:18.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:32:18.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:18.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:18.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:18.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:18.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.741+0000 7fdcd371c640 1 -- 172.21.15.171:0/3782259176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdccc104f90 msgr2=0x7fdccc107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:18.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.741+0000 7fdcd371c640 1 --2- 172.21.15.171:0/3782259176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdccc104f90 0x7fdccc107380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009900 tx=0x7fdcc002a410 comp rx=0 tx=0).stop 2024-09-19T09:32:18.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.741+0000 7fdcd371c640 1 -- 172.21.15.171:0/3782259176 shutdown_connections 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.741+0000 7fdcd371c640 1 --2- 172.21.15.171:0/3782259176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdccc1078c0 0x7fdccc109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.741+0000 7fdcd371c640 1 --2- 172.21.15.171:0/3782259176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdccc104f90 0x7fdccc107380 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.741+0000 7fdcd371c640 1 --2- 172.21.15.171:0/3782259176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc102660 0x7fdccc104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.741+0000 7fdcd371c640 1 -- 172.21.15.171:0/3782259176 >> 172.21.15.171:0/3782259176 conn(0x7fdccc0fc280 msgr2=0x7fdccc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.741+0000 7fdcd371c640 1 -- 172.21.15.171:0/3782259176 shutdown_connections 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.741+0000 7fdcd371c640 1 -- 172.21.15.171:0/3782259176 wait complete. 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.741+0000 7fdcd371c640 1 Processor -- start 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd371c640 1 -- start start 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd371c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc102660 0x7fdccc197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd371c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdccc104f90 0x7fdccc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd371c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdccc1078c0 0x7fdccc19f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:18.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd371c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc10d8d0 con 0x7fdccc1078c0 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd371c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc10d750 con 0x7fdccc102660 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd371c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc10da50 con 0x7fdccc104f90 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd0cb7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdccc104f90 0x7fdccc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd14b8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc102660 0x7fdccc197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd0cb7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdccc104f90 0x7fdccc198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:60990/0 (socket says 172.21.15.171:60990) 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd0cb7640 1 -- 172.21.15.171:0/1563639484 learned_addr learned my addr 172.21.15.171:0/1563639484 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd1cb9640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdccc1078c0 0x7fdccc19f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd0cb7640 1 -- 172.21.15.171:0/1563639484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc102660 msgr2=0x7fdccc197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd0cb7640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc102660 0x7fdccc197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd0cb7640 1 -- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdccc1078c0 msgr2=0x7fdccc19f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd0cb7640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdccc1078c0 0x7fdccc19f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:18.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd0cb7640 1 -- 172.21.15.171:0/1563639484 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc19fbf0 con 0x7fdccc104f90 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd14b8640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc102660 0x7fdccc197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd1cb9640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdccc1078c0 0x7fdccc19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.742+0000 7fdcd0cb7640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdccc104f90 0x7fdccc198500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0031610 tx=0x7fdcc0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.743+0000 7fdcca7fc640 1 -- 172.21.15.171:0/1563639484 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc003f030 con 0x7fdccc104f90 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.743+0000 7fdcca7fc640 1 -- 172.21.15.171:0/1563639484 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcc0003ad0 con 0x7fdccc104f90 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.743+0000 7fdcd371c640 1 -- 172.21.15.171:0/1563639484 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc19fe80 con 0x7fdccc104f90 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.743+0000 7fdcca7fc640 1 -- 172.21.15.171:0/1563639484 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0035070 con 0x7fdccc104f90 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.743+0000 7fdcd371c640 1 -- 172.21.15.171:0/1563639484 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc1a0350 con 0x7fdccc104f90 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.744+0000 7fdcd371c640 1 -- 172.21.15.171:0/1563639484 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdccc0fdd70 con 0x7fdccc104f90 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.745+0000 7fdcca7fc640 1 -- 172.21.15.171:0/1563639484 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fdcc0042030 con 0x7fdccc104f90 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.745+0000 7fdcca7fc640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdcb40a31e0 0x7fdcb40a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.746+0000 7fdcca7fc640 1 -- 172.21.15.171:0/1563639484 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7fdcc00ee850 con 0x7fdccc104f90 2024-09-19T09:32:18.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.746+0000 7fdcd14b8640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdcb40a31e0 0x7fdcb40a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:18.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.746+0000 7fdcd14b8640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdcb40a31e0 0x7fdcb40a56a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc005fd0 tx=0x7fdcbc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:18.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.749+0000 7fdcca7fc640 1 -- 172.21.15.171:0/1563639484 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdcc00bcee0 con 0x7fdccc104f90 2024-09-19T09:32:18.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:18.924+0000 7fdcd371c640 1 -- 172.21.15.171:0/1563639484 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdccc062630 con 0x7fdcb40a31e0 2024-09-19T09:32:19.134 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1[39366]: 2024-09-19T09:32:18.866+0000 7fe31e731640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T09:32:19.134 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1[39366]: 2024-09-19T09:32:18.873+0000 7fe316d63640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:32:19.511 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:19 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi136 2024-09-19T09:32:19.511 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:19 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi136 to 17088M 2024-09-19T09:32:19.511 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:19 smithi171 ceph-mon[35803]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:32:19.512 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:19 smithi171 ceph-mon[35803]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:32:19.512 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:19 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:19.512 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:19 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:19.512 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:19 smithi171 ceph-mon[35803]: from='osd.1 ' entity='osd.1' 2024-09-19T09:32:19.512 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:19 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:19.512 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:19 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:19.512 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:19 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:19.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:19 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi136 2024-09-19T09:32:19.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:19 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi136 to 17088M 2024-09-19T09:32:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:19 smithi136 ceph-mon[34840]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:32:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:19 smithi136 ceph-mon[34840]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:32:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:19 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:19 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:19 smithi136 ceph-mon[34840]: from='osd.1 ' entity='osd.1' 2024-09-19T09:32:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:19 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:19 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:19 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:19.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:19 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi136 2024-09-19T09:32:19.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:19 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi136 to 17088M 2024-09-19T09:32:19.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:19 smithi042 ceph-mon[31223]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:32:19.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:19 smithi042 ceph-mon[31223]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:32:19.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:19 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:19.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:19 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:19.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:19 smithi042 ceph-mon[31223]: from='osd.1 ' entity='osd.1' 2024-09-19T09:32:19.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:19 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:19.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:19 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:19.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:19 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:20.518 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:20 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:32:20.518 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:20 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:32:20.518 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:20 smithi171 ceph-mon[35803]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:20.518 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:20 smithi171 ceph-mon[35803]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:20.518 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:20.518 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:20 smithi171 ceph-mon[35803]: osd.1 [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] boot 2024-09-19T09:32:20.518 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:20 smithi171 ceph-mon[35803]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T09:32:20.518 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:20.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:20 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:32:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:20 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:32:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:20 smithi136 ceph-mon[34840]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:20 smithi136 ceph-mon[34840]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:20 smithi136 ceph-mon[34840]: osd.1 [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] boot 2024-09-19T09:32:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:20 smithi136 ceph-mon[34840]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T09:32:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:20.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:20 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:32:20.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:20 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:32:20.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:20 smithi042 ceph-mon[31223]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:32:20.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:20 smithi042 ceph-mon[31223]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:20.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:20.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:20 smithi042 ceph-mon[31223]: osd.1 [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] boot 2024-09-19T09:32:20.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:20 smithi042 ceph-mon[31223]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T09:32:20.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:32:21.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:21 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/3591851338' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ca55d67-6869-44ad-b68f-fee2caa72f44"}]: dispatch 2024-09-19T09:32:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:21 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ca55d67-6869-44ad-b68f-fee2caa72f44"}]: dispatch 2024-09-19T09:32:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:21 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ca55d67-6869-44ad-b68f-fee2caa72f44"}]': finished 2024-09-19T09:32:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:21 smithi171 ceph-mon[35803]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T09:32:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:21.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:21 smithi136 ceph-mon[34840]: from='client.? 172.21.15.171:0/3591851338' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ca55d67-6869-44ad-b68f-fee2caa72f44"}]: dispatch 2024-09-19T09:32:21.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:21 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ca55d67-6869-44ad-b68f-fee2caa72f44"}]: dispatch 2024-09-19T09:32:21.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:21 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ca55d67-6869-44ad-b68f-fee2caa72f44"}]': finished 2024-09-19T09:32:21.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:21 smithi136 ceph-mon[34840]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T09:32:21.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:21.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:21 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/3591851338' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ca55d67-6869-44ad-b68f-fee2caa72f44"}]: dispatch 2024-09-19T09:32:21.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:21 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ca55d67-6869-44ad-b68f-fee2caa72f44"}]: dispatch 2024-09-19T09:32:21.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:21 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ca55d67-6869-44ad-b68f-fee2caa72f44"}]': finished 2024-09-19T09:32:21.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:21 smithi042 ceph-mon[31223]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T09:32:21.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:22.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:22 smithi171 ceph-mon[35803]: pgmap v59: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:22.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:22 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/1769857735' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:22.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:22 smithi136 ceph-mon[34840]: pgmap v59: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:22.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:22 smithi136 ceph-mon[34840]: from='client.? 172.21.15.171:0/1769857735' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:22.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:22 smithi042 ceph-mon[31223]: pgmap v59: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:22.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:22 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/1769857735' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:24.525 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:24 smithi042 ceph-mon[31223]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:24.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:24 smithi171 ceph-mon[35803]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:24.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:24 smithi136 ceph-mon[34840]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:26.505 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:26 smithi171 ceph-mon[35803]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:26.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:26 smithi136 ceph-mon[34840]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:26.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:26 smithi042 ceph-mon[31223]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:28.457 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:28 smithi171 ceph-mon[35803]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:28.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:28 smithi136 ceph-mon[34840]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:28.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:28 smithi042 ceph-mon[31223]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:30.459 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:30 smithi171 ceph-mon[35803]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:30.459 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:30 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:32:30.459 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:30 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:30.459 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:30 smithi171 ceph-mon[35803]: Deploying daemon osd.2 on smithi171 2024-09-19T09:32:30.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:30 smithi136 ceph-mon[34840]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:30.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:30 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:32:30.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:30 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:30.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:30 smithi136 ceph-mon[34840]: Deploying daemon osd.2 on smithi171 2024-09-19T09:32:30.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:30 smithi042 ceph-mon[31223]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:30.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:30 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:32:30.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:30 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:30.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:30 smithi042 ceph-mon[31223]: Deploying daemon osd.2 on smithi171 2024-09-19T09:32:32.518 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:32 smithi171 ceph-mon[35803]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:32.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:32 smithi136 ceph-mon[34840]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:32.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:32 smithi042 ceph-mon[31223]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:34.538 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:34 smithi171 ceph-mon[35803]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:34.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:34 smithi136 ceph-mon[34840]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:34.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:34 smithi042 ceph-mon[31223]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:36.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:36 smithi171 ceph-mon[35803]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:36.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:36 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:36.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:36 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:36.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:36 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:36.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:36 smithi136 ceph-mon[34840]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:36.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:36 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:36.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:36 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:36.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:36 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:36.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:36 smithi042 ceph-mon[31223]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:36.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:36 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:36.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:36 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:36.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:36 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:38.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:38 smithi171 ceph-mon[35803]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:38.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:38.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:38.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:38.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:38.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:38 smithi136 ceph-mon[34840]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:38.680 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.679+0000 7fdcca7fc640 1 -- 172.21.15.171:0/1563639484 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdccc062630 con 0x7fdcb40a31e0 2024-09-19T09:32:38.681 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 2 on host 'smithi171' 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 -- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdcb40a31e0 msgr2=0x7fdcb40a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdcb40a31e0 0x7fdcb40a56a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc005fd0 tx=0x7fdcbc009500 comp rx=0 tx=0).stop 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 -- 172.21.15.171:0/1563639484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdccc104f90 msgr2=0x7fdccc198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdccc104f90 0x7fdccc198500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0031610 tx=0x7fdcc0004270 comp rx=0 tx=0).stop 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 -- 172.21.15.171:0/1563639484 shutdown_connections 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdcb40a31e0 0x7fdcb40a56a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdccc1078c0 0x7fdccc19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdccc104f90 0x7fdccc198500 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 --2- 172.21.15.171:0/1563639484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc102660 0x7fdccc197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 -- 172.21.15.171:0/1563639484 >> 172.21.15.171:0/1563639484 conn(0x7fdccc0fc280 msgr2=0x7fdccc102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:38.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 -- 172.21.15.171:0/1563639484 shutdown_connections 2024-09-19T09:32:38.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:32:38.681+0000 7fdcd371c640 1 -- 172.21.15.171:0/1563639484 wait complete. 2024-09-19T09:32:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:38 smithi042 ceph-mon[31223]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:39.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:39 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:39.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:39 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:39.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:39 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:39.374 DEBUG:teuthology.orchestra.run.smithi171:osd.2> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T09:32:39.376 INFO:tasks.cephadm:Deploying osd.3 on smithi042 with /dev/vg_nvme/lv_3... 2024-09-19T09:32:39.377 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:32:39.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:39 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:39.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:39 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:39.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:39 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:39.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:39 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:39.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:39 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:39.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:39 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:40.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:40 smithi042 ceph-mon[31223]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:40.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:40 smithi171 ceph-mon[35803]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:40.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:40 smithi136 ceph-mon[34840]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:41.781 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:41 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2[40840]: 2024-09-19T09:32:41.625+0000 7fa59d36a640 -1 osd.2 0 log_to_monitors true 2024-09-19T09:32:42.168 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:32:42.196 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi042:vg_nvme/lv_3 2024-09-19T09:32:42.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:42 smithi042 ceph-mon[31223]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:42.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:42 smithi042 ceph-mon[31223]: from='osd.2 [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:32:42.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:42 smithi042 ceph-mon[31223]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:32:42.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:42 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:42 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:42 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:42.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:42 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:42 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:42.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:42 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:42.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:42 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.457 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:42.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:42 smithi171 ceph-mon[35803]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:42 smithi171 ceph-mon[35803]: from='osd.2 [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:32:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:42 smithi171 ceph-mon[35803]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:32:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:42 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:42 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:42 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:42 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:42 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:42 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:42 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:42 smithi136 ceph-mon[34840]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:42.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:42 smithi136 ceph-mon[34840]: from='osd.2 [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:32:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:42 smithi136 ceph-mon[34840]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:32:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:42 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:42 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:42 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:42 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:42 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:42 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:42 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:43.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.037+0000 7f409e259640 1 -- 172.21.15.42:0/3882085082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4098102690 msgr2=0x7f4098108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.037+0000 7f409e259640 1 --2- 172.21.15.42:0/3882085082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4098102690 0x7f4098108f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4090009900 tx=0x7f409002a410 comp rx=0 tx=0).stop 2024-09-19T09:32:43.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.037+0000 7f409e259640 1 -- 172.21.15.42:0/3882085082 shutdown_connections 2024-09-19T09:32:43.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.037+0000 7f409e259640 1 --2- 172.21.15.42:0/3882085082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4098102690 0x7f4098108f20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.037+0000 7f409e259640 1 --2- 172.21.15.42:0/3882085082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4098101cd0 0x7f4098102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.037+0000 7f409e259640 1 --2- 172.21.15.42:0/3882085082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4098100ad0 0x7f4098100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.037+0000 7f409e259640 1 -- 172.21.15.42:0/3882085082 >> 172.21.15.42:0/3882085082 conn(0x7f40980fc280 msgr2=0x7f40980fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:43.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.037+0000 7f409e259640 1 -- 172.21.15.42:0/3882085082 shutdown_connections 2024-09-19T09:32:43.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.038+0000 7f409e259640 1 -- 172.21.15.42:0/3882085082 wait complete. 2024-09-19T09:32:43.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.038+0000 7f409e259640 1 Processor -- start 2024-09-19T09:32:43.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.038+0000 7f409e259640 1 -- start start 2024-09-19T09:32:43.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f409e259640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4098100ad0 0x7f409819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f409e259640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4098101cd0 0x7f409819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f409e259640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4098102690 0x7f40981a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f409e259640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f409810c750 con 0x7f4098101cd0 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f409e259640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f409810c5d0 con 0x7f4098102690 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f409e259640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f409810c8d0 con 0x7f4098100ad0 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f4096ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4098101cd0 0x7f409819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f4096ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4098101cd0 0x7f409819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47008/0 (socket says 172.21.15.42:47008) 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f4096ffd640 1 -- 172.21.15.42:0/275520890 learned_addr learned my addr 172.21.15.42:0/275520890 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f40977fe640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4098100ad0 0x7f409819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f4097fff640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4098102690 0x7f40981a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f4096ffd640 1 -- 172.21.15.42:0/275520890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4098100ad0 msgr2=0x7f409819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f4096ffd640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4098100ad0 0x7f409819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f4096ffd640 1 -- 172.21.15.42:0/275520890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4098102690 msgr2=0x7f40981a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f4096ffd640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4098102690 0x7f40981a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f4096ffd640 1 -- 172.21.15.42:0/275520890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40981a1cd0 con 0x7f4098101cd0 2024-09-19T09:32:43.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.039+0000 7f4096ffd640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4098101cd0 0x7f409819a5e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f408c00d770 tx=0x7f408c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:43.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.040+0000 7f4094ff9640 1 -- 172.21.15.42:0/275520890 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c017070 con 0x7f4098101cd0 2024-09-19T09:32:43.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.040+0000 7f4094ff9640 1 -- 172.21.15.42:0/275520890 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f408c005500 con 0x7f4098101cd0 2024-09-19T09:32:43.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.040+0000 7f409e259640 1 -- 172.21.15.42:0/275520890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40981a1fc0 con 0x7f4098101cd0 2024-09-19T09:32:43.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.040+0000 7f4094ff9640 1 -- 172.21.15.42:0/275520890 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c004e00 con 0x7f4098101cd0 2024-09-19T09:32:43.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.040+0000 7f409e259640 1 -- 172.21.15.42:0/275520890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40981a2420 con 0x7f4098101cd0 2024-09-19T09:32:43.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.041+0000 7f409e259640 1 -- 172.21.15.42:0/275520890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40981a2650 con 0x7f4098101cd0 2024-09-19T09:32:43.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.042+0000 7f4094ff9640 1 -- 172.21.15.42:0/275520890 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f408c004fa0 con 0x7f4098101cd0 2024-09-19T09:32:43.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.043+0000 7f4094ff9640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40800a31e0 0x7f40800a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.043+0000 7f40977fe640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40800a31e0 0x7f40800a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.043+0000 7f4094ff9640 1 -- 172.21.15.42:0/275520890 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2445+0+0 (secure 0 0 0) 0x7f408c0cdad0 con 0x7f4098101cd0 2024-09-19T09:32:43.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.043+0000 7f40977fe640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40800a31e0 0x7f40800a56a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4098101b30 tx=0x7f4088009670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:43.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.047+0000 7f4094ff9640 1 -- 172.21.15.42:0/275520890 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f408c09bfc0 con 0x7f4098101cd0 2024-09-19T09:32:43.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:43.235+0000 7f409e259640 1 -- 172.21.15.42:0/275520890 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f40980fe490 con 0x7f40800a31e0 2024-09-19T09:32:43.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:43 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi171 2024-09-19T09:32:43.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:43 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi171 to 17088M 2024-09-19T09:32:43.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:43 smithi042 ceph-mon[31223]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:32:43.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:43 smithi042 ceph-mon[31223]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T09:32:43.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:43 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:43.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:43 smithi042 ceph-mon[31223]: from='osd.2 [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:32:43.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:43 smithi042 ceph-mon[31223]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:32:43.498 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:43 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:43.498 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:43 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:43.498 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:43 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi171 2024-09-19T09:32:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi171 to 17088M 2024-09-19T09:32:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-mon[35803]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:32:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-mon[35803]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T09:32:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-mon[35803]: from='osd.2 [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:32:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-mon[35803]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:32:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:43.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:43.598 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2[40840]: 2024-09-19T09:32:43.318+0000 7fa598aca640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T09:32:43.598 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:43 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2[40840]: 2024-09-19T09:32:43.322+0000 7fa595104640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:32:43.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:43 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi171 2024-09-19T09:32:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:43 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi171 to 17088M 2024-09-19T09:32:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:43 smithi136 ceph-mon[34840]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:32:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:43 smithi136 ceph-mon[34840]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T09:32:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:43 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:43 smithi136 ceph-mon[34840]: from='osd.2 [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:32:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:43 smithi136 ceph-mon[34840]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:32:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:43 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:43 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:43 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:44.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:44 smithi042 ceph-mon[31223]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:44.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:44 smithi042 ceph-mon[31223]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:44.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:44 smithi042 ceph-mon[31223]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:32:44.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:44 smithi042 ceph-mon[31223]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:32:44.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:44.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:44.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:44 smithi171 ceph-mon[35803]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:44.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:44 smithi171 ceph-mon[35803]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:44.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:44 smithi171 ceph-mon[35803]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:32:44.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:44 smithi171 ceph-mon[35803]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:32:44.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:44.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:44 smithi136 ceph-mon[34840]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:44 smithi136 ceph-mon[34840]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:44 smithi136 ceph-mon[34840]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:32:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:44 smithi136 ceph-mon[34840]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:32:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:45.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:45 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:32:45.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:45 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:32:45.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:45 smithi171 ceph-mon[35803]: osd.2 [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] boot 2024-09-19T09:32:45.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:45 smithi171 ceph-mon[35803]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T09:32:45.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:45.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:32:45.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:45 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:32:45.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:45 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:32:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:45 smithi136 ceph-mon[34840]: osd.2 [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] boot 2024-09-19T09:32:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:45 smithi136 ceph-mon[34840]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T09:32:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:32:45.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:45 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:32:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:45 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:32:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:45 smithi042 ceph-mon[31223]: osd.2 [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] boot 2024-09-19T09:32:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:45 smithi042 ceph-mon[31223]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T09:32:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:32:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:32:46.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:46 smithi171 ceph-mon[35803]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:32:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:46 smithi171 ceph-mon[35803]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T09:32:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:32:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:46 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/182436984' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31859291-9497-400b-9dec-5ce253a06cda"}]: dispatch 2024-09-19T09:32:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:32:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:46 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/182436984' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31859291-9497-400b-9dec-5ce253a06cda"}]': finished 2024-09-19T09:32:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:46 smithi171 ceph-mon[35803]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T09:32:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:32:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:46 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1775872925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:46.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:46 smithi136 ceph-mon[34840]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:46.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:32:46.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:46 smithi136 ceph-mon[34840]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T09:32:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:32:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:46 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/182436984' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31859291-9497-400b-9dec-5ce253a06cda"}]: dispatch 2024-09-19T09:32:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:32:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:46 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/182436984' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31859291-9497-400b-9dec-5ce253a06cda"}]': finished 2024-09-19T09:32:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:46 smithi136 ceph-mon[34840]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T09:32:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:32:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:46 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1775872925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:46.704 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:32:46 smithi042 sudo[49941]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:32:46.704 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:32:46 smithi042 sudo[49941]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:46.704 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:32:46 smithi042 sudo[49941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:46.705 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:32:46 smithi042 sudo[49941]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:46 smithi042 ceph-mon[31223]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:32:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:32:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:46 smithi042 ceph-mon[31223]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T09:32:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:32:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:46 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/182436984' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31859291-9497-400b-9dec-5ce253a06cda"}]: dispatch 2024-09-19T09:32:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:32:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:46 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/182436984' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31859291-9497-400b-9dec-5ce253a06cda"}]': finished 2024-09-19T09:32:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:46 smithi042 ceph-mon[31223]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T09:32:46.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:32:46.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:46 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1775872925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:46.954 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:32:46 smithi042 sudo[49993]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:32:46.954 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:32:46 smithi042 sudo[49993]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:46.954 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:32:46 smithi042 sudo[49993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:46.954 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:32:46 smithi042 sudo[49993]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:47.232 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:46 smithi136 sudo[43092]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:32:47.232 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:46 smithi136 sudo[43092]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:47.232 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:46 smithi136 sudo[43092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:47.232 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:46 smithi136 sudo[43092]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:47.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:32:47.336+0000 7f4094ff9640 1 -- 172.21.15.42:0/275520890 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f408c097f30 con 0x7f4098101cd0 2024-09-19T09:32:47.634 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:47 smithi136 sudo[43095]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:32:47.634 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:47 smithi136 sudo[43095]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:47.635 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:47 smithi136 sudo[43095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:47.635 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:32:47 smithi136 sudo[43095]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:47.759 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:47 smithi171 ceph-mon[35803]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:47.759 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:47 smithi171 ceph-mon[35803]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T09:32:47.759 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:47 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:32:47.760 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:47 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:47.760 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:47 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:47.760 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:47 smithi171 ceph-mon[35803]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:32:47.760 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:47 smithi171 sudo[44469]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:32:47.760 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:47 smithi171 sudo[44469]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:47.760 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:47 smithi171 sudo[44469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:47.760 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:47 smithi171 sudo[44469]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:48.096 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:47 smithi171 sudo[44472]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:32:48.096 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:47 smithi171 sudo[44472]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:48.097 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:47 smithi171 sudo[44472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:48.097 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:32:47 smithi171 sudo[44472]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:47 smithi136 ceph-mon[34840]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:47 smithi136 ceph-mon[34840]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T09:32:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:47 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:32:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:47 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:48.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:47 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:48.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:47 smithi136 ceph-mon[34840]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:32:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:47 smithi042 ceph-mon[31223]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:47 smithi042 ceph-mon[31223]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T09:32:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:32:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:48.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:47 smithi042 ceph-mon[31223]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:32:48.681 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:48 smithi042 sudo[50373]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:32:48.682 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:48 smithi042 sudo[50373]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:48.682 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:48 smithi042 sudo[50373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:48.682 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:48 smithi042 sudo[50373]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:48.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:48 smithi042 sudo[50379]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:32:48.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:48 smithi042 sudo[50379]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:48.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:48 smithi042 sudo[50379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:48.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:48 smithi042 sudo[50379]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:49.178 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:48 smithi171 sudo[44475]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:32:49.179 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:48 smithi171 sudo[44475]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:49.179 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:48 smithi171 sudo[44475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:49.179 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:48 smithi171 sudo[44475]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:49.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:49.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:49 smithi042 ceph-mon[31223]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:32:49.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:49 smithi042 ceph-mon[31223]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:32:49.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:32:49.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:32:49.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:32:49.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:32:49.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:32:49.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:32:49.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 sudo[44478]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 sudo[44478]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 sudo[44478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 sudo[44478]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 ceph-mon[35803]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 ceph-mon[35803]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:32:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:32:49.677 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 sudo[43098]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:32:49.677 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 sudo[43098]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:49.677 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 sudo[43098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:49.677 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 sudo[43098]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 sudo[43101]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:32:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 sudo[43101]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 sudo[43101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 sudo[43101]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 ceph-mon[34840]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 ceph-mon[34840]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:32:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:32:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:50 smithi042 ceph-mon[31223]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:50 smithi042 ceph-mon[31223]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:32:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:50 smithi042 ceph-mon[31223]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:32:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:50 smithi042 ceph-mon[31223]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:32:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:50 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:32:50.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:50 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:32:50.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:50 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:32:50.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:50 smithi042 ceph-mon[31223]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:32:50.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:50 smithi171 ceph-mon[35803]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:50.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:50 smithi171 ceph-mon[35803]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:32:50.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:50 smithi171 ceph-mon[35803]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:32:50.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:50 smithi171 ceph-mon[35803]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:32:50.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:50 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:32:50.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:50 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:32:50.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:50 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:32:50.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:50 smithi171 ceph-mon[35803]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:32:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:50 smithi136 ceph-mon[34840]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:50 smithi136 ceph-mon[34840]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:32:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:50 smithi136 ceph-mon[34840]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:32:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:50 smithi136 ceph-mon[34840]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:32:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:50 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:32:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:50 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:32:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:50 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:32:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:50 smithi136 ceph-mon[34840]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:32:52.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:52 smithi042 ceph-mon[31223]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:52.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:52 smithi171 ceph-mon[35803]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:52.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:52 smithi136 ceph-mon[34840]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:54.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:54 smithi042 ceph-mon[31223]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:54.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:32:54.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:54.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:54 smithi171 ceph-mon[35803]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:54.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:32:54.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:54.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:54 smithi136 ceph-mon[34840]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:54.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:32:54.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:55.437 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:55 smithi042 ceph-mon[31223]: Deploying daemon osd.3 on smithi042 2024-09-19T09:32:55.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:55 smithi171 ceph-mon[35803]: Deploying daemon osd.3 on smithi042 2024-09-19T09:32:55.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:55 smithi136 ceph-mon[34840]: Deploying daemon osd.3 on smithi042 2024-09-19T09:32:56.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:56 smithi042 ceph-mon[31223]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:56.535 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:56 smithi136 ceph-mon[34840]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:56.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:56 smithi171 ceph-mon[35803]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:58.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:32:58 smithi042 ceph-mon[31223]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:58.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:32:58 smithi171 ceph-mon[35803]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:32:58.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:32:58 smithi136 ceph-mon[34840]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:00.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:00 smithi042 ceph-mon[31223]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:00.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:00 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:00.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:00 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:00.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:00 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:00.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:00 smithi171 ceph-mon[35803]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:00.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:00 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:00.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:00 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:00.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:00 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:00.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:00 smithi136 ceph-mon[34840]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:00.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:00 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:00.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:00 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:00.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:00 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:02.527 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:02 smithi042 ceph-mon[31223]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:02.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:02 smithi171 ceph-mon[35803]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:02.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:02 smithi136 ceph-mon[34840]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:03.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.357+0000 7f4094ff9640 1 -- 172.21.15.42:0/275520890 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f40980fe490 con 0x7f40800a31e0 2024-09-19T09:33:03.359 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 3 on host 'smithi042' 2024-09-19T09:33:03.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 -- 172.21.15.42:0/275520890 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40800a31e0 msgr2=0x7f40800a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:03.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40800a31e0 0x7f40800a56a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4098101b30 tx=0x7f4088009670 comp rx=0 tx=0).stop 2024-09-19T09:33:03.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 -- 172.21.15.42:0/275520890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4098101cd0 msgr2=0x7f409819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:03.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4098101cd0 0x7f409819a5e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f408c00d770 tx=0x7f408c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:33:03.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 -- 172.21.15.42:0/275520890 shutdown_connections 2024-09-19T09:33:03.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40800a31e0 0x7f40800a56a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:03.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4098102690 0x7f40981a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:03.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4098101cd0 0x7f409819a5e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:03.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 --2- 172.21.15.42:0/275520890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4098100ad0 0x7f409819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:03.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 -- 172.21.15.42:0/275520890 >> 172.21.15.42:0/275520890 conn(0x7f40980fc280 msgr2=0x7f40980fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:03.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 -- 172.21.15.42:0/275520890 shutdown_connections 2024-09-19T09:33:03.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:03.360+0000 7f409e259640 1 -- 172.21.15.42:0/275520890 wait complete. 2024-09-19T09:33:03.987 DEBUG:teuthology.orchestra.run.smithi042:osd.3> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T09:33:03.990 INFO:tasks.cephadm:Deploying osd.4 on smithi136 with /dev/vg_nvme/lv_3... 2024-09-19T09:33:03.990 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:33:04.244 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:33:04.496 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:04 smithi042 ceph-mon[31223]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:04.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:04 smithi136 ceph-mon[34840]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:04 smithi171 ceph-mon[35803]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:04.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:04.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:06.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:06 smithi042 ceph-mon[31223]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:06.612 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:06 smithi136 ceph-mon[34840]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:33:06.641 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_3 2024-09-19T09:33:06.758 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:33:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3[51989]: 2024-09-19T09:33:06.561+0000 7fa10f700640 -1 osd.3 0 log_to_monitors true 2024-09-19T09:33:06.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:06 smithi171 ceph-mon[35803]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:06.891 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:33:07.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.289+0000 7fc699035640 1 -- 172.21.15.136:0/3208650785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc694102660 msgr2=0x7fc694104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.289+0000 7fc699035640 1 --2- 172.21.15.136:0/3208650785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc694102660 0x7fc694104a50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009ca0 tx=0x7fc68c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.290+0000 7fc699035640 1 -- 172.21.15.136:0/3208650785 shutdown_connections 2024-09-19T09:33:07.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.290+0000 7fc699035640 1 --2- 172.21.15.136:0/3208650785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6941078c0 0x7fc694109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.290+0000 7fc699035640 1 --2- 172.21.15.136:0/3208650785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc694104f90 0x7fc694107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.290+0000 7fc699035640 1 --2- 172.21.15.136:0/3208650785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc694102660 0x7fc694104a50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.290+0000 7fc699035640 1 -- 172.21.15.136:0/3208650785 >> 172.21.15.136:0/3208650785 conn(0x7fc6940fc280 msgr2=0x7fc6940fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:07.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.290+0000 7fc699035640 1 -- 172.21.15.136:0/3208650785 shutdown_connections 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.290+0000 7fc699035640 1 -- 172.21.15.136:0/3208650785 wait complete. 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc699035640 1 Processor -- start 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc699035640 1 -- start start 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc699035640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc694102660 0x7fc694101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc699035640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc694104f90 0x7fc694100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc699035640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6941078c0 0x7fc694100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc699035640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc69410d930 con 0x7fc694102660 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc699035640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc69410d7b0 con 0x7fc6941078c0 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc699035640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc69410dab0 con 0x7fc694104f90 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc69359e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6941078c0 0x7fc694100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc692d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc694102660 0x7fc694101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc69359e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6941078c0 0x7fc694100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45772/0 (socket says 172.21.15.136:45772) 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc69359e640 1 -- 172.21.15.136:0/4180155147 learned_addr learned my addr 172.21.15.136:0/4180155147 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.291+0000 7fc69259c640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc694104f90 0x7fc694100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc69359e640 1 -- 172.21.15.136:0/4180155147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc694104f90 msgr2=0x7fc694100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc69359e640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc694104f90 0x7fc694100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc69359e640 1 -- 172.21.15.136:0/4180155147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc694102660 msgr2=0x7fc694101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc69359e640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc694102660 0x7fc694101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc69359e640 1 -- 172.21.15.136:0/4180155147 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc694101410 con 0x7fc6941078c0 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc69259c640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc694104f90 0x7fc694100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc69359e640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6941078c0 0x7fc694100b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc68400d950 tx=0x7fc68400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc68bfff640 1 -- 172.21.15.136:0/4180155147 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684017030 con 0x7fc6941078c0 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc68bfff640 1 -- 172.21.15.136:0/4180155147 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc684004020 con 0x7fc6941078c0 2024-09-19T09:33:07.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc699035640 1 -- 172.21.15.136:0/4180155147 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6941a2150 con 0x7fc6941078c0 2024-09-19T09:33:07.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc68bfff640 1 -- 172.21.15.136:0/4180155147 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684003c00 con 0x7fc6941078c0 2024-09-19T09:33:07.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.292+0000 7fc699035640 1 -- 172.21.15.136:0/4180155147 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6941a2610 con 0x7fc6941078c0 2024-09-19T09:33:07.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.293+0000 7fc699035640 1 -- 172.21.15.136:0/4180155147 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6940fdd70 con 0x7fc6941078c0 2024-09-19T09:33:07.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.294+0000 7fc68bfff640 1 -- 172.21.15.136:0/4180155147 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc68401a070 con 0x7fc6941078c0 2024-09-19T09:33:07.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.295+0000 7fc68bfff640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc6800a3240 0x7fc6800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.295+0000 7fc68bfff640 1 -- 172.21.15.136:0/4180155147 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3352+0+0 (secure 0 0 0) 0x7fc6840ce1c0 con 0x7fc6941078c0 2024-09-19T09:33:07.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.295+0000 7fc692d9d640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc6800a3240 0x7fc6800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.296+0000 7fc692d9d640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc6800a3240 0x7fc6800a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc68c005e30 tx=0x7fc68c005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:07.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.298+0000 7fc68bfff640 1 -- 172.21.15.136:0/4180155147 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc684021070 con 0x7fc6941078c0 2024-09-19T09:33:07.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:33:07.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:07.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:07.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:07.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:07.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:07.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:07.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:07.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:07.473+0000 7fc699035640 1 -- 172.21.15.136:0/4180155147 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc694062630 con 0x7fc6800a3240 2024-09-19T09:33:07.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:08 smithi136 ceph-mon[34840]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:08 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi042 2024-09-19T09:33:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:08 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi042 to 8546M 2024-09-19T09:33:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:08 smithi136 ceph-mon[34840]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:33:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:08 smithi136 ceph-mon[34840]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:33:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:08 smithi136 ceph-mon[34840]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:33:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:08.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:08 smithi042 ceph-mon[31223]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:08.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:08 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi042 2024-09-19T09:33:08.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:08 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi042 to 8546M 2024-09-19T09:33:08.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:08 smithi042 ceph-mon[31223]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:33:08.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:08 smithi042 ceph-mon[31223]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:33:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:08 smithi042 ceph-mon[31223]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:33:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:08.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:08 smithi171 ceph-mon[35803]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:08.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:08 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi042 2024-09-19T09:33:08.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:08 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi042 to 8546M 2024-09-19T09:33:08.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:08 smithi171 ceph-mon[35803]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:33:08.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:08 smithi171 ceph-mon[35803]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:33:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:08 smithi171 ceph-mon[35803]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:33:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:09.373 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:33:09 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3[51989]: 2024-09-19T09:33:09.073+0000 7fa10ae60640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T09:33:09.373 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:33:09 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3[51989]: 2024-09-19T09:33:09.079+0000 7fa103492640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:33:09.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:09 smithi136 ceph-mon[34840]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:09 smithi136 ceph-mon[34840]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:33:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:09 smithi136 ceph-mon[34840]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:33:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:09 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:09 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:09 smithi136 ceph-mon[34840]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' 2024-09-19T09:33:09.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:09 smithi042 ceph-mon[31223]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:09.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:09 smithi042 ceph-mon[31223]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:33:09.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:09 smithi042 ceph-mon[31223]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:33:09.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:09 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:09.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:09 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:09.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:09 smithi042 ceph-mon[31223]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' 2024-09-19T09:33:09.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:09 smithi171 ceph-mon[35803]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:09.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:09 smithi171 ceph-mon[35803]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:33:09.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:09 smithi171 ceph-mon[35803]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:33:09.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:09 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:09.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:09 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:09.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:09 smithi171 ceph-mon[35803]: from='osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248]' entity='osd.3' 2024-09-19T09:33:10.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:33:10.682 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:33:10.682 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:10.682 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:10.683 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] boot 2024-09-19T09:33:10.683 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: osdmap e22: 4 total, 4 up, 4 in 2024-09-19T09:33:10.683 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:10.683 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: from='client.? 172.21.15.136:0/2850496362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f45ebe54-a9d3-4af4-bf11-99bc0038141d"}]: dispatch 2024-09-19T09:33:10.683 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f45ebe54-a9d3-4af4-bf11-99bc0038141d"}]: dispatch 2024-09-19T09:33:10.683 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f45ebe54-a9d3-4af4-bf11-99bc0038141d"}]': finished 2024-09-19T09:33:10.683 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: osdmap e23: 5 total, 4 up, 5 in 2024-09-19T09:33:10.683 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:10.683 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:10 smithi136 ceph-mon[34840]: from='client.? 172.21.15.136:0/3764556845' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:10.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:33:10.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:33:10.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] boot 2024-09-19T09:33:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: osdmap e22: 4 total, 4 up, 4 in 2024-09-19T09:33:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: from='client.? 172.21.15.136:0/2850496362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f45ebe54-a9d3-4af4-bf11-99bc0038141d"}]: dispatch 2024-09-19T09:33:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f45ebe54-a9d3-4af4-bf11-99bc0038141d"}]: dispatch 2024-09-19T09:33:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f45ebe54-a9d3-4af4-bf11-99bc0038141d"}]': finished 2024-09-19T09:33:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: osdmap e23: 5 total, 4 up, 5 in 2024-09-19T09:33:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:10 smithi042 ceph-mon[31223]: from='client.? 172.21.15.136:0/3764556845' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:10.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:33:10.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: osd.3 [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] boot 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: osdmap e22: 4 total, 4 up, 4 in 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: from='client.? 172.21.15.136:0/2850496362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f45ebe54-a9d3-4af4-bf11-99bc0038141d"}]: dispatch 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f45ebe54-a9d3-4af4-bf11-99bc0038141d"}]: dispatch 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f45ebe54-a9d3-4af4-bf11-99bc0038141d"}]': finished 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: osdmap e23: 5 total, 4 up, 5 in 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:10 smithi171 ceph-mon[35803]: from='client.? 172.21.15.136:0/3764556845' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:12.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:11 smithi171 ceph-mon[35803]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:12.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:11 smithi171 ceph-mon[35803]: osdmap e24: 5 total, 4 up, 5 in 2024-09-19T09:33:12.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:11 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:11 smithi136 ceph-mon[34840]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:11 smithi136 ceph-mon[34840]: osdmap e24: 5 total, 4 up, 5 in 2024-09-19T09:33:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:11 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:12.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:11 smithi042 ceph-mon[31223]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:12.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:11 smithi042 ceph-mon[31223]: osdmap e24: 5 total, 4 up, 5 in 2024-09-19T09:33:12.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:11 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:13.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:12 smithi171 ceph-mon[35803]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T09:33:13.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:12 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:13.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:12 smithi136 ceph-mon[34840]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T09:33:13.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:12 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:13.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:12 smithi042 ceph-mon[31223]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T09:33:13.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:12 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:14.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:13 smithi171 ceph-mon[35803]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:14.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:13 smithi171 ceph-mon[35803]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T09:33:14.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:13 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:14.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:13 smithi136 ceph-mon[34840]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:14.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:13 smithi136 ceph-mon[34840]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T09:33:14.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:13 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:14.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:13 smithi042 ceph-mon[31223]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:14.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:13 smithi042 ceph-mon[31223]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T09:33:14.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:13 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:16.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:15 smithi171 ceph-mon[35803]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:16.121 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:15 smithi136 ceph-mon[34840]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:16.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:15 smithi042 ceph-mon[31223]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:17.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:17 smithi136 ceph-mon[34840]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:33:18.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:17 smithi171 ceph-mon[35803]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:33:18.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:17 smithi042 ceph-mon[31223]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:33:19.023 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:33:19.023 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:19.023 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:18 smithi136 ceph-mon[34840]: Deploying daemon osd.4 on smithi136 2024-09-19T09:33:19.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:33:19.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:19.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:18 smithi171 ceph-mon[35803]: Deploying daemon osd.4 on smithi136 2024-09-19T09:33:19.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:33:19.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:19.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:18 smithi042 ceph-mon[31223]: Deploying daemon osd.4 on smithi136 2024-09-19T09:33:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:19 smithi136 ceph-mon[34840]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T09:33:20.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:19 smithi171 ceph-mon[35803]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T09:33:20.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:19 smithi042 ceph-mon[31223]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T09:33:22.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:21 smithi171 ceph-mon[35803]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T09:33:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:21 smithi136 ceph-mon[34840]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T09:33:22.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:21 smithi042 ceph-mon[31223]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T09:33:24.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:23 smithi136 ceph-mon[34840]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:33:24.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:23 smithi171 ceph-mon[35803]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:33:24.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:23 smithi042 ceph-mon[31223]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:33:25.024 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:24 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:25.024 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:24 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:25.024 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:24 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:25.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:24 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:25.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:24 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:25.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:24 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:25.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:24 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:25.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:24 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:25.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:24 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:26.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:26 smithi136 ceph-mon[34840]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T09:33:26.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:26 smithi171 ceph-mon[35803]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T09:33:26.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:26 smithi042 ceph-mon[31223]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T09:33:27.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.927+0000 7fc68bfff640 1 -- 172.21.15.136:0/4180155147 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc694062630 con 0x7fc6800a3240 2024-09-19T09:33:27.929 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 4 on host 'smithi136' 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 -- 172.21.15.136:0/4180155147 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc6800a3240 msgr2=0x7fc6800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc6800a3240 0x7fc6800a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc68c005e30 tx=0x7fc68c005f50 comp rx=0 tx=0).stop 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 -- 172.21.15.136:0/4180155147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6941078c0 msgr2=0x7fc694100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6941078c0 0x7fc694100b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc68400d950 tx=0x7fc68400de10 comp rx=0 tx=0).stop 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 -- 172.21.15.136:0/4180155147 shutdown_connections 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc6800a3240 0x7fc6800a5700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6941078c0 0x7fc694100b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc694104f90 0x7fc694100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 --2- 172.21.15.136:0/4180155147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc694102660 0x7fc694101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 -- 172.21.15.136:0/4180155147 >> 172.21.15.136:0/4180155147 conn(0x7fc6940fc280 msgr2=0x7fc694102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 -- 172.21.15.136:0/4180155147 shutdown_connections 2024-09-19T09:33:27.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:33:27.930+0000 7fc699035640 1 -- 172.21.15.136:0/4180155147 wait complete. 2024-09-19T09:33:28.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:27 smithi136 ceph-mon[34840]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:33:28.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:28.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:28.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:28.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:27 smithi171 ceph-mon[35803]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:33:28.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:28.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:28.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:28.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:27 smithi042 ceph-mon[31223]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:33:28.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:28.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:28.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:28.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:28.595 DEBUG:teuthology.orchestra.run.smithi136:osd.4> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T09:33:28.598 INFO:tasks.cephadm:Deploying osd.5 on smithi171 with /dev/vg_nvme/lv_3... 2024-09-19T09:33:28.598 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:33:28.860 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:33:30.171 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:29 smithi171 ceph-mon[35803]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:30.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:29 smithi136 ceph-mon[34840]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:30.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:29 smithi042 ceph-mon[31223]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:30.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:33:30 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:33:30.621+0000 7fa722626640 -1 osd.4 0 log_to_monitors true 2024-09-19T09:33:31.012 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:33:31.039 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_3 2024-09-19T09:33:31.064 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:30 smithi171 ceph-mon[35803]: from='osd.4 [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:33:31.064 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:30 smithi171 ceph-mon[35803]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:33:31.290 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:33:31.373 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:30 smithi136 ceph-mon[34840]: from='osd.4 [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:33:31.373 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:30 smithi136 ceph-mon[34840]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:33:31.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:30 smithi042 ceph-mon[31223]: from='osd.4 [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:33:31.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:30 smithi042 ceph-mon[31223]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:33:31.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.729+0000 7f9bd9469640 1 -- 172.21.15.171:0/1307341225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd41020a0 msgr2=0x7f9bd41024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:31.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.729+0000 7f9bd9469640 1 --2- 172.21.15.171:0/1307341225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd41020a0 0x7f9bd41024a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009900 tx=0x7f9bc402a410 comp rx=0 tx=0).stop 2024-09-19T09:33:31.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.729+0000 7f9bd9469640 1 -- 172.21.15.171:0/1307341225 shutdown_connections 2024-09-19T09:33:31.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.729+0000 7f9bd9469640 1 --2- 172.21.15.171:0/1307341225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd41017a0 0x7f9bd4109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:31.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.729+0000 7f9bd9469640 1 --2- 172.21.15.171:0/1307341225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bd4100de0 0x7f9bd4101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:31.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.729+0000 7f9bd9469640 1 --2- 172.21.15.171:0/1307341225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd41020a0 0x7f9bd41024a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.729+0000 7f9bd9469640 1 -- 172.21.15.171:0/1307341225 >> 172.21.15.171:0/1307341225 conn(0x7f9bd40fba40 msgr2=0x7f9bd40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.729+0000 7f9bd9469640 1 -- 172.21.15.171:0/1307341225 shutdown_connections 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.729+0000 7f9bd9469640 1 -- 172.21.15.171:0/1307341225 wait complete. 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.730+0000 7f9bd9469640 1 Processor -- start 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.730+0000 7f9bd9469640 1 -- start start 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.730+0000 7f9bd9469640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd4100de0 0x7f9bd4104b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.730+0000 7f9bd9469640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bd41017a0 0x7f9bd41031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.730+0000 7f9bd9469640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd41020a0 0x7f9bd4103710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.730+0000 7f9bd9469640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd410c780 con 0x7f9bd41017a0 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.730+0000 7f9bd9469640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd410c600 con 0x7f9bd4100de0 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.730+0000 7f9bd9469640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd410c900 con 0x7f9bd41020a0 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.730+0000 7f9bd37fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd41020a0 0x7f9bd4103710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd4100de0 0x7f9bd4104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:31.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd37fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd41020a0 0x7f9bd4103710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:36570/0 (socket says 172.21.15.171:36570) 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd37fe640 1 -- 172.21.15.171:0/2198515987 learned_addr learned my addr 172.21.15.171:0/2198515987 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd27fc640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bd41017a0 0x7f9bd41031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd37fe640 1 -- 172.21.15.171:0/2198515987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd4100de0 msgr2=0x7f9bd4104b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd37fe640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd4100de0 0x7f9bd4104b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd37fe640 1 -- 172.21.15.171:0/2198515987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bd41017a0 msgr2=0x7f9bd41031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd37fe640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bd41017a0 0x7f9bd41031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd37fe640 1 -- 172.21.15.171:0/2198515987 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd4103fd0 con 0x7f9bd41020a0 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd2ffd640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd4100de0 0x7f9bd4104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd37fe640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd41020a0 0x7f9bd4103710 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009fd0 tx=0x7f9bcc00b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bbbfff640 1 -- 172.21.15.171:0/2198515987 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc017070 con 0x7f9bd41020a0 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd9469640 1 -- 172.21.15.171:0/2198515987 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd41a2120 con 0x7f9bd41020a0 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bbbfff640 1 -- 172.21.15.171:0/2198515987 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bcc003e50 con 0x7f9bd41020a0 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bbbfff640 1 -- 172.21.15.171:0/2198515987 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0106c0 con 0x7f9bd41020a0 2024-09-19T09:33:31.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.731+0000 7f9bd9469640 1 -- 172.21.15.171:0/2198515987 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd41a2630 con 0x7f9bd41020a0 2024-09-19T09:33:31.736 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.732+0000 7f9bd9469640 1 -- 172.21.15.171:0/2198515987 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd4101260 con 0x7f9bd41020a0 2024-09-19T09:33:31.736 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.734+0000 7f9bbbfff640 1 -- 172.21.15.171:0/2198515987 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9bcc003970 con 0x7f9bd41020a0 2024-09-19T09:33:31.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.735+0000 7f9bbbfff640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bbc0a32c0 0x7f9bbc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:31.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.735+0000 7f9bbbfff640 1 -- 172.21.15.171:0/2198515987 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3805+0+0 (secure 0 0 0) 0x7f9bcc0ce380 con 0x7f9bd41020a0 2024-09-19T09:33:31.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.735+0000 7f9bd2ffd640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bbc0a32c0 0x7f9bbc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:31.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.736+0000 7f9bd2ffd640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bbc0a32c0 0x7f9bbc0a5780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009230 tx=0x7f9bc40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:31.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.738+0000 7f9bbbfff640 1 -- 172.21.15.171:0/2198515987 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9bcc09bc50 con 0x7f9bd41020a0 2024-09-19T09:33:31.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:31.921+0000 7f9bd9469640 1 -- 172.21.15.171:0/2198515987 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9bd41a2920 con 0x7f9bbc0a32c0 2024-09-19T09:33:32.316 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:32.316 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='osd.4 [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi136 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi136 to 8544M 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:32.317 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:32.318 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.318 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:32.318 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:32.318 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:32.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:32.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='osd.4 [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi136 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi136 to 8544M 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:32.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:32.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:32.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:32.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:33:32.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:33:32.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:32.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='osd.4 [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:33:32.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:33:32.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi136 2024-09-19T09:33:32.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:32.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:32.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi136 to 8544M 2024-09-19T09:33:32.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:32.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:32.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:32.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:32.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:32.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:33.015 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:33:32.723+0000 7fa71dd86640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T09:33:33.015 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:33:32 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:33:32.732+0000 7fa7163b8640 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:33:33.228 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:33 smithi171 ceph-mon[35803]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:33.228 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:33 smithi171 ceph-mon[35803]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:33:33.228 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:33 smithi171 ceph-mon[35803]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:33:33.229 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:33.229 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:33.229 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:33 smithi171 ceph-mon[35803]: from='osd.4 ' entity='osd.4' 2024-09-19T09:33:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:33 smithi136 ceph-mon[34840]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:33 smithi136 ceph-mon[34840]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:33:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:33 smithi136 ceph-mon[34840]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:33:33.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:33.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:33.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:33 smithi136 ceph-mon[34840]: from='osd.4 ' entity='osd.4' 2024-09-19T09:33:33.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:33 smithi042 ceph-mon[31223]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:33.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:33 smithi042 ceph-mon[31223]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:33:33.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:33 smithi042 ceph-mon[31223]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:33:33.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:33.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:33.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:33 smithi042 ceph-mon[31223]: from='osd.4 ' entity='osd.4' 2024-09-19T09:33:34.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:34 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:33:34.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:34 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:33:34.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:34 smithi171 ceph-mon[35803]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:34.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:34 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:34.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:34 smithi171 ceph-mon[35803]: osd.4 [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] boot 2024-09-19T09:33:34.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:34 smithi171 ceph-mon[35803]: osdmap e29: 5 total, 5 up, 5 in 2024-09-19T09:33:34.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:34 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:34 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:33:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:34 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:33:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:34 smithi136 ceph-mon[34840]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:34 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:34 smithi136 ceph-mon[34840]: osd.4 [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] boot 2024-09-19T09:33:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:34 smithi136 ceph-mon[34840]: osdmap e29: 5 total, 5 up, 5 in 2024-09-19T09:33:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:34 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:34.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:34 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:33:34.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:34 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:33:34.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:34 smithi042 ceph-mon[31223]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:33:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:34 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:34 smithi042 ceph-mon[31223]: osd.4 [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] boot 2024-09-19T09:33:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:34 smithi042 ceph-mon[31223]: osdmap e29: 5 total, 5 up, 5 in 2024-09-19T09:33:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:34 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:33:35.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:35 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/412962267' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "852fe127-e1d5-4a0e-9f0f-358680473508"}]: dispatch 2024-09-19T09:33:35.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:35 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "852fe127-e1d5-4a0e-9f0f-358680473508"}]: dispatch 2024-09-19T09:33:35.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:35 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "852fe127-e1d5-4a0e-9f0f-358680473508"}]': finished 2024-09-19T09:33:35.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:35 smithi042 ceph-mon[31223]: osdmap e30: 6 total, 5 up, 6 in 2024-09-19T09:33:35.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:35 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:35.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:35 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/535745269' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:35.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:35 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/412962267' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "852fe127-e1d5-4a0e-9f0f-358680473508"}]: dispatch 2024-09-19T09:33:35.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:35 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "852fe127-e1d5-4a0e-9f0f-358680473508"}]: dispatch 2024-09-19T09:33:35.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:35 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "852fe127-e1d5-4a0e-9f0f-358680473508"}]': finished 2024-09-19T09:33:35.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:35 smithi171 ceph-mon[35803]: osdmap e30: 6 total, 5 up, 6 in 2024-09-19T09:33:35.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:35 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:35.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:35 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/535745269' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:35.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:35 smithi136 ceph-mon[34840]: from='client.? 172.21.15.171:0/412962267' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "852fe127-e1d5-4a0e-9f0f-358680473508"}]: dispatch 2024-09-19T09:33:35.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:35 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "852fe127-e1d5-4a0e-9f0f-358680473508"}]: dispatch 2024-09-19T09:33:35.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:35 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "852fe127-e1d5-4a0e-9f0f-358680473508"}]': finished 2024-09-19T09:33:35.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:35 smithi136 ceph-mon[34840]: osdmap e30: 6 total, 5 up, 6 in 2024-09-19T09:33:35.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:35 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:35.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:35 smithi136 ceph-mon[34840]: from='client.? 172.21.15.171:0/535745269' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:36.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:36 smithi042 ceph-mon[31223]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:36.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:36 smithi042 ceph-mon[31223]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T09:33:36.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:36 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:36.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:36 smithi171 ceph-mon[35803]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:36.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:36 smithi171 ceph-mon[35803]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T09:33:36.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:36 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:36.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:36 smithi136 ceph-mon[34840]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:36.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:36 smithi136 ceph-mon[34840]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T09:33:36.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:36 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:38.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:38 smithi042 ceph-mon[31223]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:38.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:38 smithi171 ceph-mon[35803]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:38 smithi136 ceph-mon[34840]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:40.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:40 smithi042 ceph-mon[31223]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:40.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:40 smithi171 ceph-mon[35803]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:40.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:40 smithi136 ceph-mon[34840]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:42.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:42 smithi042 ceph-mon[31223]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:42.480 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:42 smithi171 ceph-mon[35803]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:42.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:42 smithi136 ceph-mon[34840]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:43.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:43 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:33:43.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:43 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:43.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:43 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:33:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:43 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:43.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:43 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:33:43.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:43 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:44.310 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:44 smithi171 ceph-mon[35803]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:44.311 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:44 smithi171 ceph-mon[35803]: Deploying daemon osd.5 on smithi171 2024-09-19T09:33:44.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:44 smithi042 ceph-mon[31223]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:44.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:44 smithi042 ceph-mon[31223]: Deploying daemon osd.5 on smithi171 2024-09-19T09:33:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:44 smithi136 ceph-mon[34840]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:44 smithi136 ceph-mon[34840]: Deploying daemon osd.5 on smithi171 2024-09-19T09:33:46.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:46 smithi042 ceph-mon[31223]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:46.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:46 smithi171 ceph-mon[35803]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:46.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:46 smithi136 ceph-mon[34840]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:48.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:48 smithi171 ceph-mon[35803]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:48.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:48 smithi136 ceph-mon[34840]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:48.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:48 smithi042 ceph-mon[31223]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:49.493 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:49.493 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:49.493 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:49.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:49.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:49.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:49.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:50.450 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:50 smithi171 ceph-mon[35803]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:50.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:50 smithi042 ceph-mon[31223]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:50 smithi136 ceph-mon[34840]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:51.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.520+0000 7f9bbbfff640 1 -- 172.21.15.171:0/2198515987 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9bd41a2920 con 0x7f9bbc0a32c0 2024-09-19T09:33:51.522 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 5 on host 'smithi171' 2024-09-19T09:33:51.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 -- 172.21.15.171:0/2198515987 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bbc0a32c0 msgr2=0x7f9bbc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:51.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bbc0a32c0 0x7f9bbc0a5780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009230 tx=0x7f9bc40315b0 comp rx=0 tx=0).stop 2024-09-19T09:33:51.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 -- 172.21.15.171:0/2198515987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd41020a0 msgr2=0x7f9bd4103710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:51.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd41020a0 0x7f9bd4103710 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009fd0 tx=0x7f9bcc00b260 comp rx=0 tx=0).stop 2024-09-19T09:33:51.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 -- 172.21.15.171:0/2198515987 shutdown_connections 2024-09-19T09:33:51.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bbc0a32c0 0x7f9bbc0a5780 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:51.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd41020a0 0x7f9bd4103710 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:51.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bd41017a0 0x7f9bd41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:51.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 --2- 172.21.15.171:0/2198515987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bd4100de0 0x7f9bd4104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:51.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 -- 172.21.15.171:0/2198515987 >> 172.21.15.171:0/2198515987 conn(0x7f9bd40fba40 msgr2=0x7f9bd40ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:51.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 -- 172.21.15.171:0/2198515987 shutdown_connections 2024-09-19T09:33:51.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:33:51.522+0000 7f9bd9469640 1 -- 172.21.15.171:0/2198515987 wait complete. 2024-09-19T09:33:52.133 DEBUG:teuthology.orchestra.run.smithi171:osd.5> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T09:33:52.176 INFO:tasks.cephadm:Deploying osd.6 on smithi042 with /dev/vg_nvme/lv_2... 2024-09-19T09:33:52.177 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:33:52.444 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:52.565 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:52 smithi042 ceph-mon[31223]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:52.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:52 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:52 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:52 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.566 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:52 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.702 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:52 smithi171 ceph-mon[35803]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:52.702 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:52 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.702 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:52 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.702 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:52 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.702 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:52 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:52 smithi136 ceph-mon[34840]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:52 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:52 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:52 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:52 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:54.488 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:54 smithi042 ceph-mon[31223]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:54.561 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:54 smithi171 ceph-mon[35803]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:54.846 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:33:54 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:33:54.661+0000 7f8117836640 -1 osd.5 0 log_to_monitors true 2024-09-19T09:33:54.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:54 smithi136 ceph-mon[34840]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:33:55.201 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi042:vg_nvme/lv_2 2024-09-19T09:33:55.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='osd.5 [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:55.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:55.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:55.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.462 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:55.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='osd.5 [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:33:55.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:33:55.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:55.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:55.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:55.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:55.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:55.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:55.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:55.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='osd.5 [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:33:55.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.935+0000 7fedf9473640 1 -- 172.21.15.42:0/3789663372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fedf41078c0 msgr2=0x7fedf4109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.935+0000 7fedf9473640 1 --2- 172.21.15.42:0/3789663372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fedf41078c0 0x7fedf4109d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedec009900 tx=0x7fedec02a410 comp rx=0 tx=0).stop 2024-09-19T09:33:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.935+0000 7fedf9473640 1 -- 172.21.15.42:0/3789663372 shutdown_connections 2024-09-19T09:33:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.935+0000 7fedf9473640 1 --2- 172.21.15.42:0/3789663372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fedf41078c0 0x7fedf4109d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.935+0000 7fedf9473640 1 --2- 172.21.15.42:0/3789663372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf4104f90 0x7fedf4107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.935+0000 7fedf9473640 1 --2- 172.21.15.42:0/3789663372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedf4102660 0x7fedf4104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.935+0000 7fedf9473640 1 -- 172.21.15.42:0/3789663372 >> 172.21.15.42:0/3789663372 conn(0x7fedf40fc280 msgr2=0x7fedf40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.935+0000 7fedf9473640 1 -- 172.21.15.42:0/3789663372 shutdown_connections 2024-09-19T09:33:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.935+0000 7fedf9473640 1 -- 172.21.15.42:0/3789663372 wait complete. 2024-09-19T09:33:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.935+0000 7fedf9473640 1 Processor -- start 2024-09-19T09:33:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf9473640 1 -- start start 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf9473640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedf4102660 0x7fedf4101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf9473640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fedf4104f90 0x7fedf4100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf9473640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf41078c0 0x7fedf4100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf9473640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fedf410d880 con 0x7fedf4104f90 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf9473640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fedf410d700 con 0x7fedf4102660 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf9473640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fedf410da00 con 0x7fedf41078c0 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf27fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fedf4104f90 0x7fedf4100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf27fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fedf4104f90 0x7fedf4100610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39036/0 (socket says 172.21.15.42:39036) 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf27fc640 1 -- 172.21.15.42:0/4078323818 learned_addr learned my addr 172.21.15.42:0/4078323818 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf2ffd640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedf4102660 0x7fedf4101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf37fe640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf41078c0 0x7fedf4100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf27fc640 1 -- 172.21.15.42:0/4078323818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf41078c0 msgr2=0x7fedf4100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf27fc640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf41078c0 0x7fedf4100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf27fc640 1 -- 172.21.15.42:0/4078323818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedf4102660 msgr2=0x7fedf4101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf27fc640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedf4102660 0x7fedf4101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.936+0000 7fedf27fc640 1 -- 172.21.15.42:0/4078323818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf4101410 con 0x7fedf4104f90 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.937+0000 7fedf27fc640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fedf4104f90 0x7fedf4100610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fede800d740 tx=0x7fede800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.937+0000 7feddbfff640 1 -- 172.21.15.42:0/4078323818 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8017070 con 0x7fedf4104f90 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.937+0000 7feddbfff640 1 -- 172.21.15.42:0/4078323818 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fede800de50 con 0x7fedf4104f90 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.937+0000 7fedf9473640 1 -- 172.21.15.42:0/4078323818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf41a1fe0 con 0x7fedf4104f90 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.937+0000 7feddbfff640 1 -- 172.21.15.42:0/4078323818 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8004e00 con 0x7fedf4104f90 2024-09-19T09:33:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.937+0000 7fedf9473640 1 -- 172.21.15.42:0/4078323818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf41a2440 con 0x7fedf4104f90 2024-09-19T09:33:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.938+0000 7fedf9473640 1 -- 172.21.15.42:0/4078323818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf40fdd70 con 0x7fedf4104f90 2024-09-19T09:33:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.939+0000 7feddbfff640 1 -- 172.21.15.42:0/4078323818 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fede8004fa0 con 0x7fedf4104f90 2024-09-19T09:33:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.940+0000 7feddbfff640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feddc0a3240 0x7feddc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.940+0000 7fedf2ffd640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feddc0a3240 0x7feddc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.940+0000 7feddbfff640 1 -- 172.21.15.42:0/4078323818 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4237+0+0 (secure 0 0 0) 0x7fede80ce600 con 0x7fedf4104f90 2024-09-19T09:33:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.940+0000 7fedf2ffd640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feddc0a3240 0x7feddc0a5700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fede4007ec0 tx=0x7fede40075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:55.943+0000 7feddbfff640 1 -- 172.21.15.42:0/4078323818 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fede809bcc0 con 0x7fedf4104f90 2024-09-19T09:33:56.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:33:56.128+0000 7fedf9473640 1 -- 172.21.15.42:0/4078323818 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fedf4062630 con 0x7feddc0a3240 2024-09-19T09:33:56.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:56.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi171 2024-09-19T09:33:56.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi171 to 8544M 2024-09-19T09:33:56.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:33:56.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: from='osd.5 [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:33:56.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T09:33:56.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:56.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:33:56.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:56.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:56.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:56 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:56.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:56.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi171 2024-09-19T09:33:56.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi171 to 8544M 2024-09-19T09:33:56.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:33:56.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: from='osd.5 [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:33:56.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T09:33:56.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:56.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:33:56.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:56.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:56.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:56 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:56.847 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:33:56.409+0000 7f8112f96640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T09:33:56.847 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:33:56.418+0000 7f810f5d0640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:33:56.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:56.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi171 2024-09-19T09:33:56.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi171 to 8544M 2024-09-19T09:33:56.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:33:56.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: from='osd.5 [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:33:56.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T09:33:56.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:56.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:33:56.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:56.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:56.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:56 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:57.632 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:57 smithi042 ceph-mon[31223]: from='client.14382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:57.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:57 smithi042 ceph-mon[31223]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:33:57.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:57 smithi042 ceph-mon[31223]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T09:33:57.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:57.633 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:57.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:57 smithi171 ceph-mon[35803]: from='client.14382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:57.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:57 smithi171 ceph-mon[35803]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:33:57.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:57 smithi171 ceph-mon[35803]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T09:33:57.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:57.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:57.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:57 smithi136 ceph-mon[34840]: from='client.14382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:57 smithi136 ceph-mon[34840]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:33:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:57 smithi136 ceph-mon[34840]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T09:33:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:58.678 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:33:58.678 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:33:58.678 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:58.678 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:58.678 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: osd.5 [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] boot 2024-09-19T09:33:58.678 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T09:33:58.679 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:58.679 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1244074142' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e"}]: dispatch 2024-09-19T09:33:58.679 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1244074142' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e"}]': finished 2024-09-19T09:33:58.679 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: osdmap e35: 7 total, 6 up, 7 in 2024-09-19T09:33:58.679 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:58 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: osd.5 [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] boot 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1244074142' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e"}]: dispatch 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1244074142' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e"}]': finished 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: osdmap e35: 7 total, 6 up, 7 in 2024-09-19T09:33:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:58 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:58.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:33:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:33:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:33:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: osd.5 [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] boot 2024-09-19T09:33:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T09:33:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:33:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1244074142' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e"}]: dispatch 2024-09-19T09:33:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1244074142' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e"}]': finished 2024-09-19T09:33:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: osdmap e35: 7 total, 6 up, 7 in 2024-09-19T09:33:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:58 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:59.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:59 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/101558649' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:59.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:59 smithi042 ceph-mon[31223]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T09:33:59.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:33:59 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:59.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:59 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/101558649' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:59.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:59 smithi171 ceph-mon[35803]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T09:33:59.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:33:59 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:59 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/101558649' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:59 smithi136 ceph-mon[34840]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T09:33:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:33:59 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:00.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:00 smithi042 ceph-mon[31223]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:00.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:00 smithi042 ceph-mon[31223]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T09:34:00.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:00 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:00.748 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:00 smithi171 ceph-mon[35803]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:00.748 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:00 smithi171 ceph-mon[35803]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T09:34:00.748 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:00 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:00 smithi136 ceph-mon[34840]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:00 smithi136 ceph-mon[34840]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T09:34:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:00 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:02.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:01 smithi171 ceph-mon[35803]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:34:02.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:01 smithi171 ceph-mon[35803]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T09:34:02.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:01 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:02.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:01 smithi136 ceph-mon[34840]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:34:02.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:01 smithi136 ceph-mon[34840]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T09:34:02.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:01 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:01 smithi042 ceph-mon[31223]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:34:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:01 smithi042 ceph-mon[31223]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T09:34:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:01 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:04.141 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:03 smithi042 ceph-mon[31223]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T09:34:04.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:03 smithi171 ceph-mon[35803]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T09:34:04.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:03 smithi136 ceph-mon[34840]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T09:34:06.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:05 smithi042 ceph-mon[31223]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:34:06.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:05 smithi171 ceph-mon[35803]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:34:06.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:05 smithi136 ceph-mon[34840]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:34:07.240 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:34:07.241 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:07.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:34:07.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:07.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:34:07.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:08.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:07 smithi042 ceph-mon[31223]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T09:34:08.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:07 smithi042 ceph-mon[31223]: Deploying daemon osd.6 on smithi042 2024-09-19T09:34:08.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:07 smithi171 ceph-mon[35803]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T09:34:08.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:07 smithi171 ceph-mon[35803]: Deploying daemon osd.6 on smithi042 2024-09-19T09:34:08.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:07 smithi136 ceph-mon[34840]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T09:34:08.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:07 smithi136 ceph-mon[34840]: Deploying daemon osd.6 on smithi042 2024-09-19T09:34:10.143 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:09 smithi042 ceph-mon[31223]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T09:34:10.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:09 smithi171 ceph-mon[35803]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T09:34:10.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:09 smithi136 ceph-mon[34840]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T09:34:12.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:11 smithi042 ceph-mon[31223]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:11 smithi171 ceph-mon[35803]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:11 smithi136 ceph-mon[34840]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:13.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:12 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:13.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:12 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:13.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:12 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:13.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:12 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:13.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:12 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:13.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:12 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:13.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:12 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:12 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:12 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:14.274 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:13 smithi042 ceph-mon[31223]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:14.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:13 smithi171 ceph-mon[35803]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:14.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:13 smithi136 ceph-mon[34840]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:16.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.010+0000 7feddbfff640 1 -- 172.21.15.42:0/4078323818 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fedf4062630 con 0x7feddc0a3240 2024-09-19T09:34:16.012 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 6 on host 'smithi042' 2024-09-19T09:34:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 -- 172.21.15.42:0/4078323818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feddc0a3240 msgr2=0x7feddc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feddc0a3240 0x7feddc0a5700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fede4007ec0 tx=0x7fede40075b0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 -- 172.21.15.42:0/4078323818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fedf4104f90 msgr2=0x7fedf4100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fedf4104f90 0x7fedf4100610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fede800d740 tx=0x7fede800dc00 comp rx=0 tx=0).stop 2024-09-19T09:34:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 -- 172.21.15.42:0/4078323818 shutdown_connections 2024-09-19T09:34:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feddc0a3240 0x7feddc0a5700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf41078c0 0x7fedf4100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fedf4104f90 0x7fedf4100610 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 --2- 172.21.15.42:0/4078323818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedf4102660 0x7fedf4101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 -- 172.21.15.42:0/4078323818 >> 172.21.15.42:0/4078323818 conn(0x7fedf40fc280 msgr2=0x7fedf4102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:16.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.012+0000 7fedf9473640 1 -- 172.21.15.42:0/4078323818 shutdown_connections 2024-09-19T09:34:16.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:34:16.013+0000 7fedf9473640 1 -- 172.21.15.42:0/4078323818 wait complete. 2024-09-19T09:34:16.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:16 smithi042 ceph-mon[31223]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:16.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:16 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:16 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:16 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:16.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:16 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:16.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:16 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:16 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:16.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:16 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.327 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:16 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:16 smithi171 ceph-mon[35803]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:16.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:16 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:16 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:16 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:16.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:16 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:16.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:16 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:16 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:16.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:16 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:16 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:16 smithi136 ceph-mon[34840]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:16.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:16 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:16 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:16 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:16.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:16 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:16.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:16 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:16 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:16.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:16 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:16 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:16.672 DEBUG:teuthology.orchestra.run.smithi042:osd.6> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T09:34:16.675 INFO:tasks.cephadm:Deploying osd.7 on smithi136 with /dev/vg_nvme/lv_2... 2024-09-19T09:34:16.675 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:34:16.930 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:34:18.260 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:18 smithi136 ceph-mon[34840]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:18.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:18 smithi042 ceph-mon[31223]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:18.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:18 smithi171 ceph-mon[35803]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:19.094 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:34:18 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:34:18.836+0000 7f0318228640 -1 osd.6 0 log_to_monitors true 2024-09-19T09:34:19.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:19 smithi136 ceph-mon[34840]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:34:19.394 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:34:19.420 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_2 2024-09-19T09:34:19.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:19 smithi042 ceph-mon[31223]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:34:19.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:19 smithi171 ceph-mon[35803]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:34:19.676 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:34:20.111 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.103+0000 7f3161b43640 1 -- 172.21.15.136:0/3103924732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c1078c0 msgr2=0x7f315c109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:20.111 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.103+0000 7f3161b43640 1 --2- 172.21.15.136:0/3103924732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c1078c0 0x7f315c109d10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3154009ca0 tx=0x7f315402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:34:20.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.103+0000 7f3161b43640 1 -- 172.21.15.136:0/3103924732 shutdown_connections 2024-09-19T09:34:20.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.103+0000 7f3161b43640 1 --2- 172.21.15.136:0/3103924732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c1078c0 0x7f315c109d10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:20.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.103+0000 7f3161b43640 1 --2- 172.21.15.136:0/3103924732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315c104f90 0x7f315c107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:20.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.103+0000 7f3161b43640 1 --2- 172.21.15.136:0/3103924732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c102660 0x7f315c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:20.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.103+0000 7f3161b43640 1 -- 172.21.15.136:0/3103924732 >> 172.21.15.136:0/3103924732 conn(0x7f315c0fc280 msgr2=0x7f315c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:20.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.103+0000 7f3161b43640 1 -- 172.21.15.136:0/3103924732 shutdown_connections 2024-09-19T09:34:20.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.103+0000 7f3161b43640 1 -- 172.21.15.136:0/3103924732 wait complete. 2024-09-19T09:34:20.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f3161b43640 1 Processor -- start 2024-09-19T09:34:20.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f3161b43640 1 -- start start 2024-09-19T09:34:20.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f3161b43640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c102660 0x7f315c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f3161b43640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315c104f90 0x7f315c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f3161b43640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c1078c0 0x7f315c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f3161b43640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f315c10d880 con 0x7f315c104f90 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f3161b43640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f315c10d700 con 0x7f315c102660 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f3161b43640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f315c10da00 con 0x7f315c1078c0 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f315b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c102660 0x7f315c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f315b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c102660 0x7f315c197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58062/0 (socket says 172.21.15.136:58062) 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f315b7fe640 1 -- 172.21.15.136:0/2415335623 learned_addr learned my addr 172.21.15.136:0/2415335623 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.104+0000 7f315affd640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315c104f90 0x7f315c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f315bfff640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c1078c0 0x7f315c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f315b7fe640 1 -- 172.21.15.136:0/2415335623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c1078c0 msgr2=0x7f315c19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:20.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f315b7fe640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c1078c0 0x7f315c19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f315b7fe640 1 -- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315c104f90 msgr2=0x7f315c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f315b7fe640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315c104f90 0x7f315c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f315b7fe640 1 -- 172.21.15.136:0/2415335623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c19fb00 con 0x7f315c102660 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f315bfff640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c1078c0 0x7f315c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f315affd640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315c104f90 0x7f315c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f315b7fe640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c102660 0x7f315c197ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f314c00e9f0 tx=0x7f314c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f3158ff9640 1 -- 172.21.15.136:0/2415335623 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c00cd80 con 0x7f315c102660 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f3161b43640 1 -- 172.21.15.136:0/2415335623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c19fdf0 con 0x7f315c102660 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f3158ff9640 1 -- 172.21.15.136:0/2415335623 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f314c005500 con 0x7f315c102660 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f3158ff9640 1 -- 172.21.15.136:0/2415335623 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c010690 con 0x7f315c102660 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.105+0000 7f3161b43640 1 -- 172.21.15.136:0/2415335623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c1a0240 con 0x7f315c102660 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.106+0000 7f3161b43640 1 -- 172.21.15.136:0/2415335623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c0fdd70 con 0x7f315c102660 2024-09-19T09:34:20.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.107+0000 7f3158ff9640 1 -- 172.21.15.136:0/2415335623 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f314c0046c0 con 0x7f315c102660 2024-09-19T09:34:20.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.108+0000 7f3158ff9640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31440a3270 0x7f31440a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:20.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.108+0000 7f3158ff9640 1 -- 172.21.15.136:0/2415335623 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4669+0+0 (secure 0 0 0) 0x7f314c0cf020 con 0x7f315c102660 2024-09-19T09:34:20.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.108+0000 7f315affd640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31440a3270 0x7f31440a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:20.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.109+0000 7f315affd640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31440a3270 0x7f31440a5730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f31500058c0 tx=0x7f3150005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:20.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.112+0000 7f3158ff9640 1 -- 172.21.15.136:0/2415335623 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f314c09cb80 con 0x7f315c102660 2024-09-19T09:34:20.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:20.312+0000 7f3161b43640 1 -- 172.21.15.136:0/2415335623 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f315c062630 con 0x7f31440a3270 2024-09-19T09:34:20.314 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:20.314 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:34:20.314 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:34:20.314 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:34:20.315 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:20.315 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.315 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.315 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:20.315 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:20.315 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:20.315 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.315 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:20.315 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:20.315 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.454 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:34:20.178+0000 7f0313988640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T09:34:20.454 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:34:20.189+0000 7f030ffc2640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:20.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:34:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:34:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:34:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:21 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi042 2024-09-19T09:34:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:21 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi042 to 5697M 2024-09-19T09:34:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:21 smithi136 ceph-mon[34840]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:34:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:21 smithi136 ceph-mon[34840]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:34:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:21 smithi136 ceph-mon[34840]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:21.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:21.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:21.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:21 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi042 2024-09-19T09:34:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:21 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi042 to 5697M 2024-09-19T09:34:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:21 smithi042 ceph-mon[31223]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:34:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:21 smithi042 ceph-mon[31223]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:34:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:21 smithi042 ceph-mon[31223]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:21 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi042 2024-09-19T09:34:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:21 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi042 to 5697M 2024-09-19T09:34:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:21 smithi171 ceph-mon[35803]: from='osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:34:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:21 smithi171 ceph-mon[35803]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:34:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:21 smithi171 ceph-mon[35803]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:22.327 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:22 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:34:22.327 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:22 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:34:22.327 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:22 smithi136 ceph-mon[34840]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:22.328 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:22 smithi136 ceph-mon[34840]: osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] boot 2024-09-19T09:34:22.328 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:22 smithi136 ceph-mon[34840]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T09:34:22.328 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:22 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:22.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:22 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:34:22.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:22 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:34:22.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:22 smithi042 ceph-mon[31223]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:22.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:22 smithi042 ceph-mon[31223]: osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] boot 2024-09-19T09:34:22.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:22 smithi042 ceph-mon[31223]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T09:34:22.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:22 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:22 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:34:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:22 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:34:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:22 smithi171 ceph-mon[35803]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:34:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:22 smithi171 ceph-mon[35803]: osd.6 [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] boot 2024-09-19T09:34:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:22 smithi171 ceph-mon[35803]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T09:34:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:22 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:34:23.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:23 smithi042 ceph-mon[31223]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T09:34:23.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:23 smithi042 ceph-mon[31223]: from='client.? 172.21.15.136:0/2342076971' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9db03bdf-bab4-45b9-98af-9a827cd5f52a"}]: dispatch 2024-09-19T09:34:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:23 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9db03bdf-bab4-45b9-98af-9a827cd5f52a"}]: dispatch 2024-09-19T09:34:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:23 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9db03bdf-bab4-45b9-98af-9a827cd5f52a"}]': finished 2024-09-19T09:34:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:23 smithi042 ceph-mon[31223]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T09:34:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:23 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:23.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:23 smithi171 ceph-mon[35803]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T09:34:23.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:23 smithi171 ceph-mon[35803]: from='client.? 172.21.15.136:0/2342076971' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9db03bdf-bab4-45b9-98af-9a827cd5f52a"}]: dispatch 2024-09-19T09:34:23.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:23 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9db03bdf-bab4-45b9-98af-9a827cd5f52a"}]: dispatch 2024-09-19T09:34:23.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:23 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9db03bdf-bab4-45b9-98af-9a827cd5f52a"}]': finished 2024-09-19T09:34:23.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:23 smithi171 ceph-mon[35803]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T09:34:23.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:23 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:23.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:23 smithi136 ceph-mon[34840]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T09:34:23.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:23 smithi136 ceph-mon[34840]: from='client.? 172.21.15.136:0/2342076971' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9db03bdf-bab4-45b9-98af-9a827cd5f52a"}]: dispatch 2024-09-19T09:34:23.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:23 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9db03bdf-bab4-45b9-98af-9a827cd5f52a"}]: dispatch 2024-09-19T09:34:23.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:23 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9db03bdf-bab4-45b9-98af-9a827cd5f52a"}]': finished 2024-09-19T09:34:23.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:23 smithi136 ceph-mon[34840]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T09:34:23.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:23 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:24.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:24 smithi042 ceph-mon[31223]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:24.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:24 smithi042 ceph-mon[31223]: from='client.? 172.21.15.136:0/3006402274' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:24.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:24 smithi171 ceph-mon[35803]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:24.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:24 smithi171 ceph-mon[35803]: from='client.? 172.21.15.136:0/3006402274' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:24.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:24 smithi136 ceph-mon[34840]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:24.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:24 smithi136 ceph-mon[34840]: from='client.? 172.21.15.136:0/3006402274' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:26.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:26 smithi042 ceph-mon[31223]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:26.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:26 smithi171 ceph-mon[35803]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:26.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:26 smithi136 ceph-mon[34840]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:28 smithi136 ceph-mon[34840]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:28.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:28 smithi171 ceph-mon[35803]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:28.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:28 smithi042 ceph-mon[31223]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:30.348 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:30 smithi136 ceph-mon[34840]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:30.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:30 smithi171 ceph-mon[35803]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:30.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:30 smithi042 ceph-mon[31223]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:32.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:32 smithi136 ceph-mon[34840]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:34:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:32 smithi136 ceph-mon[34840]: Deploying daemon osd.7 on smithi136 2024-09-19T09:34:32.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:32 smithi171 ceph-mon[35803]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:32.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:34:32.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:32.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:32 smithi171 ceph-mon[35803]: Deploying daemon osd.7 on smithi136 2024-09-19T09:34:32.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:32 smithi042 ceph-mon[31223]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:32.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:34:32.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:32.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:32 smithi042 ceph-mon[31223]: Deploying daemon osd.7 on smithi136 2024-09-19T09:34:34.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:34 smithi136 ceph-mon[34840]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:34.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:34 smithi171 ceph-mon[35803]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:34.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:34 smithi042 ceph-mon[31223]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:36.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:36 smithi136 ceph-mon[34840]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:36.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:36 smithi171 ceph-mon[35803]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:36.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:36 smithi042 ceph-mon[31223]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:37.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:37 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:37.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:37 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:37.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:37 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:37.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:37 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:37.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:37 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:37.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:37 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:37.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:37.760 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:37.760 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:37 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:38.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:38 smithi171 ceph-mon[35803]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:38 smithi136 ceph-mon[34840]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:38 smithi042 ceph-mon[31223]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:40.353 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:40 smithi136 ceph-mon[34840]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:40.354 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:40 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:40.354 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:40 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:40.354 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:40 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:40.354 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:40 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:40.354 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:40 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:40.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:40 smithi171 ceph-mon[35803]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:40.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:40 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:40.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:40 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:40.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:40 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:40.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:40 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:40.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:40 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:40.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.669+0000 7f3158ff9640 1 -- 172.21.15.136:0/2415335623 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f315c062630 con 0x7f31440a3270 2024-09-19T09:34:40.671 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 7 on host 'smithi136' 2024-09-19T09:34:40.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.671+0000 7f3161b43640 1 -- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31440a3270 msgr2=0x7f31440a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:40.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.671+0000 7f3161b43640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31440a3270 0x7f31440a5730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f31500058c0 tx=0x7f3150005850 comp rx=0 tx=0).stop 2024-09-19T09:34:40.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.671+0000 7f3161b43640 1 -- 172.21.15.136:0/2415335623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c102660 msgr2=0x7f315c197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:40.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.671+0000 7f3161b43640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c102660 0x7f315c197ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f314c00e9f0 tx=0x7f314c00edf0 comp rx=0 tx=0).stop 2024-09-19T09:34:40.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.671+0000 7f3161b43640 1 -- 172.21.15.136:0/2415335623 shutdown_connections 2024-09-19T09:34:40.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.671+0000 7f3161b43640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31440a3270 0x7f31440a5730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:40.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.671+0000 7f3161b43640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c1078c0 0x7f315c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:40.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.671+0000 7f3161b43640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315c104f90 0x7f315c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:40.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.671+0000 7f3161b43640 1 --2- 172.21.15.136:0/2415335623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f315c102660 0x7f315c197ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:40.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.671+0000 7f3161b43640 1 -- 172.21.15.136:0/2415335623 >> 172.21.15.136:0/2415335623 conn(0x7f315c0fc280 msgr2=0x7f315c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:40.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.672+0000 7f3161b43640 1 -- 172.21.15.136:0/2415335623 shutdown_connections 2024-09-19T09:34:40.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:34:40.672+0000 7f3161b43640 1 -- 172.21.15.136:0/2415335623 wait complete. 2024-09-19T09:34:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:40 smithi042 ceph-mon[31223]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:40 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:40 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:40 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:40 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:40 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:41.295 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:41 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:41.296 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:41 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:41.296 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:41 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:41.298 DEBUG:teuthology.orchestra.run.smithi136:osd.7> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T09:34:41.300 INFO:tasks.cephadm:Deploying osd.8 on smithi171 with /dev/vg_nvme/lv_2... 2024-09-19T09:34:41.300 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:34:41.556 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:34:41.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:41 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:41.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:41 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:41.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:41 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:41.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:41 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:41.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:41 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:41.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:41 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:42.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:42 smithi171 ceph-mon[35803]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:42.332 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:42 smithi136 ceph-mon[34840]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:42.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:42 smithi042 ceph-mon[31223]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:43.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:34:43 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:34:43.416+0000 7f433ce21640 -1 osd.7 0 log_to_monitors true 2024-09-19T09:34:43.867 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:34:43.894 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_2 2024-09-19T09:34:44.145 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='osd.7 [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:44.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:44.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.551+0000 7f2354d40640 1 -- 172.21.15.171:0/2329551444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2350102690 msgr2=0x7f2350108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:44.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.551+0000 7f2354d40640 1 --2- 172.21.15.171:0/2329551444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2350102690 0x7f2350108f20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2348009be0 tx=0x7f234802a6c0 comp rx=0 tx=0).stop 2024-09-19T09:34:44.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.552+0000 7f2354d40640 1 -- 172.21.15.171:0/2329551444 shutdown_connections 2024-09-19T09:34:44.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.552+0000 7f2354d40640 1 --2- 172.21.15.171:0/2329551444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2350102690 0x7f2350108f20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:44.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.552+0000 7f2354d40640 1 --2- 172.21.15.171:0/2329551444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350101cd0 0x7f2350102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:44.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.552+0000 7f2354d40640 1 --2- 172.21.15.171:0/2329551444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2350100ad0 0x7f2350100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.552+0000 7f2354d40640 1 -- 172.21.15.171:0/2329551444 >> 172.21.15.171:0/2329551444 conn(0x7f23500fc280 msgr2=0x7f23500fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.552+0000 7f2354d40640 1 -- 172.21.15.171:0/2329551444 shutdown_connections 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.552+0000 7f2354d40640 1 -- 172.21.15.171:0/2329551444 wait complete. 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.552+0000 7f2354d40640 1 Processor -- start 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.552+0000 7f2354d40640 1 -- start start 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f2354d40640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100ad0 0x7f2350197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f2354d40640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2350101cd0 0x7f23501983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f2354d40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2350102690 0x7f235019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f2354d40640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f235010c700 con 0x7f2350102690 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f2354d40640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f235010c580 con 0x7f2350100ad0 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f2354d40640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f235010c880 con 0x7f2350101cd0 2024-09-19T09:34:44.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f234dd9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2350101cd0 0x7f23501983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f234dd9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2350101cd0 0x7f23501983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:49772/0 (socket says 172.21.15.171:49772) 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f234dd9b640 1 -- 172.21.15.171:0/4085188776 learned_addr learned my addr 172.21.15.171:0/4085188776 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f234e59c640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100ad0 0x7f2350197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f234dd9b640 1 -- 172.21.15.171:0/4085188776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100ad0 msgr2=0x7f2350197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f234dd9b640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100ad0 0x7f2350197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f234dd9b640 1 -- 172.21.15.171:0/4085188776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2350102690 msgr2=0x7f235019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f234dd9b640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2350102690 0x7f235019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f234dd9b640 1 -- 172.21.15.171:0/4085188776 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235019fad0 con 0x7f2350101cd0 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f234dd9b640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2350101cd0 0x7f23501983e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f234400e9f0 tx=0x7f234400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f233f7fe640 1 -- 172.21.15.171:0/4085188776 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234400ccc0 con 0x7f2350101cd0 2024-09-19T09:34:44.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f2354d40640 1 -- 172.21.15.171:0/4085188776 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235019fdc0 con 0x7f2350101cd0 2024-09-19T09:34:44.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f233f7fe640 1 -- 172.21.15.171:0/4085188776 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2344005500 con 0x7f2350101cd0 2024-09-19T09:34:44.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.553+0000 7f233f7fe640 1 -- 172.21.15.171:0/4085188776 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344010690 con 0x7f2350101cd0 2024-09-19T09:34:44.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.554+0000 7f2354d40640 1 -- 172.21.15.171:0/4085188776 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23501a0220 con 0x7f2350101cd0 2024-09-19T09:34:44.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.555+0000 7f2354d40640 1 -- 172.21.15.171:0/4085188776 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23501a04e0 con 0x7f2350101cd0 2024-09-19T09:34:44.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.556+0000 7f233f7fe640 1 -- 172.21.15.171:0/4085188776 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f23440046c0 con 0x7f2350101cd0 2024-09-19T09:34:44.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.556+0000 7f233f7fe640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f23380a3270 0x7f23380a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:44.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.557+0000 7f233f7fe640 1 -- 172.21.15.171:0/4085188776 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5101+0+0 (secure 0 0 0) 0x7f23440cf040 con 0x7f2350101cd0 2024-09-19T09:34:44.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.557+0000 7f234e59c640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f23380a3270 0x7f23380a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:44.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.557+0000 7f234e59c640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f23380a3270 0x7f23380a5730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2350101b30 tx=0x7f2340005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:44.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.561+0000 7f233f7fe640 1 -- 172.21.15.171:0/4085188776 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f234409c9f0 con 0x7f2350101cd0 2024-09-19T09:34:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='osd.7 [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:34:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:34:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:44.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='osd.7 [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:34:44.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:34:44.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:34:44.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:34:44.735+0000 7f2354d40640 1 -- 172.21.15.171:0/4085188776 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f23501a06b0 con 0x7f23380a3270 2024-09-19T09:34:45.453 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:45 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi136 2024-09-19T09:34:45.453 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:45 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi136 to 5696M 2024-09-19T09:34:45.453 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:45 smithi171 ceph-mon[35803]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:34:45.454 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:45 smithi171 ceph-mon[35803]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T09:34:45.454 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:45.454 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:45 smithi171 ceph-mon[35803]: from='osd.7 [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:34:45.454 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:45 smithi171 ceph-mon[35803]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:34:45.454 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:45.454 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:45.454 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:45.634 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:34:45.254+0000 7f4338581640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T09:34:45.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:34:45.267+0000 7f4334bbb640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:34:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi136 2024-09-19T09:34:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi136 to 5696M 2024-09-19T09:34:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-mon[34840]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:34:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-mon[34840]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T09:34:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-mon[34840]: from='osd.7 [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:34:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-mon[34840]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:34:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:45.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:45 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi136 2024-09-19T09:34:45.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:45 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi136 to 5696M 2024-09-19T09:34:45.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:45 smithi042 ceph-mon[31223]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:34:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:45 smithi042 ceph-mon[31223]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T09:34:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:45 smithi042 ceph-mon[31223]: from='osd.7 [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:34:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:45 smithi042 ceph-mon[31223]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:34:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:45.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:46.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:46 smithi171 ceph-mon[35803]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:46.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:46 smithi171 ceph-mon[35803]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:46.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:46 smithi171 ceph-mon[35803]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:34:46.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:46 smithi171 ceph-mon[35803]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T09:34:46.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:46.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:46.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:46 smithi171 ceph-mon[35803]: osd.7 [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] boot 2024-09-19T09:34:46.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:46 smithi171 ceph-mon[35803]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T09:34:46.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:46 smithi136 ceph-mon[34840]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:46 smithi136 ceph-mon[34840]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:46 smithi136 ceph-mon[34840]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:34:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:46 smithi136 ceph-mon[34840]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T09:34:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:46 smithi136 ceph-mon[34840]: osd.7 [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] boot 2024-09-19T09:34:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:46 smithi136 ceph-mon[34840]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T09:34:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:46.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:46 smithi042 ceph-mon[31223]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:34:46.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:46 smithi042 ceph-mon[31223]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:46.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:46 smithi042 ceph-mon[31223]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:34:46.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:46 smithi042 ceph-mon[31223]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T09:34:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:46 smithi042 ceph-mon[31223]: osd.7 [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] boot 2024-09-19T09:34:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:46 smithi042 ceph-mon[31223]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T09:34:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:47 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:47 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:47 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/501808431' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d24baff-7b48-42e7-8de3-c63bae1df94d"}]: dispatch 2024-09-19T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:47 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d24baff-7b48-42e7-8de3-c63bae1df94d"}]: dispatch 2024-09-19T09:34:47.511 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:47 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d24baff-7b48-42e7-8de3-c63bae1df94d"}]': finished 2024-09-19T09:34:47.512 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:47 smithi171 ceph-mon[35803]: osdmap e47: 9 total, 8 up, 9 in 2024-09-19T09:34:47.512 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:47 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:47.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:47 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:34:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:47 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:34:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:47 smithi136 ceph-mon[34840]: from='client.? 172.21.15.171:0/501808431' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d24baff-7b48-42e7-8de3-c63bae1df94d"}]: dispatch 2024-09-19T09:34:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:47 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d24baff-7b48-42e7-8de3-c63bae1df94d"}]: dispatch 2024-09-19T09:34:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:47 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d24baff-7b48-42e7-8de3-c63bae1df94d"}]': finished 2024-09-19T09:34:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:47 smithi136 ceph-mon[34840]: osdmap e47: 9 total, 8 up, 9 in 2024-09-19T09:34:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:47 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:47.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:47 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:34:47.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:47 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:34:47.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:47 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/501808431' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d24baff-7b48-42e7-8de3-c63bae1df94d"}]: dispatch 2024-09-19T09:34:47.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:47 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d24baff-7b48-42e7-8de3-c63bae1df94d"}]: dispatch 2024-09-19T09:34:47.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:47 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d24baff-7b48-42e7-8de3-c63bae1df94d"}]': finished 2024-09-19T09:34:47.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:47 smithi042 ceph-mon[31223]: osdmap e47: 9 total, 8 up, 9 in 2024-09-19T09:34:47.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:48.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:48 smithi171 ceph-mon[35803]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:48 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/4119553381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:48 smithi171 ceph-mon[35803]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T09:34:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:48 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:48.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:48 smithi136 ceph-mon[34840]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:48 smithi136 ceph-mon[34840]: from='client.? 172.21.15.171:0/4119553381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:48 smithi136 ceph-mon[34840]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T09:34:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:48 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:48.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:48 smithi042 ceph-mon[31223]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:48.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:48 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/4119553381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:48.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:48 smithi042 ceph-mon[31223]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T09:34:48.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:48 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:50.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:49 smithi171 ceph-mon[35803]: pgmap v169: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:50.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:49 smithi171 ceph-mon[35803]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T09:34:50.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:50.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:49 smithi136 ceph-mon[34840]: pgmap v169: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:50.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:49 smithi136 ceph-mon[34840]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T09:34:50.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:49 smithi042 ceph-mon[31223]: pgmap v169: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:49 smithi042 ceph-mon[31223]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T09:34:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:51.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:50 smithi171 ceph-mon[35803]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T09:34:51.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:50 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:50 smithi136 ceph-mon[34840]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T09:34:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:50 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:51.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:50 smithi042 ceph-mon[31223]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T09:34:51.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:50 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:52.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:51 smithi171 ceph-mon[35803]: pgmap v172: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:52.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:51 smithi136 ceph-mon[34840]: pgmap v172: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:52.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:51 smithi042 ceph-mon[31223]: pgmap v172: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:54.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:53 smithi042 ceph-mon[31223]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:54.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:53 smithi171 ceph-mon[35803]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:54.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:53 smithi136 ceph-mon[34840]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:56.200 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:55 smithi171 ceph-mon[35803]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:56.200 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:34:56.200 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:55 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:56.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:55 smithi136 ceph-mon[34840]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:56.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:34:56.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:55 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:56.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:55 smithi042 ceph-mon[31223]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:56.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:34:56.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:55 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:57.262 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:57 smithi171 ceph-mon[35803]: Deploying daemon osd.8 on smithi171 2024-09-19T09:34:57.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:57 smithi136 ceph-mon[34840]: Deploying daemon osd.8 on smithi171 2024-09-19T09:34:57.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:57 smithi042 ceph-mon[31223]: Deploying daemon osd.8 on smithi171 2024-09-19T09:34:58.246 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:34:58 smithi171 ceph-mon[35803]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:58.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:34:58 smithi136 ceph-mon[34840]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:58.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:34:58 smithi042 ceph-mon[31223]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:00.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:00 smithi171 ceph-mon[35803]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:00.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:00 smithi136 ceph-mon[34840]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:00.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:00 smithi042 ceph-mon[31223]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:02.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:02 smithi171 ceph-mon[35803]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:02.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:02 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:02.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:02 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:02.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:02 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:02.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:02 smithi136 ceph-mon[34840]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:02.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:02 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:02.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:02 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:02.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:02 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:02 smithi042 ceph-mon[31223]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:02 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:02 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:02 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:04.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:04 smithi171 ceph-mon[35803]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:04.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.317+0000 7f233f7fe640 1 -- 172.21.15.171:0/4085188776 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f23501a06b0 con 0x7f23380a3270 2024-09-19T09:35:04.319 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 8 on host 'smithi171' 2024-09-19T09:35:04.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 -- 172.21.15.171:0/4085188776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f23380a3270 msgr2=0x7f23380a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:04.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f23380a3270 0x7f23380a5730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2350101b30 tx=0x7f2340005f90 comp rx=0 tx=0).stop 2024-09-19T09:35:04.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 -- 172.21.15.171:0/4085188776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2350101cd0 msgr2=0x7f23501983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:04.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2350101cd0 0x7f23501983e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f234400e9f0 tx=0x7f234400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:35:04.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 -- 172.21.15.171:0/4085188776 shutdown_connections 2024-09-19T09:35:04.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f23380a3270 0x7f23380a5730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:04.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2350102690 0x7f235019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:04.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2350101cd0 0x7f23501983e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:04.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 --2- 172.21.15.171:0/4085188776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100ad0 0x7f2350197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:04.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 -- 172.21.15.171:0/4085188776 >> 172.21.15.171:0/4085188776 conn(0x7f23500fc280 msgr2=0x7f2350069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:04.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 -- 172.21.15.171:0/4085188776 shutdown_connections 2024-09-19T09:35:04.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:04.320+0000 7f2354d40640 1 -- 172.21.15.171:0/4085188776 wait complete. 2024-09-19T09:35:04.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:04 smithi136 ceph-mon[34840]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:04.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:04 smithi042 ceph-mon[31223]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:04.945 DEBUG:teuthology.orchestra.run.smithi171:osd.8> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T09:35:04.947 INFO:tasks.cephadm:Deploying osd.9 on smithi042 with /dev/vg_nvme/lv_1... 2024-09-19T09:35:04.947 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:35:05.220 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:05.566 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.567 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.567 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.567 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:05 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.626 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.627 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.627 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.627 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:05 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:05 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:05 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:05 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:05.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:05 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:06.481 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:06 smithi171 ceph-mon[35803]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:06.583 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:06 smithi042 ceph-mon[31223]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:06.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:06 smithi136 ceph-mon[34840]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:07.325 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:35:07 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:35:07.014+0000 7f8225307640 -1 osd.8 0 log_to_monitors true 2024-09-19T09:35:07.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:07 smithi042 ceph-mon[31223]: from='osd.8 [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:35:07.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:07 smithi042 ceph-mon[31223]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:35:07.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:07 smithi171 ceph-mon[35803]: from='osd.8 [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:35:07.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:07 smithi171 ceph-mon[35803]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:35:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:07 smithi136 ceph-mon[34840]: from='osd.8 [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:35:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:07 smithi136 ceph-mon[34840]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:35:07.838 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:35:07.867 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi042:vg_nvme/lv_1 2024-09-19T09:35:08.124 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:08.549 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:08.611 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:35:08.611 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:35:08.611 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:08.611 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='osd.8 [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:35:08.611 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:08.612 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:08.613 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.614 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:08.614 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:35:08.614 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:35:08.614 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:08.614 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='osd.8 [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:35:08.614 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:35:08.614 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.614 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.615 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:08.615 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:08.615 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:08.615 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.615 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:08.615 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:08.615 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.615 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:08.615 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:08.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:08.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.548+0000 7fb2f59da640 1 -- 172.21.15.42:0/1551019620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2f0100b00 msgr2=0x7fb2f0100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.548+0000 7fb2f59da640 1 --2- 172.21.15.42:0/1551019620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2f0100b00 0x7fb2f0100f00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009900 tx=0x7fb2e002a410 comp rx=0 tx=0).stop 2024-09-19T09:35:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.548+0000 7fb2f59da640 1 -- 172.21.15.42:0/1551019620 shutdown_connections 2024-09-19T09:35:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.548+0000 7fb2f59da640 1 --2- 172.21.15.42:0/1551019620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2f01026c0 0x7fb2f0108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.548+0000 7fb2f59da640 1 --2- 172.21.15.42:0/1551019620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2f0101d00 0x7fb2f0102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.548+0000 7fb2f59da640 1 --2- 172.21.15.42:0/1551019620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2f0100b00 0x7fb2f0100f00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.548+0000 7fb2f59da640 1 -- 172.21.15.42:0/1551019620 >> 172.21.15.42:0/1551019620 conn(0x7fb2f00fc270 msgr2=0x7fb2f00fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.548+0000 7fb2f59da640 1 -- 172.21.15.42:0/1551019620 shutdown_connections 2024-09-19T09:35:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.548+0000 7fb2f59da640 1 -- 172.21.15.42:0/1551019620 wait complete. 2024-09-19T09:35:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.549+0000 7fb2f59da640 1 Processor -- start 2024-09-19T09:35:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.549+0000 7fb2f59da640 1 -- start start 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2f59da640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2f0100b00 0x7fb2f0197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2f59da640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2f0101d00 0x7fb2f01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2f59da640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2f01026c0 0x7fb2f019f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2f59da640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f010c790 con 0x7fb2f0100b00 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2f59da640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f010c610 con 0x7fb2f0101d00 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2f59da640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f010c910 con 0x7fb2f01026c0 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2eeffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2f0100b00 0x7fb2f0197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2eeffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2f0100b00 0x7fb2f0197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53520/0 (socket says 172.21.15.42:53520) 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2eeffd640 1 -- 172.21.15.42:0/3566393031 learned_addr learned my addr 172.21.15.42:0/3566393031 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2ef7fe640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2f01026c0 0x7fb2f019f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2ee7fc640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2f0101d00 0x7fb2f01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2eeffd640 1 -- 172.21.15.42:0/3566393031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2f01026c0 msgr2=0x7fb2f019f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2eeffd640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2f01026c0 0x7fb2f019f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2eeffd640 1 -- 172.21.15.42:0/3566393031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2f0101d00 msgr2=0x7fb2f01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2eeffd640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2f0101d00 0x7fb2f01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2eeffd640 1 -- 172.21.15.42:0/3566393031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f019fbc0 con 0x7fb2f0100b00 2024-09-19T09:35:08.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2eeffd640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2f0100b00 0x7fb2f0197f90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006010 tx=0x7fb2e0031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.550+0000 7fb2f49d8640 1 -- 172.21.15.42:0/3566393031 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e003f030 con 0x7fb2f0100b00 2024-09-19T09:35:08.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.551+0000 7fb2f49d8640 1 -- 172.21.15.42:0/3566393031 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e00044a0 con 0x7fb2f0100b00 2024-09-19T09:35:08.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.551+0000 7fb2f49d8640 1 -- 172.21.15.42:0/3566393031 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0035070 con 0x7fb2f0100b00 2024-09-19T09:35:08.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.551+0000 7fb2f59da640 1 -- 172.21.15.42:0/3566393031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f019fe50 con 0x7fb2f0100b00 2024-09-19T09:35:08.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.551+0000 7fb2f59da640 1 -- 172.21.15.42:0/3566393031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f01a02a0 con 0x7fb2f0100b00 2024-09-19T09:35:08.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.552+0000 7fb2f59da640 1 -- 172.21.15.42:0/3566393031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f01a0520 con 0x7fb2f0100b00 2024-09-19T09:35:08.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.553+0000 7fb2f49d8640 1 -- 172.21.15.42:0/3566393031 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb2e0042030 con 0x7fb2f0100b00 2024-09-19T09:35:08.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.554+0000 7fb2f49d8640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2d80a32f0 0x7fb2d80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.554+0000 7fb2ee7fc640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2d80a32f0 0x7fb2d80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.554+0000 7fb2f49d8640 1 -- 172.21.15.42:0/3566393031 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5549+0+0 (secure 0 0 0) 0x7fb2e00ef4f0 con 0x7fb2f0100b00 2024-09-19T09:35:08.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.554+0000 7fb2ee7fc640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2d80a32f0 0x7fb2d80a57b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb2f01994b0 tx=0x7fb2e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.557+0000 7fb2f49d8640 1 -- 172.21.15.42:0/3566393031 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2e00bc5f0 con 0x7fb2f0100b00 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='osd.8 [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:08.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:08.742+0000 7fb2f59da640 1 -- 172.21.15.42:0/3566393031 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb2f01a07b0 con 0x7fb2d80a32f0 2024-09-19T09:35:09.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:09 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi171 2024-09-19T09:35:09.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:09 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi171 to 5696M 2024-09-19T09:35:09.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:09 smithi042 ceph-mon[31223]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:35:09.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:09 smithi042 ceph-mon[31223]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:35:09.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:09 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:09.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:09 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:09.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:09 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:35:09.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:09 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:35:09.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:09 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:09.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:09 smithi042 ceph-mon[31223]: from='osd.8 ' entity='osd.8' 2024-09-19T09:35:09.597 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:35:09.134+0000 7f8220a67640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T09:35:09.597 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:35:09.147+0000 7f8219099640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:35:09.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi171 2024-09-19T09:35:09.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi171 to 5696M 2024-09-19T09:35:09.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-mon[35803]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:35:09.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-mon[35803]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:35:09.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:09.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:09.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:35:09.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:35:09.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:09.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:09 smithi171 ceph-mon[35803]: from='osd.8 ' entity='osd.8' 2024-09-19T09:35:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:09 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi171 2024-09-19T09:35:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:09 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi171 to 5696M 2024-09-19T09:35:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:09 smithi136 ceph-mon[34840]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:35:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:09 smithi136 ceph-mon[34840]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:35:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:09 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:09 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:09 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:35:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:09 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:35:09.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:09 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:09.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:09 smithi136 ceph-mon[34840]: from='osd.8 ' entity='osd.8' 2024-09-19T09:35:10.349 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:10 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:35:10.349 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:10 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:35:10.349 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:10 smithi042 ceph-mon[31223]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:10.349 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:10 smithi042 ceph-mon[31223]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:10.349 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:10.349 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:10 smithi042 ceph-mon[31223]: osd.8 [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] boot 2024-09-19T09:35:10.350 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:10 smithi042 ceph-mon[31223]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T09:35:10.350 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:10.350 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:10 smithi042 ceph-mon[31223]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T09:35:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:10 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:35:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:10 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:35:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:10 smithi171 ceph-mon[35803]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:10 smithi171 ceph-mon[35803]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:10 smithi171 ceph-mon[35803]: osd.8 [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] boot 2024-09-19T09:35:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:10 smithi171 ceph-mon[35803]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T09:35:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:10 smithi171 ceph-mon[35803]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T09:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:10 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:10 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:10 smithi136 ceph-mon[34840]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:10 smithi136 ceph-mon[34840]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:10 smithi136 ceph-mon[34840]: osd.8 [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] boot 2024-09-19T09:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:10 smithi136 ceph-mon[34840]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T09:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:10 smithi136 ceph-mon[34840]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T09:35:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:11 smithi171 ceph-mon[35803]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:11 smithi171 ceph-mon[35803]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:35:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:11 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/758183169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef"}]: dispatch 2024-09-19T09:35:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:11 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/758183169' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef"}]': finished 2024-09-19T09:35:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:11 smithi171 ceph-mon[35803]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T09:35:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:11 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:11 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/378302516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:35:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:11 smithi136 ceph-mon[34840]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:11 smithi136 ceph-mon[34840]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:35:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:11 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/758183169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef"}]: dispatch 2024-09-19T09:35:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:11 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/758183169' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef"}]': finished 2024-09-19T09:35:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:11 smithi136 ceph-mon[34840]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T09:35:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:11 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:11 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/378302516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:35:12.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:11 smithi042 ceph-mon[31223]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:12.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:11 smithi042 ceph-mon[31223]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:35:12.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:11 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/758183169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef"}]: dispatch 2024-09-19T09:35:12.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:11 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/758183169' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef"}]': finished 2024-09-19T09:35:12.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:11 smithi042 ceph-mon[31223]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T09:35:12.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:11 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:12.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:11 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/378302516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:35:13.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:13 smithi136 ceph-mon[34840]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T09:35:13.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:13 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:13.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:13 smithi042 ceph-mon[31223]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T09:35:13.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:13 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:13.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:13 smithi171 ceph-mon[35803]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T09:35:13.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:13 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:14.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:14 smithi171 ceph-mon[35803]: pgmap v190: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T09:35:14.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:14 smithi171 ceph-mon[35803]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T09:35:14.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:14 smithi171 ceph-mon[35803]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:35:14.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:14 smithi136 ceph-mon[34840]: pgmap v190: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T09:35:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:14 smithi136 ceph-mon[34840]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T09:35:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:14 smithi136 ceph-mon[34840]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:35:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:14 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:14.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:14 smithi042 ceph-mon[31223]: pgmap v190: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T09:35:14.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:14 smithi042 ceph-mon[31223]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T09:35:14.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:14 smithi042 ceph-mon[31223]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:35:14.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:16.595 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:16 smithi042 ceph-mon[31223]: pgmap v192: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T09:35:16.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:16 smithi136 ceph-mon[34840]: pgmap v192: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T09:35:16.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:16 smithi171 ceph-mon[35803]: pgmap v192: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T09:35:17.699 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:17 smithi042 ceph-mon[31223]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T09:35:17.699 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:17 smithi042 ceph-mon[31223]: Cluster is now healthy 2024-09-19T09:35:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:17 smithi171 ceph-mon[35803]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T09:35:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:17 smithi171 ceph-mon[35803]: Cluster is now healthy 2024-09-19T09:35:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:17 smithi136 ceph-mon[34840]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T09:35:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:17 smithi136 ceph-mon[34840]: Cluster is now healthy 2024-09-19T09:35:18.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:18 smithi042 ceph-mon[31223]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T09:35:18.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:18 smithi171 ceph-mon[35803]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T09:35:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:18 smithi136 ceph-mon[34840]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T09:35:20.613 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:20 smithi042 ceph-mon[31223]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T09:35:20.613 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:35:20.613 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:20.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:20 smithi171 ceph-mon[35803]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T09:35:20.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:35:20.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:20 smithi136 ceph-mon[34840]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T09:35:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:35:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:21.603 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:21 smithi042 ceph-mon[31223]: Deploying daemon osd.9 on smithi042 2024-09-19T09:35:21.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:21 smithi171 ceph-mon[35803]: Deploying daemon osd.9 on smithi042 2024-09-19T09:35:21.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:21 smithi136 ceph-mon[34840]: Deploying daemon osd.9 on smithi042 2024-09-19T09:35:22.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:22 smithi042 ceph-mon[31223]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T09:35:22.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:22 smithi171 ceph-mon[35803]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T09:35:22.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:22 smithi136 ceph-mon[34840]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T09:35:24.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:24 smithi042 ceph-mon[31223]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:35:24.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:24 smithi171 ceph-mon[35803]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:35:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:24 smithi136 ceph-mon[34840]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:35:26.687 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:26 smithi136 ceph-mon[34840]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T09:35:26.687 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:26 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:26.687 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:26 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:26.687 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:26 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:26.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:26 smithi042 ceph-mon[31223]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T09:35:26.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:26.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:26.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:26 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:26.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:26 smithi171 ceph-mon[35803]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T09:35:26.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:26 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:26.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:26 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:26.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:26 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:28.555 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:28 smithi042 ceph-mon[31223]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:35:28.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:28 smithi171 ceph-mon[35803]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:35:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:28 smithi136 ceph-mon[34840]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:35:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.955+0000 7fb2f49d8640 1 -- 172.21.15.42:0/3566393031 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb2f01a07b0 con 0x7fb2d80a32f0 2024-09-19T09:35:28.958 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 9 on host 'smithi042' 2024-09-19T09:35:28.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 -- 172.21.15.42:0/3566393031 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2d80a32f0 msgr2=0x7fb2d80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:28.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2d80a32f0 0x7fb2d80a57b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb2f01994b0 tx=0x7fb2e400b390 comp rx=0 tx=0).stop 2024-09-19T09:35:28.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 -- 172.21.15.42:0/3566393031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2f0100b00 msgr2=0x7fb2f0197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:28.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2f0100b00 0x7fb2f0197f90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006010 tx=0x7fb2e0031b60 comp rx=0 tx=0).stop 2024-09-19T09:35:28.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 -- 172.21.15.42:0/3566393031 shutdown_connections 2024-09-19T09:35:28.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2d80a32f0 0x7fb2d80a57b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:28.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2f01026c0 0x7fb2f019f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:28.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2f0101d00 0x7fb2f01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:28.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 --2- 172.21.15.42:0/3566393031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2f0100b00 0x7fb2f0197f90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:28.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 -- 172.21.15.42:0/3566393031 >> 172.21.15.42:0/3566393031 conn(0x7fb2f00fc270 msgr2=0x7fb2f00fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:28.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 -- 172.21.15.42:0/3566393031 shutdown_connections 2024-09-19T09:35:28.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:35:28.958+0000 7fb2f59da640 1 -- 172.21.15.42:0/3566393031 wait complete. 2024-09-19T09:35:29.622 DEBUG:teuthology.orchestra.run.smithi042:osd.9> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T09:35:29.625 INFO:tasks.cephadm:Deploying osd.10 on smithi136 with /dev/vg_nvme/lv_1... 2024-09-19T09:35:29.625 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:35:29.884 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:35:30.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:29 smithi042 ceph-mon[31223]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:30.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.258 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:29 smithi136 ceph-mon[34840]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:30.259 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.259 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.259 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.259 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:29 smithi171 ceph-mon[35803]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:30.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:30.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:32.192 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:31 smithi042 ceph-mon[31223]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:32.192 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:31 smithi042 ceph-mon[31223]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:35:32.193 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:35:31 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:35:31.891+0000 7fe94d848640 -1 osd.9 0 log_to_monitors true 2024-09-19T09:35:32.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:31 smithi171 ceph-mon[35803]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:32.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:31 smithi171 ceph-mon[35803]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:35:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:31 smithi136 ceph-mon[34840]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:31 smithi136 ceph-mon[34840]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:35:32.401 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-19T09:35:32.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_1 2024-09-19T09:35:32.688 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:35:33.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.128+0000 7f69cc4cd640 1 -- 172.21.15.136:0/3384318908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69c4102690 msgr2=0x7f69c4108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:33.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.128+0000 7f69cc4cd640 1 --2- 172.21.15.136:0/3384318908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69c4102690 0x7f69c4108f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009ca0 tx=0x7f69bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 -- 172.21.15.136:0/3384318908 shutdown_connections 2024-09-19T09:35:33.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 --2- 172.21.15.136:0/3384318908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69c4102690 0x7f69c4108f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 --2- 172.21.15.136:0/3384318908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c4101cd0 0x7f69c4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 --2- 172.21.15.136:0/3384318908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69c4100ad0 0x7f69c4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 -- 172.21.15.136:0/3384318908 >> 172.21.15.136:0/3384318908 conn(0x7f69c40fc280 msgr2=0x7f69c40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:33.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 -- 172.21.15.136:0/3384318908 shutdown_connections 2024-09-19T09:35:33.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 -- 172.21.15.136:0/3384318908 wait complete. 2024-09-19T09:35:33.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 Processor -- start 2024-09-19T09:35:33.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 -- start start 2024-09-19T09:35:33.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69c4100ad0 0x7f69c4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:33.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c4101cd0 0x7f69c4198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:33.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69c4102690 0x7f69c419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:33.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f69c410c750 con 0x7f69c4102690 2024-09-19T09:35:33.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f69c410c5d0 con 0x7f69c4100ad0 2024-09-19T09:35:33.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.129+0000 7f69cc4cd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f69c410c8d0 con 0x7f69c4101cd0 2024-09-19T09:35:33.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69ca269640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69c4100ad0 0x7f69c4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:33.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69ca269640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69c4100ad0 0x7f69c4197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47278/0 (socket says 172.21.15.136:47278) 2024-09-19T09:35:33.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69ca269640 1 -- 172.21.15.136:0/2816657815 learned_addr learned my addr 172.21.15.136:0/2816657815 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-19T09:35:33.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69c9a68640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c4101cd0 0x7f69c4198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:33.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69caa6a640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69c4102690 0x7f69c419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:33.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69ca269640 1 -- 172.21.15.136:0/2816657815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c4101cd0 msgr2=0x7f69c4198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:33.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69ca269640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c4101cd0 0x7f69c4198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69ca269640 1 -- 172.21.15.136:0/2816657815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69c4102690 msgr2=0x7f69c419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69ca269640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69c4102690 0x7f69c419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69ca269640 1 -- 172.21.15.136:0/2816657815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c419faf0 con 0x7f69c4100ad0 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69ca269640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69c4100ad0 0x7f69c4197ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69c000d950 tx=0x7f69c000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69bb7fe640 1 -- 172.21.15.136:0/2816657815 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c0017020 con 0x7f69c4100ad0 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69bb7fe640 1 -- 172.21.15.136:0/2816657815 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69c0009c30 con 0x7f69c4100ad0 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69cc4cd640 1 -- 172.21.15.136:0/2816657815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c419fde0 con 0x7f69c4100ad0 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69bb7fe640 1 -- 172.21.15.136:0/2816657815 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c000f740 con 0x7f69c4100ad0 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.130+0000 7f69cc4cd640 1 -- 172.21.15.136:0/2816657815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c41a0290 con 0x7f69c4100ad0 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.131+0000 7f69cc4cd640 1 -- 172.21.15.136:0/2816657815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c41a0550 con 0x7f69c4100ad0 2024-09-19T09:35:33.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.133+0000 7f69bb7fe640 1 -- 172.21.15.136:0/2816657815 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f69c001a020 con 0x7f69c4100ad0 2024-09-19T09:35:33.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.133+0000 7f69bb7fe640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b00a32f0 0x7f69b00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:33.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.134+0000 7f69bb7fe640 1 -- 172.21.15.136:0/2816657815 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5981+0+0 (secure 0 0 0) 0x7f69c00cec00 con 0x7f69c4100ad0 2024-09-19T09:35:33.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.134+0000 7f69c9a68640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b00a32f0 0x7f69b00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:33.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.134+0000 7f69c9a68640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b00a32f0 0x7f69b00a57b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69c41993e0 tx=0x7f69b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:33.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.137+0000 7f69bb7fe640 1 -- 172.21.15.136:0/2816657815 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69c0021070 con 0x7f69c4100ad0 2024-09-19T09:35:33.204 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:35:32.959+0000 7fe948fa8640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T09:35:33.204 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:35:32.974+0000 7fe9455e2640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:35:33.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:33.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:33.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.206 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:32 smithi042 ceph-mon[31223]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:35:33.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:33.315+0000 7f69cc4cd640 1 -- 172.21.15.136:0/2816657815 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f69c41a0720 con 0x7f69b00a32f0 2024-09-19T09:35:33.317 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:35:33.317 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:35:33.317 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:35:33.317 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:33.317 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.317 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:32 smithi136 ceph-mon[34840]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:33.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:33.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:33.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:32 smithi171 ceph-mon[35803]: from='osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-19T09:35:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi042 2024-09-19T09:35:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi042 to 4273M 2024-09-19T09:35:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:35:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:34.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:34.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:35:34.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:35:34.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:34.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:33 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi042 2024-09-19T09:35:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi042 to 4273M 2024-09-19T09:35:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:35:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:34.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:34.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:34.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:34.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:34.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:35:34.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:35:34.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:34.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:33 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:34.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:34.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi042 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi042 to 4273M 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:34.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:33 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:35.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:34 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:35:35.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:34 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:35:35.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:34 smithi171 ceph-mon[35803]: osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] boot 2024-09-19T09:35:35.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:34 smithi171 ceph-mon[35803]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T09:35:35.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:34 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:35.368 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:34 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:35:35.368 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:34 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:35:35.368 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:34 smithi136 ceph-mon[34840]: osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] boot 2024-09-19T09:35:35.368 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:34 smithi136 ceph-mon[34840]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T09:35:35.368 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:34 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:35.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:34 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:35:35.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:34 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:35:35.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:34 smithi042 ceph-mon[31223]: osd.9 [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] boot 2024-09-19T09:35:35.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:34 smithi042 ceph-mon[31223]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T09:35:35.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:34 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:35:36.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:35 smithi042 ceph-mon[31223]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:36.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:35 smithi042 ceph-mon[31223]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T09:35:36.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:35 smithi042 ceph-mon[31223]: from='client.? 172.21.15.136:0/3577335807' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39e6662d-70d8-47a8-8cce-822de973672e"}]: dispatch 2024-09-19T09:35:36.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:35 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39e6662d-70d8-47a8-8cce-822de973672e"}]: dispatch 2024-09-19T09:35:36.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:35 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39e6662d-70d8-47a8-8cce-822de973672e"}]': finished 2024-09-19T09:35:36.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:35 smithi042 ceph-mon[31223]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T09:35:36.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:35 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:36.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:35 smithi136 ceph-mon[34840]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:36.264 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:35 smithi136 ceph-mon[34840]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T09:35:36.264 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:35 smithi136 ceph-mon[34840]: from='client.? 172.21.15.136:0/3577335807' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39e6662d-70d8-47a8-8cce-822de973672e"}]: dispatch 2024-09-19T09:35:36.264 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:35 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39e6662d-70d8-47a8-8cce-822de973672e"}]: dispatch 2024-09-19T09:35:36.264 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:35 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39e6662d-70d8-47a8-8cce-822de973672e"}]': finished 2024-09-19T09:35:36.264 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:35 smithi136 ceph-mon[34840]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T09:35:36.264 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:35 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:36.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:35 smithi171 ceph-mon[35803]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:35:36.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:35 smithi171 ceph-mon[35803]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T09:35:36.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:35 smithi171 ceph-mon[35803]: from='client.? 172.21.15.136:0/3577335807' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39e6662d-70d8-47a8-8cce-822de973672e"}]: dispatch 2024-09-19T09:35:36.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:35 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39e6662d-70d8-47a8-8cce-822de973672e"}]: dispatch 2024-09-19T09:35:36.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:35 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39e6662d-70d8-47a8-8cce-822de973672e"}]': finished 2024-09-19T09:35:36.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:35 smithi171 ceph-mon[35803]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T09:35:36.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:35 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:37.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:36 smithi171 ceph-mon[35803]: from='client.? 172.21.15.136:0/2511069739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:35:37.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:36 smithi136 ceph-mon[34840]: from='client.? 172.21.15.136:0/2511069739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:35:37.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:36 smithi042 ceph-mon[31223]: from='client.? 172.21.15.136:0/2511069739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:35:38.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:37 smithi171 ceph-mon[35803]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:38.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:37 smithi136 ceph-mon[34840]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:38.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:37 smithi042 ceph-mon[31223]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:40.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:39 smithi171 ceph-mon[35803]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:39 smithi136 ceph-mon[34840]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:40.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:39 smithi042 ceph-mon[31223]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:42.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:41 smithi136 ceph-mon[34840]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:42.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:41 smithi171 ceph-mon[35803]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:42.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:41 smithi042 ceph-mon[31223]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:44.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:44 smithi136 ceph-mon[34840]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:44.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:44 smithi171 ceph-mon[35803]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:44.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:44 smithi042 ceph-mon[31223]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:45.113 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:35:45.113 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:45 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:45.114 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:45 smithi136 ceph-mon[34840]: Deploying daemon osd.10 on smithi136 2024-09-19T09:35:45.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:35:45.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:45 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:45.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:45 smithi171 ceph-mon[35803]: Deploying daemon osd.10 on smithi136 2024-09-19T09:35:45.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:35:45.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:45 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:45.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:45 smithi042 ceph-mon[31223]: Deploying daemon osd.10 on smithi136 2024-09-19T09:35:46.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:46 smithi136 ceph-mon[34840]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:46.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:46 smithi171 ceph-mon[35803]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:46.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:46 smithi042 ceph-mon[31223]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:48 smithi136 ceph-mon[34840]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:48.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:48 smithi171 ceph-mon[35803]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:48.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:48 smithi042 ceph-mon[31223]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:50.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:50 smithi136 ceph-mon[34840]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:50.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:50 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:50.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:50 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:50.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:50 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:50.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:50 smithi171 ceph-mon[35803]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:50.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:50 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:50.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:50 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:50.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:50 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:50 smithi042 ceph-mon[31223]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:50 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:50 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:50.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:50 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:52.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:52 smithi136 ceph-mon[34840]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:52.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:52 smithi171 ceph-mon[35803]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:52.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:52 smithi042 ceph-mon[31223]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.083+0000 7f69bb7fe640 1 -- 172.21.15.136:0/2816657815 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f69c41a0720 con 0x7f69b00a32f0 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 10 on host 'smithi136' 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 -- 172.21.15.136:0/2816657815 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b00a32f0 msgr2=0x7f69b00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b00a32f0 0x7f69b00a57b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69c41993e0 tx=0x7f69b4005f90 comp rx=0 tx=0).stop 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 -- 172.21.15.136:0/2816657815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69c4100ad0 msgr2=0x7f69c4197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69c4100ad0 0x7f69c4197ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69c000d950 tx=0x7f69c000de10 comp rx=0 tx=0).stop 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 -- 172.21.15.136:0/2816657815 shutdown_connections 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b00a32f0 0x7f69b00a57b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69c4102690 0x7f69c419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c4101cd0 0x7f69c4198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 --2- 172.21.15.136:0/2816657815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69c4100ad0 0x7f69c4197ec0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 -- 172.21.15.136:0/2816657815 >> 172.21.15.136:0/2816657815 conn(0x7f69c40fc280 msgr2=0x7f69c4069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 -- 172.21.15.136:0/2816657815 shutdown_connections 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-19T09:35:53.086+0000 7f69cc4cd640 1 -- 172.21.15.136:0/2816657815 wait complete. 2024-09-19T09:35:53.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:53.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:53.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:53.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:53 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:53 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:53.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:53.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:53.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:53 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:53.936 DEBUG:teuthology.orchestra.run.smithi136:osd.10> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T09:35:53.938 INFO:tasks.cephadm:Deploying osd.11 on smithi171 with /dev/vg_nvme/lv_1... 2024-09-19T09:35:53.938 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:35:54.195 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:35:54.571 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:54 smithi171 ceph-mon[35803]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:54.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:54 smithi042 ceph-mon[31223]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:54.621 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:54 smithi136 ceph-mon[34840]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:56.496 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:56 smithi136 ceph-mon[34840]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:56.497 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:56 smithi136 ceph-mon[34840]: from='osd.10 [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:35:56.497 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:56 smithi136 ceph-mon[34840]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:35:56.497 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:35:56 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:35:56.149+0000 7fb0c1295640 -1 osd.10 0 log_to_monitors true 2024-09-19T09:35:56.536 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-19T09:35:56.564 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:56 smithi171 ceph-mon[35803]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:56.564 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:56 smithi171 ceph-mon[35803]: from='osd.10 [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:35:56.564 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:56 smithi171 ceph-mon[35803]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:35:56.565 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_1 2024-09-19T09:35:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:56 smithi042 ceph-mon[31223]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:56 smithi042 ceph-mon[31223]: from='osd.10 [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:35:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:56 smithi042 ceph-mon[31223]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:35:56.821 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:35:57.244 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.229+0000 7fefed766640 1 -- 172.21.15.171:0/2277441091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefe8100b00 msgr2=0x7fefe8100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.244 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.229+0000 7fefed766640 1 --2- 172.21.15.171:0/2277441091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefe8100b00 0x7fefe8100f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009900 tx=0x7fefdc02a410 comp rx=0 tx=0).stop 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.229+0000 7fefed766640 1 -- 172.21.15.171:0/2277441091 shutdown_connections 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.229+0000 7fefed766640 1 --2- 172.21.15.171:0/2277441091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe81026c0 0x7fefe8108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.229+0000 7fefed766640 1 --2- 172.21.15.171:0/2277441091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8101d00 0x7fefe8102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.229+0000 7fefed766640 1 --2- 172.21.15.171:0/2277441091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefe8100b00 0x7fefe8100f00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.229+0000 7fefed766640 1 -- 172.21.15.171:0/2277441091 >> 172.21.15.171:0/2277441091 conn(0x7fefe80fc270 msgr2=0x7fefe80fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.229+0000 7fefed766640 1 -- 172.21.15.171:0/2277441091 shutdown_connections 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.229+0000 7fefed766640 1 -- 172.21.15.171:0/2277441091 wait complete. 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.229+0000 7fefed766640 1 Processor -- start 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefed766640 1 -- start start 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefed766640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8100b00 0x7fefe8197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.245 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefed766640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefe8101d00 0x7fefe8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefed766640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe81026c0 0x7fefe819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefed766640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fefe810c760 con 0x7fefe8100b00 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefed766640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fefe810c5e0 con 0x7fefe81026c0 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefed766640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fefe810c8e0 con 0x7fefe8101d00 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe67fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefe8101d00 0x7fefe8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe67fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefe8101d00 0x7fefe8198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39552/0 (socket says 172.21.15.171:39552) 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe67fc640 1 -- 172.21.15.171:0/645147921 learned_addr learned my addr 172.21.15.171:0/645147921 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe77fe640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe81026c0 0x7fefe819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe6ffd640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8100b00 0x7fefe8197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe67fc640 1 -- 172.21.15.171:0/645147921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe81026c0 msgr2=0x7fefe819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe67fc640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe81026c0 0x7fefe819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.246 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe67fc640 1 -- 172.21.15.171:0/645147921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8100b00 msgr2=0x7fefe8197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe67fc640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8100b00 0x7fefe8197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe67fc640 1 -- 172.21.15.171:0/645147921 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe819fc00 con 0x7fefe8101d00 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefe67fc640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefe8101d00 0x7fefe8198510 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fefd800d950 tx=0x7fefd800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.230+0000 7fefcffff640 1 -- 172.21.15.171:0/645147921 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8017030 con 0x7fefe8101d00 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.231+0000 7fefed766640 1 -- 172.21.15.171:0/645147921 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe819fef0 con 0x7fefe8101d00 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.231+0000 7fefcffff640 1 -- 172.21.15.171:0/645147921 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd8004020 con 0x7fefe8101d00 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.231+0000 7fefcffff640 1 -- 172.21.15.171:0/645147921 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd80047a0 con 0x7fefe8101d00 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.231+0000 7fefed766640 1 -- 172.21.15.171:0/645147921 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe81a03f0 con 0x7fefe8101d00 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.232+0000 7fefed766640 1 -- 172.21.15.171:0/645147921 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe81a0680 con 0x7fefe8101d00 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.233+0000 7fefcffff640 1 -- 172.21.15.171:0/645147921 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fefd80041d0 con 0x7fefe8101d00 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.233+0000 7fefcffff640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fefd00a3270 0x7fefd00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.233+0000 7fefcffff640 1 -- 172.21.15.171:0/645147921 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6398+0+0 (secure 0 0 0) 0x7fefd80cf1f0 con 0x7fefe8101d00 2024-09-19T09:35:57.247 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.234+0000 7fefe6ffd640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fefd00a3270 0x7fefd00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.248 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.234+0000 7fefe6ffd640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fefd00a3270 0x7fefd00a5730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefdc000c00 tx=0x7fefdc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:57.248 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.237+0000 7fefcffff640 1 -- 172.21.15.171:0/645147921 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fefd809c690 con 0x7fefe8101d00 2024-09-19T09:35:57.421 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:35:57.419+0000 7fefed766640 1 -- 172.21.15.171:0/645147921 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fefe81a0850 con 0x7fefd00a3270 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='osd.10 [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.422 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.423 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.423 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:57.423 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:57.423 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.634 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:35:57.367+0000 7fb0bc9f5640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T09:35:57.634 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:35:57.383+0000 7fb0b902f640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:35:57.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:35:57.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T09:35:57.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:57.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='osd.10 [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:35:57.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:35:57.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:57.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:57.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:35:57.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T09:35:57.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:57.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='osd.10 [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:35:57.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-19T09:35:57.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:57.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:57.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:57.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:57.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi136 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi136 to 4272M 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:35:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:58 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:58.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:58.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi136 2024-09-19T09:35:58.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi136 to 4272M 2024-09-19T09:35:58.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:35:58.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T09:35:58.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:58.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:58.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:58.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:35:58.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:35:58.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:58 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:58.840 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:35:58.840 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi136 2024-09-19T09:35:58.840 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi136 to 4272M 2024-09-19T09:35:58.840 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-19T09:35:58.840 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T09:35:58.840 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:58.840 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:58.840 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:58.841 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:35:58.841 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:35:58.841 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:58 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:59.562 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:59 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:35:59.562 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:59 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:35:59.562 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:59 smithi171 ceph-mon[35803]: osd.10 [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] boot 2024-09-19T09:35:59.562 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:59 smithi171 ceph-mon[35803]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T09:35:59.562 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:35:59 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:59.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:59 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:35:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:59 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:35:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:59 smithi136 ceph-mon[34840]: osd.10 [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] boot 2024-09-19T09:35:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:59 smithi136 ceph-mon[34840]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T09:35:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:35:59 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:35:59.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:59 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:35:59.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:59 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:35:59.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:59 smithi042 ceph-mon[31223]: osd.10 [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] boot 2024-09-19T09:35:59.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:59 smithi042 ceph-mon[31223]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T09:35:59.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:35:59 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:36:00.464 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:00 smithi171 ceph-mon[35803]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:00.465 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:00 smithi171 ceph-mon[35803]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T09:36:00.465 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:00 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/3332739886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfbb71e1-73ac-4766-9b71-c81701b94a58"}]: dispatch 2024-09-19T09:36:00.465 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:00 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfbb71e1-73ac-4766-9b71-c81701b94a58"}]: dispatch 2024-09-19T09:36:00.465 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:00 smithi171 ceph-mon[35803]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfbb71e1-73ac-4766-9b71-c81701b94a58"}]': finished 2024-09-19T09:36:00.465 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:00 smithi171 ceph-mon[35803]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T09:36:00.465 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:00 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:00.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:00 smithi136 ceph-mon[34840]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:00 smithi136 ceph-mon[34840]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T09:36:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:00 smithi136 ceph-mon[34840]: from='client.? 172.21.15.171:0/3332739886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfbb71e1-73ac-4766-9b71-c81701b94a58"}]: dispatch 2024-09-19T09:36:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:00 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfbb71e1-73ac-4766-9b71-c81701b94a58"}]: dispatch 2024-09-19T09:36:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:00 smithi136 ceph-mon[34840]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfbb71e1-73ac-4766-9b71-c81701b94a58"}]': finished 2024-09-19T09:36:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:00 smithi136 ceph-mon[34840]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T09:36:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:00 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:00.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:00 smithi042 ceph-mon[31223]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:00.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:00 smithi042 ceph-mon[31223]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T09:36:00.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:00 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/3332739886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfbb71e1-73ac-4766-9b71-c81701b94a58"}]: dispatch 2024-09-19T09:36:00.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:00 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfbb71e1-73ac-4766-9b71-c81701b94a58"}]: dispatch 2024-09-19T09:36:00.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:00 smithi042 ceph-mon[31223]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfbb71e1-73ac-4766-9b71-c81701b94a58"}]': finished 2024-09-19T09:36:00.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:00 smithi042 ceph-mon[31223]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T09:36:00.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:00 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:01.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:01 smithi136 ceph-mon[34840]: from='client.? 172.21.15.171:0/2184538848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:36:01.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:01 smithi136 ceph-mon[34840]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T09:36:01.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:01 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:01.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:01 smithi042 ceph-mon[31223]: from='client.? 172.21.15.171:0/2184538848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:36:01.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:01 smithi042 ceph-mon[31223]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T09:36:01.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:01 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:01.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:01 smithi171 ceph-mon[35803]: from='client.? 172.21.15.171:0/2184538848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:36:01.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:01 smithi171 ceph-mon[35803]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T09:36:01.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:01 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:02.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:02 smithi136 ceph-mon[34840]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:02 smithi136 ceph-mon[34840]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:36:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:02 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:02.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:02 smithi042 ceph-mon[31223]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:02.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:02 smithi042 ceph-mon[31223]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:36:02.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:02 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:02.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:02 smithi171 ceph-mon[35803]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:02.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:02 smithi171 ceph-mon[35803]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:36:02.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:02 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:04.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:04 smithi042 ceph-mon[31223]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:36:04.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:04 smithi171 ceph-mon[35803]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:36:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:04 smithi136 ceph-mon[34840]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:36:06.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:06 smithi042 ceph-mon[31223]: pgmap v229: 1 pgs: 1 peering; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T09:36:06.705 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:06 smithi171 ceph-mon[35803]: pgmap v229: 1 pgs: 1 peering; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T09:36:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:06 smithi136 ceph-mon[34840]: pgmap v229: 1 pgs: 1 peering; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T09:36:08.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:08 smithi136 ceph-mon[34840]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T09:36:08.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:08 smithi042 ceph-mon[31223]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T09:36:08.757 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:08 smithi171 ceph-mon[35803]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T09:36:09.494 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:09 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:36:09.494 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:09 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:09.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:09 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:36:09.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:09 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:09 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:36:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:09 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:10.527 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:10 smithi171 ceph-mon[35803]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:36:10.527 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:10 smithi171 ceph-mon[35803]: Deploying daemon osd.11 on smithi171 2024-09-19T09:36:10.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:10 smithi042 ceph-mon[31223]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:36:10.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:10 smithi042 ceph-mon[31223]: Deploying daemon osd.11 on smithi171 2024-09-19T09:36:10.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:10 smithi136 ceph-mon[34840]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:36:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:10 smithi136 ceph-mon[34840]: Deploying daemon osd.11 on smithi171 2024-09-19T09:36:12.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:12 smithi171 ceph-mon[35803]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T09:36:12.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:12 smithi042 ceph-mon[31223]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T09:36:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:12 smithi136 ceph-mon[34840]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T09:36:14.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:14 smithi042 ceph-mon[31223]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:14.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:14.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:14.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:14 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:14.735 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:14 smithi171 ceph-mon[35803]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:14.736 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:14.736 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:14.736 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:14 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:14 smithi136 ceph-mon[34840]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:14 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:14 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:14 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:16.477 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:16 smithi171 ceph-mon[35803]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:16.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:16 smithi042 ceph-mon[31223]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:16.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:16 smithi136 ceph-mon[34840]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:17.462 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.460+0000 7fefcffff640 1 -- 172.21.15.171:0/645147921 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fefe81a0850 con 0x7fefd00a3270 2024-09-19T09:36:17.462 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 11 on host 'smithi171' 2024-09-19T09:36:17.464 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.462+0000 7fefed766640 1 -- 172.21.15.171:0/645147921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fefd00a3270 msgr2=0x7fefd00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:17.464 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.462+0000 7fefed766640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fefd00a3270 0x7fefd00a5730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefdc000c00 tx=0x7fefdc0315b0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.464 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.462+0000 7fefed766640 1 -- 172.21.15.171:0/645147921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefe8101d00 msgr2=0x7fefe8198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:17.464 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.462+0000 7fefed766640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefe8101d00 0x7fefe8198510 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fefd800d950 tx=0x7fefd800de10 comp rx=0 tx=0).stop 2024-09-19T09:36:17.465 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.462+0000 7fefed766640 1 -- 172.21.15.171:0/645147921 shutdown_connections 2024-09-19T09:36:17.465 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.462+0000 7fefed766640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fefd00a3270 0x7fefd00a5730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.465 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.462+0000 7fefed766640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe81026c0 0x7fefe819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.465 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.462+0000 7fefed766640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefe8101d00 0x7fefe8198510 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.465 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.462+0000 7fefed766640 1 --2- 172.21.15.171:0/645147921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefe8100b00 0x7fefe8197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.465 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.462+0000 7fefed766640 1 -- 172.21.15.171:0/645147921 >> 172.21.15.171:0/645147921 conn(0x7fefe80fc270 msgr2=0x7fefe806a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:17.465 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.463+0000 7fefed766640 1 -- 172.21.15.171:0/645147921 shutdown_connections 2024-09-19T09:36:17.465 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:17.463+0000 7fefed766640 1 -- 172.21.15.171:0/645147921 wait complete. 2024-09-19T09:36:18.072 DEBUG:teuthology.orchestra.run.smithi171:osd.11> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T09:36:18.074 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T09:36:18.075 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:36:18.345 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:18.706 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:18 smithi171 ceph-mon[35803]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:18.706 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.706 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.706 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.706 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.735 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:18 smithi042 ceph-mon[31223]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:18.735 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.735 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.735 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.735 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.820+0000 7fe2fd734640 1 -- 172.21.15.42:0/728552936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f81037c0 msgr2=0x7fe2f810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:18.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.820+0000 7fe2fd734640 1 --2- 172.21.15.42:0/728552936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f81037c0 0x7fe2f810a050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009ca0 tx=0x7fe2f002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:18.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.821+0000 7fe2fd734640 1 -- 172.21.15.42:0/728552936 shutdown_connections 2024-09-19T09:36:18.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.821+0000 7fe2fd734640 1 --2- 172.21.15.42:0/728552936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f81037c0 0x7fe2f810a050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:18.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.821+0000 7fe2fd734640 1 --2- 172.21.15.42:0/728552936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f8102e00 0x7fe2f8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:18.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.821+0000 7fe2fd734640 1 --2- 172.21.15.42:0/728552936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f8101c00 0x7fe2f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:18.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.821+0000 7fe2fd734640 1 -- 172.21.15.42:0/728552936 >> 172.21.15.42:0/728552936 conn(0x7fe2f80fd390 msgr2=0x7fe2f80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:18.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.821+0000 7fe2fd734640 1 -- 172.21.15.42:0/728552936 shutdown_connections 2024-09-19T09:36:18.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.821+0000 7fe2fd734640 1 -- 172.21.15.42:0/728552936 wait complete. 2024-09-19T09:36:18.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.821+0000 7fe2fd734640 1 Processor -- start 2024-09-19T09:36:18.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.821+0000 7fe2fd734640 1 -- start start 2024-09-19T09:36:18.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.821+0000 7fe2fd734640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f8101c00 0x7fe2f8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:18.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2fd734640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f8102e00 0x7fe2f80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:18.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2fd734640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f81037c0 0x7fe2f8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:18.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2fd734640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f810d860 con 0x7fe2f8102e00 2024-09-19T09:36:18.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2fd734640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f810d6e0 con 0x7fe2f8101c00 2024-09-19T09:36:18.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2fd734640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f810d9e0 con 0x7fe2f81037c0 2024-09-19T09:36:18.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f67fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f8102e00 0x7fe2f80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:18.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f67fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f8102e00 0x7fe2f80745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36110/0 (socket says 172.21.15.42:36110) 2024-09-19T09:36:18.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f67fc640 1 -- 172.21.15.42:0/2452360891 learned_addr learned my addr 172.21.15.42:0/2452360891 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:18.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f77fe640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f81037c0 0x7fe2f8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f6ffd640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f8101c00 0x7fe2f8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f67fc640 1 -- 172.21.15.42:0/2452360891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f81037c0 msgr2=0x7fe2f8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f67fc640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f81037c0 0x7fe2f8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f67fc640 1 -- 172.21.15.42:0/2452360891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f8101c00 msgr2=0x7fe2f8075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f67fc640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f8101c00 0x7fe2f8075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f67fc640 1 -- 172.21.15.42:0/2452360891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f80753e0 con 0x7fe2f8102e00 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2f67fc640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f8102e00 0x7fe2f80745e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c920 tx=0x7fe2ec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2dffff640 1 -- 172.21.15.42:0/2452360891 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec007c70 con 0x7fe2f8102e00 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2dffff640 1 -- 172.21.15.42:0/2452360891 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2ec007e10 con 0x7fe2f8102e00 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2fd734640 1 -- 172.21.15.42:0/2452360891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f81a1f60 con 0x7fe2f8102e00 2024-09-19T09:36:18.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.822+0000 7fe2dffff640 1 -- 172.21.15.42:0/2452360891 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec018890 con 0x7fe2f8102e00 2024-09-19T09:36:18.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.823+0000 7fe2fd734640 1 -- 172.21.15.42:0/2452360891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f81a23c0 con 0x7fe2f8102e00 2024-09-19T09:36:18.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.824+0000 7fe2fd734640 1 -- 172.21.15.42:0/2452360891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f8108f30 con 0x7fe2f8102e00 2024-09-19T09:36:18.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.825+0000 7fe2dffff640 1 -- 172.21.15.42:0/2452360891 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe2ec018a50 con 0x7fe2f8102e00 2024-09-19T09:36:18.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.826+0000 7fe2dffff640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe2e00a3240 0x7fe2e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:18.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.826+0000 7fe2dffff640 1 -- 172.21.15.42:0/2452360891 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6809+0+0 (secure 0 0 0) 0x7fe2ec0cf450 con 0x7fe2f8102e00 2024-09-19T09:36:18.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.827+0000 7fe2f6ffd640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe2e00a3240 0x7fe2e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:18.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.827+0000 7fe2f6ffd640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe2e00a3240 0x7fe2e00a5700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8102c60 tx=0x7fe2e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:18.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:18.831+0000 7fe2dffff640 1 -- 172.21.15.42:0/2452360891 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2ec014030 con 0x7fe2f8102e00 2024-09-19T09:36:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:18 smithi136 ceph-mon[34840]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.008+0000 7fe2fd734640 1 -- 172.21.15.42:0/2452360891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe2f8062e90 con 0x7fe2f8102e00 2024-09-19T09:36:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.008+0000 7fe2dffff640 1 -- 172.21.15.42:0/2452360891 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7fe2ec09c6b0 con 0x7fe2f8102e00 2024-09-19T09:36:19.010 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 -- 172.21.15.42:0/2452360891 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe2e00a3240 msgr2=0x7fe2e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe2e00a3240 0x7fe2e00a5700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8102c60 tx=0x7fe2e8005f90 comp rx=0 tx=0).stop 2024-09-19T09:36:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 -- 172.21.15.42:0/2452360891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f8102e00 msgr2=0x7fe2f80745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f8102e00 0x7fe2f80745e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c920 tx=0x7fe2ec00cde0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 -- 172.21.15.42:0/2452360891 shutdown_connections 2024-09-19T09:36:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe2e00a3240 0x7fe2e00a5700 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f81037c0 0x7fe2f8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f8102e00 0x7fe2f80745e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 --2- 172.21.15.42:0/2452360891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f8101c00 0x7fe2f8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 -- 172.21.15.42:0/2452360891 >> 172.21.15.42:0/2452360891 conn(0x7fe2f80fd390 msgr2=0x7fe2f8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:19.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 -- 172.21.15.42:0/2452360891 shutdown_connections 2024-09-19T09:36:19.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:19.011+0000 7fe2fd734640 1 -- 172.21.15.42:0/2452360891 wait complete. 2024-09-19T09:36:19.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:19 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2452360891' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:36:19.727 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726738558,"num_in_osds":12,"osd_in_since":1726738559,"num_remapped_pgs":0} 2024-09-19T09:36:19.762 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:19 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2452360891' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:36:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:19 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2452360891' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:36:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:20 smithi171 ceph-mon[35803]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:20 smithi171 ceph-mon[35803]: from='osd.11 [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:36:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:20 smithi171 ceph-mon[35803]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:36:20.597 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:36:20 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:36:20.331+0000 7fd045653640 -1 osd.11 0 log_to_monitors true 2024-09-19T09:36:20.728 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:36:20.758 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:20 smithi042 ceph-mon[31223]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:20.758 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:20 smithi042 ceph-mon[31223]: from='osd.11 [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:36:20.758 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:20 smithi042 ceph-mon[31223]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:36:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:20 smithi136 ceph-mon[34840]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:20 smithi136 ceph-mon[34840]: from='osd.11 [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:36:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:20 smithi136 ceph-mon[34840]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:36:20.998 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:21.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.452+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/3103827816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dc0102660 msgr2=0x7f8dc0104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:21.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.452+0000 7f8dc5ae6640 1 --2- 172.21.15.42:0/3103827816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dc0102660 0x7f8dc0104a50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009900 tx=0x7f8db002a410 comp rx=0 tx=0).stop 2024-09-19T09:36:21.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.452+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/3103827816 shutdown_connections 2024-09-19T09:36:21.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.452+0000 7f8dc5ae6640 1 --2- 172.21.15.42:0/3103827816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc01078c0 0x7f8dc0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.452+0000 7f8dc5ae6640 1 --2- 172.21.15.42:0/3103827816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc0104f90 0x7f8dc0107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.452+0000 7f8dc5ae6640 1 --2- 172.21.15.42:0/3103827816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dc0102660 0x7f8dc0104a50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.452+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/3103827816 >> 172.21.15.42:0/3103827816 conn(0x7f8dc00fc280 msgr2=0x7f8dc00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.452+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/3103827816 shutdown_connections 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.452+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/3103827816 wait complete. 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dc5ae6640 1 Processor -- start 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dc5ae6640 1 -- start start 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dc5ae6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc0102660 0x7f8dc0197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dc5ae6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc0104f90 0x7f8dc0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dc5ae6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dc01078c0 0x7f8dc019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dc5ae6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc010d890 con 0x7f8dc01078c0 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dc5ae6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc010d710 con 0x7f8dc0104f90 2024-09-19T09:36:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dc5ae6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc010da10 con 0x7f8dc0102660 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dbffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dc01078c0 0x7f8dc019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dbffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dc01078c0 0x7f8dc019f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54376/0 (socket says 172.21.15.42:54376) 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.453+0000 7f8dbffff640 1 -- 172.21.15.42:0/934962124 learned_addr learned my addr 172.21.15.42:0/934962124 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbeffd640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc0104f90 0x7f8dc0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbf7fe640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc0102660 0x7f8dc0197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbffff640 1 -- 172.21.15.42:0/934962124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc0102660 msgr2=0x7f8dc0197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbffff640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc0102660 0x7f8dc0197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbffff640 1 -- 172.21.15.42:0/934962124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc0104f90 msgr2=0x7f8dc0198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbffff640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc0104f90 0x7f8dc0198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbffff640 1 -- 172.21.15.42:0/934962124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc019fb40 con 0x7f8dc01078c0 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbffff640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dc01078c0 0x7f8dc019f4d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8db800eb10 tx=0x7f8db800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbcff9640 1 -- 172.21.15.42:0/934962124 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8004b20 con 0x7f8dc01078c0 2024-09-19T09:36:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbcff9640 1 -- 172.21.15.42:0/934962124 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db8004cc0 con 0x7f8dc01078c0 2024-09-19T09:36:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/934962124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc019fe30 con 0x7f8dc01078c0 2024-09-19T09:36:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dbcff9640 1 -- 172.21.15.42:0/934962124 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8010760 con 0x7f8dc01078c0 2024-09-19T09:36:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.454+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/934962124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc01a0330 con 0x7f8dc01078c0 2024-09-19T09:36:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.455+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/934962124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc00fdd70 con 0x7f8dc01078c0 2024-09-19T09:36:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.457+0000 7f8dbcff9640 1 -- 172.21.15.42:0/934962124 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8db8010900 con 0x7f8dc01078c0 2024-09-19T09:36:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.457+0000 7f8dbcff9640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8da80a32f0 0x7f8da80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.457+0000 7f8dbf7fe640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8da80a32f0 0x7f8da80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.457+0000 7f8dbcff9640 1 -- 172.21.15.42:0/934962124 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6831+0+0 (secure 0 0 0) 0x7f8db80cfa70 con 0x7f8dc01078c0 2024-09-19T09:36:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.458+0000 7f8dbf7fe640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8da80a32f0 0x7f8da80a57b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8db0000c00 tx=0x7f8db00315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.460+0000 7f8dbcff9640 1 -- 172.21.15.42:0/934962124 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8db8054210 con 0x7f8dc01078c0 2024-09-19T09:36:21.496 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:36:21.479+0000 7fd040db3640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T09:36:21.497 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:36:21.495+0000 7fd03d3ed640 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:36:21.497 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:36:21.497 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:36:21.497 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:21.497 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='osd.11 [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:36:21.497 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:36:21.497 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:21.497 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: Detected new or changed devices on smithi171 2024-09-19T09:36:21.497 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: Adjusting osd_memory_target on smithi171 to 4272M 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:21.498 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.638+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/934962124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8dc002da10 con 0x7f8dc01078c0 2024-09-19T09:36:21.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:36:21.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:36:21.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:21.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='osd.11 [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: Detected new or changed devices on smithi171 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: Adjusting osd_memory_target on smithi171 to 4272M 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:21.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:21.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:21.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:21.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:21.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.638+0000 7f8dbcff9640 1 -- 172.21.15.42:0/934962124 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f8db809cd60 con 0x7f8dc01078c0 2024-09-19T09:36:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.640+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/934962124 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8da80a32f0 msgr2=0x7f8da80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.640+0000 7f8dc5ae6640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8da80a32f0 0x7f8da80a57b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8db0000c00 tx=0x7f8db00315d0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.640+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/934962124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dc01078c0 msgr2=0x7f8dc019f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.640+0000 7f8dc5ae6640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dc01078c0 0x7f8dc019f4d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8db800eb10 tx=0x7f8db800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.640+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/934962124 shutdown_connections 2024-09-19T09:36:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.640+0000 7f8dc5ae6640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8da80a32f0 0x7f8da80a57b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.640+0000 7f8dc5ae6640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dc01078c0 0x7f8dc019f4d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.640+0000 7f8dc5ae6640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc0104f90 0x7f8dc0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.640+0000 7f8dc5ae6640 1 --2- 172.21.15.42:0/934962124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc0102660 0x7f8dc0197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.641+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/934962124 >> 172.21.15.42:0/934962124 conn(0x7f8dc00fc280 msgr2=0x7f8dc01030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.641+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/934962124 shutdown_connections 2024-09-19T09:36:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:21.641+0000 7f8dc5ae6640 1 -- 172.21.15.42:0/934962124 wait complete. 2024-09-19T09:36:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:36:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:36:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='osd.11 [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:36:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-19T09:36:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: Detected new or changed devices on smithi171 2024-09-19T09:36:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: Adjusting osd_memory_target on smithi171 to 4272M 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:21.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:22.201 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726738558,"num_in_osds":12,"osd_in_since":1726738559,"num_remapped_pgs":0} 2024-09-19T09:36:22.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:22 smithi171 ceph-mon[35803]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:36:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:22 smithi171 ceph-mon[35803]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:36:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:22 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:22 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:22 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/934962124' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:36:22.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:22 smithi136 ceph-mon[34840]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:36:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:22 smithi136 ceph-mon[34840]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:36:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:22 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:22 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:22 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/934962124' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:36:22.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:22 smithi042 ceph-mon[31223]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-19T09:36:22.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:22 smithi042 ceph-mon[31223]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:36:22.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:22 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:22.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:22 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:22.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:22 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/934962124' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:36:23.202 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:36:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:23.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:23 smithi042 ceph-mon[31223]: purged_snaps scrub starts 2024-09-19T09:36:23.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:23 smithi042 ceph-mon[31223]: purged_snaps scrub ok 2024-09-19T09:36:23.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:23 smithi042 ceph-mon[31223]: osd.11 [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] boot 2024-09-19T09:36:23.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:23 smithi042 ceph-mon[31223]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T09:36:23.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:23 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:23.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:23 smithi042 ceph-mon[31223]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:23.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:23 smithi171 ceph-mon[35803]: purged_snaps scrub starts 2024-09-19T09:36:23.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:23 smithi171 ceph-mon[35803]: purged_snaps scrub ok 2024-09-19T09:36:23.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:23 smithi171 ceph-mon[35803]: osd.11 [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] boot 2024-09-19T09:36:23.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:23 smithi171 ceph-mon[35803]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T09:36:23.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:23 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:23.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:23 smithi171 ceph-mon[35803]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:23 smithi136 ceph-mon[34840]: purged_snaps scrub starts 2024-09-19T09:36:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:23 smithi136 ceph-mon[34840]: purged_snaps scrub ok 2024-09-19T09:36:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:23 smithi136 ceph-mon[34840]: osd.11 [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] boot 2024-09-19T09:36:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:23 smithi136 ceph-mon[34840]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T09:36:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:23 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:36:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:23 smithi136 ceph-mon[34840]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:36:24.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.048+0000 7fb8820f9640 1 -- 172.21.15.42:0/849344880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c107900 msgr2=0x7fb87c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:24.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.048+0000 7fb8820f9640 1 --2- 172.21.15.42:0/849344880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c107900 0x7fb87c109d50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb874009ca0 tx=0x7fb87402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.048+0000 7fb8820f9640 1 -- 172.21.15.42:0/849344880 shutdown_connections 2024-09-19T09:36:24.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.048+0000 7fb8820f9640 1 --2- 172.21.15.42:0/849344880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c107900 0x7fb87c109d50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.048+0000 7fb8820f9640 1 --2- 172.21.15.42:0/849344880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c104fd0 0x7fb87c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.048+0000 7fb8820f9640 1 --2- 172.21.15.42:0/849344880 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c1026a0 0x7fb87c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.048+0000 7fb8820f9640 1 -- 172.21.15.42:0/849344880 >> 172.21.15.42:0/849344880 conn(0x7fb87c0fc2a0 msgr2=0x7fb87c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:24.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.048+0000 7fb8820f9640 1 -- 172.21.15.42:0/849344880 shutdown_connections 2024-09-19T09:36:24.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.048+0000 7fb8820f9640 1 -- 172.21.15.42:0/849344880 wait complete. 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb8820f9640 1 Processor -- start 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb8820f9640 1 -- start start 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb8820f9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c1026a0 0x7fb87c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb8820f9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c104fd0 0x7fb87c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb8820f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c107900 0x7fb87c19f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb8820f9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c10d8c0 con 0x7fb87c107900 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb8820f9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c10d740 con 0x7fb87c1026a0 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb8820f9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c10da40 con 0x7fb87c104fd0 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb87bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c107900 0x7fb87c19f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb87bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c107900 0x7fb87c19f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54398/0 (socket says 172.21.15.42:54398) 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb87bfff640 1 -- 172.21.15.42:0/2423708732 learned_addr learned my addr 172.21.15.42:0/2423708732 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:24.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb872ffd640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c104fd0 0x7fb87c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb87b7fe640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c1026a0 0x7fb87c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb87bfff640 1 -- 172.21.15.42:0/2423708732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c104fd0 msgr2=0x7fb87c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.049+0000 7fb87bfff640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c104fd0 0x7fb87c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.050+0000 7fb87bfff640 1 -- 172.21.15.42:0/2423708732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c1026a0 msgr2=0x7fb87c197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.050+0000 7fb87bfff640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c1026a0 0x7fb87c197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.050+0000 7fb87bfff640 1 -- 172.21.15.42:0/2423708732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87c19fb20 con 0x7fb87c107900 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.050+0000 7fb87b7fe640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c1026a0 0x7fb87c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.050+0000 7fb87bfff640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c107900 0x7fb87c19f4b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb874005e30 tx=0x7fb874031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.050+0000 7fb8797fa640 1 -- 172.21.15.42:0/2423708732 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb874003c30 con 0x7fb87c107900 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.050+0000 7fb8797fa640 1 -- 172.21.15.42:0/2423708732 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb874003dd0 con 0x7fb87c107900 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.050+0000 7fb8820f9640 1 -- 172.21.15.42:0/2423708732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb87c19fdb0 con 0x7fb87c107900 2024-09-19T09:36:24.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.050+0000 7fb8797fa640 1 -- 172.21.15.42:0/2423708732 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87402fde0 con 0x7fb87c107900 2024-09-19T09:36:24.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.050+0000 7fb8820f9640 1 -- 172.21.15.42:0/2423708732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb87c1a02c0 con 0x7fb87c107900 2024-09-19T09:36:24.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.051+0000 7fb8820f9640 1 -- 172.21.15.42:0/2423708732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb87c0fdd90 con 0x7fb87c107900 2024-09-19T09:36:24.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.052+0000 7fb8797fa640 1 -- 172.21.15.42:0/2423708732 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb874004050 con 0x7fb87c107900 2024-09-19T09:36:24.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.053+0000 7fb8797fa640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32f0 0x7fb8680a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:24.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.053+0000 7fb87b7fe640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32f0 0x7fb8680a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:24.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.053+0000 7fb8797fa640 1 -- 172.21.15.42:0/2423708732 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fb8740f05e0 con 0x7fb87c107900 2024-09-19T09:36:24.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.053+0000 7fb87b7fe640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32f0 0x7fb8680a57b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0058c0 tx=0x7fb86c005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:24.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.057+0000 7fb8797fa640 1 -- 172.21.15.42:0/2423708732 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8740bd7a0 con 0x7fb87c107900 2024-09-19T09:36:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.238+0000 7fb8820f9640 1 -- 172.21.15.42:0/2423708732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb87c02d970 con 0x7fb87c107900 2024-09-19T09:36:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.238+0000 7fb8797fa640 1 -- 172.21.15.42:0/2423708732 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fb8740bd0a0 con 0x7fb87c107900 2024-09-19T09:36:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 -- 172.21.15.42:0/2423708732 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32f0 msgr2=0x7fb8680a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32f0 0x7fb8680a57b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0058c0 tx=0x7fb86c005d30 comp rx=0 tx=0).stop 2024-09-19T09:36:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 -- 172.21.15.42:0/2423708732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c107900 msgr2=0x7fb87c19f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c107900 0x7fb87c19f4b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb874005e30 tx=0x7fb874031ee0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 -- 172.21.15.42:0/2423708732 shutdown_connections 2024-09-19T09:36:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32f0 0x7fb8680a57b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c107900 0x7fb87c19f4b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c104fd0 0x7fb87c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 --2- 172.21.15.42:0/2423708732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c1026a0 0x7fb87c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 -- 172.21.15.42:0/2423708732 >> 172.21.15.42:0/2423708732 conn(0x7fb87c0fc2a0 msgr2=0x7fb87c102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 -- 172.21.15.42:0/2423708732 shutdown_connections 2024-09-19T09:36:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:24.240+0000 7fb8820f9640 1 -- 172.21.15.42:0/2423708732 wait complete. 2024-09-19T09:36:24.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:24 smithi171 ceph-mon[35803]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T09:36:24.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:24 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2423708732' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:36:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:24 smithi136 ceph-mon[34840]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T09:36:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:24 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2423708732' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:36:24.905 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:24 smithi042 ceph-mon[31223]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T09:36:24.905 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:24 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2423708732' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:36:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1726738582,"num_in_osds":12,"osd_in_since":1726738559,"num_remapped_pgs":0} 2024-09-19T09:36:24.942 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:36:25.203 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:25.584 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:25 smithi042 ceph-mon[31223]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:25.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.663+0000 7f4c452f3640 1 -- 172.21.15.42:0/994207291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40100a80 msgr2=0x7f4c40100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:25.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.663+0000 7f4c452f3640 1 --2- 172.21.15.42:0/994207291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40100a80 0x7f4c40100ee0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4c28009930 tx=0x7f4c2802a420 comp rx=0 tx=0).stop 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.663+0000 7f4c452f3640 1 -- 172.21.15.42:0/994207291 shutdown_connections 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.663+0000 7f4c452f3640 1 --2- 172.21.15.42:0/994207291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c40101420 0x7f4c4010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.663+0000 7f4c452f3640 1 --2- 172.21.15.42:0/994207291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40100a80 0x7f4c40100ee0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.663+0000 7f4c452f3640 1 --2- 172.21.15.42:0/994207291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c40106a80 0x7f4c40106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.663+0000 7f4c452f3640 1 -- 172.21.15.42:0/994207291 >> 172.21.15.42:0/994207291 conn(0x7f4c400fc7a0 msgr2=0x7f4c400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.663+0000 7f4c452f3640 1 -- 172.21.15.42:0/994207291 shutdown_connections 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.663+0000 7f4c452f3640 1 -- 172.21.15.42:0/994207291 wait complete. 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.664+0000 7f4c452f3640 1 Processor -- start 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.664+0000 7f4c452f3640 1 -- start start 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.664+0000 7f4c452f3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c40100a80 0x7f4c401991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.664+0000 7f4c452f3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40101420 0x7f4c40199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:25.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.664+0000 7f4c452f3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c40106a80 0x7f4c401a4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.664+0000 7f4c452f3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40110e40 con 0x7f4c40101420 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.664+0000 7f4c452f3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40110cc0 con 0x7f4c40106a80 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.664+0000 7f4c452f3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40110fc0 con 0x7f4c40100a80 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c367fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40101420 0x7f4c40199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c367fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40101420 0x7f4c40199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54412/0 (socket says 172.21.15.42:54412) 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c367fc640 1 -- 172.21.15.42:0/1479832779 learned_addr learned my addr 172.21.15.42:0/1479832779 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c3f7fe640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c40106a80 0x7f4c401a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c3effd640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c40100a80 0x7f4c401991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c367fc640 1 -- 172.21.15.42:0/1479832779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c40100a80 msgr2=0x7f4c401991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c367fc640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c40100a80 0x7f4c401991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c367fc640 1 -- 172.21.15.42:0/1479832779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c40106a80 msgr2=0x7f4c401a4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c367fc640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c40106a80 0x7f4c401a4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c367fc640 1 -- 172.21.15.42:0/1479832779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c401a4790 con 0x7f4c40101420 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c367fc640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40101420 0x7f4c40199710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c28009a50 tx=0x7f4c28004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c3cff9640 1 -- 172.21.15.42:0/1479832779 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2803f030 con 0x7f4c40101420 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c3cff9640 1 -- 172.21.15.42:0/1479832779 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c28003ce0 con 0x7f4c40101420 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c452f3640 1 -- 172.21.15.42:0/1479832779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c401a4960 con 0x7f4c40101420 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c3cff9640 1 -- 172.21.15.42:0/1479832779 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28035070 con 0x7f4c40101420 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.665+0000 7f4c452f3640 1 -- 172.21.15.42:0/1479832779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c401a4db0 con 0x7f4c40101420 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.667+0000 7f4c452f3640 1 -- 172.21.15.42:0/1479832779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c40100ee0 con 0x7f4c40101420 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.669+0000 7f4c3cff9640 1 -- 172.21.15.42:0/1479832779 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4c28042030 con 0x7f4c40101420 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.669+0000 7f4c3cff9640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4c2c0a3240 0x7f4c2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.669+0000 7f4c3cff9640 1 -- 172.21.15.42:0/1479832779 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f4c280eff10 con 0x7f4c40101420 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.669+0000 7f4c3effd640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4c2c0a3240 0x7f4c2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.670+0000 7f4c3effd640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4c2c0a3240 0x7f4c2c0a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000cac0 tx=0x7f4c3000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.672+0000 7f4c3cff9640 1 -- 172.21.15.42:0/1479832779 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4c280bd0d0 con 0x7f4c40101420 2024-09-19T09:36:25.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:25 smithi171 ceph-mon[35803]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.848+0000 7f4c452f3640 1 -- 172.21.15.42:0/1479832779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c401a5010 con 0x7f4c40101420 2024-09-19T09:36:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.849+0000 7f4c3cff9640 1 -- 172.21.15.42:0/1479832779 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18516 (secure 0 0 0) 0x7f4c280bc9d0 con 0x7f4c40101420 2024-09-19T09:36:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:25.851 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":74,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:36:23.483870+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:36:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 -- 172.21.15.42:0/1479832779 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4c2c0a3240 msgr2=0x7f4c2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4c2c0a3240 0x7f4c2c0a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000cac0 tx=0x7f4c3000c4a0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 -- 172.21.15.42:0/1479832779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40101420 msgr2=0x7f4c40199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40101420 0x7f4c40199710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c28009a50 tx=0x7f4c28004270 comp rx=0 tx=0).stop 2024-09-19T09:36:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 -- 172.21.15.42:0/1479832779 shutdown_connections 2024-09-19T09:36:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4c2c0a3240 0x7f4c2c0a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4c40106a80 0x7f4c401a4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c40101420 0x7f4c40199710 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 --2- 172.21.15.42:0/1479832779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c40100a80 0x7f4c401991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 -- 172.21.15.42:0/1479832779 >> 172.21.15.42:0/1479832779 conn(0x7f4c400fc7a0 msgr2=0x7f4c400fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 -- 172.21.15.42:0/1479832779 shutdown_connections 2024-09-19T09:36:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:25.851+0000 7f4c452f3640 1 -- 172.21.15.42:0/1479832779 wait complete. 2024-09-19T09:36:25.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:25 smithi136 ceph-mon[34840]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:26.510 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:32:44.950596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:36:26.510 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T09:36:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:26.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:26 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1479832779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:26.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:26 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1479832779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:26.885 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:26 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1479832779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.244+0000 7f867dba7640 1 -- 172.21.15.42:0/2945132749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f867810c180 msgr2=0x7f867810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.244+0000 7f867dba7640 1 --2- 172.21.15.42:0/2945132749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f867810c180 0x7f867810e610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8670009ca0 tx=0x7f867002a950 comp rx=0 tx=0).stop 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.244+0000 7f867dba7640 1 -- 172.21.15.42:0/2945132749 shutdown_connections 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.244+0000 7f867dba7640 1 --2- 172.21.15.42:0/2945132749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f867810c180 0x7f867810e610 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.244+0000 7f867dba7640 1 --2- 172.21.15.42:0/2945132749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8678103700 0x7f867810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.244+0000 7f867dba7640 1 --2- 172.21.15.42:0/2945132749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8678102de0 0x7f86781031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.244+0000 7f867dba7640 1 -- 172.21.15.42:0/2945132749 >> 172.21.15.42:0/2945132749 conn(0x7f86780fc7a0 msgr2=0x7f86780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.244+0000 7f867dba7640 1 -- 172.21.15.42:0/2945132749 shutdown_connections 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.244+0000 7f867dba7640 1 -- 172.21.15.42:0/2945132749 wait complete. 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.245+0000 7f867dba7640 1 Processor -- start 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.245+0000 7f867dba7640 1 -- start start 2024-09-19T09:36:27.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f867dba7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8678102de0 0x7f8678198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f867dba7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8678103700 0x7f8678198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f867dba7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f867810c180 0x7f867819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f867dba7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8678111f50 con 0x7f8678103700 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f867dba7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8678111dd0 con 0x7f867810c180 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f867dba7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f86781120d0 con 0x7f8678102de0 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8678103700 0x7f8678198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8678103700 0x7f8678198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54430/0 (socket says 172.21.15.42:54430) 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8676ffd640 1 -- 172.21.15.42:0/3014273292 learned_addr learned my addr 172.21.15.42:0/3014273292 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8677fff640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f867810c180 0x7f867819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f86777fe640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8678102de0 0x7f8678198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8676ffd640 1 -- 172.21.15.42:0/3014273292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8678102de0 msgr2=0x7f8678198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8676ffd640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8678102de0 0x7f8678198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8676ffd640 1 -- 172.21.15.42:0/3014273292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f867810c180 msgr2=0x7f867819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8676ffd640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f867810c180 0x7f867819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8676ffd640 1 -- 172.21.15.42:0/3014273292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867819d3c0 con 0x7f8678103700 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8676ffd640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8678103700 0x7f8678198950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f866c00d770 tx=0x7f866c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f8674ff9640 1 -- 172.21.15.42:0/3014273292 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c017070 con 0x7f8678103700 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.246+0000 7f867dba7640 1 -- 172.21.15.42:0/3014273292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867819d6b0 con 0x7f8678103700 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.247+0000 7f8674ff9640 1 -- 172.21.15.42:0/3014273292 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f866c005500 con 0x7f8678103700 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.247+0000 7f8674ff9640 1 -- 172.21.15.42:0/3014273292 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c004e00 con 0x7f8678103700 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.247+0000 7f867dba7640 1 -- 172.21.15.42:0/3014273292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86781a4f90 con 0x7f8678103700 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.248+0000 7f867dba7640 1 -- 172.21.15.42:0/3014273292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86781031c0 con 0x7f8678103700 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.249+0000 7f8674ff9640 1 -- 172.21.15.42:0/3014273292 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f866c004fa0 con 0x7f8678103700 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.249+0000 7f8674ff9640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86600a3240 0x7f86600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.249+0000 7f8674ff9640 1 -- 172.21.15.42:0/3014273292 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f866c0cee80 con 0x7f8678103700 2024-09-19T09:36:27.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.249+0000 7f86777fe640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86600a3240 0x7f86600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.250+0000 7f86777fe640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86600a3240 0x7f86600a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f866800bbe0 tx=0x7f866800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:27.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.254+0000 7f8674ff9640 1 -- 172.21.15.42:0/3014273292 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f866c09b950 con 0x7f8678103700 2024-09-19T09:36:27.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.430+0000 7f867dba7640 1 -- 172.21.15.42:0/3014273292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86781072c0 con 0x7f8678103700 2024-09-19T09:36:27.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.431+0000 7f8674ff9640 1 -- 172.21.15.42:0/3014273292 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f866c09fc50 con 0x7f8678103700 2024-09-19T09:36:27.433 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 -- 172.21.15.42:0/3014273292 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86600a3240 msgr2=0x7f86600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86600a3240 0x7f86600a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f866800bbe0 tx=0x7f866800b390 comp rx=0 tx=0).stop 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 -- 172.21.15.42:0/3014273292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8678103700 msgr2=0x7f8678198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8678103700 0x7f8678198950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f866c00d770 tx=0x7f866c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 -- 172.21.15.42:0/3014273292 shutdown_connections 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86600a3240 0x7f86600a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f867810c180 0x7f867819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8678103700 0x7f8678198950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 --2- 172.21.15.42:0/3014273292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8678102de0 0x7f8678198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 -- 172.21.15.42:0/3014273292 >> 172.21.15.42:0/3014273292 conn(0x7f86780fc7a0 msgr2=0x7f86780fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:27.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 -- 172.21.15.42:0/3014273292 shutdown_connections 2024-09-19T09:36:27.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:27.433+0000 7f867dba7640 1 -- 172.21.15.42:0/3014273292 wait complete. 2024-09-19T09:36:27.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:27 smithi042 ceph-mon[31223]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:27.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:27 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3014273292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:36:27.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:27 smithi171 ceph-mon[35803]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:27.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:27 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3014273292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:36:27.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:27 smithi136 ceph-mon[34840]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:27.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:27 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3014273292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.a on smithi042 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.d on smithi042 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.g on smithi042 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.j on smithi042 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.b on smithi136 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.e on smithi136 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.h on smithi136 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.k on smithi136 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.c on smithi171 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.f on smithi171 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.i on smithi171 2024-09-19T09:36:28.001 INFO:tasks.cephadm:Adding mds.l on smithi171 2024-09-19T09:36:28.002 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l' 2024-09-19T09:36:28.261 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:36:28.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.694+0000 7f58f1f80640 1 -- 172.21.15.171:0/2964426422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58ec100290 msgr2=0x7f58ec100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.694+0000 7f58f1f80640 1 --2- 172.21.15.171:0/2964426422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58ec100290 0x7f58ec100690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009900 tx=0x7f58dc02a410 comp rx=0 tx=0).stop 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.694+0000 7f58f1f80640 1 -- 172.21.15.171:0/2964426422 shutdown_connections 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.694+0000 7f58f1f80640 1 --2- 172.21.15.171:0/2964426422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58ec101e50 0x7f58ec1086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.694+0000 7f58f1f80640 1 --2- 172.21.15.171:0/2964426422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58ec101490 0x7f58ec101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.694+0000 7f58f1f80640 1 --2- 172.21.15.171:0/2964426422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58ec100290 0x7f58ec100690 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.694+0000 7f58f1f80640 1 -- 172.21.15.171:0/2964426422 >> 172.21.15.171:0/2964426422 conn(0x7f58ec0fba40 msgr2=0x7f58ec0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.694+0000 7f58f1f80640 1 -- 172.21.15.171:0/2964426422 shutdown_connections 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.694+0000 7f58f1f80640 1 -- 172.21.15.171:0/2964426422 wait complete. 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.694+0000 7f58f1f80640 1 Processor -- start 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58f1f80640 1 -- start start 2024-09-19T09:36:28.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58f1f80640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58ec100290 0x7f58ec195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58f1f80640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58ec101490 0x7f58ec1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58f1f80640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58ec101e50 0x7f58ec19d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58f1f80640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec10b6f0 con 0x7f58ec101490 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58f1f80640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec10b570 con 0x7f58ec101e50 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58f1f80640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec10b870 con 0x7f58ec100290 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58eb7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58ec100290 0x7f58ec195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58eb7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58ec100290 0x7f58ec195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39002/0 (socket says 172.21.15.171:39002) 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58eb7fe640 1 -- 172.21.15.171:0/1350969897 learned_addr learned my addr 172.21.15.171:0/1350969897 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58e3fff640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58ec101490 0x7f58ec1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58ebfff640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58ec101e50 0x7f58ec19d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58eb7fe640 1 -- 172.21.15.171:0/1350969897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58ec101e50 msgr2=0x7f58ec19d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58eb7fe640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58ec101e50 0x7f58ec19d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58eb7fe640 1 -- 172.21.15.171:0/1350969897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58ec101490 msgr2=0x7f58ec1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:28.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58eb7fe640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58ec101490 0x7f58ec1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58eb7fe640 1 -- 172.21.15.171:0/1350969897 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec19d9b0 con 0x7f58ec100290 2024-09-19T09:36:28.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58ebfff640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58ec101e50 0x7f58ec19d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:28.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.695+0000 7f58eb7fe640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58ec100290 0x7f58ec195d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f58dc005ab0 tx=0x7f58dc004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:28.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.696+0000 7f58e97fa640 1 -- 172.21.15.171:0/1350969897 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc03f030 con 0x7f58ec100290 2024-09-19T09:36:28.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.696+0000 7f58e97fa640 1 -- 172.21.15.171:0/1350969897 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58dc003ce0 con 0x7f58ec100290 2024-09-19T09:36:28.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.696+0000 7f58e97fa640 1 -- 172.21.15.171:0/1350969897 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc035070 con 0x7f58ec100290 2024-09-19T09:36:28.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.696+0000 7f58f1f80640 1 -- 172.21.15.171:0/1350969897 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ec19dc40 con 0x7f58ec100290 2024-09-19T09:36:28.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.696+0000 7f58f1f80640 1 -- 172.21.15.171:0/1350969897 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ec19e170 con 0x7f58ec100290 2024-09-19T09:36:28.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.697+0000 7f58f1f80640 1 -- 172.21.15.171:0/1350969897 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ec107690 con 0x7f58ec100290 2024-09-19T09:36:28.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.698+0000 7f58e97fa640 1 -- 172.21.15.171:0/1350969897 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f58dc042030 con 0x7f58ec100290 2024-09-19T09:36:28.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.699+0000 7f58e97fa640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58d80a43e0 0x7f58d80a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:28.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.699+0000 7f58e97fa640 1 -- 172.21.15.171:0/1350969897 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f58dc0efb10 con 0x7f58ec100290 2024-09-19T09:36:28.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.699+0000 7f58e3fff640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58d80a43e0 0x7f58d80a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:28.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.700+0000 7f58e3fff640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58d80a43e0 0x7f58d80a68a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f58d4005e10 tx=0x7f58d4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:28.705 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.704+0000 7f58e97fa640 1 -- 172.21.15.171:0/1350969897 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58dc0bccd0 con 0x7f58ec100290 2024-09-19T09:36:28.889 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.887+0000 7f58f1f80640 1 -- 172.21.15.171:0/1350969897 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}) -- 0x7f58ec0628f0 con 0x7f58d80a43e0 2024-09-19T09:36:28.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.895+0000 7f58e97fa640 1 -- 172.21.15.171:0/1350969897 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f58ec0628f0 con 0x7f58d80a43e0 2024-09-19T09:36:28.897 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mds.all update... 2024-09-19T09:36:28.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.897+0000 7f58f1f80640 1 -- 172.21.15.171:0/1350969897 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58d80a43e0 msgr2=0x7f58d80a68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.897+0000 7f58f1f80640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58d80a43e0 0x7f58d80a68a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f58d4005e10 tx=0x7f58d4005da0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.897+0000 7f58f1f80640 1 -- 172.21.15.171:0/1350969897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58ec100290 msgr2=0x7f58ec195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.897+0000 7f58f1f80640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58ec100290 0x7f58ec195d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f58dc005ab0 tx=0x7f58dc004360 comp rx=0 tx=0).stop 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.897+0000 7f58f1f80640 1 -- 172.21.15.171:0/1350969897 shutdown_connections 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.897+0000 7f58f1f80640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58d80a43e0 0x7f58d80a68a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.897+0000 7f58f1f80640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58ec101e50 0x7f58ec19d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.897+0000 7f58f1f80640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58ec101490 0x7f58ec1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.897+0000 7f58f1f80640 1 --2- 172.21.15.171:0/1350969897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58ec100290 0x7f58ec195d90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.897+0000 7f58f1f80640 1 -- 172.21.15.171:0/1350969897 >> 172.21.15.171:0/1350969897 conn(0x7f58ec0fba40 msgr2=0x7f58ec104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.898+0000 7f58f1f80640 1 -- 172.21.15.171:0/1350969897 shutdown_connections 2024-09-19T09:36:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-19T09:36:28.898+0000 7f58f1f80640 1 -- 172.21.15.171:0/1350969897 wait complete. 2024-09-19T09:36:29.647 DEBUG:teuthology.orchestra.run.smithi042:mds.a> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T09:36:29.650 DEBUG:teuthology.orchestra.run.smithi042:mds.d> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T09:36:29.694 DEBUG:teuthology.orchestra.run.smithi042:mds.g> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T09:36:29.736 DEBUG:teuthology.orchestra.run.smithi042:mds.j> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T09:36:29.779 DEBUG:teuthology.orchestra.run.smithi136:mds.b> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T09:36:29.782 DEBUG:teuthology.orchestra.run.smithi136:mds.e> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T09:36:29.826 DEBUG:teuthology.orchestra.run.smithi136:mds.h> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T09:36:29.868 DEBUG:teuthology.orchestra.run.smithi136:mds.k> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T09:36:29.911 DEBUG:teuthology.orchestra.run.smithi171:mds.c> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T09:36:29.914 DEBUG:teuthology.orchestra.run.smithi171:mds.f> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T09:36:29.957 DEBUG:teuthology.orchestra.run.smithi171:mds.i> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T09:36:30.000 DEBUG:teuthology.orchestra.run.smithi171:mds.l> sudo journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T09:36:30.045 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T09:36:30.045 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:30.064 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:30.064 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:30.065 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: Saving service mds.all spec with placement smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-09-19T09:36:30.065 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:30.065 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:30.065 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:30.065 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:30.065 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:30.065 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:30.065 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:30.065 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:30.065 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:29 smithi171 ceph-mon[35803]: Deploying daemon mds.l on smithi171 2024-09-19T09:36:30.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:30.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:30.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: Saving service mds.all spec with placement smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-09-19T09:36:30.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:30.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:30.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:30.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:30.071 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:30.072 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:30.072 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:30.072 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:30.072 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:29 smithi042 ceph-mon[31223]: Deploying daemon mds.l on smithi171 2024-09-19T09:36:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: Saving service mds.all spec with placement smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-09-19T09:36:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:30.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:30.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:30.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:29 smithi136 ceph-mon[34840]: Deploying daemon mds.l on smithi171 2024-09-19T09:36:30.306 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.721+0000 7fa3cc397640 1 -- 172.21.15.42:0/2163706025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3c41002f0 msgr2=0x7fa3c41006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.721+0000 7fa3cc397640 1 --2- 172.21.15.42:0/2163706025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3c41002f0 0x7fa3c41006d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009930 tx=0x7fa3c002a420 comp rx=0 tx=0).stop 2024-09-19T09:36:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.721+0000 7fa3cc397640 1 -- 172.21.15.42:0/2163706025 shutdown_connections 2024-09-19T09:36:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.721+0000 7fa3cc397640 1 --2- 172.21.15.42:0/2163706025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c4106f50 0x7fa3c410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.721+0000 7fa3cc397640 1 --2- 172.21.15.42:0/2163706025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c4100ca0 0x7fa3c4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.721+0000 7fa3cc397640 1 --2- 172.21.15.42:0/2163706025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3c41002f0 0x7fa3c41006d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.721+0000 7fa3cc397640 1 -- 172.21.15.42:0/2163706025 >> 172.21.15.42:0/2163706025 conn(0x7fa3c4077210 msgr2=0x7fa3c40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3cc397640 1 -- 172.21.15.42:0/2163706025 shutdown_connections 2024-09-19T09:36:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3cc397640 1 -- 172.21.15.42:0/2163706025 wait complete. 2024-09-19T09:36:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3cc397640 1 Processor -- start 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3cc397640 1 -- start start 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3cc397640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3c41002f0 0x7fa3c419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3cc397640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c4100ca0 0x7fa3c419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3cc397640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c4106f50 0x7fa3c419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3cc397640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4112000 con 0x7fa3c41002f0 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3cc397640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4111e80 con 0x7fa3c4106f50 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3cc397640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4112180 con 0x7fa3c4100ca0 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3ca133640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3c41002f0 0x7fa3c419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3ca133640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3c41002f0 0x7fa3c419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43982/0 (socket says 172.21.15.42:43982) 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.722+0000 7fa3ca133640 1 -- 172.21.15.42:0/1763899669 learned_addr learned my addr 172.21.15.42:0/1763899669 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3c9932640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c4100ca0 0x7fa3c419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3ca934640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c4106f50 0x7fa3c419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3ca133640 1 -- 172.21.15.42:0/1763899669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c4100ca0 msgr2=0x7fa3c419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3ca133640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c4100ca0 0x7fa3c419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3ca133640 1 -- 172.21.15.42:0/1763899669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c4106f50 msgr2=0x7fa3c419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3ca133640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c4106f50 0x7fa3c419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3ca133640 1 -- 172.21.15.42:0/1763899669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c419f670 con 0x7fa3c41002f0 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3ca934640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c4106f50 0x7fa3c419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3ca133640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3c41002f0 0x7fa3c419a6c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009a50 tx=0x7fa3c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3bb7fe640 1 -- 172.21.15.42:0/1763899669 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c003f030 con 0x7fa3c41002f0 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3cc397640 1 -- 172.21.15.42:0/1763899669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c419f900 con 0x7fa3c41002f0 2024-09-19T09:36:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3bb7fe640 1 -- 172.21.15.42:0/1763899669 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3c0003ad0 con 0x7fa3c41002f0 2024-09-19T09:36:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3bb7fe640 1 -- 172.21.15.42:0/1763899669 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0035070 con 0x7fa3c41002f0 2024-09-19T09:36:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.723+0000 7fa3cc397640 1 -- 172.21.15.42:0/1763899669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c41a7240 con 0x7fa3c41002f0 2024-09-19T09:36:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.724+0000 7fa3cc397640 1 -- 172.21.15.42:0/1763899669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c41006d0 con 0x7fa3c41002f0 2024-09-19T09:36:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.726+0000 7fa3bb7fe640 1 -- 172.21.15.42:0/1763899669 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa3c0042030 con 0x7fa3c41002f0 2024-09-19T09:36:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.727+0000 7fa3bb7fe640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa3b00a3240 0x7fa3b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.727+0000 7fa3c9932640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa3b00a3240 0x7fa3b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.727+0000 7fa3bb7fe640 1 -- 172.21.15.42:0/1763899669 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fa3c00f00f0 con 0x7fa3c41002f0 2024-09-19T09:36:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.728+0000 7fa3c9932640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa3b00a3240 0x7fa3b00a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4106bd0 tx=0x7fa3b4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.730+0000 7fa3bb7fe640 1 -- 172.21.15.42:0/1763899669 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa3c00bd210 con 0x7fa3c41002f0 2024-09-19T09:36:30.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.940+0000 7fa3cc397640 1 -- 172.21.15.42:0/1763899669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3c41a7410 con 0x7fa3c41002f0 2024-09-19T09:36:30.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.941+0000 7fa3bb7fe640 1 -- 172.21.15.42:0/1763899669 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fa3c00bcb10 con 0x7fa3c41002f0 2024-09-19T09:36:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:30.943 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":1,"btime":"2024-09-19T09:29:39:578853+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T09:36:30.943 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 1 2024-09-19T09:36:30.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 -- 172.21.15.42:0/1763899669 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa3b00a3240 msgr2=0x7fa3b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:30.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa3b00a3240 0x7fa3b00a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4106bd0 tx=0x7fa3b4009110 comp rx=0 tx=0).stop 2024-09-19T09:36:30.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 -- 172.21.15.42:0/1763899669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3c41002f0 msgr2=0x7fa3c419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:30.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3c41002f0 0x7fa3c419a6c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009a50 tx=0x7fa3c0004270 comp rx=0 tx=0).stop 2024-09-19T09:36:30.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 -- 172.21.15.42:0/1763899669 shutdown_connections 2024-09-19T09:36:30.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa3b00a3240 0x7fa3b00a5700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c4106f50 0x7fa3c419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c4100ca0 0x7fa3c419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 --2- 172.21.15.42:0/1763899669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3c41002f0 0x7fa3c419a6c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 -- 172.21.15.42:0/1763899669 >> 172.21.15.42:0/1763899669 conn(0x7fa3c4077210 msgr2=0x7fa3c4105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:30.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 -- 172.21.15.42:0/1763899669 shutdown_connections 2024-09-19T09:36:30.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:30.943+0000 7fa3cc397640 1 -- 172.21.15.42:0/1763899669 wait complete. 2024-09-19T09:36:31.347 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:36:31 smithi171 systemd[1]: Starting Ceph mds.l for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:36:31.670 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:36:31 smithi171 podman[65704]: 2024-09-19 09:36:31.303186244 +0000 UTC m=+0.015869270 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:36:31.670 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:36:31 smithi171 podman[65704]: 2024-09-19 09:36:31.408214273 +0000 UTC m=+0.120897284 container create b5e61c7101ad016750892c2ad55b209951f72c7cef0159afc73666a39dc299de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:36:31.670 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:36:31 smithi171 podman[65704]: 2024-09-19 09:36:31.610463994 +0000 UTC m=+0.323147009 container init b5e61c7101ad016750892c2ad55b209951f72c7cef0159afc73666a39dc299de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T09:36:31.670 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:36:31 smithi171 podman[65704]: 2024-09-19 09:36:31.613222421 +0000 UTC m=+0.325905446 container start b5e61c7101ad016750892c2ad55b209951f72c7cef0159afc73666a39dc299de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:36:31.670 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mds[65723]: -- 172.21.15.171:0/165588670 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55768a0edc20 con 0x55768a0cb000 2024-09-19T09:36:31.670 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l[65719]: starting mds.l at 2024-09-19T09:36:31.670 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:36:31 smithi171 bash[65704]: b5e61c7101ad016750892c2ad55b209951f72c7cef0159afc73666a39dc299de 2024-09-19T09:36:32.097 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:36:31 smithi171 systemd[1]: Started Ceph mds.l for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1763899669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6832/1004485926,v1:172.21.15.171:6833/1004485926] up:boot 2024-09-19T09:36:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: fsmap 1 up:standby 2024-09-19T09:36:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:36:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:32.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:32.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:32.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:32.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:32.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:31 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:32.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:32.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1763899669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:32.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6832/1004485926,v1:172.21.15.171:6833/1004485926] up:boot 2024-09-19T09:36:32.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: fsmap 1 up:standby 2024-09-19T09:36:32.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:36:32.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:32.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:32.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:32.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:32.159 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:32.160 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:31 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:32.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:32.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1763899669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:32.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6832/1004485926,v1:172.21.15.171:6833/1004485926] up:boot 2024-09-19T09:36:32.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: fsmap 1 up:standby 2024-09-19T09:36:32.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:36:32.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:32.208 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:32.208 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:32.208 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:32.208 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:32.208 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:31 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:33.175 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:32 smithi136 ceph-mon[34840]: Deploying daemon mds.k on smithi136 2024-09-19T09:36:33.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:32 smithi042 ceph-mon[31223]: Deploying daemon mds.k on smithi136 2024-09-19T09:36:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:32 smithi171 ceph-mon[35803]: Deploying daemon mds.k on smithi136 2024-09-19T09:36:33.665 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:33.837 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:36:33 smithi136 systemd[1]: Starting Ceph mds.k for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:36:33.932 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:33.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:33 smithi042 ceph-mon[31223]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:34.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:33 smithi136 ceph-mon[34840]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:34.135 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:36:33 smithi136 podman[64172]: 2024-09-19 09:36:33.835216873 +0000 UTC m=+0.107365544 container create f9225b660dddd2a285ede26fab6febe7dac7d2c5ff806286a0d71c796858fb16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:36:34.135 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:36:33 smithi136 podman[64172]: 2024-09-19 09:36:33.743706179 +0000 UTC m=+0.015854858 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:36:34.135 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:36:34 smithi136 podman[64172]: 2024-09-19 09:36:34.054462983 +0000 UTC m=+0.326611659 container init f9225b660dddd2a285ede26fab6febe7dac7d2c5ff806286a0d71c796858fb16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:36:34.135 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:36:34 smithi136 podman[64172]: 2024-09-19 09:36:34.057502715 +0000 UTC m=+0.329651389 container start f9225b660dddd2a285ede26fab6febe7dac7d2c5ff806286a0d71c796858fb16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T09:36:34.135 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:36:34 smithi136 ceph-mds[64191]: -- 172.21.15.136:0/1405441996 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fac0ac7860 con 0x55fac0aa5400 2024-09-19T09:36:34.135 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:36:34 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k[64187]: starting mds.k at 2024-09-19T09:36:34.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:33 smithi171 ceph-mon[35803]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.371+0000 7f39cced2640 1 -- 172.21.15.42:0/3485545771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39c8100e20 msgr2=0x7f39c8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.371+0000 7f39cced2640 1 --2- 172.21.15.42:0/3485545771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39c8100e20 0x7f39c8101200 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009900 tx=0x7f39b802a480 comp rx=0 tx=0).stop 2024-09-19T09:36:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.371+0000 7f39cced2640 1 -- 172.21.15.42:0/3485545771 shutdown_connections 2024-09-19T09:36:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.371+0000 7f39cced2640 1 --2- 172.21.15.42:0/3485545771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39c8102ef0 0x7f39c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.371+0000 7f39cced2640 1 --2- 172.21.15.42:0/3485545771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39c8102570 0x7f39c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.371+0000 7f39cced2640 1 --2- 172.21.15.42:0/3485545771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39c8100e20 0x7f39c8101200 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.371+0000 7f39cced2640 1 -- 172.21.15.42:0/3485545771 >> 172.21.15.42:0/3485545771 conn(0x7f39c80fc7d0 msgr2=0x7f39c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:34.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.371+0000 7f39cced2640 1 -- 172.21.15.42:0/3485545771 shutdown_connections 2024-09-19T09:36:34.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.371+0000 7f39cced2640 1 -- 172.21.15.42:0/3485545771 wait complete. 2024-09-19T09:36:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.372+0000 7f39cced2640 1 Processor -- start 2024-09-19T09:36:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.372+0000 7f39cced2640 1 -- start start 2024-09-19T09:36:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.372+0000 7f39cced2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39c8100e20 0x7f39c81993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.372+0000 7f39cced2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39c8102570 0x7f39c8199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.372+0000 7f39cced2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39c8102ef0 0x7f39c81a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.372+0000 7f39cced2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f39c8110f50 con 0x7f39c8102570 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.372+0000 7f39cced2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f39c8110dd0 con 0x7f39c8102ef0 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.372+0000 7f39cced2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f39c81110d0 con 0x7f39c8100e20 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39c8102570 0x7f39c8199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39c8102570 0x7f39c8199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44002/0 (socket says 172.21.15.42:44002) 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bffff640 1 -- 172.21.15.42:0/2646355593 learned_addr learned my addr 172.21.15.42:0/2646355593 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39c659c640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39c8100e20 0x7f39c81993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39c6d9d640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39c8102ef0 0x7f39c81a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bffff640 1 -- 172.21.15.42:0/2646355593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39c8100e20 msgr2=0x7f39c81993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bffff640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39c8100e20 0x7f39c81993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bffff640 1 -- 172.21.15.42:0/2646355593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39c8102ef0 msgr2=0x7f39c81a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bffff640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39c8102ef0 0x7f39c81a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bffff640 1 -- 172.21.15.42:0/2646355593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c81a4980 con 0x7f39c8102570 2024-09-19T09:36:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39c6d9d640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39c8102ef0 0x7f39c81a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bffff640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39c8102570 0x7f39c8199900 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f39b000d950 tx=0x7f39b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bf7fe640 1 -- 172.21.15.42:0/2646355593 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0017030 con 0x7f39c8102570 2024-09-19T09:36:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39cced2640 1 -- 172.21.15.42:0/2646355593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c81a4b50 con 0x7f39c8102570 2024-09-19T09:36:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bf7fe640 1 -- 172.21.15.42:0/2646355593 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39b0004020 con 0x7f39c8102570 2024-09-19T09:36:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.373+0000 7f39bf7fe640 1 -- 172.21.15.42:0/2646355593 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b00047a0 con 0x7f39c8102570 2024-09-19T09:36:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.374+0000 7f39cced2640 1 -- 172.21.15.42:0/2646355593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c81a5090 con 0x7f39c8102570 2024-09-19T09:36:34.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.375+0000 7f39cced2640 1 -- 172.21.15.42:0/2646355593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c8101200 con 0x7f39c8102570 2024-09-19T09:36:34.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.376+0000 7f39bf7fe640 1 -- 172.21.15.42:0/2646355593 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f39b00041d0 con 0x7f39c8102570 2024-09-19T09:36:34.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.377+0000 7f39bf7fe640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39b40a3240 0x7f39b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.377+0000 7f39c659c640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39b40a3240 0x7f39b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.377+0000 7f39bf7fe640 1 -- 172.21.15.42:0/2646355593 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f39b00cf590 con 0x7f39c8102570 2024-09-19T09:36:34.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.377+0000 7f39c659c640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39b40a3240 0x7f39b40a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009230 tx=0x7f39b80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:34.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.380+0000 7f39bf7fe640 1 -- 172.21.15.42:0/2646355593 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f39b009c6b0 con 0x7f39c8102570 2024-09-19T09:36:34.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.603+0000 7f39cced2640 1 -- 172.21.15.42:0/2646355593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39c8109090 con 0x7f39c8102570 2024-09-19T09:36:34.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.603+0000 7f39bf7fe640 1 -- 172.21.15.42:0/2646355593 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f39b009bfb0 con 0x7f39c8102570 2024-09-19T09:36:34.605 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:34.605 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":2,"btime":"2024-09-19T09:36:31:641584+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:36:34.605 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 2 2024-09-19T09:36:34.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 -- 172.21.15.42:0/2646355593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39b40a3240 msgr2=0x7f39b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39b40a3240 0x7f39b40a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009230 tx=0x7f39b80058d0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 -- 172.21.15.42:0/2646355593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39c8102570 msgr2=0x7f39c8199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39c8102570 0x7f39c8199900 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f39b000d950 tx=0x7f39b000de10 comp rx=0 tx=0).stop 2024-09-19T09:36:34.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 -- 172.21.15.42:0/2646355593 shutdown_connections 2024-09-19T09:36:34.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39b40a3240 0x7f39b40a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39c8102ef0 0x7f39c81a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39c8102570 0x7f39c8199900 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 --2- 172.21.15.42:0/2646355593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39c8100e20 0x7f39c81993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 -- 172.21.15.42:0/2646355593 >> 172.21.15.42:0/2646355593 conn(0x7f39c80fc7d0 msgr2=0x7f39c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 -- 172.21.15.42:0/2646355593 shutdown_connections 2024-09-19T09:36:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:34.605+0000 7f39cced2640 1 -- 172.21.15.42:0/2646355593 wait complete. 2024-09-19T09:36:34.634 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:36:34 smithi136 bash[64172]: f9225b660dddd2a285ede26fab6febe7dac7d2c5ff806286a0d71c796858fb16 2024-09-19T09:36:34.635 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:36:34 smithi136 systemd[1]: Started Ceph mds.k for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: Deploying daemon mds.j on smithi042 2024-09-19T09:36:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2646355593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.136:6832/1364803362,v1:172.21.15.136:6833/1364803362] up:boot 2024-09-19T09:36:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: fsmap 2 up:standby 2024-09-19T09:36:35.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:35 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:36:35.556 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:35.556 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:35.556 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:35.556 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:35.556 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:35.556 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:35.556 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: Deploying daemon mds.j on smithi042 2024-09-19T09:36:35.556 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2646355593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:35.556 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.136:6832/1364803362,v1:172.21.15.136:6833/1364803362] up:boot 2024-09-19T09:36:35.557 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: fsmap 2 up:standby 2024-09-19T09:36:35.557 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:35 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: Deploying daemon mds.j on smithi042 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2646355593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.136:6832/1364803362,v1:172.21.15.136:6833/1364803362] up:boot 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: fsmap 2 up:standby 2024-09-19T09:36:35.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:35 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:36:36.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:36 smithi171 ceph-mon[35803]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:36 smithi136 ceph-mon[34840]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:36.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:36 smithi042 ceph-mon[31223]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:36.954 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:36:36 smithi042 systemd[1]: Starting Ceph mds.j for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:36:37.315 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:36:37 smithi042 podman[71052]: 2024-09-19 09:36:37.011559356 +0000 UTC m=+0.080352516 container create 3629a01698098222025b9815d15bc56fabc7d473a42c82fbaa933085d2988617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T09:36:37.315 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:36:37 smithi042 podman[71052]: 2024-09-19 09:36:36.947650366 +0000 UTC m=+0.016443486 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:36:37.315 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:36:37 smithi042 podman[71052]: 2024-09-19 09:36:37.213827159 +0000 UTC m=+0.282620272 container init 3629a01698098222025b9815d15bc56fabc7d473a42c82fbaa933085d2988617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:36:37.316 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:36:37 smithi042 podman[71052]: 2024-09-19 09:36:37.216917128 +0000 UTC m=+0.285710235 container start 3629a01698098222025b9815d15bc56fabc7d473a42c82fbaa933085d2988617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:36:37.316 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:36:37 smithi042 ceph-mds[71072]: -- 172.21.15.42:0/3224923580 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e2b7b71860 con 0x55e2b7b4f000 2024-09-19T09:36:37.316 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:36:37 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-j[71068]: starting mds.j at 2024-09-19T09:36:37.316 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:36:37 smithi042 bash[71052]: 3629a01698098222025b9815d15bc56fabc7d473a42c82fbaa933085d2988617 2024-09-19T09:36:37.704 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:36:37 smithi042 systemd[1]: Started Ceph mds.j for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:37.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:38.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: Deploying daemon mds.d on smithi042 2024-09-19T09:36:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.42:6834/3597931561,v1:172.21.15.42:6835/3597931561] up:boot 2024-09-19T09:36:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: fsmap 3 up:standby 2024-09-19T09:36:38.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:38 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:36:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:38.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:38.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:38.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:38.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:38.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: Deploying daemon mds.d on smithi042 2024-09-19T09:36:38.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.42:6834/3597931561,v1:172.21.15.42:6835/3597931561] up:boot 2024-09-19T09:36:38.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: fsmap 3 up:standby 2024-09-19T09:36:38.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:38 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:36:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: Deploying daemon mds.d on smithi042 2024-09-19T09:36:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.42:6834/3597931561,v1:172.21.15.42:6835/3597931561] up:boot 2024-09-19T09:36:38.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: fsmap 3 up:standby 2024-09-19T09:36:38.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:38 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:36:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:39.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.438+0000 7fd867527640 1 -- 172.21.15.42:0/3980276293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd860102db0 msgr2=0x7fd860103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.438+0000 7fd867527640 1 --2- 172.21.15.42:0/3980276293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd860102db0 0x7fd860103190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009930 tx=0x7fd85c02a420 comp rx=0 tx=0).stop 2024-09-19T09:36:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.438+0000 7fd867527640 1 -- 172.21.15.42:0/3980276293 shutdown_connections 2024-09-19T09:36:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.438+0000 7fd867527640 1 --2- 172.21.15.42:0/3980276293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8601082e0 0x7fd86010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.438+0000 7fd867527640 1 --2- 172.21.15.42:0/3980276293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd860103760 0x7fd860107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.438+0000 7fd867527640 1 --2- 172.21.15.42:0/3980276293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd860102db0 0x7fd860103190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.438+0000 7fd867527640 1 -- 172.21.15.42:0/3980276293 >> 172.21.15.42:0/3980276293 conn(0x7fd8600fc7d0 msgr2=0x7fd8600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.438+0000 7fd867527640 1 -- 172.21.15.42:0/3980276293 shutdown_connections 2024-09-19T09:36:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.438+0000 7fd867527640 1 -- 172.21.15.42:0/3980276293 wait complete. 2024-09-19T09:36:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.438+0000 7fd867527640 1 Processor -- start 2024-09-19T09:36:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd867527640 1 -- start start 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd867527640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd860102db0 0x7fd860198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd867527640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd860103760 0x7fd8601989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd867527640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8601082e0 0x7fd86019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd867527640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd860112090 con 0x7fd8601082e0 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd867527640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd860111f10 con 0x7fd860102db0 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd867527640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd860112210 con 0x7fd860103760 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd865ac4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8601082e0 0x7fd86019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd865ac4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8601082e0 0x7fd86019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44056/0 (socket says 172.21.15.42:44056) 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd865ac4640 1 -- 172.21.15.42:0/3795143190 learned_addr learned my addr 172.21.15.42:0/3795143190 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd864ac2640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd860103760 0x7fd8601989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd8652c3640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd860102db0 0x7fd860198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd865ac4640 1 -- 172.21.15.42:0/3795143190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd860103760 msgr2=0x7fd8601989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd865ac4640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd860103760 0x7fd8601989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd865ac4640 1 -- 172.21.15.42:0/3795143190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd860102db0 msgr2=0x7fd860198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd865ac4640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd860102db0 0x7fd860198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd865ac4640 1 -- 172.21.15.42:0/3795143190 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86019d430 con 0x7fd8601082e0 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.439+0000 7fd864ac2640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd860103760 0x7fd8601989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.440+0000 7fd865ac4640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8601082e0 0x7fd86019cd50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd85800cce0 tx=0x7fd85800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.440+0000 7fd8567fc640 1 -- 172.21.15.42:0/3795143190 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85800f450 con 0x7fd8601082e0 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.440+0000 7fd8567fc640 1 -- 172.21.15.42:0/3795143190 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd85800fad0 con 0x7fd8601082e0 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.440+0000 7fd8567fc640 1 -- 172.21.15.42:0/3795143190 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858018c10 con 0x7fd8601082e0 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.440+0000 7fd867527640 1 -- 172.21.15.42:0/3795143190 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86019d720 con 0x7fd8601082e0 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.440+0000 7fd867527640 1 -- 172.21.15.42:0/3795143190 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8601a5000 con 0x7fd8601082e0 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.441+0000 7fd867527640 1 -- 172.21.15.42:0/3795143190 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd86006a7d0 con 0x7fd8601082e0 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.442+0000 7fd8567fc640 1 -- 172.21.15.42:0/3795143190 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd85800f5f0 con 0x7fd8601082e0 2024-09-19T09:36:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.443+0000 7fd8567fc640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd84c0a32c0 0x7fd84c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.443+0000 7fd8652c3640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd84c0a32c0 0x7fd84c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.443+0000 7fd8567fc640 1 -- 172.21.15.42:0/3795143190 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd8580cfc20 con 0x7fd8601082e0 2024-09-19T09:36:39.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.443+0000 7fd8652c3640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd84c0a32c0 0x7fd84c0a5780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0096c0 tx=0x7fd85c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:39.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.446+0000 7fd8567fc640 1 -- 172.21.15.42:0/3795143190 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd858014030 con 0x7fd8601082e0 2024-09-19T09:36:39.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.667+0000 7fd867527640 1 -- 172.21.15.42:0/3795143190 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd860103190 con 0x7fd8601082e0 2024-09-19T09:36:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.668+0000 7fd8567fc640 1 -- 172.21.15.42:0/3795143190 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7fd860103190 con 0x7fd8601082e0 2024-09-19T09:36:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 4 2024-09-19T09:36:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:39.670 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":4,"btime":"2024-09-19T09:36:38:231394+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T09:36:39.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 -- 172.21.15.42:0/3795143190 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd84c0a32c0 msgr2=0x7fd84c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd84c0a32c0 0x7fd84c0a5780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0096c0 tx=0x7fd85c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 -- 172.21.15.42:0/3795143190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8601082e0 msgr2=0x7fd86019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8601082e0 0x7fd86019cd50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd85800cce0 tx=0x7fd85800a620 comp rx=0 tx=0).stop 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 -- 172.21.15.42:0/3795143190 shutdown_connections 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd84c0a32c0 0x7fd84c0a5780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8601082e0 0x7fd86019cd50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd860103760 0x7fd8601989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 --2- 172.21.15.42:0/3795143190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd860102db0 0x7fd860198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 -- 172.21.15.42:0/3795143190 >> 172.21.15.42:0/3795143190 conn(0x7fd8600fc7d0 msgr2=0x7fd8600fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 -- 172.21.15.42:0/3795143190 shutdown_connections 2024-09-19T09:36:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:39.670+0000 7fd867527640 1 -- 172.21.15.42:0/3795143190 wait complete. 2024-09-19T09:36:40.451 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:40 smithi042 ceph-mon[31223]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:40.451 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:40 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3795143190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:40.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:40 smithi136 ceph-mon[34840]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:40.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:40 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3795143190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:40.704 INFO:journalctl@ceph.mds.d.smithi042.stdout:Sep 19 09:36:40 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-d[71476]: starting mds.d at 2024-09-19T09:36:40.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:40 smithi171 ceph-mon[35803]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:40.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:40 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3795143190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:41.204 INFO:journalctl@ceph.mds.d.smithi042.stdout:Sep 19 09:36:40 smithi042 bash[71447]: 6c1b1321c6404f6ac6d00789af220220b2a9d43eb9d2c918e29cad88c5c1d2e1 2024-09-19T09:36:41.204 INFO:journalctl@ceph.mds.d.smithi042.stdout:Sep 19 09:36:40 smithi042 systemd[1]: Started Ceph mds.d for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: Deploying daemon mds.e on smithi136 2024-09-19T09:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.42:6836/916691394,v1:172.21.15.42:6837/916691394] up:boot 2024-09-19T09:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: fsmap 4 up:standby 2024-09-19T09:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:41 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:36:42.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:42.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:42.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:42.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:42.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:42.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:42.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:42.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: Deploying daemon mds.e on smithi136 2024-09-19T09:36:42.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.42:6836/916691394,v1:172.21.15.42:6837/916691394] up:boot 2024-09-19T09:36:42.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: fsmap 4 up:standby 2024-09-19T09:36:42.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:41 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:36:42.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:42.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:42.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:42.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:42.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:42.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:42.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:42.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: Deploying daemon mds.e on smithi136 2024-09-19T09:36:42.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.42:6836/916691394,v1:172.21.15.42:6837/916691394] up:boot 2024-09-19T09:36:42.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: fsmap 4 up:standby 2024-09-19T09:36:42.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:41 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:36:42.481 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:42.753 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:42.885 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:36:42 smithi136 systemd[1]: Starting Ceph mds.e for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:36:43.162 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:36:42 smithi136 podman[64488]: 2024-09-19 09:36:42.797504902 +0000 UTC m=+0.016324618 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:36:43.162 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:36:42 smithi136 podman[64488]: 2024-09-19 09:36:42.922241048 +0000 UTC m=+0.141060747 container create ebc698cbb58691170ed101c50bd18967b7e545cdda0177b1aa8f69b2a9e8c587 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T09:36:43.162 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:36:43 smithi136 podman[64488]: 2024-09-19 09:36:43.133530316 +0000 UTC m=+0.352350026 container init ebc698cbb58691170ed101c50bd18967b7e545cdda0177b1aa8f69b2a9e8c587 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T09:36:43.162 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:36:43 smithi136 podman[64488]: 2024-09-19 09:36:43.136332919 +0000 UTC m=+0.355152627 container start ebc698cbb58691170ed101c50bd18967b7e545cdda0177b1aa8f69b2a9e8c587 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:36:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.195+0000 7f10b557d640 1 -- 172.21.15.42:0/1239967545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10b0102570 msgr2=0x7f10b01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.195+0000 7f10b557d640 1 --2- 172.21.15.42:0/1239967545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10b0102570 0x7f10b01029b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009900 tx=0x7f10a402a480 comp rx=0 tx=0).stop 2024-09-19T09:36:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.195+0000 7f10b557d640 1 -- 172.21.15.42:0/1239967545 shutdown_connections 2024-09-19T09:36:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.195+0000 7f10b557d640 1 --2- 172.21.15.42:0/1239967545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10b0102ef0 0x7f10b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.195+0000 7f10b557d640 1 --2- 172.21.15.42:0/1239967545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10b0102570 0x7f10b01029b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.195+0000 7f10b557d640 1 --2- 172.21.15.42:0/1239967545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b0100e20 0x7f10b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.195+0000 7f10b557d640 1 -- 172.21.15.42:0/1239967545 >> 172.21.15.42:0/1239967545 conn(0x7f10b00fc7d0 msgr2=0x7f10b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.195+0000 7f10b557d640 1 -- 172.21.15.42:0/1239967545 shutdown_connections 2024-09-19T09:36:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.195+0000 7f10b557d640 1 -- 172.21.15.42:0/1239967545 wait complete. 2024-09-19T09:36:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.195+0000 7f10b557d640 1 Processor -- start 2024-09-19T09:36:43.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10b557d640 1 -- start start 2024-09-19T09:36:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10b557d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b0100e20 0x7f10b01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10b557d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10b0102570 0x7f10b01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10b557d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10b0102ef0 0x7f10b019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10b557d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0110f80 con 0x7f10b0102570 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10b557d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0110e00 con 0x7f10b0100e20 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10b557d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0111100 con 0x7f10b0102ef0 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10ae7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10b0102570 0x7f10b01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10ae7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10b0102570 0x7f10b01989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39782/0 (socket says 172.21.15.42:39782) 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10ae7fc640 1 -- 172.21.15.42:0/2086620311 learned_addr learned my addr 172.21.15.42:0/2086620311 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10aeffd640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b0100e20 0x7f10b01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10af7fe640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10b0102ef0 0x7f10b019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10ae7fc640 1 -- 172.21.15.42:0/2086620311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10b0102ef0 msgr2=0x7f10b019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10ae7fc640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10b0102ef0 0x7f10b019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10ae7fc640 1 -- 172.21.15.42:0/2086620311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b0100e20 msgr2=0x7f10b01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10ae7fc640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b0100e20 0x7f10b01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.196+0000 7f10ae7fc640 1 -- 172.21.15.42:0/2086620311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b019d460 con 0x7f10b0102570 2024-09-19T09:36:43.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.197+0000 7f10ae7fc640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10b0102570 0x7f10b01989f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f10a4006010 tx=0x7f10a4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:43.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.197+0000 7f1097fff640 1 -- 172.21.15.42:0/2086620311 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a403f070 con 0x7f10b0102570 2024-09-19T09:36:43.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.197+0000 7f1097fff640 1 -- 172.21.15.42:0/2086620311 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a4031c30 con 0x7f10b0102570 2024-09-19T09:36:43.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.197+0000 7f10b557d640 1 -- 172.21.15.42:0/2086620311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b019d6f0 con 0x7f10b0102570 2024-09-19T09:36:43.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.197+0000 7f1097fff640 1 -- 172.21.15.42:0/2086620311 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a4035030 con 0x7f10b0102570 2024-09-19T09:36:43.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.197+0000 7f10b557d640 1 -- 172.21.15.42:0/2086620311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b01a5030 con 0x7f10b0102570 2024-09-19T09:36:43.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.198+0000 7f10b557d640 1 -- 172.21.15.42:0/2086620311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b0101200 con 0x7f10b0102570 2024-09-19T09:36:43.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.199+0000 7f1097fff640 1 -- 172.21.15.42:0/2086620311 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f10a4042070 con 0x7f10b0102570 2024-09-19T09:36:43.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.200+0000 7f1097fff640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f10980a32c0 0x7f10980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.200+0000 7f10aeffd640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f10980a32c0 0x7f10980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.200+0000 7f1097fff640 1 -- 172.21.15.42:0/2086620311 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f10a40f0070 con 0x7f10b0102570 2024-09-19T09:36:43.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.200+0000 7f10aeffd640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f10980a32c0 0x7f10980a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10a0005fd0 tx=0x7f10a0009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:43.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.203+0000 7f1097fff640 1 -- 172.21.15.42:0/2086620311 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10a4031de0 con 0x7f10b0102570 2024-09-19T09:36:43.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.417+0000 7f10b557d640 1 -- 172.21.15.42:0/2086620311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10b0199810 con 0x7f10b0102570 2024-09-19T09:36:43.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.417+0000 7f1097fff640 1 -- 172.21.15.42:0/2086620311 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f10b0199810 con 0x7f10b0102570 2024-09-19T09:36:43.419 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:43.419 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":5,"btime":"2024-09-19T09:36:41:367643+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T09:36:43.419 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 5 2024-09-19T09:36:43.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 -- 172.21.15.42:0/2086620311 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f10980a32c0 msgr2=0x7f10980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f10980a32c0 0x7f10980a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10a0005fd0 tx=0x7f10a0009680 comp rx=0 tx=0).stop 2024-09-19T09:36:43.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 -- 172.21.15.42:0/2086620311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10b0102570 msgr2=0x7f10b01989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10b0102570 0x7f10b01989f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f10a4006010 tx=0x7f10a4003c10 comp rx=0 tx=0).stop 2024-09-19T09:36:43.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 -- 172.21.15.42:0/2086620311 shutdown_connections 2024-09-19T09:36:43.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f10980a32c0 0x7f10980a5780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10b0102ef0 0x7f10b019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10b0102570 0x7f10b01989f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 --2- 172.21.15.42:0/2086620311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b0100e20 0x7f10b01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 -- 172.21.15.42:0/2086620311 >> 172.21.15.42:0/2086620311 conn(0x7f10b00fc7d0 msgr2=0x7f10b006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 -- 172.21.15.42:0/2086620311 shutdown_connections 2024-09-19T09:36:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:43.419+0000 7f10b557d640 1 -- 172.21.15.42:0/2086620311 wait complete. 2024-09-19T09:36:43.635 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:36:43 smithi136 ceph-mds[64507]: -- 172.21.15.136:0/3573616450 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a678921c20 con 0x55a6788ff000 2024-09-19T09:36:43.635 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:36:43 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e[64503]: starting mds.e at 2024-09-19T09:36:43.635 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:36:43 smithi136 bash[64488]: ebc698cbb58691170ed101c50bd18967b7e545cdda0177b1aa8f69b2a9e8c587 2024-09-19T09:36:43.635 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:36:43 smithi136 systemd[1]: Started Ceph mds.e for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:44.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:44.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:44.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:44.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:44.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:44.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:44.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:44.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: Deploying daemon mds.f on smithi171 2024-09-19T09:36:44.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2086620311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:44.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.136:6834/3800275147,v1:172.21.15.136:6835/3800275147] up:boot 2024-09-19T09:36:44.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: fsmap 5 up:standby 2024-09-19T09:36:44.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:44 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: Deploying daemon mds.f on smithi171 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2086620311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.136:6834/3800275147,v1:172.21.15.136:6835/3800275147] up:boot 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: fsmap 5 up:standby 2024-09-19T09:36:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:44 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:36:44.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: Deploying daemon mds.f on smithi171 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2086620311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.136:6834/3800275147,v1:172.21.15.136:6835/3800275147] up:boot 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: fsmap 5 up:standby 2024-09-19T09:36:44.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:44 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:36:45.323 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:36:45 smithi171 systemd[1]: Starting Ceph mds.f for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:36:45.583 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:36:45 smithi171 podman[66005]: 2024-09-19 09:36:45.224501699 +0000 UTC m=+0.015588826 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:36:45.583 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:36:45 smithi171 podman[66005]: 2024-09-19 09:36:45.34319049 +0000 UTC m=+0.134277609 container create 1a3e427bc622fe3c5836b35d8c30ab697b77db098caf67c90b2846dc45dceab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:36:45.583 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:36:45 smithi171 podman[66005]: 2024-09-19 09:36:45.554185684 +0000 UTC m=+0.345272803 container init 1a3e427bc622fe3c5836b35d8c30ab697b77db098caf67c90b2846dc45dceab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:36:45.583 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:36:45 smithi171 podman[66005]: 2024-09-19 09:36:45.557828561 +0000 UTC m=+0.348915681 container start 1a3e427bc622fe3c5836b35d8c30ab697b77db098caf67c90b2846dc45dceab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:36:45.583 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:36:45 smithi171 ceph-mds[66024]: -- 172.21.15.171:0/3330152148 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55afbbe4f860 con 0x55afbbe2d400 2024-09-19T09:36:45.846 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:36:45 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f[66020]: starting mds.f at 2024-09-19T09:36:45.847 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:36:45 smithi171 bash[66005]: 1a3e427bc622fe3c5836b35d8c30ab697b77db098caf67c90b2846dc45dceab1 2024-09-19T09:36:45.847 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:36:45 smithi171 systemd[1]: Started Ceph mds.f for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:46.099 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:46.371 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:46.373 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:46 smithi171 ceph-mon[35803]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:46.373 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:46.373 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:46.373 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:46.373 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:46.373 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:46.373 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:46 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:46.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:46 smithi042 ceph-mon[31223]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:46.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:46.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:46.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:46.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:46.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:46.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:46 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:46 smithi136 ceph-mon[34840]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:46 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.809+0000 7fca8c2d1640 1 -- 172.21.15.42:0/2956894743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8410c170 msgr2=0x7fca8410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.809+0000 7fca8c2d1640 1 --2- 172.21.15.42:0/2956894743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8410c170 0x7fca8410e610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009ca0 tx=0x7fca7c02a950 comp rx=0 tx=0).stop 2024-09-19T09:36:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.809+0000 7fca8c2d1640 1 -- 172.21.15.42:0/2956894743 shutdown_connections 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.809+0000 7fca8c2d1640 1 --2- 172.21.15.42:0/2956894743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8410c170 0x7fca8410e610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.809+0000 7fca8c2d1640 1 --2- 172.21.15.42:0/2956894743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca84103660 0x7fca8410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.809+0000 7fca8c2d1640 1 --2- 172.21.15.42:0/2956894743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca84102d40 0x7fca84103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.809+0000 7fca8c2d1640 1 -- 172.21.15.42:0/2956894743 >> 172.21.15.42:0/2956894743 conn(0x7fca840fc7a0 msgr2=0x7fca840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.809+0000 7fca8c2d1640 1 -- 172.21.15.42:0/2956894743 shutdown_connections 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.809+0000 7fca8c2d1640 1 -- 172.21.15.42:0/2956894743 wait complete. 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.810+0000 7fca8c2d1640 1 Processor -- start 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.810+0000 7fca8c2d1640 1 -- start start 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.810+0000 7fca8c2d1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca84102d40 0x7fca841009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.810+0000 7fca8c2d1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca84103660 0x7fca84100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8c2d1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8410c170 0x7fca84101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8c2d1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca84111f70 con 0x7fca8410c170 2024-09-19T09:36:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8c2d1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fca84111df0 con 0x7fca84102d40 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8c2d1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fca841120f0 con 0x7fca84103660 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8a86e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8410c170 0x7fca84101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8a86e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8410c170 0x7fca84101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39804/0 (socket says 172.21.15.42:39804) 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8a86e640 1 -- 172.21.15.42:0/1534374928 learned_addr learned my addr 172.21.15.42:0/1534374928 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8a06d640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca84102d40 0x7fca841009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8986c640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca84103660 0x7fca84100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8a86e640 1 -- 172.21.15.42:0/1534374928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca84103660 msgr2=0x7fca84100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8a86e640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca84103660 0x7fca84100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8a86e640 1 -- 172.21.15.42:0/1534374928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca84102d40 msgr2=0x7fca841009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8a86e640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca84102d40 0x7fca841009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8a86e640 1 -- 172.21.15.42:0/1534374928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca841a68b0 con 0x7fca8410c170 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.811+0000 7fca8a86e640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8410c170 0x7fca84101420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca7c02ae70 tx=0x7fca7c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.812+0000 7fca7b7fe640 1 -- 172.21.15.42:0/1534374928 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c034040 con 0x7fca8410c170 2024-09-19T09:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.812+0000 7fca7b7fe640 1 -- 172.21.15.42:0/1534374928 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca7c030920 con 0x7fca8410c170 2024-09-19T09:36:46.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.812+0000 7fca8c2d1640 1 -- 172.21.15.42:0/1534374928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca841a6b40 con 0x7fca8410c170 2024-09-19T09:36:46.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.812+0000 7fca7b7fe640 1 -- 172.21.15.42:0/1534374928 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c045480 con 0x7fca8410c170 2024-09-19T09:36:46.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.812+0000 7fca8c2d1640 1 -- 172.21.15.42:0/1534374928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca841a6fb0 con 0x7fca8410c170 2024-09-19T09:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.813+0000 7fca8c2d1640 1 -- 172.21.15.42:0/1534374928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca84103120 con 0x7fca8410c170 2024-09-19T09:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.814+0000 7fca7b7fe640 1 -- 172.21.15.42:0/1534374928 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fca7c037020 con 0x7fca8410c170 2024-09-19T09:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.815+0000 7fca7b7fe640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca700a32c0 0x7fca700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.815+0000 7fca8a06d640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca700a32c0 0x7fca700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.815+0000 7fca7b7fe640 1 -- 172.21.15.42:0/1534374928 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fca7c0f02f0 con 0x7fca8410c170 2024-09-19T09:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.815+0000 7fca8a06d640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca700a32c0 0x7fca700a5780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca8000bbe0 tx=0x7fca8000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:46.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:46.819+0000 7fca7b7fe640 1 -- 172.21.15.42:0/1534374928 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fca7c0bd4b0 con 0x7fca8410c170 2024-09-19T09:36:47.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.031+0000 7fca8c2d1640 1 -- 172.21.15.42:0/1534374928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca8402d7c0 con 0x7fca8410c170 2024-09-19T09:36:47.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.031+0000 7fca7b7fe640 1 -- 172.21.15.42:0/1534374928 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5569 (secure 0 0 0) 0x7fca7c0bcdb0 con 0x7fca8410c170 2024-09-19T09:36:47.033 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:47.033 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"btime":"2024-09-19T09:36:46:301723+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-19T09:36:47.033 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-09-19T09:36:47.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.033+0000 7fca8c2d1640 1 -- 172.21.15.42:0/1534374928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca700a32c0 msgr2=0x7fca700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.033+0000 7fca8c2d1640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca700a32c0 0x7fca700a5780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca8000bbe0 tx=0x7fca8000b390 comp rx=0 tx=0).stop 2024-09-19T09:36:47.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.033+0000 7fca8c2d1640 1 -- 172.21.15.42:0/1534374928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8410c170 msgr2=0x7fca84101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.033+0000 7fca8c2d1640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8410c170 0x7fca84101420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca7c02ae70 tx=0x7fca7c02f5b0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.033+0000 7fca8c2d1640 1 -- 172.21.15.42:0/1534374928 shutdown_connections 2024-09-19T09:36:47.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.033+0000 7fca8c2d1640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca700a32c0 0x7fca700a5780 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.033+0000 7fca8c2d1640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8410c170 0x7fca84101420 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.033+0000 7fca8c2d1640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca84103660 0x7fca84100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.033+0000 7fca8c2d1640 1 --2- 172.21.15.42:0/1534374928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca84102d40 0x7fca841009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.033+0000 7fca8c2d1640 1 -- 172.21.15.42:0/1534374928 >> 172.21.15.42:0/1534374928 conn(0x7fca840fc7a0 msgr2=0x7fca840fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:47.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.034+0000 7fca8c2d1640 1 -- 172.21.15.42:0/1534374928 shutdown_connections 2024-09-19T09:36:47.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:47.034+0000 7fca8c2d1640 1 -- 172.21.15.42:0/1534374928 wait complete. 2024-09-19T09:36:47.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:47 smithi042 ceph-mon[31223]: Deploying daemon mds.c on smithi171 2024-09-19T09:36:47.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:47 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] up:boot 2024-09-19T09:36:47.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:47 smithi042 ceph-mon[31223]: fsmap 6 up:standby 2024-09-19T09:36:47.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:47 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:36:47.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:47 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1534374928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:47.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:47 smithi171 ceph-mon[35803]: Deploying daemon mds.c on smithi171 2024-09-19T09:36:47.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:47 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] up:boot 2024-09-19T09:36:47.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:47 smithi171 ceph-mon[35803]: fsmap 6 up:standby 2024-09-19T09:36:47.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:47 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:36:47.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:47 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1534374928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:47.598 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:36:47 smithi171 systemd[1]: Starting Ceph mds.c for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:36:47.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:47 smithi136 ceph-mon[34840]: Deploying daemon mds.c on smithi171 2024-09-19T09:36:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:47 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] up:boot 2024-09-19T09:36:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:47 smithi136 ceph-mon[34840]: fsmap 6 up:standby 2024-09-19T09:36:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:47 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:36:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:47 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1534374928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:47.960 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:36:47 smithi171 podman[66304]: 2024-09-19 09:36:47.599004633 +0000 UTC m=+0.016278244 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:36:47.960 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:36:47 smithi171 podman[66304]: 2024-09-19 09:36:47.721968861 +0000 UTC m=+0.139242464 container create fe1c194fe6538a8fdb19e4649f0c2dd20846ac4af273ad823a1e152b9f1ff6e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T09:36:47.960 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:36:47 smithi171 podman[66304]: 2024-09-19 09:36:47.932732766 +0000 UTC m=+0.350006371 container init fe1c194fe6538a8fdb19e4649f0c2dd20846ac4af273ad823a1e152b9f1ff6e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:36:47.960 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:36:47 smithi171 podman[66304]: 2024-09-19 09:36:47.935611252 +0000 UTC m=+0.352884857 container start fe1c194fe6538a8fdb19e4649f0c2dd20846ac4af273ad823a1e152b9f1ff6e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T09:36:48.314 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:36:47 smithi171 ceph-mds[66323]: -- 172.21.15.171:0/1498063672 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564b3e07f860 con 0x564b3e05c800 2024-09-19T09:36:48.314 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:36:47 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c[66319]: starting mds.c at 2024-09-19T09:36:48.315 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:36:48 smithi171 bash[66304]: fe1c194fe6538a8fdb19e4649f0c2dd20846ac4af273ad823a1e152b9f1ff6e6 2024-09-19T09:36:48.315 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:36:48 smithi171 systemd[1]: Started Ceph mds.c for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:48 smithi171 ceph-mon[35803]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:48 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:48 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:48 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:48 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:48 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:48 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:48 smithi136 ceph-mon[34840]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:48 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:48 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:48 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:48 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:48 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:48 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:48.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:48 smithi042 ceph-mon[31223]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:48.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:48 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:48.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:48 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:48.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:48 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:48.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:48 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:48.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:48 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:48.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:48 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:49 smithi171 ceph-mon[35803]: Deploying daemon mds.h on smithi136 2024-09-19T09:36:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:49 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] up:boot 2024-09-19T09:36:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:49 smithi171 ceph-mon[35803]: fsmap 7 up:standby 2024-09-19T09:36:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:49 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:36:49.607 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:49 smithi136 ceph-mon[34840]: Deploying daemon mds.h on smithi136 2024-09-19T09:36:49.607 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:49 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] up:boot 2024-09-19T09:36:49.608 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:49 smithi136 ceph-mon[34840]: fsmap 7 up:standby 2024-09-19T09:36:49.608 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:49 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:36:49.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:49 smithi042 ceph-mon[31223]: Deploying daemon mds.h on smithi136 2024-09-19T09:36:49.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:49 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] up:boot 2024-09-19T09:36:49.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:49 smithi042 ceph-mon[31223]: fsmap 7 up:standby 2024-09-19T09:36:49.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:49 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:36:49.799 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:50.069 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:50.326 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:36:50 smithi136 podman[64790]: 2024-09-19 09:36:50.226382367 +0000 UTC m=+0.121688036 container create 3468ae2ee97bfda14e5c4c9965ff3f7bfa1ece01561e1665a1c52d03a2c6eb31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:36:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:50 smithi042 ceph-mon[31223]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:50.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:50 smithi171 ceph-mon[35803]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:50.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.632+0000 7f557b408640 1 -- 172.21.15.42:0/3326970461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5574074ee0 msgr2=0x7f557410def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.632+0000 7f557b408640 1 --2- 172.21.15.42:0/3326970461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5574074ee0 0x7f557410def0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5564009900 tx=0x7f556402a480 comp rx=0 tx=0).stop 2024-09-19T09:36:50.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.632+0000 7f557b408640 1 -- 172.21.15.42:0/3326970461 shutdown_connections 2024-09-19T09:36:50.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.632+0000 7f557b408640 1 --2- 172.21.15.42:0/3326970461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f557410e430 0x7f5574110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.632+0000 7f557b408640 1 --2- 172.21.15.42:0/3326970461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5574074ee0 0x7f557410def0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.632+0000 7f557b408640 1 --2- 172.21.15.42:0/3326970461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55740745c0 0x7f55740749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.632+0000 7f557b408640 1 -- 172.21.15.42:0/3326970461 >> 172.21.15.42:0/3326970461 conn(0x7f55740fd8f0 msgr2=0x7f55740ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:50.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.632+0000 7f557b408640 1 -- 172.21.15.42:0/3326970461 shutdown_connections 2024-09-19T09:36:50.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.632+0000 7f557b408640 1 -- 172.21.15.42:0/3326970461 wait complete. 2024-09-19T09:36:50.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f557b408640 1 Processor -- start 2024-09-19T09:36:50.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f557b408640 1 -- start start 2024-09-19T09:36:50.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:50 smithi136 ceph-mon[34840]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:50.636 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:36:50 smithi136 podman[64790]: 2024-09-19 09:36:50.453829943 +0000 UTC m=+0.349135612 container init 3468ae2ee97bfda14e5c4c9965ff3f7bfa1ece01561e1665a1c52d03a2c6eb31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T09:36:50.636 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:36:50 smithi136 podman[64790]: 2024-09-19 09:36:50.456577838 +0000 UTC m=+0.351883508 container start 3468ae2ee97bfda14e5c4c9965ff3f7bfa1ece01561e1665a1c52d03a2c6eb31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T09:36:50.636 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:36:50 smithi136 ceph-mds[64809]: -- 172.21.15.136:0/351181342 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562abe7bf860 con 0x562abe79d400 2024-09-19T09:36:50.636 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:36:50 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h[64805]: starting mds.h at 2024-09-19T09:36:50.636 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:36:50 smithi136 bash[64790]: 3468ae2ee97bfda14e5c4c9965ff3f7bfa1ece01561e1665a1c52d03a2c6eb31 2024-09-19T09:36:50.636 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:36:50 smithi136 systemd[1]: Started Ceph mds.h for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:50.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f557b408640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740745c0 0x7f557419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f557b408640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5574074ee0 0x7f557419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f557b408640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f557410e430 0x7f557419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f557b408640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5574114190 con 0x7f55740745c0 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f557b408640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5574114010 con 0x7f557410e430 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f557b408640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5574114310 con 0x7f5574074ee0 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f55791a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740745c0 0x7f557419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f55791a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740745c0 0x7f557419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39364/0 (socket says 172.21.15.42:39364) 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f55791a4640 1 -- 172.21.15.42:0/1205189324 learned_addr learned my addr 172.21.15.42:0/1205189324 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f55799a5640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f557410e430 0x7f557419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.633+0000 7f55789a3640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5574074ee0 0x7f557419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.634+0000 7f55791a4640 1 -- 172.21.15.42:0/1205189324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5574074ee0 msgr2=0x7f557419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.634+0000 7f55791a4640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5574074ee0 0x7f557419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.634+0000 7f55791a4640 1 -- 172.21.15.42:0/1205189324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f557410e430 msgr2=0x7f557419efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.634+0000 7f55791a4640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f557410e430 0x7f557419efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.634+0000 7f55791a4640 1 -- 172.21.15.42:0/1205189324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557419f690 con 0x7f55740745c0 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.634+0000 7f55791a4640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740745c0 0x7f557419a6e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f557000e9f0 tx=0x7f557000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.636+0000 7f556a7fc640 1 -- 172.21.15.42:0/1205189324 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557000cd80 con 0x7f55740745c0 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.636+0000 7f556a7fc640 1 -- 172.21.15.42:0/1205189324 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5570005500 con 0x7f55740745c0 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.636+0000 7f557b408640 1 -- 172.21.15.42:0/1205189324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557419f980 con 0x7f55740745c0 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.636+0000 7f556a7fc640 1 -- 172.21.15.42:0/1205189324 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570010690 con 0x7f55740745c0 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.636+0000 7f557b408640 1 -- 172.21.15.42:0/1205189324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55741a7260 con 0x7f55740745c0 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.637+0000 7f557b408640 1 -- 172.21.15.42:0/1205189324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55740749a0 con 0x7f55740745c0 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.638+0000 7f556a7fc640 1 -- 172.21.15.42:0/1205189324 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f55700046c0 con 0x7f55740745c0 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.639+0000 7f556a7fc640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f55600a3240 0x7f55600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.639+0000 7f55789a3640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f55600a3240 0x7f55600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.639+0000 7f556a7fc640 1 -- 172.21.15.42:0/1205189324 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f55700cfa80 con 0x7f55740745c0 2024-09-19T09:36:50.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.639+0000 7f55789a3640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f55600a3240 0x7f55600a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5564009230 tx=0x7f55640058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:50.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.642+0000 7f556a7fc640 1 -- 172.21.15.42:0/1205189324 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5570054210 con 0x7f55740745c0 2024-09-19T09:36:50.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.853+0000 7f557b408640 1 -- 172.21.15.42:0/1205189324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f557419ba40 con 0x7f55740745c0 2024-09-19T09:36:50.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.854+0000 7f556a7fc640 1 -- 172.21.15.42:0/1205189324 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f557419ba40 con 0x7f55740745c0 2024-09-19T09:36:50.914 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:50.914 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-19T09:36:48:312685+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T09:36:50.914 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 -- 172.21.15.42:0/1205189324 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f55600a3240 msgr2=0x7f55600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f55600a3240 0x7f55600a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5564009230 tx=0x7f55640058d0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 -- 172.21.15.42:0/1205189324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740745c0 msgr2=0x7f557419a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740745c0 0x7f557419a6e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f557000e9f0 tx=0x7f557000edf0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 -- 172.21.15.42:0/1205189324 shutdown_connections 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f55600a3240 0x7f55600a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f557410e430 0x7f557419efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5574074ee0 0x7f557419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 --2- 172.21.15.42:0/1205189324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740745c0 0x7f557419a6e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 -- 172.21.15.42:0/1205189324 >> 172.21.15.42:0/1205189324 conn(0x7f55740fd8f0 msgr2=0x7f55740fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 -- 172.21.15.42:0/1205189324 shutdown_connections 2024-09-19T09:36:50.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:50.856+0000 7f557b408640 1 -- 172.21.15.42:0/1205189324 wait complete. 2024-09-19T09:36:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: Deploying daemon mds.i on smithi171 2024-09-19T09:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1205189324' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] up:boot 2024-09-19T09:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: fsmap 8 up:standby 2024-09-19T09:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:51 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:36:51.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:51.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:51.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:51.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:51.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:51.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:51.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:51.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: Deploying daemon mds.i on smithi171 2024-09-19T09:36:51.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1205189324' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:51.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] up:boot 2024-09-19T09:36:51.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: fsmap 8 up:standby 2024-09-19T09:36:51.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:51 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:36:52.015 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:52.015 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:52.015 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:52.015 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:52.015 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:52.015 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:52.015 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:52.016 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: Deploying daemon mds.i on smithi171 2024-09-19T09:36:52.016 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1205189324' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:52.016 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] up:boot 2024-09-19T09:36:52.016 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: fsmap 8 up:standby 2024-09-19T09:36:52.016 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:51 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:36:52.597 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:36:52 smithi171 systemd[1]: Starting Ceph mds.i for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:36:52.970 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:36:52 smithi171 podman[66603]: 2024-09-19 09:36:52.707889586 +0000 UTC m=+0.106587154 container create 61a5122301e2aa28d1951f1d0490d0530b8ae05f5eb12670a86262a1357eae88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T09:36:52.971 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:36:52 smithi171 podman[66603]: 2024-09-19 09:36:52.617381206 +0000 UTC m=+0.016078779 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:36:52.971 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:36:52 smithi171 podman[66603]: 2024-09-19 09:36:52.943584745 +0000 UTC m=+0.342282309 container init 61a5122301e2aa28d1951f1d0490d0530b8ae05f5eb12670a86262a1357eae88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:36:52.971 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:36:52 smithi171 podman[66603]: 2024-09-19 09:36:52.946343526 +0000 UTC m=+0.345041091 container start 61a5122301e2aa28d1951f1d0490d0530b8ae05f5eb12670a86262a1357eae88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:36:53.347 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:36:52 smithi171 ceph-mds[66622]: -- 172.21.15.171:0/1037490191 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612dcbd3860 con 0x5612dcbb1400 2024-09-19T09:36:53.347 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:36:52 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i[66618]: starting mds.i at 2024-09-19T09:36:53.347 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:36:53 smithi171 bash[66603]: 61a5122301e2aa28d1951f1d0490d0530b8ae05f5eb12670a86262a1357eae88 2024-09-19T09:36:53.347 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:36:53 smithi171 systemd[1]: Started Ceph mds.i for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:53.632 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: Deploying daemon mds.g on smithi042 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] up:boot 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: fsmap 9 up:standby 2024-09-19T09:36:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:54 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:36:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:54.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: Deploying daemon mds.g on smithi042 2024-09-19T09:36:54.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] up:boot 2024-09-19T09:36:54.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: fsmap 9 up:standby 2024-09-19T09:36:54.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:54 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:36:54.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: Deploying daemon mds.g on smithi042 2024-09-19T09:36:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] up:boot 2024-09-19T09:36:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: fsmap 9 up:standby 2024-09-19T09:36:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:54 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:36:54.859 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:55.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.439+0000 7fbce8a07640 1 -- 172.21.15.42:0/597420945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4106f10 msgr2=0x7fbce410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.439+0000 7fbce8a07640 1 --2- 172.21.15.42:0/597420945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4106f10 0x7fbce410ea90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009ca0 tx=0x7fbcdc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.439+0000 7fbce8a07640 1 -- 172.21.15.42:0/597420945 shutdown_connections 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.439+0000 7fbce8a07640 1 --2- 172.21.15.42:0/597420945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4106f10 0x7fbce410ea90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.439+0000 7fbce8a07640 1 --2- 172.21.15.42:0/597420945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4102790 0x7fbce41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.439+0000 7fbce8a07640 1 --2- 172.21.15.42:0/597420945 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4101de0 0x7fbce41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.439+0000 7fbce8a07640 1 -- 172.21.15.42:0/597420945 >> 172.21.15.42:0/597420945 conn(0x7fbce40fd8c0 msgr2=0x7fbce40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.439+0000 7fbce8a07640 1 -- 172.21.15.42:0/597420945 shutdown_connections 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.439+0000 7fbce8a07640 1 -- 172.21.15.42:0/597420945 wait complete. 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce8a07640 1 Processor -- start 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce8a07640 1 -- start start 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce8a07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce8a07640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4102790 0x7fbce4198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce8a07640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 0x7fbce419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce8a07640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4111fc0 con 0x7fbce4101de0 2024-09-19T09:36:55.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce8a07640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4111e40 con 0x7fbce4106f10 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce8a07640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4112140 con 0x7fbce4102790 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce41983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39382/0 (socket says 172.21.15.42:39382) 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce259c640 1 -- 172.21.15.42:0/3934916593 learned_addr learned my addr 172.21.15.42:0/3934916593 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce1d9b640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4102790 0x7fbce4198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce2d9d640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 0x7fbce419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce259c640 1 -- 172.21.15.42:0/3934916593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4102790 msgr2=0x7fbce4198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce259c640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4102790 0x7fbce4198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce259c640 1 -- 172.21.15.42:0/3934916593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 msgr2=0x7fbce419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce259c640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 0x7fbce419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce259c640 1 -- 172.21.15.42:0/3934916593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce419d380 con 0x7fbce4101de0 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.440+0000 7fbce2d9d640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 0x7fbce419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.441+0000 7fbce259c640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce41983d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400d770 tx=0x7fbcd400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:55.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.441+0000 7fbcd37fe640 1 -- 172.21.15.42:0/3934916593 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4017070 con 0x7fbce4101de0 2024-09-19T09:36:55.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.441+0000 7fbce8a07640 1 -- 172.21.15.42:0/3934916593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce419d670 con 0x7fbce4101de0 2024-09-19T09:36:55.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.441+0000 7fbcd37fe640 1 -- 172.21.15.42:0/3934916593 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd4005500 con 0x7fbce4101de0 2024-09-19T09:36:55.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.441+0000 7fbcd37fe640 1 -- 172.21.15.42:0/3934916593 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4004e00 con 0x7fbce4101de0 2024-09-19T09:36:55.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.441+0000 7fbce8a07640 1 -- 172.21.15.42:0/3934916593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce41a4f50 con 0x7fbce4101de0 2024-09-19T09:36:55.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.442+0000 7fbce8a07640 1 -- 172.21.15.42:0/3934916593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce41021c0 con 0x7fbce4101de0 2024-09-19T09:36:55.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.443+0000 7fbcd37fe640 1 -- 172.21.15.42:0/3934916593 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbcd4004fa0 con 0x7fbce4101de0 2024-09-19T09:36:55.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.444+0000 7fbcd37fe640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbccc0a3240 0x7fbccc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.444+0000 7fbcd37fe640 1 -- 172.21.15.42:0/3934916593 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fbcd40ceea0 con 0x7fbce4101de0 2024-09-19T09:36:55.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.444+0000 7fbce1d9b640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbccc0a3240 0x7fbccc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.444+0000 7fbce1d9b640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbccc0a3240 0x7fbccc0a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbce4108870 tx=0x7fbcd800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:55.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.448+0000 7fbcd37fe640 1 -- 172.21.15.42:0/3934916593 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbcd409c060 con 0x7fbce4101de0 2024-09-19T09:36:55.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.669+0000 7fbce8a07640 1 -- 172.21.15.42:0/3934916593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbce410a1b0 con 0x7fbce4101de0 2024-09-19T09:36:55.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.670+0000 7fbcd37fe640 1 -- 172.21.15.42:0/3934916593 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7fbcd409b960 con 0x7fbce4101de0 2024-09-19T09:36:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:55.672 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"btime":"2024-09-19T09:36:53:622820+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T09:36:55.672 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 -- 172.21.15.42:0/3934916593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbccc0a3240 msgr2=0x7fbccc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbccc0a3240 0x7fbccc0a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbce4108870 tx=0x7fbcd800b410 comp rx=0 tx=0).stop 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 -- 172.21.15.42:0/3934916593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 msgr2=0x7fbce41983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce41983d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400d770 tx=0x7fbcd400dc30 comp rx=0 tx=0).stop 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 -- 172.21.15.42:0/3934916593 shutdown_connections 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbccc0a3240 0x7fbccc0a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 0x7fbce419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4102790 0x7fbce4198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 --2- 172.21.15.42:0/3934916593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce41983d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 -- 172.21.15.42:0/3934916593 >> 172.21.15.42:0/3934916593 conn(0x7fbce40fd8c0 msgr2=0x7fbce40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 -- 172.21.15.42:0/3934916593 shutdown_connections 2024-09-19T09:36:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:55.672+0000 7fbce8a07640 1 -- 172.21.15.42:0/3934916593 wait complete. 2024-09-19T09:36:56.280 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:56 smithi042 ceph-mon[31223]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:56.281 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:56 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3934916593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:56.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:56 smithi171 ceph-mon[35803]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:56.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:56 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3934916593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:56.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:56 smithi136 ceph-mon[34840]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:56.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:56 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3934916593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:56.704 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:36:56 smithi042 systemd[1]: Started Ceph mds.g for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:57.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:57.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:57.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:57.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:57.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:57.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:57.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:57.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: Deploying daemon mds.a on smithi042 2024-09-19T09:36:57.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.42:6838/3152711275,v1:172.21.15.42:6839/3152711275] up:boot 2024-09-19T09:36:57.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: fsmap 10 up:standby 2024-09-19T09:36:57.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:57 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:36:57.879 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:57.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:57.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:57.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:57.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:57.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:57.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:57.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: Deploying daemon mds.a on smithi042 2024-09-19T09:36:57.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.42:6838/3152711275,v1:172.21.15.42:6839/3152711275] up:boot 2024-09-19T09:36:57.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: fsmap 10 up:standby 2024-09-19T09:36:57.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:57 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:36:57.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:36:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: Deploying daemon mds.a on smithi042 2024-09-19T09:36:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.42:6838/3152711275,v1:172.21.15.42:6839/3152711275] up:boot 2024-09-19T09:36:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: fsmap 10 up:standby 2024-09-19T09:36:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:57 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:36:58.313 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:58.454 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:36:58 smithi042 systemd[1]: Starting Ceph mds.a for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:36:58.935 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:36:58 smithi042 podman[72560]: 2024-09-19 09:36:58.521343623 +0000 UTC m=+0.020917267 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:36:58.935 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:36:58 smithi042 podman[72560]: 2024-09-19 09:36:58.648488608 +0000 UTC m=+0.148062249 container create 1dc74a60140c9fce22dcf9a19faef85290056b0f2554e036f1a16525c5793f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T09:36:58.935 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:36:58 smithi042 podman[72560]: 2024-09-19 09:36:58.834002729 +0000 UTC m=+0.333576380 container init 1dc74a60140c9fce22dcf9a19faef85290056b0f2554e036f1a16525c5793f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T09:36:58.935 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:36:58 smithi042 podman[72560]: 2024-09-19 09:36:58.837038235 +0000 UTC m=+0.336611878 container start 1dc74a60140c9fce22dcf9a19faef85290056b0f2554e036f1a16525c5793f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:36:58.936 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:36:58 smithi042 ceph-mds[72606]: -- 172.21.15.42:0/3046727107 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5625a4f3bc20 con 0x5625a4f18800 2024-09-19T09:36:58.936 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:36:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a[72589]: starting mds.a at 2024-09-19T09:36:58.936 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:36:58 smithi042 bash[72560]: 1dc74a60140c9fce22dcf9a19faef85290056b0f2554e036f1a16525c5793f87 2024-09-19T09:36:58.974 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:59.204 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:36:58 smithi042 systemd[1]: Started Ceph mds.a for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:59.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.403+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/932637226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd78103640 msgr2=0x7fbd7810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.403+0000 7fbd7e1bc640 1 --2- 172.21.15.42:0/932637226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd78103640 0x7fbd7810bb30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009900 tx=0x7fbd6c02a480 comp rx=0 tx=0).stop 2024-09-19T09:36:59.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.403+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/932637226 shutdown_connections 2024-09-19T09:36:59.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.403+0000 7fbd7e1bc640 1 --2- 172.21.15.42:0/932637226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd7810c150 0x7fbd7810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.403+0000 7fbd7e1bc640 1 --2- 172.21.15.42:0/932637226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd78103640 0x7fbd7810bb30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.403+0000 7fbd7e1bc640 1 --2- 172.21.15.42:0/932637226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd78102d20 0x7fbd78103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.403+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/932637226 >> 172.21.15.42:0/932637226 conn(0x7fbd780fc780 msgr2=0x7fbd780feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.403+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/932637226 shutdown_connections 2024-09-19T09:36:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.403+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/932637226 wait complete. 2024-09-19T09:36:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.404+0000 7fbd7e1bc640 1 Processor -- start 2024-09-19T09:36:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.404+0000 7fbd7e1bc640 1 -- start start 2024-09-19T09:36:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.404+0000 7fbd7e1bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd78102d20 0x7fbd781984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.404+0000 7fbd7e1bc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd78103640 0x7fbd781989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.404+0000 7fbd7e1bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7810c150 0x7fbd7819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.404+0000 7fbd7e1bc640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbd78111f50 con 0x7fbd7810c150 2024-09-19T09:36:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd7e1bc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbd78111dd0 con 0x7fbd78103640 2024-09-19T09:36:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd7e1bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781120d0 con 0x7fbd78102d20 2024-09-19T09:36:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7810c150 0x7fbd7819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7810c150 0x7fbd7819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39434/0 (socket says 172.21.15.42:39434) 2024-09-19T09:36:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd77fff640 1 -- 172.21.15.42:0/2381946108 learned_addr learned my addr 172.21.15.42:0/2381946108 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:36:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd76ffd640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd78103640 0x7fbd781989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd777fe640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd78102d20 0x7fbd781984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd77fff640 1 -- 172.21.15.42:0/2381946108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd78102d20 msgr2=0x7fbd781984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd77fff640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd78102d20 0x7fbd781984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd77fff640 1 -- 172.21.15.42:0/2381946108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd78103640 msgr2=0x7fbd781989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd77fff640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd78103640 0x7fbd781989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd77fff640 1 -- 172.21.15.42:0/2381946108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7819d450 con 0x7fbd7810c150 2024-09-19T09:36:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd76ffd640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd78103640 0x7fbd781989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd77fff640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7810c150 0x7fbd7819cd70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000eaa0 tx=0x7fbd7000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd74ff9640 1 -- 172.21.15.42:0/2381946108 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000cdb0 con 0x7fbd7810c150 2024-09-19T09:36:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/2381946108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7819d740 con 0x7fbd7810c150 2024-09-19T09:36:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd74ff9640 1 -- 172.21.15.42:0/2381946108 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd70005020 con 0x7fbd7810c150 2024-09-19T09:36:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.405+0000 7fbd74ff9640 1 -- 172.21.15.42:0/2381946108 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd700116b0 con 0x7fbd7810c150 2024-09-19T09:36:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.406+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/2381946108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd781a5020 con 0x7fbd7810c150 2024-09-19T09:36:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.406+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/2381946108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd78103100 con 0x7fbd7810c150 2024-09-19T09:36:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.408+0000 7fbd74ff9640 1 -- 172.21.15.42:0/2381946108 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbd70005560 con 0x7fbd7810c150 2024-09-19T09:36:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.409+0000 7fbd74ff9640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbd600a3240 0x7fbd600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.409+0000 7fbd777fe640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbd600a3240 0x7fbd600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.409+0000 7fbd74ff9640 1 -- 172.21.15.42:0/2381946108 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fbd700cfa20 con 0x7fbd7810c150 2024-09-19T09:36:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.409+0000 7fbd777fe640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbd600a3240 0x7fbd600a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbd68005fd0 tx=0x7fbd68005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.412+0000 7fbd74ff9640 1 -- 172.21.15.42:0/2381946108 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd70016030 con 0x7fbd7810c150 2024-09-19T09:36:59.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.626+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/2381946108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd7802d7c0 con 0x7fbd7810c150 2024-09-19T09:36:59.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.627+0000 7fbd74ff9640 1 -- 172.21.15.42:0/2381946108 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7fbd7009cb80 con 0x7fbd7810c150 2024-09-19T09:36:59.629 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:36:59.629 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":12,"btime":"2024-09-19T09:36:59:552749+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T09:36:59.630 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 12 2024-09-19T09:36:59.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.629+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/2381946108 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbd600a3240 msgr2=0x7fbd600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.629+0000 7fbd7e1bc640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbd600a3240 0x7fbd600a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbd68005fd0 tx=0x7fbd68005850 comp rx=0 tx=0).stop 2024-09-19T09:36:59.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.629+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/2381946108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7810c150 msgr2=0x7fbd7819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.629+0000 7fbd7e1bc640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7810c150 0x7fbd7819cd70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000eaa0 tx=0x7fbd7000ef60 comp rx=0 tx=0).stop 2024-09-19T09:36:59.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.629+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/2381946108 shutdown_connections 2024-09-19T09:36:59.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.629+0000 7fbd7e1bc640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbd600a3240 0x7fbd600a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.629+0000 7fbd7e1bc640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7810c150 0x7fbd7819cd70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.629+0000 7fbd7e1bc640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd78103640 0x7fbd781989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.629+0000 7fbd7e1bc640 1 --2- 172.21.15.42:0/2381946108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd78102d20 0x7fbd781984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.629+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/2381946108 >> 172.21.15.42:0/2381946108 conn(0x7fbd780fc780 msgr2=0x7fbd780fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:59.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.630+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/2381946108 shutdown_connections 2024-09-19T09:36:59.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:36:59.630+0000 7fbd7e1bc640 1 -- 172.21.15.42:0/2381946108 wait complete. 2024-09-19T09:37:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:37:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:37:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: Deploying daemon mds.b on smithi136 2024-09-19T09:37:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.42:6840/649947071,v1:172.21.15.42:6841/649947071] up:boot 2024-09-19T09:37:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: fsmap 11 up:standby 2024-09-19T09:37:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:37:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:36:59 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2381946108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:00.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: Deploying daemon mds.b on smithi136 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.42:6840/649947071,v1:172.21.15.42:6841/649947071] up:boot 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: fsmap 11 up:standby 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:37:00.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:36:59 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2381946108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:00.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:00.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:00.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:00.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:00.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:37:00.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:37:00.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:00.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: Deploying daemon mds.b on smithi136 2024-09-19T09:37:00.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.42:6840/649947071,v1:172.21.15.42:6841/649947071] up:boot 2024-09-19T09:37:00.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: fsmap 11 up:standby 2024-09-19T09:37:00.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:37:00.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:36:59 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2381946108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:01.135 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:00 smithi136 systemd[1]: Starting Ceph mds.b for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:37:01.418 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:01 smithi136 podman[65101]: 2024-09-19 09:37:01.146604615 +0000 UTC m=+0.094577364 container create 4cc887f8444997cc0a0da998fe4542048135c6372cf9eda6f990e3d1dff161ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:37:01.418 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:01 smithi136 podman[65101]: 2024-09-19 09:37:01.068018976 +0000 UTC m=+0.015991674 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:37:01.418 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:01 smithi136 podman[65101]: 2024-09-19 09:37:01.390552929 +0000 UTC m=+0.338525616 container init 4cc887f8444997cc0a0da998fe4542048135c6372cf9eda6f990e3d1dff161ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:37:01.419 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:01 smithi136 podman[65101]: 2024-09-19 09:37:01.39337449 +0000 UTC m=+0.341347184 container start 4cc887f8444997cc0a0da998fe4542048135c6372cf9eda6f990e3d1dff161ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T09:37:01.419 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:01 smithi136 ceph-mds[65120]: -- 172.21.15.136:0/3966686077 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b35970d860 con 0x55b3596eb400 2024-09-19T09:37:01.885 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:01 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b[65116]: starting mds.b at 2024-09-19T09:37:01.885 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:01 smithi136 bash[65101]: 4cc887f8444997cc0a0da998fe4542048135c6372cf9eda6f990e3d1dff161ca 2024-09-19T09:37:01.885 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:01 smithi136 systemd[1]: Started Ceph mds.b for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:37:02.281 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:02.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:02 smithi136 ceph-mon[34840]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:02.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:02 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:02 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:02 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:02 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:02 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:02 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:02 smithi171 ceph-mon[35803]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:02 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:02 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:02 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:02 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:02 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:02 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:02.306 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:02 smithi042 ceph-mon[31223]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:02.306 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:02 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.306 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:02 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.306 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:02 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.306 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:02 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.306 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:02 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:02.306 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:02 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:02.878 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:03.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:03 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] up:boot 2024-09-19T09:37:03.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:03 smithi042 ceph-mon[31223]: fsmap 12 up:standby 2024-09-19T09:37:03.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:03 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:37:03.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:03 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] up:boot 2024-09-19T09:37:03.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:03 smithi171 ceph-mon[35803]: fsmap 12 up:standby 2024-09-19T09:37:03.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:03 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.363+0000 7f1c165f6640 1 -- 172.21.15.42:0/1879794019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c10106f10 msgr2=0x7f1c1010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.363+0000 7f1c165f6640 1 --2- 172.21.15.42:0/1879794019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c10106f10 0x7f1c1010ea90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c08009ca0 tx=0x7f1c0802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.364+0000 7f1c165f6640 1 -- 172.21.15.42:0/1879794019 shutdown_connections 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.364+0000 7f1c165f6640 1 --2- 172.21.15.42:0/1879794019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c10106f10 0x7f1c1010ea90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.364+0000 7f1c165f6640 1 --2- 172.21.15.42:0/1879794019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c10102790 0x7f1c101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.364+0000 7f1c165f6640 1 --2- 172.21.15.42:0/1879794019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c10101de0 0x7f1c101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.364+0000 7f1c165f6640 1 -- 172.21.15.42:0/1879794019 >> 172.21.15.42:0/1879794019 conn(0x7f1c100fd8c0 msgr2=0x7f1c100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.364+0000 7f1c165f6640 1 -- 172.21.15.42:0/1879794019 shutdown_connections 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.364+0000 7f1c165f6640 1 -- 172.21.15.42:0/1879794019 wait complete. 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.364+0000 7f1c165f6640 1 Processor -- start 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.364+0000 7f1c165f6640 1 -- start start 2024-09-19T09:37:03.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c165f6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c10101de0 0x7f1c1019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c165f6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c10102790 0x7f1c1019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c165f6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c10106f10 0x7f1c1019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c165f6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10111f70 con 0x7f1c10101de0 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c165f6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10111df0 con 0x7f1c10106f10 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c165f6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1c101120f0 con 0x7f1c10102790 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c10101de0 0x7f1c1019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c10101de0 0x7f1c1019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58378/0 (socket says 172.21.15.42:58378) 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0ffff640 1 -- 172.21.15.42:0/3742446717 learned_addr learned my addr 172.21.15.42:0/3742446717 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0f7fe640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c10102790 0x7f1c1019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c14b93640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c10106f10 0x7f1c1019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0ffff640 1 -- 172.21.15.42:0/3742446717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c10102790 msgr2=0x7f1c1019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0ffff640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c10102790 0x7f1c1019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0ffff640 1 -- 172.21.15.42:0/3742446717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c10106f10 msgr2=0x7f1c1019eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0ffff640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c10106f10 0x7f1c1019eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0ffff640 1 -- 172.21.15.42:0/3742446717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1019f580 con 0x7f1c10101de0 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0ffff640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c10101de0 0x7f1c1019a5d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000e9f0 tx=0x7f1c0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0d7fa640 1 -- 172.21.15.42:0/3742446717 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000cd80 con 0x7f1c10101de0 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c165f6640 1 -- 172.21.15.42:0/3742446717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1019f870 con 0x7f1c10101de0 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0d7fa640 1 -- 172.21.15.42:0/3742446717 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c00010910 con 0x7f1c10101de0 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c0d7fa640 1 -- 172.21.15.42:0/3742446717 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00018990 con 0x7f1c10101de0 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.365+0000 7f1c165f6640 1 -- 172.21.15.42:0/3742446717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c101a7150 con 0x7f1c10101de0 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.367+0000 7f1c165f6640 1 -- 172.21.15.42:0/3742446717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c101021c0 con 0x7f1c10101de0 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.369+0000 7f1c0d7fa640 1 -- 172.21.15.42:0/3742446717 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1c00010ac0 con 0x7f1c10101de0 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.369+0000 7f1c0d7fa640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1bfc0a3240 0x7f1bfc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.369+0000 7f1c0f7fe640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1bfc0a3240 0x7f1bfc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.369+0000 7f1c0d7fa640 1 -- 172.21.15.42:0/3742446717 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f1c000cfc70 con 0x7f1c10101de0 2024-09-19T09:37:03.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.370+0000 7f1c0f7fe640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1bfc0a3240 0x7f1bfc0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c100ff6e0 tx=0x7f1bf8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:03.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.373+0000 7f1c0d7fa640 1 -- 172.21.15.42:0/3742446717 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c0009ce30 con 0x7f1c10101de0 2024-09-19T09:37:03.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:03 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] up:boot 2024-09-19T09:37:03.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:03 smithi136 ceph-mon[34840]: fsmap 12 up:standby 2024-09-19T09:37:03.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:03 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:37:03.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.616+0000 7f1c165f6640 1 -- 172.21.15.42:0/3742446717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c101a7440 con 0x7f1c10101de0 2024-09-19T09:37:03.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.617+0000 7f1c0d7fa640 1 -- 172.21.15.42:0/3742446717 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10530 (secure 0 0 0) 0x7f1c0009c730 con 0x7f1c10101de0 2024-09-19T09:37:03.619 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:03.619 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":13,"btime":"2024-09-19T09:37:01:994083+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T09:37:03.619 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 13 2024-09-19T09:37:03.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.619+0000 7f1c165f6640 1 -- 172.21.15.42:0/3742446717 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1bfc0a3240 msgr2=0x7f1bfc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.619+0000 7f1c165f6640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1bfc0a3240 0x7f1bfc0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c100ff6e0 tx=0x7f1bf8005f90 comp rx=0 tx=0).stop 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.619+0000 7f1c165f6640 1 -- 172.21.15.42:0/3742446717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c10101de0 msgr2=0x7f1c1019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.619+0000 7f1c165f6640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c10101de0 0x7f1c1019a5d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000e9f0 tx=0x7f1c0000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.619+0000 7f1c165f6640 1 -- 172.21.15.42:0/3742446717 shutdown_connections 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.619+0000 7f1c165f6640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1bfc0a3240 0x7f1bfc0a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.619+0000 7f1c165f6640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c10106f10 0x7f1c1019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.619+0000 7f1c165f6640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c10102790 0x7f1c1019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.619+0000 7f1c165f6640 1 --2- 172.21.15.42:0/3742446717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c10101de0 0x7f1c1019a5d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.619+0000 7f1c165f6640 1 -- 172.21.15.42:0/3742446717 >> 172.21.15.42:0/3742446717 conn(0x7f1c100fd8c0 msgr2=0x7f1c100feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.620+0000 7f1c165f6640 1 -- 172.21.15.42:0/3742446717 shutdown_connections 2024-09-19T09:37:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:03.620+0000 7f1c165f6640 1 -- 172.21.15.42:0/3742446717 wait complete. 2024-09-19T09:37:04.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:04.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3742446717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:04.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.187 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.187 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:04.187 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:04.187 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.187 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:04 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:04.189 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T09:37:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3742446717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:04.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:04.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:04 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:04.469 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:04.469 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.469 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.469 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.470 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.470 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3742446717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:04.470 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.470 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.470 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:04.470 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:04.470 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:04.470 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:04 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.582+0000 7f5deeabf640 1 -- 172.21.15.42:0/1407593502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de8100a80 msgr2=0x7f5de8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.582+0000 7f5deeabf640 1 --2- 172.21.15.42:0/1407593502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de8100a80 0x7f5de8100ee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009cd0 tx=0x7f5dd802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.582+0000 7f5deeabf640 1 -- 172.21.15.42:0/1407593502 shutdown_connections 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.582+0000 7f5deeabf640 1 --2- 172.21.15.42:0/1407593502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5de8101420 0x7f5de810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.582+0000 7f5deeabf640 1 --2- 172.21.15.42:0/1407593502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de8100a80 0x7f5de8100ee0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.582+0000 7f5deeabf640 1 --2- 172.21.15.42:0/1407593502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5de8106a80 0x7f5de8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.582+0000 7f5deeabf640 1 -- 172.21.15.42:0/1407593502 >> 172.21.15.42:0/1407593502 conn(0x7f5de80fc7a0 msgr2=0x7f5de80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.582+0000 7f5deeabf640 1 -- 172.21.15.42:0/1407593502 shutdown_connections 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.582+0000 7f5deeabf640 1 -- 172.21.15.42:0/1407593502 wait complete. 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.583+0000 7f5deeabf640 1 Processor -- start 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5deeabf640 1 -- start start 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5deeabf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de8100a80 0x7f5de81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5deeabf640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5de8101420 0x7f5de8199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5deeabf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5de8106a80 0x7f5de81a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5deeabf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5de8110e80 con 0x7f5de8100a80 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5deeabf640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5de8110d00 con 0x7f5de8101420 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5deeabf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5de8111000 con 0x7f5de8106a80 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5dec85b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de8100a80 0x7f5de81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5dec85b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de8100a80 0x7f5de81992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58404/0 (socket says 172.21.15.42:58404) 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5dec85b640 1 -- 172.21.15.42:0/2859437149 learned_addr learned my addr 172.21.15.42:0/2859437149 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5ded05c640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5de8106a80 0x7f5de81a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5de7fff640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5de8101420 0x7f5de8199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5dec85b640 1 -- 172.21.15.42:0/2859437149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5de8106a80 msgr2=0x7f5de81a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5dec85b640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5de8106a80 0x7f5de81a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5dec85b640 1 -- 172.21.15.42:0/2859437149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5de8101420 msgr2=0x7f5de8199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5dec85b640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5de8101420 0x7f5de8199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.584+0000 7f5dec85b640 1 -- 172.21.15.42:0/2859437149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de81a48b0 con 0x7f5de8100a80 2024-09-19T09:37:05.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.585+0000 7f5dec85b640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de8100a80 0x7f5de81992f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000e9f0 tx=0x7f5dd000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.585+0000 7f5de5ffb640 1 -- 172.21.15.42:0/2859437149 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000cd80 con 0x7f5de8100a80 2024-09-19T09:37:05.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.585+0000 7f5deeabf640 1 -- 172.21.15.42:0/2859437149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de81a4a80 con 0x7f5de8100a80 2024-09-19T09:37:05.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.585+0000 7f5de5ffb640 1 -- 172.21.15.42:0/2859437149 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd0005500 con 0x7f5de8100a80 2024-09-19T09:37:05.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.585+0000 7f5de5ffb640 1 -- 172.21.15.42:0/2859437149 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0010690 con 0x7f5de8100a80 2024-09-19T09:37:05.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.585+0000 7f5deeabf640 1 -- 172.21.15.42:0/2859437149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de81a4f90 con 0x7f5de8100a80 2024-09-19T09:37:05.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.586+0000 7f5deeabf640 1 -- 172.21.15.42:0/2859437149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de8100ee0 con 0x7f5de8100a80 2024-09-19T09:37:05.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.587+0000 7f5de5ffb640 1 -- 172.21.15.42:0/2859437149 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5dd00046c0 con 0x7f5de8100a80 2024-09-19T09:37:05.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.588+0000 7f5de5ffb640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5dd40a32c0 0x7f5dd40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.588+0000 7f5de7fff640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5dd40a32c0 0x7f5dd40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.588+0000 7f5de5ffb640 1 -- 172.21.15.42:0/2859437149 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f5dd00cf7c0 con 0x7f5de8100a80 2024-09-19T09:37:05.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.588+0000 7f5de7fff640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5dd40a32c0 0x7f5dd40a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8006010 tx=0x7f5dd8009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.595+0000 7f5de5ffb640 1 -- 172.21.15.42:0/2859437149 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5dd009c980 con 0x7f5de8100a80 2024-09-19T09:37:05.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.811+0000 7f5deeabf640 1 -- 172.21.15.42:0/2859437149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5de8108ff0 con 0x7f5de8100a80 2024-09-19T09:37:05.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.812+0000 7f5de5ffb640 1 -- 172.21.15.42:0/2859437149 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f5dd009c280 con 0x7f5de8100a80 2024-09-19T09:37:05.814 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:05.814 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-19T09:37:05.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:37:05.814 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-19T09:37:05.815 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-19T09:37:05.815 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:37:05.815 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-19T09:37:05.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 -- 172.21.15.42:0/2859437149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5dd40a32c0 msgr2=0x7f5dd40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5dd40a32c0 0x7f5dd40a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8006010 tx=0x7f5dd8009360 comp rx=0 tx=0).stop 2024-09-19T09:37:05.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 -- 172.21.15.42:0/2859437149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de8100a80 msgr2=0x7f5de81992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de8100a80 0x7f5de81992f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000e9f0 tx=0x7f5dd000edf0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 -- 172.21.15.42:0/2859437149 shutdown_connections 2024-09-19T09:37:05.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5dd40a32c0 0x7f5dd40a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5de8106a80 0x7f5de81a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5de8101420 0x7f5de8199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 --2- 172.21.15.42:0/2859437149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de8100a80 0x7f5de81992f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 -- 172.21.15.42:0/2859437149 >> 172.21.15.42:0/2859437149 conn(0x7f5de80fc7a0 msgr2=0x7f5de80fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:05.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 -- 172.21.15.42:0/2859437149 shutdown_connections 2024-09-19T09:37:05.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:05.814+0000 7f5deeabf640 1 -- 172.21.15.42:0/2859437149 wait complete. 2024-09-19T09:37:06.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:06.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2859437149' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:37:06.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:06.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:06.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:06.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2859437149' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:37:06.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:06.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:06.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.552 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:37:06.552 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:37:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2859437149' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:37:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:06.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:06.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:06.809 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:07.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.268+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/3266025804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4102790 msgr2=0x7ff1e41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.268+0000 7ff1eb5cd640 1 --2- 172.21.15.42:0/3266025804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4102790 0x7ff1e41067e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009900 tx=0x7ff1d402a410 comp rx=0 tx=0).stop 2024-09-19T09:37:07.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.268+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/3266025804 shutdown_connections 2024-09-19T09:37:07.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.268+0000 7ff1eb5cd640 1 --2- 172.21.15.42:0/3266025804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1e4106f10 0x7ff1e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.268+0000 7ff1eb5cd640 1 --2- 172.21.15.42:0/3266025804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4102790 0x7ff1e41067e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.268+0000 7ff1eb5cd640 1 --2- 172.21.15.42:0/3266025804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e4101de0 0x7ff1e41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.268+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/3266025804 >> 172.21.15.42:0/3266025804 conn(0x7ff1e40fd8c0 msgr2=0x7ff1e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:07.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.268+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/3266025804 shutdown_connections 2024-09-19T09:37:07.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.268+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/3266025804 wait complete. 2024-09-19T09:37:07.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1eb5cd640 1 Processor -- start 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1eb5cd640 1 -- start start 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1eb5cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4101de0 0x7ff1e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1eb5cd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1e4102790 0x7ff1e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1eb5cd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e4106f10 0x7ff1e4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1eb5cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e4111f70 con 0x7ff1e4101de0 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1eb5cd640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e4111df0 con 0x7ff1e4102790 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1eb5cd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e41120f0 con 0x7ff1e4106f10 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1e9369640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4101de0 0x7ff1e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1e9369640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4101de0 0x7ff1e40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58408/0 (socket says 172.21.15.42:58408) 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1e9369640 1 -- 172.21.15.42:0/4045579727 learned_addr learned my addr 172.21.15.42:0/4045579727 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.269+0000 7ff1e8b68640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1e4102790 0x7ff1e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1e9b6a640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e4106f10 0x7ff1e4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1e9369640 1 -- 172.21.15.42:0/4045579727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e4106f10 msgr2=0x7ff1e4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1e9369640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e4106f10 0x7ff1e4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1e9369640 1 -- 172.21.15.42:0/4045579727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1e4102790 msgr2=0x7ff1e4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1e9369640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1e4102790 0x7ff1e4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1e9369640 1 -- 172.21.15.42:0/4045579727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e41a6970 con 0x7ff1e4101de0 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1e9369640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4101de0 0x7ff1e40744f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000d770 tx=0x7ff1e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1da7fc640 1 -- 172.21.15.42:0/4045579727 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0017070 con 0x7ff1e4101de0 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1da7fc640 1 -- 172.21.15.42:0/4045579727 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1e0005500 con 0x7ff1e4101de0 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1da7fc640 1 -- 172.21.15.42:0/4045579727 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0004e00 con 0x7ff1e4101de0 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/4045579727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e41a6c60 con 0x7ff1e4101de0 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.270+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/4045579727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e41a7120 con 0x7ff1e4101de0 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.271+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/4045579727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e41021c0 con 0x7ff1e4101de0 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.273+0000 7ff1da7fc640 1 -- 172.21.15.42:0/4045579727 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff1e0004fa0 con 0x7ff1e4101de0 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.273+0000 7ff1da7fc640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff1d00a3240 0x7ff1d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.273+0000 7ff1e8b68640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff1d00a3240 0x7ff1d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.273+0000 7ff1da7fc640 1 -- 172.21.15.42:0/4045579727 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7ff1e00cf1f0 con 0x7ff1e4101de0 2024-09-19T09:37:07.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.274+0000 7ff1e8b68640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff1d00a3240 0x7ff1d00a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009230 tx=0x7ff1d40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:07.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.277+0000 7ff1da7fc640 1 -- 172.21.15.42:0/4045579727 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1e009bd60 con 0x7ff1e4101de0 2024-09-19T09:37:07.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.450+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/4045579727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff1e410a180 con 0x7ff1e4101de0 2024-09-19T09:37:07.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.933+0000 7ff1da7fc640 1 -- 172.21.15.42:0/4045579727 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7ff1e00a0060 con 0x7ff1e4101de0 2024-09-19T09:37:07.935 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-19T09:37:07.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/4045579727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff1d00a3240 msgr2=0x7ff1d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff1d00a3240 0x7ff1d00a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009230 tx=0x7ff1d40058d0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/4045579727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4101de0 msgr2=0x7ff1e40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4101de0 0x7ff1e40744f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000d770 tx=0x7ff1e000dc30 comp rx=0 tx=0).stop 2024-09-19T09:37:07.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/4045579727 shutdown_connections 2024-09-19T09:37:07.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff1d00a3240 0x7ff1d00a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e4106f10 0x7ff1e4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1e4102790 0x7ff1e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 --2- 172.21.15.42:0/4045579727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4101de0 0x7ff1e40744f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/4045579727 >> 172.21.15.42:0/4045579727 conn(0x7ff1e40fd8c0 msgr2=0x7ff1e40fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/4045579727 shutdown_connections 2024-09-19T09:37:07.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:07.936+0000 7ff1eb5cd640 1 -- 172.21.15.42:0/4045579727 wait complete. 2024-09-19T09:37:08.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:07 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:08.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:07 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/4045579727' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:37:08.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:07 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:08.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:07 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/4045579727' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:37:08.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:07 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:37:08.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:07 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/4045579727' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:37:08.575 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:37:08.833 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:09.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:08 smithi042 ceph-mon[31223]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:09.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:08 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/4045579727' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:37:09.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:08 smithi042 ceph-mon[31223]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:37:09.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.297+0000 7fca4d53d640 1 -- 172.21.15.42:0/1355596309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca48102d40 msgr2=0x7fca48103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.297+0000 7fca4d53d640 1 --2- 172.21.15.42:0/1355596309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca48102d40 0x7fca48103120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fca38009900 tx=0x7fca3802a480 comp rx=0 tx=0).stop 2024-09-19T09:37:09.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.297+0000 7fca4d53d640 1 -- 172.21.15.42:0/1355596309 shutdown_connections 2024-09-19T09:37:09.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.297+0000 7fca4d53d640 1 --2- 172.21.15.42:0/1355596309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca4810c170 0x7fca4810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.297+0000 7fca4d53d640 1 --2- 172.21.15.42:0/1355596309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca48103660 0x7fca4810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.297+0000 7fca4d53d640 1 --2- 172.21.15.42:0/1355596309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca48102d40 0x7fca48103120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 -- 172.21.15.42:0/1355596309 >> 172.21.15.42:0/1355596309 conn(0x7fca480fc7a0 msgr2=0x7fca480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 -- 172.21.15.42:0/1355596309 shutdown_connections 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 -- 172.21.15.42:0/1355596309 wait complete. 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 Processor -- start 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 -- start start 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca48102d40 0x7fca481983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca48103660 0x7fca48198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca4810c170 0x7fca4819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca48111fb0 con 0x7fca48103660 2024-09-19T09:37:09.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fca48111e30 con 0x7fca48102d40 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.298+0000 7fca4d53d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fca48112130 con 0x7fca4810c170 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca3ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca48103660 0x7fca48198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca3ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca48103660 0x7fca48198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58424/0 (socket says 172.21.15.42:58424) 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca3ffff640 1 -- 172.21.15.42:0/536588117 learned_addr learned my addr 172.21.15.42:0/536588117 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca46ffd640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca48102d40 0x7fca481983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca477fe640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca4810c170 0x7fca4819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca3ffff640 1 -- 172.21.15.42:0/536588117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca4810c170 msgr2=0x7fca4819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca3ffff640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca4810c170 0x7fca4819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca3ffff640 1 -- 172.21.15.42:0/536588117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca48102d40 msgr2=0x7fca481983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca3ffff640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca48102d40 0x7fca481983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca3ffff640 1 -- 172.21.15.42:0/536588117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4819d390 con 0x7fca48103660 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca477fe640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca4810c170 0x7fca4819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca3ffff640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca48103660 0x7fca48198920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fca3000c970 tx=0x7fca3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:09.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca44ff9640 1 -- 172.21.15.42:0/536588117 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30007bb0 con 0x7fca48103660 2024-09-19T09:37:09.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca4d53d640 1 -- 172.21.15.42:0/536588117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4819d680 con 0x7fca48103660 2024-09-19T09:37:09.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca44ff9640 1 -- 172.21.15.42:0/536588117 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca30007d50 con 0x7fca48103660 2024-09-19T09:37:09.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca44ff9640 1 -- 172.21.15.42:0/536588117 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30018820 con 0x7fca48103660 2024-09-19T09:37:09.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.299+0000 7fca4d53d640 1 -- 172.21.15.42:0/536588117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca481a4f60 con 0x7fca48103660 2024-09-19T09:37:09.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.301+0000 7fca4d53d640 1 -- 172.21.15.42:0/536588117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca48103120 con 0x7fca48103660 2024-09-19T09:37:09.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.302+0000 7fca44ff9640 1 -- 172.21.15.42:0/536588117 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fca300189c0 con 0x7fca48103660 2024-09-19T09:37:09.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.302+0000 7fca44ff9640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca340a3240 0x7fca340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.302+0000 7fca46ffd640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca340a3240 0x7fca340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.302+0000 7fca44ff9640 1 -- 172.21.15.42:0/536588117 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7fca300cf770 con 0x7fca48103660 2024-09-19T09:37:09.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.303+0000 7fca46ffd640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca340a3240 0x7fca340a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca380096c0 tx=0x7fca38031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:09.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.307+0000 7fca44ff9640 1 -- 172.21.15.42:0/536588117 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fca30014030 con 0x7fca48103660 2024-09-19T09:37:09.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:08 smithi171 ceph-mon[35803]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:09.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:08 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/4045579727' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:37:09.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:08 smithi171 ceph-mon[35803]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:37:09.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:08 smithi136 ceph-mon[34840]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:09.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:08 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/4045579727' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:37:09.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:08 smithi136 ceph-mon[34840]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:37:09.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.483+0000 7fca4d53d640 1 -- 172.21.15.42:0/536588117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fca481a5190 con 0x7fca48103660 2024-09-19T09:37:09.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.940+0000 7fca44ff9640 1 -- 172.21.15.42:0/536588117 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7fca3001f300 con 0x7fca48103660 2024-09-19T09:37:09.941 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-19T09:37:09.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 -- 172.21.15.42:0/536588117 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca340a3240 msgr2=0x7fca340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca340a3240 0x7fca340a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca380096c0 tx=0x7fca38031490 comp rx=0 tx=0).stop 2024-09-19T09:37:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 -- 172.21.15.42:0/536588117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca48103660 msgr2=0x7fca48198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca48103660 0x7fca48198920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fca3000c970 tx=0x7fca3000ce30 comp rx=0 tx=0).stop 2024-09-19T09:37:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 -- 172.21.15.42:0/536588117 shutdown_connections 2024-09-19T09:37:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fca340a3240 0x7fca340a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca4810c170 0x7fca4819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca48103660 0x7fca48198920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 --2- 172.21.15.42:0/536588117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca48102d40 0x7fca481983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 -- 172.21.15.42:0/536588117 >> 172.21.15.42:0/536588117 conn(0x7fca480fc7a0 msgr2=0x7fca480fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 -- 172.21.15.42:0/536588117 shutdown_connections 2024-09-19T09:37:09.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:09.943+0000 7fca4d53d640 1 -- 172.21.15.42:0/536588117 wait complete. 2024-09-19T09:37:10.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:09 smithi042 ceph-mon[31223]: pgmap v266: 33 pgs: 8 creating+peering, 24 unknown, 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:10.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:09 smithi042 ceph-mon[31223]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:37:10.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:09 smithi042 ceph-mon[31223]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:37:10.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:09 smithi171 ceph-mon[35803]: pgmap v266: 33 pgs: 8 creating+peering, 24 unknown, 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:10.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:09 smithi171 ceph-mon[35803]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:37:10.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:09 smithi171 ceph-mon[35803]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:37:10.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:09 smithi136 ceph-mon[34840]: pgmap v266: 33 pgs: 8 creating+peering, 24 unknown, 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:10.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:09 smithi136 ceph-mon[34840]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:37:10.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:09 smithi136 ceph-mon[34840]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:37:10.592 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:37:10.849 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:11.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:10 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/536588117' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:37:11.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:10 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/536588117' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:37:11.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:10 smithi042 ceph-mon[31223]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:37:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.298+0000 7f847f0ec640 1 -- 172.21.15.42:0/3270923562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8478101de0 msgr2=0x7f84781021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.298+0000 7f847f0ec640 1 --2- 172.21.15.42:0/3270923562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8478101de0 0x7f84781021c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8468009900 tx=0x7f846802a410 comp rx=0 tx=0).stop 2024-09-19T09:37:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.299+0000 7f847f0ec640 1 -- 172.21.15.42:0/3270923562 shutdown_connections 2024-09-19T09:37:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.299+0000 7f847f0ec640 1 --2- 172.21.15.42:0/3270923562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478106f10 0x7f847810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.299+0000 7f847f0ec640 1 --2- 172.21.15.42:0/3270923562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8478102790 0x7f84781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.299+0000 7f847f0ec640 1 --2- 172.21.15.42:0/3270923562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8478101de0 0x7f84781021c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.299+0000 7f847f0ec640 1 -- 172.21.15.42:0/3270923562 >> 172.21.15.42:0/3270923562 conn(0x7f84780fd8c0 msgr2=0x7f84780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.299+0000 7f847f0ec640 1 -- 172.21.15.42:0/3270923562 shutdown_connections 2024-09-19T09:37:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.299+0000 7f847f0ec640 1 -- 172.21.15.42:0/3270923562 wait complete. 2024-09-19T09:37:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.299+0000 7f847f0ec640 1 Processor -- start 2024-09-19T09:37:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.299+0000 7f847f0ec640 1 -- start start 2024-09-19T09:37:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.299+0000 7f847f0ec640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8478101de0 0x7f84781961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847f0ec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478102790 0x7f84781966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847f0ec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8478106f10 0x7f847819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847f0ec640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f847810fdd0 con 0x7f8478106f10 2024-09-19T09:37:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847f0ec640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f847810fc50 con 0x7f8478101de0 2024-09-19T09:37:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847f0ec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f847810ff50 con 0x7f8478102790 2024-09-19T09:37:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847d689640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8478106f10 0x7f847819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847d689640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8478106f10 0x7f847819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40220/0 (socket says 172.21.15.42:40220) 2024-09-19T09:37:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847d689640 1 -- 172.21.15.42:0/3069022788 learned_addr learned my addr 172.21.15.42:0/3069022788 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f8477fff640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478102790 0x7f84781966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847ce88640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8478101de0 0x7f84781961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847d689640 1 -- 172.21.15.42:0/3069022788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478102790 msgr2=0x7f84781966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847d689640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478102790 0x7f84781966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847d689640 1 -- 172.21.15.42:0/3069022788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8478101de0 msgr2=0x7f84781961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847d689640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8478101de0 0x7f84781961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847d689640 1 -- 172.21.15.42:0/3069022788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847819b160 con 0x7f8478106f10 2024-09-19T09:37:11.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847d689640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8478106f10 0x7f847819aa80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f847000eaa0 tx=0x7f847000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f8475ffb640 1 -- 172.21.15.42:0/3069022788 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8470004d20 con 0x7f8478106f10 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f8475ffb640 1 -- 172.21.15.42:0/3069022788 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8470005020 con 0x7f8478106f10 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f847f0ec640 1 -- 172.21.15.42:0/3069022788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847819b450 con 0x7f8478106f10 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.300+0000 7f8475ffb640 1 -- 172.21.15.42:0/3069022788 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84700116d0 con 0x7f8478106f10 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.301+0000 7f847f0ec640 1 -- 172.21.15.42:0/3069022788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84781a2d30 con 0x7f8478106f10 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.302+0000 7f847f0ec640 1 -- 172.21.15.42:0/3069022788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84781021c0 con 0x7f8478106f10 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.303+0000 7f8475ffb640 1 -- 172.21.15.42:0/3069022788 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f84700051d0 con 0x7f8478106f10 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.303+0000 7f8475ffb640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84600a7690 0x7f84600a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.303+0000 7f847ce88640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84600a7690 0x7f84600a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.304+0000 7f8475ffb640 1 -- 172.21.15.42:0/3069022788 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7f84700cf970 con 0x7f8478106f10 2024-09-19T09:37:11.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.304+0000 7f847ce88640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84600a7690 0x7f84600a9b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8468000c00 tx=0x7f84680041a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.308+0000 7f8475ffb640 1 -- 172.21.15.42:0/3069022788 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8470016030 con 0x7f8478106f10 2024-09-19T09:37:11.350 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:10 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/536588117' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:37:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:10 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/536588117' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:37:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:10 smithi171 ceph-mon[35803]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:37:12.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:10 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/536588117' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:37:12.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:10 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/536588117' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:37:12.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:10 smithi136 ceph-mon[34840]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:37:12.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:11.523+0000 7f847f0ec640 1 -- 172.21.15.42:0/3069022788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f847802d7c0 con 0x7f8478106f10 2024-09-19T09:37:12.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.010+0000 7f8475ffb640 1 -- 172.21.15.42:0/3069022788 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f847009c7a0 con 0x7f8478106f10 2024-09-19T09:37:12.094 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T09:37:12.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.012+0000 7f847f0ec640 1 -- 172.21.15.42:0/3069022788 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84600a7690 msgr2=0x7f84600a9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:12.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84600a7690 0x7f84600a9b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8468000c00 tx=0x7f84680041a0 comp rx=0 tx=0).stop 2024-09-19T09:37:12.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 -- 172.21.15.42:0/3069022788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8478106f10 msgr2=0x7f847819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:12.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8478106f10 0x7f847819aa80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f847000eaa0 tx=0x7f847000eea0 comp rx=0 tx=0).stop 2024-09-19T09:37:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 -- 172.21.15.42:0/3069022788 shutdown_connections 2024-09-19T09:37:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84600a7690 0x7f84600a9b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8478106f10 0x7f847819aa80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478102790 0x7f84781966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 --2- 172.21.15.42:0/3069022788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8478101de0 0x7f84781961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 -- 172.21.15.42:0/3069022788 >> 172.21.15.42:0/3069022788 conn(0x7f84780fd8c0 msgr2=0x7f84780feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 -- 172.21.15.42:0/3069022788 shutdown_connections 2024-09-19T09:37:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:12.013+0000 7f847f0ec640 1 -- 172.21.15.42:0/3069022788 wait complete. 2024-09-19T09:37:12.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:11 smithi042 ceph-mon[31223]: pgmap v269: 97 pgs: 1 creating+activating, 40 creating+peering, 38 unknown, 18 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:12.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:11 smithi042 ceph-mon[31223]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:37:12.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:11 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3069022788' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:37:12.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:11 smithi042 ceph-mon[31223]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:37:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:11 smithi171 ceph-mon[35803]: pgmap v269: 97 pgs: 1 creating+activating, 40 creating+peering, 38 unknown, 18 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:11 smithi171 ceph-mon[35803]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:37:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:11 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3069022788' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:37:12.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:11 smithi171 ceph-mon[35803]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:37:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:11 smithi136 ceph-mon[34840]: pgmap v269: 97 pgs: 1 creating+activating, 40 creating+peering, 38 unknown, 18 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:37:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:11 smithi136 ceph-mon[34840]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:37:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:11 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3069022788' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:37:12.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:11 smithi136 ceph-mon[34840]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:37:12.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:37:12.895 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:13.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:12 smithi042 ceph-mon[31223]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:37:13.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:12 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3069022788' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:37:13.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:12 smithi042 ceph-mon[31223]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:37:13.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:12 smithi042 ceph-mon[31223]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:37:13.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:12 smithi171 ceph-mon[35803]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:37:13.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:12 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3069022788' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:37:13.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:12 smithi171 ceph-mon[35803]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:37:13.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:12 smithi171 ceph-mon[35803]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:37:13.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.370+0000 7f05a80e6640 1 -- 172.21.15.42:0/102577321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a0101de0 msgr2=0x7f05a01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.370+0000 7f05a80e6640 1 --2- 172.21.15.42:0/102577321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a0101de0 0x7f05a01021c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f059c009900 tx=0x7f059c02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:13.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.370+0000 7f05a80e6640 1 -- 172.21.15.42:0/102577321 shutdown_connections 2024-09-19T09:37:13.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.370+0000 7f05a80e6640 1 --2- 172.21.15.42:0/102577321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05a0106f10 0x7f05a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.370+0000 7f05a80e6640 1 --2- 172.21.15.42:0/102577321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05a0102790 0x7f05a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.370+0000 7f05a80e6640 1 --2- 172.21.15.42:0/102577321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a0101de0 0x7f05a01021c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.370+0000 7f05a80e6640 1 -- 172.21.15.42:0/102577321 >> 172.21.15.42:0/102577321 conn(0x7f05a00fd8c0 msgr2=0x7f05a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:13.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.370+0000 7f05a80e6640 1 -- 172.21.15.42:0/102577321 shutdown_connections 2024-09-19T09:37:13.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.370+0000 7f05a80e6640 1 -- 172.21.15.42:0/102577321 wait complete. 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a80e6640 1 Processor -- start 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a80e6640 1 -- start start 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a80e6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05a0101de0 0x7f05a0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a80e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a0102790 0x7f05a01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a80e6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05a0106f10 0x7f05a019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a80e6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0111f90 con 0x7f05a0102790 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a80e6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0111e10 con 0x7f05a0101de0 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a80e6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0112110 con 0x7f05a0106f10 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a5681640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a0102790 0x7f05a01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a5681640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a0102790 0x7f05a01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40234/0 (socket says 172.21.15.42:40234) 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a5681640 1 -- 172.21.15.42:0/4045130020 learned_addr learned my addr 172.21.15.42:0/4045130020 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a5e82640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05a0101de0 0x7f05a0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a6683640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05a0106f10 0x7f05a019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a5681640 1 -- 172.21.15.42:0/4045130020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05a0106f10 msgr2=0x7f05a019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a5681640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05a0106f10 0x7f05a019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.371+0000 7f05a5681640 1 -- 172.21.15.42:0/4045130020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05a0101de0 msgr2=0x7f05a0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.372+0000 7f05a5681640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05a0101de0 0x7f05a0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.372+0000 7f05a5681640 1 -- 172.21.15.42:0/4045130020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a019d440 con 0x7f05a0102790 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.372+0000 7f05a6683640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05a0106f10 0x7f05a019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.372+0000 7f05a5681640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a0102790 0x7f05a01989d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f059400c890 tx=0x7f059400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.372+0000 7f0592ffd640 1 -- 172.21.15.42:0/4045130020 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594004220 con 0x7f05a0102790 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.372+0000 7f0592ffd640 1 -- 172.21.15.42:0/4045130020 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05940043c0 con 0x7f05a0102790 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.372+0000 7f05a80e6640 1 -- 172.21.15.42:0/4045130020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a019d730 con 0x7f05a0102790 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.372+0000 7f0592ffd640 1 -- 172.21.15.42:0/4045130020 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05940049e0 con 0x7f05a0102790 2024-09-19T09:37:13.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.372+0000 7f05a80e6640 1 -- 172.21.15.42:0/4045130020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a01a5010 con 0x7f05a0102790 2024-09-19T09:37:13.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.373+0000 7f05a80e6640 1 -- 172.21.15.42:0/4045130020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a01021c0 con 0x7f05a0102790 2024-09-19T09:37:13.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.374+0000 7f0592ffd640 1 -- 172.21.15.42:0/4045130020 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f05940079b0 con 0x7f05a0102790 2024-09-19T09:37:13.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.375+0000 7f0592ffd640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f058c0a32c0 0x7f058c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.375+0000 7f05a5e82640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f058c0a32c0 0x7f058c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.375+0000 7f0592ffd640 1 -- 172.21.15.42:0/4045130020 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f05940cf930 con 0x7f05a0102790 2024-09-19T09:37:13.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.375+0000 7f05a5e82640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f058c0a32c0 0x7f058c0a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f059c0096c0 tx=0x7f059c031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:13.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.379+0000 7f0592ffd640 1 -- 172.21.15.42:0/4045130020 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0594014030 con 0x7f05a0102790 2024-09-19T09:37:13.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:12 smithi136 ceph-mon[34840]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:37:13.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:12 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3069022788' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:37:13.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:12 smithi136 ceph-mon[34840]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:12 smithi136 ceph-mon[34840]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:37:13.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.559+0000 7f05a80e6640 1 -- 172.21.15.42:0/4045130020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05a002d7c0 con 0x7f05a0102790 2024-09-19T09:37:13.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.561+0000 7f0592ffd640 1 -- 172.21.15.42:0/4045130020 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22327 (secure 0 0 0) 0x7f059409c700 con 0x7f05a0102790 2024-09-19T09:37:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:13.563 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":79,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:11.524639+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:37:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.563+0000 7f05a80e6640 1 -- 172.21.15.42:0/4045130020 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f058c0a32c0 msgr2=0x7f058c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.563+0000 7f05a80e6640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f058c0a32c0 0x7f058c0a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f059c0096c0 tx=0x7f059c031490 comp rx=0 tx=0).stop 2024-09-19T09:37:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.564+0000 7f05a80e6640 1 -- 172.21.15.42:0/4045130020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a0102790 msgr2=0x7f05a01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.564+0000 7f05a80e6640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a0102790 0x7f05a01989d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f059400c890 tx=0x7f059400cd50 comp rx=0 tx=0).stop 2024-09-19T09:37:13.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.564+0000 7f05a80e6640 1 -- 172.21.15.42:0/4045130020 shutdown_connections 2024-09-19T09:37:13.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.564+0000 7f05a80e6640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f058c0a32c0 0x7f058c0a5780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.564+0000 7f05a80e6640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05a0106f10 0x7f05a019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.564+0000 7f05a80e6640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a0102790 0x7f05a01989d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.564+0000 7f05a80e6640 1 --2- 172.21.15.42:0/4045130020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05a0101de0 0x7f05a0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.564+0000 7f05a80e6640 1 -- 172.21.15.42:0/4045130020 >> 172.21.15.42:0/4045130020 conn(0x7f05a00fd8c0 msgr2=0x7f05a00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:13.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.564+0000 7f05a80e6640 1 -- 172.21.15.42:0/4045130020 shutdown_connections 2024-09-19T09:37:13.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:13.564+0000 7f05a80e6640 1 -- 172.21.15.42:0/4045130020 wait complete. 2024-09-19T09:37:14.127 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:13 smithi042 ceph-mon[31223]: pgmap v272: 97 pgs: 1 creating+activating, 40 creating+peering, 18 unknown, 38 active+clean; 577 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:37:14.127 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:13 smithi042 ceph-mon[31223]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:37:14.127 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:13 smithi042 ceph-mon[31223]: Cluster is now healthy 2024-09-19T09:37:14.128 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:13 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] up:active 2024-09-19T09:37:14.128 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:13 smithi042 ceph-mon[31223]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:14.128 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:13 smithi042 ceph-mon[31223]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:14.128 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:13 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/4045130020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:14.156 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:37:14.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:13 smithi171 ceph-mon[35803]: pgmap v272: 97 pgs: 1 creating+activating, 40 creating+peering, 18 unknown, 38 active+clean; 577 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:37:14.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:13 smithi171 ceph-mon[35803]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:37:14.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:13 smithi171 ceph-mon[35803]: Cluster is now healthy 2024-09-19T09:37:14.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:13 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] up:active 2024-09-19T09:37:14.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:13 smithi171 ceph-mon[35803]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:14.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:13 smithi171 ceph-mon[35803]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:14.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:13 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/4045130020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:13 smithi136 ceph-mon[34840]: pgmap v272: 97 pgs: 1 creating+activating, 40 creating+peering, 18 unknown, 38 active+clean; 577 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:37:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:13 smithi136 ceph-mon[34840]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:37:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:13 smithi136 ceph-mon[34840]: Cluster is now healthy 2024-09-19T09:37:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:13 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] up:active 2024-09-19T09:37:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:13 smithi136 ceph-mon[34840]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:13 smithi136 ceph-mon[34840]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:14.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:13 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/4045130020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:14.411 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.910+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2008175804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aec101de0 msgr2=0x7f0aec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.910+0000 7f0af2fbb640 1 --2- 172.21.15.42:0/2008175804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aec101de0 0x7f0aec1021c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009900 tx=0x7f0ae002a410 comp rx=0 tx=0).stop 2024-09-19T09:37:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.910+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2008175804 shutdown_connections 2024-09-19T09:37:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.910+0000 7f0af2fbb640 1 --2- 172.21.15.42:0/2008175804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aec106f10 0x7f0aec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.910+0000 7f0af2fbb640 1 --2- 172.21.15.42:0/2008175804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aec102790 0x7f0aec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.910+0000 7f0af2fbb640 1 --2- 172.21.15.42:0/2008175804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aec101de0 0x7f0aec1021c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.910+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2008175804 >> 172.21.15.42:0/2008175804 conn(0x7f0aec0fd8c0 msgr2=0x7f0aec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.910+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2008175804 shutdown_connections 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.910+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2008175804 wait complete. 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af2fbb640 1 Processor -- start 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af2fbb640 1 -- start start 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af2fbb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aec101de0 0x7f0aec198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af2fbb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aec102790 0x7f0aec198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af2fbb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aec106f10 0x7f0aec19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af2fbb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec111fe0 con 0x7f0aec101de0 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af2fbb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec111e60 con 0x7f0aec102790 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af2fbb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec112160 con 0x7f0aec106f10 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af0d57640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aec101de0 0x7f0aec198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af0d57640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aec101de0 0x7f0aec198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40266/0 (socket says 172.21.15.42:40266) 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af0d57640 1 -- 172.21.15.42:0/2445713141 learned_addr learned my addr 172.21.15.42:0/2445713141 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.911+0000 7f0af1558640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aec106f10 0x7f0aec19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0aebfff640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aec102790 0x7f0aec198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0af0d57640 1 -- 172.21.15.42:0/2445713141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aec106f10 msgr2=0x7f0aec19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0af0d57640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aec106f10 0x7f0aec19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0af0d57640 1 -- 172.21.15.42:0/2445713141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aec102790 msgr2=0x7f0aec198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0af0d57640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aec102790 0x7f0aec198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0af0d57640 1 -- 172.21.15.42:0/2445713141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec19d3f0 con 0x7f0aec101de0 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0af0d57640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aec101de0 0x7f0aec198440 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0004770 tx=0x7f0ae0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0ae9ffb640 1 -- 172.21.15.42:0/2445713141 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae003f070 con 0x7f0aec101de0 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0ae9ffb640 1 -- 172.21.15.42:0/2445713141 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ae0031ca0 con 0x7f0aec101de0 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2445713141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aec19d680 con 0x7f0aec101de0 2024-09-19T09:37:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.912+0000 7f0ae9ffb640 1 -- 172.21.15.42:0/2445713141 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0035030 con 0x7f0aec101de0 2024-09-19T09:37:14.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.913+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2445713141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aec1a4fc0 con 0x7f0aec101de0 2024-09-19T09:37:14.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.913+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2445713141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aec1032c0 con 0x7f0aec101de0 2024-09-19T09:37:14.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.915+0000 7f0ae9ffb640 1 -- 172.21.15.42:0/2445713141 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0ae0042070 con 0x7f0aec101de0 2024-09-19T09:37:14.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.915+0000 7f0ae9ffb640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0adc0a3240 0x7f0adc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:14.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.915+0000 7f0aebfff640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0adc0a3240 0x7f0adc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:14.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.915+0000 7f0ae9ffb640 1 -- 172.21.15.42:0/2445713141 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f0ae00eff00 con 0x7f0aec101de0 2024-09-19T09:37:14.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.916+0000 7f0aebfff640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0adc0a3240 0x7f0adc0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0aec1088e0 tx=0x7f0ad800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:14.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:14.919+0000 7f0ae9ffb640 1 -- 172.21.15.42:0/2445713141 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ae00bc720 con 0x7f0aec101de0 2024-09-19T09:37:15.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.099+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2445713141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0aec10a0f0 con 0x7f0aec101de0 2024-09-19T09:37:15.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.101+0000 7f0ae9ffb640 1 -- 172.21.15.42:0/2445713141 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22327 (secure 0 0 0) 0x7f0ae00c0a20 con 0x7f0aec101de0 2024-09-19T09:37:15.103 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:15.103 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":79,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:11.524639+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:37:15.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2445713141 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0adc0a3240 msgr2=0x7f0adc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0adc0a3240 0x7f0adc0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0aec1088e0 tx=0x7f0ad800b390 comp rx=0 tx=0).stop 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2445713141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aec101de0 msgr2=0x7f0aec198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aec101de0 0x7f0aec198440 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0004770 tx=0x7f0ae0003c10 comp rx=0 tx=0).stop 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2445713141 shutdown_connections 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0adc0a3240 0x7f0adc0a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aec106f10 0x7f0aec19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aec102790 0x7f0aec198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 --2- 172.21.15.42:0/2445713141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aec101de0 0x7f0aec198440 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2445713141 >> 172.21.15.42:0/2445713141 conn(0x7f0aec0fd8c0 msgr2=0x7f0aec0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2445713141 shutdown_connections 2024-09-19T09:37:15.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:15.104+0000 7f0af2fbb640 1 -- 172.21.15.42:0/2445713141 wait complete. 2024-09-19T09:37:15.723 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:37:15.981 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:16.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:15 smithi042 ceph-mon[31223]: pgmap v273: 97 pgs: 32 creating+peering, 65 active+clean; 578 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 920 B/s wr, 3 op/s 2024-09-19T09:37:16.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:15 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2445713141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:16.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:15 smithi171 ceph-mon[35803]: pgmap v273: 97 pgs: 32 creating+peering, 65 active+clean; 578 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 920 B/s wr, 3 op/s 2024-09-19T09:37:16.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:15 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2445713141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:16.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:15 smithi136 ceph-mon[34840]: pgmap v273: 97 pgs: 32 creating+peering, 65 active+clean; 578 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 920 B/s wr, 3 op/s 2024-09-19T09:37:16.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:15 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2445713141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:16.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.420+0000 7fcb057f8640 1 -- 172.21.15.42:0/2482463743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb00101de0 msgr2=0x7fcb001021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:16.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.420+0000 7fcb057f8640 1 --2- 172.21.15.42:0/2482463743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb00101de0 0x7fcb001021c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009900 tx=0x7fcaf002a410 comp rx=0 tx=0).stop 2024-09-19T09:37:16.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.420+0000 7fcb057f8640 1 -- 172.21.15.42:0/2482463743 shutdown_connections 2024-09-19T09:37:16.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.420+0000 7fcb057f8640 1 --2- 172.21.15.42:0/2482463743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb00106f10 0x7fcb0010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:16.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.420+0000 7fcb057f8640 1 --2- 172.21.15.42:0/2482463743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb00102790 0x7fcb001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.420+0000 7fcb057f8640 1 --2- 172.21.15.42:0/2482463743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb00101de0 0x7fcb001021c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.420+0000 7fcb057f8640 1 -- 172.21.15.42:0/2482463743 >> 172.21.15.42:0/2482463743 conn(0x7fcb000fd8c0 msgr2=0x7fcb000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.420+0000 7fcb057f8640 1 -- 172.21.15.42:0/2482463743 shutdown_connections 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.420+0000 7fcb057f8640 1 -- 172.21.15.42:0/2482463743 wait complete. 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.421+0000 7fcb057f8640 1 Processor -- start 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.421+0000 7fcb057f8640 1 -- start start 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.421+0000 7fcb057f8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb00101de0 0x7fcb00198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.421+0000 7fcb057f8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb00102790 0x7fcb00198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.421+0000 7fcb057f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb00106f10 0x7fcb0019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcb057f8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00111fb0 con 0x7fcb00106f10 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcb057f8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00111e30 con 0x7fcb00102790 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcb057f8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00112130 con 0x7fcb00101de0 2024-09-19T09:37:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcaff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb00106f10 0x7fcb0019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcaff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb00106f10 0x7fcb0019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40284/0 (socket says 172.21.15.42:40284) 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcaff7fe640 1 -- 172.21.15.42:0/2218185959 learned_addr learned my addr 172.21.15.42:0/2218185959 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcaf67fc640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb00102790 0x7fcb00198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcafeffd640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb00101de0 0x7fcb00198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcaff7fe640 1 -- 172.21.15.42:0/2218185959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb00101de0 msgr2=0x7fcb00198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcaff7fe640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb00101de0 0x7fcb00198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcaff7fe640 1 -- 172.21.15.42:0/2218185959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb00102790 msgr2=0x7fcb00198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcaff7fe640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb00102790 0x7fcb00198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcaff7fe640 1 -- 172.21.15.42:0/2218185959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0019d4c0 con 0x7fcb00106f10 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcaff7fe640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb00106f10 0x7fcb0019cde0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800eaa0 tx=0x7fcaf800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcafcff9640 1 -- 172.21.15.42:0/2218185959 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800cdb0 con 0x7fcb00106f10 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcafcff9640 1 -- 172.21.15.42:0/2218185959 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf8005020 con 0x7fcb00106f10 2024-09-19T09:37:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcb057f8640 1 -- 172.21.15.42:0/2218185959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0019d7b0 con 0x7fcb00106f10 2024-09-19T09:37:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcafcff9640 1 -- 172.21.15.42:0/2218185959 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80116b0 con 0x7fcb00106f10 2024-09-19T09:37:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.422+0000 7fcb057f8640 1 -- 172.21.15.42:0/2218185959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb001a5090 con 0x7fcb00106f10 2024-09-19T09:37:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.423+0000 7fcb057f8640 1 -- 172.21.15.42:0/2218185959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb001021c0 con 0x7fcb00106f10 2024-09-19T09:37:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.425+0000 7fcafcff9640 1 -- 172.21.15.42:0/2218185959 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcaf8005560 con 0x7fcb00106f10 2024-09-19T09:37:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.425+0000 7fcafcff9640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaec0a32c0 0x7fcaec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.426+0000 7fcafeffd640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaec0a32c0 0x7fcaec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.426+0000 7fcafcff9640 1 -- 172.21.15.42:0/2218185959 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fcaf80cfde0 con 0x7fcb00106f10 2024-09-19T09:37:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.426+0000 7fcafeffd640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaec0a32c0 0x7fcaec0a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005ab0 tx=0x7fcaf0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.429+0000 7fcafcff9640 1 -- 172.21.15.42:0/2218185959 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcaf8016030 con 0x7fcb00106f10 2024-09-19T09:37:16.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.640+0000 7fcb057f8640 1 -- 172.21.15.42:0/2218185959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcb0010a150 con 0x7fcb00106f10 2024-09-19T09:37:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.954+0000 7fcafcff9640 1 -- 172.21.15.42:0/2218185959 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fcaf809ccd0 con 0x7fcb00106f10 2024-09-19T09:37:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 -- 172.21.15.42:0/2218185959 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaec0a32c0 msgr2=0x7fcaec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaec0a32c0 0x7fcaec0a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005ab0 tx=0x7fcaf0005a20 comp rx=0 tx=0).stop 2024-09-19T09:37:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 -- 172.21.15.42:0/2218185959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb00106f10 msgr2=0x7fcb0019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb00106f10 0x7fcb0019cde0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800eaa0 tx=0x7fcaf800ef60 comp rx=0 tx=0).stop 2024-09-19T09:37:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 -- 172.21.15.42:0/2218185959 shutdown_connections 2024-09-19T09:37:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaec0a32c0 0x7fcaec0a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb00106f10 0x7fcb0019cde0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb00102790 0x7fcb00198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 --2- 172.21.15.42:0/2218185959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb00101de0 0x7fcb00198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 -- 172.21.15.42:0/2218185959 >> 172.21.15.42:0/2218185959 conn(0x7fcb000fd8c0 msgr2=0x7fcb000febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:16.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 -- 172.21.15.42:0/2218185959 shutdown_connections 2024-09-19T09:37:16.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:16.956+0000 7fcb057f8640 1 -- 172.21.15.42:0/2218185959 wait complete. 2024-09-19T09:37:17.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:16 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2218185959' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:37:17.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:16 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2218185959' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:37:17.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:16 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2218185959' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:37:17.385 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:17 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b[65116]: 2024-09-19T09:37:17.004+0000 7efec71a3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:37:17.791 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-19T09:37:17.791 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-19T09:37:18.051 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:18.173 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:17 smithi042 ceph-mon[31223]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T09:37:18.173 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:17 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2218185959' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:37:18.173 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:17 smithi042 ceph-mon[31223]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:17 smithi171 ceph-mon[35803]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T09:37:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:17 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2218185959' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:37:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:17 smithi171 ceph-mon[35803]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:18.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:17 smithi136 ceph-mon[34840]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T09:37:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:17 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2218185959' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:37:18.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:17 smithi136 ceph-mon[34840]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:18.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.536+0000 7f1a2e444640 1 -- 172.21.15.42:0/2566633779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a28101440 msgr2=0x7f1a28101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:18.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.536+0000 7f1a2e444640 1 --2- 172.21.15.42:0/2566633779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a28101440 0x7f1a28101820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009900 tx=0x7f1a1802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:37:18.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.536+0000 7f1a2e444640 1 -- 172.21.15.42:0/2566633779 shutdown_connections 2024-09-19T09:37:18.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.536+0000 7f1a2e444640 1 --2- 172.21.15.42:0/2566633779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a28106050 0x7f1a2810dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:18.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.536+0000 7f1a2e444640 1 --2- 172.21.15.42:0/2566633779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a28101df0 0x7f1a28105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:18.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.536+0000 7f1a2e444640 1 --2- 172.21.15.42:0/2566633779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a28101440 0x7f1a28101820 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:18.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.536+0000 7f1a2e444640 1 -- 172.21.15.42:0/2566633779 >> 172.21.15.42:0/2566633779 conn(0x7f1a28077210 msgr2=0x7f1a280fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:18.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.536+0000 7f1a2e444640 1 -- 172.21.15.42:0/2566633779 shutdown_connections 2024-09-19T09:37:18.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.536+0000 7f1a2e444640 1 -- 172.21.15.42:0/2566633779 wait complete. 2024-09-19T09:37:18.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2e444640 1 Processor -- start 2024-09-19T09:37:18.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2e444640 1 -- start start 2024-09-19T09:37:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2e444640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a28101440 0x7f1a28198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2e444640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a28101df0 0x7f1a28198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2e444640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a28106050 0x7f1a2819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2e444640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281110d0 con 0x7f1a28106050 2024-09-19T09:37:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2e444640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28110f50 con 0x7f1a28101df0 2024-09-19T09:37:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2e444640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28111250 con 0x7f1a28101440 2024-09-19T09:37:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2c9e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a28106050 0x7f1a2819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2c9e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a28106050 0x7f1a2819cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40296/0 (socket says 172.21.15.42:40296) 2024-09-19T09:37:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.537+0000 7f1a2c9e1640 1 -- 172.21.15.42:0/2585293030 learned_addr learned my addr 172.21.15.42:0/2585293030 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a27fff640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a28101440 0x7f1a28198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a277fe640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a28101df0 0x7f1a28198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a2c9e1640 1 -- 172.21.15.42:0/2585293030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a28101440 msgr2=0x7f1a28198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a2c9e1640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a28101440 0x7f1a28198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a2c9e1640 1 -- 172.21.15.42:0/2585293030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a28101df0 msgr2=0x7f1a28198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a2c9e1640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a28101df0 0x7f1a28198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a2c9e1640 1 -- 172.21.15.42:0/2585293030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2819d640 con 0x7f1a28106050 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a277fe640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a28101df0 0x7f1a28198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a2c9e1640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a28106050 0x7f1a2819cf60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000cce0 tx=0x7f1a2000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a257fa640 1 -- 172.21.15.42:0/2585293030 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000f450 con 0x7f1a28106050 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a257fa640 1 -- 172.21.15.42:0/2585293030 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a2000fad0 con 0x7f1a28106050 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a2e444640 1 -- 172.21.15.42:0/2585293030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2819d930 con 0x7f1a28106050 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a257fa640 1 -- 172.21.15.42:0/2585293030 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20018c10 con 0x7f1a28106050 2024-09-19T09:37:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.538+0000 7f1a2e444640 1 -- 172.21.15.42:0/2585293030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a281a5210 con 0x7f1a28106050 2024-09-19T09:37:18.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.539+0000 7f1a2e444640 1 -- 172.21.15.42:0/2585293030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a28101820 con 0x7f1a28106050 2024-09-19T09:37:18.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.540+0000 7f1a257fa640 1 -- 172.21.15.42:0/2585293030 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1a2000f5f0 con 0x7f1a28106050 2024-09-19T09:37:18.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.541+0000 7f1a257fa640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1a100a32c0 0x7f1a100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:18.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.541+0000 7f1a27fff640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1a100a32c0 0x7f1a100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:18.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.541+0000 7f1a257fa640 1 -- 172.21.15.42:0/2585293030 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f1a200cfeb0 con 0x7f1a28106050 2024-09-19T09:37:18.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.542+0000 7f1a27fff640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1a100a32c0 0x7f1a100a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1a180096c0 tx=0x7f1a18031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:18.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.546+0000 7f1a257fa640 1 -- 172.21.15.42:0/2585293030 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a20014030 con 0x7f1a28106050 2024-09-19T09:37:18.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.759+0000 7f1a2e444640 1 -- 172.21.15.42:0/2585293030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f1a2810a240 con 0x7f1a28106050 2024-09-19T09:37:18.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.961+0000 7f1a257fa640 1 -- 172.21.15.42:0/2585293030 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f1a2009cd20 con 0x7f1a28106050 2024-09-19T09:37:18.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.964+0000 7f1a2e444640 1 -- 172.21.15.42:0/2585293030 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1a100a32c0 msgr2=0x7f1a100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.964+0000 7f1a2e444640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1a100a32c0 0x7f1a100a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1a180096c0 tx=0x7f1a18031490 comp rx=0 tx=0).stop 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.964+0000 7f1a2e444640 1 -- 172.21.15.42:0/2585293030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a28106050 msgr2=0x7f1a2819cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.964+0000 7f1a2e444640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a28106050 0x7f1a2819cf60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000cce0 tx=0x7f1a2000a620 comp rx=0 tx=0).stop 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.964+0000 7f1a2e444640 1 -- 172.21.15.42:0/2585293030 shutdown_connections 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.964+0000 7f1a2e444640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1a100a32c0 0x7f1a100a5780 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.964+0000 7f1a2e444640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a28106050 0x7f1a2819cf60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.964+0000 7f1a2e444640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a28101df0 0x7f1a28198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.965+0000 7f1a2e444640 1 --2- 172.21.15.42:0/2585293030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a28101440 0x7f1a28198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.965+0000 7f1a2e444640 1 -- 172.21.15.42:0/2585293030 >> 172.21.15.42:0/2585293030 conn(0x7f1a28077210 msgr2=0x7f1a28100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.965+0000 7f1a2e444640 1 -- 172.21.15.42:0/2585293030 shutdown_connections 2024-09-19T09:37:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:18.965+0000 7f1a2e444640 1 -- 172.21.15.42:0/2585293030 wait complete. 2024-09-19T09:37:19.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:18 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2585293030' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:37:19.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:18 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2585293030' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:37:19.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:18 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2585293030' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:37:19.612 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T09:37:19.870 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:20.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:19 smithi042 ceph-mon[31223]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:37:20.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:19 smithi042 ceph-mon[31223]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:37:20.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:19 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2585293030' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:37:20.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:19 smithi042 ceph-mon[31223]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:37:20.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:19 smithi042 ceph-mon[31223]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:20.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:19 smithi042 ceph-mon[31223]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:37:20.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:19 smithi042 ceph-mon[31223]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:37:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:19 smithi171 ceph-mon[35803]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:37:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:19 smithi171 ceph-mon[35803]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:37:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:19 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2585293030' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:37:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:19 smithi171 ceph-mon[35803]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:37:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:19 smithi171 ceph-mon[35803]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:19 smithi171 ceph-mon[35803]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:37:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:19 smithi171 ceph-mon[35803]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:37:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 -- 172.21.15.42:0/874952741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3828102ef0 msgr2=0x7f382810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 --2- 172.21.15.42:0/874952741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3828102ef0 0x7f382810da40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3820009ca0 tx=0x7f382002a950 comp rx=0 tx=0).stop 2024-09-19T09:37:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 -- 172.21.15.42:0/874952741 shutdown_connections 2024-09-19T09:37:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 --2- 172.21.15.42:0/874952741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3828102ef0 0x7f382810da40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 --2- 172.21.15.42:0/874952741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3828102570 0x7f38281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 --2- 172.21.15.42:0/874952741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3828100e20 0x7f3828101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 -- 172.21.15.42:0/874952741 >> 172.21.15.42:0/874952741 conn(0x7f38280fc7d0 msgr2=0x7f38280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 -- 172.21.15.42:0/874952741 shutdown_connections 2024-09-19T09:37:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 -- 172.21.15.42:0/874952741 wait complete. 2024-09-19T09:37:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 Processor -- start 2024-09-19T09:37:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.347+0000 7f382ee73640 1 -- start start 2024-09-19T09:37:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f382ee73640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3828100e20 0x7f3828198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f382ee73640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3828102570 0x7f3828198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f382ee73640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3828102ef0 0x7f382819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f382ee73640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3828111020 con 0x7f3828102570 2024-09-19T09:37:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f382ee73640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3828110ea0 con 0x7f3828100e20 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f382ee73640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f38281111a0 con 0x7f3828102ef0 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f3827fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3828102570 0x7f3828198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f3827fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3828102570 0x7f3828198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37294/0 (socket says 172.21.15.42:37294) 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f3827fff640 1 -- 172.21.15.42:0/408575842 learned_addr learned my addr 172.21.15.42:0/408575842 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f382cc0f640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3828100e20 0x7f3828198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f382d410640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3828102ef0 0x7f382819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f3827fff640 1 -- 172.21.15.42:0/408575842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3828102ef0 msgr2=0x7f382819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f3827fff640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3828102ef0 0x7f382819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f3827fff640 1 -- 172.21.15.42:0/408575842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3828100e20 msgr2=0x7f3828198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f3827fff640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3828100e20 0x7f3828198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f3827fff640 1 -- 172.21.15.42:0/408575842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382819d620 con 0x7f3828102570 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.348+0000 7f3827fff640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3828102570 0x7f3828198bb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f381400b4a0 tx=0x7f381400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.349+0000 7f3825ffb640 1 -- 172.21.15.42:0/408575842 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814015020 con 0x7f3828102570 2024-09-19T09:37:20.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.349+0000 7f3825ffb640 1 -- 172.21.15.42:0/408575842 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3814011d10 con 0x7f3828102570 2024-09-19T09:37:20.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.349+0000 7f382ee73640 1 -- 172.21.15.42:0/408575842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382819d910 con 0x7f3828102570 2024-09-19T09:37:20.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.349+0000 7f3825ffb640 1 -- 172.21.15.42:0/408575842 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381400f2e0 con 0x7f3828102570 2024-09-19T09:37:20.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.349+0000 7f382ee73640 1 -- 172.21.15.42:0/408575842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38280fcbb0 con 0x7f3828102570 2024-09-19T09:37:20.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.350+0000 7f382ee73640 1 -- 172.21.15.42:0/408575842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38281021b0 con 0x7f3828102570 2024-09-19T09:37:20.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.352+0000 7f3825ffb640 1 -- 172.21.15.42:0/408575842 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3814018020 con 0x7f3828102570 2024-09-19T09:37:20.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.353+0000 7f3825ffb640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f38180a3240 0x7f38180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.353+0000 7f3825ffb640 1 -- 172.21.15.42:0/408575842 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f38140cf170 con 0x7f3828102570 2024-09-19T09:37:20.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.353+0000 7f382cc0f640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f38180a3240 0x7f38180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.353+0000 7f382cc0f640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f38180a3240 0x7f38180a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f381c009990 tx=0x7f381c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.357+0000 7f3825ffb640 1 -- 172.21.15.42:0/408575842 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f381401f020 con 0x7f3828102570 2024-09-19T09:37:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:19 smithi136 ceph-mon[34840]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:37:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:19 smithi136 ceph-mon[34840]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:37:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:19 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2585293030' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:37:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:19 smithi136 ceph-mon[34840]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:37:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:19 smithi136 ceph-mon[34840]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:37:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:19 smithi136 ceph-mon[34840]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:37:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:19 smithi136 ceph-mon[34840]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:37:20.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.573+0000 7f382ee73640 1 -- 172.21.15.42:0/408575842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f382810a0a0 con 0x7f3828102570 2024-09-19T09:37:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.983+0000 7f3825ffb640 1 -- 172.21.15.42:0/408575842 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f381409bf40 con 0x7f3828102570 2024-09-19T09:37:20.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 -- 172.21.15.42:0/408575842 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f38180a3240 msgr2=0x7f38180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f38180a3240 0x7f38180a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f381c009990 tx=0x7f381c009110 comp rx=0 tx=0).stop 2024-09-19T09:37:20.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 -- 172.21.15.42:0/408575842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3828102570 msgr2=0x7f3828198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3828102570 0x7f3828198bb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f381400b4a0 tx=0x7f381400b8a0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 -- 172.21.15.42:0/408575842 shutdown_connections 2024-09-19T09:37:20.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f38180a3240 0x7f38180a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3828102ef0 0x7f382819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3828102570 0x7f3828198bb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 --2- 172.21.15.42:0/408575842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3828100e20 0x7f3828198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 -- 172.21.15.42:0/408575842 >> 172.21.15.42:0/408575842 conn(0x7f38280fc7d0 msgr2=0x7f382806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 -- 172.21.15.42:0/408575842 shutdown_connections 2024-09-19T09:37:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:20.985+0000 7f382ee73640 1 -- 172.21.15.42:0/408575842 wait complete. 2024-09-19T09:37:21.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:20 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] up:active 2024-09-19T09:37:21.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:20 smithi171 ceph-mon[35803]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:37:21.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:20 smithi171 ceph-mon[35803]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:37:21.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:20 smithi171 ceph-mon[35803]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T09:37:21.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:20 smithi171 ceph-mon[35803]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T09:37:21.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:20 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/408575842' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:37:21.363 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:20 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] up:active 2024-09-19T09:37:21.363 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:20 smithi042 ceph-mon[31223]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:37:21.363 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:20 smithi042 ceph-mon[31223]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:37:21.363 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:20 smithi042 ceph-mon[31223]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T09:37:21.363 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:20 smithi042 ceph-mon[31223]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T09:37:21.364 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:20 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/408575842' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:37:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:20 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] up:active 2024-09-19T09:37:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:20 smithi136 ceph-mon[34840]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:37:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:20 smithi136 ceph-mon[34840]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:37:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:20 smithi136 ceph-mon[34840]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T09:37:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:20 smithi136 ceph-mon[34840]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T09:37:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:20 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/408575842' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:37:21.709 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T09:37:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:22.248 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:21 smithi042 ceph-mon[31223]: pgmap v276: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 8 op/s 2024-09-19T09:37:22.248 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:21 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/408575842' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:37:22.248 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:21 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] up:active 2024-09-19T09:37:22.248 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:21 smithi042 ceph-mon[31223]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:37:22.248 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:21 smithi042 ceph-mon[31223]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T09:37:22.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:21 smithi042 ceph-mon[31223]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T09:37:22.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:21 smithi042 ceph-mon[31223]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T09:37:22.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:21 smithi171 ceph-mon[35803]: pgmap v276: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 8 op/s 2024-09-19T09:37:22.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:21 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/408575842' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:37:22.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:21 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] up:active 2024-09-19T09:37:22.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:21 smithi171 ceph-mon[35803]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:37:22.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:21 smithi171 ceph-mon[35803]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T09:37:22.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:21 smithi171 ceph-mon[35803]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T09:37:22.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:21 smithi171 ceph-mon[35803]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T09:37:22.385 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b[65116]: 2024-09-19T09:37:22.004+0000 7efec71a3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T09:37:22.385 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b[65116]: 2024-09-19T09:37:22.004+0000 7efec71a3640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T09:37:22.385 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b[65116]: 2024-09-19T09:37:22.004+0000 7efec71a3640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-19T09:37:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:21 smithi136 ceph-mon[34840]: pgmap v276: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 8 op/s 2024-09-19T09:37:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:21 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/408575842' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:37:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:21 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] up:active 2024-09-19T09:37:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:21 smithi136 ceph-mon[34840]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:37:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:21 smithi136 ceph-mon[34840]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T09:37:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:21 smithi136 ceph-mon[34840]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T09:37:22.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:21 smithi136 ceph-mon[34840]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T09:37:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.418+0000 7fc284a2a640 1 -- 172.21.15.42:0/1697565038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc280102570 msgr2=0x7fc2801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.418+0000 7fc284a2a640 1 --2- 172.21.15.42:0/1697565038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc280102570 0x7fc2801029b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc268009900 tx=0x7fc26802a480 comp rx=0 tx=0).stop 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.418+0000 7fc284a2a640 1 -- 172.21.15.42:0/1697565038 shutdown_connections 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.418+0000 7fc284a2a640 1 --2- 172.21.15.42:0/1697565038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280102ef0 0x7fc28010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.418+0000 7fc284a2a640 1 --2- 172.21.15.42:0/1697565038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc280102570 0x7fc2801029b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.418+0000 7fc284a2a640 1 --2- 172.21.15.42:0/1697565038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc280100e20 0x7fc280101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.418+0000 7fc284a2a640 1 -- 172.21.15.42:0/1697565038 >> 172.21.15.42:0/1697565038 conn(0x7fc2800fc7d0 msgr2=0x7fc2800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.418+0000 7fc284a2a640 1 -- 172.21.15.42:0/1697565038 shutdown_connections 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.418+0000 7fc284a2a640 1 -- 172.21.15.42:0/1697565038 wait complete. 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.419+0000 7fc284a2a640 1 Processor -- start 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.419+0000 7fc284a2a640 1 -- start start 2024-09-19T09:37:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc284a2a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc280100e20 0x7fc2801984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc284a2a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc280102570 0x7fc280198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc284a2a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280102ef0 0x7fc28019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc284a2a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc280110f80 con 0x7fc280100e20 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc284a2a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc280110e00 con 0x7fc280102570 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc284a2a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc280111100 con 0x7fc280102ef0 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc27e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc280100e20 0x7fc2801984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc27e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc280100e20 0x7fc2801984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37322/0 (socket says 172.21.15.42:37322) 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc27e59c640 1 -- 172.21.15.42:0/4190560715 learned_addr learned my addr 172.21.15.42:0/4190560715 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc27ed9d640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280102ef0 0x7fc28019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc275d9b640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc280102570 0x7fc280198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc27e59c640 1 -- 172.21.15.42:0/4190560715 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280102ef0 msgr2=0x7fc28019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc27e59c640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280102ef0 0x7fc28019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc27e59c640 1 -- 172.21.15.42:0/4190560715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc280102570 msgr2=0x7fc280198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc27e59c640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc280102570 0x7fc280198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc27e59c640 1 -- 172.21.15.42:0/4190560715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28019d490 con 0x7fc280100e20 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc275d9b640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc280102570 0x7fc280198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.420+0000 7fc27e59c640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc280100e20 0x7fc2801984e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc27000c890 tx=0x7fc27000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.421+0000 7fc277fff640 1 -- 172.21.15.42:0/4190560715 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270004220 con 0x7fc280100e20 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.421+0000 7fc277fff640 1 -- 172.21.15.42:0/4190560715 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2700043c0 con 0x7fc280100e20 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.421+0000 7fc284a2a640 1 -- 172.21.15.42:0/4190560715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28019d780 con 0x7fc280100e20 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.421+0000 7fc277fff640 1 -- 172.21.15.42:0/4190560715 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2700049e0 con 0x7fc280100e20 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.421+0000 7fc284a2a640 1 -- 172.21.15.42:0/4190560715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2801a5060 con 0x7fc280100e20 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.422+0000 7fc284a2a640 1 -- 172.21.15.42:0/4190560715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc280101200 con 0x7fc280100e20 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.423+0000 7fc277fff640 1 -- 172.21.15.42:0/4190560715 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc2700079b0 con 0x7fc280100e20 2024-09-19T09:37:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.423+0000 7fc277fff640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc26c0a3240 0x7fc26c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.424+0000 7fc275d9b640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc26c0a3240 0x7fc26c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.424+0000 7fc277fff640 1 -- 172.21.15.42:0/4190560715 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fc2700cf820 con 0x7fc280100e20 2024-09-19T09:37:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.424+0000 7fc275d9b640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc26c0a3240 0x7fc26c0a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc2800fffe0 tx=0x7fc268005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.428+0000 7fc277fff640 1 -- 172.21.15.42:0/4190560715 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc270014030 con 0x7fc280100e20 2024-09-19T09:37:22.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.641+0000 7fc284a2a640 1 -- 172.21.15.42:0/4190560715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc28010a0a0 con 0x7fc280100e20 2024-09-19T09:37:23.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:22.999+0000 7fc277fff640 1 -- 172.21.15.42:0/4190560715 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fc27009c690 con 0x7fc280100e20 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 -- 172.21.15.42:0/4190560715 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc26c0a3240 msgr2=0x7fc26c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc26c0a3240 0x7fc26c0a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc2800fffe0 tx=0x7fc268005a20 comp rx=0 tx=0).stop 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 -- 172.21.15.42:0/4190560715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc280100e20 msgr2=0x7fc2801984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc280100e20 0x7fc2801984e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc27000c890 tx=0x7fc27000cd50 comp rx=0 tx=0).stop 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 -- 172.21.15.42:0/4190560715 shutdown_connections 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc26c0a3240 0x7fc26c0a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280102ef0 0x7fc28019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc280102570 0x7fc280198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 --2- 172.21.15.42:0/4190560715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc280100e20 0x7fc2801984e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 -- 172.21.15.42:0/4190560715 >> 172.21.15.42:0/4190560715 conn(0x7fc2800fc7d0 msgr2=0x7fc28006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 -- 172.21.15.42:0/4190560715 shutdown_connections 2024-09-19T09:37:23.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:23.001+0000 7fc284a2a640 1 -- 172.21.15.42:0/4190560715 wait complete. 2024-09-19T09:37:23.295 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:22 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] up:active 2024-09-19T09:37:23.296 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:22 smithi042 ceph-mon[31223]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:37:23.296 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:22 smithi042 ceph-mon[31223]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:37:23.296 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:22 smithi042 ceph-mon[31223]: Cluster is now healthy 2024-09-19T09:37:23.296 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:22 smithi042 ceph-mon[31223]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-19T09:37:23.296 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:22 smithi042 ceph-mon[31223]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T09:37:23.296 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:22 smithi042 ceph-mon[31223]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-19T09:37:23.296 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:22 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/4190560715' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:37:23.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:22 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] up:active 2024-09-19T09:37:23.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:22 smithi171 ceph-mon[35803]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:37:23.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:22 smithi171 ceph-mon[35803]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:37:23.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:22 smithi171 ceph-mon[35803]: Cluster is now healthy 2024-09-19T09:37:23.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:22 smithi171 ceph-mon[35803]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-19T09:37:23.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:22 smithi171 ceph-mon[35803]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T09:37:23.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:22 smithi171 ceph-mon[35803]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-19T09:37:23.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:22 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/4190560715' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:37:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] up:active 2024-09-19T09:37:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-mon[34840]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:37:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-mon[34840]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:37:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-mon[34840]: Cluster is now healthy 2024-09-19T09:37:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-mon[34840]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-19T09:37:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-mon[34840]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T09:37:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-mon[34840]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-19T09:37:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:22 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/4190560715' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:37:23.613 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-19T09:37:23.614 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T09:37:23.876 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:24.274 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:24 smithi042 ceph-mon[31223]: pgmap v277: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 9 op/s 2024-09-19T09:37:24.274 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:24 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/4190560715' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:37:24.275 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:24 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] up:active 2024-09-19T09:37:24.275 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:24 smithi042 ceph-mon[31223]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T09:37:24.275 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:24 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:37:24.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:24 smithi171 ceph-mon[35803]: pgmap v277: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 9 op/s 2024-09-19T09:37:24.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:24 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/4190560715' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:37:24.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:24 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] up:active 2024-09-19T09:37:24.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:24 smithi171 ceph-mon[35803]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T09:37:24.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:24 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:37:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.358+0000 7f69d16f0640 1 -- 172.21.15.42:0/57365454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc106ba0 msgr2=0x7f69cc106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.358+0000 7f69d16f0640 1 --2- 172.21.15.42:0/57365454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc106ba0 0x7f69cc106f80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009900 tx=0x7f69bc02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.358+0000 7f69d16f0640 1 -- 172.21.15.42:0/57365454 shutdown_connections 2024-09-19T09:37:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.358+0000 7f69d16f0640 1 --2- 172.21.15.42:0/57365454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69cc100a70 0x7f69cc10ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.358+0000 7f69d16f0640 1 --2- 172.21.15.42:0/57365454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69cc1000d0 0x7f69cc100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.358+0000 7f69d16f0640 1 --2- 172.21.15.42:0/57365454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc106ba0 0x7f69cc106f80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.358+0000 7f69d16f0640 1 -- 172.21.15.42:0/57365454 >> 172.21.15.42:0/57365454 conn(0x7f69cc077210 msgr2=0x7f69cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.359+0000 7f69d16f0640 1 -- 172.21.15.42:0/57365454 shutdown_connections 2024-09-19T09:37:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.359+0000 7f69d16f0640 1 -- 172.21.15.42:0/57365454 wait complete. 2024-09-19T09:37:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.359+0000 7f69d16f0640 1 Processor -- start 2024-09-19T09:37:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.359+0000 7f69d16f0640 1 -- start start 2024-09-19T09:37:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.359+0000 7f69d16f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc1000d0 0x7f69cc1012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69d16f0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69cc100a70 0x7f69cc1017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69d16f0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69cc106ba0 0x7f69cc101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69d16f0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc1120b0 con 0x7f69cc1000d0 2024-09-19T09:37:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69d16f0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc111f30 con 0x7f69cc100a70 2024-09-19T09:37:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69d16f0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc112230 con 0x7f69cc106ba0 2024-09-19T09:37:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69caffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc1000d0 0x7f69cc1012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69caffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc1000d0 0x7f69cc1012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37342/0 (socket says 172.21.15.42:37342) 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69caffd640 1 -- 172.21.15.42:0/3284930951 learned_addr learned my addr 172.21.15.42:0/3284930951 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69cb7fe640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69cc106ba0 0x7f69cc101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69ca7fc640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69cc100a70 0x7f69cc1017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69caffd640 1 -- 172.21.15.42:0/3284930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69cc106ba0 msgr2=0x7f69cc101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69caffd640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69cc106ba0 0x7f69cc101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69caffd640 1 -- 172.21.15.42:0/3284930951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69cc100a70 msgr2=0x7f69cc1017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69caffd640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69cc100a70 0x7f69cc1017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69caffd640 1 -- 172.21.15.42:0/3284930951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc1a69b0 con 0x7f69cc1000d0 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69cb7fe640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69cc106ba0 0x7f69cc101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69caffd640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc1000d0 0x7f69cc1012b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69bc006010 tx=0x7f69bc003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69b3fff640 1 -- 172.21.15.42:0/3284930951 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc03f070 con 0x7f69cc1000d0 2024-09-19T09:37:24.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69b3fff640 1 -- 172.21.15.42:0/3284930951 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69bc031e30 con 0x7f69cc1000d0 2024-09-19T09:37:24.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69d16f0640 1 -- 172.21.15.42:0/3284930951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69cc1a6c40 con 0x7f69cc1000d0 2024-09-19T09:37:24.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.360+0000 7f69b3fff640 1 -- 172.21.15.42:0/3284930951 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc035030 con 0x7f69cc1000d0 2024-09-19T09:37:24.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.361+0000 7f69d16f0640 1 -- 172.21.15.42:0/3284930951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69cc1a7120 con 0x7f69cc1000d0 2024-09-19T09:37:24.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.362+0000 7f69d16f0640 1 -- 172.21.15.42:0/3284930951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69cc100530 con 0x7f69cc1000d0 2024-09-19T09:37:24.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.363+0000 7f69b3fff640 1 -- 172.21.15.42:0/3284930951 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f69bc042070 con 0x7f69cc1000d0 2024-09-19T09:37:24.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.363+0000 7f69b3fff640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b40a3240 0x7f69b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:24.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.364+0000 7f69ca7fc640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b40a3240 0x7f69b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:24.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.364+0000 7f69b3fff640 1 -- 172.21.15.42:0/3284930951 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f69bc0f01a0 con 0x7f69cc1000d0 2024-09-19T09:37:24.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.364+0000 7f69ca7fc640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b40a3240 0x7f69b40a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69cc102d40 tx=0x7f69c0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:24.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.368+0000 7f69b3fff640 1 -- 172.21.15.42:0/3284930951 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69bc0bd010 con 0x7f69cc1000d0 2024-09-19T09:37:24.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:24 smithi136 ceph-mon[34840]: pgmap v277: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 9 op/s 2024-09-19T09:37:24.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:24 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/4190560715' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:37:24.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:24 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] up:active 2024-09-19T09:37:24.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:24 smithi136 ceph-mon[34840]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T09:37:24.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:24 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:37:24.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.568+0000 7f69d16f0640 1 -- 172.21.15.42:0/3284930951 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f69cc105290 con 0x7f69b40a3240 2024-09-19T09:37:24.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.596+0000 7f69b3fff640 1 -- 172.21.15.42:0/3284930951 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f69cc105290 con 0x7f69b40a3240 2024-09-19T09:37:24.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.598+0000 7f69d16f0640 1 -- 172.21.15.42:0/3284930951 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b40a3240 msgr2=0x7f69b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b40a3240 0x7f69b40a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69cc102d40 tx=0x7f69c0008040 comp rx=0 tx=0).stop 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 -- 172.21.15.42:0/3284930951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc1000d0 msgr2=0x7f69cc1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc1000d0 0x7f69cc1012b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69bc006010 tx=0x7f69bc003c80 comp rx=0 tx=0).stop 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 -- 172.21.15.42:0/3284930951 shutdown_connections 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f69b40a3240 0x7f69b40a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69cc106ba0 0x7f69cc101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69cc100a70 0x7f69cc1017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 --2- 172.21.15.42:0/3284930951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69cc1000d0 0x7f69cc1012b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 -- 172.21.15.42:0/3284930951 >> 172.21.15.42:0/3284930951 conn(0x7f69cc077210 msgr2=0x7f69cc104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 -- 172.21.15.42:0/3284930951 shutdown_connections 2024-09-19T09:37:24.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:24.599+0000 7f69d16f0640 1 -- 172.21.15.42:0/3284930951 wait complete. 2024-09-19T09:37:24.954 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:37:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:37:24.573+0000 7ffa1e9b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:37:24.954 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:37:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:37:24.573+0000 7ffa1e9b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:37:24.955 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:37:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:37:24.573+0000 7ffa1e9b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:37:24.955 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:37:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:37:24.573+0000 7ffa1e9b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:37:24.955 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:37:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:37:24.573+0000 7ffa1e9b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:37:25.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T09:37:25.515 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:25.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.943+0000 7f06690c1640 1 -- 172.21.15.42:0/2114974680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0664102ef0 msgr2=0x7f066410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.943+0000 7f06690c1640 1 --2- 172.21.15.42:0/2114974680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0664102ef0 0x7f066410da40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0654009900 tx=0x7f065402a480 comp rx=0 tx=0).stop 2024-09-19T09:37:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.943+0000 7f06690c1640 1 -- 172.21.15.42:0/2114974680 shutdown_connections 2024-09-19T09:37:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.943+0000 7f06690c1640 1 --2- 172.21.15.42:0/2114974680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0664102ef0 0x7f066410da40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.943+0000 7f06690c1640 1 --2- 172.21.15.42:0/2114974680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0664102570 0x7f06641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.943+0000 7f06690c1640 1 --2- 172.21.15.42:0/2114974680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0664100e20 0x7f0664101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.943+0000 7f06690c1640 1 -- 172.21.15.42:0/2114974680 >> 172.21.15.42:0/2114974680 conn(0x7f06640fc7d0 msgr2=0x7f06640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.943+0000 7f06690c1640 1 -- 172.21.15.42:0/2114974680 shutdown_connections 2024-09-19T09:37:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.943+0000 7f06690c1640 1 -- 172.21.15.42:0/2114974680 wait complete. 2024-09-19T09:37:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f06690c1640 1 Processor -- start 2024-09-19T09:37:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f06690c1640 1 -- start start 2024-09-19T09:37:25.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f06690c1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0664100e20 0x7f0664198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:25.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f06690c1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0664102570 0x7f0664198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:25.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f06690c1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0664102ef0 0x7f066419cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:25.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f06690c1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0664111020 con 0x7f0664102570 2024-09-19T09:37:25.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f06690c1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0664110ea0 con 0x7f0664100e20 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f06690c1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f06641111a0 con 0x7f0664102ef0 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f066259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0664102570 0x7f0664198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f066259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0664102570 0x7f0664198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37384/0 (socket says 172.21.15.42:37384) 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.944+0000 7f066259c640 1 -- 172.21.15.42:0/2633888789 learned_addr learned my addr 172.21.15.42:0/2633888789 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f0662d9d640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0664100e20 0x7f0664198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f066359e640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0664102ef0 0x7f066419cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f066259c640 1 -- 172.21.15.42:0/2633888789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0664102ef0 msgr2=0x7f066419cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f066259c640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0664102ef0 0x7f066419cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f066259c640 1 -- 172.21.15.42:0/2633888789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0664100e20 msgr2=0x7f0664198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f066259c640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0664100e20 0x7f0664198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f066259c640 1 -- 172.21.15.42:0/2633888789 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066419d640 con 0x7f0664102570 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f066359e640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0664102ef0 0x7f066419cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f0662d9d640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0664100e20 0x7f0664198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f066259c640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0664102570 0x7f0664198bd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f064c00b4a0 tx=0x7f064c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f065bfff640 1 -- 172.21.15.42:0/2633888789 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c014070 con 0x7f0664102570 2024-09-19T09:37:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f065bfff640 1 -- 172.21.15.42:0/2633888789 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f064c010af0 con 0x7f0664102570 2024-09-19T09:37:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f065bfff640 1 -- 172.21.15.42:0/2633888789 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c017d10 con 0x7f0664102570 2024-09-19T09:37:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f06690c1640 1 -- 172.21.15.42:0/2633888789 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066419d930 con 0x7f0664102570 2024-09-19T09:37:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.945+0000 7f06690c1640 1 -- 172.21.15.42:0/2633888789 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06641a5210 con 0x7f0664102570 2024-09-19T09:37:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.946+0000 7f06690c1640 1 -- 172.21.15.42:0/2633888789 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0664101280 con 0x7f0664102570 2024-09-19T09:37:25.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.947+0000 7f065bfff640 1 -- 172.21.15.42:0/2633888789 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f064c017070 con 0x7f0664102570 2024-09-19T09:37:25.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.948+0000 7f065bfff640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06500a3240 0x7f06500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:25.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.948+0000 7f0662d9d640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06500a3240 0x7f06500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:25.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.948+0000 7f065bfff640 1 -- 172.21.15.42:0/2633888789 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f064c0cecb0 con 0x7f0664102570 2024-09-19T09:37:25.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.949+0000 7f0662d9d640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06500a3240 0x7f06500a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f065c009fa0 tx=0x7f065c009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:25.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:25.952+0000 7f065bfff640 1 -- 172.21.15.42:0/2633888789 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f064c09bb20 con 0x7f0664102570 2024-09-19T09:37:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.154+0000 7f06690c1640 1 -- 172.21.15.42:0/2633888789 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0664062630 con 0x7f06500a3240 2024-09-19T09:37:26.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.178+0000 7f065bfff640 1 -- 172.21.15.42:0/2633888789 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0664062630 con 0x7f06500a3240 2024-09-19T09:37:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 -- 172.21.15.42:0/2633888789 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06500a3240 msgr2=0x7f06500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06500a3240 0x7f06500a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f065c009fa0 tx=0x7f065c009570 comp rx=0 tx=0).stop 2024-09-19T09:37:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 -- 172.21.15.42:0/2633888789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0664102570 msgr2=0x7f0664198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0664102570 0x7f0664198bd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f064c00b4a0 tx=0x7f064c00b960 comp rx=0 tx=0).stop 2024-09-19T09:37:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 -- 172.21.15.42:0/2633888789 shutdown_connections 2024-09-19T09:37:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06500a3240 0x7f06500a5700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0664102ef0 0x7f066419cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0664102570 0x7f0664198bd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:26.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 --2- 172.21.15.42:0/2633888789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0664100e20 0x7f0664198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:26.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 -- 172.21.15.42:0/2633888789 >> 172.21.15.42:0/2633888789 conn(0x7f06640fc7d0 msgr2=0x7f066406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:26.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 -- 172.21.15.42:0/2633888789 shutdown_connections 2024-09-19T09:37:26.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:26.180+0000 7f06690c1640 1 -- 172.21.15.42:0/2633888789 wait complete. 2024-09-19T09:37:26.191 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:26 smithi042 ceph-mon[31223]: pgmap v278: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-19T09:37:26.191 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:26 smithi042 ceph-mon[31223]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:26.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:26 smithi171 ceph-mon[35803]: pgmap v278: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-19T09:37:26.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:26 smithi171 ceph-mon[35803]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:26.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:26 smithi136 ceph-mon[34840]: pgmap v278: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-19T09:37:26.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:26 smithi136 ceph-mon[34840]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:26.875 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T09:37:27.143 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:27.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:27.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-19T09:37:27.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-19T09:37:27.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T09:37:27.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T09:37:27.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T09:37:27.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-19T09:37:27.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-09-19T09:37:27.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-19T09:37:27.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-19T09:37:27.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:27 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T09:37:27.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:27.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-19T09:37:27.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-19T09:37:27.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T09:37:27.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T09:37:27.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T09:37:27.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-19T09:37:27.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-09-19T09:37:27.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-19T09:37:27.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-19T09:37:27.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:27 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-19T09:37:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:27 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T09:37:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.568+0000 7f918339f640 1 -- 172.21.15.42:0/3074623411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f917c1008d0 msgr2=0x7f917c100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.568+0000 7f918339f640 1 --2- 172.21.15.42:0/3074623411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f917c1008d0 0x7f917c100d30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f916c009930 tx=0x7f916c02a420 comp rx=0 tx=0).stop 2024-09-19T09:37:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.568+0000 7f918339f640 1 -- 172.21.15.42:0/3074623411 shutdown_connections 2024-09-19T09:37:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.568+0000 7f918339f640 1 --2- 172.21.15.42:0/3074623411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c101270 0x7f917c10d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.568+0000 7f918339f640 1 --2- 172.21.15.42:0/3074623411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f917c1008d0 0x7f917c100d30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.568+0000 7f918339f640 1 --2- 172.21.15.42:0/3074623411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f917c1068d0 0x7f917c106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.568+0000 7f918339f640 1 -- 172.21.15.42:0/3074623411 >> 172.21.15.42:0/3074623411 conn(0x7f917c0fc630 msgr2=0x7f917c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.568+0000 7f918339f640 1 -- 172.21.15.42:0/3074623411 shutdown_connections 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.568+0000 7f918339f640 1 -- 172.21.15.42:0/3074623411 wait complete. 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.569+0000 7f918339f640 1 Processor -- start 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.569+0000 7f918339f640 1 -- start start 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.569+0000 7f918339f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f917c1008d0 0x7f917c199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.569+0000 7f918339f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f917c101270 0x7f917c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.569+0000 7f918339f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c1068d0 0x7f917c1a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.569+0000 7f918339f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f917c110cd0 con 0x7f917c1008d0 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.569+0000 7f918339f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f917c110b50 con 0x7f917c101270 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.569+0000 7f918339f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f917c110e50 con 0x7f917c1068d0 2024-09-19T09:37:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918239d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f917c1008d0 0x7f917c199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918239d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f917c1008d0 0x7f917c199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37402/0 (socket says 172.21.15.42:37402) 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918239d640 1 -- 172.21.15.42:0/1734758365 learned_addr learned my addr 172.21.15.42:0/1734758365 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f9181b9c640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f917c101270 0x7f917c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f9182b9e640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c1068d0 0x7f917c1a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918239d640 1 -- 172.21.15.42:0/1734758365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c1068d0 msgr2=0x7f917c1a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918239d640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c1068d0 0x7f917c1a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918239d640 1 -- 172.21.15.42:0/1734758365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f917c101270 msgr2=0x7f917c199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918239d640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f917c101270 0x7f917c199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918239d640 1 -- 172.21.15.42:0/1734758365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917c196f20 con 0x7f917c1008d0 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f9181b9c640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f917c101270 0x7f917c199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918239d640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f917c1008d0 0x7f917c199130 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f917800e9f0 tx=0x7f917800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f91737fe640 1 -- 172.21.15.42:0/1734758365 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917800cd80 con 0x7f917c1008d0 2024-09-19T09:37:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f91737fe640 1 -- 172.21.15.42:0/1734758365 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9178010910 con 0x7f917c1008d0 2024-09-19T09:37:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918339f640 1 -- 172.21.15.42:0/1734758365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917c197210 con 0x7f917c1008d0 2024-09-19T09:37:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f91737fe640 1 -- 172.21.15.42:0/1734758365 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178018990 con 0x7f917c1008d0 2024-09-19T09:37:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.570+0000 7f918339f640 1 -- 172.21.15.42:0/1734758365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f917c197720 con 0x7f917c1008d0 2024-09-19T09:37:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.571+0000 7f918339f640 1 -- 172.21.15.42:0/1734758365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f917c102010 con 0x7f917c1008d0 2024-09-19T09:37:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.572+0000 7f91737fe640 1 -- 172.21.15.42:0/1734758365 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9178010ac0 con 0x7f917c1008d0 2024-09-19T09:37:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.573+0000 7f91737fe640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91680a32d0 0x7f91680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.573+0000 7f9181b9c640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91680a32d0 0x7f91680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.573+0000 7f91737fe640 1 -- 172.21.15.42:0/1734758365 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f91780cfe60 con 0x7f917c1008d0 2024-09-19T09:37:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.574+0000 7f9181b9c640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91680a32d0 0x7f91680a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f916c000c00 tx=0x7f916c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:27.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.577+0000 7f91737fe640 1 -- 172.21.15.42:0/1734758365 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f917809c9a0 con 0x7f917c1008d0 2024-09-19T09:37:27.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.783+0000 7f918339f640 1 -- 172.21.15.42:0/1734758365 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f917c062630 con 0x7f91680a32d0 2024-09-19T09:37:27.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.787+0000 7f91737fe640 1 -- 172.21.15.42:0/1734758365 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f917c062630 con 0x7f91680a32d0 2024-09-19T09:37:27.789 INFO:teuthology.orchestra.run.smithi042.stdout:/volumes/qa/sv_0/f1ba0bcd-341c-44c5-9414-dfe10cc59eac 2024-09-19T09:37:27.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 -- 172.21.15.42:0/1734758365 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91680a32d0 msgr2=0x7f91680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:27.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91680a32d0 0x7f91680a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f916c000c00 tx=0x7f916c005a20 comp rx=0 tx=0).stop 2024-09-19T09:37:27.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 -- 172.21.15.42:0/1734758365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f917c1008d0 msgr2=0x7f917c199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:27.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f917c1008d0 0x7f917c199130 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f917800e9f0 tx=0x7f917800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:37:27.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 -- 172.21.15.42:0/1734758365 shutdown_connections 2024-09-19T09:37:27.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91680a32d0 0x7f91680a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:27.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c1068d0 0x7f917c1a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:27.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f917c101270 0x7f917c199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:27.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 --2- 172.21.15.42:0/1734758365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f917c1008d0 0x7f917c199130 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:27.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 -- 172.21.15.42:0/1734758365 >> 172.21.15.42:0/1734758365 conn(0x7f917c0fc630 msgr2=0x7f917c0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:27.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 -- 172.21.15.42:0/1734758365 shutdown_connections 2024-09-19T09:37:27.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:27.789+0000 7f918339f640 1 -- 172.21.15.42:0/1734758365 wait complete. 2024-09-19T09:37:28.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: pgmap v279: 97 pgs: 97 active+clean; 585 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-09-19T09:37:28.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-19T09:37:28.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-19T09:37:28.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T09:37:28.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T09:37:28.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T09:37:28.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-19T09:37:28.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-19T09:37:28.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-19T09:37:28.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-19T09:37:28.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T09:37:28.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:37:28.349 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:28 smithi171 ceph-mon[35803]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:37:28.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: pgmap v279: 97 pgs: 97 active+clean; 585 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-09-19T09:37:28.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-19T09:37:28.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-19T09:37:28.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T09:37:28.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T09:37:28.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T09:37:28.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-19T09:37:28.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-19T09:37:28.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-19T09:37:28.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-19T09:37:28.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T09:37:28.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:37:28.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:28 smithi136 ceph-mon[34840]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:37:28.419 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: pgmap v279: 97 pgs: 97 active+clean; 585 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-09-19T09:37:28.419 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-19T09:37:28.419 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-19T09:37:28.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T09:37:28.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T09:37:28.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T09:37:28.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-19T09:37:28.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-19T09:37:28.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-19T09:37:28.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-19T09:37:28.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T09:37:28.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:37:28.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:28 smithi042 ceph-mon[31223]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:37:28.448 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T09:37:28.703 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:29.150 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:29 smithi042 ceph-mon[31223]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:29.150 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:29 smithi042 ceph-mon[31223]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:37:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.148+0000 7f5c1de7c640 1 -- 172.21.15.42:0/408630679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c18102790 msgr2=0x7f5c181067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.148+0000 7f5c1de7c640 1 --2- 172.21.15.42:0/408630679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c18102790 0x7f5c181067e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009900 tx=0x7f5c0002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.148+0000 7f5c1de7c640 1 -- 172.21.15.42:0/408630679 shutdown_connections 2024-09-19T09:37:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.148+0000 7f5c1de7c640 1 --2- 172.21.15.42:0/408630679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c18106f10 0x7f5c1810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.148+0000 7f5c1de7c640 1 --2- 172.21.15.42:0/408630679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c18102790 0x7f5c181067e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.148+0000 7f5c1de7c640 1 --2- 172.21.15.42:0/408630679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c18101de0 0x7f5c181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.148+0000 7f5c1de7c640 1 -- 172.21.15.42:0/408630679 >> 172.21.15.42:0/408630679 conn(0x7f5c180fd8c0 msgr2=0x7f5c180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.148+0000 7f5c1de7c640 1 -- 172.21.15.42:0/408630679 shutdown_connections 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.148+0000 7f5c1de7c640 1 -- 172.21.15.42:0/408630679 wait complete. 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.149+0000 7f5c1de7c640 1 Processor -- start 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.149+0000 7f5c1de7c640 1 -- start start 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.149+0000 7f5c1de7c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c18101de0 0x7f5c18198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.149+0000 7f5c1de7c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c18102790 0x7f5c18198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c1de7c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c18106f10 0x7f5c1819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c1de7c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18111f30 con 0x7f5c18106f10 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c1de7c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18111db0 con 0x7f5c18102790 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c1de7c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181120b0 con 0x7f5c18101de0 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c18106f10 0x7f5c1819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c18106f10 0x7f5c1819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37424/0 (socket says 172.21.15.42:37424) 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c17fff640 1 -- 172.21.15.42:0/2381483939 learned_addr learned my addr 172.21.15.42:0/2381483939 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c177fe640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c18101de0 0x7f5c18198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c0ffff640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c18102790 0x7f5c18198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c17fff640 1 -- 172.21.15.42:0/2381483939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c18101de0 msgr2=0x7f5c18198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c17fff640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c18101de0 0x7f5c18198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c17fff640 1 -- 172.21.15.42:0/2381483939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c18102790 msgr2=0x7f5c18198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c17fff640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c18102790 0x7f5c18198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c17fff640 1 -- 172.21.15.42:0/2381483939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1819d3c0 con 0x7f5c18106f10 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c17fff640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c18106f10 0x7f5c1819cce0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000cad0 tx=0x7f5c1000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c157fa640 1 -- 172.21.15.42:0/2381483939 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000ad60 con 0x7f5c18106f10 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c1de7c640 1 -- 172.21.15.42:0/2381483939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1819d6b0 con 0x7f5c18106f10 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c157fa640 1 -- 172.21.15.42:0/2381483939 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c10005020 con 0x7f5c18106f10 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c157fa640 1 -- 172.21.15.42:0/2381483939 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000f6b0 con 0x7f5c18106f10 2024-09-19T09:37:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.150+0000 7f5c1de7c640 1 -- 172.21.15.42:0/2381483939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c181a4f90 con 0x7f5c18106f10 2024-09-19T09:37:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.151+0000 7f5c1de7c640 1 -- 172.21.15.42:0/2381483939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c181021c0 con 0x7f5c18106f10 2024-09-19T09:37:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.152+0000 7f5c157fa640 1 -- 172.21.15.42:0/2381483939 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5c10005560 con 0x7f5c18106f10 2024-09-19T09:37:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.153+0000 7f5c157fa640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5c040a32d0 0x7f5c040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.153+0000 7f5c177fe640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5c040a32d0 0x7f5c040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.153+0000 7f5c157fa640 1 -- 172.21.15.42:0/2381483939 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f5c100cfb70 con 0x7f5c18106f10 2024-09-19T09:37:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.154+0000 7f5c177fe640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5c040a32d0 0x7f5c040a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800abe0 tx=0x7f5c0800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.157+0000 7f5c157fa640 1 -- 172.21.15.42:0/2381483939 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c10014030 con 0x7f5c18106f10 2024-09-19T09:37:29.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:29 smithi171 ceph-mon[35803]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:29.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:29 smithi171 ceph-mon[35803]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:37:29.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.362+0000 7f5c1de7c640 1 -- 172.21.15.42:0/2381483939 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5c1810a160 con 0x7f5c040a32d0 2024-09-19T09:37:29.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:29 smithi136 ceph-mon[34840]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:29.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:29 smithi136 ceph-mon[34840]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:37:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.388+0000 7f5c157fa640 1 -- 172.21.15.42:0/2381483939 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5c0800fc20 con 0x7f5c040a32d0 2024-09-19T09:37:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 -- 172.21.15.42:0/2381483939 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5c040a32d0 msgr2=0x7f5c040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5c040a32d0 0x7f5c040a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800abe0 tx=0x7f5c0800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 -- 172.21.15.42:0/2381483939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c18106f10 msgr2=0x7f5c1819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c18106f10 0x7f5c1819cce0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000cad0 tx=0x7f5c1000ced0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 -- 172.21.15.42:0/2381483939 shutdown_connections 2024-09-19T09:37:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5c040a32d0 0x7f5c040a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c18106f10 0x7f5c1819cce0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c18102790 0x7f5c18198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 --2- 172.21.15.42:0/2381483939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c18101de0 0x7f5c18198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 -- 172.21.15.42:0/2381483939 >> 172.21.15.42:0/2381483939 conn(0x7f5c180fd8c0 msgr2=0x7f5c180fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 -- 172.21.15.42:0/2381483939 shutdown_connections 2024-09-19T09:37:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:29.391+0000 7f5c1de7c640 1 -- 172.21.15.42:0/2381483939 wait complete. 2024-09-19T09:37:30.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T09:37:30.109 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:30 smithi042 ceph-mon[31223]: pgmap v282: 97 pgs: 97 active+clean; 610 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 KiB/s wr, 25 op/s; 3.3 KiB/s, 1 objects/s recovering 2024-09-19T09:37:30.109 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:30 smithi042 ceph-mon[31223]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:30.343 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:30.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:30 smithi171 ceph-mon[35803]: pgmap v282: 97 pgs: 97 active+clean; 610 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 KiB/s wr, 25 op/s; 3.3 KiB/s, 1 objects/s recovering 2024-09-19T09:37:30.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:30 smithi171 ceph-mon[35803]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:30 smithi136 ceph-mon[34840]: pgmap v282: 97 pgs: 97 active+clean; 610 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 KiB/s wr, 25 op/s; 3.3 KiB/s, 1 objects/s recovering 2024-09-19T09:37:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:30 smithi136 ceph-mon[34840]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:30.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 -- 172.21.15.42:0/2378530652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c4102570 msgr2=0x7f01c41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:30.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 --2- 172.21.15.42:0/2378530652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c4102570 0x7f01c41029b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009900 tx=0x7f01b802a480 comp rx=0 tx=0).stop 2024-09-19T09:37:30.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 -- 172.21.15.42:0/2378530652 shutdown_connections 2024-09-19T09:37:30.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 --2- 172.21.15.42:0/2378530652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01c4102ef0 0x7f01c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 --2- 172.21.15.42:0/2378530652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c4102570 0x7f01c41029b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 --2- 172.21.15.42:0/2378530652 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01c4100e20 0x7f01c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 -- 172.21.15.42:0/2378530652 >> 172.21.15.42:0/2378530652 conn(0x7f01c40fc7d0 msgr2=0x7f01c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:30.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 -- 172.21.15.42:0/2378530652 shutdown_connections 2024-09-19T09:37:30.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 -- 172.21.15.42:0/2378530652 wait complete. 2024-09-19T09:37:30.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 Processor -- start 2024-09-19T09:37:30.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 -- start start 2024-09-19T09:37:30.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c4100e20 0x7f01c41973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:30.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.765+0000 7f01caaf7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01c4102570 0x7f01c41978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:30.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01caaf7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01c4102ef0 0x7f01c419bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:30.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01caaf7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f01c4110fd0 con 0x7f01c4100e20 2024-09-19T09:37:30.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01caaf7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f01c4110e50 con 0x7f01c4102570 2024-09-19T09:37:30.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01caaf7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f01c4111150 con 0x7f01c4102ef0 2024-09-19T09:37:30.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c8893640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c4100e20 0x7f01c41973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:30.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c8893640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c4100e20 0x7f01c41973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59580/0 (socket says 172.21.15.42:59580) 2024-09-19T09:37:30.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c8893640 1 -- 172.21.15.42:0/212964308 learned_addr learned my addr 172.21.15.42:0/212964308 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:30.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c9094640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01c4102ef0 0x7f01c419bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:30.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c3fff640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01c4102570 0x7f01c41978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:30.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c8893640 1 -- 172.21.15.42:0/212964308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01c4102ef0 msgr2=0x7f01c419bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:30.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c8893640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01c4102ef0 0x7f01c419bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c8893640 1 -- 172.21.15.42:0/212964308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01c4102570 msgr2=0x7f01c41978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c8893640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01c4102570 0x7f01c41978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c8893640 1 -- 172.21.15.42:0/212964308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c419c360 con 0x7f01c4100e20 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c3fff640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01c4102570 0x7f01c41978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c8893640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c4100e20 0x7f01c41973b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f01b400d950 tx=0x7f01b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c1ffb640 1 -- 172.21.15.42:0/212964308 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b4017070 con 0x7f01c4100e20 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c1ffb640 1 -- 172.21.15.42:0/212964308 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01b4009c30 con 0x7f01c4100e20 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01caaf7640 1 -- 172.21.15.42:0/212964308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c419c650 con 0x7f01c4100e20 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.766+0000 7f01c1ffb640 1 -- 172.21.15.42:0/212964308 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b400f6b0 con 0x7f01c4100e20 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.767+0000 7f01caaf7640 1 -- 172.21.15.42:0/212964308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c41a3f30 con 0x7f01c4100e20 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.767+0000 7f01caaf7640 1 -- 172.21.15.42:0/212964308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c4101200 con 0x7f01c4100e20 2024-09-19T09:37:30.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.769+0000 7f01c1ffb640 1 -- 172.21.15.42:0/212964308 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f01b40109d0 con 0x7f01c4100e20 2024-09-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.770+0000 7f01c1ffb640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01ac0a32d0 0x7f01ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.770+0000 7f01c3fff640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01ac0a32d0 0x7f01ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.770+0000 7f01c1ffb640 1 -- 172.21.15.42:0/212964308 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f01b40cf750 con 0x7f01c4100e20 2024-09-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.770+0000 7f01c3fff640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01ac0a32d0 0x7f01ac0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f01b8000c00 tx=0x7f01b8005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.774+0000 7f01c1ffb640 1 -- 172.21.15.42:0/212964308 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f01b4009de0 con 0x7f01c4100e20 2024-09-19T09:37:30.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.980+0000 7f01caaf7640 1 -- 172.21.15.42:0/212964308 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f01c4062630 con 0x7f01ac0a32d0 2024-09-19T09:37:30.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.985+0000 7f01c1ffb640 1 -- 172.21.15.42:0/212964308 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f01c4062630 con 0x7f01ac0a32d0 2024-09-19T09:37:30.987 INFO:teuthology.orchestra.run.smithi042.stdout:/volumes/qa/sv_1/94e4dcd3-edf0-4b47-9d1e-7e59a8a791d4 2024-09-19T09:37:30.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 -- 172.21.15.42:0/212964308 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01ac0a32d0 msgr2=0x7f01ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:30.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01ac0a32d0 0x7f01ac0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f01b8000c00 tx=0x7f01b8005a40 comp rx=0 tx=0).stop 2024-09-19T09:37:30.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 -- 172.21.15.42:0/212964308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c4100e20 msgr2=0x7f01c41973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:30.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c4100e20 0x7f01c41973b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f01b400d950 tx=0x7f01b400de10 comp rx=0 tx=0).stop 2024-09-19T09:37:30.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 -- 172.21.15.42:0/212964308 shutdown_connections 2024-09-19T09:37:30.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01ac0a32d0 0x7f01ac0a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01c4102ef0 0x7f01c419bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01c4102570 0x7f01c41978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 --2- 172.21.15.42:0/212964308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c4100e20 0x7f01c41973b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 -- 172.21.15.42:0/212964308 >> 172.21.15.42:0/212964308 conn(0x7f01c40fc7d0 msgr2=0x7f01c4105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:30.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 -- 172.21.15.42:0/212964308 shutdown_connections 2024-09-19T09:37:30.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:30.988+0000 7f01caaf7640 1 -- 172.21.15.42:0/212964308 wait complete. 2024-09-19T09:37:31.630 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:31.929 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:32.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:32 smithi042 ceph-mon[31223]: pgmap v283: 97 pgs: 97 active+clean; 610 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 KiB/s wr, 24 op/s; 3.5 KiB/s, 2 objects/s recovering 2024-09-19T09:37:32.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:32 smithi042 ceph-mon[31223]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:32.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:32 smithi171 ceph-mon[35803]: pgmap v283: 97 pgs: 97 active+clean; 610 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 KiB/s wr, 24 op/s; 3.5 KiB/s, 2 objects/s recovering 2024-09-19T09:37:32.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:32 smithi171 ceph-mon[35803]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.367+0000 7fb49c8df640 1 -- 172.21.15.42:0/3580488066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb498106a80 msgr2=0x7fb498106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.367+0000 7fb49c8df640 1 --2- 172.21.15.42:0/3580488066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb498106a80 0x7fb498106e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb488009930 tx=0x7fb48802a420 comp rx=0 tx=0).stop 2024-09-19T09:37:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.367+0000 7fb49c8df640 1 -- 172.21.15.42:0/3580488066 shutdown_connections 2024-09-19T09:37:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.367+0000 7fb49c8df640 1 --2- 172.21.15.42:0/3580488066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb498101420 0x7fb49810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.367+0000 7fb49c8df640 1 --2- 172.21.15.42:0/3580488066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb498100a80 0x7fb498100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.367+0000 7fb49c8df640 1 --2- 172.21.15.42:0/3580488066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb498106a80 0x7fb498106e60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.367+0000 7fb49c8df640 1 -- 172.21.15.42:0/3580488066 >> 172.21.15.42:0/3580488066 conn(0x7fb4980fc7a0 msgr2=0x7fb4980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.367+0000 7fb49c8df640 1 -- 172.21.15.42:0/3580488066 shutdown_connections 2024-09-19T09:37:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.367+0000 7fb49c8df640 1 -- 172.21.15.42:0/3580488066 wait complete. 2024-09-19T09:37:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb49c8df640 1 Processor -- start 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb49c8df640 1 -- start start 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb49c8df640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb498100a80 0x7fb4981973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb49c8df640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb498101420 0x7fb4981978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb49c8df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb498106a80 0x7fb49819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb49c8df640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb498110e40 con 0x7fb498106a80 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb49c8df640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb498110cc0 con 0x7fb498101420 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb49c8df640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb498110fc0 con 0x7fb498100a80 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb496d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb498106a80 0x7fb49819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb496d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb498106a80 0x7fb49819bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59608/0 (socket says 172.21.15.42:59608) 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb496d9d640 1 -- 172.21.15.42:0/3102096280 learned_addr learned my addr 172.21.15.42:0/3102096280 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb49659c640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb498100a80 0x7fb4981973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb495d9b640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb498101420 0x7fb4981978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb496d9d640 1 -- 172.21.15.42:0/3102096280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb498100a80 msgr2=0x7fb4981973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb496d9d640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb498100a80 0x7fb4981973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb496d9d640 1 -- 172.21.15.42:0/3102096280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb498101420 msgr2=0x7fb4981978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb496d9d640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb498101420 0x7fb4981978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb496d9d640 1 -- 172.21.15.42:0/3102096280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49819c350 con 0x7fb498106a80 2024-09-19T09:37:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.368+0000 7fb495d9b640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb498101420 0x7fb4981978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.369+0000 7fb496d9d640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb498106a80 0x7fb49819bc70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb49000cad0 tx=0x7fb49000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.369+0000 7fb4877fe640 1 -- 172.21.15.42:0/3102096280 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49000ae20 con 0x7fb498106a80 2024-09-19T09:37:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.369+0000 7fb4877fe640 1 -- 172.21.15.42:0/3102096280 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb490005020 con 0x7fb498106a80 2024-09-19T09:37:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.369+0000 7fb49c8df640 1 -- 172.21.15.42:0/3102096280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49819c640 con 0x7fb498106a80 2024-09-19T09:37:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.369+0000 7fb4877fe640 1 -- 172.21.15.42:0/3102096280 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49000f6f0 con 0x7fb498106a80 2024-09-19T09:37:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.369+0000 7fb49c8df640 1 -- 172.21.15.42:0/3102096280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49806a790 con 0x7fb498106a80 2024-09-19T09:37:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.370+0000 7fb49c8df640 1 -- 172.21.15.42:0/3102096280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4981021c0 con 0x7fb498106a80 2024-09-19T09:37:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.371+0000 7fb4877fe640 1 -- 172.21.15.42:0/3102096280 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb4900051d0 con 0x7fb498106a80 2024-09-19T09:37:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.372+0000 7fb4877fe640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb4800a3420 0x7fb4800a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.372+0000 7fb49659c640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb4800a3420 0x7fb4800a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:32.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.372+0000 7fb4877fe640 1 -- 172.21.15.42:0/3102096280 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb4900cf970 con 0x7fb498106a80 2024-09-19T09:37:32.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.373+0000 7fb49659c640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb4800a3420 0x7fb4800a58e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb488009900 tx=0x7fb4880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:32.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.376+0000 7fb4877fe640 1 -- 172.21.15.42:0/3102096280 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb490014030 con 0x7fb498106a80 2024-09-19T09:37:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:32 smithi136 ceph-mon[34840]: pgmap v283: 97 pgs: 97 active+clean; 610 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 KiB/s wr, 24 op/s; 3.5 KiB/s, 2 objects/s recovering 2024-09-19T09:37:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:32 smithi136 ceph-mon[34840]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:32.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.588+0000 7fb49c8df640 1 -- 172.21.15.42:0/3102096280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb498100ee0 con 0x7fb498106a80 2024-09-19T09:37:32.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.588+0000 7fb4877fe640 1 -- 172.21.15.42:0/3102096280 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7fb498100ee0 con 0x7fb498106a80 2024-09-19T09:37:32.590 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:32.590 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":27,"btime":"2024-09-19T09:37:23:003045+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:37:23.003018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:37:32.591 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 27 2024-09-19T09:37:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.590+0000 7fb49c8df640 1 -- 172.21.15.42:0/3102096280 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb4800a3420 msgr2=0x7fb4800a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:32.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.590+0000 7fb49c8df640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb4800a3420 0x7fb4800a58e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb488009900 tx=0x7fb4880058d0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.590+0000 7fb49c8df640 1 -- 172.21.15.42:0/3102096280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb498106a80 msgr2=0x7fb49819bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.590+0000 7fb49c8df640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb498106a80 0x7fb49819bc70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb49000cad0 tx=0x7fb49000cf90 comp rx=0 tx=0).stop 2024-09-19T09:37:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.591+0000 7fb49c8df640 1 -- 172.21.15.42:0/3102096280 shutdown_connections 2024-09-19T09:37:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.591+0000 7fb49c8df640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb4800a3420 0x7fb4800a58e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.591+0000 7fb49c8df640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb498106a80 0x7fb49819bc70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.591+0000 7fb49c8df640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb498101420 0x7fb4981978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.591+0000 7fb49c8df640 1 --2- 172.21.15.42:0/3102096280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb498100a80 0x7fb4981973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.591+0000 7fb49c8df640 1 -- 172.21.15.42:0/3102096280 >> 172.21.15.42:0/3102096280 conn(0x7fb4980fc7a0 msgr2=0x7fb4980fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.591+0000 7fb49c8df640 1 -- 172.21.15.42:0/3102096280 shutdown_connections 2024-09-19T09:37:32.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:32.591+0000 7fb49c8df640 1 -- 172.21.15.42:0/3102096280 wait complete. 2024-09-19T09:37:33.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:33 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3102096280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:33.246 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:37:33.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:33 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3102096280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:33 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3102096280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:33.503 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:33.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.957+0000 7fbceba33640 1 -- 172.21.15.42:0/3987605326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 msgr2=0x7fbce41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.957+0000 7fbceba33640 1 --2- 172.21.15.42:0/3987605326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce41021c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009900 tx=0x7fbce002a410 comp rx=0 tx=0).stop 2024-09-19T09:37:33.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.957+0000 7fbceba33640 1 -- 172.21.15.42:0/3987605326 shutdown_connections 2024-09-19T09:37:33.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.957+0000 7fbceba33640 1 --2- 172.21.15.42:0/3987605326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4106f10 0x7fbce410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.957+0000 7fbceba33640 1 --2- 172.21.15.42:0/3987605326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4102790 0x7fbce41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.957+0000 7fbceba33640 1 --2- 172.21.15.42:0/3987605326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce41021c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.957+0000 7fbceba33640 1 -- 172.21.15.42:0/3987605326 >> 172.21.15.42:0/3987605326 conn(0x7fbce40fd8c0 msgr2=0x7fbce40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:33.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.957+0000 7fbceba33640 1 -- 172.21.15.42:0/3987605326 shutdown_connections 2024-09-19T09:37:33.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.957+0000 7fbceba33640 1 -- 172.21.15.42:0/3987605326 wait complete. 2024-09-19T09:37:33.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbceba33640 1 Processor -- start 2024-09-19T09:37:33.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbceba33640 1 -- start start 2024-09-19T09:37:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbceba33640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbceba33640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4102790 0x7fbce4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbceba33640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 0x7fbce4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbceba33640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4111f70 con 0x7fbce4101de0 2024-09-19T09:37:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbceba33640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4111df0 con 0x7fbce4106f10 2024-09-19T09:37:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbceba33640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41120f0 con 0x7fbce4102790 2024-09-19T09:37:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbce97cf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbce97cf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59626/0 (socket says 172.21.15.42:59626) 2024-09-19T09:37:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbce97cf640 1 -- 172.21.15.42:0/201901981 learned_addr learned my addr 172.21.15.42:0/201901981 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbce9fd0640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 0x7fbce4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.958+0000 7fbce8fce640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4102790 0x7fbce4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbce97cf640 1 -- 172.21.15.42:0/201901981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4102790 msgr2=0x7fbce4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbce97cf640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4102790 0x7fbce4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbce97cf640 1 -- 172.21.15.42:0/201901981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 msgr2=0x7fbce4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbce97cf640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 0x7fbce4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbce97cf640 1 -- 172.21.15.42:0/201901981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce41a6990 con 0x7fbce4101de0 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbce97cf640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbce0006010 tx=0x7fbce00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbcda7fc640 1 -- 172.21.15.42:0/201901981 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce003f030 con 0x7fbce4101de0 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbceba33640 1 -- 172.21.15.42:0/201901981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce41a6c20 con 0x7fbce4101de0 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbcda7fc640 1 -- 172.21.15.42:0/201901981 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbce0003ce0 con 0x7fbce4101de0 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbcda7fc640 1 -- 172.21.15.42:0/201901981 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0035070 con 0x7fbce4101de0 2024-09-19T09:37:33.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.959+0000 7fbceba33640 1 -- 172.21.15.42:0/201901981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce41a7150 con 0x7fbce4101de0 2024-09-19T09:37:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.960+0000 7fbceba33640 1 -- 172.21.15.42:0/201901981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce41021c0 con 0x7fbce4101de0 2024-09-19T09:37:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.961+0000 7fbcda7fc640 1 -- 172.21.15.42:0/201901981 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbce0042030 con 0x7fbce4101de0 2024-09-19T09:37:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.962+0000 7fbcda7fc640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcd00a32d0 0x7fbcd00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.962+0000 7fbce8fce640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcd00a32d0 0x7fbcd00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.962+0000 7fbcda7fc640 1 -- 172.21.15.42:0/201901981 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fbce00f0000 con 0x7fbce4101de0 2024-09-19T09:37:33.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.963+0000 7fbce8fce640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcd00a32d0 0x7fbcd00a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005fd0 tx=0x7fbcd4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:33.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:33.967+0000 7fbcda7fc640 1 -- 172.21.15.42:0/201901981 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbce00bcc60 con 0x7fbce4101de0 2024-09-19T09:37:34.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.146+0000 7fbceba33640 1 -- 172.21.15.42:0/201901981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbce410a0f0 con 0x7fbce4101de0 2024-09-19T09:37:34.148 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:34 smithi042 ceph-mon[31223]: pgmap v284: 97 pgs: 97 active+clean; 610 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.9 KiB/s wr, 17 op/s; 3.5 KiB/s, 2 objects/s recovering 2024-09-19T09:37:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.148+0000 7fbcda7fc640 1 -- 172.21.15.42:0/201901981 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22852 (secure 0 0 0) 0x7fbce00bc560 con 0x7fbce4101de0 2024-09-19T09:37:34.150 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:34.150 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:28.010101+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:37:34.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 -- 172.21.15.42:0/201901981 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcd00a32d0 msgr2=0x7fbcd00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:34.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcd00a32d0 0x7fbcd00a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005fd0 tx=0x7fbcd4005850 comp rx=0 tx=0).stop 2024-09-19T09:37:34.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 -- 172.21.15.42:0/201901981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 msgr2=0x7fbce40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:34.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbce0006010 tx=0x7fbce00042f0 comp rx=0 tx=0).stop 2024-09-19T09:37:34.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 -- 172.21.15.42:0/201901981 shutdown_connections 2024-09-19T09:37:34.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcd00a32d0 0x7fbcd00a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:34.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbce4106f10 0x7fbce4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:34.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbce4102790 0x7fbce4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:34.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 --2- 172.21.15.42:0/201901981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:34.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 -- 172.21.15.42:0/201901981 >> 172.21.15.42:0/201901981 conn(0x7fbce40fd8c0 msgr2=0x7fbce40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:34.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 -- 172.21.15.42:0/201901981 shutdown_connections 2024-09-19T09:37:34.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:34.150+0000 7fbceba33640 1 -- 172.21.15.42:0/201901981 wait complete. 2024-09-19T09:37:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:34 smithi171 ceph-mon[35803]: pgmap v284: 97 pgs: 97 active+clean; 610 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.9 KiB/s wr, 17 op/s; 3.5 KiB/s, 2 objects/s recovering 2024-09-19T09:37:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:34 smithi136 ceph-mon[34840]: pgmap v284: 97 pgs: 97 active+clean; 610 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.9 KiB/s wr, 17 op/s; 3.5 KiB/s, 2 objects/s recovering 2024-09-19T09:37:34.794 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:37:34.795 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:37:35.055 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:35.297 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:35 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/201901981' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:35.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:35 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/201901981' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:35.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:35 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/201901981' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:35.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.522+0000 7f8bd5e82640 1 -- 172.21.15.42:0/4201955296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bd0074e30 msgr2=0x7f8bd010df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:35.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.522+0000 7f8bd5e82640 1 --2- 172.21.15.42:0/4201955296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bd0074e30 0x7f8bd010df10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009900 tx=0x7f8bc402a480 comp rx=0 tx=0).stop 2024-09-19T09:37:35.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.522+0000 7f8bd5e82640 1 -- 172.21.15.42:0/4201955296 shutdown_connections 2024-09-19T09:37:35.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.522+0000 7f8bd5e82640 1 --2- 172.21.15.42:0/4201955296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd010e450 0x7f8bd0110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.522+0000 7f8bd5e82640 1 --2- 172.21.15.42:0/4201955296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bd0074e30 0x7f8bd010df10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.522+0000 7f8bd5e82640 1 --2- 172.21.15.42:0/4201955296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bd0074510 0x7f8bd00748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.522+0000 7f8bd5e82640 1 -- 172.21.15.42:0/4201955296 >> 172.21.15.42:0/4201955296 conn(0x7f8bd00fd8f0 msgr2=0x7f8bd00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.522+0000 7f8bd5e82640 1 -- 172.21.15.42:0/4201955296 shutdown_connections 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.522+0000 7f8bd5e82640 1 -- 172.21.15.42:0/4201955296 wait complete. 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bd5e82640 1 Processor -- start 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bd5e82640 1 -- start start 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bd5e82640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bd0074510 0x7f8bd01a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bd5e82640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd0074e30 0x7f8bd01a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bd5e82640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bd010e450 0x7f8bd019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bd5e82640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd0114260 con 0x7f8bd0074510 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bd5e82640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd01140e0 con 0x7f8bd0074e30 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bd5e82640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd01143e0 con 0x7f8bd010e450 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bcf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bd0074510 0x7f8bd01a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:35.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bcf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bd0074510 0x7f8bd01a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59642/0 (socket says 172.21.15.42:59642) 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bcf7fe640 1 -- 172.21.15.42:0/1574656711 learned_addr learned my addr 172.21.15.42:0/1574656711 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bcf7fe640 1 -- 172.21.15.42:0/1574656711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bd010e450 msgr2=0x7f8bd019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bcf7fe640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bd010e450 0x7f8bd019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bcf7fe640 1 -- 172.21.15.42:0/1574656711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd0074e30 msgr2=0x7f8bd01a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bcf7fe640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd0074e30 0x7f8bd01a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.523+0000 7f8bcf7fe640 1 -- 172.21.15.42:0/1574656711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd019aeb0 con 0x7f8bd0074510 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.524+0000 7f8bcf7fe640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bd0074510 0x7f8bd01a0570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000b4a0 tx=0x7f8bc000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.524+0000 7f8bccff9640 1 -- 172.21.15.42:0/1574656711 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0014070 con 0x7f8bd0074510 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.524+0000 7f8bccff9640 1 -- 172.21.15.42:0/1574656711 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bc0010af0 con 0x7f8bd0074510 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.524+0000 7f8bd5e82640 1 -- 172.21.15.42:0/1574656711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd019b1a0 con 0x7f8bd0074510 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.524+0000 7f8bccff9640 1 -- 172.21.15.42:0/1574656711 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0017d10 con 0x7f8bd0074510 2024-09-19T09:37:35.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.524+0000 7f8bd5e82640 1 -- 172.21.15.42:0/1574656711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd01a74f0 con 0x7f8bd0074510 2024-09-19T09:37:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.525+0000 7f8bd5e82640 1 -- 172.21.15.42:0/1574656711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd0075c50 con 0x7f8bd0074510 2024-09-19T09:37:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.526+0000 7f8bccff9640 1 -- 172.21.15.42:0/1574656711 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8bc0017070 con 0x7f8bd0074510 2024-09-19T09:37:35.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.527+0000 7f8bccff9640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bb80a32d0 0x7f8bb80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.527+0000 7f8bceffd640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bb80a32d0 0x7f8bb80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.527+0000 7f8bccff9640 1 -- 172.21.15.42:0/1574656711 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8bc00cee90 con 0x7f8bd0074510 2024-09-19T09:37:35.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.528+0000 7f8bceffd640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bb80a32d0 0x7f8bb80a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8bc402a9a0 tx=0x7f8bc4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:35.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.532+0000 7f8bccff9640 1 -- 172.21.15.42:0/1574656711 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8bc009bae0 con 0x7f8bd0074510 2024-09-19T09:37:35.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.702+0000 7f8bd5e82640 1 -- 172.21.15.42:0/1574656711 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8bd0062630 con 0x7f8bb80a32d0 2024-09-19T09:37:35.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.709+0000 7f8bccff9640 1 -- 172.21.15.42:0/1574656711 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258796 (secure 0 0 0) 0x7f8bd0062630 con 0x7f8bb80a32d0 2024-09-19T09:37:35.716 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:35.718 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-19T09:37:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.712+0000 7f8bd5e82640 1 -- 172.21.15.42:0/1574656711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bb80a32d0 msgr2=0x7f8bb80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.712+0000 7f8bd5e82640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bb80a32d0 0x7f8bb80a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8bc402a9a0 tx=0x7f8bc4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.712+0000 7f8bd5e82640 1 -- 172.21.15.42:0/1574656711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bd0074510 msgr2=0x7f8bd01a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.712+0000 7f8bd5e82640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bd0074510 0x7f8bd01a0570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000b4a0 tx=0x7f8bc000b960 comp rx=0 tx=0).stop 2024-09-19T09:37:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.713+0000 7f8bd5e82640 1 -- 172.21.15.42:0/1574656711 shutdown_connections 2024-09-19T09:37:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.713+0000 7f8bd5e82640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8bb80a32d0 0x7f8bb80a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.713+0000 7f8bd5e82640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bd010e450 0x7f8bd019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.713+0000 7f8bd5e82640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd0074e30 0x7f8bd01a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.713+0000 7f8bd5e82640 1 --2- 172.21.15.42:0/1574656711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bd0074510 0x7f8bd01a0570 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.713+0000 7f8bd5e82640 1 -- 172.21.15.42:0/1574656711 >> 172.21.15.42:0/1574656711 conn(0x7f8bd00fd8f0 msgr2=0x7f8bd00ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.713+0000 7f8bd5e82640 1 -- 172.21.15.42:0/1574656711 shutdown_connections 2024-09-19T09:37:35.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:35.713+0000 7f8bd5e82640 1 -- 172.21.15.42:0/1574656711 wait complete. 2024-09-19T09:37:36.297 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:36 smithi042 ceph-mon[31223]: pgmap v285: 97 pgs: 97 active+clean; 632 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 12 op/s; 3.5 KiB/s, 2 objects/s recovering 2024-09-19T09:37:36.328 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-19T09:37:34.504064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647413,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":253,"num_read_kb":233,"num_write":411,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":1209642,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":339,"ondisk_log_size":339,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382824,"kb_used_data":12724,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559000,"statfs":{"total":1151940427776,"available":1151548416000,"internally_reserved":0,"allocated":13029376,"data_stored":7152711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48618,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":24,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":28906,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001908"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017500+0000","last_change":"2024-09-19T09:37:10.964695+0000","last_active":"2024-09-19T09:37:28.017500+0000","last_peered":"2024-09-19T09:37:28.017500+0000","last_clean":"2024-09-19T09:37:28.017500+0000","last_became_active":"2024-09-19T09:37:10.964343+0000","last_became_peered":"2024-09-19T09:37:10.964343+0000","last_unstale":"2024-09-19T09:37:28.017500+0000","last_undegraded":"2024-09-19T09:37:28.017500+0000","last_fullsized":"2024-09-19T09:37:28.017500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:44.224621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016481+0000","last_change":"2024-09-19T09:37:10.964163+0000","last_active":"2024-09-19T09:37:28.016481+0000","last_peered":"2024-09-19T09:37:28.016481+0000","last_clean":"2024-09-19T09:37:28.016481+0000","last_became_active":"2024-09-19T09:37:10.963758+0000","last_became_peered":"2024-09-19T09:37:10.963758+0000","last_unstale":"2024-09-19T09:37:28.016481+0000","last_undegraded":"2024-09-19T09:37:28.016481+0000","last_fullsized":"2024-09-19T09:37:28.016481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:49.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016475+0000","last_change":"2024-09-19T09:37:10.958145+0000","last_active":"2024-09-19T09:37:28.016475+0000","last_peered":"2024-09-19T09:37:28.016475+0000","last_clean":"2024-09-19T09:37:28.016475+0000","last_became_active":"2024-09-19T09:37:10.957666+0000","last_became_peered":"2024-09-19T09:37:10.957666+0000","last_unstale":"2024-09-19T09:37:28.016475+0000","last_undegraded":"2024-09-19T09:37:28.016475+0000","last_fullsized":"2024-09-19T09:37:28.016475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.479753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.022081+0000","last_change":"2024-09-19T09:37:28.021681+0000","last_active":"2024-09-19T09:37:28.022081+0000","last_peered":"2024-09-19T09:37:28.022081+0000","last_clean":"2024-09-19T09:37:28.022081+0000","last_became_active":"2024-09-19T09:37:28.021294+0000","last_became_peered":"2024-09-19T09:37:28.021294+0000","last_unstale":"2024-09-19T09:37:28.022081+0000","last_undegraded":"2024-09-19T09:37:28.022081+0000","last_fullsized":"2024-09-19T09:37:28.022081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:36.535707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020286+0000","last_change":"2024-09-19T09:37:10.957138+0000","last_active":"2024-09-19T09:37:28.020286+0000","last_peered":"2024-09-19T09:37:28.020286+0000","last_clean":"2024-09-19T09:37:28.020286+0000","last_became_active":"2024-09-19T09:37:10.956824+0000","last_became_peered":"2024-09-19T09:37:10.956824+0000","last_unstale":"2024-09-19T09:37:28.020286+0000","last_undegraded":"2024-09-19T09:37:28.020286+0000","last_fullsized":"2024-09-19T09:37:28.020286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.919747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014634+0000","last_change":"2024-09-19T09:37:10.969804+0000","last_active":"2024-09-19T09:37:28.014634+0000","last_peered":"2024-09-19T09:37:28.014634+0000","last_clean":"2024-09-19T09:37:28.014634+0000","last_became_active":"2024-09-19T09:37:10.969454+0000","last_became_peered":"2024-09-19T09:37:10.969454+0000","last_unstale":"2024-09-19T09:37:28.014634+0000","last_undegraded":"2024-09-19T09:37:28.014634+0000","last_fullsized":"2024-09-19T09:37:28.014634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:14.856255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017497+0000","last_change":"2024-09-19T09:37:10.962853+0000","last_active":"2024-09-19T09:37:28.017497+0000","last_peered":"2024-09-19T09:37:28.017497+0000","last_clean":"2024-09-19T09:37:28.017497+0000","last_became_active":"2024-09-19T09:37:10.961207+0000","last_became_peered":"2024-09-19T09:37:10.961207+0000","last_unstale":"2024-09-19T09:37:28.017497+0000","last_undegraded":"2024-09-19T09:37:28.017497+0000","last_fullsized":"2024-09-19T09:37:28.017497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017053+0000","last_change":"2024-09-19T09:37:10.970216+0000","last_active":"2024-09-19T09:37:28.017053+0000","last_peered":"2024-09-19T09:37:28.017053+0000","last_clean":"2024-09-19T09:37:28.017053+0000","last_became_active":"2024-09-19T09:37:10.969486+0000","last_became_peered":"2024-09-19T09:37:10.969486+0000","last_unstale":"2024-09-19T09:37:28.017053+0000","last_undegraded":"2024-09-19T09:37:28.017053+0000","last_fullsized":"2024-09-19T09:37:28.017053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:56.859228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016269+0000","last_change":"2024-09-19T09:37:10.962596+0000","last_active":"2024-09-19T09:37:28.016269+0000","last_peered":"2024-09-19T09:37:28.016269+0000","last_clean":"2024-09-19T09:37:28.016269+0000","last_became_active":"2024-09-19T09:37:10.962230+0000","last_became_peered":"2024-09-19T09:37:10.962230+0000","last_unstale":"2024-09-19T09:37:28.016269+0000","last_undegraded":"2024-09-19T09:37:28.016269+0000","last_fullsized":"2024-09-19T09:37:28.016269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:07.810793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015170+0000","last_change":"2024-09-19T09:37:10.962186+0000","last_active":"2024-09-19T09:37:28.015170+0000","last_peered":"2024-09-19T09:37:28.015170+0000","last_clean":"2024-09-19T09:37:28.015170+0000","last_became_active":"2024-09-19T09:37:10.961845+0000","last_became_peered":"2024-09-19T09:37:10.961845+0000","last_unstale":"2024-09-19T09:37:28.015170+0000","last_undegraded":"2024-09-19T09:37:28.015170+0000","last_fullsized":"2024-09-19T09:37:28.015170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:24.150103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018025+0000","last_change":"2024-09-19T09:37:10.958763+0000","last_active":"2024-09-19T09:37:28.018025+0000","last_peered":"2024-09-19T09:37:28.018025+0000","last_clean":"2024-09-19T09:37:28.018025+0000","last_became_active":"2024-09-19T09:37:10.958397+0000","last_became_peered":"2024-09-19T09:37:10.958397+0000","last_unstale":"2024-09-19T09:37:28.018025+0000","last_undegraded":"2024-09-19T09:37:28.018025+0000","last_fullsized":"2024-09-19T09:37:28.018025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:37.690594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013858+0000","last_change":"2024-09-19T09:37:10.964787+0000","last_active":"2024-09-19T09:37:28.013858+0000","last_peered":"2024-09-19T09:37:28.013858+0000","last_clean":"2024-09-19T09:37:28.013858+0000","last_became_active":"2024-09-19T09:37:10.964121+0000","last_became_peered":"2024-09-19T09:37:10.964121+0000","last_unstale":"2024-09-19T09:37:28.013858+0000","last_undegraded":"2024-09-19T09:37:28.013858+0000","last_fullsized":"2024-09-19T09:37:28.013858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:02.456961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013043+0000","last_change":"2024-09-19T09:37:10.963290+0000","last_active":"2024-09-19T09:37:28.013043+0000","last_peered":"2024-09-19T09:37:28.013043+0000","last_clean":"2024-09-19T09:37:28.013043+0000","last_became_active":"2024-09-19T09:37:10.962961+0000","last_became_peered":"2024-09-19T09:37:10.962961+0000","last_unstale":"2024-09-19T09:37:28.013043+0000","last_undegraded":"2024-09-19T09:37:28.013043+0000","last_fullsized":"2024-09-19T09:37:28.013043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.266745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016628+0000","last_change":"2024-09-19T09:37:10.969742+0000","last_active":"2024-09-19T09:37:28.016628+0000","last_peered":"2024-09-19T09:37:28.016628+0000","last_clean":"2024-09-19T09:37:28.016628+0000","last_became_active":"2024-09-19T09:37:10.969399+0000","last_became_peered":"2024-09-19T09:37:10.969399+0000","last_unstale":"2024-09-19T09:37:28.016628+0000","last_undegraded":"2024-09-19T09:37:28.016628+0000","last_fullsized":"2024-09-19T09:37:28.016628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.386596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016450+0000","last_change":"2024-09-19T09:37:10.962406+0000","last_active":"2024-09-19T09:37:28.016450+0000","last_peered":"2024-09-19T09:37:28.016450+0000","last_clean":"2024-09-19T09:37:28.016450+0000","last_became_active":"2024-09-19T09:37:10.962130+0000","last_became_peered":"2024-09-19T09:37:10.962130+0000","last_unstale":"2024-09-19T09:37:28.016450+0000","last_undegraded":"2024-09-19T09:37:28.016450+0000","last_fullsized":"2024-09-19T09:37:28.016450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015418+0000","last_change":"2024-09-19T09:37:10.958465+0000","last_active":"2024-09-19T09:37:28.015418+0000","last_peered":"2024-09-19T09:37:28.015418+0000","last_clean":"2024-09-19T09:37:28.015418+0000","last_became_active":"2024-09-19T09:37:10.957600+0000","last_became_peered":"2024-09-19T09:37:10.957600+0000","last_unstale":"2024-09-19T09:37:28.015418+0000","last_undegraded":"2024-09-19T09:37:28.015418+0000","last_fullsized":"2024-09-19T09:37:28.015418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:39.232483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017505+0000","last_change":"2024-09-19T09:37:10.965463+0000","last_active":"2024-09-19T09:37:28.017505+0000","last_peered":"2024-09-19T09:37:28.017505+0000","last_clean":"2024-09-19T09:37:28.017505+0000","last_became_active":"2024-09-19T09:37:10.965137+0000","last_became_peered":"2024-09-19T09:37:10.965137+0000","last_unstale":"2024-09-19T09:37:28.017505+0000","last_undegraded":"2024-09-19T09:37:28.017505+0000","last_fullsized":"2024-09-19T09:37:28.017505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:19.582515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015407+0000","last_change":"2024-09-19T09:37:10.964897+0000","last_active":"2024-09-19T09:37:28.015407+0000","last_peered":"2024-09-19T09:37:28.015407+0000","last_clean":"2024-09-19T09:37:28.015407+0000","last_became_active":"2024-09-19T09:37:10.964527+0000","last_became_peered":"2024-09-19T09:37:10.964527+0000","last_unstale":"2024-09-19T09:37:28.015407+0000","last_undegraded":"2024-09-19T09:37:28.015407+0000","last_fullsized":"2024-09-19T09:37:28.015407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:29.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015328+0000","last_change":"2024-09-19T09:37:10.953645+0000","last_active":"2024-09-19T09:37:28.015328+0000","last_peered":"2024-09-19T09:37:28.015328+0000","last_clean":"2024-09-19T09:37:28.015328+0000","last_became_active":"2024-09-19T09:37:10.953326+0000","last_became_peered":"2024-09-19T09:37:10.953326+0000","last_unstale":"2024-09-19T09:37:28.015328+0000","last_undegraded":"2024-09-19T09:37:28.015328+0000","last_fullsized":"2024-09-19T09:37:28.015328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.644615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016578+0000","last_change":"2024-09-19T09:37:10.961384+0000","last_active":"2024-09-19T09:37:28.016578+0000","last_peered":"2024-09-19T09:37:28.016578+0000","last_clean":"2024-09-19T09:37:28.016578+0000","last_became_active":"2024-09-19T09:37:10.961038+0000","last_became_peered":"2024-09-19T09:37:10.961038+0000","last_unstale":"2024-09-19T09:37:28.016578+0000","last_undegraded":"2024-09-19T09:37:28.016578+0000","last_fullsized":"2024-09-19T09:37:28.016578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:54.876799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013067+0000","last_change":"2024-09-19T09:37:10.955789+0000","last_active":"2024-09-19T09:37:28.013067+0000","last_peered":"2024-09-19T09:37:28.013067+0000","last_clean":"2024-09-19T09:37:28.013067+0000","last_became_active":"2024-09-19T09:37:10.955447+0000","last_became_peered":"2024-09-19T09:37:10.955447+0000","last_unstale":"2024-09-19T09:37:28.013067+0000","last_undegraded":"2024-09-19T09:37:28.013067+0000","last_fullsized":"2024-09-19T09:37:28.013067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:28.512069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015730+0000","last_change":"2024-09-19T09:37:10.956501+0000","last_active":"2024-09-19T09:37:28.015730+0000","last_peered":"2024-09-19T09:37:28.015730+0000","last_clean":"2024-09-19T09:37:28.015730+0000","last_became_active":"2024-09-19T09:37:10.956161+0000","last_became_peered":"2024-09-19T09:37:10.956161+0000","last_unstale":"2024-09-19T09:37:28.015730+0000","last_undegraded":"2024-09-19T09:37:28.015730+0000","last_fullsized":"2024-09-19T09:37:28.015730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:31.738143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017612+0000","last_change":"2024-09-19T09:37:10.961486+0000","last_active":"2024-09-19T09:37:28.017612+0000","last_peered":"2024-09-19T09:37:28.017612+0000","last_clean":"2024-09-19T09:37:28.017612+0000","last_became_active":"2024-09-19T09:37:10.960877+0000","last_became_peered":"2024-09-19T09:37:10.960877+0000","last_unstale":"2024-09-19T09:37:28.017612+0000","last_undegraded":"2024-09-19T09:37:28.017612+0000","last_fullsized":"2024-09-19T09:37:28.017612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:34.889431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020088+0000","last_change":"2024-09-19T09:37:10.964400+0000","last_active":"2024-09-19T09:37:28.020088+0000","last_peered":"2024-09-19T09:37:28.020088+0000","last_clean":"2024-09-19T09:37:28.020088+0000","last_became_active":"2024-09-19T09:37:10.963394+0000","last_became_peered":"2024-09-19T09:37:10.963394+0000","last_unstale":"2024-09-19T09:37:28.020088+0000","last_undegraded":"2024-09-19T09:37:28.020088+0000","last_fullsized":"2024-09-19T09:37:28.020088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:22.185221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017710+0000","last_change":"2024-09-19T09:37:10.959661+0000","last_active":"2024-09-19T09:37:28.017710+0000","last_peered":"2024-09-19T09:37:28.017710+0000","last_clean":"2024-09-19T09:37:28.017710+0000","last_became_active":"2024-09-19T09:37:10.959371+0000","last_became_peered":"2024-09-19T09:37:10.959371+0000","last_unstale":"2024-09-19T09:37:28.017710+0000","last_undegraded":"2024-09-19T09:37:28.017710+0000","last_fullsized":"2024-09-19T09:37:28.017710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.752712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015704+0000","last_change":"2024-09-19T09:37:10.967310+0000","last_active":"2024-09-19T09:37:28.015704+0000","last_peered":"2024-09-19T09:37:28.015704+0000","last_clean":"2024-09-19T09:37:28.015704+0000","last_became_active":"2024-09-19T09:37:10.965415+0000","last_became_peered":"2024-09-19T09:37:10.965415+0000","last_unstale":"2024-09-19T09:37:28.015704+0000","last_undegraded":"2024-09-19T09:37:28.015704+0000","last_fullsized":"2024-09-19T09:37:28.015704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:16.968646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016734+0000","last_change":"2024-09-19T09:37:10.967301+0000","last_active":"2024-09-19T09:37:28.016734+0000","last_peered":"2024-09-19T09:37:28.016734+0000","last_clean":"2024-09-19T09:37:28.016734+0000","last_became_active":"2024-09-19T09:37:10.966397+0000","last_became_peered":"2024-09-19T09:37:10.966397+0000","last_unstale":"2024-09-19T09:37:28.016734+0000","last_undegraded":"2024-09-19T09:37:28.016734+0000","last_fullsized":"2024-09-19T09:37:28.016734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.621085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013100+0000","last_change":"2024-09-19T09:37:10.958069+0000","last_active":"2024-09-19T09:37:28.013100+0000","last_peered":"2024-09-19T09:37:28.013100+0000","last_clean":"2024-09-19T09:37:28.013100+0000","last_became_active":"2024-09-19T09:37:10.957670+0000","last_became_peered":"2024-09-19T09:37:10.957670+0000","last_unstale":"2024-09-19T09:37:28.013100+0000","last_undegraded":"2024-09-19T09:37:28.013100+0000","last_fullsized":"2024-09-19T09:37:28.013100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.412978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016752+0000","last_change":"2024-09-19T09:37:10.960490+0000","last_active":"2024-09-19T09:37:28.016752+0000","last_peered":"2024-09-19T09:37:28.016752+0000","last_clean":"2024-09-19T09:37:28.016752+0000","last_became_active":"2024-09-19T09:37:10.960239+0000","last_became_peered":"2024-09-19T09:37:10.960239+0000","last_unstale":"2024-09-19T09:37:28.016752+0000","last_undegraded":"2024-09-19T09:37:28.016752+0000","last_fullsized":"2024-09-19T09:37:28.016752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.384348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014794+0000","last_change":"2024-09-19T09:37:10.955930+0000","last_active":"2024-09-19T09:37:28.014794+0000","last_peered":"2024-09-19T09:37:28.014794+0000","last_clean":"2024-09-19T09:37:28.014794+0000","last_became_active":"2024-09-19T09:37:10.955605+0000","last_became_peered":"2024-09-19T09:37:10.955605+0000","last_unstale":"2024-09-19T09:37:28.014794+0000","last_undegraded":"2024-09-19T09:37:28.014794+0000","last_fullsized":"2024-09-19T09:37:28.014794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:36.033350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014891+0000","last_change":"2024-09-19T09:37:10.960467+0000","last_active":"2024-09-19T09:37:28.014891+0000","last_peered":"2024-09-19T09:37:28.014891+0000","last_clean":"2024-09-19T09:37:28.014891+0000","last_became_active":"2024-09-19T09:37:10.960082+0000","last_became_peered":"2024-09-19T09:37:10.960082+0000","last_unstale":"2024-09-19T09:37:28.014891+0000","last_undegraded":"2024-09-19T09:37:28.014891+0000","last_fullsized":"2024-09-19T09:37:28.014891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:07.451648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017381+0000","last_change":"2024-09-19T09:37:10.965674+0000","last_active":"2024-09-19T09:37:28.017381+0000","last_peered":"2024-09-19T09:37:28.017381+0000","last_clean":"2024-09-19T09:37:28.017381+0000","last_became_active":"2024-09-19T09:37:10.965368+0000","last_became_peered":"2024-09-19T09:37:10.965368+0000","last_unstale":"2024-09-19T09:37:28.017381+0000","last_undegraded":"2024-09-19T09:37:28.017381+0000","last_fullsized":"2024-09-19T09:37:28.017381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:23.712785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020306+0000","last_change":"2024-09-19T09:37:10.966972+0000","last_active":"2024-09-19T09:37:28.020306+0000","last_peered":"2024-09-19T09:37:28.020306+0000","last_clean":"2024-09-19T09:37:28.020306+0000","last_became_active":"2024-09-19T09:37:10.966642+0000","last_became_peered":"2024-09-19T09:37:10.966642+0000","last_unstale":"2024-09-19T09:37:28.020306+0000","last_undegraded":"2024-09-19T09:37:28.020306+0000","last_fullsized":"2024-09-19T09:37:28.020306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.416611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:32.032283+0000","last_change":"2024-09-19T09:37:08.953116+0000","last_active":"2024-09-19T09:37:32.032283+0000","last_peered":"2024-09-19T09:37:32.032283+0000","last_clean":"2024-09-19T09:37:32.032283+0000","last_became_active":"2024-09-19T09:37:08.952748+0000","last_became_peered":"2024-09-19T09:37:08.952748+0000","last_unstale":"2024-09-19T09:37:32.032283+0000","last_undegraded":"2024-09-19T09:37:32.032283+0000","last_fullsized":"2024-09-19T09:37:32.032283+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:22.395359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021330+0000","last_change":"2024-09-19T09:37:10.969106+0000","last_active":"2024-09-19T09:37:28.021330+0000","last_peered":"2024-09-19T09:37:28.021330+0000","last_clean":"2024-09-19T09:37:28.021330+0000","last_became_active":"2024-09-19T09:37:10.968801+0000","last_became_peered":"2024-09-19T09:37:10.968801+0000","last_unstale":"2024-09-19T09:37:28.021330+0000","last_undegraded":"2024-09-19T09:37:28.021330+0000","last_fullsized":"2024-09-19T09:37:28.021330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.674925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014739+0000","last_change":"2024-09-19T09:37:08.949604+0000","last_active":"2024-09-19T09:37:28.014739+0000","last_peered":"2024-09-19T09:37:28.014739+0000","last_clean":"2024-09-19T09:37:28.014739+0000","last_became_active":"2024-09-19T09:37:08.949143+0000","last_became_peered":"2024-09-19T09:37:08.949143+0000","last_unstale":"2024-09-19T09:37:28.014739+0000","last_undegraded":"2024-09-19T09:37:28.014739+0000","last_fullsized":"2024-09-19T09:37:28.014739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:37.933319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012827+0000","last_change":"2024-09-19T09:37:08.946277+0000","last_active":"2024-09-19T09:37:28.012827+0000","last_peered":"2024-09-19T09:37:28.012827+0000","last_clean":"2024-09-19T09:37:28.012827+0000","last_became_active":"2024-09-19T09:37:08.945808+0000","last_became_peered":"2024-09-19T09:37:08.945808+0000","last_unstale":"2024-09-19T09:37:28.012827+0000","last_undegraded":"2024-09-19T09:37:28.012827+0000","last_fullsized":"2024-09-19T09:37:28.012827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.060811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017159+0000","last_change":"2024-09-19T09:37:10.957765+0000","last_active":"2024-09-19T09:37:28.017159+0000","last_peered":"2024-09-19T09:37:28.017159+0000","last_clean":"2024-09-19T09:37:28.017159+0000","last_became_active":"2024-09-19T09:37:10.957458+0000","last_became_peered":"2024-09-19T09:37:10.957458+0000","last_unstale":"2024-09-19T09:37:28.017159+0000","last_undegraded":"2024-09-19T09:37:28.017159+0000","last_fullsized":"2024-09-19T09:37:28.017159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:49.418473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020344+0000","last_change":"2024-09-19T09:37:08.953124+0000","last_active":"2024-09-19T09:37:28.020344+0000","last_peered":"2024-09-19T09:37:28.020344+0000","last_clean":"2024-09-19T09:37:28.020344+0000","last_became_active":"2024-09-19T09:37:08.952159+0000","last_became_peered":"2024-09-19T09:37:08.952159+0000","last_unstale":"2024-09-19T09:37:28.020344+0000","last_undegraded":"2024-09-19T09:37:28.020344+0000","last_fullsized":"2024-09-19T09:37:28.020344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:24.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014710+0000","last_change":"2024-09-19T09:37:10.964038+0000","last_active":"2024-09-19T09:37:28.014710+0000","last_peered":"2024-09-19T09:37:28.014710+0000","last_clean":"2024-09-19T09:37:28.014710+0000","last_became_active":"2024-09-19T09:37:10.963671+0000","last_became_peered":"2024-09-19T09:37:10.963671+0000","last_unstale":"2024-09-19T09:37:28.014710+0000","last_undegraded":"2024-09-19T09:37:28.014710+0000","last_fullsized":"2024-09-19T09:37:28.014710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:19.743329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:33.029608+0000","last_change":"2024-09-19T09:37:08.949600+0000","last_active":"2024-09-19T09:37:33.029608+0000","last_peered":"2024-09-19T09:37:33.029608+0000","last_clean":"2024-09-19T09:37:33.029608+0000","last_became_active":"2024-09-19T09:37:08.949141+0000","last_became_peered":"2024-09-19T09:37:08.949141+0000","last_unstale":"2024-09-19T09:37:33.029608+0000","last_undegraded":"2024-09-19T09:37:33.029608+0000","last_fullsized":"2024-09-19T09:37:33.029608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:42.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016060+0000","last_change":"2024-09-19T09:37:10.967506+0000","last_active":"2024-09-19T09:37:28.016060+0000","last_peered":"2024-09-19T09:37:28.016060+0000","last_clean":"2024-09-19T09:37:28.016060+0000","last_became_active":"2024-09-19T09:37:10.967193+0000","last_became_peered":"2024-09-19T09:37:10.967193+0000","last_unstale":"2024-09-19T09:37:28.016060+0000","last_undegraded":"2024-09-19T09:37:28.016060+0000","last_fullsized":"2024-09-19T09:37:28.016060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:33.158325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017606+0000","last_change":"2024-09-19T09:37:08.955305+0000","last_active":"2024-09-19T09:37:28.017606+0000","last_peered":"2024-09-19T09:37:28.017606+0000","last_clean":"2024-09-19T09:37:28.017606+0000","last_became_active":"2024-09-19T09:37:08.954932+0000","last_became_peered":"2024-09-19T09:37:08.954932+0000","last_unstale":"2024-09-19T09:37:28.017606+0000","last_undegraded":"2024-09-19T09:37:28.017606+0000","last_fullsized":"2024-09-19T09:37:28.017606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.157466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021974+0000","last_change":"2024-09-19T09:37:28.021974+0000","last_active":"2024-09-19T09:37:28.021974+0000","last_peered":"2024-09-19T09:37:28.021974+0000","last_clean":"2024-09-19T09:37:28.021974+0000","last_became_active":"2024-09-19T09:37:28.021579+0000","last_became_peered":"2024-09-19T09:37:28.021579+0000","last_unstale":"2024-09-19T09:37:28.021974+0000","last_undegraded":"2024-09-19T09:37:28.021974+0000","last_fullsized":"2024-09-19T09:37:28.021974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:28.562862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021814+0000","last_change":"2024-09-19T09:37:08.976540+0000","last_active":"2024-09-19T09:37:28.021814+0000","last_peered":"2024-09-19T09:37:28.021814+0000","last_clean":"2024-09-19T09:37:28.021814+0000","last_became_active":"2024-09-19T09:37:08.976196+0000","last_became_peered":"2024-09-19T09:37:08.976196+0000","last_unstale":"2024-09-19T09:37:28.021814+0000","last_undegraded":"2024-09-19T09:37:28.021814+0000","last_fullsized":"2024-09-19T09:37:28.021814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:38.735947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021407+0000","last_change":"2024-09-19T09:37:28.021407+0000","last_active":"2024-09-19T09:37:28.021407+0000","last_peered":"2024-09-19T09:37:28.021407+0000","last_clean":"2024-09-19T09:37:28.021407+0000","last_became_active":"2024-09-19T09:37:28.021020+0000","last_became_peered":"2024-09-19T09:37:28.021020+0000","last_unstale":"2024-09-19T09:37:28.021407+0000","last_undegraded":"2024-09-19T09:37:28.021407+0000","last_fullsized":"2024-09-19T09:37:28.021407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:25.394012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:33.031661+0000","last_change":"2024-09-19T09:37:28.029037+0000","last_active":"2024-09-19T09:37:33.031661+0000","last_peered":"2024-09-19T09:37:33.031661+0000","last_clean":"2024-09-19T09:37:33.031661+0000","last_became_active":"2024-09-19T09:37:28.018325+0000","last_became_peered":"2024-09-19T09:37:28.018325+0000","last_unstale":"2024-09-19T09:37:33.031661+0000","last_undegraded":"2024-09-19T09:37:33.031661+0000","last_fullsized":"2024-09-19T09:37:33.031661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:56.121569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":61,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020724+0000","last_change":"2024-09-19T09:37:10.963688+0000","last_active":"2024-09-19T09:37:28.020724+0000","last_peered":"2024-09-19T09:37:28.020724+0000","last_clean":"2024-09-19T09:37:28.020724+0000","last_became_active":"2024-09-19T09:37:10.963296+0000","last_became_peered":"2024-09-19T09:37:10.963296+0000","last_unstale":"2024-09-19T09:37:28.020724+0000","last_undegraded":"2024-09-19T09:37:28.020724+0000","last_fullsized":"2024-09-19T09:37:28.020724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:49.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015183+0000","last_change":"2024-09-19T09:37:08.952198+0000","last_active":"2024-09-19T09:37:28.015183+0000","last_peered":"2024-09-19T09:37:28.015183+0000","last_clean":"2024-09-19T09:37:28.015183+0000","last_became_active":"2024-09-19T09:37:08.951699+0000","last_became_peered":"2024-09-19T09:37:08.951699+0000","last_unstale":"2024-09-19T09:37:28.015183+0000","last_undegraded":"2024-09-19T09:37:28.015183+0000","last_fullsized":"2024-09-19T09:37:28.015183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:46.729847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012881+0000","last_change":"2024-09-19T09:37:10.955741+0000","last_active":"2024-09-19T09:37:28.012881+0000","last_peered":"2024-09-19T09:37:28.012881+0000","last_clean":"2024-09-19T09:37:28.012881+0000","last_became_active":"2024-09-19T09:37:10.955394+0000","last_became_peered":"2024-09-19T09:37:10.955394+0000","last_unstale":"2024-09-19T09:37:28.012881+0000","last_undegraded":"2024-09-19T09:37:28.012881+0000","last_fullsized":"2024-09-19T09:37:28.012881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:56.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021172+0000","last_change":"2024-09-19T09:37:08.949979+0000","last_active":"2024-09-19T09:37:28.021172+0000","last_peered":"2024-09-19T09:37:28.021172+0000","last_clean":"2024-09-19T09:37:28.021172+0000","last_became_active":"2024-09-19T09:37:08.949664+0000","last_became_peered":"2024-09-19T09:37:08.949664+0000","last_unstale":"2024-09-19T09:37:28.021172+0000","last_undegraded":"2024-09-19T09:37:28.021172+0000","last_fullsized":"2024-09-19T09:37:28.021172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:06.449337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017773+0000","last_change":"2024-09-19T09:37:10.957479+0000","last_active":"2024-09-19T09:37:28.017773+0000","last_peered":"2024-09-19T09:37:28.017773+0000","last_clean":"2024-09-19T09:37:28.017773+0000","last_became_active":"2024-09-19T09:37:10.957130+0000","last_became_peered":"2024-09-19T09:37:10.957130+0000","last_unstale":"2024-09-19T09:37:28.017773+0000","last_undegraded":"2024-09-19T09:37:28.017773+0000","last_fullsized":"2024-09-19T09:37:28.017773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:52.840857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'6","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:33.030818+0000","last_change":"2024-09-19T09:37:08.951558+0000","last_active":"2024-09-19T09:37:33.030818+0000","last_peered":"2024-09-19T09:37:33.030818+0000","last_clean":"2024-09-19T09:37:33.030818+0000","last_became_active":"2024-09-19T09:37:08.951092+0000","last_became_peered":"2024-09-19T09:37:08.951092+0000","last_unstale":"2024-09-19T09:37:33.030818+0000","last_undegraded":"2024-09-19T09:37:33.030818+0000","last_fullsized":"2024-09-19T09:37:33.030818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:30.326253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018198+0000","last_change":"2024-09-19T09:37:10.962692+0000","last_active":"2024-09-19T09:37:28.018198+0000","last_peered":"2024-09-19T09:37:28.018198+0000","last_clean":"2024-09-19T09:37:28.018198+0000","last_became_active":"2024-09-19T09:37:10.962145+0000","last_became_peered":"2024-09-19T09:37:10.962145+0000","last_unstale":"2024-09-19T09:37:28.018198+0000","last_undegraded":"2024-09-19T09:37:28.018198+0000","last_fullsized":"2024-09-19T09:37:28.018198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:48.232759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020176+0000","last_change":"2024-09-19T09:37:08.976531+0000","last_active":"2024-09-19T09:37:28.020176+0000","last_peered":"2024-09-19T09:37:28.020176+0000","last_clean":"2024-09-19T09:37:28.020176+0000","last_became_active":"2024-09-19T09:37:08.975892+0000","last_became_peered":"2024-09-19T09:37:08.975892+0000","last_unstale":"2024-09-19T09:37:28.020176+0000","last_undegraded":"2024-09-19T09:37:28.020176+0000","last_fullsized":"2024-09-19T09:37:28.020176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.545504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019761+0000","last_change":"2024-09-19T09:37:10.968116+0000","last_active":"2024-09-19T09:37:28.019761+0000","last_peered":"2024-09-19T09:37:28.019761+0000","last_clean":"2024-09-19T09:37:28.019761+0000","last_became_active":"2024-09-19T09:37:10.967767+0000","last_became_peered":"2024-09-19T09:37:10.967767+0000","last_unstale":"2024-09-19T09:37:28.019761+0000","last_undegraded":"2024-09-19T09:37:28.019761+0000","last_fullsized":"2024-09-19T09:37:28.019761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:34.104712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020842+0000","last_change":"2024-09-19T09:37:08.949384+0000","last_active":"2024-09-19T09:37:28.020842+0000","last_peered":"2024-09-19T09:37:28.020842+0000","last_clean":"2024-09-19T09:37:28.020842+0000","last_became_active":"2024-09-19T09:37:08.948950+0000","last_became_peered":"2024-09-19T09:37:08.948950+0000","last_unstale":"2024-09-19T09:37:28.020842+0000","last_undegraded":"2024-09-19T09:37:28.020842+0000","last_fullsized":"2024-09-19T09:37:28.020842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:15.527608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016950+0000","last_change":"2024-09-19T09:37:10.965720+0000","last_active":"2024-09-19T09:37:28.016950+0000","last_peered":"2024-09-19T09:37:28.016950+0000","last_clean":"2024-09-19T09:37:28.016950+0000","last_became_active":"2024-09-19T09:37:10.965341+0000","last_became_peered":"2024-09-19T09:37:10.965341+0000","last_unstale":"2024-09-19T09:37:28.016950+0000","last_undegraded":"2024-09-19T09:37:28.016950+0000","last_fullsized":"2024-09-19T09:37:28.016950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:36.591438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013189+0000","last_change":"2024-09-19T09:37:08.953702+0000","last_active":"2024-09-19T09:37:28.013189+0000","last_peered":"2024-09-19T09:37:28.013189+0000","last_clean":"2024-09-19T09:37:28.013189+0000","last_became_active":"2024-09-19T09:37:08.953312+0000","last_became_peered":"2024-09-19T09:37:08.953312+0000","last_unstale":"2024-09-19T09:37:28.013189+0000","last_undegraded":"2024-09-19T09:37:28.013189+0000","last_fullsized":"2024-09-19T09:37:28.013189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:54.059096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017769+0000","last_change":"2024-09-19T09:37:10.959814+0000","last_active":"2024-09-19T09:37:28.017769+0000","last_peered":"2024-09-19T09:37:28.017769+0000","last_clean":"2024-09-19T09:37:28.017769+0000","last_became_active":"2024-09-19T09:37:10.959342+0000","last_became_peered":"2024-09-19T09:37:10.959342+0000","last_unstale":"2024-09-19T09:37:28.017769+0000","last_undegraded":"2024-09-19T09:37:28.017769+0000","last_fullsized":"2024-09-19T09:37:28.017769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021892+0000","last_change":"2024-09-19T09:37:08.947978+0000","last_active":"2024-09-19T09:37:28.021892+0000","last_peered":"2024-09-19T09:37:28.021892+0000","last_clean":"2024-09-19T09:37:28.021892+0000","last_became_active":"2024-09-19T09:37:08.947548+0000","last_became_peered":"2024-09-19T09:37:08.947548+0000","last_unstale":"2024-09-19T09:37:28.021892+0000","last_undegraded":"2024-09-19T09:37:28.021892+0000","last_fullsized":"2024-09-19T09:37:28.021892+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:38.283616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018434+0000","last_change":"2024-09-19T09:37:10.964008+0000","last_active":"2024-09-19T09:37:28.018434+0000","last_peered":"2024-09-19T09:37:28.018434+0000","last_clean":"2024-09-19T09:37:28.018434+0000","last_became_active":"2024-09-19T09:37:10.963554+0000","last_became_peered":"2024-09-19T09:37:10.963554+0000","last_unstale":"2024-09-19T09:37:28.018434+0000","last_undegraded":"2024-09-19T09:37:28.018434+0000","last_fullsized":"2024-09-19T09:37:28.018434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:57.320967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:33.030023+0000","last_change":"2024-09-19T09:37:28.027589+0000","last_active":"2024-09-19T09:37:33.030023+0000","last_peered":"2024-09-19T09:37:33.030023+0000","last_clean":"2024-09-19T09:37:33.030023+0000","last_became_active":"2024-09-19T09:37:28.020013+0000","last_became_peered":"2024-09-19T09:37:28.020013+0000","last_unstale":"2024-09-19T09:37:33.030023+0000","last_undegraded":"2024-09-19T09:37:33.030023+0000","last_fullsized":"2024-09-19T09:37:33.030023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:51.327069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018295+0000","last_change":"2024-09-19T09:37:10.960337+0000","last_active":"2024-09-19T09:37:28.018295+0000","last_peered":"2024-09-19T09:37:28.018295+0000","last_clean":"2024-09-19T09:37:28.018295+0000","last_became_active":"2024-09-19T09:37:10.960006+0000","last_became_peered":"2024-09-19T09:37:10.960006+0000","last_unstale":"2024-09-19T09:37:28.018295+0000","last_undegraded":"2024-09-19T09:37:28.018295+0000","last_fullsized":"2024-09-19T09:37:28.018295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:16.942098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":336,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019254+0000","last_change":"2024-09-19T09:36:01.923601+0000","last_active":"2024-09-19T09:37:28.019254+0000","last_peered":"2024-09-19T09:37:28.019254+0000","last_clean":"2024-09-19T09:37:28.019254+0000","last_became_active":"2024-09-19T09:36:01.923051+0000","last_became_peered":"2024-09-19T09:36:01.923051+0000","last_unstale":"2024-09-19T09:37:28.019254+0000","last_undegraded":"2024-09-19T09:37:28.019254+0000","last_fullsized":"2024-09-19T09:37:28.019254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_clean_scrub_stamp":"2024-09-19T09:32:45.321588+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:41.635565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013536+0000","last_change":"2024-09-19T09:37:08.948818+0000","last_active":"2024-09-19T09:37:28.013536+0000","last_peered":"2024-09-19T09:37:28.013536+0000","last_clean":"2024-09-19T09:37:28.013536+0000","last_became_active":"2024-09-19T09:37:08.948494+0000","last_became_peered":"2024-09-19T09:37:08.948494+0000","last_unstale":"2024-09-19T09:37:28.013536+0000","last_undegraded":"2024-09-19T09:37:28.013536+0000","last_fullsized":"2024-09-19T09:37:28.013536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:35.255778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017276+0000","last_change":"2024-09-19T09:37:10.966315+0000","last_active":"2024-09-19T09:37:28.017276+0000","last_peered":"2024-09-19T09:37:28.017276+0000","last_clean":"2024-09-19T09:37:28.017276+0000","last_became_active":"2024-09-19T09:37:10.965979+0000","last_became_peered":"2024-09-19T09:37:10.965979+0000","last_unstale":"2024-09-19T09:37:28.017276+0000","last_undegraded":"2024-09-19T09:37:28.017276+0000","last_fullsized":"2024-09-19T09:37:28.017276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:36.229434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.030136+0000","last_change":"2024-09-19T09:37:28.029598+0000","last_active":"2024-09-19T09:37:28.030136+0000","last_peered":"2024-09-19T09:37:28.030136+0000","last_clean":"2024-09-19T09:37:28.030136+0000","last_became_active":"2024-09-19T09:37:28.021459+0000","last_became_peered":"2024-09-19T09:37:28.021459+0000","last_unstale":"2024-09-19T09:37:28.030136+0000","last_undegraded":"2024-09-19T09:37:28.030136+0000","last_fullsized":"2024-09-19T09:37:28.030136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:00.755946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012816+0000","last_change":"2024-09-19T09:37:10.962825+0000","last_active":"2024-09-19T09:37:28.012816+0000","last_peered":"2024-09-19T09:37:28.012816+0000","last_clean":"2024-09-19T09:37:28.012816+0000","last_became_active":"2024-09-19T09:37:10.962475+0000","last_became_peered":"2024-09-19T09:37:10.962475+0000","last_unstale":"2024-09-19T09:37:28.012816+0000","last_undegraded":"2024-09-19T09:37:28.012816+0000","last_fullsized":"2024-09-19T09:37:28.012816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:30.650918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'5","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:31.028509+0000","last_change":"2024-09-19T09:37:08.976364+0000","last_active":"2024-09-19T09:37:31.028509+0000","last_peered":"2024-09-19T09:37:31.028509+0000","last_clean":"2024-09-19T09:37:31.028509+0000","last_became_active":"2024-09-19T09:37:08.975983+0000","last_became_peered":"2024-09-19T09:37:08.975983+0000","last_unstale":"2024-09-19T09:37:31.028509+0000","last_undegraded":"2024-09-19T09:37:31.028509+0000","last_fullsized":"2024-09-19T09:37:31.028509+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.762847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020702+0000","last_change":"2024-09-19T09:37:28.020341+0000","last_active":"2024-09-19T09:37:28.020702+0000","last_peered":"2024-09-19T09:37:28.020702+0000","last_clean":"2024-09-19T09:37:28.020702+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:37:28.020702+0000","last_undegraded":"2024-09-19T09:37:28.020702+0000","last_fullsized":"2024-09-19T09:37:28.020702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:24.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"79'6","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:30.023416+0000","last_change":"2024-09-19T09:37:08.950403+0000","last_active":"2024-09-19T09:37:30.023416+0000","last_peered":"2024-09-19T09:37:30.023416+0000","last_clean":"2024-09-19T09:37:30.023416+0000","last_became_active":"2024-09-19T09:37:08.950077+0000","last_became_peered":"2024-09-19T09:37:08.950077+0000","last_unstale":"2024-09-19T09:37:30.023416+0000","last_undegraded":"2024-09-19T09:37:30.023416+0000","last_fullsized":"2024-09-19T09:37:30.023416+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:46.446439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014647+0000","last_change":"2024-09-19T09:37:10.969493+0000","last_active":"2024-09-19T09:37:28.014647+0000","last_peered":"2024-09-19T09:37:28.014647+0000","last_clean":"2024-09-19T09:37:28.014647+0000","last_became_active":"2024-09-19T09:37:10.969038+0000","last_became_peered":"2024-09-19T09:37:10.969038+0000","last_unstale":"2024-09-19T09:37:28.014647+0000","last_undegraded":"2024-09-19T09:37:28.014647+0000","last_fullsized":"2024-09-19T09:37:28.014647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:55.518806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015137+0000","last_change":"2024-09-19T09:37:08.977207+0000","last_active":"2024-09-19T09:37:28.015137+0000","last_peered":"2024-09-19T09:37:28.015137+0000","last_clean":"2024-09-19T09:37:28.015137+0000","last_became_active":"2024-09-19T09:37:08.976859+0000","last_became_peered":"2024-09-19T09:37:08.976859+0000","last_unstale":"2024-09-19T09:37:28.015137+0000","last_undegraded":"2024-09-19T09:37:28.015137+0000","last_fullsized":"2024-09-19T09:37:28.015137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:25.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.023437+0000","last_change":"2024-09-19T09:37:28.023437+0000","last_active":"2024-09-19T09:37:28.023437+0000","last_peered":"2024-09-19T09:37:28.023437+0000","last_clean":"2024-09-19T09:37:28.023437+0000","last_became_active":"2024-09-19T09:37:28.018678+0000","last_became_peered":"2024-09-19T09:37:28.018678+0000","last_unstale":"2024-09-19T09:37:28.023437+0000","last_undegraded":"2024-09-19T09:37:28.023437+0000","last_fullsized":"2024-09-19T09:37:28.023437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:44.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020845+0000","last_change":"2024-09-19T09:37:08.976594+0000","last_active":"2024-09-19T09:37:28.020845+0000","last_peered":"2024-09-19T09:37:28.020845+0000","last_clean":"2024-09-19T09:37:28.020845+0000","last_became_active":"2024-09-19T09:37:08.976222+0000","last_became_peered":"2024-09-19T09:37:08.976222+0000","last_unstale":"2024-09-19T09:37:28.020845+0000","last_undegraded":"2024-09-19T09:37:28.020845+0000","last_fullsized":"2024-09-19T09:37:28.020845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:53.492591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013129+0000","last_change":"2024-09-19T09:37:10.957096+0000","last_active":"2024-09-19T09:37:28.013129+0000","last_peered":"2024-09-19T09:37:28.013129+0000","last_clean":"2024-09-19T09:37:28.013129+0000","last_became_active":"2024-09-19T09:37:10.956740+0000","last_became_peered":"2024-09-19T09:37:10.956740+0000","last_unstale":"2024-09-19T09:37:28.013129+0000","last_undegraded":"2024-09-19T09:37:28.013129+0000","last_fullsized":"2024-09-19T09:37:28.013129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:40.358624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015502+0000","last_change":"2024-09-19T09:37:08.948528+0000","last_active":"2024-09-19T09:37:28.015502+0000","last_peered":"2024-09-19T09:37:28.015502+0000","last_clean":"2024-09-19T09:37:28.015502+0000","last_became_active":"2024-09-19T09:37:08.948183+0000","last_became_peered":"2024-09-19T09:37:08.948183+0000","last_unstale":"2024-09-19T09:37:28.015502+0000","last_undegraded":"2024-09-19T09:37:28.015502+0000","last_fullsized":"2024-09-19T09:37:28.015502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:23.214471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017729+0000","last_change":"2024-09-19T09:37:10.959492+0000","last_active":"2024-09-19T09:37:28.017729+0000","last_peered":"2024-09-19T09:37:28.017729+0000","last_clean":"2024-09-19T09:37:28.017729+0000","last_became_active":"2024-09-19T09:37:10.959032+0000","last_became_peered":"2024-09-19T09:37:10.959032+0000","last_unstale":"2024-09-19T09:37:28.017729+0000","last_undegraded":"2024-09-19T09:37:28.017729+0000","last_fullsized":"2024-09-19T09:37:28.017729+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.080976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013794+0000","last_change":"2024-09-19T09:37:09.270315+0000","last_active":"2024-09-19T09:37:28.013794+0000","last_peered":"2024-09-19T09:37:28.013794+0000","last_clean":"2024-09-19T09:37:28.013794+0000","last_became_active":"2024-09-19T09:37:09.269891+0000","last_became_peered":"2024-09-19T09:37:09.269891+0000","last_unstale":"2024-09-19T09:37:28.013794+0000","last_undegraded":"2024-09-19T09:37:28.013794+0000","last_fullsized":"2024-09-19T09:37:28.013794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:12.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016720+0000","last_change":"2024-09-19T09:37:10.961363+0000","last_active":"2024-09-19T09:37:28.016720+0000","last_peered":"2024-09-19T09:37:28.016720+0000","last_clean":"2024-09-19T09:37:28.016720+0000","last_became_active":"2024-09-19T09:37:10.960951+0000","last_became_peered":"2024-09-19T09:37:10.960951+0000","last_unstale":"2024-09-19T09:37:28.016720+0000","last_undegraded":"2024-09-19T09:37:28.016720+0000","last_fullsized":"2024-09-19T09:37:28.016720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:31.226355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015555+0000","last_change":"2024-09-19T09:37:08.976805+0000","last_active":"2024-09-19T09:37:28.015555+0000","last_peered":"2024-09-19T09:37:28.015555+0000","last_clean":"2024-09-19T09:37:28.015555+0000","last_became_active":"2024-09-19T09:37:08.976502+0000","last_became_peered":"2024-09-19T09:37:08.976502+0000","last_unstale":"2024-09-19T09:37:28.015555+0000","last_undegraded":"2024-09-19T09:37:28.015555+0000","last_fullsized":"2024-09-19T09:37:28.015555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:25.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020113+0000","last_change":"2024-09-19T09:37:10.965723+0000","last_active":"2024-09-19T09:37:28.020113+0000","last_peered":"2024-09-19T09:37:28.020113+0000","last_clean":"2024-09-19T09:37:28.020113+0000","last_became_active":"2024-09-19T09:37:10.965385+0000","last_became_peered":"2024-09-19T09:37:10.965385+0000","last_unstale":"2024-09-19T09:37:28.020113+0000","last_undegraded":"2024-09-19T09:37:28.020113+0000","last_fullsized":"2024-09-19T09:37:28.020113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:15.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017690+0000","last_change":"2024-09-19T09:37:08.948028+0000","last_active":"2024-09-19T09:37:28.017690+0000","last_peered":"2024-09-19T09:37:28.017690+0000","last_clean":"2024-09-19T09:37:28.017690+0000","last_became_active":"2024-09-19T09:37:08.947583+0000","last_became_peered":"2024-09-19T09:37:08.947583+0000","last_unstale":"2024-09-19T09:37:28.017690+0000","last_undegraded":"2024-09-19T09:37:28.017690+0000","last_fullsized":"2024-09-19T09:37:28.017690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:15.485850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017516+0000","last_change":"2024-09-19T09:37:10.964577+0000","last_active":"2024-09-19T09:37:28.017516+0000","last_peered":"2024-09-19T09:37:28.017516+0000","last_clean":"2024-09-19T09:37:28.017516+0000","last_became_active":"2024-09-19T09:37:10.964226+0000","last_became_peered":"2024-09-19T09:37:10.964226+0000","last_unstale":"2024-09-19T09:37:28.017516+0000","last_undegraded":"2024-09-19T09:37:28.017516+0000","last_fullsized":"2024-09-19T09:37:28.017516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:44.074286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014911+0000","last_change":"2024-09-19T09:37:08.952257+0000","last_active":"2024-09-19T09:37:28.014911+0000","last_peered":"2024-09-19T09:37:28.014911+0000","last_clean":"2024-09-19T09:37:28.014911+0000","last_became_active":"2024-09-19T09:37:08.951056+0000","last_became_peered":"2024-09-19T09:37:08.951056+0000","last_unstale":"2024-09-19T09:37:28.014911+0000","last_undegraded":"2024-09-19T09:37:28.014911+0000","last_fullsized":"2024-09-19T09:37:28.014911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:35.238551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017765+0000","last_change":"2024-09-19T09:37:10.965956+0000","last_active":"2024-09-19T09:37:28.017765+0000","last_peered":"2024-09-19T09:37:28.017765+0000","last_clean":"2024-09-19T09:37:28.017765+0000","last_became_active":"2024-09-19T09:37:10.965367+0000","last_became_peered":"2024-09-19T09:37:10.965367+0000","last_unstale":"2024-09-19T09:37:28.017765+0000","last_undegraded":"2024-09-19T09:37:28.017765+0000","last_fullsized":"2024-09-19T09:37:28.017765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:23.280106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.027523+0000","last_change":"2024-09-19T09:37:28.026998+0000","last_active":"2024-09-19T09:37:28.027523+0000","last_peered":"2024-09-19T09:37:28.027523+0000","last_clean":"2024-09-19T09:37:28.027523+0000","last_became_active":"2024-09-19T09:37:28.021169+0000","last_became_peered":"2024-09-19T09:37:28.021169+0000","last_unstale":"2024-09-19T09:37:28.027523+0000","last_undegraded":"2024-09-19T09:37:28.027523+0000","last_fullsized":"2024-09-19T09:37:28.027523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.876143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017806+0000","last_change":"2024-09-19T09:37:10.959937+0000","last_active":"2024-09-19T09:37:28.017806+0000","last_peered":"2024-09-19T09:37:28.017806+0000","last_clean":"2024-09-19T09:37:28.017806+0000","last_became_active":"2024-09-19T09:37:10.959466+0000","last_became_peered":"2024-09-19T09:37:10.959466+0000","last_unstale":"2024-09-19T09:37:28.017806+0000","last_undegraded":"2024-09-19T09:37:28.017806+0000","last_fullsized":"2024-09-19T09:37:28.017806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:13.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021701+0000","last_change":"2024-09-19T09:37:10.966737+0000","last_active":"2024-09-19T09:37:28.021701+0000","last_peered":"2024-09-19T09:37:28.021701+0000","last_clean":"2024-09-19T09:37:28.021701+0000","last_became_active":"2024-09-19T09:37:10.966436+0000","last_became_peered":"2024-09-19T09:37:10.966436+0000","last_unstale":"2024-09-19T09:37:28.021701+0000","last_undegraded":"2024-09-19T09:37:28.021701+0000","last_fullsized":"2024-09-19T09:37:28.021701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:05.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020657+0000","last_change":"2024-09-19T09:37:08.950225+0000","last_active":"2024-09-19T09:37:28.020657+0000","last_peered":"2024-09-19T09:37:28.020657+0000","last_clean":"2024-09-19T09:37:28.020657+0000","last_became_active":"2024-09-19T09:37:08.949855+0000","last_became_peered":"2024-09-19T09:37:08.949855+0000","last_unstale":"2024-09-19T09:37:28.020657+0000","last_undegraded":"2024-09-19T09:37:28.020657+0000","last_fullsized":"2024-09-19T09:37:28.020657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:12.315407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016294+0000","last_change":"2024-09-19T09:37:10.965763+0000","last_active":"2024-09-19T09:37:28.016294+0000","last_peered":"2024-09-19T09:37:28.016294+0000","last_clean":"2024-09-19T09:37:28.016294+0000","last_became_active":"2024-09-19T09:37:10.965425+0000","last_became_peered":"2024-09-19T09:37:10.965425+0000","last_unstale":"2024-09-19T09:37:28.016294+0000","last_undegraded":"2024-09-19T09:37:28.016294+0000","last_fullsized":"2024-09-19T09:37:28.016294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:34.474506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020815+0000","last_change":"2024-09-19T09:37:08.954211+0000","last_active":"2024-09-19T09:37:28.020815+0000","last_peered":"2024-09-19T09:37:28.020815+0000","last_clean":"2024-09-19T09:37:28.020815+0000","last_became_active":"2024-09-19T09:37:08.953869+0000","last_became_peered":"2024-09-19T09:37:08.953869+0000","last_unstale":"2024-09-19T09:37:28.020815+0000","last_undegraded":"2024-09-19T09:37:28.020815+0000","last_fullsized":"2024-09-19T09:37:28.020815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:10.650227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016975+0000","last_change":"2024-09-19T09:37:10.957032+0000","last_active":"2024-09-19T09:37:28.016975+0000","last_peered":"2024-09-19T09:37:28.016975+0000","last_clean":"2024-09-19T09:37:28.016975+0000","last_became_active":"2024-09-19T09:37:10.955979+0000","last_became_peered":"2024-09-19T09:37:10.955979+0000","last_unstale":"2024-09-19T09:37:28.016975+0000","last_undegraded":"2024-09-19T09:37:28.016975+0000","last_fullsized":"2024-09-19T09:37:28.016975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.734353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018040+0000","last_change":"2024-09-19T09:37:08.976359+0000","last_active":"2024-09-19T09:37:28.018040+0000","last_peered":"2024-09-19T09:37:28.018040+0000","last_clean":"2024-09-19T09:37:28.018040+0000","last_became_active":"2024-09-19T09:37:08.976019+0000","last_became_peered":"2024-09-19T09:37:08.976019+0000","last_unstale":"2024-09-19T09:37:28.018040+0000","last_undegraded":"2024-09-19T09:37:28.018040+0000","last_fullsized":"2024-09-19T09:37:28.018040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:34.401585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017783+0000","last_change":"2024-09-19T09:37:10.954000+0000","last_active":"2024-09-19T09:37:28.017783+0000","last_peered":"2024-09-19T09:37:28.017783+0000","last_clean":"2024-09-19T09:37:28.017783+0000","last_became_active":"2024-09-19T09:37:10.953709+0000","last_became_peered":"2024-09-19T09:37:10.953709+0000","last_unstale":"2024-09-19T09:37:28.017783+0000","last_undegraded":"2024-09-19T09:37:28.017783+0000","last_fullsized":"2024-09-19T09:37:28.017783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:36.779680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.036749+0000","last_change":"2024-09-19T09:37:28.036392+0000","last_active":"2024-09-19T09:37:28.036749+0000","last_peered":"2024-09-19T09:37:28.036749+0000","last_clean":"2024-09-19T09:37:28.036749+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:37:28.036749+0000","last_undegraded":"2024-09-19T09:37:28.036749+0000","last_fullsized":"2024-09-19T09:37:28.036749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:56.344807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56811,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":228,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":28789,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":520192,"data_stored":161895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612625,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":437286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841556,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1593344,"data_stored":1078311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005082,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":437333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266719,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":436922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495651,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1030507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659177,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":437326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888109,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051635,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":487960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280566,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":925696,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476796,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":436896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607617,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":950272,"data_stored":465858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":933888,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":43882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:37:36.336 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:37:36.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:36 smithi171 ceph-mon[35803]: pgmap v285: 97 pgs: 97 active+clean; 632 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 12 op/s; 3.5 KiB/s, 2 objects/s recovering 2024-09-19T09:37:36.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:36 smithi136 ceph-mon[34840]: pgmap v285: 97 pgs: 97 active+clean; 632 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 12 op/s; 3.5 KiB/s, 2 objects/s recovering 2024-09-19T09:37:36.596 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:37.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.041+0000 7f08d0f78640 1 -- 172.21.15.42:0/1741839509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08cc102ef0 msgr2=0x7f08cc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.041+0000 7f08d0f78640 1 --2- 172.21.15.42:0/1741839509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08cc102ef0 0x7f08cc10da40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009ca0 tx=0x7f08c402a950 comp rx=0 tx=0).stop 2024-09-19T09:37:37.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.041+0000 7f08d0f78640 1 -- 172.21.15.42:0/1741839509 shutdown_connections 2024-09-19T09:37:37.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.041+0000 7f08d0f78640 1 --2- 172.21.15.42:0/1741839509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08cc102ef0 0x7f08cc10da40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.041+0000 7f08d0f78640 1 --2- 172.21.15.42:0/1741839509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc102570 0x7f08cc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.041+0000 7f08d0f78640 1 --2- 172.21.15.42:0/1741839509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08cc100e20 0x7f08cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.041+0000 7f08d0f78640 1 -- 172.21.15.42:0/1741839509 >> 172.21.15.42:0/1741839509 conn(0x7f08cc0fc7d0 msgr2=0x7f08cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.041+0000 7f08d0f78640 1 -- 172.21.15.42:0/1741839509 shutdown_connections 2024-09-19T09:37:37.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.041+0000 7f08d0f78640 1 -- 172.21.15.42:0/1741839509 wait complete. 2024-09-19T09:37:37.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08d0f78640 1 Processor -- start 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08d0f78640 1 -- start start 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08d0f78640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08cc100e20 0x7f08cc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08d0f78640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08cc102570 0x7f08cc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08d0f78640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc102ef0 0x7f08cc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08d0f78640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc110f80 con 0x7f08cc102570 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08d0f78640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc110e00 con 0x7f08cc100e20 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08d0f78640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc111100 con 0x7f08cc102ef0 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08c9d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08cc102570 0x7f08cc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08c9d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08cc102570 0x7f08cc0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59670/0 (socket says 172.21.15.42:59670) 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08c9d9b640 1 -- 172.21.15.42:0/1785651921 learned_addr learned my addr 172.21.15.42:0/1785651921 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08ca59c640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08cc100e20 0x7f08cc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.042+0000 7f08cad9d640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc102ef0 0x7f08cc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08c9d9b640 1 -- 172.21.15.42:0/1785651921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc102ef0 msgr2=0x7f08cc0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08c9d9b640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc102ef0 0x7f08cc0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08c9d9b640 1 -- 172.21.15.42:0/1785651921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08cc100e20 msgr2=0x7f08cc0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08c9d9b640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08cc100e20 0x7f08cc0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08c9d9b640 1 -- 172.21.15.42:0/1785651921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc1a6910 con 0x7f08cc102570 2024-09-19T09:37:37.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08ca59c640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08cc100e20 0x7f08cc0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:37.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08c9d9b640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08cc102570 0x7f08cc0fd1c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f08c000d950 tx=0x7f08c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08bb7fe640 1 -- 172.21.15.42:0/1785651921 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0017030 con 0x7f08cc102570 2024-09-19T09:37:37.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08bb7fe640 1 -- 172.21.15.42:0/1785651921 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08c0004020 con 0x7f08cc102570 2024-09-19T09:37:37.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08d0f78640 1 -- 172.21.15.42:0/1785651921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08cc1a6c00 con 0x7f08cc102570 2024-09-19T09:37:37.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08bb7fe640 1 -- 172.21.15.42:0/1785651921 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c00047a0 con 0x7f08cc102570 2024-09-19T09:37:37.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.043+0000 7f08d0f78640 1 -- 172.21.15.42:0/1785651921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08cc1a7140 con 0x7f08cc102570 2024-09-19T09:37:37.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.044+0000 7f08d0f78640 1 -- 172.21.15.42:0/1785651921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08cc101200 con 0x7f08cc102570 2024-09-19T09:37:37.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.048+0000 7f08bb7fe640 1 -- 172.21.15.42:0/1785651921 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f08c00041d0 con 0x7f08cc102570 2024-09-19T09:37:37.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.048+0000 7f08bb7fe640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08b40a32d0 0x7f08b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.049+0000 7f08ca59c640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08b40a32d0 0x7f08b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.049+0000 7f08bb7fe640 1 -- 172.21.15.42:0/1785651921 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f08c00cfa40 con 0x7f08cc102570 2024-09-19T09:37:37.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.049+0000 7f08ca59c640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08b40a32d0 0x7f08b40a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f08bc005d00 tx=0x7f08bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.051+0000 7f08bb7fe640 1 -- 172.21.15.42:0/1785651921 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08c009c580 con 0x7f08cc102570 2024-09-19T09:37:37.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.227+0000 7f08d0f78640 1 -- 172.21.15.42:0/1785651921 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08cc062630 con 0x7f08b40a32d0 2024-09-19T09:37:37.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.234+0000 7f08bb7fe640 1 -- 172.21.15.42:0/1785651921 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258777 (secure 0 0 0) 0x7f08cc062630 con 0x7f08b40a32d0 2024-09-19T09:37:37.237 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:37.238 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-19T09:37:37.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 -- 172.21.15.42:0/1785651921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08b40a32d0 msgr2=0x7f08b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08b40a32d0 0x7f08b40a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f08bc005d00 tx=0x7f08bc00b410 comp rx=0 tx=0).stop 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 -- 172.21.15.42:0/1785651921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08cc102570 msgr2=0x7f08cc0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08cc102570 0x7f08cc0fd1c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f08c000d950 tx=0x7f08c000de10 comp rx=0 tx=0).stop 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 -- 172.21.15.42:0/1785651921 shutdown_connections 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08b40a32d0 0x7f08b40a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc102ef0 0x7f08cc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08cc102570 0x7f08cc0fd1c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 --2- 172.21.15.42:0/1785651921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08cc100e20 0x7f08cc0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 -- 172.21.15.42:0/1785651921 >> 172.21.15.42:0/1785651921 conn(0x7f08cc0fc7d0 msgr2=0x7f08cc06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 -- 172.21.15.42:0/1785651921 shutdown_connections 2024-09-19T09:37:37.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:37.237+0000 7f08d0f78640 1 -- 172.21.15.42:0/1785651921 wait complete. 2024-09-19T09:37:37.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:37 smithi171 ceph-mon[35803]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:37 smithi136 ceph-mon[34840]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:37.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:37 smithi042 ceph-mon[31223]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:37.867 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-19T09:37:36.504579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647413,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":263,"num_read_kb":238,"num_write":418,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":1209642,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382820,"kb_used_data":12744,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559004,"statfs":{"total":1151940427776,"available":1151548420096,"internally_reserved":0,"allocated":13049856,"data_stored":7175367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48618,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":92,"num_write":31,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":28906,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.493398"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017500+0000","last_change":"2024-09-19T09:37:10.964695+0000","last_active":"2024-09-19T09:37:28.017500+0000","last_peered":"2024-09-19T09:37:28.017500+0000","last_clean":"2024-09-19T09:37:28.017500+0000","last_became_active":"2024-09-19T09:37:10.964343+0000","last_became_peered":"2024-09-19T09:37:10.964343+0000","last_unstale":"2024-09-19T09:37:28.017500+0000","last_undegraded":"2024-09-19T09:37:28.017500+0000","last_fullsized":"2024-09-19T09:37:28.017500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:44.224621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016481+0000","last_change":"2024-09-19T09:37:10.964163+0000","last_active":"2024-09-19T09:37:28.016481+0000","last_peered":"2024-09-19T09:37:28.016481+0000","last_clean":"2024-09-19T09:37:28.016481+0000","last_became_active":"2024-09-19T09:37:10.963758+0000","last_became_peered":"2024-09-19T09:37:10.963758+0000","last_unstale":"2024-09-19T09:37:28.016481+0000","last_undegraded":"2024-09-19T09:37:28.016481+0000","last_fullsized":"2024-09-19T09:37:28.016481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:49.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016475+0000","last_change":"2024-09-19T09:37:10.958145+0000","last_active":"2024-09-19T09:37:28.016475+0000","last_peered":"2024-09-19T09:37:28.016475+0000","last_clean":"2024-09-19T09:37:28.016475+0000","last_became_active":"2024-09-19T09:37:10.957666+0000","last_became_peered":"2024-09-19T09:37:10.957666+0000","last_unstale":"2024-09-19T09:37:28.016475+0000","last_undegraded":"2024-09-19T09:37:28.016475+0000","last_fullsized":"2024-09-19T09:37:28.016475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.479753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.022081+0000","last_change":"2024-09-19T09:37:28.021681+0000","last_active":"2024-09-19T09:37:28.022081+0000","last_peered":"2024-09-19T09:37:28.022081+0000","last_clean":"2024-09-19T09:37:28.022081+0000","last_became_active":"2024-09-19T09:37:28.021294+0000","last_became_peered":"2024-09-19T09:37:28.021294+0000","last_unstale":"2024-09-19T09:37:28.022081+0000","last_undegraded":"2024-09-19T09:37:28.022081+0000","last_fullsized":"2024-09-19T09:37:28.022081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:36.535707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020286+0000","last_change":"2024-09-19T09:37:10.957138+0000","last_active":"2024-09-19T09:37:28.020286+0000","last_peered":"2024-09-19T09:37:28.020286+0000","last_clean":"2024-09-19T09:37:28.020286+0000","last_became_active":"2024-09-19T09:37:10.956824+0000","last_became_peered":"2024-09-19T09:37:10.956824+0000","last_unstale":"2024-09-19T09:37:28.020286+0000","last_undegraded":"2024-09-19T09:37:28.020286+0000","last_fullsized":"2024-09-19T09:37:28.020286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.919747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014634+0000","last_change":"2024-09-19T09:37:10.969804+0000","last_active":"2024-09-19T09:37:28.014634+0000","last_peered":"2024-09-19T09:37:28.014634+0000","last_clean":"2024-09-19T09:37:28.014634+0000","last_became_active":"2024-09-19T09:37:10.969454+0000","last_became_peered":"2024-09-19T09:37:10.969454+0000","last_unstale":"2024-09-19T09:37:28.014634+0000","last_undegraded":"2024-09-19T09:37:28.014634+0000","last_fullsized":"2024-09-19T09:37:28.014634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:14.856255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017497+0000","last_change":"2024-09-19T09:37:10.962853+0000","last_active":"2024-09-19T09:37:28.017497+0000","last_peered":"2024-09-19T09:37:28.017497+0000","last_clean":"2024-09-19T09:37:28.017497+0000","last_became_active":"2024-09-19T09:37:10.961207+0000","last_became_peered":"2024-09-19T09:37:10.961207+0000","last_unstale":"2024-09-19T09:37:28.017497+0000","last_undegraded":"2024-09-19T09:37:28.017497+0000","last_fullsized":"2024-09-19T09:37:28.017497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017053+0000","last_change":"2024-09-19T09:37:10.970216+0000","last_active":"2024-09-19T09:37:28.017053+0000","last_peered":"2024-09-19T09:37:28.017053+0000","last_clean":"2024-09-19T09:37:28.017053+0000","last_became_active":"2024-09-19T09:37:10.969486+0000","last_became_peered":"2024-09-19T09:37:10.969486+0000","last_unstale":"2024-09-19T09:37:28.017053+0000","last_undegraded":"2024-09-19T09:37:28.017053+0000","last_fullsized":"2024-09-19T09:37:28.017053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:56.859228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016269+0000","last_change":"2024-09-19T09:37:10.962596+0000","last_active":"2024-09-19T09:37:28.016269+0000","last_peered":"2024-09-19T09:37:28.016269+0000","last_clean":"2024-09-19T09:37:28.016269+0000","last_became_active":"2024-09-19T09:37:10.962230+0000","last_became_peered":"2024-09-19T09:37:10.962230+0000","last_unstale":"2024-09-19T09:37:28.016269+0000","last_undegraded":"2024-09-19T09:37:28.016269+0000","last_fullsized":"2024-09-19T09:37:28.016269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:07.810793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015170+0000","last_change":"2024-09-19T09:37:10.962186+0000","last_active":"2024-09-19T09:37:28.015170+0000","last_peered":"2024-09-19T09:37:28.015170+0000","last_clean":"2024-09-19T09:37:28.015170+0000","last_became_active":"2024-09-19T09:37:10.961845+0000","last_became_peered":"2024-09-19T09:37:10.961845+0000","last_unstale":"2024-09-19T09:37:28.015170+0000","last_undegraded":"2024-09-19T09:37:28.015170+0000","last_fullsized":"2024-09-19T09:37:28.015170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:24.150103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018025+0000","last_change":"2024-09-19T09:37:10.958763+0000","last_active":"2024-09-19T09:37:28.018025+0000","last_peered":"2024-09-19T09:37:28.018025+0000","last_clean":"2024-09-19T09:37:28.018025+0000","last_became_active":"2024-09-19T09:37:10.958397+0000","last_became_peered":"2024-09-19T09:37:10.958397+0000","last_unstale":"2024-09-19T09:37:28.018025+0000","last_undegraded":"2024-09-19T09:37:28.018025+0000","last_fullsized":"2024-09-19T09:37:28.018025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:37.690594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013858+0000","last_change":"2024-09-19T09:37:10.964787+0000","last_active":"2024-09-19T09:37:28.013858+0000","last_peered":"2024-09-19T09:37:28.013858+0000","last_clean":"2024-09-19T09:37:28.013858+0000","last_became_active":"2024-09-19T09:37:10.964121+0000","last_became_peered":"2024-09-19T09:37:10.964121+0000","last_unstale":"2024-09-19T09:37:28.013858+0000","last_undegraded":"2024-09-19T09:37:28.013858+0000","last_fullsized":"2024-09-19T09:37:28.013858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:02.456961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013043+0000","last_change":"2024-09-19T09:37:10.963290+0000","last_active":"2024-09-19T09:37:28.013043+0000","last_peered":"2024-09-19T09:37:28.013043+0000","last_clean":"2024-09-19T09:37:28.013043+0000","last_became_active":"2024-09-19T09:37:10.962961+0000","last_became_peered":"2024-09-19T09:37:10.962961+0000","last_unstale":"2024-09-19T09:37:28.013043+0000","last_undegraded":"2024-09-19T09:37:28.013043+0000","last_fullsized":"2024-09-19T09:37:28.013043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.266745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016628+0000","last_change":"2024-09-19T09:37:10.969742+0000","last_active":"2024-09-19T09:37:28.016628+0000","last_peered":"2024-09-19T09:37:28.016628+0000","last_clean":"2024-09-19T09:37:28.016628+0000","last_became_active":"2024-09-19T09:37:10.969399+0000","last_became_peered":"2024-09-19T09:37:10.969399+0000","last_unstale":"2024-09-19T09:37:28.016628+0000","last_undegraded":"2024-09-19T09:37:28.016628+0000","last_fullsized":"2024-09-19T09:37:28.016628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.386596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016450+0000","last_change":"2024-09-19T09:37:10.962406+0000","last_active":"2024-09-19T09:37:28.016450+0000","last_peered":"2024-09-19T09:37:28.016450+0000","last_clean":"2024-09-19T09:37:28.016450+0000","last_became_active":"2024-09-19T09:37:10.962130+0000","last_became_peered":"2024-09-19T09:37:10.962130+0000","last_unstale":"2024-09-19T09:37:28.016450+0000","last_undegraded":"2024-09-19T09:37:28.016450+0000","last_fullsized":"2024-09-19T09:37:28.016450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015418+0000","last_change":"2024-09-19T09:37:10.958465+0000","last_active":"2024-09-19T09:37:28.015418+0000","last_peered":"2024-09-19T09:37:28.015418+0000","last_clean":"2024-09-19T09:37:28.015418+0000","last_became_active":"2024-09-19T09:37:10.957600+0000","last_became_peered":"2024-09-19T09:37:10.957600+0000","last_unstale":"2024-09-19T09:37:28.015418+0000","last_undegraded":"2024-09-19T09:37:28.015418+0000","last_fullsized":"2024-09-19T09:37:28.015418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:39.232483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017505+0000","last_change":"2024-09-19T09:37:10.965463+0000","last_active":"2024-09-19T09:37:28.017505+0000","last_peered":"2024-09-19T09:37:28.017505+0000","last_clean":"2024-09-19T09:37:28.017505+0000","last_became_active":"2024-09-19T09:37:10.965137+0000","last_became_peered":"2024-09-19T09:37:10.965137+0000","last_unstale":"2024-09-19T09:37:28.017505+0000","last_undegraded":"2024-09-19T09:37:28.017505+0000","last_fullsized":"2024-09-19T09:37:28.017505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:19.582515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015407+0000","last_change":"2024-09-19T09:37:10.964897+0000","last_active":"2024-09-19T09:37:28.015407+0000","last_peered":"2024-09-19T09:37:28.015407+0000","last_clean":"2024-09-19T09:37:28.015407+0000","last_became_active":"2024-09-19T09:37:10.964527+0000","last_became_peered":"2024-09-19T09:37:10.964527+0000","last_unstale":"2024-09-19T09:37:28.015407+0000","last_undegraded":"2024-09-19T09:37:28.015407+0000","last_fullsized":"2024-09-19T09:37:28.015407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:29.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015328+0000","last_change":"2024-09-19T09:37:10.953645+0000","last_active":"2024-09-19T09:37:28.015328+0000","last_peered":"2024-09-19T09:37:28.015328+0000","last_clean":"2024-09-19T09:37:28.015328+0000","last_became_active":"2024-09-19T09:37:10.953326+0000","last_became_peered":"2024-09-19T09:37:10.953326+0000","last_unstale":"2024-09-19T09:37:28.015328+0000","last_undegraded":"2024-09-19T09:37:28.015328+0000","last_fullsized":"2024-09-19T09:37:28.015328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.644615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016578+0000","last_change":"2024-09-19T09:37:10.961384+0000","last_active":"2024-09-19T09:37:28.016578+0000","last_peered":"2024-09-19T09:37:28.016578+0000","last_clean":"2024-09-19T09:37:28.016578+0000","last_became_active":"2024-09-19T09:37:10.961038+0000","last_became_peered":"2024-09-19T09:37:10.961038+0000","last_unstale":"2024-09-19T09:37:28.016578+0000","last_undegraded":"2024-09-19T09:37:28.016578+0000","last_fullsized":"2024-09-19T09:37:28.016578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:54.876799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013067+0000","last_change":"2024-09-19T09:37:10.955789+0000","last_active":"2024-09-19T09:37:28.013067+0000","last_peered":"2024-09-19T09:37:28.013067+0000","last_clean":"2024-09-19T09:37:28.013067+0000","last_became_active":"2024-09-19T09:37:10.955447+0000","last_became_peered":"2024-09-19T09:37:10.955447+0000","last_unstale":"2024-09-19T09:37:28.013067+0000","last_undegraded":"2024-09-19T09:37:28.013067+0000","last_fullsized":"2024-09-19T09:37:28.013067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:28.512069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015730+0000","last_change":"2024-09-19T09:37:10.956501+0000","last_active":"2024-09-19T09:37:28.015730+0000","last_peered":"2024-09-19T09:37:28.015730+0000","last_clean":"2024-09-19T09:37:28.015730+0000","last_became_active":"2024-09-19T09:37:10.956161+0000","last_became_peered":"2024-09-19T09:37:10.956161+0000","last_unstale":"2024-09-19T09:37:28.015730+0000","last_undegraded":"2024-09-19T09:37:28.015730+0000","last_fullsized":"2024-09-19T09:37:28.015730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:31.738143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017612+0000","last_change":"2024-09-19T09:37:10.961486+0000","last_active":"2024-09-19T09:37:28.017612+0000","last_peered":"2024-09-19T09:37:28.017612+0000","last_clean":"2024-09-19T09:37:28.017612+0000","last_became_active":"2024-09-19T09:37:10.960877+0000","last_became_peered":"2024-09-19T09:37:10.960877+0000","last_unstale":"2024-09-19T09:37:28.017612+0000","last_undegraded":"2024-09-19T09:37:28.017612+0000","last_fullsized":"2024-09-19T09:37:28.017612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:34.889431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020088+0000","last_change":"2024-09-19T09:37:10.964400+0000","last_active":"2024-09-19T09:37:28.020088+0000","last_peered":"2024-09-19T09:37:28.020088+0000","last_clean":"2024-09-19T09:37:28.020088+0000","last_became_active":"2024-09-19T09:37:10.963394+0000","last_became_peered":"2024-09-19T09:37:10.963394+0000","last_unstale":"2024-09-19T09:37:28.020088+0000","last_undegraded":"2024-09-19T09:37:28.020088+0000","last_fullsized":"2024-09-19T09:37:28.020088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:22.185221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017710+0000","last_change":"2024-09-19T09:37:10.959661+0000","last_active":"2024-09-19T09:37:28.017710+0000","last_peered":"2024-09-19T09:37:28.017710+0000","last_clean":"2024-09-19T09:37:28.017710+0000","last_became_active":"2024-09-19T09:37:10.959371+0000","last_became_peered":"2024-09-19T09:37:10.959371+0000","last_unstale":"2024-09-19T09:37:28.017710+0000","last_undegraded":"2024-09-19T09:37:28.017710+0000","last_fullsized":"2024-09-19T09:37:28.017710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.752712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015704+0000","last_change":"2024-09-19T09:37:10.967310+0000","last_active":"2024-09-19T09:37:28.015704+0000","last_peered":"2024-09-19T09:37:28.015704+0000","last_clean":"2024-09-19T09:37:28.015704+0000","last_became_active":"2024-09-19T09:37:10.965415+0000","last_became_peered":"2024-09-19T09:37:10.965415+0000","last_unstale":"2024-09-19T09:37:28.015704+0000","last_undegraded":"2024-09-19T09:37:28.015704+0000","last_fullsized":"2024-09-19T09:37:28.015704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:16.968646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016734+0000","last_change":"2024-09-19T09:37:10.967301+0000","last_active":"2024-09-19T09:37:28.016734+0000","last_peered":"2024-09-19T09:37:28.016734+0000","last_clean":"2024-09-19T09:37:28.016734+0000","last_became_active":"2024-09-19T09:37:10.966397+0000","last_became_peered":"2024-09-19T09:37:10.966397+0000","last_unstale":"2024-09-19T09:37:28.016734+0000","last_undegraded":"2024-09-19T09:37:28.016734+0000","last_fullsized":"2024-09-19T09:37:28.016734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.621085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013100+0000","last_change":"2024-09-19T09:37:10.958069+0000","last_active":"2024-09-19T09:37:28.013100+0000","last_peered":"2024-09-19T09:37:28.013100+0000","last_clean":"2024-09-19T09:37:28.013100+0000","last_became_active":"2024-09-19T09:37:10.957670+0000","last_became_peered":"2024-09-19T09:37:10.957670+0000","last_unstale":"2024-09-19T09:37:28.013100+0000","last_undegraded":"2024-09-19T09:37:28.013100+0000","last_fullsized":"2024-09-19T09:37:28.013100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.412978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016752+0000","last_change":"2024-09-19T09:37:10.960490+0000","last_active":"2024-09-19T09:37:28.016752+0000","last_peered":"2024-09-19T09:37:28.016752+0000","last_clean":"2024-09-19T09:37:28.016752+0000","last_became_active":"2024-09-19T09:37:10.960239+0000","last_became_peered":"2024-09-19T09:37:10.960239+0000","last_unstale":"2024-09-19T09:37:28.016752+0000","last_undegraded":"2024-09-19T09:37:28.016752+0000","last_fullsized":"2024-09-19T09:37:28.016752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.384348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014794+0000","last_change":"2024-09-19T09:37:10.955930+0000","last_active":"2024-09-19T09:37:28.014794+0000","last_peered":"2024-09-19T09:37:28.014794+0000","last_clean":"2024-09-19T09:37:28.014794+0000","last_became_active":"2024-09-19T09:37:10.955605+0000","last_became_peered":"2024-09-19T09:37:10.955605+0000","last_unstale":"2024-09-19T09:37:28.014794+0000","last_undegraded":"2024-09-19T09:37:28.014794+0000","last_fullsized":"2024-09-19T09:37:28.014794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:36.033350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014891+0000","last_change":"2024-09-19T09:37:10.960467+0000","last_active":"2024-09-19T09:37:28.014891+0000","last_peered":"2024-09-19T09:37:28.014891+0000","last_clean":"2024-09-19T09:37:28.014891+0000","last_became_active":"2024-09-19T09:37:10.960082+0000","last_became_peered":"2024-09-19T09:37:10.960082+0000","last_unstale":"2024-09-19T09:37:28.014891+0000","last_undegraded":"2024-09-19T09:37:28.014891+0000","last_fullsized":"2024-09-19T09:37:28.014891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:07.451648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017381+0000","last_change":"2024-09-19T09:37:10.965674+0000","last_active":"2024-09-19T09:37:28.017381+0000","last_peered":"2024-09-19T09:37:28.017381+0000","last_clean":"2024-09-19T09:37:28.017381+0000","last_became_active":"2024-09-19T09:37:10.965368+0000","last_became_peered":"2024-09-19T09:37:10.965368+0000","last_unstale":"2024-09-19T09:37:28.017381+0000","last_undegraded":"2024-09-19T09:37:28.017381+0000","last_fullsized":"2024-09-19T09:37:28.017381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:23.712785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020306+0000","last_change":"2024-09-19T09:37:10.966972+0000","last_active":"2024-09-19T09:37:28.020306+0000","last_peered":"2024-09-19T09:37:28.020306+0000","last_clean":"2024-09-19T09:37:28.020306+0000","last_became_active":"2024-09-19T09:37:10.966642+0000","last_became_peered":"2024-09-19T09:37:10.966642+0000","last_unstale":"2024-09-19T09:37:28.020306+0000","last_undegraded":"2024-09-19T09:37:28.020306+0000","last_fullsized":"2024-09-19T09:37:28.020306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.416611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:32.032283+0000","last_change":"2024-09-19T09:37:08.953116+0000","last_active":"2024-09-19T09:37:32.032283+0000","last_peered":"2024-09-19T09:37:32.032283+0000","last_clean":"2024-09-19T09:37:32.032283+0000","last_became_active":"2024-09-19T09:37:08.952748+0000","last_became_peered":"2024-09-19T09:37:08.952748+0000","last_unstale":"2024-09-19T09:37:32.032283+0000","last_undegraded":"2024-09-19T09:37:32.032283+0000","last_fullsized":"2024-09-19T09:37:32.032283+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:22.395359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021330+0000","last_change":"2024-09-19T09:37:10.969106+0000","last_active":"2024-09-19T09:37:28.021330+0000","last_peered":"2024-09-19T09:37:28.021330+0000","last_clean":"2024-09-19T09:37:28.021330+0000","last_became_active":"2024-09-19T09:37:10.968801+0000","last_became_peered":"2024-09-19T09:37:10.968801+0000","last_unstale":"2024-09-19T09:37:28.021330+0000","last_undegraded":"2024-09-19T09:37:28.021330+0000","last_fullsized":"2024-09-19T09:37:28.021330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.674925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014739+0000","last_change":"2024-09-19T09:37:08.949604+0000","last_active":"2024-09-19T09:37:28.014739+0000","last_peered":"2024-09-19T09:37:28.014739+0000","last_clean":"2024-09-19T09:37:28.014739+0000","last_became_active":"2024-09-19T09:37:08.949143+0000","last_became_peered":"2024-09-19T09:37:08.949143+0000","last_unstale":"2024-09-19T09:37:28.014739+0000","last_undegraded":"2024-09-19T09:37:28.014739+0000","last_fullsized":"2024-09-19T09:37:28.014739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:37.933319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012827+0000","last_change":"2024-09-19T09:37:08.946277+0000","last_active":"2024-09-19T09:37:28.012827+0000","last_peered":"2024-09-19T09:37:28.012827+0000","last_clean":"2024-09-19T09:37:28.012827+0000","last_became_active":"2024-09-19T09:37:08.945808+0000","last_became_peered":"2024-09-19T09:37:08.945808+0000","last_unstale":"2024-09-19T09:37:28.012827+0000","last_undegraded":"2024-09-19T09:37:28.012827+0000","last_fullsized":"2024-09-19T09:37:28.012827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.060811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017159+0000","last_change":"2024-09-19T09:37:10.957765+0000","last_active":"2024-09-19T09:37:28.017159+0000","last_peered":"2024-09-19T09:37:28.017159+0000","last_clean":"2024-09-19T09:37:28.017159+0000","last_became_active":"2024-09-19T09:37:10.957458+0000","last_became_peered":"2024-09-19T09:37:10.957458+0000","last_unstale":"2024-09-19T09:37:28.017159+0000","last_undegraded":"2024-09-19T09:37:28.017159+0000","last_fullsized":"2024-09-19T09:37:28.017159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:49.418473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020344+0000","last_change":"2024-09-19T09:37:08.953124+0000","last_active":"2024-09-19T09:37:28.020344+0000","last_peered":"2024-09-19T09:37:28.020344+0000","last_clean":"2024-09-19T09:37:28.020344+0000","last_became_active":"2024-09-19T09:37:08.952159+0000","last_became_peered":"2024-09-19T09:37:08.952159+0000","last_unstale":"2024-09-19T09:37:28.020344+0000","last_undegraded":"2024-09-19T09:37:28.020344+0000","last_fullsized":"2024-09-19T09:37:28.020344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:24.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014710+0000","last_change":"2024-09-19T09:37:10.964038+0000","last_active":"2024-09-19T09:37:28.014710+0000","last_peered":"2024-09-19T09:37:28.014710+0000","last_clean":"2024-09-19T09:37:28.014710+0000","last_became_active":"2024-09-19T09:37:10.963671+0000","last_became_peered":"2024-09-19T09:37:10.963671+0000","last_unstale":"2024-09-19T09:37:28.014710+0000","last_undegraded":"2024-09-19T09:37:28.014710+0000","last_fullsized":"2024-09-19T09:37:28.014710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:19.743329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:33.029608+0000","last_change":"2024-09-19T09:37:08.949600+0000","last_active":"2024-09-19T09:37:33.029608+0000","last_peered":"2024-09-19T09:37:33.029608+0000","last_clean":"2024-09-19T09:37:33.029608+0000","last_became_active":"2024-09-19T09:37:08.949141+0000","last_became_peered":"2024-09-19T09:37:08.949141+0000","last_unstale":"2024-09-19T09:37:33.029608+0000","last_undegraded":"2024-09-19T09:37:33.029608+0000","last_fullsized":"2024-09-19T09:37:33.029608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:42.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016060+0000","last_change":"2024-09-19T09:37:10.967506+0000","last_active":"2024-09-19T09:37:28.016060+0000","last_peered":"2024-09-19T09:37:28.016060+0000","last_clean":"2024-09-19T09:37:28.016060+0000","last_became_active":"2024-09-19T09:37:10.967193+0000","last_became_peered":"2024-09-19T09:37:10.967193+0000","last_unstale":"2024-09-19T09:37:28.016060+0000","last_undegraded":"2024-09-19T09:37:28.016060+0000","last_fullsized":"2024-09-19T09:37:28.016060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:33.158325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017606+0000","last_change":"2024-09-19T09:37:08.955305+0000","last_active":"2024-09-19T09:37:28.017606+0000","last_peered":"2024-09-19T09:37:28.017606+0000","last_clean":"2024-09-19T09:37:28.017606+0000","last_became_active":"2024-09-19T09:37:08.954932+0000","last_became_peered":"2024-09-19T09:37:08.954932+0000","last_unstale":"2024-09-19T09:37:28.017606+0000","last_undegraded":"2024-09-19T09:37:28.017606+0000","last_fullsized":"2024-09-19T09:37:28.017606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.157466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021974+0000","last_change":"2024-09-19T09:37:28.021974+0000","last_active":"2024-09-19T09:37:28.021974+0000","last_peered":"2024-09-19T09:37:28.021974+0000","last_clean":"2024-09-19T09:37:28.021974+0000","last_became_active":"2024-09-19T09:37:28.021579+0000","last_became_peered":"2024-09-19T09:37:28.021579+0000","last_unstale":"2024-09-19T09:37:28.021974+0000","last_undegraded":"2024-09-19T09:37:28.021974+0000","last_fullsized":"2024-09-19T09:37:28.021974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:28.562862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021814+0000","last_change":"2024-09-19T09:37:08.976540+0000","last_active":"2024-09-19T09:37:28.021814+0000","last_peered":"2024-09-19T09:37:28.021814+0000","last_clean":"2024-09-19T09:37:28.021814+0000","last_became_active":"2024-09-19T09:37:08.976196+0000","last_became_peered":"2024-09-19T09:37:08.976196+0000","last_unstale":"2024-09-19T09:37:28.021814+0000","last_undegraded":"2024-09-19T09:37:28.021814+0000","last_fullsized":"2024-09-19T09:37:28.021814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:38.735947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021407+0000","last_change":"2024-09-19T09:37:28.021407+0000","last_active":"2024-09-19T09:37:28.021407+0000","last_peered":"2024-09-19T09:37:28.021407+0000","last_clean":"2024-09-19T09:37:28.021407+0000","last_became_active":"2024-09-19T09:37:28.021020+0000","last_became_peered":"2024-09-19T09:37:28.021020+0000","last_unstale":"2024-09-19T09:37:28.021407+0000","last_undegraded":"2024-09-19T09:37:28.021407+0000","last_fullsized":"2024-09-19T09:37:28.021407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:25.394012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:33.031661+0000","last_change":"2024-09-19T09:37:28.029037+0000","last_active":"2024-09-19T09:37:33.031661+0000","last_peered":"2024-09-19T09:37:33.031661+0000","last_clean":"2024-09-19T09:37:33.031661+0000","last_became_active":"2024-09-19T09:37:28.018325+0000","last_became_peered":"2024-09-19T09:37:28.018325+0000","last_unstale":"2024-09-19T09:37:33.031661+0000","last_undegraded":"2024-09-19T09:37:33.031661+0000","last_fullsized":"2024-09-19T09:37:33.031661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:56.121569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":61,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020724+0000","last_change":"2024-09-19T09:37:10.963688+0000","last_active":"2024-09-19T09:37:28.020724+0000","last_peered":"2024-09-19T09:37:28.020724+0000","last_clean":"2024-09-19T09:37:28.020724+0000","last_became_active":"2024-09-19T09:37:10.963296+0000","last_became_peered":"2024-09-19T09:37:10.963296+0000","last_unstale":"2024-09-19T09:37:28.020724+0000","last_undegraded":"2024-09-19T09:37:28.020724+0000","last_fullsized":"2024-09-19T09:37:28.020724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:49.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015183+0000","last_change":"2024-09-19T09:37:08.952198+0000","last_active":"2024-09-19T09:37:28.015183+0000","last_peered":"2024-09-19T09:37:28.015183+0000","last_clean":"2024-09-19T09:37:28.015183+0000","last_became_active":"2024-09-19T09:37:08.951699+0000","last_became_peered":"2024-09-19T09:37:08.951699+0000","last_unstale":"2024-09-19T09:37:28.015183+0000","last_undegraded":"2024-09-19T09:37:28.015183+0000","last_fullsized":"2024-09-19T09:37:28.015183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:46.729847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012881+0000","last_change":"2024-09-19T09:37:10.955741+0000","last_active":"2024-09-19T09:37:28.012881+0000","last_peered":"2024-09-19T09:37:28.012881+0000","last_clean":"2024-09-19T09:37:28.012881+0000","last_became_active":"2024-09-19T09:37:10.955394+0000","last_became_peered":"2024-09-19T09:37:10.955394+0000","last_unstale":"2024-09-19T09:37:28.012881+0000","last_undegraded":"2024-09-19T09:37:28.012881+0000","last_fullsized":"2024-09-19T09:37:28.012881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:56.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021172+0000","last_change":"2024-09-19T09:37:08.949979+0000","last_active":"2024-09-19T09:37:28.021172+0000","last_peered":"2024-09-19T09:37:28.021172+0000","last_clean":"2024-09-19T09:37:28.021172+0000","last_became_active":"2024-09-19T09:37:08.949664+0000","last_became_peered":"2024-09-19T09:37:08.949664+0000","last_unstale":"2024-09-19T09:37:28.021172+0000","last_undegraded":"2024-09-19T09:37:28.021172+0000","last_fullsized":"2024-09-19T09:37:28.021172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:06.449337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017773+0000","last_change":"2024-09-19T09:37:10.957479+0000","last_active":"2024-09-19T09:37:28.017773+0000","last_peered":"2024-09-19T09:37:28.017773+0000","last_clean":"2024-09-19T09:37:28.017773+0000","last_became_active":"2024-09-19T09:37:10.957130+0000","last_became_peered":"2024-09-19T09:37:10.957130+0000","last_unstale":"2024-09-19T09:37:28.017773+0000","last_undegraded":"2024-09-19T09:37:28.017773+0000","last_fullsized":"2024-09-19T09:37:28.017773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:52.840857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'6","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:33.030818+0000","last_change":"2024-09-19T09:37:08.951558+0000","last_active":"2024-09-19T09:37:33.030818+0000","last_peered":"2024-09-19T09:37:33.030818+0000","last_clean":"2024-09-19T09:37:33.030818+0000","last_became_active":"2024-09-19T09:37:08.951092+0000","last_became_peered":"2024-09-19T09:37:08.951092+0000","last_unstale":"2024-09-19T09:37:33.030818+0000","last_undegraded":"2024-09-19T09:37:33.030818+0000","last_fullsized":"2024-09-19T09:37:33.030818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:30.326253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018198+0000","last_change":"2024-09-19T09:37:10.962692+0000","last_active":"2024-09-19T09:37:28.018198+0000","last_peered":"2024-09-19T09:37:28.018198+0000","last_clean":"2024-09-19T09:37:28.018198+0000","last_became_active":"2024-09-19T09:37:10.962145+0000","last_became_peered":"2024-09-19T09:37:10.962145+0000","last_unstale":"2024-09-19T09:37:28.018198+0000","last_undegraded":"2024-09-19T09:37:28.018198+0000","last_fullsized":"2024-09-19T09:37:28.018198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:48.232759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020176+0000","last_change":"2024-09-19T09:37:08.976531+0000","last_active":"2024-09-19T09:37:28.020176+0000","last_peered":"2024-09-19T09:37:28.020176+0000","last_clean":"2024-09-19T09:37:28.020176+0000","last_became_active":"2024-09-19T09:37:08.975892+0000","last_became_peered":"2024-09-19T09:37:08.975892+0000","last_unstale":"2024-09-19T09:37:28.020176+0000","last_undegraded":"2024-09-19T09:37:28.020176+0000","last_fullsized":"2024-09-19T09:37:28.020176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.545504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019761+0000","last_change":"2024-09-19T09:37:10.968116+0000","last_active":"2024-09-19T09:37:28.019761+0000","last_peered":"2024-09-19T09:37:28.019761+0000","last_clean":"2024-09-19T09:37:28.019761+0000","last_became_active":"2024-09-19T09:37:10.967767+0000","last_became_peered":"2024-09-19T09:37:10.967767+0000","last_unstale":"2024-09-19T09:37:28.019761+0000","last_undegraded":"2024-09-19T09:37:28.019761+0000","last_fullsized":"2024-09-19T09:37:28.019761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:34.104712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020842+0000","last_change":"2024-09-19T09:37:08.949384+0000","last_active":"2024-09-19T09:37:28.020842+0000","last_peered":"2024-09-19T09:37:28.020842+0000","last_clean":"2024-09-19T09:37:28.020842+0000","last_became_active":"2024-09-19T09:37:08.948950+0000","last_became_peered":"2024-09-19T09:37:08.948950+0000","last_unstale":"2024-09-19T09:37:28.020842+0000","last_undegraded":"2024-09-19T09:37:28.020842+0000","last_fullsized":"2024-09-19T09:37:28.020842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:15.527608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016950+0000","last_change":"2024-09-19T09:37:10.965720+0000","last_active":"2024-09-19T09:37:28.016950+0000","last_peered":"2024-09-19T09:37:28.016950+0000","last_clean":"2024-09-19T09:37:28.016950+0000","last_became_active":"2024-09-19T09:37:10.965341+0000","last_became_peered":"2024-09-19T09:37:10.965341+0000","last_unstale":"2024-09-19T09:37:28.016950+0000","last_undegraded":"2024-09-19T09:37:28.016950+0000","last_fullsized":"2024-09-19T09:37:28.016950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:36.591438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013189+0000","last_change":"2024-09-19T09:37:08.953702+0000","last_active":"2024-09-19T09:37:28.013189+0000","last_peered":"2024-09-19T09:37:28.013189+0000","last_clean":"2024-09-19T09:37:28.013189+0000","last_became_active":"2024-09-19T09:37:08.953312+0000","last_became_peered":"2024-09-19T09:37:08.953312+0000","last_unstale":"2024-09-19T09:37:28.013189+0000","last_undegraded":"2024-09-19T09:37:28.013189+0000","last_fullsized":"2024-09-19T09:37:28.013189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:54.059096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017769+0000","last_change":"2024-09-19T09:37:10.959814+0000","last_active":"2024-09-19T09:37:28.017769+0000","last_peered":"2024-09-19T09:37:28.017769+0000","last_clean":"2024-09-19T09:37:28.017769+0000","last_became_active":"2024-09-19T09:37:10.959342+0000","last_became_peered":"2024-09-19T09:37:10.959342+0000","last_unstale":"2024-09-19T09:37:28.017769+0000","last_undegraded":"2024-09-19T09:37:28.017769+0000","last_fullsized":"2024-09-19T09:37:28.017769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021892+0000","last_change":"2024-09-19T09:37:08.947978+0000","last_active":"2024-09-19T09:37:28.021892+0000","last_peered":"2024-09-19T09:37:28.021892+0000","last_clean":"2024-09-19T09:37:28.021892+0000","last_became_active":"2024-09-19T09:37:08.947548+0000","last_became_peered":"2024-09-19T09:37:08.947548+0000","last_unstale":"2024-09-19T09:37:28.021892+0000","last_undegraded":"2024-09-19T09:37:28.021892+0000","last_fullsized":"2024-09-19T09:37:28.021892+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:38.283616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018434+0000","last_change":"2024-09-19T09:37:10.964008+0000","last_active":"2024-09-19T09:37:28.018434+0000","last_peered":"2024-09-19T09:37:28.018434+0000","last_clean":"2024-09-19T09:37:28.018434+0000","last_became_active":"2024-09-19T09:37:10.963554+0000","last_became_peered":"2024-09-19T09:37:10.963554+0000","last_unstale":"2024-09-19T09:37:28.018434+0000","last_undegraded":"2024-09-19T09:37:28.018434+0000","last_fullsized":"2024-09-19T09:37:28.018434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:57.320967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:33.030023+0000","last_change":"2024-09-19T09:37:28.027589+0000","last_active":"2024-09-19T09:37:33.030023+0000","last_peered":"2024-09-19T09:37:33.030023+0000","last_clean":"2024-09-19T09:37:33.030023+0000","last_became_active":"2024-09-19T09:37:28.020013+0000","last_became_peered":"2024-09-19T09:37:28.020013+0000","last_unstale":"2024-09-19T09:37:33.030023+0000","last_undegraded":"2024-09-19T09:37:33.030023+0000","last_fullsized":"2024-09-19T09:37:33.030023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:51.327069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018295+0000","last_change":"2024-09-19T09:37:10.960337+0000","last_active":"2024-09-19T09:37:28.018295+0000","last_peered":"2024-09-19T09:37:28.018295+0000","last_clean":"2024-09-19T09:37:28.018295+0000","last_became_active":"2024-09-19T09:37:10.960006+0000","last_became_peered":"2024-09-19T09:37:10.960006+0000","last_unstale":"2024-09-19T09:37:28.018295+0000","last_undegraded":"2024-09-19T09:37:28.018295+0000","last_fullsized":"2024-09-19T09:37:28.018295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:16.942098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":336,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019254+0000","last_change":"2024-09-19T09:36:01.923601+0000","last_active":"2024-09-19T09:37:28.019254+0000","last_peered":"2024-09-19T09:37:28.019254+0000","last_clean":"2024-09-19T09:37:28.019254+0000","last_became_active":"2024-09-19T09:36:01.923051+0000","last_became_peered":"2024-09-19T09:36:01.923051+0000","last_unstale":"2024-09-19T09:37:28.019254+0000","last_undegraded":"2024-09-19T09:37:28.019254+0000","last_fullsized":"2024-09-19T09:37:28.019254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_clean_scrub_stamp":"2024-09-19T09:32:45.321588+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:41.635565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013536+0000","last_change":"2024-09-19T09:37:08.948818+0000","last_active":"2024-09-19T09:37:28.013536+0000","last_peered":"2024-09-19T09:37:28.013536+0000","last_clean":"2024-09-19T09:37:28.013536+0000","last_became_active":"2024-09-19T09:37:08.948494+0000","last_became_peered":"2024-09-19T09:37:08.948494+0000","last_unstale":"2024-09-19T09:37:28.013536+0000","last_undegraded":"2024-09-19T09:37:28.013536+0000","last_fullsized":"2024-09-19T09:37:28.013536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:35.255778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017276+0000","last_change":"2024-09-19T09:37:10.966315+0000","last_active":"2024-09-19T09:37:28.017276+0000","last_peered":"2024-09-19T09:37:28.017276+0000","last_clean":"2024-09-19T09:37:28.017276+0000","last_became_active":"2024-09-19T09:37:10.965979+0000","last_became_peered":"2024-09-19T09:37:10.965979+0000","last_unstale":"2024-09-19T09:37:28.017276+0000","last_undegraded":"2024-09-19T09:37:28.017276+0000","last_fullsized":"2024-09-19T09:37:28.017276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:36.229434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.030136+0000","last_change":"2024-09-19T09:37:28.029598+0000","last_active":"2024-09-19T09:37:28.030136+0000","last_peered":"2024-09-19T09:37:28.030136+0000","last_clean":"2024-09-19T09:37:28.030136+0000","last_became_active":"2024-09-19T09:37:28.021459+0000","last_became_peered":"2024-09-19T09:37:28.021459+0000","last_unstale":"2024-09-19T09:37:28.030136+0000","last_undegraded":"2024-09-19T09:37:28.030136+0000","last_fullsized":"2024-09-19T09:37:28.030136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:00.755946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012816+0000","last_change":"2024-09-19T09:37:10.962825+0000","last_active":"2024-09-19T09:37:28.012816+0000","last_peered":"2024-09-19T09:37:28.012816+0000","last_clean":"2024-09-19T09:37:28.012816+0000","last_became_active":"2024-09-19T09:37:10.962475+0000","last_became_peered":"2024-09-19T09:37:10.962475+0000","last_unstale":"2024-09-19T09:37:28.012816+0000","last_undegraded":"2024-09-19T09:37:28.012816+0000","last_fullsized":"2024-09-19T09:37:28.012816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:30.650918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'5","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:31.028509+0000","last_change":"2024-09-19T09:37:08.976364+0000","last_active":"2024-09-19T09:37:31.028509+0000","last_peered":"2024-09-19T09:37:31.028509+0000","last_clean":"2024-09-19T09:37:31.028509+0000","last_became_active":"2024-09-19T09:37:08.975983+0000","last_became_peered":"2024-09-19T09:37:08.975983+0000","last_unstale":"2024-09-19T09:37:31.028509+0000","last_undegraded":"2024-09-19T09:37:31.028509+0000","last_fullsized":"2024-09-19T09:37:31.028509+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.762847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020702+0000","last_change":"2024-09-19T09:37:28.020341+0000","last_active":"2024-09-19T09:37:28.020702+0000","last_peered":"2024-09-19T09:37:28.020702+0000","last_clean":"2024-09-19T09:37:28.020702+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:37:28.020702+0000","last_undegraded":"2024-09-19T09:37:28.020702+0000","last_fullsized":"2024-09-19T09:37:28.020702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:24.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"79'6","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:35.028778+0000","last_change":"2024-09-19T09:37:08.950403+0000","last_active":"2024-09-19T09:37:35.028778+0000","last_peered":"2024-09-19T09:37:35.028778+0000","last_clean":"2024-09-19T09:37:35.028778+0000","last_became_active":"2024-09-19T09:37:08.950077+0000","last_became_peered":"2024-09-19T09:37:08.950077+0000","last_unstale":"2024-09-19T09:37:35.028778+0000","last_undegraded":"2024-09-19T09:37:35.028778+0000","last_fullsized":"2024-09-19T09:37:35.028778+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:46.446439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014647+0000","last_change":"2024-09-19T09:37:10.969493+0000","last_active":"2024-09-19T09:37:28.014647+0000","last_peered":"2024-09-19T09:37:28.014647+0000","last_clean":"2024-09-19T09:37:28.014647+0000","last_became_active":"2024-09-19T09:37:10.969038+0000","last_became_peered":"2024-09-19T09:37:10.969038+0000","last_unstale":"2024-09-19T09:37:28.014647+0000","last_undegraded":"2024-09-19T09:37:28.014647+0000","last_fullsized":"2024-09-19T09:37:28.014647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:55.518806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015137+0000","last_change":"2024-09-19T09:37:08.977207+0000","last_active":"2024-09-19T09:37:28.015137+0000","last_peered":"2024-09-19T09:37:28.015137+0000","last_clean":"2024-09-19T09:37:28.015137+0000","last_became_active":"2024-09-19T09:37:08.976859+0000","last_became_peered":"2024-09-19T09:37:08.976859+0000","last_unstale":"2024-09-19T09:37:28.015137+0000","last_undegraded":"2024-09-19T09:37:28.015137+0000","last_fullsized":"2024-09-19T09:37:28.015137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:25.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.023437+0000","last_change":"2024-09-19T09:37:28.023437+0000","last_active":"2024-09-19T09:37:28.023437+0000","last_peered":"2024-09-19T09:37:28.023437+0000","last_clean":"2024-09-19T09:37:28.023437+0000","last_became_active":"2024-09-19T09:37:28.018678+0000","last_became_peered":"2024-09-19T09:37:28.018678+0000","last_unstale":"2024-09-19T09:37:28.023437+0000","last_undegraded":"2024-09-19T09:37:28.023437+0000","last_fullsized":"2024-09-19T09:37:28.023437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:44.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020845+0000","last_change":"2024-09-19T09:37:08.976594+0000","last_active":"2024-09-19T09:37:28.020845+0000","last_peered":"2024-09-19T09:37:28.020845+0000","last_clean":"2024-09-19T09:37:28.020845+0000","last_became_active":"2024-09-19T09:37:08.976222+0000","last_became_peered":"2024-09-19T09:37:08.976222+0000","last_unstale":"2024-09-19T09:37:28.020845+0000","last_undegraded":"2024-09-19T09:37:28.020845+0000","last_fullsized":"2024-09-19T09:37:28.020845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:53.492591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013129+0000","last_change":"2024-09-19T09:37:10.957096+0000","last_active":"2024-09-19T09:37:28.013129+0000","last_peered":"2024-09-19T09:37:28.013129+0000","last_clean":"2024-09-19T09:37:28.013129+0000","last_became_active":"2024-09-19T09:37:10.956740+0000","last_became_peered":"2024-09-19T09:37:10.956740+0000","last_unstale":"2024-09-19T09:37:28.013129+0000","last_undegraded":"2024-09-19T09:37:28.013129+0000","last_fullsized":"2024-09-19T09:37:28.013129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:40.358624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'12","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:32.020224+0000","last_change":"2024-09-19T09:37:08.948528+0000","last_active":"2024-09-19T09:37:32.020224+0000","last_peered":"2024-09-19T09:37:32.020224+0000","last_clean":"2024-09-19T09:37:32.020224+0000","last_became_active":"2024-09-19T09:37:08.948183+0000","last_became_peered":"2024-09-19T09:37:08.948183+0000","last_unstale":"2024-09-19T09:37:32.020224+0000","last_undegraded":"2024-09-19T09:37:32.020224+0000","last_fullsized":"2024-09-19T09:37:32.020224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:23.214471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017729+0000","last_change":"2024-09-19T09:37:10.959492+0000","last_active":"2024-09-19T09:37:28.017729+0000","last_peered":"2024-09-19T09:37:28.017729+0000","last_clean":"2024-09-19T09:37:28.017729+0000","last_became_active":"2024-09-19T09:37:10.959032+0000","last_became_peered":"2024-09-19T09:37:10.959032+0000","last_unstale":"2024-09-19T09:37:28.017729+0000","last_undegraded":"2024-09-19T09:37:28.017729+0000","last_fullsized":"2024-09-19T09:37:28.017729+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.080976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013794+0000","last_change":"2024-09-19T09:37:09.270315+0000","last_active":"2024-09-19T09:37:28.013794+0000","last_peered":"2024-09-19T09:37:28.013794+0000","last_clean":"2024-09-19T09:37:28.013794+0000","last_became_active":"2024-09-19T09:37:09.269891+0000","last_became_peered":"2024-09-19T09:37:09.269891+0000","last_unstale":"2024-09-19T09:37:28.013794+0000","last_undegraded":"2024-09-19T09:37:28.013794+0000","last_fullsized":"2024-09-19T09:37:28.013794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:12.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016720+0000","last_change":"2024-09-19T09:37:10.961363+0000","last_active":"2024-09-19T09:37:28.016720+0000","last_peered":"2024-09-19T09:37:28.016720+0000","last_clean":"2024-09-19T09:37:28.016720+0000","last_became_active":"2024-09-19T09:37:10.960951+0000","last_became_peered":"2024-09-19T09:37:10.960951+0000","last_unstale":"2024-09-19T09:37:28.016720+0000","last_undegraded":"2024-09-19T09:37:28.016720+0000","last_fullsized":"2024-09-19T09:37:28.016720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:31.226355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015555+0000","last_change":"2024-09-19T09:37:08.976805+0000","last_active":"2024-09-19T09:37:28.015555+0000","last_peered":"2024-09-19T09:37:28.015555+0000","last_clean":"2024-09-19T09:37:28.015555+0000","last_became_active":"2024-09-19T09:37:08.976502+0000","last_became_peered":"2024-09-19T09:37:08.976502+0000","last_unstale":"2024-09-19T09:37:28.015555+0000","last_undegraded":"2024-09-19T09:37:28.015555+0000","last_fullsized":"2024-09-19T09:37:28.015555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:25.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020113+0000","last_change":"2024-09-19T09:37:10.965723+0000","last_active":"2024-09-19T09:37:28.020113+0000","last_peered":"2024-09-19T09:37:28.020113+0000","last_clean":"2024-09-19T09:37:28.020113+0000","last_became_active":"2024-09-19T09:37:10.965385+0000","last_became_peered":"2024-09-19T09:37:10.965385+0000","last_unstale":"2024-09-19T09:37:28.020113+0000","last_undegraded":"2024-09-19T09:37:28.020113+0000","last_fullsized":"2024-09-19T09:37:28.020113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:15.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017690+0000","last_change":"2024-09-19T09:37:08.948028+0000","last_active":"2024-09-19T09:37:28.017690+0000","last_peered":"2024-09-19T09:37:28.017690+0000","last_clean":"2024-09-19T09:37:28.017690+0000","last_became_active":"2024-09-19T09:37:08.947583+0000","last_became_peered":"2024-09-19T09:37:08.947583+0000","last_unstale":"2024-09-19T09:37:28.017690+0000","last_undegraded":"2024-09-19T09:37:28.017690+0000","last_fullsized":"2024-09-19T09:37:28.017690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:15.485850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017516+0000","last_change":"2024-09-19T09:37:10.964577+0000","last_active":"2024-09-19T09:37:28.017516+0000","last_peered":"2024-09-19T09:37:28.017516+0000","last_clean":"2024-09-19T09:37:28.017516+0000","last_became_active":"2024-09-19T09:37:10.964226+0000","last_became_peered":"2024-09-19T09:37:10.964226+0000","last_unstale":"2024-09-19T09:37:28.017516+0000","last_undegraded":"2024-09-19T09:37:28.017516+0000","last_fullsized":"2024-09-19T09:37:28.017516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:44.074286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014911+0000","last_change":"2024-09-19T09:37:08.952257+0000","last_active":"2024-09-19T09:37:28.014911+0000","last_peered":"2024-09-19T09:37:28.014911+0000","last_clean":"2024-09-19T09:37:28.014911+0000","last_became_active":"2024-09-19T09:37:08.951056+0000","last_became_peered":"2024-09-19T09:37:08.951056+0000","last_unstale":"2024-09-19T09:37:28.014911+0000","last_undegraded":"2024-09-19T09:37:28.014911+0000","last_fullsized":"2024-09-19T09:37:28.014911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:35.238551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017765+0000","last_change":"2024-09-19T09:37:10.965956+0000","last_active":"2024-09-19T09:37:28.017765+0000","last_peered":"2024-09-19T09:37:28.017765+0000","last_clean":"2024-09-19T09:37:28.017765+0000","last_became_active":"2024-09-19T09:37:10.965367+0000","last_became_peered":"2024-09-19T09:37:10.965367+0000","last_unstale":"2024-09-19T09:37:28.017765+0000","last_undegraded":"2024-09-19T09:37:28.017765+0000","last_fullsized":"2024-09-19T09:37:28.017765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:23.280106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.027523+0000","last_change":"2024-09-19T09:37:28.026998+0000","last_active":"2024-09-19T09:37:28.027523+0000","last_peered":"2024-09-19T09:37:28.027523+0000","last_clean":"2024-09-19T09:37:28.027523+0000","last_became_active":"2024-09-19T09:37:28.021169+0000","last_became_peered":"2024-09-19T09:37:28.021169+0000","last_unstale":"2024-09-19T09:37:28.027523+0000","last_undegraded":"2024-09-19T09:37:28.027523+0000","last_fullsized":"2024-09-19T09:37:28.027523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.876143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017806+0000","last_change":"2024-09-19T09:37:10.959937+0000","last_active":"2024-09-19T09:37:28.017806+0000","last_peered":"2024-09-19T09:37:28.017806+0000","last_clean":"2024-09-19T09:37:28.017806+0000","last_became_active":"2024-09-19T09:37:10.959466+0000","last_became_peered":"2024-09-19T09:37:10.959466+0000","last_unstale":"2024-09-19T09:37:28.017806+0000","last_undegraded":"2024-09-19T09:37:28.017806+0000","last_fullsized":"2024-09-19T09:37:28.017806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:13.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021701+0000","last_change":"2024-09-19T09:37:10.966737+0000","last_active":"2024-09-19T09:37:28.021701+0000","last_peered":"2024-09-19T09:37:28.021701+0000","last_clean":"2024-09-19T09:37:28.021701+0000","last_became_active":"2024-09-19T09:37:10.966436+0000","last_became_peered":"2024-09-19T09:37:10.966436+0000","last_unstale":"2024-09-19T09:37:28.021701+0000","last_undegraded":"2024-09-19T09:37:28.021701+0000","last_fullsized":"2024-09-19T09:37:28.021701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:05.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020657+0000","last_change":"2024-09-19T09:37:08.950225+0000","last_active":"2024-09-19T09:37:28.020657+0000","last_peered":"2024-09-19T09:37:28.020657+0000","last_clean":"2024-09-19T09:37:28.020657+0000","last_became_active":"2024-09-19T09:37:08.949855+0000","last_became_peered":"2024-09-19T09:37:08.949855+0000","last_unstale":"2024-09-19T09:37:28.020657+0000","last_undegraded":"2024-09-19T09:37:28.020657+0000","last_fullsized":"2024-09-19T09:37:28.020657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:12.315407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016294+0000","last_change":"2024-09-19T09:37:10.965763+0000","last_active":"2024-09-19T09:37:28.016294+0000","last_peered":"2024-09-19T09:37:28.016294+0000","last_clean":"2024-09-19T09:37:28.016294+0000","last_became_active":"2024-09-19T09:37:10.965425+0000","last_became_peered":"2024-09-19T09:37:10.965425+0000","last_unstale":"2024-09-19T09:37:28.016294+0000","last_undegraded":"2024-09-19T09:37:28.016294+0000","last_fullsized":"2024-09-19T09:37:28.016294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:34.474506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020815+0000","last_change":"2024-09-19T09:37:08.954211+0000","last_active":"2024-09-19T09:37:28.020815+0000","last_peered":"2024-09-19T09:37:28.020815+0000","last_clean":"2024-09-19T09:37:28.020815+0000","last_became_active":"2024-09-19T09:37:08.953869+0000","last_became_peered":"2024-09-19T09:37:08.953869+0000","last_unstale":"2024-09-19T09:37:28.020815+0000","last_undegraded":"2024-09-19T09:37:28.020815+0000","last_fullsized":"2024-09-19T09:37:28.020815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:10.650227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016975+0000","last_change":"2024-09-19T09:37:10.957032+0000","last_active":"2024-09-19T09:37:28.016975+0000","last_peered":"2024-09-19T09:37:28.016975+0000","last_clean":"2024-09-19T09:37:28.016975+0000","last_became_active":"2024-09-19T09:37:10.955979+0000","last_became_peered":"2024-09-19T09:37:10.955979+0000","last_unstale":"2024-09-19T09:37:28.016975+0000","last_undegraded":"2024-09-19T09:37:28.016975+0000","last_fullsized":"2024-09-19T09:37:28.016975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.734353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018040+0000","last_change":"2024-09-19T09:37:08.976359+0000","last_active":"2024-09-19T09:37:28.018040+0000","last_peered":"2024-09-19T09:37:28.018040+0000","last_clean":"2024-09-19T09:37:28.018040+0000","last_became_active":"2024-09-19T09:37:08.976019+0000","last_became_peered":"2024-09-19T09:37:08.976019+0000","last_unstale":"2024-09-19T09:37:28.018040+0000","last_undegraded":"2024-09-19T09:37:28.018040+0000","last_fullsized":"2024-09-19T09:37:28.018040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:34.401585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017783+0000","last_change":"2024-09-19T09:37:10.954000+0000","last_active":"2024-09-19T09:37:28.017783+0000","last_peered":"2024-09-19T09:37:28.017783+0000","last_clean":"2024-09-19T09:37:28.017783+0000","last_became_active":"2024-09-19T09:37:10.953709+0000","last_became_peered":"2024-09-19T09:37:10.953709+0000","last_unstale":"2024-09-19T09:37:28.017783+0000","last_undegraded":"2024-09-19T09:37:28.017783+0000","last_fullsized":"2024-09-19T09:37:28.017783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:36.779680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:33.026348+0000","last_change":"2024-09-19T09:37:28.036392+0000","last_active":"2024-09-19T09:37:33.026348+0000","last_peered":"2024-09-19T09:37:33.026348+0000","last_clean":"2024-09-19T09:37:33.026348+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:37:33.026348+0000","last_undegraded":"2024-09-19T09:37:33.026348+0000","last_fullsized":"2024-09-19T09:37:33.026348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:56.344807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56811,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":137,"num_read_kb":129,"num_write":235,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":28789,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":170433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612625,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":437286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841556,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1593344,"data_stored":1078311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1030507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659177,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":437326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888109,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051635,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":487960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280567,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476797,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":436896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607618,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":488514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":933888,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":52420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:37:37.871 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:37:37.872 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T09:37:37.872 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T09:37:38.130 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:38.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:38 smithi042 ceph-mon[31223]: pgmap v286: 97 pgs: 97 active+clean; 632 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.3 KiB/s wr, 12 op/s; 3.0 KiB/s, 2 objects/s recovering 2024-09-19T09:37:38.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:38 smithi042 ceph-mon[31223]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:38.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:38 smithi171 ceph-mon[35803]: pgmap v286: 97 pgs: 97 active+clean; 632 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.3 KiB/s wr, 12 op/s; 3.0 KiB/s, 2 objects/s recovering 2024-09-19T09:37:38.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:38 smithi171 ceph-mon[35803]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:38.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:38 smithi136 ceph-mon[34840]: pgmap v286: 97 pgs: 97 active+clean; 632 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.3 KiB/s wr, 12 op/s; 3.0 KiB/s, 2 objects/s recovering 2024-09-19T09:37:38.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:38 smithi136 ceph-mon[34840]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.572+0000 7ffb66eb8640 1 -- 172.21.15.42:0/1799417352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb60100d60 msgr2=0x7ffb601011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.572+0000 7ffb66eb8640 1 --2- 172.21.15.42:0/1799417352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb60100d60 0x7ffb601011e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009900 tx=0x7ffb4c02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.572+0000 7ffb66eb8640 1 -- 172.21.15.42:0/1799417352 shutdown_connections 2024-09-19T09:37:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.572+0000 7ffb66eb8640 1 --2- 172.21.15.42:0/1799417352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb60101720 0x7ffb60108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.572+0000 7ffb66eb8640 1 --2- 172.21.15.42:0/1799417352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb60100d60 0x7ffb601011e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.572+0000 7ffb66eb8640 1 --2- 172.21.15.42:0/1799417352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb60102100 0x7ffb60102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.572+0000 7ffb66eb8640 1 -- 172.21.15.42:0/1799417352 >> 172.21.15.42:0/1799417352 conn(0x7ffb600fba40 msgr2=0x7ffb600fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.572+0000 7ffb66eb8640 1 -- 172.21.15.42:0/1799417352 shutdown_connections 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.572+0000 7ffb66eb8640 1 -- 172.21.15.42:0/1799417352 wait complete. 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb66eb8640 1 Processor -- start 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb66eb8640 1 -- start start 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb66eb8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb60100d60 0x7ffb6010b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb66eb8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb60101720 0x7ffb60109af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb66eb8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb60102100 0x7ffb6010a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb66eb8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6010d960 con 0x7ffb60100d60 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb66eb8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6010d7e0 con 0x7ffb60101720 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb66eb8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6010dae0 con 0x7ffb60102100 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb64c54640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb60100d60 0x7ffb6010b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb64c54640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb60100d60 0x7ffb6010b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59688/0 (socket says 172.21.15.42:59688) 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb64c54640 1 -- 172.21.15.42:0/3242878283 learned_addr learned my addr 172.21.15.42:0/3242878283 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb5ffff640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb60101720 0x7ffb60109af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb65455640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb60102100 0x7ffb6010a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb64c54640 1 -- 172.21.15.42:0/3242878283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb60102100 msgr2=0x7ffb6010a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb64c54640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb60102100 0x7ffb6010a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb64c54640 1 -- 172.21.15.42:0/3242878283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb60101720 msgr2=0x7ffb60109af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb64c54640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb60101720 0x7ffb60109af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.573+0000 7ffb64c54640 1 -- 172.21.15.42:0/3242878283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6010a8f0 con 0x7ffb60100d60 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.574+0000 7ffb64c54640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb60100d60 0x7ffb6010b4a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400b450 tx=0x7ffb5400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.574+0000 7ffb5dffb640 1 -- 172.21.15.42:0/3242878283 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54015020 con 0x7ffb60100d60 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.574+0000 7ffb66eb8640 1 -- 172.21.15.42:0/3242878283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb601a2150 con 0x7ffb60100d60 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.574+0000 7ffb5dffb640 1 -- 172.21.15.42:0/3242878283 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb54011d70 con 0x7ffb60100d60 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.574+0000 7ffb5dffb640 1 -- 172.21.15.42:0/3242878283 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400f340 con 0x7ffb60100d60 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.574+0000 7ffb66eb8640 1 -- 172.21.15.42:0/3242878283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb601a26e0 con 0x7ffb60100d60 2024-09-19T09:37:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.575+0000 7ffb66eb8640 1 -- 172.21.15.42:0/3242878283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb60107f60 con 0x7ffb60100d60 2024-09-19T09:37:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.576+0000 7ffb5dffb640 1 -- 172.21.15.42:0/3242878283 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffb54018020 con 0x7ffb60100d60 2024-09-19T09:37:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.577+0000 7ffb5dffb640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a32d0 0x7ffb500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.577+0000 7ffb5ffff640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a32d0 0x7ffb500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.577+0000 7ffb5dffb640 1 -- 172.21.15.42:0/3242878283 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ffb540cf520 con 0x7ffb60100d60 2024-09-19T09:37:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.577+0000 7ffb5ffff640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a32d0 0x7ffb500a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c02aa00 tx=0x7ffb4c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.581+0000 7ffb5dffb640 1 -- 172.21.15.42:0/3242878283 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb5401f020 con 0x7ffb60100d60 2024-09-19T09:37:38.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.821+0000 7ffb66eb8640 1 -- 172.21.15.42:0/3242878283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ffb6002d7c0 con 0x7ffb60100d60 2024-09-19T09:37:38.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.824+0000 7ffb5dffb640 1 -- 172.21.15.42:0/3242878283 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7ffb5400d040 con 0x7ffb60100d60 2024-09-19T09:37:38.825 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-19T09:37:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDi8OtmXa4QMRAA1tZULiKmOIjhnde8kIZsnA== 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 -- 172.21.15.42:0/3242878283 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a32d0 msgr2=0x7ffb500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a32d0 0x7ffb500a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c02aa00 tx=0x7ffb4c031400 comp rx=0 tx=0).stop 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 -- 172.21.15.42:0/3242878283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb60100d60 msgr2=0x7ffb6010b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb60100d60 0x7ffb6010b4a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400b450 tx=0x7ffb5400b910 comp rx=0 tx=0).stop 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 -- 172.21.15.42:0/3242878283 shutdown_connections 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a32d0 0x7ffb500a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb60102100 0x7ffb6010a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb60101720 0x7ffb60109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 --2- 172.21.15.42:0/3242878283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb60100d60 0x7ffb6010b4a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 -- 172.21.15.42:0/3242878283 >> 172.21.15.42:0/3242878283 conn(0x7ffb600fba40 msgr2=0x7ffb60105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 -- 172.21.15.42:0/3242878283 shutdown_connections 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:38.826+0000 7ffb66eb8640 1 -- 172.21.15.42:0/3242878283 wait complete. 2024-09-19T09:37:39.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:39 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3242878283' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:37:39.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:39 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3242878283' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:37:39.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:39 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3242878283' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:37:39.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:39 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3242878283' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:37:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:39 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3242878283' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:37:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:39 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3242878283' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:37:39.527 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:37:39.527 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T09:37:39.527 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T09:37:39.567 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T09:37:39.567 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T09:37:39.567 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T09:37:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:40.273 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:40 smithi042 ceph-mon[31223]: pgmap v287: 97 pgs: 97 active+clean; 636 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 13 op/s; 2.7 KiB/s, 1 objects/s recovering 2024-09-19T09:37:40.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:40 smithi171 ceph-mon[35803]: pgmap v287: 97 pgs: 97 active+clean; 636 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 13 op/s; 2.7 KiB/s, 1 objects/s recovering 2024-09-19T09:37:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:40 smithi136 ceph-mon[34840]: pgmap v287: 97 pgs: 97 active+clean; 636 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 13 op/s; 2.7 KiB/s, 1 objects/s recovering 2024-09-19T09:37:40.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.354+0000 7f1622102640 1 -- 172.21.15.42:0/1190521811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f161c10c170 msgr2=0x7f161c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:40.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.354+0000 7f1622102640 1 --2- 172.21.15.42:0/1190521811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f161c10c170 0x7f161c10e610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1614009ca0 tx=0x7f161402a950 comp rx=0 tx=0).stop 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.354+0000 7f1622102640 1 -- 172.21.15.42:0/1190521811 shutdown_connections 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.354+0000 7f1622102640 1 --2- 172.21.15.42:0/1190521811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f161c10c170 0x7f161c10e610 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.354+0000 7f1622102640 1 --2- 172.21.15.42:0/1190521811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f161c103660 0x7f161c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.354+0000 7f1622102640 1 --2- 172.21.15.42:0/1190521811 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f161c102d40 0x7f161c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.354+0000 7f1622102640 1 -- 172.21.15.42:0/1190521811 >> 172.21.15.42:0/1190521811 conn(0x7f161c0fc7a0 msgr2=0x7f161c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.354+0000 7f1622102640 1 -- 172.21.15.42:0/1190521811 shutdown_connections 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.354+0000 7f1622102640 1 -- 172.21.15.42:0/1190521811 wait complete. 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f1622102640 1 Processor -- start 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f1622102640 1 -- start start 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f1622102640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f161c102d40 0x7f161c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f1622102640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f161c103660 0x7f161c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:40.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f1622102640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f161c10c170 0x7f161c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f1622102640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f161c111fb0 con 0x7f161c10c170 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f1622102640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f161c111e30 con 0x7f161c102d40 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f1622102640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f161c112130 con 0x7f161c103660 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f161bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f161c10c170 0x7f161c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f161bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f161c10c170 0x7f161c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56854/0 (socket says 172.21.15.42:56854) 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f161bfff640 1 -- 172.21.15.42:0/1279968971 learned_addr learned my addr 172.21.15.42:0/1279968971 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f161affd640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f161c103660 0x7f161c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.355+0000 7f161b7fe640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f161c102d40 0x7f161c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f161bfff640 1 -- 172.21.15.42:0/1279968971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f161c103660 msgr2=0x7f161c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f161bfff640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f161c103660 0x7f161c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f161bfff640 1 -- 172.21.15.42:0/1279968971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f161c102d40 msgr2=0x7f161c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:40.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f161bfff640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f161c102d40 0x7f161c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f161bfff640 1 -- 172.21.15.42:0/1279968971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161c19d380 con 0x7f161c10c170 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f161b7fe640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f161c102d40 0x7f161c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f161bfff640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f161c10c170 0x7f161c19cca0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1614006010 tx=0x7f161402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f1618ff9640 1 -- 172.21.15.42:0/1279968971 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614034040 con 0x7f161c10c170 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f1622102640 1 -- 172.21.15.42:0/1279968971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161c19d610 con 0x7f161c10c170 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f1618ff9640 1 -- 172.21.15.42:0/1279968971 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1614003e00 con 0x7f161c10c170 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f1618ff9640 1 -- 172.21.15.42:0/1279968971 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16140456e0 con 0x7f161c10c170 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.356+0000 7f1622102640 1 -- 172.21.15.42:0/1279968971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f161c1a4f50 con 0x7f161c10c170 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.357+0000 7f1622102640 1 -- 172.21.15.42:0/1279968971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f161c103120 con 0x7f161c10c170 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.358+0000 7f1618ff9640 1 -- 172.21.15.42:0/1279968971 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1614037020 con 0x7f161c10c170 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.359+0000 7f1618ff9640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f16040a32d0 0x7f16040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.359+0000 7f161b7fe640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f16040a32d0 0x7f16040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:40.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.359+0000 7f1618ff9640 1 -- 172.21.15.42:0/1279968971 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f16140f0b80 con 0x7f161c10c170 2024-09-19T09:37:40.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.359+0000 7f161b7fe640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f16040a32d0 0x7f16040a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f160c00baa0 tx=0x7f160c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:40.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.363+0000 7f1618ff9640 1 -- 172.21.15.42:0/1279968971 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f16140bd7d0 con 0x7f161c10c170 2024-09-19T09:37:40.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.587+0000 7f1622102640 1 -- 172.21.15.42:0/1279968971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f161c1a5150 con 0x7f161c10c170 2024-09-19T09:37:40.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.593+0000 7f1618ff9640 1 -- 172.21.15.42:0/1279968971 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264042 (secure 0 0 0) 0x7f16140bd0d0 con 0x7f161c10c170 2024-09-19T09:37:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:40.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 -- 172.21.15.42:0/1279968971 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f16040a32d0 msgr2=0x7f16040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f16040a32d0 0x7f16040a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f160c00baa0 tx=0x7f160c005d90 comp rx=0 tx=0).stop 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 -- 172.21.15.42:0/1279968971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f161c10c170 msgr2=0x7f161c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f161c10c170 0x7f161c19cca0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1614006010 tx=0x7f161402f710 comp rx=0 tx=0).stop 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 -- 172.21.15.42:0/1279968971 shutdown_connections 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f16040a32d0 0x7f16040a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f161c10c170 0x7f161c19cca0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f161c103660 0x7f161c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 --2- 172.21.15.42:0/1279968971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f161c102d40 0x7f161c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 -- 172.21.15.42:0/1279968971 >> 172.21.15.42:0/1279968971 conn(0x7f161c0fc7a0 msgr2=0x7f161c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 -- 172.21.15.42:0/1279968971 shutdown_connections 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:40.596+0000 7f1622102640 1 -- 172.21.15.42:0/1279968971 wait complete. 2024-09-19T09:37:41.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:41 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1279968971' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:37:41.317 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":117232266},{"type":"v1","addr":"172.21.15.42:6801","nonce":117232266}]},"active_addr":"172.21.15.42:6801/117232266","active_change":"2024-09-19T09:30:26.412429+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.42:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3093687184}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3241260732}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":49813489}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":70909531}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":216491978}]}]} 2024-09-19T09:37:41.323 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T09:37:41.323 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T09:37:41.323 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:37:41.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:41 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1279968971' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:37:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:41 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1279968971' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:37:41.581 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:42.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.994+0000 7f259e59f640 1 -- 172.21.15.42:0/779387004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2598102ef0 msgr2=0x7f259810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.994+0000 7f259e59f640 1 --2- 172.21.15.42:0/779387004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2598102ef0 0x7f259810da40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2590009ca0 tx=0x7f259002a950 comp rx=0 tx=0).stop 2024-09-19T09:37:42.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.994+0000 7f259e59f640 1 -- 172.21.15.42:0/779387004 shutdown_connections 2024-09-19T09:37:42.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.994+0000 7f259e59f640 1 --2- 172.21.15.42:0/779387004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2598102ef0 0x7f259810da40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.994+0000 7f259e59f640 1 --2- 172.21.15.42:0/779387004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2598102570 0x7f25981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.994+0000 7f259e59f640 1 --2- 172.21.15.42:0/779387004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2598100e20 0x7f2598101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.994+0000 7f259e59f640 1 -- 172.21.15.42:0/779387004 >> 172.21.15.42:0/779387004 conn(0x7f25980fc7d0 msgr2=0x7f25980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:42.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.994+0000 7f259e59f640 1 -- 172.21.15.42:0/779387004 shutdown_connections 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.994+0000 7f259e59f640 1 -- 172.21.15.42:0/779387004 wait complete. 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259e59f640 1 Processor -- start 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259e59f640 1 -- start start 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259e59f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2598100e20 0x7f25981983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259e59f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2598102570 0x7f2598198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259e59f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2598102ef0 0x7f259819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259e59f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2598110fd0 con 0x7f2598102ef0 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259e59f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2598110e50 con 0x7f2598100e20 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259e59f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2598111150 con 0x7f2598102570 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259cb3c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2598102ef0 0x7f259819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259cb3c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2598102ef0 0x7f259819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56878/0 (socket says 172.21.15.42:56878) 2024-09-19T09:37:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259cb3c640 1 -- 172.21.15.42:0/2014257671 learned_addr learned my addr 172.21.15.42:0/2014257671 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f258ffff640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2598102570 0x7f2598198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259cb3c640 1 -- 172.21.15.42:0/2014257671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2598102570 msgr2=0x7f2598198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f2597fff640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2598100e20 0x7f25981983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259cb3c640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2598102570 0x7f2598198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259cb3c640 1 -- 172.21.15.42:0/2014257671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2598100e20 msgr2=0x7f25981983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259cb3c640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2598100e20 0x7f25981983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.995+0000 7f259cb3c640 1 -- 172.21.15.42:0/2014257671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259819d390 con 0x7f2598102ef0 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.996+0000 7f259cb3c640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2598102ef0 0x7f259819ccb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2590009dc0 tx=0x7f2590003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.996+0000 7f2595ffb640 1 -- 172.21.15.42:0/2014257671 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590034040 con 0x7f2598102ef0 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.996+0000 7f2595ffb640 1 -- 172.21.15.42:0/2014257671 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f259002fe10 con 0x7f2598102ef0 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.996+0000 7f259e59f640 1 -- 172.21.15.42:0/2014257671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259819d620 con 0x7f2598102ef0 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.996+0000 7f2595ffb640 1 -- 172.21.15.42:0/2014257671 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25900047b0 con 0x7f2598102ef0 2024-09-19T09:37:42.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.996+0000 7f259e59f640 1 -- 172.21.15.42:0/2014257671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25981a4f60 con 0x7f2598102ef0 2024-09-19T09:37:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.997+0000 7f259e59f640 1 -- 172.21.15.42:0/2014257671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2598101200 con 0x7f2598102ef0 2024-09-19T09:37:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.998+0000 7f2595ffb640 1 -- 172.21.15.42:0/2014257671 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2590037020 con 0x7f2598102ef0 2024-09-19T09:37:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.999+0000 7f2595ffb640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f25840a3350 0x7f25840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.999+0000 7f2597fff640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f25840a3350 0x7f25840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.999+0000 7f2595ffb640 1 -- 172.21.15.42:0/2014257671 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f25900f09a0 con 0x7f2598102ef0 2024-09-19T09:37:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:41.999+0000 7f2597fff640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f25840a3350 0x7f25840a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2588005fd0 tx=0x7f2588005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.003+0000 7f2595ffb640 1 -- 172.21.15.42:0/2014257671 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25900bd5f0 con 0x7f2598102ef0 2024-09-19T09:37:42.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.183+0000 7f259e59f640 1 -- 172.21.15.42:0/2014257671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25981a5130 con 0x7f2598102ef0 2024-09-19T09:37:42.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.184+0000 7f2595ffb640 1 -- 172.21.15.42:0/2014257671 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22852 (secure 0 0 0) 0x7f25900bcef0 con 0x7f2598102ef0 2024-09-19T09:37:42.186 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:42.186 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:28.010101+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:37:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 -- 172.21.15.42:0/2014257671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f25840a3350 msgr2=0x7f25840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f25840a3350 0x7f25840a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2588005fd0 tx=0x7f2588005c70 comp rx=0 tx=0).stop 2024-09-19T09:37:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 -- 172.21.15.42:0/2014257671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2598102ef0 msgr2=0x7f259819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2598102ef0 0x7f259819ccb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2590009dc0 tx=0x7f2590003d00 comp rx=0 tx=0).stop 2024-09-19T09:37:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 -- 172.21.15.42:0/2014257671 shutdown_connections 2024-09-19T09:37:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f25840a3350 0x7f25840a5810 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2598102ef0 0x7f259819ccb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2598102570 0x7f2598198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 --2- 172.21.15.42:0/2014257671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2598100e20 0x7f25981983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 -- 172.21.15.42:0/2014257671 >> 172.21.15.42:0/2014257671 conn(0x7f25980fc7d0 msgr2=0x7f259806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:42.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 -- 172.21.15.42:0/2014257671 shutdown_connections 2024-09-19T09:37:42.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:42.186+0000 7f259e59f640 1 -- 172.21.15.42:0/2014257671 wait complete. 2024-09-19T09:37:42.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:42 smithi171 ceph-mon[35803]: pgmap v288: 97 pgs: 97 active+clean; 636 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 10 op/s; 153 B/s, 0 objects/s recovering 2024-09-19T09:37:42.757 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:42 smithi042 ceph-mon[31223]: pgmap v288: 97 pgs: 97 active+clean; 636 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 10 op/s; 153 B/s, 0 objects/s recovering 2024-09-19T09:37:42.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:42 smithi136 ceph-mon[34840]: pgmap v288: 97 pgs: 97 active+clean; 636 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 10 op/s; 153 B/s, 0 objects/s recovering 2024-09-19T09:37:42.945 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T09:37:42.945 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:37:43.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:43 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2014257671' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:43.209 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:43.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:43 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2014257671' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:43.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:43 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2014257671' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:43.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.660+0000 7fa0b6322640 1 -- 172.21.15.42:0/25142854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b0102d40 msgr2=0x7fa0b0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:43.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.660+0000 7fa0b6322640 1 --2- 172.21.15.42:0/25142854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b0102d40 0x7fa0b0103120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009900 tx=0x7fa0a002a480 comp rx=0 tx=0).stop 2024-09-19T09:37:43.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.660+0000 7fa0b6322640 1 -- 172.21.15.42:0/25142854 shutdown_connections 2024-09-19T09:37:43.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.660+0000 7fa0b6322640 1 --2- 172.21.15.42:0/25142854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b010c170 0x7fa0b010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.660+0000 7fa0b6322640 1 --2- 172.21.15.42:0/25142854 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0b0103660 0x7fa0b010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.660+0000 7fa0b6322640 1 --2- 172.21.15.42:0/25142854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b0102d40 0x7fa0b0103120 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.660+0000 7fa0b6322640 1 -- 172.21.15.42:0/25142854 >> 172.21.15.42:0/25142854 conn(0x7fa0b00fc7a0 msgr2=0x7fa0b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:43.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.660+0000 7fa0b6322640 1 -- 172.21.15.42:0/25142854 shutdown_connections 2024-09-19T09:37:43.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.660+0000 7fa0b6322640 1 -- 172.21.15.42:0/25142854 wait complete. 2024-09-19T09:37:43.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.661+0000 7fa0b6322640 1 Processor -- start 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.661+0000 7fa0b6322640 1 -- start start 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.661+0000 7fa0b6322640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b0102d40 0x7fa0b019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.661+0000 7fa0b6322640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b0103660 0x7fa0b019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.661+0000 7fa0b6322640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0b010c170 0x7fa0b019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.661+0000 7fa0b6322640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b0111fb0 con 0x7fa0b0102d40 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.661+0000 7fa0b6322640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b0111e30 con 0x7fa0b010c170 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.661+0000 7fa0b6322640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b0112130 con 0x7fa0b0103660 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0affff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b0102d40 0x7fa0b019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0affff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b0102d40 0x7fa0b019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56896/0 (socket says 172.21.15.42:56896) 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0affff640 1 -- 172.21.15.42:0/1719496673 learned_addr learned my addr 172.21.15.42:0/1719496673 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:43.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0b48bf640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0b010c170 0x7fa0b019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0af7fe640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b0103660 0x7fa0b019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0affff640 1 -- 172.21.15.42:0/1719496673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b0103660 msgr2=0x7fa0b019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0affff640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b0103660 0x7fa0b019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0affff640 1 -- 172.21.15.42:0/1719496673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0b010c170 msgr2=0x7fa0b019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0affff640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0b010c170 0x7fa0b019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0affff640 1 -- 172.21.15.42:0/1719496673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b019f5d0 con 0x7fa0b0102d40 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0b48bf640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0b010c170 0x7fa0b019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0af7fe640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b0103660 0x7fa0b019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0affff640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b0102d40 0x7fa0b019a620 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0005ab0 tx=0x7fa0a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0ad7fa640 1 -- 172.21.15.42:0/1719496673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a003f030 con 0x7fa0b0102d40 2024-09-19T09:37:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0b6322640 1 -- 172.21.15.42:0/1719496673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b019f860 con 0x7fa0b0102d40 2024-09-19T09:37:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0ad7fa640 1 -- 172.21.15.42:0/1719496673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0a0003ce0 con 0x7fa0b0102d40 2024-09-19T09:37:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0ad7fa640 1 -- 172.21.15.42:0/1719496673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0035070 con 0x7fa0b0102d40 2024-09-19T09:37:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.662+0000 7fa0b6322640 1 -- 172.21.15.42:0/1719496673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b01a71a0 con 0x7fa0b0102d40 2024-09-19T09:37:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.663+0000 7fa0b6322640 1 -- 172.21.15.42:0/1719496673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b006b070 con 0x7fa0b0102d40 2024-09-19T09:37:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.665+0000 7fa0ad7fa640 1 -- 172.21.15.42:0/1719496673 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa0a0042030 con 0x7fa0b0102d40 2024-09-19T09:37:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.665+0000 7fa0ad7fa640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0980a32d0 0x7fa0980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.665+0000 7fa0af7fe640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0980a32d0 0x7fa0980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.665+0000 7fa0ad7fa640 1 -- 172.21.15.42:0/1719496673 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa0a00f0460 con 0x7fa0b0102d40 2024-09-19T09:37:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.666+0000 7fa0af7fe640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0980a32d0 0x7fa0980a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa0b010ea60 tx=0x7fa0a4005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:43.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.670+0000 7fa0ad7fa640 1 -- 172.21.15.42:0/1719496673 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa0a00bd000 con 0x7fa0b0102d40 2024-09-19T09:37:43.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.847+0000 7fa0b6322640 1 -- 172.21.15.42:0/1719496673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0b01a73c0 con 0x7fa0b0102d40 2024-09-19T09:37:43.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.849+0000 7fa0ad7fa640 1 -- 172.21.15.42:0/1719496673 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22852 (secure 0 0 0) 0x7fa0a00bc900 con 0x7fa0b0102d40 2024-09-19T09:37:43.851 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:37:43.851 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:28.010101+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:37:43.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 -- 172.21.15.42:0/1719496673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0980a32d0 msgr2=0x7fa0980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0980a32d0 0x7fa0980a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa0b010ea60 tx=0x7fa0a4005e30 comp rx=0 tx=0).stop 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 -- 172.21.15.42:0/1719496673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b0102d40 msgr2=0x7fa0b019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b0102d40 0x7fa0b019a620 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0005ab0 tx=0x7fa0a00042f0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 -- 172.21.15.42:0/1719496673 shutdown_connections 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0980a32d0 0x7fa0980a5790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0b010c170 0x7fa0b019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b0103660 0x7fa0b019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 --2- 172.21.15.42:0/1719496673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b0102d40 0x7fa0b019a620 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 -- 172.21.15.42:0/1719496673 >> 172.21.15.42:0/1719496673 conn(0x7fa0b00fc7a0 msgr2=0x7fa0b010d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 -- 172.21.15.42:0/1719496673 shutdown_connections 2024-09-19T09:37:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:43.852+0000 7fa0b6322640 1 -- 172.21.15.42:0/1719496673 wait complete. 2024-09-19T09:37:44.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:44 smithi042 ceph-mon[31223]: pgmap v289: 97 pgs: 97 active+clean; 636 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T09:37:44.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:44 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1719496673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:44.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:44 smithi171 ceph-mon[35803]: pgmap v289: 97 pgs: 97 active+clean; 636 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T09:37:44.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:44 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1719496673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:44.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:44 smithi136 ceph-mon[34840]: pgmap v289: 97 pgs: 97 active+clean; 636 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T09:37:44.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:44 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1719496673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:44.599 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T09:37:44.600 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T09:37:44.600 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T09:37:44.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T09:37:44.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T09:37:44.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T09:37:44.602 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T09:37:44.602 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T09:37:44.603 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T09:37:44.603 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T09:37:44.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T09:37:44.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T09:37:45.293 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:45.294 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.794+0000 7fdcff10a640 1 -- 172.21.15.42:0/699068744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdcf81008d0 msgr2=0x7fdcf8100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.794+0000 7fdcff10a640 1 --2- 172.21.15.42:0/699068744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdcf81008d0 0x7fdcf8100cb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009900 tx=0x7fdcec02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.794+0000 7fdcff10a640 1 -- 172.21.15.42:0/699068744 shutdown_connections 2024-09-19T09:37:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.794+0000 7fdcff10a640 1 --2- 172.21.15.42:0/699068744 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf810e480 0x7fdcf8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.794+0000 7fdcff10a640 1 --2- 172.21.15.42:0/699068744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf8101280 0x7fdcf810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.794+0000 7fdcff10a640 1 --2- 172.21.15.42:0/699068744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdcf81008d0 0x7fdcf8100cb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.794+0000 7fdcff10a640 1 -- 172.21.15.42:0/699068744 >> 172.21.15.42:0/699068744 conn(0x7fdcf80fc7a0 msgr2=0x7fdcf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.794+0000 7fdcff10a640 1 -- 172.21.15.42:0/699068744 shutdown_connections 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.794+0000 7fdcff10a640 1 -- 172.21.15.42:0/699068744 wait complete. 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcff10a640 1 Processor -- start 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcff10a640 1 -- start start 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcff10a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdcf81008d0 0x7fdcf81a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcff10a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf8101280 0x7fdcf81a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcff10a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf810e480 0x7fdcf819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcff10a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf8114260 con 0x7fdcf81008d0 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcff10a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81140e0 con 0x7fdcf810e480 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcff10a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81143e0 con 0x7fdcf8101280 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcfcea6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdcf81008d0 0x7fdcf81a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcfcea6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdcf81008d0 0x7fdcf81a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56924/0 (socket says 172.21.15.42:56924) 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcfcea6640 1 -- 172.21.15.42:0/3947587693 learned_addr learned my addr 172.21.15.42:0/3947587693 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcf7fff640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf8101280 0x7fdcf81a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcfd6a7640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf810e480 0x7fdcf819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcfcea6640 1 -- 172.21.15.42:0/3947587693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf8101280 msgr2=0x7fdcf81a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcfcea6640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf8101280 0x7fdcf81a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcfcea6640 1 -- 172.21.15.42:0/3947587693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf810e480 msgr2=0x7fdcf819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcfcea6640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcf810e480 0x7fdcf819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.795+0000 7fdcfcea6640 1 -- 172.21.15.42:0/3947587693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf819aec0 con 0x7fdcf81008d0 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.796+0000 7fdcfcea6640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdcf81008d0 0x7fdcf81a0580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdcec031550 tx=0x7fdcec004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.796+0000 7fdcf5ffb640 1 -- 172.21.15.42:0/3947587693 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec03f030 con 0x7fdcf81008d0 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.796+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf819b150 con 0x7fdcf81008d0 2024-09-19T09:37:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.796+0000 7fdcf5ffb640 1 -- 172.21.15.42:0/3947587693 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcec003ce0 con 0x7fdcf81008d0 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.796+0000 7fdcf5ffb640 1 -- 172.21.15.42:0/3947587693 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec035070 con 0x7fdcf81008d0 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.796+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf81a7330 con 0x7fdcf81008d0 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.797+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdcf80628c0 con 0x7fdcf81008d0 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.798+0000 7fdcf5ffb640 1 -- 172.21.15.42:0/3947587693 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdcec042030 con 0x7fdcf81008d0 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.799+0000 7fdcf5ffb640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdce80a32d0 0x7fdce80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.799+0000 7fdcf7fff640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdce80a32d0 0x7fdce80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.799+0000 7fdcf5ffb640 1 -- 172.21.15.42:0/3947587693 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fdcec0f0760 con 0x7fdcf81008d0 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.799+0000 7fdcf5ffb640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] conn(0x7fdce80acf80 0x7fdce80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.799+0000 7fdcf5ffb640 1 -- 172.21.15.42:0/3947587693 --> [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcec03ce50 con 0x7fdce80acf80 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.799+0000 7fdcf5ffb640 1 -- 172.21.15.42:0/3947587693 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fdcec0f0b10 con 0x7fdcf81008d0 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.799+0000 7fdcfd6a7640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] conn(0x7fdce80acf80 0x7fdce80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.799+0000 7fdcf7fff640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdce80a32d0 0x7fdce80a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdcf819bea0 tx=0x7fdce4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.800+0000 7fdcfd6a7640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] conn(0x7fdce80acf80 0x7fdce80af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.800+0000 7fdcf5ffb640 1 -- 172.21.15.42:0/3947587693 <== osd.0 v2:172.21.15.42:6802/2566861265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdcec03ce50 con 0x7fdce80acf80 2024-09-19T09:37:45.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.814+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 --> [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdcf8062d40 con 0x7fdce80acf80 2024-09-19T09:37:45.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.814+0000 7fdcf5ffb640 1 -- 172.21.15.42:0/3947587693 <== osd.0 v2:172.21.15.42:6802/2566861265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdcf8062d40 con 0x7fdce80acf80 2024-09-19T09:37:45.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.814+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] conn(0x7fdce80acf80 msgr2=0x7fdce80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.814+0000 7fdcff10a640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] conn(0x7fdce80acf80 0x7fdce80af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.814+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdce80a32d0 msgr2=0x7fdce80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.814+0000 7fdcff10a640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdce80a32d0 0x7fdce80a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdcf819bea0 tx=0x7fdce4009110 comp rx=0 tx=0).stop 2024-09-19T09:37:45.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.814+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdcf81008d0 msgr2=0x7fdcf81a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.814+0000 7fdcff10a640 1 --2- 172.21.15.42:0/3947587693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdcf81008d0 0x7fdcf81a0580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdcec031550 tx=0x7fdcec004360 comp rx=0 tx=0).stop 2024-09-19T09:37:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.814+0000 7fdcfd6a7640 1 -- 172.21.15.42:0/3947587693 reap_dead start 2024-09-19T09:37:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.815+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 shutdown_connections 2024-09-19T09:37:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.815+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 >> 172.21.15.42:0/3947587693 conn(0x7fdcf80fc7a0 msgr2=0x7fdcf80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.815+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 shutdown_connections 2024-09-19T09:37:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:45.815+0000 7fdcff10a640 1 -- 172.21.15.42:0/3947587693 wait complete. 2024-09-19T09:37:46.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:46 smithi171 ceph-mon[35803]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-19T09:37:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:46 smithi136 ceph-mon[34840]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-19T09:37:46.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:46 smithi042 ceph-mon[31223]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-19T09:37:46.557 INFO:teuthology.orchestra.run.smithi042.stdout:34359738442 2024-09-19T09:37:46.558 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T09:37:46.605 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:46.610 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:46.610 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:46.610 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:46.613 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:46.620 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:46.640 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:46.644 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.177+0000 7f1b79876640 1 -- 172.21.15.42:0/2638901108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74101de0 msgr2=0x7f1b741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.177+0000 7f1b79876640 1 --2- 172.21.15.42:0/2638901108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74101de0 0x7f1b741021c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009900 tx=0x7f1b6402a410 comp rx=0 tx=0).stop 2024-09-19T09:37:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.177+0000 7f1b79876640 1 -- 172.21.15.42:0/2638901108 shutdown_connections 2024-09-19T09:37:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.177+0000 7f1b79876640 1 --2- 172.21.15.42:0/2638901108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b74106f10 0x7f1b7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.177+0000 7f1b79876640 1 --2- 172.21.15.42:0/2638901108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b74102790 0x7f1b741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.177+0000 7f1b79876640 1 --2- 172.21.15.42:0/2638901108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74101de0 0x7f1b741021c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.177+0000 7f1b79876640 1 -- 172.21.15.42:0/2638901108 >> 172.21.15.42:0/2638901108 conn(0x7f1b740fd8c0 msgr2=0x7f1b740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.177+0000 7f1b79876640 1 -- 172.21.15.42:0/2638901108 shutdown_connections 2024-09-19T09:37:47.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.177+0000 7f1b79876640 1 -- 172.21.15.42:0/2638901108 wait complete. 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b79876640 1 Processor -- start 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b79876640 1 -- start start 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b79876640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b74101de0 0x7f1b7419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b79876640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b74102790 0x7f1b7419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b79876640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74106f10 0x7f1b7419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b79876640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74111f70 con 0x7f1b74106f10 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b79876640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74111df0 con 0x7f1b74102790 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b79876640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1b741120f0 con 0x7f1b74101de0 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b737fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74106f10 0x7f1b7419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b737fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74106f10 0x7f1b7419eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56942/0 (socket says 172.21.15.42:56942) 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.178+0000 7f1b737fe640 1 -- 172.21.15.42:0/800357846 learned_addr learned my addr 172.21.15.42:0/800357846 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b727fc640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b74102790 0x7f1b7419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b72ffd640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b74101de0 0x7f1b7419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b737fe640 1 -- 172.21.15.42:0/800357846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b74101de0 msgr2=0x7f1b7419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b737fe640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b74101de0 0x7f1b7419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b737fe640 1 -- 172.21.15.42:0/800357846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b74102790 msgr2=0x7f1b7419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b737fe640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b74102790 0x7f1b7419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b737fe640 1 -- 172.21.15.42:0/800357846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7419f590 con 0x7f1b74106f10 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b737fe640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74106f10 0x7f1b7419eeb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00cce0 tx=0x7f1b6c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b78874640 1 -- 172.21.15.42:0/800357846 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00f450 con 0x7f1b74106f10 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b78874640 1 -- 172.21.15.42:0/800357846 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b6c00fad0 con 0x7f1b74106f10 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7419f880 con 0x7f1b74106f10 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b78874640 1 -- 172.21.15.42:0/800357846 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c018c10 con 0x7f1b74106f10 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.179+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b741a7160 con 0x7f1b74106f10 2024-09-19T09:37:47.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.180+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b74075780 con 0x7f1b74106f10 2024-09-19T09:37:47.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.181+0000 7f1b78874640 1 -- 172.21.15.42:0/800357846 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1b6c00f5f0 con 0x7f1b74106f10 2024-09-19T09:37:47.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.182+0000 7f1b78874640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1b5c0a32d0 0x7f1b5c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.182+0000 7f1b72ffd640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1b5c0a32d0 0x7f1b5c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.182+0000 7f1b78874640 1 -- 172.21.15.42:0/800357846 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f1b6c0d0430 con 0x7f1b74106f10 2024-09-19T09:37:47.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.182+0000 7f1b78874640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] conn(0x7f1b5c0acf80 0x7f1b5c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.182+0000 7f1b78874640 1 -- 172.21.15.42:0/800357846 --> [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b6c015e70 con 0x7f1b5c0acf80 2024-09-19T09:37:47.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.182+0000 7f1b78874640 1 -- 172.21.15.42:0/800357846 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f1b6c0d0880 con 0x7f1b74106f10 2024-09-19T09:37:47.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.183+0000 7f1b72ffd640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1b5c0a32d0 0x7f1b5c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1b640096c0 tx=0x7f1b64000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.183+0000 7f1b727fc640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] conn(0x7f1b5c0acf80 0x7f1b5c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.183+0000 7f1b727fc640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] conn(0x7f1b5c0acf80 0x7f1b5c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.184+0000 7f1b78874640 1 -- 172.21.15.42:0/800357846 <== osd.1 v2:172.21.15.136:6800/2317267026 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b6c015e70 con 0x7f1b5c0acf80 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.198+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 --> [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1b741032c0 con 0x7f1b5c0acf80 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.198+0000 7f1b78874640 1 -- 172.21.15.42:0/800357846 <== osd.1 v2:172.21.15.136:6800/2317267026 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1b741032c0 con 0x7f1b5c0acf80 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.198+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 >> [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] conn(0x7f1b5c0acf80 msgr2=0x7f1b5c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.198+0000 7f1b79876640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] conn(0x7f1b5c0acf80 0x7f1b5c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.199+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1b5c0a32d0 msgr2=0x7f1b5c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.199+0000 7f1b79876640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1b5c0a32d0 0x7f1b5c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1b640096c0 tx=0x7f1b64000bc0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.199+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74106f10 msgr2=0x7f1b7419eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.199+0000 7f1b79876640 1 --2- 172.21.15.42:0/800357846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74106f10 0x7f1b7419eeb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00cce0 tx=0x7f1b6c00a620 comp rx=0 tx=0).stop 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.199+0000 7f1b737fe640 1 -- 172.21.15.42:0/800357846 reap_dead start 2024-09-19T09:37:47.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.199+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 shutdown_connections 2024-09-19T09:37:47.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.199+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 >> 172.21.15.42:0/800357846 conn(0x7f1b740fd8c0 msgr2=0x7f1b740feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.199+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 shutdown_connections 2024-09-19T09:37:47.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.199+0000 7f1b79876640 1 -- 172.21.15.42:0/800357846 wait complete. 2024-09-19T09:37:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.482+0000 7f2cdfb20640 1 -- 172.21.15.42:0/2308109312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cd810c170 msgr2=0x7f2cd810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.482+0000 7f2cdfb20640 1 --2- 172.21.15.42:0/2308109312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cd810c170 0x7f2cd810e610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009ca0 tx=0x7f2cd002a950 comp rx=0 tx=0).stop 2024-09-19T09:37:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 -- 172.21.15.42:0/2308109312 shutdown_connections 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 --2- 172.21.15.42:0/2308109312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cd810c170 0x7f2cd810e610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 --2- 172.21.15.42:0/2308109312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd8103660 0x7f2cd810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 --2- 172.21.15.42:0/2308109312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cd8102d40 0x7f2cd8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 -- 172.21.15.42:0/2308109312 >> 172.21.15.42:0/2308109312 conn(0x7f2cd80fc7a0 msgr2=0x7f2cd80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 -- 172.21.15.42:0/2308109312 shutdown_connections 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 -- 172.21.15.42:0/2308109312 wait complete. 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 Processor -- start 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 -- start start 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cd8102d40 0x7f2cd8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cd8103660 0x7f2cd8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd810c170 0x7f2cd819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8111f50 con 0x7f2cd8103660 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8111dd0 con 0x7f2cd8102d40 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.483+0000 7f2cdfb20640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd81120d0 con 0x7f2cd810c170 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdd0bb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cd8103660 0x7f2cd8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdd0bb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cd8103660 0x7f2cd8198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56950/0 (socket says 172.21.15.42:56950) 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdd0bb640 1 -- 172.21.15.42:0/1812273967 learned_addr learned my addr 172.21.15.42:0/1812273967 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdd8bc640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cd8102d40 0x7f2cd8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cde0bd640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd810c170 0x7f2cd819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdd0bb640 1 -- 172.21.15.42:0/1812273967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd810c170 msgr2=0x7f2cd819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdd0bb640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd810c170 0x7f2cd819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdd0bb640 1 -- 172.21.15.42:0/1812273967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cd8102d40 msgr2=0x7f2cd8198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdd0bb640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cd8102d40 0x7f2cd8198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdd0bb640 1 -- 172.21.15.42:0/1812273967 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd819d3b0 con 0x7f2cd8103660 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cde0bd640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd810c170 0x7f2cd819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdd0bb640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cd8103660 0x7f2cd8198940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800d750 tx=0x7f2cc800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cceffd640 1 -- 172.21.15.42:0/1812273967 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8017070 con 0x7f2cd8103660 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cceffd640 1 -- 172.21.15.42:0/1812273967 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc8005020 con 0x7f2cd8103660 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd819d6a0 con 0x7f2cd8103660 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cceffd640 1 -- 172.21.15.42:0/1812273967 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8004d00 con 0x7f2cd8103660 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.484+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd81a4f80 con 0x7f2cd8103660 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.485+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2cd8062980 con 0x7f2cd8103660 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.487+0000 7f2cceffd640 1 -- 172.21.15.42:0/1812273967 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2cc8005560 con 0x7f2cd8103660 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.487+0000 7f2cceffd640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2cc40a32d0 0x7f2cc40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.487+0000 7f2cceffd640 1 -- 172.21.15.42:0/1812273967 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2cc80cf860 con 0x7f2cd8103660 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.487+0000 7f2cdd8bc640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2cc40a32d0 0x7f2cc40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.488+0000 7f2cceffd640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] conn(0x7f2cc40acf80 0x7f2cc40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.488+0000 7f2cceffd640 1 -- 172.21.15.42:0/1812273967 --> [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cc8022e50 con 0x7f2cc40acf80 2024-09-19T09:37:47.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.488+0000 7f2cceffd640 1 -- 172.21.15.42:0/1812273967 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f2cc80cfcb0 con 0x7f2cd8103660 2024-09-19T09:37:47.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.488+0000 7f2cdd8bc640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2cc40a32d0 0x7f2cc40a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40058c0 tx=0x7f2cd400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.488+0000 7f2cde0bd640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] conn(0x7f2cc40acf80 0x7f2cc40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.488+0000 7f2cde0bd640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] conn(0x7f2cc40acf80 0x7f2cc40af420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.489+0000 7f2cceffd640 1 -- 172.21.15.42:0/1812273967 <== osd.11 v2:172.21.15.171:6824/2813410869 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2cc8022e50 con 0x7f2cc40acf80 2024-09-19T09:37:47.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.503+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 --> [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2cd8062d80 con 0x7f2cc40acf80 2024-09-19T09:37:47.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.503+0000 7f2cceffd640 1 -- 172.21.15.42:0/1812273967 <== osd.11 v2:172.21.15.171:6824/2813410869 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2cd8062d80 con 0x7f2cc40acf80 2024-09-19T09:37:47.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 >> [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] conn(0x7f2cc40acf80 msgr2=0x7f2cc40af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cdfb20640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] conn(0x7f2cc40acf80 0x7f2cc40af420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2cc40a32d0 msgr2=0x7f2cc40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cdfb20640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2cc40a32d0 0x7f2cc40a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40058c0 tx=0x7f2cd400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cd8103660 msgr2=0x7f2cd8198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cdfb20640 1 --2- 172.21.15.42:0/1812273967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cd8103660 0x7f2cd8198940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800d750 tx=0x7f2cc800dc10 comp rx=0 tx=0).stop 2024-09-19T09:37:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cde0bd640 1 -- 172.21.15.42:0/1812273967 reap_dead start 2024-09-19T09:37:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 shutdown_connections 2024-09-19T09:37:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 >> 172.21.15.42:0/1812273967 conn(0x7f2cd80fc7a0 msgr2=0x7f2cd80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 shutdown_connections 2024-09-19T09:37:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:47.504+0000 7f2cdfb20640 1 -- 172.21.15.42:0/1812273967 wait complete. 2024-09-19T09:37:48.234 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:48 smithi042 ceph-mon[31223]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-19T09:37:48.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:48 smithi171 ceph-mon[35803]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-19T09:37:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:48 smithi136 ceph-mon[34840]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-19T09:37:49.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.105+0000 7fed29e09640 1 -- 172.21.15.42:0/1612433811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2410c170 msgr2=0x7fed2410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.105+0000 7fed29e09640 1 --2- 172.21.15.42:0/1612433811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2410c170 0x7fed2410e610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009ca0 tx=0x7fed1c02a950 comp rx=0 tx=0).stop 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.105+0000 7fed29e09640 1 -- 172.21.15.42:0/1612433811 shutdown_connections 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.105+0000 7fed29e09640 1 --2- 172.21.15.42:0/1612433811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2410c170 0x7fed2410e610 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.105+0000 7fed29e09640 1 --2- 172.21.15.42:0/1612433811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed24103660 0x7fed2410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.105+0000 7fed29e09640 1 --2- 172.21.15.42:0/1612433811 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed24102d40 0x7fed24103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.105+0000 7fed29e09640 1 -- 172.21.15.42:0/1612433811 >> 172.21.15.42:0/1612433811 conn(0x7fed240fc7a0 msgr2=0x7fed240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.105+0000 7fed29e09640 1 -- 172.21.15.42:0/1612433811 shutdown_connections 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.105+0000 7fed29e09640 1 -- 172.21.15.42:0/1612433811 wait complete. 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.105+0000 7fed29e09640 1 Processor -- start 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed29e09640 1 -- start start 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed29e09640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed24102d40 0x7fed24198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed29e09640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed24103660 0x7fed24198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:49.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed29e09640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2410c170 0x7fed2419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed29e09640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fed24111f30 con 0x7fed2410c170 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed29e09640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fed24111db0 con 0x7fed24103660 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed29e09640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fed241120b0 con 0x7fed24102d40 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed23fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2410c170 0x7fed2419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed237fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed24102d40 0x7fed24198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed23fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2410c170 0x7fed2419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56978/0 (socket says 172.21.15.42:56978) 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed23fff640 1 -- 172.21.15.42:0/3651464810 learned_addr learned my addr 172.21.15.42:0/3651464810 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed22ffd640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed24103660 0x7fed24198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed23fff640 1 -- 172.21.15.42:0/3651464810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed24102d40 msgr2=0x7fed24198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed23fff640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed24102d40 0x7fed24198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed23fff640 1 -- 172.21.15.42:0/3651464810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed24103660 msgr2=0x7fed24198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed23fff640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed24103660 0x7fed24198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed23fff640 1 -- 172.21.15.42:0/3651464810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2419d3c0 con 0x7fed2410c170 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.106+0000 7fed22ffd640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed24103660 0x7fed24198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.107+0000 7fed23fff640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2410c170 0x7fed2419cce0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fed1c02ae70 tx=0x7fed1c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.107+0000 7fed20ff9640 1 -- 172.21.15.42:0/3651464810 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c034040 con 0x7fed2410c170 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.107+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2419d650 con 0x7fed2410c170 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.107+0000 7fed20ff9640 1 -- 172.21.15.42:0/3651464810 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed1c030920 con 0x7fed2410c170 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.107+0000 7fed20ff9640 1 -- 172.21.15.42:0/3651464810 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c045480 con 0x7fed2410c170 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.107+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed241a4f90 con 0x7fed2410c170 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.108+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed24062980 con 0x7fed2410c170 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.109+0000 7fed20ff9640 1 -- 172.21.15.42:0/3651464810 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fed1c037020 con 0x7fed2410c170 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.110+0000 7fed20ff9640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed100a32d0 0x7fed100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.110+0000 7fed237fe640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed100a32d0 0x7fed100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.110+0000 7fed20ff9640 1 -- 172.21.15.42:0/3651464810 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fed1c0f0cb0 con 0x7fed2410c170 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.110+0000 7fed20ff9640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] conn(0x7fed100acf80 0x7fed100af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:49.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.110+0000 7fed20ff9640 1 -- 172.21.15.42:0/3651464810 --> [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed1c02c030 con 0x7fed100acf80 2024-09-19T09:37:49.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.110+0000 7fed20ff9640 1 -- 172.21.15.42:0/3651464810 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fed1c0f1100 con 0x7fed2410c170 2024-09-19T09:37:49.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.111+0000 7fed237fe640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed100a32d0 0x7fed100a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed14005d00 tx=0x7fed1400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:49.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.111+0000 7fed22ffd640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] conn(0x7fed100acf80 0x7fed100af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:49.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.111+0000 7fed22ffd640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] conn(0x7fed100acf80 0x7fed100af420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:49.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.112+0000 7fed20ff9640 1 -- 172.21.15.42:0/3651464810 <== osd.4 v2:172.21.15.136:6808/1987544741 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed1c02c030 con 0x7fed100acf80 2024-09-19T09:37:49.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.126+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 --> [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed24062d80 con 0x7fed100acf80 2024-09-19T09:37:49.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.126+0000 7fed20ff9640 1 -- 172.21.15.42:0/3651464810 <== osd.4 v2:172.21.15.136:6808/1987544741 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fed24062d80 con 0x7fed100acf80 2024-09-19T09:37:49.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 >> [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] conn(0x7fed100acf80 msgr2=0x7fed100af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed29e09640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] conn(0x7fed100acf80 0x7fed100af420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed100a32d0 msgr2=0x7fed100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed29e09640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fed100a32d0 0x7fed100a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed14005d00 tx=0x7fed1400b410 comp rx=0 tx=0).stop 2024-09-19T09:37:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2410c170 msgr2=0x7fed2419cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed29e09640 1 --2- 172.21.15.42:0/3651464810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2410c170 0x7fed2419cce0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fed1c02ae70 tx=0x7fed1c02f5b0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed23fff640 1 -- 172.21.15.42:0/3651464810 reap_dead start 2024-09-19T09:37:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 shutdown_connections 2024-09-19T09:37:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 >> 172.21.15.42:0/3651464810 conn(0x7fed240fc7a0 msgr2=0x7fed240fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 shutdown_connections 2024-09-19T09:37:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.127+0000 7fed29e09640 1 -- 172.21.15.42:0/3651464810 wait complete. 2024-09-19T09:37:49.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.930+0000 7f26ff359640 1 -- 172.21.15.42:0/1106786656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26f8102790 msgr2=0x7f26f81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.930+0000 7f26ff359640 1 --2- 172.21.15.42:0/1106786656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26f8102790 0x7f26f81067e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009900 tx=0x7f26e802a410 comp rx=0 tx=0).stop 2024-09-19T09:37:49.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.930+0000 7f26ff359640 1 -- 172.21.15.42:0/1106786656 shutdown_connections 2024-09-19T09:37:49.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.930+0000 7f26ff359640 1 --2- 172.21.15.42:0/1106786656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26f8106f10 0x7f26f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.930+0000 7f26ff359640 1 --2- 172.21.15.42:0/1106786656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26f8102790 0x7f26f81067e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.930+0000 7f26ff359640 1 --2- 172.21.15.42:0/1106786656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26f8101de0 0x7f26f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.930+0000 7f26ff359640 1 -- 172.21.15.42:0/1106786656 >> 172.21.15.42:0/1106786656 conn(0x7f26f80fd8c0 msgr2=0x7f26f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.930+0000 7f26ff359640 1 -- 172.21.15.42:0/1106786656 shutdown_connections 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.930+0000 7f26ff359640 1 -- 172.21.15.42:0/1106786656 wait complete. 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26ff359640 1 Processor -- start 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26ff359640 1 -- start start 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26ff359640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26f8101de0 0x7f26f8198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26ff359640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26f8102790 0x7f26f8198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26ff359640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26f8106f10 0x7f26f819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26ff359640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8111f90 con 0x7f26f8101de0 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26ff359640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8111e10 con 0x7f26f8106f10 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26ff359640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8112110 con 0x7f26f8102790 2024-09-19T09:37:49.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26fd0f5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26f8101de0 0x7f26f8198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26fd0f5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26f8101de0 0x7f26f8198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56998/0 (socket says 172.21.15.42:56998) 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.931+0000 7f26fd0f5640 1 -- 172.21.15.42:0/3165312671 learned_addr learned my addr 172.21.15.42:0/3165312671 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26fc8f4640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26f8102790 0x7f26f8198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26fd0f5640 1 -- 172.21.15.42:0/3165312671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26f8102790 msgr2=0x7f26f8198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26fd0f5640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26f8102790 0x7f26f8198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26fd0f5640 1 -- 172.21.15.42:0/3165312671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26f8106f10 msgr2=0x7f26f819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26fd0f5640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26f8106f10 0x7f26f819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26fd0f5640 1 -- 172.21.15.42:0/3165312671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f819d500 con 0x7f26f8101de0 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26fd0f5640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26f8101de0 0x7f26f8198550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f26f400b4a0 tx=0x7f26f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26ee7fc640 1 -- 172.21.15.42:0/3165312671 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4014070 con 0x7f26f8101de0 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f819d7f0 con 0x7f26f8101de0 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26ee7fc640 1 -- 172.21.15.42:0/3165312671 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26f4010af0 con 0x7f26f8101de0 2024-09-19T09:37:49.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26ee7fc640 1 -- 172.21.15.42:0/3165312671 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4017d10 con 0x7f26f8101de0 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.932+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f81a50d0 con 0x7f26f8101de0 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.933+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26f8062900 con 0x7f26f8101de0 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.934+0000 7f26ee7fc640 1 -- 172.21.15.42:0/3165312671 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f26f4017070 con 0x7f26f8101de0 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.935+0000 7f26ee7fc640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26e40a32d0 0x7f26e40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.935+0000 7f26fc8f4640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26e40a32d0 0x7f26e40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.935+0000 7f26ee7fc640 1 -- 172.21.15.42:0/3165312671 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f26f40cf1d0 con 0x7f26f8101de0 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.935+0000 7f26ee7fc640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] conn(0x7f26e40acf80 0x7f26e40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.935+0000 7f26ee7fc640 1 -- 172.21.15.42:0/3165312671 --> [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26f401ae50 con 0x7f26e40acf80 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.935+0000 7f26ee7fc640 1 -- 172.21.15.42:0/3165312671 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f26f40cf620 con 0x7f26f8101de0 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.935+0000 7f26fc8f4640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26e40a32d0 0x7f26e40a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f26e80096c0 tx=0x7f26e8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.936+0000 7f26fd8f6640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] conn(0x7f26e40acf80 0x7f26e40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.936+0000 7f26fd8f6640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] conn(0x7f26e40acf80 0x7f26e40af420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:49.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.937+0000 7f26ee7fc640 1 -- 172.21.15.42:0/3165312671 <== osd.10 v2:172.21.15.136:6824/3459426707 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f26f401ae50 con 0x7f26e40acf80 2024-09-19T09:37:49.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.951+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 --> [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f26f8062d00 con 0x7f26e40acf80 2024-09-19T09:37:49.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.951+0000 7f26ee7fc640 1 -- 172.21.15.42:0/3165312671 <== osd.10 v2:172.21.15.136:6824/3459426707 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f26f8062d00 con 0x7f26e40acf80 2024-09-19T09:37:49.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 >> [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] conn(0x7f26e40acf80 msgr2=0x7f26e40af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26ff359640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] conn(0x7f26e40acf80 0x7f26e40af420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26e40a32d0 msgr2=0x7f26e40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26ff359640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26e40a32d0 0x7f26e40a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f26e80096c0 tx=0x7f26e8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26f8101de0 msgr2=0x7f26f8198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26ff359640 1 --2- 172.21.15.42:0/3165312671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26f8101de0 0x7f26f8198550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f26f400b4a0 tx=0x7f26f400b960 comp rx=0 tx=0).stop 2024-09-19T09:37:49.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26fd8f6640 1 -- 172.21.15.42:0/3165312671 reap_dead start 2024-09-19T09:37:49.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 shutdown_connections 2024-09-19T09:37:49.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 >> 172.21.15.42:0/3165312671 conn(0x7f26f80fd8c0 msgr2=0x7f26f80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:49.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 shutdown_connections 2024-09-19T09:37:49.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:49.952+0000 7f26ff359640 1 -- 172.21.15.42:0/3165312671 wait complete. 2024-09-19T09:37:50.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:50 smithi171 ceph-mon[35803]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:37:50.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:50 smithi136 ceph-mon[34840]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:37:50.412 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:50 smithi042 ceph-mon[31223]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:37:50.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.669+0000 7fef05cc2640 1 -- 172.21.15.42:0/220071855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef00102790 msgr2=0x7fef001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.669+0000 7fef05cc2640 1 --2- 172.21.15.42:0/220071855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef00102790 0x7fef001067e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feee8009900 tx=0x7feee802a410 comp rx=0 tx=0).stop 2024-09-19T09:37:50.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.669+0000 7fef05cc2640 1 -- 172.21.15.42:0/220071855 shutdown_connections 2024-09-19T09:37:50.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.669+0000 7fef05cc2640 1 --2- 172.21.15.42:0/220071855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef00106f10 0x7fef0010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.669+0000 7fef05cc2640 1 --2- 172.21.15.42:0/220071855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef00102790 0x7fef001067e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.669+0000 7fef05cc2640 1 --2- 172.21.15.42:0/220071855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef00101de0 0x7fef001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.669+0000 7fef05cc2640 1 -- 172.21.15.42:0/220071855 >> 172.21.15.42:0/220071855 conn(0x7fef000fd8c0 msgr2=0x7fef000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.669+0000 7fef05cc2640 1 -- 172.21.15.42:0/220071855 shutdown_connections 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.669+0000 7fef05cc2640 1 -- 172.21.15.42:0/220071855 wait complete. 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7fef05cc2640 1 Processor -- start 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7fef05cc2640 1 -- start start 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7fef05cc2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef00101de0 0x7fef00198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7fef05cc2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef00102790 0x7fef00198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7fef05cc2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef00106f10 0x7fef0019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7fef05cc2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef00111f70 con 0x7fef00102790 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7fef05cc2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fef00111df0 con 0x7fef00101de0 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7fef05cc2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef001120f0 con 0x7fef00106f10 2024-09-19T09:37:50.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7feef6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef00102790 0x7fef00198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7feef6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef00102790 0x7fef00198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53384/0 (socket says 172.21.15.42:53384) 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7feef6ffd640 1 -- 172.21.15.42:0/2464727791 learned_addr learned my addr 172.21.15.42:0/2464727791 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7feefffff640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef00106f10 0x7fef0019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7feef6ffd640 1 -- 172.21.15.42:0/2464727791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef00106f10 msgr2=0x7fef0019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7feeff7fe640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef00101de0 0x7fef00198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7feef6ffd640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef00106f10 0x7fef0019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.670+0000 7feef6ffd640 1 -- 172.21.15.42:0/2464727791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef00101de0 msgr2=0x7fef00198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.671+0000 7feef6ffd640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef00101de0 0x7fef00198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.671+0000 7feef6ffd640 1 -- 172.21.15.42:0/2464727791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0019d3e0 con 0x7fef00102790 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.671+0000 7feefffff640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef00106f10 0x7fef0019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.671+0000 7feef6ffd640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef00102790 0x7fef00198970 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feee8006010 tx=0x7feee80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.671+0000 7feefd7fa640 1 -- 172.21.15.42:0/2464727791 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee803f030 con 0x7fef00102790 2024-09-19T09:37:50.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.671+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0019d670 con 0x7fef00102790 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.671+0000 7feefd7fa640 1 -- 172.21.15.42:0/2464727791 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feee8003ce0 con 0x7fef00102790 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.671+0000 7feefd7fa640 1 -- 172.21.15.42:0/2464727791 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee8035070 con 0x7fef00102790 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.671+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef001a4fb0 con 0x7fef00102790 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.672+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef00062940 con 0x7fef00102790 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.673+0000 7feefd7fa640 1 -- 172.21.15.42:0/2464727791 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7feee8042030 con 0x7fef00102790 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.674+0000 7feefd7fa640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feeec0a32d0 0x7feeec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.674+0000 7feeff7fe640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feeec0a32d0 0x7feeec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.674+0000 7feefd7fa640 1 -- 172.21.15.42:0/2464727791 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7feee80f0780 con 0x7fef00102790 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.674+0000 7feefd7fa640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] conn(0x7feeec0acf80 0x7feeec0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.674+0000 7feefd7fa640 1 -- 172.21.15.42:0/2464727791 --> [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feee803ce50 con 0x7feeec0acf80 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.674+0000 7feefd7fa640 1 -- 172.21.15.42:0/2464727791 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7feee80f0b30 con 0x7fef00102790 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.674+0000 7feefffff640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] conn(0x7feeec0acf80 0x7feeec0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:50.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.675+0000 7feeff7fe640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feeec0a32d0 0x7feeec0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feef0005fd0 tx=0x7feef0009470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:50.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.675+0000 7feefffff640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] conn(0x7feeec0acf80 0x7feeec0af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:50.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.676+0000 7feefd7fa640 1 -- 172.21.15.42:0/2464727791 <== osd.9 v2:172.21.15.42:6826/1760632261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feee803ce50 con 0x7feeec0acf80 2024-09-19T09:37:50.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.689+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 --> [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef00062d40 con 0x7feeec0acf80 2024-09-19T09:37:50.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.689+0000 7feefd7fa640 1 -- 172.21.15.42:0/2464727791 <== osd.9 v2:172.21.15.42:6826/1760632261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fef00062d40 con 0x7feeec0acf80 2024-09-19T09:37:50.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] conn(0x7feeec0acf80 msgr2=0x7feeec0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7fef05cc2640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] conn(0x7feeec0acf80 0x7feeec0af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feeec0a32d0 msgr2=0x7feeec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7fef05cc2640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feeec0a32d0 0x7feeec0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feef0005fd0 tx=0x7feef0009470 comp rx=0 tx=0).stop 2024-09-19T09:37:50.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef00102790 msgr2=0x7fef00198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7fef05cc2640 1 --2- 172.21.15.42:0/2464727791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef00102790 0x7fef00198970 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feee8006010 tx=0x7feee80042f0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7feefffff640 1 -- 172.21.15.42:0/2464727791 reap_dead start 2024-09-19T09:37:50.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 shutdown_connections 2024-09-19T09:37:50.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 >> 172.21.15.42:0/2464727791 conn(0x7fef000fd8c0 msgr2=0x7fef000fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:50.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 shutdown_connections 2024-09-19T09:37:50.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.690+0000 7fef05cc2640 1 -- 172.21.15.42:0/2464727791 wait complete. 2024-09-19T09:37:51.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.098+0000 7f8c408e8640 1 -- 172.21.15.42:0/2170684077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c3c101de0 msgr2=0x7f8c3c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.098+0000 7f8c408e8640 1 --2- 172.21.15.42:0/2170684077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c3c101de0 0x7f8c3c1021c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009900 tx=0x7f8c2c02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.098+0000 7f8c408e8640 1 -- 172.21.15.42:0/2170684077 shutdown_connections 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.098+0000 7f8c408e8640 1 --2- 172.21.15.42:0/2170684077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c3c106f10 0x7f8c3c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.098+0000 7f8c408e8640 1 --2- 172.21.15.42:0/2170684077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c3c102790 0x7f8c3c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.098+0000 7f8c408e8640 1 --2- 172.21.15.42:0/2170684077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c3c101de0 0x7f8c3c1021c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.098+0000 7f8c408e8640 1 -- 172.21.15.42:0/2170684077 >> 172.21.15.42:0/2170684077 conn(0x7f8c3c0fd8c0 msgr2=0x7f8c3c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.098+0000 7f8c408e8640 1 -- 172.21.15.42:0/2170684077 shutdown_connections 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.098+0000 7f8c408e8640 1 -- 172.21.15.42:0/2170684077 wait complete. 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.098+0000 7f8c408e8640 1 Processor -- start 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c408e8640 1 -- start start 2024-09-19T09:37:51.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c408e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c3c101de0 0x7f8c3c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c408e8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c3c102790 0x7f8c3c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c408e8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c3c106f10 0x7f8c3c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c408e8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3c111f90 con 0x7f8c3c101de0 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c408e8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3c111e10 con 0x7f8c3c102790 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c408e8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3c112110 con 0x7f8c3c106f10 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c3c101de0 0x7f8c3c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c3c101de0 0x7f8c3c198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53404/0 (socket says 172.21.15.42:53404) 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3a59c640 1 -- 172.21.15.42:0/1780607742 learned_addr learned my addr 172.21.15.42:0/1780607742 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c39d9b640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c3c102790 0x7f8c3c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3ad9d640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c3c106f10 0x7f8c3c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3a59c640 1 -- 172.21.15.42:0/1780607742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c3c106f10 msgr2=0x7f8c3c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3a59c640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c3c106f10 0x7f8c3c19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3a59c640 1 -- 172.21.15.42:0/1780607742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c3c102790 msgr2=0x7f8c3c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3a59c640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c3c102790 0x7f8c3c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3a59c640 1 -- 172.21.15.42:0/1780607742 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3c19d400 con 0x7f8c3c101de0 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c39d9b640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c3c102790 0x7f8c3c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3ad9d640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c3c106f10 0x7f8c3c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.099+0000 7f8c3a59c640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c3c101de0 0x7f8c3c198450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c005ab0 tx=0x7f8c2c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.100+0000 7f8c2b7fe640 1 -- 172.21.15.42:0/1780607742 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c03f030 con 0x7f8c3c101de0 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.100+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c3c19d690 con 0x7f8c3c101de0 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.100+0000 7f8c2b7fe640 1 -- 172.21.15.42:0/1780607742 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c2c003ce0 con 0x7f8c3c101de0 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.100+0000 7f8c2b7fe640 1 -- 172.21.15.42:0/1780607742 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c035070 con 0x7f8c3c101de0 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.100+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c3c1a4fd0 con 0x7f8c3c101de0 2024-09-19T09:37:51.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.101+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c3c062980 con 0x7f8c3c101de0 2024-09-19T09:37:51.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.102+0000 7f8c2b7fe640 1 -- 172.21.15.42:0/1780607742 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8c2c042030 con 0x7f8c3c101de0 2024-09-19T09:37:51.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.103+0000 7f8c2b7fe640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8c240a32d0 0x7f8c240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.103+0000 7f8c39d9b640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8c240a32d0 0x7f8c240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.103+0000 7f8c2b7fe640 1 -- 172.21.15.42:0/1780607742 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8c2c0f06b0 con 0x7f8c3c101de0 2024-09-19T09:37:51.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.103+0000 7f8c2b7fe640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] conn(0x7f8c240acf80 0x7f8c240af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.103+0000 7f8c2b7fe640 1 -- 172.21.15.42:0/1780607742 --> [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c2c001d30 con 0x7f8c240acf80 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.103+0000 7f8c2b7fe640 1 -- 172.21.15.42:0/1780607742 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f8c2c0f0b00 con 0x7f8c3c101de0 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.103+0000 7f8c39d9b640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8c240a32d0 0x7f8c240a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c30006fd0 tx=0x7f8c30008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.103+0000 7f8c3ad9d640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] conn(0x7f8c240acf80 0x7f8c240af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.104+0000 7f8c3ad9d640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] conn(0x7f8c240acf80 0x7f8c240af420 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.104+0000 7f8c2b7fe640 1 -- 172.21.15.42:0/1780607742 <== osd.8 v2:172.21.15.171:6816/4167633089 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c2c001d30 con 0x7f8c240acf80 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.118+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 --> [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c3c062d80 con 0x7f8c240acf80 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c2b7fe640 1 -- 172.21.15.42:0/1780607742 <== osd.8 v2:172.21.15.171:6816/4167633089 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8c3c062d80 con 0x7f8c240acf80 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 >> [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] conn(0x7f8c240acf80 msgr2=0x7f8c240af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c408e8640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] conn(0x7f8c240acf80 0x7f8c240af420 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8c240a32d0 msgr2=0x7f8c240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c408e8640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8c240a32d0 0x7f8c240a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c30006fd0 tx=0x7f8c30008040 comp rx=0 tx=0).stop 2024-09-19T09:37:51.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c3c101de0 msgr2=0x7f8c3c198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c408e8640 1 --2- 172.21.15.42:0/1780607742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c3c101de0 0x7f8c3c198450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c005ab0 tx=0x7f8c2c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c3ad9d640 1 -- 172.21.15.42:0/1780607742 reap_dead start 2024-09-19T09:37:51.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 shutdown_connections 2024-09-19T09:37:51.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 >> 172.21.15.42:0/1780607742 conn(0x7f8c3c0fd8c0 msgr2=0x7f8c3c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 shutdown_connections 2024-09-19T09:37:51.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.119+0000 7f8c408e8640 1 -- 172.21.15.42:0/1780607742 wait complete. 2024-09-19T09:37:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.572+0000 7fac2f4e7640 1 -- 172.21.15.42:0/3145225207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac28074620 msgr2=0x7fac28074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.572+0000 7fac2f4e7640 1 --2- 172.21.15.42:0/3145225207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac28074620 0x7fac28074a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fac20009900 tx=0x7fac2002a480 comp rx=0 tx=0).stop 2024-09-19T09:37:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.572+0000 7fac2f4e7640 1 -- 172.21.15.42:0/3145225207 shutdown_connections 2024-09-19T09:37:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.572+0000 7fac2f4e7640 1 --2- 172.21.15.42:0/3145225207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac2810e3c0 0x7fac28110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.572+0000 7fac2f4e7640 1 --2- 172.21.15.42:0/3145225207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac28074f40 0x7fac2810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.572+0000 7fac2f4e7640 1 --2- 172.21.15.42:0/3145225207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac28074620 0x7fac28074a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.572+0000 7fac2f4e7640 1 -- 172.21.15.42:0/3145225207 >> 172.21.15.42:0/3145225207 conn(0x7fac280fd8c0 msgr2=0x7fac280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.572+0000 7fac2f4e7640 1 -- 172.21.15.42:0/3145225207 shutdown_connections 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.572+0000 7fac2f4e7640 1 -- 172.21.15.42:0/3145225207 wait complete. 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2f4e7640 1 Processor -- start 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2f4e7640 1 -- start start 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2f4e7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac28074620 0x7fac281a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2f4e7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac28074f40 0x7fac281a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2f4e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac2810e3c0 0x7fac2819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2f4e7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fac28114230 con 0x7fac2810e3c0 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2f4e7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fac281140b0 con 0x7fac28074f40 2024-09-19T09:37:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2f4e7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fac281143b0 con 0x7fac28074620 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2da84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac2810e3c0 0x7fac2819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2da84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac2810e3c0 0x7fac2819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53352/0 (socket says 172.21.15.42:53352) 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2da84640 1 -- 172.21.15.42:0/2092092260 learned_addr learned my addr 172.21.15.42:0/2092092260 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.573+0000 7fac2ca82640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac28074f40 0x7fac281a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac2d283640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac28074620 0x7fac281a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac2da84640 1 -- 172.21.15.42:0/2092092260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac28074620 msgr2=0x7fac281a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac2da84640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac28074620 0x7fac281a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac2da84640 1 -- 172.21.15.42:0/2092092260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac28074f40 msgr2=0x7fac281a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac2da84640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac28074f40 0x7fac281a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac2da84640 1 -- 172.21.15.42:0/2092092260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2819ad00 con 0x7fac2810e3c0 2024-09-19T09:37:51.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac2ca82640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac28074f40 0x7fac281a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:51.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac2da84640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac2810e3c0 0x7fac2819a5d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fac1800b970 tx=0x7fac1800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac267fc640 1 -- 172.21.15.42:0/2092092260 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18019070 con 0x7fac2810e3c0 2024-09-19T09:37:51.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2819aff0 con 0x7fac2810e3c0 2024-09-19T09:37:51.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac267fc640 1 -- 172.21.15.42:0/2092092260 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac1800cb40 con 0x7fac2810e3c0 2024-09-19T09:37:51.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac267fc640 1 -- 172.21.15.42:0/2092092260 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18007650 con 0x7fac2810e3c0 2024-09-19T09:37:51.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.574+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac281a72e0 con 0x7fac2810e3c0 2024-09-19T09:37:51.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.575+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac28062980 con 0x7fac2810e3c0 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.576+0000 7fac267fc640 1 -- 172.21.15.42:0/2092092260 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fac1801c070 con 0x7fac2810e3c0 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.577+0000 7fac267fc640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fac100a32d0 0x7fac100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.577+0000 7fac2d283640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fac100a32d0 0x7fac100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.577+0000 7fac267fc640 1 -- 172.21.15.42:0/2092092260 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fac180cf090 con 0x7fac2810e3c0 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.577+0000 7fac267fc640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] conn(0x7fac100acf80 0x7fac100af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.577+0000 7fac267fc640 1 -- 172.21.15.42:0/2092092260 --> [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac100afaf0 con 0x7fac100acf80 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.577+0000 7fac267fc640 1 -- 172.21.15.42:0/2092092260 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fac180d6050 con 0x7fac2810e3c0 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.577+0000 7fac2ca82640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] conn(0x7fac100acf80 0x7fac100af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.577+0000 7fac2d283640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fac100a32d0 0x7fac100a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fac200096c0 tx=0x7fac20000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.578+0000 7fac2ca82640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] conn(0x7fac100acf80 0x7fac100af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.578+0000 7fac267fc640 1 -- 172.21.15.42:0/2092092260 <== osd.3 v2:172.21.15.42:6810/3782422248 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac100afaf0 con 0x7fac100acf80 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.593+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 --> [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac28062e00 con 0x7fac100acf80 2024-09-19T09:37:51.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.593+0000 7fac267fc640 1 -- 172.21.15.42:0/2092092260 <== osd.3 v2:172.21.15.42:6810/3782422248 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fac28062e00 con 0x7fac100acf80 2024-09-19T09:37:51.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] conn(0x7fac100acf80 msgr2=0x7fac100af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2f4e7640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] conn(0x7fac100acf80 0x7fac100af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fac100a32d0 msgr2=0x7fac100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2f4e7640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fac100a32d0 0x7fac100a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fac200096c0 tx=0x7fac20000bc0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac2810e3c0 msgr2=0x7fac2819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2f4e7640 1 --2- 172.21.15.42:0/2092092260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac2810e3c0 0x7fac2819a5d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fac1800b970 tx=0x7fac1800be30 comp rx=0 tx=0).stop 2024-09-19T09:37:51.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2da84640 1 -- 172.21.15.42:0/2092092260 reap_dead start 2024-09-19T09:37:51.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 shutdown_connections 2024-09-19T09:37:51.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 >> 172.21.15.42:0/2092092260 conn(0x7fac280fd8c0 msgr2=0x7fac280ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 shutdown_connections 2024-09-19T09:37:51.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:50.594+0000 7fac2f4e7640 1 -- 172.21.15.42:0/2092092260 wait complete. 2024-09-19T09:37:51.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.896+0000 7f3177a60640 1 -- 172.21.15.42:0/687204100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3170101de0 msgr2=0x7f31701021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.896+0000 7f3177a60640 1 --2- 172.21.15.42:0/687204100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3170101de0 0x7f31701021c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3160009900 tx=0x7f316002a410 comp rx=0 tx=0).stop 2024-09-19T09:37:51.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.896+0000 7f3177a60640 1 -- 172.21.15.42:0/687204100 shutdown_connections 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.896+0000 7f3177a60640 1 --2- 172.21.15.42:0/687204100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3170106f10 0x7f317010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.896+0000 7f3177a60640 1 --2- 172.21.15.42:0/687204100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3170102790 0x7f31701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.896+0000 7f3177a60640 1 --2- 172.21.15.42:0/687204100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3170101de0 0x7f31701021c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.896+0000 7f3177a60640 1 -- 172.21.15.42:0/687204100 >> 172.21.15.42:0/687204100 conn(0x7f31700fd880 msgr2=0x7f31700ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.896+0000 7f3177a60640 1 -- 172.21.15.42:0/687204100 shutdown_connections 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.896+0000 7f3177a60640 1 -- 172.21.15.42:0/687204100 wait complete. 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3177a60640 1 Processor -- start 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3177a60640 1 -- start start 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3177a60640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3170101de0 0x7f31701983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3177a60640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3170102790 0x7f3170198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3177a60640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3170106f10 0x7f317019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3177a60640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3170111f30 con 0x7f3170101de0 2024-09-19T09:37:51.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3177a60640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3170111db0 con 0x7f3170102790 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3177a60640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f31701120b0 con 0x7f3170106f10 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f31757fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3170101de0 0x7f31701983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f31757fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3170101de0 0x7f31701983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53410/0 (socket says 172.21.15.42:53410) 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f31757fc640 1 -- 172.21.15.42:0/1323325008 learned_addr learned my addr 172.21.15.42:0/1323325008 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3174ffb640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3170102790 0x7f3170198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3175ffd640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3170106f10 0x7f317019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f31757fc640 1 -- 172.21.15.42:0/1323325008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3170106f10 msgr2=0x7f317019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f31757fc640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3170106f10 0x7f317019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f31757fc640 1 -- 172.21.15.42:0/1323325008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3170102790 msgr2=0x7f3170198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f31757fc640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3170102790 0x7f3170198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f31757fc640 1 -- 172.21.15.42:0/1323325008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317019d370 con 0x7f3170101de0 2024-09-19T09:37:51.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.897+0000 7f3175ffd640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3170106f10 0x7f317019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.898+0000 7f31757fc640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3170101de0 0x7f31701983c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3160005ab0 tx=0x7f31600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.898+0000 7f316e7fc640 1 -- 172.21.15.42:0/1323325008 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316003f030 con 0x7f3170101de0 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.898+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317019d600 con 0x7f3170101de0 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.898+0000 7f316e7fc640 1 -- 172.21.15.42:0/1323325008 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3160003ce0 con 0x7f3170101de0 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.898+0000 7f316e7fc640 1 -- 172.21.15.42:0/1323325008 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160035070 con 0x7f3170101de0 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.898+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31701a4f40 con 0x7f3170101de0 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.899+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3170062980 con 0x7f3170101de0 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.900+0000 7f316e7fc640 1 -- 172.21.15.42:0/1323325008 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3160042030 con 0x7f3170101de0 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.901+0000 7f316e7fc640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31580a32d0 0x7f31580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.901+0000 7f316e7fc640 1 -- 172.21.15.42:0/1323325008 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f31600f0480 con 0x7f3170101de0 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.901+0000 7f3174ffb640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31580a32d0 0x7f31580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.901+0000 7f316e7fc640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] conn(0x7f31580acf80 0x7f31580af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.901+0000 7f316e7fc640 1 -- 172.21.15.42:0/1323325008 --> [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31580afaf0 con 0x7f31580acf80 2024-09-19T09:37:51.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.901+0000 7f316e7fc640 1 -- 172.21.15.42:0/1323325008 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f31600f7050 con 0x7f3170101de0 2024-09-19T09:37:51.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.901+0000 7f3174ffb640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31580a32d0 0x7f31580a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3164005e10 tx=0x7f3164005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.902+0000 7f3175ffd640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] conn(0x7f31580acf80 0x7f31580af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.902+0000 7f3175ffd640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] conn(0x7f31580acf80 0x7f31580af420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.903+0000 7f316e7fc640 1 -- 172.21.15.42:0/1323325008 <== osd.5 v2:172.21.15.171:6808/2964439242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31580afaf0 con 0x7f31580acf80 2024-09-19T09:37:51.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.916+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 --> [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3170062db0 con 0x7f31580acf80 2024-09-19T09:37:51.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.917+0000 7f316e7fc640 1 -- 172.21.15.42:0/1323325008 <== osd.5 v2:172.21.15.171:6808/2964439242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3170062db0 con 0x7f31580acf80 2024-09-19T09:37:51.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 >> [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] conn(0x7f31580acf80 msgr2=0x7f31580af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3177a60640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] conn(0x7f31580acf80 0x7f31580af420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31580a32d0 msgr2=0x7f31580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3177a60640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31580a32d0 0x7f31580a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3164005e10 tx=0x7f3164005da0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3170101de0 msgr2=0x7f31701983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3177a60640 1 --2- 172.21.15.42:0/1323325008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3170101de0 0x7f31701983c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3160005ab0 tx=0x7f31600042f0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3175ffd640 1 -- 172.21.15.42:0/1323325008 reap_dead start 2024-09-19T09:37:51.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 shutdown_connections 2024-09-19T09:37:51.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 >> 172.21.15.42:0/1323325008 conn(0x7f31700fd880 msgr2=0x7f31700febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 shutdown_connections 2024-09-19T09:37:51.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:51.918+0000 7f3177a60640 1 -- 172.21.15.42:0/1323325008 wait complete. 2024-09-19T09:37:52.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.096+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3957245848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf68100a80 msgr2=0x7fcf68100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.096+0000 7fcf6d26e640 1 --2- 172.21.15.42:0/3957245848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf68100a80 0x7fcf68100ee0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009930 tx=0x7fcf5c02a420 comp rx=0 tx=0).stop 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.096+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3957245848 shutdown_connections 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.096+0000 7fcf6d26e640 1 --2- 172.21.15.42:0/3957245848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf68101420 0x7fcf6810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.096+0000 7fcf6d26e640 1 --2- 172.21.15.42:0/3957245848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf68100a80 0x7fcf68100ee0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.096+0000 7fcf6d26e640 1 --2- 172.21.15.42:0/3957245848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf68106a80 0x7fcf68106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.096+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3957245848 >> 172.21.15.42:0/3957245848 conn(0x7fcf680fc7a0 msgr2=0x7fcf680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.096+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3957245848 shutdown_connections 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.096+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3957245848 wait complete. 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.096+0000 7fcf6d26e640 1 Processor -- start 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf6d26e640 1 -- start start 2024-09-19T09:37:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf6d26e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf68100a80 0x7fcf680fce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf6d26e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf68101420 0x7fcf680fd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf6d26e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf68106a80 0x7fcf680fd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf6d26e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68110e80 con 0x7fcf68106a80 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf6d26e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68110d00 con 0x7fcf68100a80 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf6d26e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68111000 con 0x7fcf68101420 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf68106a80 0x7fcf680fd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf68106a80 0x7fcf680fd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53428/0 (socket says 172.21.15.42:53428) 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf677fe640 1 -- 172.21.15.42:0/3685471756 learned_addr learned my addr 172.21.15.42:0/3685471756 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf667fc640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf68101420 0x7fcf680fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf66ffd640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf68100a80 0x7fcf680fce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf677fe640 1 -- 172.21.15.42:0/3685471756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf68101420 msgr2=0x7fcf680fd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf677fe640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf68101420 0x7fcf680fd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf677fe640 1 -- 172.21.15.42:0/3685471756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf68100a80 msgr2=0x7fcf680fce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf677fe640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf68100a80 0x7fcf680fce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf677fe640 1 -- 172.21.15.42:0/3685471756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf681a6930 con 0x7fcf68106a80 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.097+0000 7fcf677fe640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf68106a80 0x7fcf680fd8c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000cad0 tx=0x7fcf6000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.098+0000 7fcf4ffff640 1 -- 172.21.15.42:0/3685471756 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6000ae20 con 0x7fcf68106a80 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.098+0000 7fcf4ffff640 1 -- 172.21.15.42:0/3685471756 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf60005020 con 0x7fcf68106a80 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.098+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf681a6c20 con 0x7fcf68106a80 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.098+0000 7fcf4ffff640 1 -- 172.21.15.42:0/3685471756 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6000f6f0 con 0x7fcf68106a80 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.098+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf681a7180 con 0x7fcf68106a80 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.099+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf680628c0 con 0x7fcf68106a80 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.100+0000 7fcf4ffff640 1 -- 172.21.15.42:0/3685471756 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcf600051d0 con 0x7fcf68106a80 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.101+0000 7fcf4ffff640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf500a3350 0x7fcf500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.101+0000 7fcf66ffd640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf500a3350 0x7fcf500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.101+0000 7fcf4ffff640 1 -- 172.21.15.42:0/3685471756 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fcf600cfee0 con 0x7fcf68106a80 2024-09-19T09:37:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.101+0000 7fcf4ffff640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] conn(0x7fcf500ad000 0x7fcf500af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.101+0000 7fcf4ffff640 1 -- 172.21.15.42:0/3685471756 --> [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf60012ec0 con 0x7fcf500ad000 2024-09-19T09:37:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.101+0000 7fcf4ffff640 1 -- 172.21.15.42:0/3685471756 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fcf600d0290 con 0x7fcf68106a80 2024-09-19T09:37:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.101+0000 7fcf66ffd640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf500a3350 0x7fcf500a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800bb60 tx=0x7fcf5800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.101+0000 7fcf667fc640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] conn(0x7fcf500ad000 0x7fcf500af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.102+0000 7fcf667fc640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] conn(0x7fcf500ad000 0x7fcf500af4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.103+0000 7fcf4ffff640 1 -- 172.21.15.42:0/3685471756 <== osd.2 v2:172.21.15.171:6800/1649199499 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf60012ec0 con 0x7fcf500ad000 2024-09-19T09:37:52.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.116+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 --> [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf68062d40 con 0x7fcf500ad000 2024-09-19T09:37:52.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf4ffff640 1 -- 172.21.15.42:0/3685471756 <== osd.2 v2:172.21.15.171:6800/1649199499 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf68062d40 con 0x7fcf500ad000 2024-09-19T09:37:52.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 >> [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] conn(0x7fcf500ad000 msgr2=0x7fcf500af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf6d26e640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] conn(0x7fcf500ad000 0x7fcf500af4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf500a3350 msgr2=0x7fcf500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf6d26e640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcf500a3350 0x7fcf500a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800bb60 tx=0x7fcf5800b390 comp rx=0 tx=0).stop 2024-09-19T09:37:52.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf68106a80 msgr2=0x7fcf680fd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf6d26e640 1 --2- 172.21.15.42:0/3685471756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf68106a80 0x7fcf680fd8c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000cad0 tx=0x7fcf6000cf90 comp rx=0 tx=0).stop 2024-09-19T09:37:52.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf677fe640 1 -- 172.21.15.42:0/3685471756 reap_dead start 2024-09-19T09:37:52.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 shutdown_connections 2024-09-19T09:37:52.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 >> 172.21.15.42:0/3685471756 conn(0x7fcf680fc7a0 msgr2=0x7fcf6806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 shutdown_connections 2024-09-19T09:37:52.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.117+0000 7fcf6d26e640 1 -- 172.21.15.42:0/3685471756 wait complete. 2024-09-19T09:37:52.305 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:52 smithi042 ceph-mon[31223]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:37:52.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.304+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2772319306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac102ef0 msgr2=0x7f0bac10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.304+0000 7f0bb35ae640 1 --2- 172.21.15.42:0/2772319306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac102ef0 0x7f0bac10da40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009ca0 tx=0x7f0ba402a950 comp rx=0 tx=0).stop 2024-09-19T09:37:52.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.304+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2772319306 shutdown_connections 2024-09-19T09:37:52.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.304+0000 7f0bb35ae640 1 --2- 172.21.15.42:0/2772319306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac102ef0 0x7f0bac10da40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.304+0000 7f0bb35ae640 1 --2- 172.21.15.42:0/2772319306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac102570 0x7f0bac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.304+0000 7f0bb35ae640 1 --2- 172.21.15.42:0/2772319306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bac100e20 0x7f0bac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.304+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2772319306 >> 172.21.15.42:0/2772319306 conn(0x7f0bac0fc7d0 msgr2=0x7f0bac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.304+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2772319306 shutdown_connections 2024-09-19T09:37:52.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.304+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2772319306 wait complete. 2024-09-19T09:37:52.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.305+0000 7f0bb35ae640 1 Processor -- start 2024-09-19T09:37:52.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.305+0000 7f0bb35ae640 1 -- start start 2024-09-19T09:37:52.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.305+0000 7f0bb35ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac100e20 0x7f0bac198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.305+0000 7f0bb35ae640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac102570 0x7f0bac198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.305+0000 7f0bb35ae640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bac102ef0 0x7f0bac19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.305+0000 7f0bb35ae640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac110f80 con 0x7f0bac100e20 2024-09-19T09:37:52.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.305+0000 7f0bb35ae640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac110e00 con 0x7f0bac102570 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.305+0000 7f0bb35ae640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac111100 con 0x7f0bac102ef0 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb0b49640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac102570 0x7f0bac198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb134a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac100e20 0x7f0bac198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb0b49640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac102570 0x7f0bac198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:36378/0 (socket says 172.21.15.42:36378) 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb0b49640 1 -- 172.21.15.42:0/2894712953 learned_addr learned my addr 172.21.15.42:0/2894712953 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb1b4b640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bac102ef0 0x7f0bac19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb0b49640 1 -- 172.21.15.42:0/2894712953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bac102ef0 msgr2=0x7f0bac19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb0b49640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bac102ef0 0x7f0bac19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb0b49640 1 -- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac100e20 msgr2=0x7f0bac198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb0b49640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac100e20 0x7f0bac198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb0b49640 1 -- 172.21.15.42:0/2894712953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac19d510 con 0x7f0bac102570 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb1b4b640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bac102ef0 0x7f0bac19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:52.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.306+0000 7f0bb0b49640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac102570 0x7f0bac198aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00e9f0 tx=0x7f0b9c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.307+0000 7f0ba27fc640 1 -- 172.21.15.42:0/2894712953 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c00cd80 con 0x7f0bac102570 2024-09-19T09:37:52.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.307+0000 7f0ba27fc640 1 -- 172.21.15.42:0/2894712953 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b9c010910 con 0x7f0bac102570 2024-09-19T09:37:52.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.307+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bac19d800 con 0x7f0bac102570 2024-09-19T09:37:52.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.307+0000 7f0ba27fc640 1 -- 172.21.15.42:0/2894712953 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c018990 con 0x7f0bac102570 2024-09-19T09:37:52.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.307+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bac1a50e0 con 0x7f0bac102570 2024-09-19T09:37:52.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.308+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bac104210 con 0x7f0bac102570 2024-09-19T09:37:52.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.309+0000 7f0ba27fc640 1 -- 172.21.15.42:0/2894712953 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0b9c018b30 con 0x7f0bac102570 2024-09-19T09:37:52.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.310+0000 7f0ba27fc640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0b980a3350 0x7f0b980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.310+0000 7f0bb134a640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0b980a3350 0x7f0b980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.310+0000 7f0ba27fc640 1 -- 172.21.15.42:0/2894712953 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0b9c0cfe00 con 0x7f0bac102570 2024-09-19T09:37:52.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.310+0000 7f0ba27fc640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] conn(0x7f0b980ad000 0x7f0b980af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.310+0000 7f0ba27fc640 1 -- 172.21.15.42:0/2894712953 --> [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b9c010760 con 0x7f0b980ad000 2024-09-19T09:37:52.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.310+0000 7f0ba27fc640 1 -- 172.21.15.42:0/2894712953 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f0b9c0d2420 con 0x7f0bac102570 2024-09-19T09:37:52.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.311+0000 7f0bb134a640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0b980a3350 0x7f0b980a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009bd0 tx=0x7f0ba8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.311+0000 7f0bb1b4b640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] conn(0x7f0b980ad000 0x7f0b980af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.311+0000 7f0bb1b4b640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] conn(0x7f0b980ad000 0x7f0b980af4a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.312+0000 7f0ba27fc640 1 -- 172.21.15.42:0/2894712953 <== osd.6 v2:172.21.15.42:6818/1896771810 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b9c010760 con 0x7f0b980ad000 2024-09-19T09:37:52.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.325+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 --> [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0bac1021b0 con 0x7f0b980ad000 2024-09-19T09:37:52.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0ba27fc640 1 -- 172.21.15.42:0/2894712953 <== osd.6 v2:172.21.15.42:6818/1896771810 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0bac1021b0 con 0x7f0b980ad000 2024-09-19T09:37:52.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] conn(0x7f0b980ad000 msgr2=0x7f0b980af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb35ae640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] conn(0x7f0b980ad000 0x7f0b980af4a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0b980a3350 msgr2=0x7f0b980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb35ae640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0b980a3350 0x7f0b980a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009bd0 tx=0x7f0ba8005f90 comp rx=0 tx=0).stop 2024-09-19T09:37:52.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac102570 msgr2=0x7f0bac198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb35ae640 1 --2- 172.21.15.42:0/2894712953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bac102570 0x7f0bac198aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00e9f0 tx=0x7f0b9c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb1b4b640 1 -- 172.21.15.42:0/2894712953 reap_dead start 2024-09-19T09:37:52.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 shutdown_connections 2024-09-19T09:37:52.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 >> 172.21.15.42:0/2894712953 conn(0x7f0bac0fc7d0 msgr2=0x7f0bac103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 shutdown_connections 2024-09-19T09:37:52.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:52.326+0000 7f0bb35ae640 1 -- 172.21.15.42:0/2894712953 wait complete. 2024-09-19T09:37:52.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:52 smithi171 ceph-mon[35803]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:37:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:52 smithi136 ceph-mon[34840]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:37:53.040 INFO:teuthology.orchestra.run.smithi042.stdout:313532612628 2024-09-19T09:37:53.040 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T09:37:53.971 INFO:teuthology.orchestra.run.smithi042.stdout:283467841560 2024-09-19T09:37:53.971 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T09:37:54.194 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:54 smithi042 ceph-mon[31223]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:37:54.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:54 smithi171 ceph-mon[35803]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:37:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:54 smithi136 ceph-mon[34840]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:37:54.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.766+0000 7f602d8d9640 1 -- 172.21.15.42:0/523875041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6028106f10 msgr2=0x7f602810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.766+0000 7f602d8d9640 1 --2- 172.21.15.42:0/523875041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6028106f10 0x7f602810ea90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6020009ca0 tx=0x7f602002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.766+0000 7f602d8d9640 1 -- 172.21.15.42:0/523875041 shutdown_connections 2024-09-19T09:37:54.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.766+0000 7f602d8d9640 1 --2- 172.21.15.42:0/523875041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6028106f10 0x7f602810ea90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.766+0000 7f602d8d9640 1 --2- 172.21.15.42:0/523875041 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6028102790 0x7f60281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.766+0000 7f602d8d9640 1 --2- 172.21.15.42:0/523875041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6028101de0 0x7f60281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.767+0000 7f602d8d9640 1 -- 172.21.15.42:0/523875041 >> 172.21.15.42:0/523875041 conn(0x7f60280fd8c0 msgr2=0x7f60280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.767+0000 7f602d8d9640 1 -- 172.21.15.42:0/523875041 shutdown_connections 2024-09-19T09:37:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.767+0000 7f602d8d9640 1 -- 172.21.15.42:0/523875041 wait complete. 2024-09-19T09:37:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.767+0000 7f602d8d9640 1 Processor -- start 2024-09-19T09:37:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.767+0000 7f602d8d9640 1 -- start start 2024-09-19T09:37:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f602d8d9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6028101de0 0x7f6028198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f602d8d9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6028102790 0x7f6028198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f602d8d9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6028106f10 0x7f602819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f602d8d9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6028111f70 con 0x7f6028102790 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f602d8d9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6028111df0 con 0x7f6028106f10 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f602d8d9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f60281120f0 con 0x7f6028101de0 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f60267fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6028102790 0x7f6028198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f60267fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6028102790 0x7f6028198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53454/0 (socket says 172.21.15.42:53454) 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f60267fc640 1 -- 172.21.15.42:0/1360496609 learned_addr learned my addr 172.21.15.42:0/1360496609 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f60277fe640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6028106f10 0x7f602819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f6026ffd640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6028101de0 0x7f6028198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f60267fc640 1 -- 172.21.15.42:0/1360496609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6028101de0 msgr2=0x7f6028198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f60267fc640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6028101de0 0x7f6028198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f60267fc640 1 -- 172.21.15.42:0/1360496609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6028106f10 msgr2=0x7f602819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f60267fc640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6028106f10 0x7f602819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f60267fc640 1 -- 172.21.15.42:0/1360496609 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602819d2e0 con 0x7f6028102790 2024-09-19T09:37:54.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.768+0000 7f60267fc640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6028102790 0x7f6028198870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c920 tx=0x7f601c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:54.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.769+0000 7f602c8d7640 1 -- 172.21.15.42:0/1360496609 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c007c70 con 0x7f6028102790 2024-09-19T09:37:54.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.769+0000 7f602c8d7640 1 -- 172.21.15.42:0/1360496609 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f601c007e10 con 0x7f6028102790 2024-09-19T09:37:54.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.769+0000 7f602c8d7640 1 -- 172.21.15.42:0/1360496609 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c018890 con 0x7f6028102790 2024-09-19T09:37:54.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.769+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602819d5d0 con 0x7f6028102790 2024-09-19T09:37:54.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.769+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60281a4eb0 con 0x7f6028102790 2024-09-19T09:37:54.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.770+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60280feee0 con 0x7f6028102790 2024-09-19T09:37:54.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.771+0000 7f602c8d7640 1 -- 172.21.15.42:0/1360496609 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f601c018a70 con 0x7f6028102790 2024-09-19T09:37:54.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.772+0000 7f602c8d7640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f60100a32d0 0x7f60100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:54.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.772+0000 7f6026ffd640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f60100a32d0 0x7f60100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:54.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.772+0000 7f602c8d7640 1 -- 172.21.15.42:0/1360496609 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f601c0cfb70 con 0x7f6028102790 2024-09-19T09:37:54.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.772+0000 7f602c8d7640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] conn(0x7f60100acf80 0x7f60100af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:54.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.772+0000 7f602c8d7640 1 -- 172.21.15.42:0/1360496609 --> [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f601c012ec0 con 0x7f60100acf80 2024-09-19T09:37:54.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.772+0000 7f602c8d7640 1 -- 172.21.15.42:0/1360496609 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f601c0d42a0 con 0x7f6028102790 2024-09-19T09:37:54.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.772+0000 7f6026ffd640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f60100a32d0 0x7f60100a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60180058c0 tx=0x7f601800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:54.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.772+0000 7f60277fe640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] conn(0x7f60100acf80 0x7f60100af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:54.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.773+0000 7f60277fe640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] conn(0x7f60100acf80 0x7f60100af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:54.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.774+0000 7f602c8d7640 1 -- 172.21.15.42:0/1360496609 <== osd.7 v2:172.21.15.136:6816/1586327351 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f601c012ec0 con 0x7f60100acf80 2024-09-19T09:37:54.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.787+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 --> [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f60281032c0 con 0x7f60100acf80 2024-09-19T09:37:54.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.788+0000 7f602c8d7640 1 -- 172.21.15.42:0/1360496609 <== osd.7 v2:172.21.15.136:6816/1586327351 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f60281032c0 con 0x7f60100acf80 2024-09-19T09:37:54.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 >> [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] conn(0x7f60100acf80 msgr2=0x7f60100af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f602d8d9640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] conn(0x7f60100acf80 0x7f60100af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f60100a32d0 msgr2=0x7f60100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f602d8d9640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f60100a32d0 0x7f60100a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60180058c0 tx=0x7f601800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6028102790 msgr2=0x7f6028198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f602d8d9640 1 --2- 172.21.15.42:0/1360496609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6028102790 0x7f6028198870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c920 tx=0x7f601c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f60277fe640 1 -- 172.21.15.42:0/1360496609 reap_dead start 2024-09-19T09:37:54.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 shutdown_connections 2024-09-19T09:37:54.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 >> 172.21.15.42:0/1360496609 conn(0x7f60280fd8c0 msgr2=0x7f60280ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:54.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 shutdown_connections 2024-09-19T09:37:54.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:37:54.789+0000 7f602d8d9640 1 -- 172.21.15.42:0/1360496609 wait complete. 2024-09-19T09:37:54.925 INFO:teuthology.orchestra.run.smithi042.stdout:146028888113 2024-09-19T09:37:54.925 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T09:37:55.565 INFO:teuthology.orchestra.run.smithi042.stdout:51539607621 2024-09-19T09:37:55.565 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T09:37:55.933 INFO:teuthology.orchestra.run.smithi042.stdout:261993005087 2024-09-19T09:37:55.933 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T09:37:56.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:56 smithi042 ceph-mon[31223]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-19T09:37:56.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:56 smithi171 ceph-mon[35803]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-19T09:37:56.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:56 smithi136 ceph-mon[34840]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-19T09:37:56.439 INFO:teuthology.orchestra.run.smithi042.stdout:124554051639 2024-09-19T09:37:56.439 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T09:37:56.982 INFO:teuthology.orchestra.run.smithi042.stdout:68719476801 2024-09-19T09:37:56.982 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T09:37:57.605 INFO:teuthology.orchestra.run.smithi042.stdout:227633266724 2024-09-19T09:37:57.606 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T09:37:58.078 INFO:teuthology.orchestra.run.smithi042.stdout:197568495656 2024-09-19T09:37:58.078 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T09:37:58.337 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:37:58 smithi042 ceph-mon[31223]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:37:58.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:37:58 smithi171 ceph-mon[35803]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:37:58.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:37:58 smithi136 ceph-mon[34840]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:37:58.659 INFO:teuthology.orchestra.run.smithi042.stdout:176093659182 2024-09-19T09:37:58.659 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T09:37:59.070 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:59.117 INFO:teuthology.orchestra.run.smithi042.stdout:94489280571 2024-09-19T09:37:59.117 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T09:37:59.231 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:59.232 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:59.236 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:59.236 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:59.237 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:59.237 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:59.238 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:59.476 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:00.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:00 smithi042 ceph-mon[31223]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:38:00.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.342+0000 7fd062151640 1 -- 172.21.15.42:0/1153129026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c105560 msgr2=0x7fd05c10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:00.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.342+0000 7fd062151640 1 --2- 172.21.15.42:0/1153129026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c105560 0x7fd05c10d0e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd054009ca0 tx=0x7fd05402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:00.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.342+0000 7fd062151640 1 -- 172.21.15.42:0/1153129026 shutdown_connections 2024-09-19T09:38:00.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.342+0000 7fd062151640 1 --2- 172.21.15.42:0/1153129026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c105560 0x7fd05c10d0e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:00.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.342+0000 7fd062151640 1 --2- 172.21.15.42:0/1153129026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd05c100de0 0x7fd05c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:00.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.342+0000 7fd062151640 1 --2- 172.21.15.42:0/1153129026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd05c100430 0x7fd05c100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:00.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.342+0000 7fd062151640 1 -- 172.21.15.42:0/1153129026 >> 172.21.15.42:0/1153129026 conn(0x7fd05c077230 msgr2=0x7fd05c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:00.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.342+0000 7fd062151640 1 -- 172.21.15.42:0/1153129026 shutdown_connections 2024-09-19T09:38:00.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.342+0000 7fd062151640 1 -- 172.21.15.42:0/1153129026 wait complete. 2024-09-19T09:38:00.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.343+0000 7fd062151640 1 Processor -- start 2024-09-19T09:38:00.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.343+0000 7fd062151640 1 -- start start 2024-09-19T09:38:00.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd062151640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd05c100430 0x7fd05c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:00.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd062151640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd05c100de0 0x7fd05c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:00.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd062151640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c105560 0x7fd05c1a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:00.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd062151640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c110e40 con 0x7fd05c105560 2024-09-19T09:38:00.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd062151640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c110cc0 con 0x7fd05c100430 2024-09-19T09:38:00.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd062151640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c110fc0 con 0x7fd05c100de0 2024-09-19T09:38:00.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd05b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd05c100430 0x7fd05c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:00.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd05b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd05c100430 0x7fd05c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:36830/0 (socket says 172.21.15.42:36830) 2024-09-19T09:38:00.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd05b7fe640 1 -- 172.21.15.42:0/1528931497 learned_addr learned my addr 172.21.15.42:0/1528931497 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:00.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c105560 0x7fd05c1a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:00.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.344+0000 7fd05affd640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd05c100de0 0x7fd05c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:00.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.345+0000 7fd05affd640 1 -- 172.21.15.42:0/1528931497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd05c100430 msgr2=0x7fd05c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:00.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.345+0000 7fd05affd640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd05c100430 0x7fd05c1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.345+0000 7fd05affd640 1 -- 172.21.15.42:0/1528931497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c105560 msgr2=0x7fd05c1a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.345+0000 7fd05affd640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c105560 0x7fd05c1a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.345+0000 7fd05affd640 1 -- 172.21.15.42:0/1528931497 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c1a48b0 con 0x7fd05c100de0 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.345+0000 7fd05b7fe640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd05c100430 0x7fd05c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.345+0000 7fd05bfff640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c105560 0x7fd05c1a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.345+0000 7fd05affd640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd05c100de0 0x7fd05c199830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd05000d6d0 tx=0x7fd05000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.346+0000 7fd058ff9640 1 -- 172.21.15.42:0/1528931497 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050017070 con 0x7fd05c100de0 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.346+0000 7fd062151640 1 -- 172.21.15.42:0/1528931497 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05c1a4a80 con 0x7fd05c100de0 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.346+0000 7fd058ff9640 1 -- 172.21.15.42:0/1528931497 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd050009820 con 0x7fd05c100de0 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.346+0000 7fd062151640 1 -- 172.21.15.42:0/1528931497 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05c1a4fc0 con 0x7fd05c100de0 2024-09-19T09:38:00.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.346+0000 7fd058ff9640 1 -- 172.21.15.42:0/1528931497 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050004cd0 con 0x7fd05c100de0 2024-09-19T09:38:00.351 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:00 smithi171 ceph-mon[35803]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:38:00.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.347+0000 7fd062151640 1 -- 172.21.15.42:0/1528931497 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd048005290 con 0x7fd05c100de0 2024-09-19T09:38:00.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.349+0000 7fd058ff9640 1 -- 172.21.15.42:0/1528931497 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd050005220 con 0x7fd05c100de0 2024-09-19T09:38:00.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.350+0000 7fd058ff9640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0440a32d0 0x7fd0440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:00.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.350+0000 7fd05b7fe640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0440a32d0 0x7fd0440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:00.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.350+0000 7fd058ff9640 1 -- 172.21.15.42:0/1528931497 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd0500cf1f0 con 0x7fd05c100de0 2024-09-19T09:38:00.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.350+0000 7fd05b7fe640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0440a32d0 0x7fd0440a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd04c005fd0 tx=0x7fd04c00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:00.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.354+0000 7fd058ff9640 1 -- 172.21.15.42:0/1528931497 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd05009b6e0 con 0x7fd05c100de0 2024-09-19T09:38:00.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:00 smithi136 ceph-mon[34840]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:38:00.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.537+0000 7fd062151640 1 -- 172.21.15.42:0/1528931497 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd048005850 con 0x7fd05c100de0 2024-09-19T09:38:00.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.538+0000 7fd058ff9640 1 -- 172.21.15.42:0/1528931497 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd05009f9e0 con 0x7fd05c100de0 2024-09-19T09:38:00.540 INFO:teuthology.orchestra.run.smithi042.stdout:146028888115 2024-09-19T09:38:00.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 -- 172.21.15.42:0/1528931497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0440a32d0 msgr2=0x7fd0440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:00.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0440a32d0 0x7fd0440a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd04c005fd0 tx=0x7fd04c00b480 comp rx=0 tx=0).stop 2024-09-19T09:38:00.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 -- 172.21.15.42:0/1528931497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd05c100de0 msgr2=0x7fd05c199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:00.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd05c100de0 0x7fd05c199830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd05000d6d0 tx=0x7fd05000db90 comp rx=0 tx=0).stop 2024-09-19T09:38:00.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 -- 172.21.15.42:0/1528931497 shutdown_connections 2024-09-19T09:38:00.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0440a32d0 0x7fd0440a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:00.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c105560 0x7fd05c1a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:00.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd05c100de0 0x7fd05c199830 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:00.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 --2- 172.21.15.42:0/1528931497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd05c100430 0x7fd05c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:00.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 -- 172.21.15.42:0/1528931497 >> 172.21.15.42:0/1528931497 conn(0x7fd05c077230 msgr2=0x7fd05c103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:00.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 -- 172.21.15.42:0/1528931497 shutdown_connections 2024-09-19T09:38:00.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.540+0000 7fd062151640 1 -- 172.21.15.42:0/1528931497 wait complete. 2024-09-19T09:38:01.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:01 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1265875841' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:38:01.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:01 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1528931497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:38:01.267 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888113 got 146028888115 for osd.5 2024-09-19T09:38:01.267 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:01.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:01 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1265875841' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:38:01.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:01 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1528931497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:38:01.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:01 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1265875841' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:38:01.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:01 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1528931497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:38:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.783+0000 7f1809e33640 1 -- 172.21.15.42:0/3202060264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f180410c180 msgr2=0x7f180410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.783+0000 7f1809e33640 1 --2- 172.21.15.42:0/3202060264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f180410c180 0x7f180410e600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009ca0 tx=0x7f17fc02a950 comp rx=0 tx=0).stop 2024-09-19T09:38:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.783+0000 7f1809e33640 1 -- 172.21.15.42:0/3202060264 shutdown_connections 2024-09-19T09:38:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.783+0000 7f1809e33640 1 --2- 172.21.15.42:0/3202060264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f180410c180 0x7f180410e600 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.783+0000 7f1809e33640 1 --2- 172.21.15.42:0/3202060264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18041036c0 0x7f180410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.783+0000 7f1809e33640 1 --2- 172.21.15.42:0/3202060264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1804102da0 0x7f1804103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.783+0000 7f1809e33640 1 -- 172.21.15.42:0/3202060264 >> 172.21.15.42:0/3202060264 conn(0x7f18040fc7a0 msgr2=0x7f18040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.783+0000 7f1809e33640 1 -- 172.21.15.42:0/3202060264 shutdown_connections 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.783+0000 7f1809e33640 1 -- 172.21.15.42:0/3202060264 wait complete. 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f1809e33640 1 Processor -- start 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f1809e33640 1 -- start start 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f1809e33640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1804102da0 0x7f180419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f1809e33640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18041036c0 0x7f180419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f1809e33640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180410c180 0x7f180419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f1809e33640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1804111fa0 con 0x7f1804102da0 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f1809e33640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1804111e20 con 0x7f18041036c0 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f1809e33640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1804112120 con 0x7f180410c180 2024-09-19T09:38:01.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f18037fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1804102da0 0x7f180419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f18037fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1804102da0 0x7f180419a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50142/0 (socket says 172.21.15.42:50142) 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.784+0000 7f18037fe640 1 -- 172.21.15.42:0/2434287228 learned_addr learned my addr 172.21.15.42:0/2434287228 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f1803fff640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180410c180 0x7f180419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f1802ffd640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18041036c0 0x7f180419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f18037fe640 1 -- 172.21.15.42:0/2434287228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180410c180 msgr2=0x7f180419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f18037fe640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180410c180 0x7f180419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f18037fe640 1 -- 172.21.15.42:0/2434287228 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18041036c0 msgr2=0x7f180419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f18037fe640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18041036c0 0x7f180419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f18037fe640 1 -- 172.21.15.42:0/2434287228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180419f650 con 0x7f1804102da0 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f18037fe640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1804102da0 0x7f180419a6a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f17f400b4a0 tx=0x7f17f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f1800ff9640 1 -- 172.21.15.42:0/2434287228 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f4014070 con 0x7f1804102da0 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f1800ff9640 1 -- 172.21.15.42:0/2434287228 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17f4010af0 con 0x7f1804102da0 2024-09-19T09:38:01.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f1809e33640 1 -- 172.21.15.42:0/2434287228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180419f940 con 0x7f1804102da0 2024-09-19T09:38:01.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f1800ff9640 1 -- 172.21.15.42:0/2434287228 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f4017d10 con 0x7f1804102da0 2024-09-19T09:38:01.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.785+0000 7f1809e33640 1 -- 172.21.15.42:0/2434287228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18041a7220 con 0x7f1804102da0 2024-09-19T09:38:01.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.786+0000 7f1809e33640 1 -- 172.21.15.42:0/2434287228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1804103180 con 0x7f1804102da0 2024-09-19T09:38:01.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.787+0000 7f1800ff9640 1 -- 172.21.15.42:0/2434287228 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f17f4017070 con 0x7f1804102da0 2024-09-19T09:38:01.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.788+0000 7f1800ff9640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f17ec0a32d0 0x7f17ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:01.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.788+0000 7f1800ff9640 1 -- 172.21.15.42:0/2434287228 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f17f40ceea0 con 0x7f1804102da0 2024-09-19T09:38:01.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.788+0000 7f1802ffd640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f17ec0a32d0 0x7f17ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:01.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.789+0000 7f1802ffd640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f17ec0a32d0 0x7f17ec0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18040febe0 tx=0x7f17f800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:01.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.792+0000 7f1800ff9640 1 -- 172.21.15.42:0/2434287228 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f17f409bb50 con 0x7f1804102da0 2024-09-19T09:38:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.972+0000 7f1809e33640 1 -- 172.21.15.42:0/2434287228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f18041a73f0 con 0x7f1804102da0 2024-09-19T09:38:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.972+0000 7f1800ff9640 1 -- 172.21.15.42:0/2434287228 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f17f409b450 con 0x7f1804102da0 2024-09-19T09:38:01.974 INFO:teuthology.orchestra.run.smithi042.stdout:51539607624 2024-09-19T09:38:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.974+0000 7f1809e33640 1 -- 172.21.15.42:0/2434287228 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f17ec0a32d0 msgr2=0x7f17ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.974+0000 7f1809e33640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f17ec0a32d0 0x7f17ec0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18040febe0 tx=0x7f17f800a4c0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.974+0000 7f1809e33640 1 -- 172.21.15.42:0/2434287228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1804102da0 msgr2=0x7f180419a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.974+0000 7f1809e33640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1804102da0 0x7f180419a6a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f17f400b4a0 tx=0x7f17f400b960 comp rx=0 tx=0).stop 2024-09-19T09:38:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.974+0000 7f1809e33640 1 -- 172.21.15.42:0/2434287228 shutdown_connections 2024-09-19T09:38:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.974+0000 7f1809e33640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f17ec0a32d0 0x7f17ec0a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.974+0000 7f1809e33640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180410c180 0x7f180419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.974+0000 7f1809e33640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18041036c0 0x7f180419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.974+0000 7f1809e33640 1 --2- 172.21.15.42:0/2434287228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1804102da0 0x7f180419a6a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.974+0000 7f1809e33640 1 -- 172.21.15.42:0/2434287228 >> 172.21.15.42:0/2434287228 conn(0x7f18040fc7a0 msgr2=0x7f1804100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.975+0000 7f1809e33640 1 -- 172.21.15.42:0/2434287228 shutdown_connections 2024-09-19T09:38:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:01.975+0000 7f1809e33640 1 -- 172.21.15.42:0/2434287228 wait complete. 2024-09-19T09:38:02.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:02 smithi171 ceph-mon[35803]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:38:02.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:02 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2434287228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:38:02.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:02 smithi042 ceph-mon[31223]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:38:02.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:02 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2434287228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:38:02.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:02 smithi136 ceph-mon[34840]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:38:02.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:02 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2434287228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:38:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.004+0000 7f78fccb3640 1 -- 172.21.15.42:0/3935976415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f80745c0 msgr2=0x7f78f80749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.004+0000 7f78fccb3640 1 --2- 172.21.15.42:0/3935976415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f80745c0 0x7f78f80749a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009900 tx=0x7f78e802a480 comp rx=0 tx=0).stop 2024-09-19T09:38:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.005+0000 7f78fccb3640 1 -- 172.21.15.42:0/3935976415 shutdown_connections 2024-09-19T09:38:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.005+0000 7f78fccb3640 1 --2- 172.21.15.42:0/3935976415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78f810e430 0x7f78f8110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.005+0000 7f78fccb3640 1 --2- 172.21.15.42:0/3935976415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f8074ee0 0x7f78f810def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.005+0000 7f78fccb3640 1 --2- 172.21.15.42:0/3935976415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f80745c0 0x7f78f80749a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.005+0000 7f78fccb3640 1 -- 172.21.15.42:0/3935976415 >> 172.21.15.42:0/3935976415 conn(0x7f78f80fd8f0 msgr2=0x7f78f80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.005+0000 7f78fccb3640 1 -- 172.21.15.42:0/3935976415 shutdown_connections 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.005+0000 7f78fccb3640 1 -- 172.21.15.42:0/3935976415 wait complete. 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78fccb3640 1 Processor -- start 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78fccb3640 1 -- start start 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78fccb3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f80745c0 0x7f78f819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78fccb3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f8074ee0 0x7f78f819acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78fccb3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78f810e430 0x7f78f819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78fccb3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78f8114180 con 0x7f78f80745c0 2024-09-19T09:38:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78fccb3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f78f8114000 con 0x7f78f810e430 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78fccb3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f78f8114300 con 0x7f78f8074ee0 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78f659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f80745c0 0x7f78f819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78f659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f80745c0 0x7f78f819a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50186/0 (socket says 172.21.15.42:50186) 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78f659c640 1 -- 172.21.15.42:0/2021449655 learned_addr learned my addr 172.21.15.42:0/2021449655 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78f5d9b640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f8074ee0 0x7f78f819acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.006+0000 7f78f6d9d640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78f810e430 0x7f78f819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78f659c640 1 -- 172.21.15.42:0/2021449655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f8074ee0 msgr2=0x7f78f819acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78f659c640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f8074ee0 0x7f78f819acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78f659c640 1 -- 172.21.15.42:0/2021449655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78f810e430 msgr2=0x7f78f819dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78f659c640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78f810e430 0x7f78f819dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78f659c640 1 -- 172.21.15.42:0/2021449655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f819e6d0 con 0x7f78f80745c0 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78f5d9b640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f8074ee0 0x7f78f819acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78f6d9d640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78f810e430 0x7f78f819dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78f659c640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f80745c0 0x7f78f819a780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f78e8006010 tx=0x7f78e8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78e77fe640 1 -- 172.21.15.42:0/2021449655 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e803f030 con 0x7f78f80745c0 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78e77fe640 1 -- 172.21.15.42:0/2021449655 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78e8004440 con 0x7f78f80745c0 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78fccb3640 1 -- 172.21.15.42:0/2021449655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f819e960 con 0x7f78f80745c0 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78e77fe640 1 -- 172.21.15.42:0/2021449655 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8035070 con 0x7f78f80745c0 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.007+0000 7f78fccb3640 1 -- 172.21.15.42:0/2021449655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f81a7330 con 0x7f78f80745c0 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.008+0000 7f78fccb3640 1 -- 172.21.15.42:0/2021449655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f80749a0 con 0x7f78f80745c0 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.010+0000 7f78e77fe640 1 -- 172.21.15.42:0/2021449655 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f78e8042030 con 0x7f78f80745c0 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.011+0000 7f78e77fe640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78e00a32d0 0x7f78e00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.011+0000 7f78f5d9b640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78e00a32d0 0x7f78e00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.011+0000 7f78e77fe640 1 -- 172.21.15.42:0/2021449655 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f78e80eff80 con 0x7f78f80745c0 2024-09-19T09:38:03.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.011+0000 7f78f5d9b640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78e00a32d0 0x7f78e00a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f78f810f870 tx=0x7f78ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:03.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.015+0000 7f78e77fe640 1 -- 172.21.15.42:0/2021449655 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78e80bcb20 con 0x7f78f80745c0 2024-09-19T09:38:03.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.901+0000 7f1c9d763640 1 -- 172.21.15.42:0/2444326083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c98074510 msgr2=0x7f1c980748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.901+0000 7f1c9d763640 1 --2- 172.21.15.42:0/2444326083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c98074510 0x7f1c980748f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009900 tx=0x7f1c8802a480 comp rx=0 tx=0).stop 2024-09-19T09:38:03.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.901+0000 7f1c9d763640 1 -- 172.21.15.42:0/2444326083 shutdown_connections 2024-09-19T09:38:03.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.901+0000 7f1c9d763640 1 --2- 172.21.15.42:0/2444326083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c9810e440 0x7f1c98110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.901+0000 7f1c9d763640 1 --2- 172.21.15.42:0/2444326083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c98074e30 0x7f1c9810df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.901+0000 7f1c9d763640 1 --2- 172.21.15.42:0/2444326083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c98074510 0x7f1c980748f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.901+0000 7f1c9d763640 1 -- 172.21.15.42:0/2444326083 >> 172.21.15.42:0/2444326083 conn(0x7f1c980fd8c0 msgr2=0x7f1c980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.901+0000 7f1c9d763640 1 -- 172.21.15.42:0/2444326083 shutdown_connections 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.901+0000 7f1c9d763640 1 -- 172.21.15.42:0/2444326083 wait complete. 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c9d763640 1 Processor -- start 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c9d763640 1 -- start start 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c9d763640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c98074510 0x7f1c9819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c9d763640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c98074e30 0x7f1c9819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c9d763640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c9810e440 0x7f1c9819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c9d763640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1c981141e0 con 0x7f1c9810e440 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c9d763640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98114060 con 0x7f1c98074e30 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c9d763640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98114360 con 0x7f1c98074510 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c9810e440 0x7f1c9819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c9810e440 0x7f1c9819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50176/0 (socket says 172.21.15.42:50176) 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c977fe640 1 -- 172.21.15.42:0/2016240861 learned_addr learned my addr 172.21.15.42:0/2016240861 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:03.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.902+0000 7f1c967fc640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c98074e30 0x7f1c9819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c96ffd640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c98074510 0x7f1c9819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c977fe640 1 -- 172.21.15.42:0/2016240861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c98074510 msgr2=0x7f1c9819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c977fe640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c98074510 0x7f1c9819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c977fe640 1 -- 172.21.15.42:0/2016240861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c98074e30 msgr2=0x7f1c9819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c977fe640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c98074e30 0x7f1c9819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c977fe640 1 -- 172.21.15.42:0/2016240861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9819f690 con 0x7f1c9810e440 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c977fe640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c9810e440 0x7f1c9819efb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000b9e0 tx=0x7f1c9000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c7ffff640 1 -- 172.21.15.42:0/2016240861 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90019070 con 0x7f1c9810e440 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c7ffff640 1 -- 172.21.15.42:0/2016240861 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c90014440 con 0x7f1c9810e440 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c9d763640 1 -- 172.21.15.42:0/2016240861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9819f980 con 0x7f1c9810e440 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c7ffff640 1 -- 172.21.15.42:0/2016240861 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c900125c0 con 0x7f1c9810e440 2024-09-19T09:38:03.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.903+0000 7f1c9d763640 1 -- 172.21.15.42:0/2016240861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c981a7260 con 0x7f1c9810e440 2024-09-19T09:38:03.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.905+0000 7f1c9d763640 1 -- 172.21.15.42:0/2016240861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c980748f0 con 0x7f1c9810e440 2024-09-19T09:38:03.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.906+0000 7f1c7ffff640 1 -- 172.21.15.42:0/2016240861 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1c9001c070 con 0x7f1c9810e440 2024-09-19T09:38:03.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.907+0000 7f1c7ffff640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1c800a32d0 0x7f1c800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.907+0000 7f1c7ffff640 1 -- 172.21.15.42:0/2016240861 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f1c900cf040 con 0x7f1c9810e440 2024-09-19T09:38:03.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.907+0000 7f1c96ffd640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1c800a32d0 0x7f1c800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.158 INFO:teuthology.orchestra.run.smithi042.stdout:261993005089 2024-09-19T09:38:03.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.907+0000 7f1c96ffd640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1c800a32d0 0x7f1c800a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1c88000c00 tx=0x7f1c880314b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:03.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.911+0000 7f1c7ffff640 1 -- 172.21.15.42:0/2016240861 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c9009bcf0 con 0x7f1c9810e440 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.099+0000 7f1c9d763640 1 -- 172.21.15.42:0/2016240861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f1c981095c0 con 0x7f1c9810e440 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.101+0000 7f1c7ffff640 1 -- 172.21.15.42:0/2016240861 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1c9009b5f0 con 0x7f1c9810e440 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 -- 172.21.15.42:0/2016240861 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1c800a32d0 msgr2=0x7f1c800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1c800a32d0 0x7f1c800a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1c88000c00 tx=0x7f1c880314b0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 -- 172.21.15.42:0/2016240861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c9810e440 msgr2=0x7f1c9819efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c9810e440 0x7f1c9819efb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000b9e0 tx=0x7f1c9000bea0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 -- 172.21.15.42:0/2016240861 shutdown_connections 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1c800a32d0 0x7f1c800a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c9810e440 0x7f1c9819efb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c98074e30 0x7f1c9819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 --2- 172.21.15.42:0/2016240861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c98074510 0x7f1c9819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 -- 172.21.15.42:0/2016240861 >> 172.21.15.42:0/2016240861 conn(0x7f1c980fd8c0 msgr2=0x7f1c980fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 -- 172.21.15.42:0/2016240861 shutdown_connections 2024-09-19T09:38:03.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.103+0000 7f1c9d763640 1 -- 172.21.15.42:0/2016240861 wait complete. 2024-09-19T09:38:03.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.202+0000 7f78fccb3640 1 -- 172.21.15.42:0/2021449655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f78f81095b0 con 0x7f78f80745c0 2024-09-19T09:38:03.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.202+0000 7f78e77fe640 1 -- 172.21.15.42:0/2021449655 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f78e80bc420 con 0x7f78f80745c0 2024-09-19T09:38:03.204 INFO:teuthology.orchestra.run.smithi042.stdout:124554051641 2024-09-19T09:38:03.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.204+0000 7f78fccb3640 1 -- 172.21.15.42:0/2021449655 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78e00a32d0 msgr2=0x7f78e00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.204+0000 7f78fccb3640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78e00a32d0 0x7f78e00a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f78f810f870 tx=0x7f78ec005f90 comp rx=0 tx=0).stop 2024-09-19T09:38:03.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.204+0000 7f78fccb3640 1 -- 172.21.15.42:0/2021449655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f80745c0 msgr2=0x7f78f819a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.204+0000 7f78fccb3640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f80745c0 0x7f78f819a780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f78e8006010 tx=0x7f78e8004040 comp rx=0 tx=0).stop 2024-09-19T09:38:03.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.204+0000 7f78fccb3640 1 -- 172.21.15.42:0/2021449655 shutdown_connections 2024-09-19T09:38:03.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.204+0000 7f78fccb3640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78e00a32d0 0x7f78e00a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.204+0000 7f78fccb3640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78f810e430 0x7f78f819dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.204+0000 7f78fccb3640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f8074ee0 0x7f78f819acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.204+0000 7f78fccb3640 1 --2- 172.21.15.42:0/2021449655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78f80745c0 0x7f78f819a780 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.205+0000 7f78fccb3640 1 -- 172.21.15.42:0/2021449655 >> 172.21.15.42:0/2021449655 conn(0x7f78f80fd8f0 msgr2=0x7f78f80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.205+0000 7f78fccb3640 1 -- 172.21.15.42:0/2021449655 shutdown_connections 2024-09-19T09:38:03.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.205+0000 7f78fccb3640 1 -- 172.21.15.42:0/2021449655 wait complete. 2024-09-19T09:38:03.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:03 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2879074605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:38:03.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:03 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2879074605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:38:03.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.555+0000 7f5a3dced640 1 -- 172.21.15.42:0/2545180918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38102570 msgr2=0x7f5a381029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.555+0000 7f5a3dced640 1 --2- 172.21.15.42:0/2545180918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38102570 0x7f5a381029b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009900 tx=0x7f5a2c02a480 comp rx=0 tx=0).stop 2024-09-19T09:38:03.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.555+0000 7f5a3dced640 1 -- 172.21.15.42:0/2545180918 shutdown_connections 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.555+0000 7f5a3dced640 1 --2- 172.21.15.42:0/2545180918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a38102ef0 0x7f5a3810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.555+0000 7f5a3dced640 1 --2- 172.21.15.42:0/2545180918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38102570 0x7f5a381029b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.555+0000 7f5a3dced640 1 --2- 172.21.15.42:0/2545180918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a38100e20 0x7f5a38101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.555+0000 7f5a3dced640 1 -- 172.21.15.42:0/2545180918 >> 172.21.15.42:0/2545180918 conn(0x7f5a380fc7d0 msgr2=0x7f5a380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.556+0000 7f5a3dced640 1 -- 172.21.15.42:0/2545180918 shutdown_connections 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.556+0000 7f5a3dced640 1 -- 172.21.15.42:0/2545180918 wait complete. 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.556+0000 7f5a3dced640 1 Processor -- start 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a3dced640 1 -- start start 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a3dced640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38100e20 0x7f5a38199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a3dced640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a38102570 0x7f5a381997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a3dced640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a38102ef0 0x7f5a381a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a3dced640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a38110f80 con 0x7f5a38100e20 2024-09-19T09:38:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a3dced640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5a38110e00 con 0x7f5a38102ef0 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a3dced640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5a38111100 con 0x7f5a38102570 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a377fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38100e20 0x7f5a38199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a377fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38100e20 0x7f5a38199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50196/0 (socket says 172.21.15.42:50196) 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a377fe640 1 -- 172.21.15.42:0/169285712 learned_addr learned my addr 172.21.15.42:0/169285712 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a36ffd640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a38102570 0x7f5a381997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a37fff640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a38102ef0 0x7f5a381a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a377fe640 1 -- 172.21.15.42:0/169285712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a38102570 msgr2=0x7f5a381997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a377fe640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a38102570 0x7f5a381997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a377fe640 1 -- 172.21.15.42:0/169285712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a38102ef0 msgr2=0x7f5a381a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a377fe640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a38102ef0 0x7f5a381a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a377fe640 1 -- 172.21.15.42:0/169285712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a381a4850 con 0x7f5a38100e20 2024-09-19T09:38:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a37fff640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a38102ef0 0x7f5a381a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.557+0000 7f5a377fe640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38100e20 0x7f5a38199290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800eab0 tx=0x7f5a2800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.558+0000 7f5a34ff9640 1 -- 172.21.15.42:0/169285712 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800ce40 con 0x7f5a38100e20 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.558+0000 7f5a34ff9640 1 -- 172.21.15.42:0/169285712 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a28011950 con 0x7f5a38100e20 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.558+0000 7f5a3dced640 1 -- 172.21.15.42:0/169285712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a381a4a20 con 0x7f5a38100e20 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.558+0000 7f5a34ff9640 1 -- 172.21.15.42:0/169285712 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28010ae0 con 0x7f5a38100e20 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.558+0000 7f5a3dced640 1 -- 172.21.15.42:0/169285712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a381a4f30 con 0x7f5a38100e20 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.559+0000 7f5a3dced640 1 -- 172.21.15.42:0/169285712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a38101200 con 0x7f5a38100e20 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.560+0000 7f5a34ff9640 1 -- 172.21.15.42:0/169285712 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5a28011b00 con 0x7f5a38100e20 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.561+0000 7f5a34ff9640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5a200a3350 0x7f5a200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.561+0000 7f5a36ffd640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5a200a3350 0x7f5a200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.561+0000 7f5a34ff9640 1 -- 172.21.15.42:0/169285712 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f5a280d0130 con 0x7f5a38100e20 2024-09-19T09:38:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.561+0000 7f5a36ffd640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5a200a3350 0x7f5a200a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009230 tx=0x7f5a2c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:03.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.564+0000 7f5a34ff9640 1 -- 172.21.15.42:0/169285712 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a28016030 con 0x7f5a38100e20 2024-09-19T09:38:03.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:03 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2879074605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:38:03.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 -- 172.21.15.42:0/3655299851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208c102570 msgr2=0x7f208c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 --2- 172.21.15.42:0/3655299851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208c102570 0x7f208c1029b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2080009900 tx=0x7f208002a480 comp rx=0 tx=0).stop 2024-09-19T09:38:03.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 -- 172.21.15.42:0/3655299851 shutdown_connections 2024-09-19T09:38:03.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 --2- 172.21.15.42:0/3655299851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f208c102ef0 0x7f208c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 --2- 172.21.15.42:0/3655299851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208c102570 0x7f208c1029b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 --2- 172.21.15.42:0/3655299851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c100e20 0x7f208c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 -- 172.21.15.42:0/3655299851 >> 172.21.15.42:0/3655299851 conn(0x7f208c0fc7d0 msgr2=0x7f208c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 -- 172.21.15.42:0/3655299851 shutdown_connections 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 -- 172.21.15.42:0/3655299851 wait complete. 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 Processor -- start 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.231+0000 7f2093f89640 1 -- start start 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2093f89640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c100e20 0x7f208c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2093f89640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208c102570 0x7f208c197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2093f89640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f208c102ef0 0x7f208c197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2093f89640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f208c110fa0 con 0x7f208c102570 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2093f89640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f208c110e20 con 0x7f208c102ef0 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2093f89640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f208c111120 con 0x7f208c100e20 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2091524640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208c102570 0x7f208c197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2091524640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208c102570 0x7f208c197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53460/0 (socket says 172.21.15.42:53460) 2024-09-19T09:38:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2091524640 1 -- 172.21.15.42:0/1265875841 learned_addr learned my addr 172.21.15.42:0/1265875841 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:03.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2091d25640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c100e20 0x7f208c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.651 INFO:teuthology.orchestra.run.smithi042.stdout:34359738444 2024-09-19T09:38:03.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2092526640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f208c102ef0 0x7f208c197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2091524640 1 -- 172.21.15.42:0/1265875841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c100e20 msgr2=0x7f208c1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2091524640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c100e20 0x7f208c1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2091524640 1 -- 172.21.15.42:0/1265875841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f208c102ef0 msgr2=0x7f208c197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2091524640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f208c102ef0 0x7f208c197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2091524640 1 -- 172.21.15.42:0/1265875841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208c1a6a30 con 0x7f208c102570 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f2091524640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208c102570 0x7f208c197700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2080006010 tx=0x7f2080003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f208affd640 1 -- 172.21.15.42:0/1265875841 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208003f070 con 0x7f208c102570 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.232+0000 7f208affd640 1 -- 172.21.15.42:0/1265875841 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2080031e30 con 0x7f208c102570 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.233+0000 7f2093f89640 1 -- 172.21.15.42:0/1265875841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208c1a6cc0 con 0x7f208c102570 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.233+0000 7f208affd640 1 -- 172.21.15.42:0/1265875841 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080035030 con 0x7f208c102570 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.233+0000 7f2093f89640 1 -- 172.21.15.42:0/1265875841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f208c1a71a0 con 0x7f208c102570 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.233+0000 7f2093f89640 1 -- 172.21.15.42:0/1265875841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f208c101200 con 0x7f208c102570 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.235+0000 7f208affd640 1 -- 172.21.15.42:0/1265875841 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2080042070 con 0x7f208c102570 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.235+0000 7f208affd640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20740a32d0 0x7f20740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.235+0000 7f2091d25640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20740a32d0 0x7f20740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.236+0000 7f208affd640 1 -- 172.21.15.42:0/1265875841 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f20800f0410 con 0x7f208c102570 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.236+0000 7f2091d25640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20740a32d0 0x7f20740a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f207c00a400 tx=0x7f207c00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.240+0000 7f208affd640 1 -- 172.21.15.42:0/1265875841 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f20800bcfb0 con 0x7f208c102570 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.424+0000 7f2093f89640 1 -- 172.21.15.42:0/1265875841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f208c108b00 con 0x7f208c102570 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.424+0000 7f208affd640 1 -- 172.21.15.42:0/1265875841 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f20800bc8b0 con 0x7f208c102570 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 -- 172.21.15.42:0/1265875841 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20740a32d0 msgr2=0x7f20740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20740a32d0 0x7f20740a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f207c00a400 tx=0x7f207c00d040 comp rx=0 tx=0).stop 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 -- 172.21.15.42:0/1265875841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208c102570 msgr2=0x7f208c197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208c102570 0x7f208c197700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2080006010 tx=0x7f2080003c80 comp rx=0 tx=0).stop 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 -- 172.21.15.42:0/1265875841 shutdown_connections 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20740a32d0 0x7f20740a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f208c102ef0 0x7f208c197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f208c102570 0x7f208c197700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 --2- 172.21.15.42:0/1265875841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c100e20 0x7f208c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 -- 172.21.15.42:0/1265875841 >> 172.21.15.42:0/1265875841 conn(0x7f208c0fc7d0 msgr2=0x7f208c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 -- 172.21.15.42:0/1265875841 shutdown_connections 2024-09-19T09:38:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:00.426+0000 7f2093f89640 1 -- 172.21.15.42:0/1265875841 wait complete. 2024-09-19T09:38:03.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.742+0000 7f5a3dced640 1 -- 172.21.15.42:0/169285712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f5a3806a560 con 0x7f5a38100e20 2024-09-19T09:38:03.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.742+0000 7f5a34ff9640 1 -- 172.21.15.42:0/169285712 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5a3806a560 con 0x7f5a38100e20 2024-09-19T09:38:03.744 INFO:teuthology.orchestra.run.smithi042.stdout:313532612631 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 -- 172.21.15.42:0/169285712 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5a200a3350 msgr2=0x7f5a200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5a200a3350 0x7f5a200a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009230 tx=0x7f5a2c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 -- 172.21.15.42:0/169285712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38100e20 msgr2=0x7f5a38199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38100e20 0x7f5a38199290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800eab0 tx=0x7f5a2800ef70 comp rx=0 tx=0).stop 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 -- 172.21.15.42:0/169285712 shutdown_connections 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5a200a3350 0x7f5a200a5810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a38102ef0 0x7f5a381a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a38102570 0x7f5a381997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 --2- 172.21.15.42:0/169285712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38100e20 0x7f5a38199290 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 -- 172.21.15.42:0/169285712 >> 172.21.15.42:0/169285712 conn(0x7f5a380fc7d0 msgr2=0x7f5a38105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 -- 172.21.15.42:0/169285712 shutdown_connections 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:03.744+0000 7f5a3dced640 1 -- 172.21.15.42:0/169285712 wait complete. 2024-09-19T09:38:04.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.792+0000 7f276ca00640 1 -- 172.21.15.42:0/1865633676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2768103530 msgr2=0x7f276810ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:04.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.792+0000 7f276ca00640 1 --2- 172.21.15.42:0/1865633676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2768103530 0x7f276810ba20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2750009900 tx=0x7f275002a480 comp rx=0 tx=0).stop 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.792+0000 7f276ca00640 1 -- 172.21.15.42:0/1865633676 shutdown_connections 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.792+0000 7f276ca00640 1 --2- 172.21.15.42:0/1865633676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f276810bff0 0x7f276810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.792+0000 7f276ca00640 1 --2- 172.21.15.42:0/1865633676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2768103530 0x7f276810ba20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.792+0000 7f276ca00640 1 --2- 172.21.15.42:0/1865633676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2768102c10 0x7f2768102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.792+0000 7f276ca00640 1 -- 172.21.15.42:0/1865633676 >> 172.21.15.42:0/1865633676 conn(0x7f27680fc610 msgr2=0x7f27680fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.793+0000 7f276ca00640 1 -- 172.21.15.42:0/1865633676 shutdown_connections 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.793+0000 7f276ca00640 1 -- 172.21.15.42:0/1865633676 wait complete. 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.793+0000 7f276ca00640 1 Processor -- start 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276ca00640 1 -- start start 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276ca00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2768102c10 0x7f2768198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276ca00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2768103530 0x7f27681987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f276810bff0 0x7f276819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276ca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2768111e00 con 0x7f276810bff0 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276ca00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2768111c80 con 0x7f2768102c10 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276ca00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2768111f80 con 0x7f2768103530 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276759e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f276810bff0 0x7f276819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276759e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f276810bff0 0x7f276819cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50154/0 (socket says 172.21.15.42:50154) 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276759e640 1 -- 172.21.15.42:0/2879074605 learned_addr learned my addr 172.21.15.42:0/2879074605 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f2766d9d640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2768102c10 0x7f2768198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276659c640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2768103530 0x7f27681987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276759e640 1 -- 172.21.15.42:0/2879074605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2768103530 msgr2=0x7f27681987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276759e640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2768103530 0x7f27681987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276759e640 1 -- 172.21.15.42:0/2879074605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2768102c10 msgr2=0x7f2768198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276759e640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2768102c10 0x7f2768198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.794+0000 7f276759e640 1 -- 172.21.15.42:0/2879074605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276819d210 con 0x7f276810bff0 2024-09-19T09:38:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.795+0000 7f276759e640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f276810bff0 0x7f276819cb30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2760009fd0 tx=0x7f276000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.795+0000 7f275ffff640 1 -- 172.21.15.42:0/2879074605 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2760011830 con 0x7f276810bff0 2024-09-19T09:38:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.795+0000 7f276ca00640 1 -- 172.21.15.42:0/2879074605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276819d500 con 0x7f276810bff0 2024-09-19T09:38:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.795+0000 7f275ffff640 1 -- 172.21.15.42:0/2879074605 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2760016070 con 0x7f276810bff0 2024-09-19T09:38:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.795+0000 7f275ffff640 1 -- 172.21.15.42:0/2879074605 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276000f2e0 con 0x7f276810bff0 2024-09-19T09:38:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.795+0000 7f276ca00640 1 -- 172.21.15.42:0/2879074605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27681a4de0 con 0x7f276810bff0 2024-09-19T09:38:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.796+0000 7f276ca00640 1 -- 172.21.15.42:0/2879074605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2768102ff0 con 0x7f276810bff0 2024-09-19T09:38:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.797+0000 7f275ffff640 1 -- 172.21.15.42:0/2879074605 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f27600119d0 con 0x7f276810bff0 2024-09-19T09:38:04.147 INFO:teuthology.orchestra.run.smithi042.stdout:283467841562 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.798+0000 7f275ffff640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f27540a3350 0x7f27540a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.798+0000 7f275ffff640 1 -- 172.21.15.42:0/2879074605 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f27600cef70 con 0x7f276810bff0 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.798+0000 7f2766d9d640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f27540a3350 0x7f27540a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.799+0000 7f2766d9d640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f27540a3350 0x7f27540a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2758007ec0 tx=0x7f27580075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.802+0000 7f275ffff640 1 -- 172.21.15.42:0/2879074605 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f276009bc20 con 0x7f276810bff0 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.988+0000 7f276ca00640 1 -- 172.21.15.42:0/2879074605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f2768106aa0 con 0x7f276810bff0 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.988+0000 7f275ffff640 1 -- 172.21.15.42:0/2879074605 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f276009b520 con 0x7f276810bff0 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 -- 172.21.15.42:0/2879074605 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f27540a3350 msgr2=0x7f27540a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f27540a3350 0x7f27540a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2758007ec0 tx=0x7f27580075b0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 -- 172.21.15.42:0/2879074605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f276810bff0 msgr2=0x7f276819cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f276810bff0 0x7f276819cb30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2760009fd0 tx=0x7f276000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 -- 172.21.15.42:0/2879074605 shutdown_connections 2024-09-19T09:38:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f27540a3350 0x7f27540a5810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f276810bff0 0x7f276819cb30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2768103530 0x7f27681987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 --2- 172.21.15.42:0/2879074605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2768102c10 0x7f2768198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 -- 172.21.15.42:0/2879074605 >> 172.21.15.42:0/2879074605 conn(0x7f27680fc610 msgr2=0x7f27680fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 -- 172.21.15.42:0/2879074605 shutdown_connections 2024-09-19T09:38:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:02.992+0000 7f276ca00640 1 -- 172.21.15.42:0/2879074605 wait complete. 2024-09-19T09:38:04.361 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:04 smithi136 ceph-mon[34840]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T09:38:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:04 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2016240861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:38:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:04 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2021449655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:38:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:04 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/169285712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:38:04.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:04 smithi042 ceph-mon[31223]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T09:38:04.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:04 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2016240861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:38:04.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:04 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2021449655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:38:04.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:04 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/169285712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:38:04.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:04 smithi171 ceph-mon[35803]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T09:38:04.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:04 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2016240861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:38:04.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:04 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2021449655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:38:04.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:04 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/169285712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:38:04.871 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841560 got 283467841562 for osd.10 2024-09-19T09:38:04.872 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:05.507 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:05.527 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051639 got 124554051641 for osd.4 2024-09-19T09:38:05.528 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:05.910 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607621 got 51539607624 for osd.1 2024-09-19T09:38:05.910 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:06.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:06 smithi136 ceph-mon[34840]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:38:06.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:06 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:06.402 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:06 smithi042 ceph-mon[31223]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:38:06.402 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:06 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:06.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.400+0000 7f9d636ec640 1 -- 172.21.15.42:0/1699034666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5c101de0 msgr2=0x7f9d5c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:06.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.400+0000 7f9d636ec640 1 --2- 172.21.15.42:0/1699034666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5c101de0 0x7f9d5c1021c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009900 tx=0x7f9d5802a410 comp rx=0 tx=0).stop 2024-09-19T09:38:06.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.400+0000 7f9d636ec640 1 -- 172.21.15.42:0/1699034666 shutdown_connections 2024-09-19T09:38:06.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.400+0000 7f9d636ec640 1 --2- 172.21.15.42:0/1699034666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c106f10 0x7f9d5c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.400+0000 7f9d636ec640 1 --2- 172.21.15.42:0/1699034666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d5c102790 0x7f9d5c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.400+0000 7f9d636ec640 1 --2- 172.21.15.42:0/1699034666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5c101de0 0x7f9d5c1021c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.400+0000 7f9d636ec640 1 -- 172.21.15.42:0/1699034666 >> 172.21.15.42:0/1699034666 conn(0x7f9d5c0fd8c0 msgr2=0x7f9d5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.400+0000 7f9d636ec640 1 -- 172.21.15.42:0/1699034666 shutdown_connections 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.400+0000 7f9d636ec640 1 -- 172.21.15.42:0/1699034666 wait complete. 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d636ec640 1 Processor -- start 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d636ec640 1 -- start start 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d636ec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c101de0 0x7f9d5c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d636ec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5c102790 0x7f9d5c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d636ec640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d5c106f10 0x7f9d5c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d636ec640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c111f70 con 0x7f9d5c102790 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d636ec640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c111df0 con 0x7f9d5c106f10 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d636ec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c1120f0 con 0x7f9d5c101de0 2024-09-19T09:38:06.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d60c87640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5c102790 0x7f9d5c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d60c87640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5c102790 0x7f9d5c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50206/0 (socket says 172.21.15.42:50206) 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d60c87640 1 -- 172.21.15.42:0/3007747297 learned_addr learned my addr 172.21.15.42:0/3007747297 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.401+0000 7f9d61488640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c101de0 0x7f9d5c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d61c89640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d5c106f10 0x7f9d5c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d60c87640 1 -- 172.21.15.42:0/3007747297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c101de0 msgr2=0x7f9d5c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d60c87640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c101de0 0x7f9d5c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d60c87640 1 -- 172.21.15.42:0/3007747297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d5c106f10 msgr2=0x7f9d5c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d60c87640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d5c106f10 0x7f9d5c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d60c87640 1 -- 172.21.15.42:0/3007747297 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5c1a68f0 con 0x7f9d5c102790 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d60c87640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5c102790 0x7f9d5c074a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000d950 tx=0x7f9d5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d4e7fc640 1 -- 172.21.15.42:0/3007747297 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50017030 con 0x7f9d5c102790 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d4e7fc640 1 -- 172.21.15.42:0/3007747297 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d50004020 con 0x7f9d5c102790 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d636ec640 1 -- 172.21.15.42:0/3007747297 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5c1a6be0 con 0x7f9d5c102790 2024-09-19T09:38:06.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d4e7fc640 1 -- 172.21.15.42:0/3007747297 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d500047a0 con 0x7f9d5c102790 2024-09-19T09:38:06.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.402+0000 7f9d636ec640 1 -- 172.21.15.42:0/3007747297 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5c1a7170 con 0x7f9d5c102790 2024-09-19T09:38:06.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.403+0000 7f9d636ec640 1 -- 172.21.15.42:0/3007747297 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d5c1021c0 con 0x7f9d5c102790 2024-09-19T09:38:06.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.405+0000 7f9d4e7fc640 1 -- 172.21.15.42:0/3007747297 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9d500041d0 con 0x7f9d5c102790 2024-09-19T09:38:06.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.405+0000 7f9d4e7fc640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d480a3350 0x7f9d480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:06.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.405+0000 7f9d61488640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d480a3350 0x7f9d480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:06.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.405+0000 7f9d4e7fc640 1 -- 172.21.15.42:0/3007747297 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f9d500cf370 con 0x7f9d5c102790 2024-09-19T09:38:06.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.406+0000 7f9d61488640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d480a3350 0x7f9d480a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009230 tx=0x7f9d580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:06.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.410+0000 7f9d4e7fc640 1 -- 172.21.15.42:0/3007747297 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d5009bf10 con 0x7f9d5c102790 2024-09-19T09:38:06.585 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738442 got 34359738444 for osd.0 2024-09-19T09:38:06.585 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:06.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:06 smithi171 ceph-mon[35803]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:38:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:06 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.595+0000 7f9d636ec640 1 -- 172.21.15.42:0/3007747297 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f9d5c109b60 con 0x7f9d5c102790 2024-09-19T09:38:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.596+0000 7f9d4e7fc640 1 -- 172.21.15.42:0/3007747297 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9d5009b810 con 0x7f9d5c102790 2024-09-19T09:38:06.598 INFO:teuthology.orchestra.run.smithi042.stdout:227633266726 2024-09-19T09:38:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 -- 172.21.15.42:0/3007747297 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d480a3350 msgr2=0x7f9d480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d480a3350 0x7f9d480a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009230 tx=0x7f9d580058d0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 -- 172.21.15.42:0/3007747297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5c102790 msgr2=0x7f9d5c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5c102790 0x7f9d5c074a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000d950 tx=0x7f9d5000de10 comp rx=0 tx=0).stop 2024-09-19T09:38:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 -- 172.21.15.42:0/3007747297 shutdown_connections 2024-09-19T09:38:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d480a3350 0x7f9d480a5810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d5c106f10 0x7f9d5c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5c102790 0x7f9d5c074a30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 --2- 172.21.15.42:0/3007747297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c101de0 0x7f9d5c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 -- 172.21.15.42:0/3007747297 >> 172.21.15.42:0/3007747297 conn(0x7f9d5c0fd8c0 msgr2=0x7f9d5c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 -- 172.21.15.42:0/3007747297 shutdown_connections 2024-09-19T09:38:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:06.598+0000 7f9d636ec640 1 -- 172.21.15.42:0/3007747297 wait complete. 2024-09-19T09:38:07.346 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:07 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3007747297' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:38:07.372 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266724 got 227633266726 for osd.8 2024-09-19T09:38:07.372 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:07.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:07 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3007747297' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:38:07.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:07 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3007747297' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:38:07.800 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612628 got 313532612631 for osd.11 2024-09-19T09:38:07.800 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:08.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.214+0000 7f404a3f9640 1 -- 172.21.15.42:0/4161476110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4044074f40 msgr2=0x7f404410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.214+0000 7f404a3f9640 1 --2- 172.21.15.42:0/4161476110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4044074f40 0x7f404410de80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4038009900 tx=0x7f403802a480 comp rx=0 tx=0).stop 2024-09-19T09:38:08.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.214+0000 7f404a3f9640 1 -- 172.21.15.42:0/4161476110 shutdown_connections 2024-09-19T09:38:08.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.214+0000 7f404a3f9640 1 --2- 172.21.15.42:0/4161476110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f404410e3c0 0x7f4044110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.214+0000 7f404a3f9640 1 --2- 172.21.15.42:0/4161476110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4044074f40 0x7f404410de80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.214+0000 7f404a3f9640 1 --2- 172.21.15.42:0/4161476110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4044074620 0x7f4044074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.214+0000 7f404a3f9640 1 -- 172.21.15.42:0/4161476110 >> 172.21.15.42:0/4161476110 conn(0x7f40440fd8c0 msgr2=0x7f40440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:08.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.214+0000 7f404a3f9640 1 -- 172.21.15.42:0/4161476110 shutdown_connections 2024-09-19T09:38:08.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.214+0000 7f404a3f9640 1 -- 172.21.15.42:0/4161476110 wait complete. 2024-09-19T09:38:08.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.215+0000 7f404a3f9640 1 Processor -- start 2024-09-19T09:38:08.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.215+0000 7f404a3f9640 1 -- start start 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.215+0000 7f404a3f9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4044074620 0x7f404419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f404a3f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4044074f40 0x7f404419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f404a3f9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f404410e3c0 0x7f404419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f404a3f9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4044114160 con 0x7f4044074f40 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f404a3f9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4044113fe0 con 0x7f4044074620 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f404a3f9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40441142e0 con 0x7f404410e3c0 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40437fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4044074f40 0x7f404419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40437fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4044074f40 0x7f404419abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50218/0 (socket says 172.21.15.42:50218) 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40437fe640 1 -- 172.21.15.42:0/746100920 learned_addr learned my addr 172.21.15.42:0/746100920 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f4043fff640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4044074620 0x7f404419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f4048996640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f404410e3c0 0x7f404419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40437fe640 1 -- 172.21.15.42:0/746100920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f404410e3c0 msgr2=0x7f404419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40437fe640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f404410e3c0 0x7f404419ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40437fe640 1 -- 172.21.15.42:0/746100920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4044074620 msgr2=0x7f404419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40437fe640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4044074620 0x7f404419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40437fe640 1 -- 172.21.15.42:0/746100920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404419f630 con 0x7f4044074f40 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40437fe640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4044074f40 0x7f404419abc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4038006010 tx=0x7f40380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40417fa640 1 -- 172.21.15.42:0/746100920 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403803f030 con 0x7f4044074f40 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40417fa640 1 -- 172.21.15.42:0/746100920 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4038003ce0 con 0x7f4044074f40 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f404a3f9640 1 -- 172.21.15.42:0/746100920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404419f8c0 con 0x7f4044074f40 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f40417fa640 1 -- 172.21.15.42:0/746100920 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038035070 con 0x7f4044074f40 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.216+0000 7f404a3f9640 1 -- 172.21.15.42:0/746100920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40441a7200 con 0x7f4044074f40 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.217+0000 7f404a3f9640 1 -- 172.21.15.42:0/746100920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4044075cd0 con 0x7f4044074f40 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.219+0000 7f40417fa640 1 -- 172.21.15.42:0/746100920 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4038042030 con 0x7f4044074f40 2024-09-19T09:38:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.219+0000 7f40417fa640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f402c0a32d0 0x7f402c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.219+0000 7f4043fff640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f402c0a32d0 0x7f402c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.219+0000 7f40417fa640 1 -- 172.21.15.42:0/746100920 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f40380f0380 con 0x7f4044074f40 2024-09-19T09:38:08.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.220+0000 7f4043fff640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f402c0a32d0 0x7f402c0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4034005fd0 tx=0x7f4034005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:08.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.222+0000 7f40417fa640 1 -- 172.21.15.42:0/746100920 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40380bcf80 con 0x7f4044074f40 2024-09-19T09:38:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.402+0000 7f404a3f9640 1 -- 172.21.15.42:0/746100920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4044109540 con 0x7f4044074f40 2024-09-19T09:38:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.402+0000 7f40417fa640 1 -- 172.21.15.42:0/746100920 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f40380bc880 con 0x7f4044074f40 2024-09-19T09:38:08.404 INFO:teuthology.orchestra.run.smithi042.stdout:176093659184 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 -- 172.21.15.42:0/746100920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f402c0a32d0 msgr2=0x7f402c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f402c0a32d0 0x7f402c0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4034005fd0 tx=0x7f4034005e20 comp rx=0 tx=0).stop 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 -- 172.21.15.42:0/746100920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4044074f40 msgr2=0x7f404419abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4044074f40 0x7f404419abc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4038006010 tx=0x7f40380042f0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 -- 172.21.15.42:0/746100920 shutdown_connections 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f402c0a32d0 0x7f402c0a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f404410e3c0 0x7f404419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4044074f40 0x7f404419abc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 --2- 172.21.15.42:0/746100920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4044074620 0x7f404419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 -- 172.21.15.42:0/746100920 >> 172.21.15.42:0/746100920 conn(0x7f40440fd8c0 msgr2=0x7f40440fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 -- 172.21.15.42:0/746100920 shutdown_connections 2024-09-19T09:38:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.405+0000 7f404a3f9640 1 -- 172.21.15.42:0/746100920 wait complete. 2024-09-19T09:38:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:08 smithi042 ceph-mon[31223]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:38:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:08 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:08 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/746100920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:38:08.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.825+0000 7fce9246f640 1 -- 172.21.15.42:0/3482819296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8c100a80 msgr2=0x7fce8c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.825+0000 7fce9246f640 1 --2- 172.21.15.42:0/3482819296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8c100a80 0x7fce8c100ee0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fce80009930 tx=0x7fce8002a420 comp rx=0 tx=0).stop 2024-09-19T09:38:08.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.825+0000 7fce9246f640 1 -- 172.21.15.42:0/3482819296 shutdown_connections 2024-09-19T09:38:08.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.825+0000 7fce9246f640 1 --2- 172.21.15.42:0/3482819296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce8c101420 0x7fce8c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.825+0000 7fce9246f640 1 --2- 172.21.15.42:0/3482819296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8c100a80 0x7fce8c100ee0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.825+0000 7fce9246f640 1 --2- 172.21.15.42:0/3482819296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce8c106a80 0x7fce8c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.825+0000 7fce9246f640 1 -- 172.21.15.42:0/3482819296 >> 172.21.15.42:0/3482819296 conn(0x7fce8c0fc7a0 msgr2=0x7fce8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:08.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.825+0000 7fce9246f640 1 -- 172.21.15.42:0/3482819296 shutdown_connections 2024-09-19T09:38:08.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.825+0000 7fce9246f640 1 -- 172.21.15.42:0/3482819296 wait complete. 2024-09-19T09:38:08.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce9246f640 1 Processor -- start 2024-09-19T09:38:08.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce9246f640 1 -- start start 2024-09-19T09:38:08.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce9246f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce8c100a80 0x7fce8c1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce9246f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce8c101420 0x7fce8c197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce9246f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8c106a80 0x7fce8c19bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce9246f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c110ef0 con 0x7fce8c106a80 2024-09-19T09:38:08.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce9246f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c110d70 con 0x7fce8c101420 2024-09-19T09:38:08.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce9246f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c111070 con 0x7fce8c100a80 2024-09-19T09:38:08.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce90a0c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8c106a80 0x7fce8c19bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce90a0c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8c106a80 0x7fce8c19bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50238/0 (socket says 172.21.15.42:50238) 2024-09-19T09:38:08.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce90a0c640 1 -- 172.21.15.42:0/550434907 learned_addr learned my addr 172.21.15.42:0/550434907 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:08.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.826+0000 7fce8bfff640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce8c100a80 0x7fce8c1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce8b7fe640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce8c101420 0x7fce8c197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce90a0c640 1 -- 172.21.15.42:0/550434907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce8c100a80 msgr2=0x7fce8c1973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce90a0c640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce8c100a80 0x7fce8c1973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce90a0c640 1 -- 172.21.15.42:0/550434907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce8c101420 msgr2=0x7fce8c197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce90a0c640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce8c101420 0x7fce8c197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce90a0c640 1 -- 172.21.15.42:0/550434907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8c19c380 con 0x7fce8c106a80 2024-09-19T09:38:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce90a0c640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8c106a80 0x7fce8c19bca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fce8400b970 tx=0x7fce8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce897fa640 1 -- 172.21.15.42:0/550434907 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84019070 con 0x7fce8c106a80 2024-09-19T09:38:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce897fa640 1 -- 172.21.15.42:0/550434907 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce8400cb40 con 0x7fce8c106a80 2024-09-19T09:38:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce9246f640 1 -- 172.21.15.42:0/550434907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8c19c670 con 0x7fce8c106a80 2024-09-19T09:38:08.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce897fa640 1 -- 172.21.15.42:0/550434907 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84007650 con 0x7fce8c106a80 2024-09-19T09:38:08.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.827+0000 7fce9246f640 1 -- 172.21.15.42:0/550434907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8c1a3f50 con 0x7fce8c106a80 2024-09-19T09:38:08.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.828+0000 7fce9246f640 1 -- 172.21.15.42:0/550434907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce8c100ee0 con 0x7fce8c106a80 2024-09-19T09:38:08.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.829+0000 7fce897fa640 1 -- 172.21.15.42:0/550434907 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fce8401c070 con 0x7fce8c106a80 2024-09-19T09:38:08.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.830+0000 7fce897fa640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce740a32d0 0x7fce740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.830+0000 7fce8bfff640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce740a32d0 0x7fce740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.830+0000 7fce897fa640 1 -- 172.21.15.42:0/550434907 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fce840cf050 con 0x7fce8c106a80 2024-09-19T09:38:08.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.830+0000 7fce8bfff640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce740a32d0 0x7fce740a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fce7c005fd0 tx=0x7fce7c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:08.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:08.834+0000 7fce897fa640 1 -- 172.21.15.42:0/550434907 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce8409bd00 con 0x7fce8c106a80 2024-09-19T09:38:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:08 smithi171 ceph-mon[35803]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:38:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:08 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:08 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/746100920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:08 smithi136 ceph-mon[34840]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:08 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:08 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/746100920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:38:09.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.014+0000 7fce9246f640 1 -- 172.21.15.42:0/550434907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fce8c109040 con 0x7fce8c106a80 2024-09-19T09:38:09.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.014+0000 7fce897fa640 1 -- 172.21.15.42:0/550434907 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fce8409b600 con 0x7fce8c106a80 2024-09-19T09:38:09.017 INFO:teuthology.orchestra.run.smithi042.stdout:197568495659 2024-09-19T09:38:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.016+0000 7fce9246f640 1 -- 172.21.15.42:0/550434907 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce740a32d0 msgr2=0x7fce740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.016+0000 7fce9246f640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce740a32d0 0x7fce740a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fce7c005fd0 tx=0x7fce7c005850 comp rx=0 tx=0).stop 2024-09-19T09:38:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.016+0000 7fce9246f640 1 -- 172.21.15.42:0/550434907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8c106a80 msgr2=0x7fce8c19bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:09.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.016+0000 7fce9246f640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8c106a80 0x7fce8c19bca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fce8400b970 tx=0x7fce8400be30 comp rx=0 tx=0).stop 2024-09-19T09:38:09.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.017+0000 7fce9246f640 1 -- 172.21.15.42:0/550434907 shutdown_connections 2024-09-19T09:38:09.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.017+0000 7fce9246f640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fce740a32d0 0x7fce740a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.017+0000 7fce9246f640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce8c106a80 0x7fce8c19bca0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.017+0000 7fce9246f640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce8c101420 0x7fce8c197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.017+0000 7fce9246f640 1 --2- 172.21.15.42:0/550434907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce8c100a80 0x7fce8c1973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.017+0000 7fce9246f640 1 -- 172.21.15.42:0/550434907 >> 172.21.15.42:0/550434907 conn(0x7fce8c0fc7a0 msgr2=0x7fce8c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:09.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.017+0000 7fce9246f640 1 -- 172.21.15.42:0/550434907 shutdown_connections 2024-09-19T09:38:09.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.017+0000 7fce9246f640 1 -- 172.21.15.42:0/550434907 wait complete. 2024-09-19T09:38:09.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.020+0000 7fe4e583c640 1 -- 172.21.15.42:0/4155487494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4e010e4d0 msgr2=0x7fe4e01108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:09.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.020+0000 7fe4e583c640 1 --2- 172.21.15.42:0/4155487494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4e010e4d0 0x7fe4e01108e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009ca0 tx=0x7fe4d802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.020+0000 7fe4e583c640 1 -- 172.21.15.42:0/4155487494 shutdown_connections 2024-09-19T09:38:09.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.020+0000 7fe4e583c640 1 --2- 172.21.15.42:0/4155487494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4e010e4d0 0x7fe4e01108e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.020+0000 7fe4e583c640 1 --2- 172.21.15.42:0/4155487494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0101360 0x7fe4e010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.020+0000 7fe4e583c640 1 --2- 172.21.15.42:0/4155487494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4e01009b0 0x7fe4e0100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.020+0000 7fe4e583c640 1 -- 172.21.15.42:0/4155487494 >> 172.21.15.42:0/4155487494 conn(0x7fe4e00fc7d0 msgr2=0x7fe4e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:09.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.020+0000 7fe4e583c640 1 -- 172.21.15.42:0/4155487494 shutdown_connections 2024-09-19T09:38:09.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.020+0000 7fe4e583c640 1 -- 172.21.15.42:0/4155487494 wait complete. 2024-09-19T09:38:09.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4e583c640 1 Processor -- start 2024-09-19T09:38:09.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4e583c640 1 -- start start 2024-09-19T09:38:09.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4e583c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4e01009b0 0x7fe4e019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:09.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4e583c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0101360 0x7fe4e019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:09.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4e583c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4e010e4d0 0x7fe4e019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:09.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4e583c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e0114200 con 0x7fe4e010e4d0 2024-09-19T09:38:09.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4e583c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e0114080 con 0x7fe4e01009b0 2024-09-19T09:38:09.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4e583c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e0114380 con 0x7fe4e0101360 2024-09-19T09:38:09.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4df7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4e010e4d0 0x7fe4e019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:09.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4df7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4e010e4d0 0x7fe4e019efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50244/0 (socket says 172.21.15.42:50244) 2024-09-19T09:38:09.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.021+0000 7fe4df7fe640 1 -- 172.21.15.42:0/3156033583 learned_addr learned my addr 172.21.15.42:0/3156033583 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:09.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4de7fc640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0101360 0x7fe4e019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:09.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4deffd640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4e01009b0 0x7fe4e019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:09.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4df7fe640 1 -- 172.21.15.42:0/3156033583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0101360 msgr2=0x7fe4e019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:09.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4df7fe640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0101360 0x7fe4e019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4df7fe640 1 -- 172.21.15.42:0/3156033583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4e01009b0 msgr2=0x7fe4e019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:09.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4df7fe640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4e01009b0 0x7fe4e019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4df7fe640 1 -- 172.21.15.42:0/3156033583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e019f690 con 0x7fe4e010e4d0 2024-09-19T09:38:09.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4df7fe640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4e010e4d0 0x7fe4e019efb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8031a60 tx=0x7fe4d8031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:09.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4e483a640 1 -- 172.21.15.42:0/3156033583 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8003c30 con 0x7fe4e010e4d0 2024-09-19T09:38:09.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4e583c640 1 -- 172.21.15.42:0/3156033583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e019f920 con 0x7fe4e010e4d0 2024-09-19T09:38:09.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.022+0000 7fe4e483a640 1 -- 172.21.15.42:0/3156033583 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4d8003dd0 con 0x7fe4e010e4d0 2024-09-19T09:38:09.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.023+0000 7fe4e583c640 1 -- 172.21.15.42:0/3156033583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e01a7260 con 0x7fe4e010e4d0 2024-09-19T09:38:09.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.023+0000 7fe4e483a640 1 -- 172.21.15.42:0/3156033583 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80047e0 con 0x7fe4e010e4d0 2024-09-19T09:38:09.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.024+0000 7fe4e583c640 1 -- 172.21.15.42:0/3156033583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e0100d90 con 0x7fe4e010e4d0 2024-09-19T09:38:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.025+0000 7fe4e483a640 1 -- 172.21.15.42:0/3156033583 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe4d802f790 con 0x7fe4e010e4d0 2024-09-19T09:38:09.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.026+0000 7fe4e483a640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe4c80a32d0 0x7fe4c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:09.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.026+0000 7fe4deffd640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe4c80a32d0 0x7fe4c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:09.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.026+0000 7fe4e483a640 1 -- 172.21.15.42:0/3156033583 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fe4d80f0ee0 con 0x7fe4e010e4d0 2024-09-19T09:38:09.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.027+0000 7fe4deffd640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe4c80a32d0 0x7fe4c80a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00058c0 tx=0x7fe4d000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:09.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.031+0000 7fe4e483a640 1 -- 172.21.15.42:0/3156033583 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4d80bdb90 con 0x7fe4e010e4d0 2024-09-19T09:38:09.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.216+0000 7fe4e583c640 1 -- 172.21.15.42:0/3156033583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe4e0109660 con 0x7fe4e010e4d0 2024-09-19T09:38:09.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.217+0000 7fe4e483a640 1 -- 172.21.15.42:0/3156033583 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe4d80bd490 con 0x7fe4e010e4d0 2024-09-19T09:38:09.219 INFO:teuthology.orchestra.run.smithi042.stdout:68719476804 2024-09-19T09:38:09.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 -- 172.21.15.42:0/3156033583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe4c80a32d0 msgr2=0x7fe4c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:09.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe4c80a32d0 0x7fe4c80a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00058c0 tx=0x7fe4d000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 -- 172.21.15.42:0/3156033583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4e010e4d0 msgr2=0x7fe4e019efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:09.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4e010e4d0 0x7fe4e019efb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8031a60 tx=0x7fe4d8031a90 comp rx=0 tx=0).stop 2024-09-19T09:38:09.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 -- 172.21.15.42:0/3156033583 shutdown_connections 2024-09-19T09:38:09.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe4c80a32d0 0x7fe4c80a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4e010e4d0 0x7fe4e019efb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0101360 0x7fe4e019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 --2- 172.21.15.42:0/3156033583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4e01009b0 0x7fe4e019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:09.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 -- 172.21.15.42:0/3156033583 >> 172.21.15.42:0/3156033583 conn(0x7fe4e00fc7d0 msgr2=0x7fe4e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:09.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 -- 172.21.15.42:0/3156033583 shutdown_connections 2024-09-19T09:38:09.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:09.219+0000 7fe4e583c640 1 -- 172.21.15.42:0/3156033583 wait complete. 2024-09-19T09:38:09.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:09 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/550434907' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:38:09.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:09 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3156033583' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:38:09.830 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476801 got 68719476804 for osd.2 2024-09-19T09:38:09.830 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:09.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:09 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/550434907' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:38:09.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:09 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3156033583' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:38:09.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:09 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/550434907' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:09 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3156033583' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:38:10.256 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005087 got 261993005089 for osd.9 2024-09-19T09:38:10.257 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:10.689 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:10.700 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495656 got 197568495659 for osd.7 2024-09-19T09:38:10.701 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:10.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:10 smithi042 ceph-mon[31223]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:10.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:10 smithi171 ceph-mon[35803]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:10 smithi136 ceph-mon[34840]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:11.121 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659182 got 176093659184 for osd.6 2024-09-19T09:38:11.122 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.591+0000 7f9bc6f47640 1 -- 172.21.15.42:0/1166440238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bc0101de0 msgr2=0x7f9bc01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.591+0000 7f9bc6f47640 1 --2- 172.21.15.42:0/1166440238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bc0101de0 0x7f9bc01021c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009900 tx=0x7f9ba802a410 comp rx=0 tx=0).stop 2024-09-19T09:38:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.591+0000 7f9bc6f47640 1 -- 172.21.15.42:0/1166440238 shutdown_connections 2024-09-19T09:38:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.591+0000 7f9bc6f47640 1 --2- 172.21.15.42:0/1166440238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bc0106f10 0x7f9bc010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.591+0000 7f9bc6f47640 1 --2- 172.21.15.42:0/1166440238 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bc0102790 0x7f9bc01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.591+0000 7f9bc6f47640 1 --2- 172.21.15.42:0/1166440238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bc0101de0 0x7f9bc01021c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.591+0000 7f9bc6f47640 1 -- 172.21.15.42:0/1166440238 >> 172.21.15.42:0/1166440238 conn(0x7f9bc00fd8c0 msgr2=0x7f9bc00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:11.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.591+0000 7f9bc6f47640 1 -- 172.21.15.42:0/1166440238 shutdown_connections 2024-09-19T09:38:11.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.591+0000 7f9bc6f47640 1 -- 172.21.15.42:0/1166440238 wait complete. 2024-09-19T09:38:11.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bc6f47640 1 Processor -- start 2024-09-19T09:38:11.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bc6f47640 1 -- start start 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bc6f47640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bc0101de0 0x7f9bc01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bc6f47640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bc0102790 0x7f9bc0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bc6f47640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bc0106f10 0x7f9bc019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bc6f47640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc0111f70 con 0x7f9bc0102790 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bc6f47640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc0111df0 con 0x7f9bc0101de0 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bc6f47640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc01120f0 con 0x7f9bc0106f10 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bbffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bc0102790 0x7f9bc0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bbffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bc0102790 0x7f9bc0198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52600/0 (socket says 172.21.15.42:52600) 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.592+0000 7f9bbffff640 1 -- 172.21.15.42:0/642501389 learned_addr learned my addr 172.21.15.42:0/642501389 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bc4ce3640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bc0101de0 0x7f9bc01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bc54e4640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bc0106f10 0x7f9bc019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bbffff640 1 -- 172.21.15.42:0/642501389 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bc0106f10 msgr2=0x7f9bc019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bbffff640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bc0106f10 0x7f9bc019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bbffff640 1 -- 172.21.15.42:0/642501389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bc0101de0 msgr2=0x7f9bc01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bbffff640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bc0101de0 0x7f9bc01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bbffff640 1 -- 172.21.15.42:0/642501389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc019d3a0 con 0x7f9bc0102790 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bc4ce3640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bc0101de0 0x7f9bc01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bbffff640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bc0102790 0x7f9bc0198930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000d950 tx=0x7f9bb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bbdffb640 1 -- 172.21.15.42:0/642501389 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0017070 con 0x7f9bc0102790 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bc6f47640 1 -- 172.21.15.42:0/642501389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc019d690 con 0x7f9bc0102790 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bbdffb640 1 -- 172.21.15.42:0/642501389 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bb0009c30 con 0x7f9bc0102790 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.593+0000 7f9bbdffb640 1 -- 172.21.15.42:0/642501389 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000f6b0 con 0x7f9bc0102790 2024-09-19T09:38:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.594+0000 7f9bc6f47640 1 -- 172.21.15.42:0/642501389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc01a4f70 con 0x7f9bc0102790 2024-09-19T09:38:11.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.594+0000 7f9bc6f47640 1 -- 172.21.15.42:0/642501389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc01021c0 con 0x7f9bc0102790 2024-09-19T09:38:11.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.596+0000 7f9bbdffb640 1 -- 172.21.15.42:0/642501389 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9bb00109d0 con 0x7f9bc0102790 2024-09-19T09:38:11.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.597+0000 7f9bbdffb640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bac0a32d0 0x7f9bac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:11.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.597+0000 7f9bc4ce3640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bac0a32d0 0x7f9bac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:11.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.597+0000 7f9bbdffb640 1 -- 172.21.15.42:0/642501389 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f9bb00cf7b0 con 0x7f9bc0102790 2024-09-19T09:38:11.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.598+0000 7f9bc4ce3640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bac0a32d0 0x7f9bac0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8005ab0 tx=0x7f9ba8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:11.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.602+0000 7f9bbdffb640 1 -- 172.21.15.42:0/642501389 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9bb0009de0 con 0x7f9bc0102790 2024-09-19T09:38:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.809+0000 7f9bc6f47640 1 -- 172.21.15.42:0/642501389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9bc010a150 con 0x7f9bc0102790 2024-09-19T09:38:11.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.809+0000 7f9bbdffb640 1 -- 172.21.15.42:0/642501389 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9bb009c2f0 con 0x7f9bc0102790 2024-09-19T09:38:11.811 INFO:teuthology.orchestra.run.smithi042.stdout:94489280575 2024-09-19T09:38:11.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 -- 172.21.15.42:0/642501389 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bac0a32d0 msgr2=0x7f9bac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:11.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bac0a32d0 0x7f9bac0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8005ab0 tx=0x7f9ba8005a20 comp rx=0 tx=0).stop 2024-09-19T09:38:11.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 -- 172.21.15.42:0/642501389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bc0102790 msgr2=0x7f9bc0198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:11.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bc0102790 0x7f9bc0198930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000d950 tx=0x7f9bb000de10 comp rx=0 tx=0).stop 2024-09-19T09:38:11.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 -- 172.21.15.42:0/642501389 shutdown_connections 2024-09-19T09:38:11.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9bac0a32d0 0x7f9bac0a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bc0106f10 0x7f9bc019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bc0102790 0x7f9bc0198930 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 --2- 172.21.15.42:0/642501389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9bc0101de0 0x7f9bc01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:11.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 -- 172.21.15.42:0/642501389 >> 172.21.15.42:0/642501389 conn(0x7f9bc00fd8c0 msgr2=0x7f9bc00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:11.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 -- 172.21.15.42:0/642501389 shutdown_connections 2024-09-19T09:38:11.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:11.811+0000 7f9bc6f47640 1 -- 172.21.15.42:0/642501389 wait complete. 2024-09-19T09:38:12.523 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:12 smithi042 ceph-mon[31223]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:12.523 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:12 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/642501389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:38:12.553 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280571 got 94489280575 for osd.3 2024-09-19T09:38:12.553 DEBUG:teuthology.parallel:result is None 2024-09-19T09:38:12.554 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:38:12.554 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:38:12.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:12 smithi171 ceph-mon[35803]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:12.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:12 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/642501389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:12 smithi136 ceph-mon[34840]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:12 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/642501389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:38:13.004 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:13.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.470+0000 7f21c8908640 1 -- 172.21.15.42:0/2622874824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21c410c180 msgr2=0x7f21c410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:13.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.470+0000 7f21c8908640 1 --2- 172.21.15.42:0/2622874824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21c410c180 0x7f21c410e600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009ca0 tx=0x7f21bc02a950 comp rx=0 tx=0).stop 2024-09-19T09:38:13.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.470+0000 7f21c8908640 1 -- 172.21.15.42:0/2622874824 shutdown_connections 2024-09-19T09:38:13.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.470+0000 7f21c8908640 1 --2- 172.21.15.42:0/2622874824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21c410c180 0x7f21c410e600 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.470+0000 7f21c8908640 1 --2- 172.21.15.42:0/2622874824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c41036c0 0x7f21c410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.470+0000 7f21c8908640 1 --2- 172.21.15.42:0/2622874824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21c4102da0 0x7f21c4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.470+0000 7f21c8908640 1 -- 172.21.15.42:0/2622874824 >> 172.21.15.42:0/2622874824 conn(0x7f21c40fc7a0 msgr2=0x7f21c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.470+0000 7f21c8908640 1 -- 172.21.15.42:0/2622874824 shutdown_connections 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.470+0000 7f21c8908640 1 -- 172.21.15.42:0/2622874824 wait complete. 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c8908640 1 Processor -- start 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c8908640 1 -- start start 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c8908640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21c4102da0 0x7f21c4198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c8908640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21c41036c0 0x7f21c4198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c8908640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c410c180 0x7f21c419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c8908640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4111fc0 con 0x7f21c41036c0 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c8908640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4111e40 con 0x7f21c410c180 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c8908640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4112140 con 0x7f21c4102da0 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21c41036c0 0x7f21c4198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:13.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21c41036c0 0x7f21c4198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52612/0 (socket says 172.21.15.42:52612) 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c1d9b640 1 -- 172.21.15.42:0/2001732079 learned_addr learned my addr 172.21.15.42:0/2001732079 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c259c640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21c4102da0 0x7f21c4198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.471+0000 7f21c2d9d640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c410c180 0x7f21c419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21c1d9b640 1 -- 172.21.15.42:0/2001732079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21c4102da0 msgr2=0x7f21c4198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21c1d9b640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21c4102da0 0x7f21c4198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21c1d9b640 1 -- 172.21.15.42:0/2001732079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c410c180 msgr2=0x7f21c419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21c1d9b640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c410c180 0x7f21c419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21c1d9b640 1 -- 172.21.15.42:0/2001732079 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c419d510 con 0x7f21c41036c0 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21c1d9b640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21c41036c0 0x7f21c4198aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00b4a0 tx=0x7f21ac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21bb7fe640 1 -- 172.21.15.42:0/2001732079 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac014070 con 0x7f21c41036c0 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21bb7fe640 1 -- 172.21.15.42:0/2001732079 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21ac010af0 con 0x7f21c41036c0 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21c8908640 1 -- 172.21.15.42:0/2001732079 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c419d800 con 0x7f21c41036c0 2024-09-19T09:38:13.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21bb7fe640 1 -- 172.21.15.42:0/2001732079 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac017d10 con 0x7f21c41036c0 2024-09-19T09:38:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.472+0000 7f21c8908640 1 -- 172.21.15.42:0/2001732079 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c41a50e0 con 0x7f21c41036c0 2024-09-19T09:38:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.473+0000 7f21c8908640 1 -- 172.21.15.42:0/2001732079 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c4103180 con 0x7f21c41036c0 2024-09-19T09:38:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.474+0000 7f21bb7fe640 1 -- 172.21.15.42:0/2001732079 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f21ac017070 con 0x7f21c41036c0 2024-09-19T09:38:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.475+0000 7f21bb7fe640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f21b00a3350 0x7f21b00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.475+0000 7f21c259c640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f21b00a3350 0x7f21b00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.475+0000 7f21bb7fe640 1 -- 172.21.15.42:0/2001732079 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f21ac0ceca0 con 0x7f21c41036c0 2024-09-19T09:38:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.475+0000 7f21c259c640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f21b00a3350 0x7f21b00a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f21b4005fd0 tx=0x7f21b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.479+0000 7f21bb7fe640 1 -- 172.21.15.42:0/2001732079 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21ac09b950 con 0x7f21c41036c0 2024-09-19T09:38:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.682+0000 7f21c8908640 1 -- 172.21.15.42:0/2001732079 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21c4062630 con 0x7f21b00a3350 2024-09-19T09:38:13.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:13 smithi042 ceph-mon[31223]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:13.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.688+0000 7f21bb7fe640 1 -- 172.21.15.42:0/2001732079 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258774 (secure 0 0 0) 0x7f21c4062630 con 0x7f21b00a3350 2024-09-19T09:38:13.693 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:13.694 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-19T09:38:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 -- 172.21.15.42:0/2001732079 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f21b00a3350 msgr2=0x7f21b00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f21b00a3350 0x7f21b00a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f21b4005fd0 tx=0x7f21b400b390 comp rx=0 tx=0).stop 2024-09-19T09:38:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 -- 172.21.15.42:0/2001732079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21c41036c0 msgr2=0x7f21c4198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21c41036c0 0x7f21c4198aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00b4a0 tx=0x7f21ac00b960 comp rx=0 tx=0).stop 2024-09-19T09:38:13.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 -- 172.21.15.42:0/2001732079 shutdown_connections 2024-09-19T09:38:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f21b00a3350 0x7f21b00a5810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21c410c180 0x7f21c419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21c41036c0 0x7f21c4198aa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 --2- 172.21.15.42:0/2001732079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21c4102da0 0x7f21c4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 -- 172.21.15.42:0/2001732079 >> 172.21.15.42:0/2001732079 conn(0x7f21c40fc7a0 msgr2=0x7f21c40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 -- 172.21.15.42:0/2001732079 shutdown_connections 2024-09-19T09:38:13.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:13.692+0000 7f21c8908640 1 -- 172.21.15.42:0/2001732079 wait complete. 2024-09-19T09:38:13.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:13 smithi171 ceph-mon[35803]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:13 smithi136 ceph-mon[34840]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:14.376 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-19T09:38:12.513788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660120,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":619,"num_read_kb":432,"num_write":428,"num_write_kb":3078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":1209642,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382868,"kb_used_data":12792,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558956,"statfs":{"total":1151940427776,"available":1151548370944,"internally_reserved":0,"allocated":13099008,"data_stored":7213488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003048"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017500+0000","last_change":"2024-09-19T09:37:10.964695+0000","last_active":"2024-09-19T09:37:28.017500+0000","last_peered":"2024-09-19T09:37:28.017500+0000","last_clean":"2024-09-19T09:37:28.017500+0000","last_became_active":"2024-09-19T09:37:10.964343+0000","last_became_peered":"2024-09-19T09:37:10.964343+0000","last_unstale":"2024-09-19T09:37:28.017500+0000","last_undegraded":"2024-09-19T09:37:28.017500+0000","last_fullsized":"2024-09-19T09:37:28.017500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:44.224621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016481+0000","last_change":"2024-09-19T09:37:10.964163+0000","last_active":"2024-09-19T09:37:28.016481+0000","last_peered":"2024-09-19T09:37:28.016481+0000","last_clean":"2024-09-19T09:37:28.016481+0000","last_became_active":"2024-09-19T09:37:10.963758+0000","last_became_peered":"2024-09-19T09:37:10.963758+0000","last_unstale":"2024-09-19T09:37:28.016481+0000","last_undegraded":"2024-09-19T09:37:28.016481+0000","last_fullsized":"2024-09-19T09:37:28.016481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:49.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016475+0000","last_change":"2024-09-19T09:37:10.958145+0000","last_active":"2024-09-19T09:37:28.016475+0000","last_peered":"2024-09-19T09:37:28.016475+0000","last_clean":"2024-09-19T09:37:28.016475+0000","last_became_active":"2024-09-19T09:37:10.957666+0000","last_became_peered":"2024-09-19T09:37:10.957666+0000","last_unstale":"2024-09-19T09:37:28.016475+0000","last_undegraded":"2024-09-19T09:37:28.016475+0000","last_fullsized":"2024-09-19T09:37:28.016475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.479753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.022081+0000","last_change":"2024-09-19T09:37:28.021681+0000","last_active":"2024-09-19T09:37:28.022081+0000","last_peered":"2024-09-19T09:37:28.022081+0000","last_clean":"2024-09-19T09:37:28.022081+0000","last_became_active":"2024-09-19T09:37:28.021294+0000","last_became_peered":"2024-09-19T09:37:28.021294+0000","last_unstale":"2024-09-19T09:37:28.022081+0000","last_undegraded":"2024-09-19T09:37:28.022081+0000","last_fullsized":"2024-09-19T09:37:28.022081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:36.535707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020286+0000","last_change":"2024-09-19T09:37:10.957138+0000","last_active":"2024-09-19T09:37:28.020286+0000","last_peered":"2024-09-19T09:37:28.020286+0000","last_clean":"2024-09-19T09:37:28.020286+0000","last_became_active":"2024-09-19T09:37:10.956824+0000","last_became_peered":"2024-09-19T09:37:10.956824+0000","last_unstale":"2024-09-19T09:37:28.020286+0000","last_undegraded":"2024-09-19T09:37:28.020286+0000","last_fullsized":"2024-09-19T09:37:28.020286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.919747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014634+0000","last_change":"2024-09-19T09:37:10.969804+0000","last_active":"2024-09-19T09:37:28.014634+0000","last_peered":"2024-09-19T09:37:28.014634+0000","last_clean":"2024-09-19T09:37:28.014634+0000","last_became_active":"2024-09-19T09:37:10.969454+0000","last_became_peered":"2024-09-19T09:37:10.969454+0000","last_unstale":"2024-09-19T09:37:28.014634+0000","last_undegraded":"2024-09-19T09:37:28.014634+0000","last_fullsized":"2024-09-19T09:37:28.014634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:14.856255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017497+0000","last_change":"2024-09-19T09:37:10.962853+0000","last_active":"2024-09-19T09:37:28.017497+0000","last_peered":"2024-09-19T09:37:28.017497+0000","last_clean":"2024-09-19T09:37:28.017497+0000","last_became_active":"2024-09-19T09:37:10.961207+0000","last_became_peered":"2024-09-19T09:37:10.961207+0000","last_unstale":"2024-09-19T09:37:28.017497+0000","last_undegraded":"2024-09-19T09:37:28.017497+0000","last_fullsized":"2024-09-19T09:37:28.017497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017053+0000","last_change":"2024-09-19T09:37:10.970216+0000","last_active":"2024-09-19T09:37:28.017053+0000","last_peered":"2024-09-19T09:37:28.017053+0000","last_clean":"2024-09-19T09:37:28.017053+0000","last_became_active":"2024-09-19T09:37:10.969486+0000","last_became_peered":"2024-09-19T09:37:10.969486+0000","last_unstale":"2024-09-19T09:37:28.017053+0000","last_undegraded":"2024-09-19T09:37:28.017053+0000","last_fullsized":"2024-09-19T09:37:28.017053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:56.859228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016269+0000","last_change":"2024-09-19T09:37:10.962596+0000","last_active":"2024-09-19T09:37:28.016269+0000","last_peered":"2024-09-19T09:37:28.016269+0000","last_clean":"2024-09-19T09:37:28.016269+0000","last_became_active":"2024-09-19T09:37:10.962230+0000","last_became_peered":"2024-09-19T09:37:10.962230+0000","last_unstale":"2024-09-19T09:37:28.016269+0000","last_undegraded":"2024-09-19T09:37:28.016269+0000","last_fullsized":"2024-09-19T09:37:28.016269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:07.810793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015170+0000","last_change":"2024-09-19T09:37:10.962186+0000","last_active":"2024-09-19T09:37:28.015170+0000","last_peered":"2024-09-19T09:37:28.015170+0000","last_clean":"2024-09-19T09:37:28.015170+0000","last_became_active":"2024-09-19T09:37:10.961845+0000","last_became_peered":"2024-09-19T09:37:10.961845+0000","last_unstale":"2024-09-19T09:37:28.015170+0000","last_undegraded":"2024-09-19T09:37:28.015170+0000","last_fullsized":"2024-09-19T09:37:28.015170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:24.150103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018025+0000","last_change":"2024-09-19T09:37:10.958763+0000","last_active":"2024-09-19T09:37:28.018025+0000","last_peered":"2024-09-19T09:37:28.018025+0000","last_clean":"2024-09-19T09:37:28.018025+0000","last_became_active":"2024-09-19T09:37:10.958397+0000","last_became_peered":"2024-09-19T09:37:10.958397+0000","last_unstale":"2024-09-19T09:37:28.018025+0000","last_undegraded":"2024-09-19T09:37:28.018025+0000","last_fullsized":"2024-09-19T09:37:28.018025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:37.690594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013858+0000","last_change":"2024-09-19T09:37:10.964787+0000","last_active":"2024-09-19T09:37:28.013858+0000","last_peered":"2024-09-19T09:37:28.013858+0000","last_clean":"2024-09-19T09:37:28.013858+0000","last_became_active":"2024-09-19T09:37:10.964121+0000","last_became_peered":"2024-09-19T09:37:10.964121+0000","last_unstale":"2024-09-19T09:37:28.013858+0000","last_undegraded":"2024-09-19T09:37:28.013858+0000","last_fullsized":"2024-09-19T09:37:28.013858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:02.456961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013043+0000","last_change":"2024-09-19T09:37:10.963290+0000","last_active":"2024-09-19T09:37:28.013043+0000","last_peered":"2024-09-19T09:37:28.013043+0000","last_clean":"2024-09-19T09:37:28.013043+0000","last_became_active":"2024-09-19T09:37:10.962961+0000","last_became_peered":"2024-09-19T09:37:10.962961+0000","last_unstale":"2024-09-19T09:37:28.013043+0000","last_undegraded":"2024-09-19T09:37:28.013043+0000","last_fullsized":"2024-09-19T09:37:28.013043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.266745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016628+0000","last_change":"2024-09-19T09:37:10.969742+0000","last_active":"2024-09-19T09:37:28.016628+0000","last_peered":"2024-09-19T09:37:28.016628+0000","last_clean":"2024-09-19T09:37:28.016628+0000","last_became_active":"2024-09-19T09:37:10.969399+0000","last_became_peered":"2024-09-19T09:37:10.969399+0000","last_unstale":"2024-09-19T09:37:28.016628+0000","last_undegraded":"2024-09-19T09:37:28.016628+0000","last_fullsized":"2024-09-19T09:37:28.016628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.386596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016450+0000","last_change":"2024-09-19T09:37:10.962406+0000","last_active":"2024-09-19T09:37:28.016450+0000","last_peered":"2024-09-19T09:37:28.016450+0000","last_clean":"2024-09-19T09:37:28.016450+0000","last_became_active":"2024-09-19T09:37:10.962130+0000","last_became_peered":"2024-09-19T09:37:10.962130+0000","last_unstale":"2024-09-19T09:37:28.016450+0000","last_undegraded":"2024-09-19T09:37:28.016450+0000","last_fullsized":"2024-09-19T09:37:28.016450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015418+0000","last_change":"2024-09-19T09:37:10.958465+0000","last_active":"2024-09-19T09:37:28.015418+0000","last_peered":"2024-09-19T09:37:28.015418+0000","last_clean":"2024-09-19T09:37:28.015418+0000","last_became_active":"2024-09-19T09:37:10.957600+0000","last_became_peered":"2024-09-19T09:37:10.957600+0000","last_unstale":"2024-09-19T09:37:28.015418+0000","last_undegraded":"2024-09-19T09:37:28.015418+0000","last_fullsized":"2024-09-19T09:37:28.015418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:39.232483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017505+0000","last_change":"2024-09-19T09:37:10.965463+0000","last_active":"2024-09-19T09:37:28.017505+0000","last_peered":"2024-09-19T09:37:28.017505+0000","last_clean":"2024-09-19T09:37:28.017505+0000","last_became_active":"2024-09-19T09:37:10.965137+0000","last_became_peered":"2024-09-19T09:37:10.965137+0000","last_unstale":"2024-09-19T09:37:28.017505+0000","last_undegraded":"2024-09-19T09:37:28.017505+0000","last_fullsized":"2024-09-19T09:37:28.017505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:19.582515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015407+0000","last_change":"2024-09-19T09:37:10.964897+0000","last_active":"2024-09-19T09:37:28.015407+0000","last_peered":"2024-09-19T09:37:28.015407+0000","last_clean":"2024-09-19T09:37:28.015407+0000","last_became_active":"2024-09-19T09:37:10.964527+0000","last_became_peered":"2024-09-19T09:37:10.964527+0000","last_unstale":"2024-09-19T09:37:28.015407+0000","last_undegraded":"2024-09-19T09:37:28.015407+0000","last_fullsized":"2024-09-19T09:37:28.015407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:29.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015328+0000","last_change":"2024-09-19T09:37:10.953645+0000","last_active":"2024-09-19T09:37:28.015328+0000","last_peered":"2024-09-19T09:37:28.015328+0000","last_clean":"2024-09-19T09:37:28.015328+0000","last_became_active":"2024-09-19T09:37:10.953326+0000","last_became_peered":"2024-09-19T09:37:10.953326+0000","last_unstale":"2024-09-19T09:37:28.015328+0000","last_undegraded":"2024-09-19T09:37:28.015328+0000","last_fullsized":"2024-09-19T09:37:28.015328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.644615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016578+0000","last_change":"2024-09-19T09:37:10.961384+0000","last_active":"2024-09-19T09:37:28.016578+0000","last_peered":"2024-09-19T09:37:28.016578+0000","last_clean":"2024-09-19T09:37:28.016578+0000","last_became_active":"2024-09-19T09:37:10.961038+0000","last_became_peered":"2024-09-19T09:37:10.961038+0000","last_unstale":"2024-09-19T09:37:28.016578+0000","last_undegraded":"2024-09-19T09:37:28.016578+0000","last_fullsized":"2024-09-19T09:37:28.016578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:54.876799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013067+0000","last_change":"2024-09-19T09:37:10.955789+0000","last_active":"2024-09-19T09:37:28.013067+0000","last_peered":"2024-09-19T09:37:28.013067+0000","last_clean":"2024-09-19T09:37:28.013067+0000","last_became_active":"2024-09-19T09:37:10.955447+0000","last_became_peered":"2024-09-19T09:37:10.955447+0000","last_unstale":"2024-09-19T09:37:28.013067+0000","last_undegraded":"2024-09-19T09:37:28.013067+0000","last_fullsized":"2024-09-19T09:37:28.013067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:28.512069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015730+0000","last_change":"2024-09-19T09:37:10.956501+0000","last_active":"2024-09-19T09:37:28.015730+0000","last_peered":"2024-09-19T09:37:28.015730+0000","last_clean":"2024-09-19T09:37:28.015730+0000","last_became_active":"2024-09-19T09:37:10.956161+0000","last_became_peered":"2024-09-19T09:37:10.956161+0000","last_unstale":"2024-09-19T09:37:28.015730+0000","last_undegraded":"2024-09-19T09:37:28.015730+0000","last_fullsized":"2024-09-19T09:37:28.015730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:31.738143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017612+0000","last_change":"2024-09-19T09:37:10.961486+0000","last_active":"2024-09-19T09:37:28.017612+0000","last_peered":"2024-09-19T09:37:28.017612+0000","last_clean":"2024-09-19T09:37:28.017612+0000","last_became_active":"2024-09-19T09:37:10.960877+0000","last_became_peered":"2024-09-19T09:37:10.960877+0000","last_unstale":"2024-09-19T09:37:28.017612+0000","last_undegraded":"2024-09-19T09:37:28.017612+0000","last_fullsized":"2024-09-19T09:37:28.017612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:34.889431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020088+0000","last_change":"2024-09-19T09:37:10.964400+0000","last_active":"2024-09-19T09:37:28.020088+0000","last_peered":"2024-09-19T09:37:28.020088+0000","last_clean":"2024-09-19T09:37:28.020088+0000","last_became_active":"2024-09-19T09:37:10.963394+0000","last_became_peered":"2024-09-19T09:37:10.963394+0000","last_unstale":"2024-09-19T09:37:28.020088+0000","last_undegraded":"2024-09-19T09:37:28.020088+0000","last_fullsized":"2024-09-19T09:37:28.020088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:22.185221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017710+0000","last_change":"2024-09-19T09:37:10.959661+0000","last_active":"2024-09-19T09:37:28.017710+0000","last_peered":"2024-09-19T09:37:28.017710+0000","last_clean":"2024-09-19T09:37:28.017710+0000","last_became_active":"2024-09-19T09:37:10.959371+0000","last_became_peered":"2024-09-19T09:37:10.959371+0000","last_unstale":"2024-09-19T09:37:28.017710+0000","last_undegraded":"2024-09-19T09:37:28.017710+0000","last_fullsized":"2024-09-19T09:37:28.017710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.752712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015704+0000","last_change":"2024-09-19T09:37:10.967310+0000","last_active":"2024-09-19T09:37:28.015704+0000","last_peered":"2024-09-19T09:37:28.015704+0000","last_clean":"2024-09-19T09:37:28.015704+0000","last_became_active":"2024-09-19T09:37:10.965415+0000","last_became_peered":"2024-09-19T09:37:10.965415+0000","last_unstale":"2024-09-19T09:37:28.015704+0000","last_undegraded":"2024-09-19T09:37:28.015704+0000","last_fullsized":"2024-09-19T09:37:28.015704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:16.968646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016734+0000","last_change":"2024-09-19T09:37:10.967301+0000","last_active":"2024-09-19T09:37:28.016734+0000","last_peered":"2024-09-19T09:37:28.016734+0000","last_clean":"2024-09-19T09:37:28.016734+0000","last_became_active":"2024-09-19T09:37:10.966397+0000","last_became_peered":"2024-09-19T09:37:10.966397+0000","last_unstale":"2024-09-19T09:37:28.016734+0000","last_undegraded":"2024-09-19T09:37:28.016734+0000","last_fullsized":"2024-09-19T09:37:28.016734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.621085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013100+0000","last_change":"2024-09-19T09:37:10.958069+0000","last_active":"2024-09-19T09:37:28.013100+0000","last_peered":"2024-09-19T09:37:28.013100+0000","last_clean":"2024-09-19T09:37:28.013100+0000","last_became_active":"2024-09-19T09:37:10.957670+0000","last_became_peered":"2024-09-19T09:37:10.957670+0000","last_unstale":"2024-09-19T09:37:28.013100+0000","last_undegraded":"2024-09-19T09:37:28.013100+0000","last_fullsized":"2024-09-19T09:37:28.013100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.412978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016752+0000","last_change":"2024-09-19T09:37:10.960490+0000","last_active":"2024-09-19T09:37:28.016752+0000","last_peered":"2024-09-19T09:37:28.016752+0000","last_clean":"2024-09-19T09:37:28.016752+0000","last_became_active":"2024-09-19T09:37:10.960239+0000","last_became_peered":"2024-09-19T09:37:10.960239+0000","last_unstale":"2024-09-19T09:37:28.016752+0000","last_undegraded":"2024-09-19T09:37:28.016752+0000","last_fullsized":"2024-09-19T09:37:28.016752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.384348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014794+0000","last_change":"2024-09-19T09:37:10.955930+0000","last_active":"2024-09-19T09:37:28.014794+0000","last_peered":"2024-09-19T09:37:28.014794+0000","last_clean":"2024-09-19T09:37:28.014794+0000","last_became_active":"2024-09-19T09:37:10.955605+0000","last_became_peered":"2024-09-19T09:37:10.955605+0000","last_unstale":"2024-09-19T09:37:28.014794+0000","last_undegraded":"2024-09-19T09:37:28.014794+0000","last_fullsized":"2024-09-19T09:37:28.014794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:36.033350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014891+0000","last_change":"2024-09-19T09:37:10.960467+0000","last_active":"2024-09-19T09:37:28.014891+0000","last_peered":"2024-09-19T09:37:28.014891+0000","last_clean":"2024-09-19T09:37:28.014891+0000","last_became_active":"2024-09-19T09:37:10.960082+0000","last_became_peered":"2024-09-19T09:37:10.960082+0000","last_unstale":"2024-09-19T09:37:28.014891+0000","last_undegraded":"2024-09-19T09:37:28.014891+0000","last_fullsized":"2024-09-19T09:37:28.014891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:07.451648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017381+0000","last_change":"2024-09-19T09:37:10.965674+0000","last_active":"2024-09-19T09:37:28.017381+0000","last_peered":"2024-09-19T09:37:28.017381+0000","last_clean":"2024-09-19T09:37:28.017381+0000","last_became_active":"2024-09-19T09:37:10.965368+0000","last_became_peered":"2024-09-19T09:37:10.965368+0000","last_unstale":"2024-09-19T09:37:28.017381+0000","last_undegraded":"2024-09-19T09:37:28.017381+0000","last_fullsized":"2024-09-19T09:37:28.017381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:23.712785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020306+0000","last_change":"2024-09-19T09:37:10.966972+0000","last_active":"2024-09-19T09:37:28.020306+0000","last_peered":"2024-09-19T09:37:28.020306+0000","last_clean":"2024-09-19T09:37:28.020306+0000","last_became_active":"2024-09-19T09:37:10.966642+0000","last_became_peered":"2024-09-19T09:37:10.966642+0000","last_unstale":"2024-09-19T09:37:28.020306+0000","last_undegraded":"2024-09-19T09:37:28.020306+0000","last_fullsized":"2024-09-19T09:37:28.020306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.416611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:07.075178+0000","last_change":"2024-09-19T09:37:08.953116+0000","last_active":"2024-09-19T09:38:07.075178+0000","last_peered":"2024-09-19T09:38:07.075178+0000","last_clean":"2024-09-19T09:38:07.075178+0000","last_became_active":"2024-09-19T09:37:08.952748+0000","last_became_peered":"2024-09-19T09:37:08.952748+0000","last_unstale":"2024-09-19T09:38:07.075178+0000","last_undegraded":"2024-09-19T09:38:07.075178+0000","last_fullsized":"2024-09-19T09:38:07.075178+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:22.395359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021330+0000","last_change":"2024-09-19T09:37:10.969106+0000","last_active":"2024-09-19T09:37:28.021330+0000","last_peered":"2024-09-19T09:37:28.021330+0000","last_clean":"2024-09-19T09:37:28.021330+0000","last_became_active":"2024-09-19T09:37:10.968801+0000","last_became_peered":"2024-09-19T09:37:10.968801+0000","last_unstale":"2024-09-19T09:37:28.021330+0000","last_undegraded":"2024-09-19T09:37:28.021330+0000","last_fullsized":"2024-09-19T09:37:28.021330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.674925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014739+0000","last_change":"2024-09-19T09:37:08.949604+0000","last_active":"2024-09-19T09:37:28.014739+0000","last_peered":"2024-09-19T09:37:28.014739+0000","last_clean":"2024-09-19T09:37:28.014739+0000","last_became_active":"2024-09-19T09:37:08.949143+0000","last_became_peered":"2024-09-19T09:37:08.949143+0000","last_unstale":"2024-09-19T09:37:28.014739+0000","last_undegraded":"2024-09-19T09:37:28.014739+0000","last_fullsized":"2024-09-19T09:37:28.014739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:37.933319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012827+0000","last_change":"2024-09-19T09:37:08.946277+0000","last_active":"2024-09-19T09:37:28.012827+0000","last_peered":"2024-09-19T09:37:28.012827+0000","last_clean":"2024-09-19T09:37:28.012827+0000","last_became_active":"2024-09-19T09:37:08.945808+0000","last_became_peered":"2024-09-19T09:37:08.945808+0000","last_unstale":"2024-09-19T09:37:28.012827+0000","last_undegraded":"2024-09-19T09:37:28.012827+0000","last_fullsized":"2024-09-19T09:37:28.012827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.060811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017159+0000","last_change":"2024-09-19T09:37:10.957765+0000","last_active":"2024-09-19T09:37:28.017159+0000","last_peered":"2024-09-19T09:37:28.017159+0000","last_clean":"2024-09-19T09:37:28.017159+0000","last_became_active":"2024-09-19T09:37:10.957458+0000","last_became_peered":"2024-09-19T09:37:10.957458+0000","last_unstale":"2024-09-19T09:37:28.017159+0000","last_undegraded":"2024-09-19T09:37:28.017159+0000","last_fullsized":"2024-09-19T09:37:28.017159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:49.418473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020344+0000","last_change":"2024-09-19T09:37:08.953124+0000","last_active":"2024-09-19T09:37:28.020344+0000","last_peered":"2024-09-19T09:37:28.020344+0000","last_clean":"2024-09-19T09:37:28.020344+0000","last_became_active":"2024-09-19T09:37:08.952159+0000","last_became_peered":"2024-09-19T09:37:08.952159+0000","last_unstale":"2024-09-19T09:37:28.020344+0000","last_undegraded":"2024-09-19T09:37:28.020344+0000","last_fullsized":"2024-09-19T09:37:28.020344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:24.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014710+0000","last_change":"2024-09-19T09:37:10.964038+0000","last_active":"2024-09-19T09:37:28.014710+0000","last_peered":"2024-09-19T09:37:28.014710+0000","last_clean":"2024-09-19T09:37:28.014710+0000","last_became_active":"2024-09-19T09:37:10.963671+0000","last_became_peered":"2024-09-19T09:37:10.963671+0000","last_unstale":"2024-09-19T09:37:28.014710+0000","last_undegraded":"2024-09-19T09:37:28.014710+0000","last_fullsized":"2024-09-19T09:37:28.014710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:19.743329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":117,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:08.073728+0000","last_change":"2024-09-19T09:37:08.949600+0000","last_active":"2024-09-19T09:38:08.073728+0000","last_peered":"2024-09-19T09:38:08.073728+0000","last_clean":"2024-09-19T09:38:08.073728+0000","last_became_active":"2024-09-19T09:37:08.949141+0000","last_became_peered":"2024-09-19T09:37:08.949141+0000","last_unstale":"2024-09-19T09:38:08.073728+0000","last_undegraded":"2024-09-19T09:38:08.073728+0000","last_fullsized":"2024-09-19T09:38:08.073728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:42.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016060+0000","last_change":"2024-09-19T09:37:10.967506+0000","last_active":"2024-09-19T09:37:28.016060+0000","last_peered":"2024-09-19T09:37:28.016060+0000","last_clean":"2024-09-19T09:37:28.016060+0000","last_became_active":"2024-09-19T09:37:10.967193+0000","last_became_peered":"2024-09-19T09:37:10.967193+0000","last_unstale":"2024-09-19T09:37:28.016060+0000","last_undegraded":"2024-09-19T09:37:28.016060+0000","last_fullsized":"2024-09-19T09:37:28.016060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:33.158325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017606+0000","last_change":"2024-09-19T09:37:08.955305+0000","last_active":"2024-09-19T09:37:28.017606+0000","last_peered":"2024-09-19T09:37:28.017606+0000","last_clean":"2024-09-19T09:37:28.017606+0000","last_became_active":"2024-09-19T09:37:08.954932+0000","last_became_peered":"2024-09-19T09:37:08.954932+0000","last_unstale":"2024-09-19T09:37:28.017606+0000","last_undegraded":"2024-09-19T09:37:28.017606+0000","last_fullsized":"2024-09-19T09:37:28.017606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.157466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021974+0000","last_change":"2024-09-19T09:37:28.021974+0000","last_active":"2024-09-19T09:37:28.021974+0000","last_peered":"2024-09-19T09:37:28.021974+0000","last_clean":"2024-09-19T09:37:28.021974+0000","last_became_active":"2024-09-19T09:37:28.021579+0000","last_became_peered":"2024-09-19T09:37:28.021579+0000","last_unstale":"2024-09-19T09:37:28.021974+0000","last_undegraded":"2024-09-19T09:37:28.021974+0000","last_fullsized":"2024-09-19T09:37:28.021974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:28.562862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021814+0000","last_change":"2024-09-19T09:37:08.976540+0000","last_active":"2024-09-19T09:37:28.021814+0000","last_peered":"2024-09-19T09:37:28.021814+0000","last_clean":"2024-09-19T09:37:28.021814+0000","last_became_active":"2024-09-19T09:37:08.976196+0000","last_became_peered":"2024-09-19T09:37:08.976196+0000","last_unstale":"2024-09-19T09:37:28.021814+0000","last_undegraded":"2024-09-19T09:37:28.021814+0000","last_fullsized":"2024-09-19T09:37:28.021814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:38.735947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021407+0000","last_change":"2024-09-19T09:37:28.021407+0000","last_active":"2024-09-19T09:37:28.021407+0000","last_peered":"2024-09-19T09:37:28.021407+0000","last_clean":"2024-09-19T09:37:28.021407+0000","last_became_active":"2024-09-19T09:37:28.021020+0000","last_became_peered":"2024-09-19T09:37:28.021020+0000","last_unstale":"2024-09-19T09:37:28.021407+0000","last_undegraded":"2024-09-19T09:37:28.021407+0000","last_fullsized":"2024-09-19T09:37:28.021407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:25.394012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'33","reported_seq":174,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:08.075503+0000","last_change":"2024-09-19T09:37:28.029037+0000","last_active":"2024-09-19T09:38:08.075503+0000","last_peered":"2024-09-19T09:38:08.075503+0000","last_clean":"2024-09-19T09:38:08.075503+0000","last_became_active":"2024-09-19T09:37:28.018325+0000","last_became_peered":"2024-09-19T09:37:28.018325+0000","last_unstale":"2024-09-19T09:38:08.075503+0000","last_undegraded":"2024-09-19T09:38:08.075503+0000","last_fullsized":"2024-09-19T09:38:08.075503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:56.121569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62310,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":110,"num_write":35,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020724+0000","last_change":"2024-09-19T09:37:10.963688+0000","last_active":"2024-09-19T09:37:28.020724+0000","last_peered":"2024-09-19T09:37:28.020724+0000","last_clean":"2024-09-19T09:37:28.020724+0000","last_became_active":"2024-09-19T09:37:10.963296+0000","last_became_peered":"2024-09-19T09:37:10.963296+0000","last_unstale":"2024-09-19T09:37:28.020724+0000","last_undegraded":"2024-09-19T09:37:28.020724+0000","last_fullsized":"2024-09-19T09:37:28.020724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:49.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015183+0000","last_change":"2024-09-19T09:37:08.952198+0000","last_active":"2024-09-19T09:37:28.015183+0000","last_peered":"2024-09-19T09:37:28.015183+0000","last_clean":"2024-09-19T09:37:28.015183+0000","last_became_active":"2024-09-19T09:37:08.951699+0000","last_became_peered":"2024-09-19T09:37:08.951699+0000","last_unstale":"2024-09-19T09:37:28.015183+0000","last_undegraded":"2024-09-19T09:37:28.015183+0000","last_fullsized":"2024-09-19T09:37:28.015183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:46.729847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012881+0000","last_change":"2024-09-19T09:37:10.955741+0000","last_active":"2024-09-19T09:37:28.012881+0000","last_peered":"2024-09-19T09:37:28.012881+0000","last_clean":"2024-09-19T09:37:28.012881+0000","last_became_active":"2024-09-19T09:37:10.955394+0000","last_became_peered":"2024-09-19T09:37:10.955394+0000","last_unstale":"2024-09-19T09:37:28.012881+0000","last_undegraded":"2024-09-19T09:37:28.012881+0000","last_fullsized":"2024-09-19T09:37:28.012881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:56.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021172+0000","last_change":"2024-09-19T09:37:08.949979+0000","last_active":"2024-09-19T09:37:28.021172+0000","last_peered":"2024-09-19T09:37:28.021172+0000","last_clean":"2024-09-19T09:37:28.021172+0000","last_became_active":"2024-09-19T09:37:08.949664+0000","last_became_peered":"2024-09-19T09:37:08.949664+0000","last_unstale":"2024-09-19T09:37:28.021172+0000","last_undegraded":"2024-09-19T09:37:28.021172+0000","last_fullsized":"2024-09-19T09:37:28.021172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:06.449337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017773+0000","last_change":"2024-09-19T09:37:10.957479+0000","last_active":"2024-09-19T09:37:28.017773+0000","last_peered":"2024-09-19T09:37:28.017773+0000","last_clean":"2024-09-19T09:37:28.017773+0000","last_became_active":"2024-09-19T09:37:10.957130+0000","last_became_peered":"2024-09-19T09:37:10.957130+0000","last_unstale":"2024-09-19T09:37:28.017773+0000","last_undegraded":"2024-09-19T09:37:28.017773+0000","last_fullsized":"2024-09-19T09:37:28.017773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:52.840857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'6","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:07.076447+0000","last_change":"2024-09-19T09:37:08.951558+0000","last_active":"2024-09-19T09:38:07.076447+0000","last_peered":"2024-09-19T09:38:07.076447+0000","last_clean":"2024-09-19T09:38:07.076447+0000","last_became_active":"2024-09-19T09:37:08.951092+0000","last_became_peered":"2024-09-19T09:37:08.951092+0000","last_unstale":"2024-09-19T09:38:07.076447+0000","last_undegraded":"2024-09-19T09:38:07.076447+0000","last_fullsized":"2024-09-19T09:38:07.076447+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:30.326253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018198+0000","last_change":"2024-09-19T09:37:10.962692+0000","last_active":"2024-09-19T09:37:28.018198+0000","last_peered":"2024-09-19T09:37:28.018198+0000","last_clean":"2024-09-19T09:37:28.018198+0000","last_became_active":"2024-09-19T09:37:10.962145+0000","last_became_peered":"2024-09-19T09:37:10.962145+0000","last_unstale":"2024-09-19T09:37:28.018198+0000","last_undegraded":"2024-09-19T09:37:28.018198+0000","last_fullsized":"2024-09-19T09:37:28.018198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:48.232759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020176+0000","last_change":"2024-09-19T09:37:08.976531+0000","last_active":"2024-09-19T09:37:28.020176+0000","last_peered":"2024-09-19T09:37:28.020176+0000","last_clean":"2024-09-19T09:37:28.020176+0000","last_became_active":"2024-09-19T09:37:08.975892+0000","last_became_peered":"2024-09-19T09:37:08.975892+0000","last_unstale":"2024-09-19T09:37:28.020176+0000","last_undegraded":"2024-09-19T09:37:28.020176+0000","last_fullsized":"2024-09-19T09:37:28.020176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.545504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019761+0000","last_change":"2024-09-19T09:37:10.968116+0000","last_active":"2024-09-19T09:37:28.019761+0000","last_peered":"2024-09-19T09:37:28.019761+0000","last_clean":"2024-09-19T09:37:28.019761+0000","last_became_active":"2024-09-19T09:37:10.967767+0000","last_became_peered":"2024-09-19T09:37:10.967767+0000","last_unstale":"2024-09-19T09:37:28.019761+0000","last_undegraded":"2024-09-19T09:37:28.019761+0000","last_fullsized":"2024-09-19T09:37:28.019761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:34.104712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020842+0000","last_change":"2024-09-19T09:37:08.949384+0000","last_active":"2024-09-19T09:37:28.020842+0000","last_peered":"2024-09-19T09:37:28.020842+0000","last_clean":"2024-09-19T09:37:28.020842+0000","last_became_active":"2024-09-19T09:37:08.948950+0000","last_became_peered":"2024-09-19T09:37:08.948950+0000","last_unstale":"2024-09-19T09:37:28.020842+0000","last_undegraded":"2024-09-19T09:37:28.020842+0000","last_fullsized":"2024-09-19T09:37:28.020842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:15.527608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016950+0000","last_change":"2024-09-19T09:37:10.965720+0000","last_active":"2024-09-19T09:37:28.016950+0000","last_peered":"2024-09-19T09:37:28.016950+0000","last_clean":"2024-09-19T09:37:28.016950+0000","last_became_active":"2024-09-19T09:37:10.965341+0000","last_became_peered":"2024-09-19T09:37:10.965341+0000","last_unstale":"2024-09-19T09:37:28.016950+0000","last_undegraded":"2024-09-19T09:37:28.016950+0000","last_fullsized":"2024-09-19T09:37:28.016950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:36.591438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013189+0000","last_change":"2024-09-19T09:37:08.953702+0000","last_active":"2024-09-19T09:37:28.013189+0000","last_peered":"2024-09-19T09:37:28.013189+0000","last_clean":"2024-09-19T09:37:28.013189+0000","last_became_active":"2024-09-19T09:37:08.953312+0000","last_became_peered":"2024-09-19T09:37:08.953312+0000","last_unstale":"2024-09-19T09:37:28.013189+0000","last_undegraded":"2024-09-19T09:37:28.013189+0000","last_fullsized":"2024-09-19T09:37:28.013189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:54.059096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017769+0000","last_change":"2024-09-19T09:37:10.959814+0000","last_active":"2024-09-19T09:37:28.017769+0000","last_peered":"2024-09-19T09:37:28.017769+0000","last_clean":"2024-09-19T09:37:28.017769+0000","last_became_active":"2024-09-19T09:37:10.959342+0000","last_became_peered":"2024-09-19T09:37:10.959342+0000","last_unstale":"2024-09-19T09:37:28.017769+0000","last_undegraded":"2024-09-19T09:37:28.017769+0000","last_fullsized":"2024-09-19T09:37:28.017769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021892+0000","last_change":"2024-09-19T09:37:08.947978+0000","last_active":"2024-09-19T09:37:28.021892+0000","last_peered":"2024-09-19T09:37:28.021892+0000","last_clean":"2024-09-19T09:37:28.021892+0000","last_became_active":"2024-09-19T09:37:08.947548+0000","last_became_peered":"2024-09-19T09:37:08.947548+0000","last_unstale":"2024-09-19T09:37:28.021892+0000","last_undegraded":"2024-09-19T09:37:28.021892+0000","last_fullsized":"2024-09-19T09:37:28.021892+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:38.283616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018434+0000","last_change":"2024-09-19T09:37:10.964008+0000","last_active":"2024-09-19T09:37:28.018434+0000","last_peered":"2024-09-19T09:37:28.018434+0000","last_clean":"2024-09-19T09:37:28.018434+0000","last_became_active":"2024-09-19T09:37:10.963554+0000","last_became_peered":"2024-09-19T09:37:10.963554+0000","last_unstale":"2024-09-19T09:37:28.018434+0000","last_undegraded":"2024-09-19T09:37:28.018434+0000","last_fullsized":"2024-09-19T09:37:28.018434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:57.320967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'5","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:07.072862+0000","last_change":"2024-09-19T09:37:28.027589+0000","last_active":"2024-09-19T09:38:07.072862+0000","last_peered":"2024-09-19T09:38:07.072862+0000","last_clean":"2024-09-19T09:38:07.072862+0000","last_became_active":"2024-09-19T09:37:28.020013+0000","last_became_peered":"2024-09-19T09:37:28.020013+0000","last_unstale":"2024-09-19T09:38:07.072862+0000","last_undegraded":"2024-09-19T09:38:07.072862+0000","last_fullsized":"2024-09-19T09:38:07.072862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:51.327069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018295+0000","last_change":"2024-09-19T09:37:10.960337+0000","last_active":"2024-09-19T09:37:28.018295+0000","last_peered":"2024-09-19T09:37:28.018295+0000","last_clean":"2024-09-19T09:37:28.018295+0000","last_became_active":"2024-09-19T09:37:10.960006+0000","last_became_peered":"2024-09-19T09:37:10.960006+0000","last_unstale":"2024-09-19T09:37:28.018295+0000","last_undegraded":"2024-09-19T09:37:28.018295+0000","last_fullsized":"2024-09-19T09:37:28.018295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:16.942098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":336,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019254+0000","last_change":"2024-09-19T09:36:01.923601+0000","last_active":"2024-09-19T09:37:28.019254+0000","last_peered":"2024-09-19T09:37:28.019254+0000","last_clean":"2024-09-19T09:37:28.019254+0000","last_became_active":"2024-09-19T09:36:01.923051+0000","last_became_peered":"2024-09-19T09:36:01.923051+0000","last_unstale":"2024-09-19T09:37:28.019254+0000","last_undegraded":"2024-09-19T09:37:28.019254+0000","last_fullsized":"2024-09-19T09:37:28.019254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_clean_scrub_stamp":"2024-09-19T09:32:45.321588+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:41.635565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013536+0000","last_change":"2024-09-19T09:37:08.948818+0000","last_active":"2024-09-19T09:37:28.013536+0000","last_peered":"2024-09-19T09:37:28.013536+0000","last_clean":"2024-09-19T09:37:28.013536+0000","last_became_active":"2024-09-19T09:37:08.948494+0000","last_became_peered":"2024-09-19T09:37:08.948494+0000","last_unstale":"2024-09-19T09:37:28.013536+0000","last_undegraded":"2024-09-19T09:37:28.013536+0000","last_fullsized":"2024-09-19T09:37:28.013536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:35.255778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017276+0000","last_change":"2024-09-19T09:37:10.966315+0000","last_active":"2024-09-19T09:37:28.017276+0000","last_peered":"2024-09-19T09:37:28.017276+0000","last_clean":"2024-09-19T09:37:28.017276+0000","last_became_active":"2024-09-19T09:37:10.965979+0000","last_became_peered":"2024-09-19T09:37:10.965979+0000","last_unstale":"2024-09-19T09:37:28.017276+0000","last_undegraded":"2024-09-19T09:37:28.017276+0000","last_fullsized":"2024-09-19T09:37:28.017276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:36.229434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.030136+0000","last_change":"2024-09-19T09:37:28.029598+0000","last_active":"2024-09-19T09:37:28.030136+0000","last_peered":"2024-09-19T09:37:28.030136+0000","last_clean":"2024-09-19T09:37:28.030136+0000","last_became_active":"2024-09-19T09:37:28.021459+0000","last_became_peered":"2024-09-19T09:37:28.021459+0000","last_unstale":"2024-09-19T09:37:28.030136+0000","last_undegraded":"2024-09-19T09:37:28.030136+0000","last_fullsized":"2024-09-19T09:37:28.030136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:00.755946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012816+0000","last_change":"2024-09-19T09:37:10.962825+0000","last_active":"2024-09-19T09:37:28.012816+0000","last_peered":"2024-09-19T09:37:28.012816+0000","last_clean":"2024-09-19T09:37:28.012816+0000","last_became_active":"2024-09-19T09:37:10.962475+0000","last_became_peered":"2024-09-19T09:37:10.962475+0000","last_unstale":"2024-09-19T09:37:28.012816+0000","last_undegraded":"2024-09-19T09:37:28.012816+0000","last_fullsized":"2024-09-19T09:37:28.012816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:30.650918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'5","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:11.082100+0000","last_change":"2024-09-19T09:37:08.976364+0000","last_active":"2024-09-19T09:38:11.082100+0000","last_peered":"2024-09-19T09:38:11.082100+0000","last_clean":"2024-09-19T09:38:11.082100+0000","last_became_active":"2024-09-19T09:37:08.975983+0000","last_became_peered":"2024-09-19T09:37:08.975983+0000","last_unstale":"2024-09-19T09:38:11.082100+0000","last_undegraded":"2024-09-19T09:38:11.082100+0000","last_fullsized":"2024-09-19T09:38:11.082100+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.762847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020702+0000","last_change":"2024-09-19T09:37:28.020341+0000","last_active":"2024-09-19T09:37:28.020702+0000","last_peered":"2024-09-19T09:37:28.020702+0000","last_clean":"2024-09-19T09:37:28.020702+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:37:28.020702+0000","last_undegraded":"2024-09-19T09:37:28.020702+0000","last_fullsized":"2024-09-19T09:37:28.020702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:24.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"79'6","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:10.081507+0000","last_change":"2024-09-19T09:37:08.950403+0000","last_active":"2024-09-19T09:38:10.081507+0000","last_peered":"2024-09-19T09:38:10.081507+0000","last_clean":"2024-09-19T09:38:10.081507+0000","last_became_active":"2024-09-19T09:37:08.950077+0000","last_became_peered":"2024-09-19T09:37:08.950077+0000","last_unstale":"2024-09-19T09:38:10.081507+0000","last_undegraded":"2024-09-19T09:38:10.081507+0000","last_fullsized":"2024-09-19T09:38:10.081507+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:46.446439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014647+0000","last_change":"2024-09-19T09:37:10.969493+0000","last_active":"2024-09-19T09:37:28.014647+0000","last_peered":"2024-09-19T09:37:28.014647+0000","last_clean":"2024-09-19T09:37:28.014647+0000","last_became_active":"2024-09-19T09:37:10.969038+0000","last_became_peered":"2024-09-19T09:37:10.969038+0000","last_unstale":"2024-09-19T09:37:28.014647+0000","last_undegraded":"2024-09-19T09:37:28.014647+0000","last_fullsized":"2024-09-19T09:37:28.014647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:55.518806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015137+0000","last_change":"2024-09-19T09:37:08.977207+0000","last_active":"2024-09-19T09:37:28.015137+0000","last_peered":"2024-09-19T09:37:28.015137+0000","last_clean":"2024-09-19T09:37:28.015137+0000","last_became_active":"2024-09-19T09:37:08.976859+0000","last_became_peered":"2024-09-19T09:37:08.976859+0000","last_unstale":"2024-09-19T09:37:28.015137+0000","last_undegraded":"2024-09-19T09:37:28.015137+0000","last_fullsized":"2024-09-19T09:37:28.015137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:25.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.023437+0000","last_change":"2024-09-19T09:37:28.023437+0000","last_active":"2024-09-19T09:37:28.023437+0000","last_peered":"2024-09-19T09:37:28.023437+0000","last_clean":"2024-09-19T09:37:28.023437+0000","last_became_active":"2024-09-19T09:37:28.018678+0000","last_became_peered":"2024-09-19T09:37:28.018678+0000","last_unstale":"2024-09-19T09:37:28.023437+0000","last_undegraded":"2024-09-19T09:37:28.023437+0000","last_fullsized":"2024-09-19T09:37:28.023437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:44.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020845+0000","last_change":"2024-09-19T09:37:08.976594+0000","last_active":"2024-09-19T09:37:28.020845+0000","last_peered":"2024-09-19T09:37:28.020845+0000","last_clean":"2024-09-19T09:37:28.020845+0000","last_became_active":"2024-09-19T09:37:08.976222+0000","last_became_peered":"2024-09-19T09:37:08.976222+0000","last_unstale":"2024-09-19T09:37:28.020845+0000","last_undegraded":"2024-09-19T09:37:28.020845+0000","last_fullsized":"2024-09-19T09:37:28.020845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:53.492591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013129+0000","last_change":"2024-09-19T09:37:10.957096+0000","last_active":"2024-09-19T09:37:28.013129+0000","last_peered":"2024-09-19T09:37:28.013129+0000","last_clean":"2024-09-19T09:37:28.013129+0000","last_became_active":"2024-09-19T09:37:10.956740+0000","last_became_peered":"2024-09-19T09:37:10.956740+0000","last_unstale":"2024-09-19T09:37:28.013129+0000","last_undegraded":"2024-09-19T09:37:28.013129+0000","last_fullsized":"2024-09-19T09:37:28.013129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:40.358624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'14","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:35.021212+0000","last_change":"2024-09-19T09:37:08.948528+0000","last_active":"2024-09-19T09:37:35.021212+0000","last_peered":"2024-09-19T09:37:35.021212+0000","last_clean":"2024-09-19T09:37:35.021212+0000","last_became_active":"2024-09-19T09:37:08.948183+0000","last_became_peered":"2024-09-19T09:37:08.948183+0000","last_unstale":"2024-09-19T09:37:35.021212+0000","last_undegraded":"2024-09-19T09:37:35.021212+0000","last_fullsized":"2024-09-19T09:37:35.021212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:23.214471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017729+0000","last_change":"2024-09-19T09:37:10.959492+0000","last_active":"2024-09-19T09:37:28.017729+0000","last_peered":"2024-09-19T09:37:28.017729+0000","last_clean":"2024-09-19T09:37:28.017729+0000","last_became_active":"2024-09-19T09:37:10.959032+0000","last_became_peered":"2024-09-19T09:37:10.959032+0000","last_unstale":"2024-09-19T09:37:28.017729+0000","last_undegraded":"2024-09-19T09:37:28.017729+0000","last_fullsized":"2024-09-19T09:37:28.017729+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.080976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013794+0000","last_change":"2024-09-19T09:37:09.270315+0000","last_active":"2024-09-19T09:37:28.013794+0000","last_peered":"2024-09-19T09:37:28.013794+0000","last_clean":"2024-09-19T09:37:28.013794+0000","last_became_active":"2024-09-19T09:37:09.269891+0000","last_became_peered":"2024-09-19T09:37:09.269891+0000","last_unstale":"2024-09-19T09:37:28.013794+0000","last_undegraded":"2024-09-19T09:37:28.013794+0000","last_fullsized":"2024-09-19T09:37:28.013794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:12.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016720+0000","last_change":"2024-09-19T09:37:10.961363+0000","last_active":"2024-09-19T09:37:28.016720+0000","last_peered":"2024-09-19T09:37:28.016720+0000","last_clean":"2024-09-19T09:37:28.016720+0000","last_became_active":"2024-09-19T09:37:10.960951+0000","last_became_peered":"2024-09-19T09:37:10.960951+0000","last_unstale":"2024-09-19T09:37:28.016720+0000","last_undegraded":"2024-09-19T09:37:28.016720+0000","last_fullsized":"2024-09-19T09:37:28.016720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:31.226355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015555+0000","last_change":"2024-09-19T09:37:08.976805+0000","last_active":"2024-09-19T09:37:28.015555+0000","last_peered":"2024-09-19T09:37:28.015555+0000","last_clean":"2024-09-19T09:37:28.015555+0000","last_became_active":"2024-09-19T09:37:08.976502+0000","last_became_peered":"2024-09-19T09:37:08.976502+0000","last_unstale":"2024-09-19T09:37:28.015555+0000","last_undegraded":"2024-09-19T09:37:28.015555+0000","last_fullsized":"2024-09-19T09:37:28.015555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:25.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020113+0000","last_change":"2024-09-19T09:37:10.965723+0000","last_active":"2024-09-19T09:37:28.020113+0000","last_peered":"2024-09-19T09:37:28.020113+0000","last_clean":"2024-09-19T09:37:28.020113+0000","last_became_active":"2024-09-19T09:37:10.965385+0000","last_became_peered":"2024-09-19T09:37:10.965385+0000","last_unstale":"2024-09-19T09:37:28.020113+0000","last_undegraded":"2024-09-19T09:37:28.020113+0000","last_fullsized":"2024-09-19T09:37:28.020113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:15.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017690+0000","last_change":"2024-09-19T09:37:08.948028+0000","last_active":"2024-09-19T09:37:28.017690+0000","last_peered":"2024-09-19T09:37:28.017690+0000","last_clean":"2024-09-19T09:37:28.017690+0000","last_became_active":"2024-09-19T09:37:08.947583+0000","last_became_peered":"2024-09-19T09:37:08.947583+0000","last_unstale":"2024-09-19T09:37:28.017690+0000","last_undegraded":"2024-09-19T09:37:28.017690+0000","last_fullsized":"2024-09-19T09:37:28.017690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:15.485850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017516+0000","last_change":"2024-09-19T09:37:10.964577+0000","last_active":"2024-09-19T09:37:28.017516+0000","last_peered":"2024-09-19T09:37:28.017516+0000","last_clean":"2024-09-19T09:37:28.017516+0000","last_became_active":"2024-09-19T09:37:10.964226+0000","last_became_peered":"2024-09-19T09:37:10.964226+0000","last_unstale":"2024-09-19T09:37:28.017516+0000","last_undegraded":"2024-09-19T09:37:28.017516+0000","last_fullsized":"2024-09-19T09:37:28.017516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:44.074286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014911+0000","last_change":"2024-09-19T09:37:08.952257+0000","last_active":"2024-09-19T09:37:28.014911+0000","last_peered":"2024-09-19T09:37:28.014911+0000","last_clean":"2024-09-19T09:37:28.014911+0000","last_became_active":"2024-09-19T09:37:08.951056+0000","last_became_peered":"2024-09-19T09:37:08.951056+0000","last_unstale":"2024-09-19T09:37:28.014911+0000","last_undegraded":"2024-09-19T09:37:28.014911+0000","last_fullsized":"2024-09-19T09:37:28.014911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:35.238551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017765+0000","last_change":"2024-09-19T09:37:10.965956+0000","last_active":"2024-09-19T09:37:28.017765+0000","last_peered":"2024-09-19T09:37:28.017765+0000","last_clean":"2024-09-19T09:37:28.017765+0000","last_became_active":"2024-09-19T09:37:10.965367+0000","last_became_peered":"2024-09-19T09:37:10.965367+0000","last_unstale":"2024-09-19T09:37:28.017765+0000","last_undegraded":"2024-09-19T09:37:28.017765+0000","last_fullsized":"2024-09-19T09:37:28.017765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:23.280106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.027523+0000","last_change":"2024-09-19T09:37:28.026998+0000","last_active":"2024-09-19T09:37:28.027523+0000","last_peered":"2024-09-19T09:37:28.027523+0000","last_clean":"2024-09-19T09:37:28.027523+0000","last_became_active":"2024-09-19T09:37:28.021169+0000","last_became_peered":"2024-09-19T09:37:28.021169+0000","last_unstale":"2024-09-19T09:37:28.027523+0000","last_undegraded":"2024-09-19T09:37:28.027523+0000","last_fullsized":"2024-09-19T09:37:28.027523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.876143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017806+0000","last_change":"2024-09-19T09:37:10.959937+0000","last_active":"2024-09-19T09:37:28.017806+0000","last_peered":"2024-09-19T09:37:28.017806+0000","last_clean":"2024-09-19T09:37:28.017806+0000","last_became_active":"2024-09-19T09:37:10.959466+0000","last_became_peered":"2024-09-19T09:37:10.959466+0000","last_unstale":"2024-09-19T09:37:28.017806+0000","last_undegraded":"2024-09-19T09:37:28.017806+0000","last_fullsized":"2024-09-19T09:37:28.017806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:13.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021701+0000","last_change":"2024-09-19T09:37:10.966737+0000","last_active":"2024-09-19T09:37:28.021701+0000","last_peered":"2024-09-19T09:37:28.021701+0000","last_clean":"2024-09-19T09:37:28.021701+0000","last_became_active":"2024-09-19T09:37:10.966436+0000","last_became_peered":"2024-09-19T09:37:10.966436+0000","last_unstale":"2024-09-19T09:37:28.021701+0000","last_undegraded":"2024-09-19T09:37:28.021701+0000","last_fullsized":"2024-09-19T09:37:28.021701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:05.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020657+0000","last_change":"2024-09-19T09:37:08.950225+0000","last_active":"2024-09-19T09:37:28.020657+0000","last_peered":"2024-09-19T09:37:28.020657+0000","last_clean":"2024-09-19T09:37:28.020657+0000","last_became_active":"2024-09-19T09:37:08.949855+0000","last_became_peered":"2024-09-19T09:37:08.949855+0000","last_unstale":"2024-09-19T09:37:28.020657+0000","last_undegraded":"2024-09-19T09:37:28.020657+0000","last_fullsized":"2024-09-19T09:37:28.020657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:12.315407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016294+0000","last_change":"2024-09-19T09:37:10.965763+0000","last_active":"2024-09-19T09:37:28.016294+0000","last_peered":"2024-09-19T09:37:28.016294+0000","last_clean":"2024-09-19T09:37:28.016294+0000","last_became_active":"2024-09-19T09:37:10.965425+0000","last_became_peered":"2024-09-19T09:37:10.965425+0000","last_unstale":"2024-09-19T09:37:28.016294+0000","last_undegraded":"2024-09-19T09:37:28.016294+0000","last_fullsized":"2024-09-19T09:37:28.016294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:34.474506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020815+0000","last_change":"2024-09-19T09:37:08.954211+0000","last_active":"2024-09-19T09:37:28.020815+0000","last_peered":"2024-09-19T09:37:28.020815+0000","last_clean":"2024-09-19T09:37:28.020815+0000","last_became_active":"2024-09-19T09:37:08.953869+0000","last_became_peered":"2024-09-19T09:37:08.953869+0000","last_unstale":"2024-09-19T09:37:28.020815+0000","last_undegraded":"2024-09-19T09:37:28.020815+0000","last_fullsized":"2024-09-19T09:37:28.020815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:10.650227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016975+0000","last_change":"2024-09-19T09:37:10.957032+0000","last_active":"2024-09-19T09:37:28.016975+0000","last_peered":"2024-09-19T09:37:28.016975+0000","last_clean":"2024-09-19T09:37:28.016975+0000","last_became_active":"2024-09-19T09:37:10.955979+0000","last_became_peered":"2024-09-19T09:37:10.955979+0000","last_unstale":"2024-09-19T09:37:28.016975+0000","last_undegraded":"2024-09-19T09:37:28.016975+0000","last_fullsized":"2024-09-19T09:37:28.016975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.734353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018040+0000","last_change":"2024-09-19T09:37:08.976359+0000","last_active":"2024-09-19T09:37:28.018040+0000","last_peered":"2024-09-19T09:37:28.018040+0000","last_clean":"2024-09-19T09:37:28.018040+0000","last_became_active":"2024-09-19T09:37:08.976019+0000","last_became_peered":"2024-09-19T09:37:08.976019+0000","last_unstale":"2024-09-19T09:37:28.018040+0000","last_undegraded":"2024-09-19T09:37:28.018040+0000","last_fullsized":"2024-09-19T09:37:28.018040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:34.401585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017783+0000","last_change":"2024-09-19T09:37:10.954000+0000","last_active":"2024-09-19T09:37:28.017783+0000","last_peered":"2024-09-19T09:37:28.017783+0000","last_clean":"2024-09-19T09:37:28.017783+0000","last_became_active":"2024-09-19T09:37:10.953709+0000","last_became_peered":"2024-09-19T09:37:10.953709+0000","last_unstale":"2024-09-19T09:37:28.017783+0000","last_undegraded":"2024-09-19T09:37:28.017783+0000","last_fullsized":"2024-09-19T09:37:28.017783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:36.779680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:08.079000+0000","last_change":"2024-09-19T09:37:28.036392+0000","last_active":"2024-09-19T09:38:08.079000+0000","last_peered":"2024-09-19T09:38:08.079000+0000","last_clean":"2024-09-19T09:38:08.079000+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:08.079000+0000","last_undegraded":"2024-09-19T09:38:08.079000+0000","last_fullsized":"2024-09-19T09:38:08.079000+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:56.344807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69518,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":493,"num_read_kb":323,"num_write":245,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":28789,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":208554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612633,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":437286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841564,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1609728,"data_stored":1091018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495660,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1030507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659186,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":437326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888117,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051643,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":500667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280575,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476805,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":436896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607626,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":501221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":933888,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:38:14.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:38:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.148+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3014661081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c441036e0 msgr2=0x7f0c44107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.148+0000 7f0c48e8d640 1 --2- 172.21.15.42:0/3014661081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c441036e0 0x7f0c44107b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009930 tx=0x7f0c2c02a420 comp rx=0 tx=0).stop 2024-09-19T09:38:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.148+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3014661081 shutdown_connections 2024-09-19T09:38:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.148+0000 7f0c48e8d640 1 --2- 172.21.15.42:0/3014661081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c441082a0 0x7f0c4410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.148+0000 7f0c48e8d640 1 --2- 172.21.15.42:0/3014661081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c441036e0 0x7f0c44107b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.148+0000 7f0c48e8d640 1 --2- 172.21.15.42:0/3014661081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c44102d30 0x7f0c44103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.148+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3014661081 >> 172.21.15.42:0/3014661081 conn(0x7f0c440fc7d0 msgr2=0x7f0c440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.148+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3014661081 shutdown_connections 2024-09-19T09:38:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.148+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3014661081 wait complete. 2024-09-19T09:38:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.148+0000 7f0c48e8d640 1 Processor -- start 2024-09-19T09:38:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c48e8d640 1 -- start start 2024-09-19T09:38:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c48e8d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c44102d30 0x7f0c44100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c48e8d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c441036e0 0x7f0c44100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c48e8d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c441082a0 0x7f0c44101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c48e8d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0c441120a0 con 0x7f0c44102d30 2024-09-19T09:38:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c48e8d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44111f20 con 0x7f0c441036e0 2024-09-19T09:38:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c48e8d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44112220 con 0x7f0c441082a0 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c4259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c44102d30 0x7f0c44100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c4259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c44102d30 0x7f0c44100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52632/0 (socket says 172.21.15.42:52632) 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c4259c640 1 -- 172.21.15.42:0/3709315770 learned_addr learned my addr 172.21.15.42:0/3709315770 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c41d9b640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c441036e0 0x7f0c44100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c42d9d640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c441082a0 0x7f0c44101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c4259c640 1 -- 172.21.15.42:0/3709315770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c441082a0 msgr2=0x7f0c44101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c4259c640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c441082a0 0x7f0c44101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c4259c640 1 -- 172.21.15.42:0/3709315770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c441036e0 msgr2=0x7f0c44100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c4259c640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c441036e0 0x7f0c44100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.149+0000 7f0c4259c640 1 -- 172.21.15.42:0/3709315770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c441a6a20 con 0x7f0c44102d30 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.150+0000 7f0c4259c640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c44102d30 0x7f0c44100990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400d950 tx=0x7f0c3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.150+0000 7f0c3b7fe640 1 -- 172.21.15.42:0/3709315770 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34017030 con 0x7f0c44102d30 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.150+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3709315770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c441a6d10 con 0x7f0c44102d30 2024-09-19T09:38:15.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.150+0000 7f0c3b7fe640 1 -- 172.21.15.42:0/3709315770 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c34004020 con 0x7f0c44102d30 2024-09-19T09:38:15.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.150+0000 7f0c3b7fe640 1 -- 172.21.15.42:0/3709315770 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c340047a0 con 0x7f0c44102d30 2024-09-19T09:38:15.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.150+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3709315770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c441a71c0 con 0x7f0c44102d30 2024-09-19T09:38:15.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.151+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3709315770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c44103110 con 0x7f0c44102d30 2024-09-19T09:38:15.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.153+0000 7f0c3b7fe640 1 -- 172.21.15.42:0/3709315770 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0c340041d0 con 0x7f0c44102d30 2024-09-19T09:38:15.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.154+0000 7f0c3b7fe640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0c300a32d0 0x7f0c300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:15.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.154+0000 7f0c41d9b640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0c300a32d0 0x7f0c300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:15.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.154+0000 7f0c3b7fe640 1 -- 172.21.15.42:0/3709315770 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0c340cfaa0 con 0x7f0c44102d30 2024-09-19T09:38:15.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.154+0000 7f0c41d9b640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0c300a32d0 0x7f0c300a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c005940 tx=0x7f0c2c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:15.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.157+0000 7f0c3b7fe640 1 -- 172.21.15.42:0/3709315770 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c3409c5e0 con 0x7f0c44102d30 2024-09-19T09:38:15.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.330+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3709315770 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0c4410a320 con 0x7f0c300a32d0 2024-09-19T09:38:15.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.337+0000 7f0c3b7fe640 1 -- 172.21.15.42:0/3709315770 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258777 (secure 0 0 0) 0x7f0c2c032db0 con 0x7f0c300a32d0 2024-09-19T09:38:15.341 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:15.342 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-19T09:38:15.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3709315770 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0c300a32d0 msgr2=0x7f0c300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:15.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0c300a32d0 0x7f0c300a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c005940 tx=0x7f0c2c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3709315770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c44102d30 msgr2=0x7f0c44100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c44102d30 0x7f0c44100990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400d950 tx=0x7f0c3400de10 comp rx=0 tx=0).stop 2024-09-19T09:38:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3709315770 shutdown_connections 2024-09-19T09:38:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0c300a32d0 0x7f0c300a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c441082a0 0x7f0c44101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c441036e0 0x7f0c44100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 --2- 172.21.15.42:0/3709315770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c44102d30 0x7f0c44100990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3709315770 >> 172.21.15.42:0/3709315770 conn(0x7f0c440fc7d0 msgr2=0x7f0c44105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3709315770 shutdown_connections 2024-09-19T09:38:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:15.341+0000 7f0c48e8d640 1 -- 172.21.15.42:0/3709315770 wait complete. 2024-09-19T09:38:15.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:15 smithi042 ceph-mon[31223]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:15.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:15.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:15.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:15.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:15.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:15.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:15 smithi171 ceph-mon[35803]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:15.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:15.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:15.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:15.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:15.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:15 smithi136 ceph-mon[34840]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:15 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:15 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:15 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:15 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:15 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:38:15.974 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-19T09:38:14.514254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660120,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":654,"num_read_kb":447,"num_write":428,"num_write_kb":3078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":1209642,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382868,"kb_used_data":12792,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558956,"statfs":{"total":1151940427776,"available":1151548370944,"internally_reserved":0,"allocated":13099008,"data_stored":7213488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003037"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017500+0000","last_change":"2024-09-19T09:37:10.964695+0000","last_active":"2024-09-19T09:37:28.017500+0000","last_peered":"2024-09-19T09:37:28.017500+0000","last_clean":"2024-09-19T09:37:28.017500+0000","last_became_active":"2024-09-19T09:37:10.964343+0000","last_became_peered":"2024-09-19T09:37:10.964343+0000","last_unstale":"2024-09-19T09:37:28.017500+0000","last_undegraded":"2024-09-19T09:37:28.017500+0000","last_fullsized":"2024-09-19T09:37:28.017500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:44.224621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016481+0000","last_change":"2024-09-19T09:37:10.964163+0000","last_active":"2024-09-19T09:37:28.016481+0000","last_peered":"2024-09-19T09:37:28.016481+0000","last_clean":"2024-09-19T09:37:28.016481+0000","last_became_active":"2024-09-19T09:37:10.963758+0000","last_became_peered":"2024-09-19T09:37:10.963758+0000","last_unstale":"2024-09-19T09:37:28.016481+0000","last_undegraded":"2024-09-19T09:37:28.016481+0000","last_fullsized":"2024-09-19T09:37:28.016481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:49.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016475+0000","last_change":"2024-09-19T09:37:10.958145+0000","last_active":"2024-09-19T09:37:28.016475+0000","last_peered":"2024-09-19T09:37:28.016475+0000","last_clean":"2024-09-19T09:37:28.016475+0000","last_became_active":"2024-09-19T09:37:10.957666+0000","last_became_peered":"2024-09-19T09:37:10.957666+0000","last_unstale":"2024-09-19T09:37:28.016475+0000","last_undegraded":"2024-09-19T09:37:28.016475+0000","last_fullsized":"2024-09-19T09:37:28.016475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.479753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.022081+0000","last_change":"2024-09-19T09:37:28.021681+0000","last_active":"2024-09-19T09:37:28.022081+0000","last_peered":"2024-09-19T09:37:28.022081+0000","last_clean":"2024-09-19T09:37:28.022081+0000","last_became_active":"2024-09-19T09:37:28.021294+0000","last_became_peered":"2024-09-19T09:37:28.021294+0000","last_unstale":"2024-09-19T09:37:28.022081+0000","last_undegraded":"2024-09-19T09:37:28.022081+0000","last_fullsized":"2024-09-19T09:37:28.022081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:36.535707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020286+0000","last_change":"2024-09-19T09:37:10.957138+0000","last_active":"2024-09-19T09:37:28.020286+0000","last_peered":"2024-09-19T09:37:28.020286+0000","last_clean":"2024-09-19T09:37:28.020286+0000","last_became_active":"2024-09-19T09:37:10.956824+0000","last_became_peered":"2024-09-19T09:37:10.956824+0000","last_unstale":"2024-09-19T09:37:28.020286+0000","last_undegraded":"2024-09-19T09:37:28.020286+0000","last_fullsized":"2024-09-19T09:37:28.020286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.919747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014634+0000","last_change":"2024-09-19T09:37:10.969804+0000","last_active":"2024-09-19T09:37:28.014634+0000","last_peered":"2024-09-19T09:37:28.014634+0000","last_clean":"2024-09-19T09:37:28.014634+0000","last_became_active":"2024-09-19T09:37:10.969454+0000","last_became_peered":"2024-09-19T09:37:10.969454+0000","last_unstale":"2024-09-19T09:37:28.014634+0000","last_undegraded":"2024-09-19T09:37:28.014634+0000","last_fullsized":"2024-09-19T09:37:28.014634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:14.856255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017497+0000","last_change":"2024-09-19T09:37:10.962853+0000","last_active":"2024-09-19T09:37:28.017497+0000","last_peered":"2024-09-19T09:37:28.017497+0000","last_clean":"2024-09-19T09:37:28.017497+0000","last_became_active":"2024-09-19T09:37:10.961207+0000","last_became_peered":"2024-09-19T09:37:10.961207+0000","last_unstale":"2024-09-19T09:37:28.017497+0000","last_undegraded":"2024-09-19T09:37:28.017497+0000","last_fullsized":"2024-09-19T09:37:28.017497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017053+0000","last_change":"2024-09-19T09:37:10.970216+0000","last_active":"2024-09-19T09:37:28.017053+0000","last_peered":"2024-09-19T09:37:28.017053+0000","last_clean":"2024-09-19T09:37:28.017053+0000","last_became_active":"2024-09-19T09:37:10.969486+0000","last_became_peered":"2024-09-19T09:37:10.969486+0000","last_unstale":"2024-09-19T09:37:28.017053+0000","last_undegraded":"2024-09-19T09:37:28.017053+0000","last_fullsized":"2024-09-19T09:37:28.017053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:56.859228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016269+0000","last_change":"2024-09-19T09:37:10.962596+0000","last_active":"2024-09-19T09:37:28.016269+0000","last_peered":"2024-09-19T09:37:28.016269+0000","last_clean":"2024-09-19T09:37:28.016269+0000","last_became_active":"2024-09-19T09:37:10.962230+0000","last_became_peered":"2024-09-19T09:37:10.962230+0000","last_unstale":"2024-09-19T09:37:28.016269+0000","last_undegraded":"2024-09-19T09:37:28.016269+0000","last_fullsized":"2024-09-19T09:37:28.016269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:07.810793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015170+0000","last_change":"2024-09-19T09:37:10.962186+0000","last_active":"2024-09-19T09:37:28.015170+0000","last_peered":"2024-09-19T09:37:28.015170+0000","last_clean":"2024-09-19T09:37:28.015170+0000","last_became_active":"2024-09-19T09:37:10.961845+0000","last_became_peered":"2024-09-19T09:37:10.961845+0000","last_unstale":"2024-09-19T09:37:28.015170+0000","last_undegraded":"2024-09-19T09:37:28.015170+0000","last_fullsized":"2024-09-19T09:37:28.015170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:24.150103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018025+0000","last_change":"2024-09-19T09:37:10.958763+0000","last_active":"2024-09-19T09:37:28.018025+0000","last_peered":"2024-09-19T09:37:28.018025+0000","last_clean":"2024-09-19T09:37:28.018025+0000","last_became_active":"2024-09-19T09:37:10.958397+0000","last_became_peered":"2024-09-19T09:37:10.958397+0000","last_unstale":"2024-09-19T09:37:28.018025+0000","last_undegraded":"2024-09-19T09:37:28.018025+0000","last_fullsized":"2024-09-19T09:37:28.018025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:37.690594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013858+0000","last_change":"2024-09-19T09:37:10.964787+0000","last_active":"2024-09-19T09:37:28.013858+0000","last_peered":"2024-09-19T09:37:28.013858+0000","last_clean":"2024-09-19T09:37:28.013858+0000","last_became_active":"2024-09-19T09:37:10.964121+0000","last_became_peered":"2024-09-19T09:37:10.964121+0000","last_unstale":"2024-09-19T09:37:28.013858+0000","last_undegraded":"2024-09-19T09:37:28.013858+0000","last_fullsized":"2024-09-19T09:37:28.013858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:02.456961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013043+0000","last_change":"2024-09-19T09:37:10.963290+0000","last_active":"2024-09-19T09:37:28.013043+0000","last_peered":"2024-09-19T09:37:28.013043+0000","last_clean":"2024-09-19T09:37:28.013043+0000","last_became_active":"2024-09-19T09:37:10.962961+0000","last_became_peered":"2024-09-19T09:37:10.962961+0000","last_unstale":"2024-09-19T09:37:28.013043+0000","last_undegraded":"2024-09-19T09:37:28.013043+0000","last_fullsized":"2024-09-19T09:37:28.013043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.266745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016628+0000","last_change":"2024-09-19T09:37:10.969742+0000","last_active":"2024-09-19T09:37:28.016628+0000","last_peered":"2024-09-19T09:37:28.016628+0000","last_clean":"2024-09-19T09:37:28.016628+0000","last_became_active":"2024-09-19T09:37:10.969399+0000","last_became_peered":"2024-09-19T09:37:10.969399+0000","last_unstale":"2024-09-19T09:37:28.016628+0000","last_undegraded":"2024-09-19T09:37:28.016628+0000","last_fullsized":"2024-09-19T09:37:28.016628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.386596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016450+0000","last_change":"2024-09-19T09:37:10.962406+0000","last_active":"2024-09-19T09:37:28.016450+0000","last_peered":"2024-09-19T09:37:28.016450+0000","last_clean":"2024-09-19T09:37:28.016450+0000","last_became_active":"2024-09-19T09:37:10.962130+0000","last_became_peered":"2024-09-19T09:37:10.962130+0000","last_unstale":"2024-09-19T09:37:28.016450+0000","last_undegraded":"2024-09-19T09:37:28.016450+0000","last_fullsized":"2024-09-19T09:37:28.016450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015418+0000","last_change":"2024-09-19T09:37:10.958465+0000","last_active":"2024-09-19T09:37:28.015418+0000","last_peered":"2024-09-19T09:37:28.015418+0000","last_clean":"2024-09-19T09:37:28.015418+0000","last_became_active":"2024-09-19T09:37:10.957600+0000","last_became_peered":"2024-09-19T09:37:10.957600+0000","last_unstale":"2024-09-19T09:37:28.015418+0000","last_undegraded":"2024-09-19T09:37:28.015418+0000","last_fullsized":"2024-09-19T09:37:28.015418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:39.232483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017505+0000","last_change":"2024-09-19T09:37:10.965463+0000","last_active":"2024-09-19T09:37:28.017505+0000","last_peered":"2024-09-19T09:37:28.017505+0000","last_clean":"2024-09-19T09:37:28.017505+0000","last_became_active":"2024-09-19T09:37:10.965137+0000","last_became_peered":"2024-09-19T09:37:10.965137+0000","last_unstale":"2024-09-19T09:37:28.017505+0000","last_undegraded":"2024-09-19T09:37:28.017505+0000","last_fullsized":"2024-09-19T09:37:28.017505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:19.582515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015407+0000","last_change":"2024-09-19T09:37:10.964897+0000","last_active":"2024-09-19T09:37:28.015407+0000","last_peered":"2024-09-19T09:37:28.015407+0000","last_clean":"2024-09-19T09:37:28.015407+0000","last_became_active":"2024-09-19T09:37:10.964527+0000","last_became_peered":"2024-09-19T09:37:10.964527+0000","last_unstale":"2024-09-19T09:37:28.015407+0000","last_undegraded":"2024-09-19T09:37:28.015407+0000","last_fullsized":"2024-09-19T09:37:28.015407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:29.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015328+0000","last_change":"2024-09-19T09:37:10.953645+0000","last_active":"2024-09-19T09:37:28.015328+0000","last_peered":"2024-09-19T09:37:28.015328+0000","last_clean":"2024-09-19T09:37:28.015328+0000","last_became_active":"2024-09-19T09:37:10.953326+0000","last_became_peered":"2024-09-19T09:37:10.953326+0000","last_unstale":"2024-09-19T09:37:28.015328+0000","last_undegraded":"2024-09-19T09:37:28.015328+0000","last_fullsized":"2024-09-19T09:37:28.015328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.644615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016578+0000","last_change":"2024-09-19T09:37:10.961384+0000","last_active":"2024-09-19T09:37:28.016578+0000","last_peered":"2024-09-19T09:37:28.016578+0000","last_clean":"2024-09-19T09:37:28.016578+0000","last_became_active":"2024-09-19T09:37:10.961038+0000","last_became_peered":"2024-09-19T09:37:10.961038+0000","last_unstale":"2024-09-19T09:37:28.016578+0000","last_undegraded":"2024-09-19T09:37:28.016578+0000","last_fullsized":"2024-09-19T09:37:28.016578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:54.876799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013067+0000","last_change":"2024-09-19T09:37:10.955789+0000","last_active":"2024-09-19T09:37:28.013067+0000","last_peered":"2024-09-19T09:37:28.013067+0000","last_clean":"2024-09-19T09:37:28.013067+0000","last_became_active":"2024-09-19T09:37:10.955447+0000","last_became_peered":"2024-09-19T09:37:10.955447+0000","last_unstale":"2024-09-19T09:37:28.013067+0000","last_undegraded":"2024-09-19T09:37:28.013067+0000","last_fullsized":"2024-09-19T09:37:28.013067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:28.512069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015730+0000","last_change":"2024-09-19T09:37:10.956501+0000","last_active":"2024-09-19T09:37:28.015730+0000","last_peered":"2024-09-19T09:37:28.015730+0000","last_clean":"2024-09-19T09:37:28.015730+0000","last_became_active":"2024-09-19T09:37:10.956161+0000","last_became_peered":"2024-09-19T09:37:10.956161+0000","last_unstale":"2024-09-19T09:37:28.015730+0000","last_undegraded":"2024-09-19T09:37:28.015730+0000","last_fullsized":"2024-09-19T09:37:28.015730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:31.738143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017612+0000","last_change":"2024-09-19T09:37:10.961486+0000","last_active":"2024-09-19T09:37:28.017612+0000","last_peered":"2024-09-19T09:37:28.017612+0000","last_clean":"2024-09-19T09:37:28.017612+0000","last_became_active":"2024-09-19T09:37:10.960877+0000","last_became_peered":"2024-09-19T09:37:10.960877+0000","last_unstale":"2024-09-19T09:37:28.017612+0000","last_undegraded":"2024-09-19T09:37:28.017612+0000","last_fullsized":"2024-09-19T09:37:28.017612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:34.889431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020088+0000","last_change":"2024-09-19T09:37:10.964400+0000","last_active":"2024-09-19T09:37:28.020088+0000","last_peered":"2024-09-19T09:37:28.020088+0000","last_clean":"2024-09-19T09:37:28.020088+0000","last_became_active":"2024-09-19T09:37:10.963394+0000","last_became_peered":"2024-09-19T09:37:10.963394+0000","last_unstale":"2024-09-19T09:37:28.020088+0000","last_undegraded":"2024-09-19T09:37:28.020088+0000","last_fullsized":"2024-09-19T09:37:28.020088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:22.185221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017710+0000","last_change":"2024-09-19T09:37:10.959661+0000","last_active":"2024-09-19T09:37:28.017710+0000","last_peered":"2024-09-19T09:37:28.017710+0000","last_clean":"2024-09-19T09:37:28.017710+0000","last_became_active":"2024-09-19T09:37:10.959371+0000","last_became_peered":"2024-09-19T09:37:10.959371+0000","last_unstale":"2024-09-19T09:37:28.017710+0000","last_undegraded":"2024-09-19T09:37:28.017710+0000","last_fullsized":"2024-09-19T09:37:28.017710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.752712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015704+0000","last_change":"2024-09-19T09:37:10.967310+0000","last_active":"2024-09-19T09:37:28.015704+0000","last_peered":"2024-09-19T09:37:28.015704+0000","last_clean":"2024-09-19T09:37:28.015704+0000","last_became_active":"2024-09-19T09:37:10.965415+0000","last_became_peered":"2024-09-19T09:37:10.965415+0000","last_unstale":"2024-09-19T09:37:28.015704+0000","last_undegraded":"2024-09-19T09:37:28.015704+0000","last_fullsized":"2024-09-19T09:37:28.015704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:16.968646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016734+0000","last_change":"2024-09-19T09:37:10.967301+0000","last_active":"2024-09-19T09:37:28.016734+0000","last_peered":"2024-09-19T09:37:28.016734+0000","last_clean":"2024-09-19T09:37:28.016734+0000","last_became_active":"2024-09-19T09:37:10.966397+0000","last_became_peered":"2024-09-19T09:37:10.966397+0000","last_unstale":"2024-09-19T09:37:28.016734+0000","last_undegraded":"2024-09-19T09:37:28.016734+0000","last_fullsized":"2024-09-19T09:37:28.016734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.621085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013100+0000","last_change":"2024-09-19T09:37:10.958069+0000","last_active":"2024-09-19T09:37:28.013100+0000","last_peered":"2024-09-19T09:37:28.013100+0000","last_clean":"2024-09-19T09:37:28.013100+0000","last_became_active":"2024-09-19T09:37:10.957670+0000","last_became_peered":"2024-09-19T09:37:10.957670+0000","last_unstale":"2024-09-19T09:37:28.013100+0000","last_undegraded":"2024-09-19T09:37:28.013100+0000","last_fullsized":"2024-09-19T09:37:28.013100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.412978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016752+0000","last_change":"2024-09-19T09:37:10.960490+0000","last_active":"2024-09-19T09:37:28.016752+0000","last_peered":"2024-09-19T09:37:28.016752+0000","last_clean":"2024-09-19T09:37:28.016752+0000","last_became_active":"2024-09-19T09:37:10.960239+0000","last_became_peered":"2024-09-19T09:37:10.960239+0000","last_unstale":"2024-09-19T09:37:28.016752+0000","last_undegraded":"2024-09-19T09:37:28.016752+0000","last_fullsized":"2024-09-19T09:37:28.016752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.384348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014794+0000","last_change":"2024-09-19T09:37:10.955930+0000","last_active":"2024-09-19T09:37:28.014794+0000","last_peered":"2024-09-19T09:37:28.014794+0000","last_clean":"2024-09-19T09:37:28.014794+0000","last_became_active":"2024-09-19T09:37:10.955605+0000","last_became_peered":"2024-09-19T09:37:10.955605+0000","last_unstale":"2024-09-19T09:37:28.014794+0000","last_undegraded":"2024-09-19T09:37:28.014794+0000","last_fullsized":"2024-09-19T09:37:28.014794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:36.033350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014891+0000","last_change":"2024-09-19T09:37:10.960467+0000","last_active":"2024-09-19T09:37:28.014891+0000","last_peered":"2024-09-19T09:37:28.014891+0000","last_clean":"2024-09-19T09:37:28.014891+0000","last_became_active":"2024-09-19T09:37:10.960082+0000","last_became_peered":"2024-09-19T09:37:10.960082+0000","last_unstale":"2024-09-19T09:37:28.014891+0000","last_undegraded":"2024-09-19T09:37:28.014891+0000","last_fullsized":"2024-09-19T09:37:28.014891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:07.451648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017381+0000","last_change":"2024-09-19T09:37:10.965674+0000","last_active":"2024-09-19T09:37:28.017381+0000","last_peered":"2024-09-19T09:37:28.017381+0000","last_clean":"2024-09-19T09:37:28.017381+0000","last_became_active":"2024-09-19T09:37:10.965368+0000","last_became_peered":"2024-09-19T09:37:10.965368+0000","last_unstale":"2024-09-19T09:37:28.017381+0000","last_undegraded":"2024-09-19T09:37:28.017381+0000","last_fullsized":"2024-09-19T09:37:28.017381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:23.712785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020306+0000","last_change":"2024-09-19T09:37:10.966972+0000","last_active":"2024-09-19T09:37:28.020306+0000","last_peered":"2024-09-19T09:37:28.020306+0000","last_clean":"2024-09-19T09:37:28.020306+0000","last_became_active":"2024-09-19T09:37:10.966642+0000","last_became_peered":"2024-09-19T09:37:10.966642+0000","last_unstale":"2024-09-19T09:37:28.020306+0000","last_undegraded":"2024-09-19T09:37:28.020306+0000","last_fullsized":"2024-09-19T09:37:28.020306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.416611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:12.081562+0000","last_change":"2024-09-19T09:37:08.953116+0000","last_active":"2024-09-19T09:38:12.081562+0000","last_peered":"2024-09-19T09:38:12.081562+0000","last_clean":"2024-09-19T09:38:12.081562+0000","last_became_active":"2024-09-19T09:37:08.952748+0000","last_became_peered":"2024-09-19T09:37:08.952748+0000","last_unstale":"2024-09-19T09:38:12.081562+0000","last_undegraded":"2024-09-19T09:38:12.081562+0000","last_fullsized":"2024-09-19T09:38:12.081562+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:22.395359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021330+0000","last_change":"2024-09-19T09:37:10.969106+0000","last_active":"2024-09-19T09:37:28.021330+0000","last_peered":"2024-09-19T09:37:28.021330+0000","last_clean":"2024-09-19T09:37:28.021330+0000","last_became_active":"2024-09-19T09:37:10.968801+0000","last_became_peered":"2024-09-19T09:37:10.968801+0000","last_unstale":"2024-09-19T09:37:28.021330+0000","last_undegraded":"2024-09-19T09:37:28.021330+0000","last_fullsized":"2024-09-19T09:37:28.021330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.674925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014739+0000","last_change":"2024-09-19T09:37:08.949604+0000","last_active":"2024-09-19T09:37:28.014739+0000","last_peered":"2024-09-19T09:37:28.014739+0000","last_clean":"2024-09-19T09:37:28.014739+0000","last_became_active":"2024-09-19T09:37:08.949143+0000","last_became_peered":"2024-09-19T09:37:08.949143+0000","last_unstale":"2024-09-19T09:37:28.014739+0000","last_undegraded":"2024-09-19T09:37:28.014739+0000","last_fullsized":"2024-09-19T09:37:28.014739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:37.933319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012827+0000","last_change":"2024-09-19T09:37:08.946277+0000","last_active":"2024-09-19T09:37:28.012827+0000","last_peered":"2024-09-19T09:37:28.012827+0000","last_clean":"2024-09-19T09:37:28.012827+0000","last_became_active":"2024-09-19T09:37:08.945808+0000","last_became_peered":"2024-09-19T09:37:08.945808+0000","last_unstale":"2024-09-19T09:37:28.012827+0000","last_undegraded":"2024-09-19T09:37:28.012827+0000","last_fullsized":"2024-09-19T09:37:28.012827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.060811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017159+0000","last_change":"2024-09-19T09:37:10.957765+0000","last_active":"2024-09-19T09:37:28.017159+0000","last_peered":"2024-09-19T09:37:28.017159+0000","last_clean":"2024-09-19T09:37:28.017159+0000","last_became_active":"2024-09-19T09:37:10.957458+0000","last_became_peered":"2024-09-19T09:37:10.957458+0000","last_unstale":"2024-09-19T09:37:28.017159+0000","last_undegraded":"2024-09-19T09:37:28.017159+0000","last_fullsized":"2024-09-19T09:37:28.017159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:49.418473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020344+0000","last_change":"2024-09-19T09:37:08.953124+0000","last_active":"2024-09-19T09:37:28.020344+0000","last_peered":"2024-09-19T09:37:28.020344+0000","last_clean":"2024-09-19T09:37:28.020344+0000","last_became_active":"2024-09-19T09:37:08.952159+0000","last_became_peered":"2024-09-19T09:37:08.952159+0000","last_unstale":"2024-09-19T09:37:28.020344+0000","last_undegraded":"2024-09-19T09:37:28.020344+0000","last_fullsized":"2024-09-19T09:37:28.020344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:24.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014710+0000","last_change":"2024-09-19T09:37:10.964038+0000","last_active":"2024-09-19T09:37:28.014710+0000","last_peered":"2024-09-19T09:37:28.014710+0000","last_clean":"2024-09-19T09:37:28.014710+0000","last_became_active":"2024-09-19T09:37:10.963671+0000","last_became_peered":"2024-09-19T09:37:10.963671+0000","last_unstale":"2024-09-19T09:37:28.014710+0000","last_undegraded":"2024-09-19T09:37:28.014710+0000","last_fullsized":"2024-09-19T09:37:28.014710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:19.743329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:13.081393+0000","last_change":"2024-09-19T09:37:08.949600+0000","last_active":"2024-09-19T09:38:13.081393+0000","last_peered":"2024-09-19T09:38:13.081393+0000","last_clean":"2024-09-19T09:38:13.081393+0000","last_became_active":"2024-09-19T09:37:08.949141+0000","last_became_peered":"2024-09-19T09:37:08.949141+0000","last_unstale":"2024-09-19T09:38:13.081393+0000","last_undegraded":"2024-09-19T09:38:13.081393+0000","last_fullsized":"2024-09-19T09:38:13.081393+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:42.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016060+0000","last_change":"2024-09-19T09:37:10.967506+0000","last_active":"2024-09-19T09:37:28.016060+0000","last_peered":"2024-09-19T09:37:28.016060+0000","last_clean":"2024-09-19T09:37:28.016060+0000","last_became_active":"2024-09-19T09:37:10.967193+0000","last_became_peered":"2024-09-19T09:37:10.967193+0000","last_unstale":"2024-09-19T09:37:28.016060+0000","last_undegraded":"2024-09-19T09:37:28.016060+0000","last_fullsized":"2024-09-19T09:37:28.016060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:33.158325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017606+0000","last_change":"2024-09-19T09:37:08.955305+0000","last_active":"2024-09-19T09:37:28.017606+0000","last_peered":"2024-09-19T09:37:28.017606+0000","last_clean":"2024-09-19T09:37:28.017606+0000","last_became_active":"2024-09-19T09:37:08.954932+0000","last_became_peered":"2024-09-19T09:37:08.954932+0000","last_unstale":"2024-09-19T09:37:28.017606+0000","last_undegraded":"2024-09-19T09:37:28.017606+0000","last_fullsized":"2024-09-19T09:37:28.017606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.157466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021974+0000","last_change":"2024-09-19T09:37:28.021974+0000","last_active":"2024-09-19T09:37:28.021974+0000","last_peered":"2024-09-19T09:37:28.021974+0000","last_clean":"2024-09-19T09:37:28.021974+0000","last_became_active":"2024-09-19T09:37:28.021579+0000","last_became_peered":"2024-09-19T09:37:28.021579+0000","last_unstale":"2024-09-19T09:37:28.021974+0000","last_undegraded":"2024-09-19T09:37:28.021974+0000","last_fullsized":"2024-09-19T09:37:28.021974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:28.562862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021814+0000","last_change":"2024-09-19T09:37:08.976540+0000","last_active":"2024-09-19T09:37:28.021814+0000","last_peered":"2024-09-19T09:37:28.021814+0000","last_clean":"2024-09-19T09:37:28.021814+0000","last_became_active":"2024-09-19T09:37:08.976196+0000","last_became_peered":"2024-09-19T09:37:08.976196+0000","last_unstale":"2024-09-19T09:37:28.021814+0000","last_undegraded":"2024-09-19T09:37:28.021814+0000","last_fullsized":"2024-09-19T09:37:28.021814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:38.735947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021407+0000","last_change":"2024-09-19T09:37:28.021407+0000","last_active":"2024-09-19T09:37:28.021407+0000","last_peered":"2024-09-19T09:37:28.021407+0000","last_clean":"2024-09-19T09:37:28.021407+0000","last_became_active":"2024-09-19T09:37:28.021020+0000","last_became_peered":"2024-09-19T09:37:28.021020+0000","last_unstale":"2024-09-19T09:37:28.021407+0000","last_undegraded":"2024-09-19T09:37:28.021407+0000","last_fullsized":"2024-09-19T09:37:28.021407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:25.394012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'33","reported_seq":184,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:13.082307+0000","last_change":"2024-09-19T09:37:28.029037+0000","last_active":"2024-09-19T09:38:13.082307+0000","last_peered":"2024-09-19T09:38:13.082307+0000","last_clean":"2024-09-19T09:38:13.082307+0000","last_became_active":"2024-09-19T09:37:28.018325+0000","last_became_peered":"2024-09-19T09:37:28.018325+0000","last_unstale":"2024-09-19T09:38:13.082307+0000","last_undegraded":"2024-09-19T09:38:13.082307+0000","last_fullsized":"2024-09-19T09:38:13.082307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:56.121569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62310,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":115,"num_write":35,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020724+0000","last_change":"2024-09-19T09:37:10.963688+0000","last_active":"2024-09-19T09:37:28.020724+0000","last_peered":"2024-09-19T09:37:28.020724+0000","last_clean":"2024-09-19T09:37:28.020724+0000","last_became_active":"2024-09-19T09:37:10.963296+0000","last_became_peered":"2024-09-19T09:37:10.963296+0000","last_unstale":"2024-09-19T09:37:28.020724+0000","last_undegraded":"2024-09-19T09:37:28.020724+0000","last_fullsized":"2024-09-19T09:37:28.020724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:49.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015183+0000","last_change":"2024-09-19T09:37:08.952198+0000","last_active":"2024-09-19T09:37:28.015183+0000","last_peered":"2024-09-19T09:37:28.015183+0000","last_clean":"2024-09-19T09:37:28.015183+0000","last_became_active":"2024-09-19T09:37:08.951699+0000","last_became_peered":"2024-09-19T09:37:08.951699+0000","last_unstale":"2024-09-19T09:37:28.015183+0000","last_undegraded":"2024-09-19T09:37:28.015183+0000","last_fullsized":"2024-09-19T09:37:28.015183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:46.729847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012881+0000","last_change":"2024-09-19T09:37:10.955741+0000","last_active":"2024-09-19T09:37:28.012881+0000","last_peered":"2024-09-19T09:37:28.012881+0000","last_clean":"2024-09-19T09:37:28.012881+0000","last_became_active":"2024-09-19T09:37:10.955394+0000","last_became_peered":"2024-09-19T09:37:10.955394+0000","last_unstale":"2024-09-19T09:37:28.012881+0000","last_undegraded":"2024-09-19T09:37:28.012881+0000","last_fullsized":"2024-09-19T09:37:28.012881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:56.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021172+0000","last_change":"2024-09-19T09:37:08.949979+0000","last_active":"2024-09-19T09:37:28.021172+0000","last_peered":"2024-09-19T09:37:28.021172+0000","last_clean":"2024-09-19T09:37:28.021172+0000","last_became_active":"2024-09-19T09:37:08.949664+0000","last_became_peered":"2024-09-19T09:37:08.949664+0000","last_unstale":"2024-09-19T09:37:28.021172+0000","last_undegraded":"2024-09-19T09:37:28.021172+0000","last_fullsized":"2024-09-19T09:37:28.021172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:06.449337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017773+0000","last_change":"2024-09-19T09:37:10.957479+0000","last_active":"2024-09-19T09:37:28.017773+0000","last_peered":"2024-09-19T09:37:28.017773+0000","last_clean":"2024-09-19T09:37:28.017773+0000","last_became_active":"2024-09-19T09:37:10.957130+0000","last_became_peered":"2024-09-19T09:37:10.957130+0000","last_unstale":"2024-09-19T09:37:28.017773+0000","last_undegraded":"2024-09-19T09:37:28.017773+0000","last_fullsized":"2024-09-19T09:37:28.017773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:52.840857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'6","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:12.084135+0000","last_change":"2024-09-19T09:37:08.951558+0000","last_active":"2024-09-19T09:38:12.084135+0000","last_peered":"2024-09-19T09:38:12.084135+0000","last_clean":"2024-09-19T09:38:12.084135+0000","last_became_active":"2024-09-19T09:37:08.951092+0000","last_became_peered":"2024-09-19T09:37:08.951092+0000","last_unstale":"2024-09-19T09:38:12.084135+0000","last_undegraded":"2024-09-19T09:38:12.084135+0000","last_fullsized":"2024-09-19T09:38:12.084135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:30.326253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018198+0000","last_change":"2024-09-19T09:37:10.962692+0000","last_active":"2024-09-19T09:37:28.018198+0000","last_peered":"2024-09-19T09:37:28.018198+0000","last_clean":"2024-09-19T09:37:28.018198+0000","last_became_active":"2024-09-19T09:37:10.962145+0000","last_became_peered":"2024-09-19T09:37:10.962145+0000","last_unstale":"2024-09-19T09:37:28.018198+0000","last_undegraded":"2024-09-19T09:37:28.018198+0000","last_fullsized":"2024-09-19T09:37:28.018198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:48.232759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020176+0000","last_change":"2024-09-19T09:37:08.976531+0000","last_active":"2024-09-19T09:37:28.020176+0000","last_peered":"2024-09-19T09:37:28.020176+0000","last_clean":"2024-09-19T09:37:28.020176+0000","last_became_active":"2024-09-19T09:37:08.975892+0000","last_became_peered":"2024-09-19T09:37:08.975892+0000","last_unstale":"2024-09-19T09:37:28.020176+0000","last_undegraded":"2024-09-19T09:37:28.020176+0000","last_fullsized":"2024-09-19T09:37:28.020176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.545504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019761+0000","last_change":"2024-09-19T09:37:10.968116+0000","last_active":"2024-09-19T09:37:28.019761+0000","last_peered":"2024-09-19T09:37:28.019761+0000","last_clean":"2024-09-19T09:37:28.019761+0000","last_became_active":"2024-09-19T09:37:10.967767+0000","last_became_peered":"2024-09-19T09:37:10.967767+0000","last_unstale":"2024-09-19T09:37:28.019761+0000","last_undegraded":"2024-09-19T09:37:28.019761+0000","last_fullsized":"2024-09-19T09:37:28.019761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:34.104712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020842+0000","last_change":"2024-09-19T09:37:08.949384+0000","last_active":"2024-09-19T09:37:28.020842+0000","last_peered":"2024-09-19T09:37:28.020842+0000","last_clean":"2024-09-19T09:37:28.020842+0000","last_became_active":"2024-09-19T09:37:08.948950+0000","last_became_peered":"2024-09-19T09:37:08.948950+0000","last_unstale":"2024-09-19T09:37:28.020842+0000","last_undegraded":"2024-09-19T09:37:28.020842+0000","last_fullsized":"2024-09-19T09:37:28.020842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:15.527608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016950+0000","last_change":"2024-09-19T09:37:10.965720+0000","last_active":"2024-09-19T09:37:28.016950+0000","last_peered":"2024-09-19T09:37:28.016950+0000","last_clean":"2024-09-19T09:37:28.016950+0000","last_became_active":"2024-09-19T09:37:10.965341+0000","last_became_peered":"2024-09-19T09:37:10.965341+0000","last_unstale":"2024-09-19T09:37:28.016950+0000","last_undegraded":"2024-09-19T09:37:28.016950+0000","last_fullsized":"2024-09-19T09:37:28.016950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:36.591438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013189+0000","last_change":"2024-09-19T09:37:08.953702+0000","last_active":"2024-09-19T09:37:28.013189+0000","last_peered":"2024-09-19T09:37:28.013189+0000","last_clean":"2024-09-19T09:37:28.013189+0000","last_became_active":"2024-09-19T09:37:08.953312+0000","last_became_peered":"2024-09-19T09:37:08.953312+0000","last_unstale":"2024-09-19T09:37:28.013189+0000","last_undegraded":"2024-09-19T09:37:28.013189+0000","last_fullsized":"2024-09-19T09:37:28.013189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:54.059096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017769+0000","last_change":"2024-09-19T09:37:10.959814+0000","last_active":"2024-09-19T09:37:28.017769+0000","last_peered":"2024-09-19T09:37:28.017769+0000","last_clean":"2024-09-19T09:37:28.017769+0000","last_became_active":"2024-09-19T09:37:10.959342+0000","last_became_peered":"2024-09-19T09:37:10.959342+0000","last_unstale":"2024-09-19T09:37:28.017769+0000","last_undegraded":"2024-09-19T09:37:28.017769+0000","last_fullsized":"2024-09-19T09:37:28.017769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021892+0000","last_change":"2024-09-19T09:37:08.947978+0000","last_active":"2024-09-19T09:37:28.021892+0000","last_peered":"2024-09-19T09:37:28.021892+0000","last_clean":"2024-09-19T09:37:28.021892+0000","last_became_active":"2024-09-19T09:37:08.947548+0000","last_became_peered":"2024-09-19T09:37:08.947548+0000","last_unstale":"2024-09-19T09:37:28.021892+0000","last_undegraded":"2024-09-19T09:37:28.021892+0000","last_fullsized":"2024-09-19T09:37:28.021892+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:38.283616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018434+0000","last_change":"2024-09-19T09:37:10.964008+0000","last_active":"2024-09-19T09:37:28.018434+0000","last_peered":"2024-09-19T09:37:28.018434+0000","last_clean":"2024-09-19T09:37:28.018434+0000","last_became_active":"2024-09-19T09:37:10.963554+0000","last_became_peered":"2024-09-19T09:37:10.963554+0000","last_unstale":"2024-09-19T09:37:28.018434+0000","last_undegraded":"2024-09-19T09:37:28.018434+0000","last_fullsized":"2024-09-19T09:37:28.018434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:57.320967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'5","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:12.080510+0000","last_change":"2024-09-19T09:37:28.027589+0000","last_active":"2024-09-19T09:38:12.080510+0000","last_peered":"2024-09-19T09:38:12.080510+0000","last_clean":"2024-09-19T09:38:12.080510+0000","last_became_active":"2024-09-19T09:37:28.020013+0000","last_became_peered":"2024-09-19T09:37:28.020013+0000","last_unstale":"2024-09-19T09:38:12.080510+0000","last_undegraded":"2024-09-19T09:38:12.080510+0000","last_fullsized":"2024-09-19T09:38:12.080510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:51.327069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018295+0000","last_change":"2024-09-19T09:37:10.960337+0000","last_active":"2024-09-19T09:37:28.018295+0000","last_peered":"2024-09-19T09:37:28.018295+0000","last_clean":"2024-09-19T09:37:28.018295+0000","last_became_active":"2024-09-19T09:37:10.960006+0000","last_became_peered":"2024-09-19T09:37:10.960006+0000","last_unstale":"2024-09-19T09:37:28.018295+0000","last_undegraded":"2024-09-19T09:37:28.018295+0000","last_fullsized":"2024-09-19T09:37:28.018295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:16.942098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":336,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019254+0000","last_change":"2024-09-19T09:36:01.923601+0000","last_active":"2024-09-19T09:37:28.019254+0000","last_peered":"2024-09-19T09:37:28.019254+0000","last_clean":"2024-09-19T09:37:28.019254+0000","last_became_active":"2024-09-19T09:36:01.923051+0000","last_became_peered":"2024-09-19T09:36:01.923051+0000","last_unstale":"2024-09-19T09:37:28.019254+0000","last_undegraded":"2024-09-19T09:37:28.019254+0000","last_fullsized":"2024-09-19T09:37:28.019254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_clean_scrub_stamp":"2024-09-19T09:32:45.321588+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:41.635565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013536+0000","last_change":"2024-09-19T09:37:08.948818+0000","last_active":"2024-09-19T09:37:28.013536+0000","last_peered":"2024-09-19T09:37:28.013536+0000","last_clean":"2024-09-19T09:37:28.013536+0000","last_became_active":"2024-09-19T09:37:08.948494+0000","last_became_peered":"2024-09-19T09:37:08.948494+0000","last_unstale":"2024-09-19T09:37:28.013536+0000","last_undegraded":"2024-09-19T09:37:28.013536+0000","last_fullsized":"2024-09-19T09:37:28.013536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:35.255778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017276+0000","last_change":"2024-09-19T09:37:10.966315+0000","last_active":"2024-09-19T09:37:28.017276+0000","last_peered":"2024-09-19T09:37:28.017276+0000","last_clean":"2024-09-19T09:37:28.017276+0000","last_became_active":"2024-09-19T09:37:10.965979+0000","last_became_peered":"2024-09-19T09:37:10.965979+0000","last_unstale":"2024-09-19T09:37:28.017276+0000","last_undegraded":"2024-09-19T09:37:28.017276+0000","last_fullsized":"2024-09-19T09:37:28.017276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:36.229434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.030136+0000","last_change":"2024-09-19T09:37:28.029598+0000","last_active":"2024-09-19T09:37:28.030136+0000","last_peered":"2024-09-19T09:37:28.030136+0000","last_clean":"2024-09-19T09:37:28.030136+0000","last_became_active":"2024-09-19T09:37:28.021459+0000","last_became_peered":"2024-09-19T09:37:28.021459+0000","last_unstale":"2024-09-19T09:37:28.030136+0000","last_undegraded":"2024-09-19T09:37:28.030136+0000","last_fullsized":"2024-09-19T09:37:28.030136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:00.755946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012816+0000","last_change":"2024-09-19T09:37:10.962825+0000","last_active":"2024-09-19T09:37:28.012816+0000","last_peered":"2024-09-19T09:37:28.012816+0000","last_clean":"2024-09-19T09:37:28.012816+0000","last_became_active":"2024-09-19T09:37:10.962475+0000","last_became_peered":"2024-09-19T09:37:10.962475+0000","last_unstale":"2024-09-19T09:37:28.012816+0000","last_undegraded":"2024-09-19T09:37:28.012816+0000","last_fullsized":"2024-09-19T09:37:28.012816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:30.650918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'5","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:11.082100+0000","last_change":"2024-09-19T09:37:08.976364+0000","last_active":"2024-09-19T09:38:11.082100+0000","last_peered":"2024-09-19T09:38:11.082100+0000","last_clean":"2024-09-19T09:38:11.082100+0000","last_became_active":"2024-09-19T09:37:08.975983+0000","last_became_peered":"2024-09-19T09:37:08.975983+0000","last_unstale":"2024-09-19T09:38:11.082100+0000","last_undegraded":"2024-09-19T09:38:11.082100+0000","last_fullsized":"2024-09-19T09:38:11.082100+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.762847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020702+0000","last_change":"2024-09-19T09:37:28.020341+0000","last_active":"2024-09-19T09:37:28.020702+0000","last_peered":"2024-09-19T09:37:28.020702+0000","last_clean":"2024-09-19T09:37:28.020702+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:37:28.020702+0000","last_undegraded":"2024-09-19T09:37:28.020702+0000","last_fullsized":"2024-09-19T09:37:28.020702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:24.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"79'6","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:10.081507+0000","last_change":"2024-09-19T09:37:08.950403+0000","last_active":"2024-09-19T09:38:10.081507+0000","last_peered":"2024-09-19T09:38:10.081507+0000","last_clean":"2024-09-19T09:38:10.081507+0000","last_became_active":"2024-09-19T09:37:08.950077+0000","last_became_peered":"2024-09-19T09:37:08.950077+0000","last_unstale":"2024-09-19T09:38:10.081507+0000","last_undegraded":"2024-09-19T09:38:10.081507+0000","last_fullsized":"2024-09-19T09:38:10.081507+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:46.446439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014647+0000","last_change":"2024-09-19T09:37:10.969493+0000","last_active":"2024-09-19T09:37:28.014647+0000","last_peered":"2024-09-19T09:37:28.014647+0000","last_clean":"2024-09-19T09:37:28.014647+0000","last_became_active":"2024-09-19T09:37:10.969038+0000","last_became_peered":"2024-09-19T09:37:10.969038+0000","last_unstale":"2024-09-19T09:37:28.014647+0000","last_undegraded":"2024-09-19T09:37:28.014647+0000","last_fullsized":"2024-09-19T09:37:28.014647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:55.518806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015137+0000","last_change":"2024-09-19T09:37:08.977207+0000","last_active":"2024-09-19T09:37:28.015137+0000","last_peered":"2024-09-19T09:37:28.015137+0000","last_clean":"2024-09-19T09:37:28.015137+0000","last_became_active":"2024-09-19T09:37:08.976859+0000","last_became_peered":"2024-09-19T09:37:08.976859+0000","last_unstale":"2024-09-19T09:37:28.015137+0000","last_undegraded":"2024-09-19T09:37:28.015137+0000","last_fullsized":"2024-09-19T09:37:28.015137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:25.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.023437+0000","last_change":"2024-09-19T09:37:28.023437+0000","last_active":"2024-09-19T09:37:28.023437+0000","last_peered":"2024-09-19T09:37:28.023437+0000","last_clean":"2024-09-19T09:37:28.023437+0000","last_became_active":"2024-09-19T09:37:28.018678+0000","last_became_peered":"2024-09-19T09:37:28.018678+0000","last_unstale":"2024-09-19T09:37:28.023437+0000","last_undegraded":"2024-09-19T09:37:28.023437+0000","last_fullsized":"2024-09-19T09:37:28.023437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:44.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020845+0000","last_change":"2024-09-19T09:37:08.976594+0000","last_active":"2024-09-19T09:37:28.020845+0000","last_peered":"2024-09-19T09:37:28.020845+0000","last_clean":"2024-09-19T09:37:28.020845+0000","last_became_active":"2024-09-19T09:37:08.976222+0000","last_became_peered":"2024-09-19T09:37:08.976222+0000","last_unstale":"2024-09-19T09:37:28.020845+0000","last_undegraded":"2024-09-19T09:37:28.020845+0000","last_fullsized":"2024-09-19T09:37:28.020845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:53.492591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013129+0000","last_change":"2024-09-19T09:37:10.957096+0000","last_active":"2024-09-19T09:37:28.013129+0000","last_peered":"2024-09-19T09:37:28.013129+0000","last_clean":"2024-09-19T09:37:28.013129+0000","last_became_active":"2024-09-19T09:37:10.956740+0000","last_became_peered":"2024-09-19T09:37:10.956740+0000","last_unstale":"2024-09-19T09:37:28.013129+0000","last_undegraded":"2024-09-19T09:37:28.013129+0000","last_fullsized":"2024-09-19T09:37:28.013129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:40.358624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'14","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:35.021212+0000","last_change":"2024-09-19T09:37:08.948528+0000","last_active":"2024-09-19T09:37:35.021212+0000","last_peered":"2024-09-19T09:37:35.021212+0000","last_clean":"2024-09-19T09:37:35.021212+0000","last_became_active":"2024-09-19T09:37:08.948183+0000","last_became_peered":"2024-09-19T09:37:08.948183+0000","last_unstale":"2024-09-19T09:37:35.021212+0000","last_undegraded":"2024-09-19T09:37:35.021212+0000","last_fullsized":"2024-09-19T09:37:35.021212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:23.214471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017729+0000","last_change":"2024-09-19T09:37:10.959492+0000","last_active":"2024-09-19T09:37:28.017729+0000","last_peered":"2024-09-19T09:37:28.017729+0000","last_clean":"2024-09-19T09:37:28.017729+0000","last_became_active":"2024-09-19T09:37:10.959032+0000","last_became_peered":"2024-09-19T09:37:10.959032+0000","last_unstale":"2024-09-19T09:37:28.017729+0000","last_undegraded":"2024-09-19T09:37:28.017729+0000","last_fullsized":"2024-09-19T09:37:28.017729+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.080976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013794+0000","last_change":"2024-09-19T09:37:09.270315+0000","last_active":"2024-09-19T09:37:28.013794+0000","last_peered":"2024-09-19T09:37:28.013794+0000","last_clean":"2024-09-19T09:37:28.013794+0000","last_became_active":"2024-09-19T09:37:09.269891+0000","last_became_peered":"2024-09-19T09:37:09.269891+0000","last_unstale":"2024-09-19T09:37:28.013794+0000","last_undegraded":"2024-09-19T09:37:28.013794+0000","last_fullsized":"2024-09-19T09:37:28.013794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:12.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016720+0000","last_change":"2024-09-19T09:37:10.961363+0000","last_active":"2024-09-19T09:37:28.016720+0000","last_peered":"2024-09-19T09:37:28.016720+0000","last_clean":"2024-09-19T09:37:28.016720+0000","last_became_active":"2024-09-19T09:37:10.960951+0000","last_became_peered":"2024-09-19T09:37:10.960951+0000","last_unstale":"2024-09-19T09:37:28.016720+0000","last_undegraded":"2024-09-19T09:37:28.016720+0000","last_fullsized":"2024-09-19T09:37:28.016720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:31.226355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015555+0000","last_change":"2024-09-19T09:37:08.976805+0000","last_active":"2024-09-19T09:37:28.015555+0000","last_peered":"2024-09-19T09:37:28.015555+0000","last_clean":"2024-09-19T09:37:28.015555+0000","last_became_active":"2024-09-19T09:37:08.976502+0000","last_became_peered":"2024-09-19T09:37:08.976502+0000","last_unstale":"2024-09-19T09:37:28.015555+0000","last_undegraded":"2024-09-19T09:37:28.015555+0000","last_fullsized":"2024-09-19T09:37:28.015555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:25.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020113+0000","last_change":"2024-09-19T09:37:10.965723+0000","last_active":"2024-09-19T09:37:28.020113+0000","last_peered":"2024-09-19T09:37:28.020113+0000","last_clean":"2024-09-19T09:37:28.020113+0000","last_became_active":"2024-09-19T09:37:10.965385+0000","last_became_peered":"2024-09-19T09:37:10.965385+0000","last_unstale":"2024-09-19T09:37:28.020113+0000","last_undegraded":"2024-09-19T09:37:28.020113+0000","last_fullsized":"2024-09-19T09:37:28.020113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:15.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017690+0000","last_change":"2024-09-19T09:37:08.948028+0000","last_active":"2024-09-19T09:37:28.017690+0000","last_peered":"2024-09-19T09:37:28.017690+0000","last_clean":"2024-09-19T09:37:28.017690+0000","last_became_active":"2024-09-19T09:37:08.947583+0000","last_became_peered":"2024-09-19T09:37:08.947583+0000","last_unstale":"2024-09-19T09:37:28.017690+0000","last_undegraded":"2024-09-19T09:37:28.017690+0000","last_fullsized":"2024-09-19T09:37:28.017690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:15.485850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017516+0000","last_change":"2024-09-19T09:37:10.964577+0000","last_active":"2024-09-19T09:37:28.017516+0000","last_peered":"2024-09-19T09:37:28.017516+0000","last_clean":"2024-09-19T09:37:28.017516+0000","last_became_active":"2024-09-19T09:37:10.964226+0000","last_became_peered":"2024-09-19T09:37:10.964226+0000","last_unstale":"2024-09-19T09:37:28.017516+0000","last_undegraded":"2024-09-19T09:37:28.017516+0000","last_fullsized":"2024-09-19T09:37:28.017516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:44.074286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014911+0000","last_change":"2024-09-19T09:37:08.952257+0000","last_active":"2024-09-19T09:37:28.014911+0000","last_peered":"2024-09-19T09:37:28.014911+0000","last_clean":"2024-09-19T09:37:28.014911+0000","last_became_active":"2024-09-19T09:37:08.951056+0000","last_became_peered":"2024-09-19T09:37:08.951056+0000","last_unstale":"2024-09-19T09:37:28.014911+0000","last_undegraded":"2024-09-19T09:37:28.014911+0000","last_fullsized":"2024-09-19T09:37:28.014911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:35.238551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017765+0000","last_change":"2024-09-19T09:37:10.965956+0000","last_active":"2024-09-19T09:37:28.017765+0000","last_peered":"2024-09-19T09:37:28.017765+0000","last_clean":"2024-09-19T09:37:28.017765+0000","last_became_active":"2024-09-19T09:37:10.965367+0000","last_became_peered":"2024-09-19T09:37:10.965367+0000","last_unstale":"2024-09-19T09:37:28.017765+0000","last_undegraded":"2024-09-19T09:37:28.017765+0000","last_fullsized":"2024-09-19T09:37:28.017765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:23.280106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.027523+0000","last_change":"2024-09-19T09:37:28.026998+0000","last_active":"2024-09-19T09:37:28.027523+0000","last_peered":"2024-09-19T09:37:28.027523+0000","last_clean":"2024-09-19T09:37:28.027523+0000","last_became_active":"2024-09-19T09:37:28.021169+0000","last_became_peered":"2024-09-19T09:37:28.021169+0000","last_unstale":"2024-09-19T09:37:28.027523+0000","last_undegraded":"2024-09-19T09:37:28.027523+0000","last_fullsized":"2024-09-19T09:37:28.027523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.876143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017806+0000","last_change":"2024-09-19T09:37:10.959937+0000","last_active":"2024-09-19T09:37:28.017806+0000","last_peered":"2024-09-19T09:37:28.017806+0000","last_clean":"2024-09-19T09:37:28.017806+0000","last_became_active":"2024-09-19T09:37:10.959466+0000","last_became_peered":"2024-09-19T09:37:10.959466+0000","last_unstale":"2024-09-19T09:37:28.017806+0000","last_undegraded":"2024-09-19T09:37:28.017806+0000","last_fullsized":"2024-09-19T09:37:28.017806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:13.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021701+0000","last_change":"2024-09-19T09:37:10.966737+0000","last_active":"2024-09-19T09:37:28.021701+0000","last_peered":"2024-09-19T09:37:28.021701+0000","last_clean":"2024-09-19T09:37:28.021701+0000","last_became_active":"2024-09-19T09:37:10.966436+0000","last_became_peered":"2024-09-19T09:37:10.966436+0000","last_unstale":"2024-09-19T09:37:28.021701+0000","last_undegraded":"2024-09-19T09:37:28.021701+0000","last_fullsized":"2024-09-19T09:37:28.021701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:05.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020657+0000","last_change":"2024-09-19T09:37:08.950225+0000","last_active":"2024-09-19T09:37:28.020657+0000","last_peered":"2024-09-19T09:37:28.020657+0000","last_clean":"2024-09-19T09:37:28.020657+0000","last_became_active":"2024-09-19T09:37:08.949855+0000","last_became_peered":"2024-09-19T09:37:08.949855+0000","last_unstale":"2024-09-19T09:37:28.020657+0000","last_undegraded":"2024-09-19T09:37:28.020657+0000","last_fullsized":"2024-09-19T09:37:28.020657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:12.315407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016294+0000","last_change":"2024-09-19T09:37:10.965763+0000","last_active":"2024-09-19T09:37:28.016294+0000","last_peered":"2024-09-19T09:37:28.016294+0000","last_clean":"2024-09-19T09:37:28.016294+0000","last_became_active":"2024-09-19T09:37:10.965425+0000","last_became_peered":"2024-09-19T09:37:10.965425+0000","last_unstale":"2024-09-19T09:37:28.016294+0000","last_undegraded":"2024-09-19T09:37:28.016294+0000","last_fullsized":"2024-09-19T09:37:28.016294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:34.474506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020815+0000","last_change":"2024-09-19T09:37:08.954211+0000","last_active":"2024-09-19T09:37:28.020815+0000","last_peered":"2024-09-19T09:37:28.020815+0000","last_clean":"2024-09-19T09:37:28.020815+0000","last_became_active":"2024-09-19T09:37:08.953869+0000","last_became_peered":"2024-09-19T09:37:08.953869+0000","last_unstale":"2024-09-19T09:37:28.020815+0000","last_undegraded":"2024-09-19T09:37:28.020815+0000","last_fullsized":"2024-09-19T09:37:28.020815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:10.650227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.016975+0000","last_change":"2024-09-19T09:37:10.957032+0000","last_active":"2024-09-19T09:37:28.016975+0000","last_peered":"2024-09-19T09:37:28.016975+0000","last_clean":"2024-09-19T09:37:28.016975+0000","last_became_active":"2024-09-19T09:37:10.955979+0000","last_became_peered":"2024-09-19T09:37:10.955979+0000","last_unstale":"2024-09-19T09:37:28.016975+0000","last_undegraded":"2024-09-19T09:37:28.016975+0000","last_fullsized":"2024-09-19T09:37:28.016975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.734353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018040+0000","last_change":"2024-09-19T09:37:08.976359+0000","last_active":"2024-09-19T09:37:28.018040+0000","last_peered":"2024-09-19T09:37:28.018040+0000","last_clean":"2024-09-19T09:37:28.018040+0000","last_became_active":"2024-09-19T09:37:08.976019+0000","last_became_peered":"2024-09-19T09:37:08.976019+0000","last_unstale":"2024-09-19T09:37:28.018040+0000","last_undegraded":"2024-09-19T09:37:28.018040+0000","last_fullsized":"2024-09-19T09:37:28.018040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:34.401585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017783+0000","last_change":"2024-09-19T09:37:10.954000+0000","last_active":"2024-09-19T09:37:28.017783+0000","last_peered":"2024-09-19T09:37:28.017783+0000","last_clean":"2024-09-19T09:37:28.017783+0000","last_became_active":"2024-09-19T09:37:10.953709+0000","last_became_peered":"2024-09-19T09:37:10.953709+0000","last_unstale":"2024-09-19T09:37:28.017783+0000","last_undegraded":"2024-09-19T09:37:28.017783+0000","last_fullsized":"2024-09-19T09:37:28.017783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:36.779680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:08.079000+0000","last_change":"2024-09-19T09:37:28.036392+0000","last_active":"2024-09-19T09:38:08.079000+0000","last_peered":"2024-09-19T09:38:08.079000+0000","last_clean":"2024-09-19T09:38:08.079000+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:08.079000+0000","last_undegraded":"2024-09-19T09:38:08.079000+0000","last_fullsized":"2024-09-19T09:38:08.079000+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:56.344807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69518,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":528,"num_read_kb":338,"num_write":245,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":28789,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":208554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612634,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":437286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841565,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1609728,"data_stored":1091018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495660,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1030507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659186,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":437326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888118,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051644,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":500667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280575,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476805,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":436896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607626,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":501221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":933888,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:38:15.978 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:38:15.978 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T09:38:15.978 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T09:38:15.979 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T09:38:16.237 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:16.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:16 smithi042 ceph-mon[31223]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:16.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:16 smithi042 ceph-mon[31223]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:16.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.719+0000 7fc5eeca5640 1 -- 172.21.15.42:0/3981384478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5e810e480 msgr2=0x7fc5e8110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.719+0000 7fc5eeca5640 1 --2- 172.21.15.42:0/3981384478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5e810e480 0x7fc5e8110870 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009ca0 tx=0x7fc5e002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.719+0000 7fc5eeca5640 1 -- 172.21.15.42:0/3981384478 shutdown_connections 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.719+0000 7fc5eeca5640 1 --2- 172.21.15.42:0/3981384478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5e810e480 0x7fc5e8110870 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.719+0000 7fc5eeca5640 1 --2- 172.21.15.42:0/3981384478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5e8101280 0x7fc5e810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.719+0000 7fc5eeca5640 1 --2- 172.21.15.42:0/3981384478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5e81008d0 0x7fc5e8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.719+0000 7fc5eeca5640 1 -- 172.21.15.42:0/3981384478 >> 172.21.15.42:0/3981384478 conn(0x7fc5e80fc7a0 msgr2=0x7fc5e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.719+0000 7fc5eeca5640 1 -- 172.21.15.42:0/3981384478 shutdown_connections 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.719+0000 7fc5eeca5640 1 -- 172.21.15.42:0/3981384478 wait complete. 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.720+0000 7fc5eeca5640 1 Processor -- start 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.720+0000 7fc5eeca5640 1 -- start start 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.720+0000 7fc5eeca5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5e81008d0 0x7fc5e819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.720+0000 7fc5eeca5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5e8101280 0x7fc5e819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eeca5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5e810e480 0x7fc5e819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eeca5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e81141d0 con 0x7fc5e81008d0 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eeca5640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e8114050 con 0x7fc5e8101280 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eeca5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e8114350 con 0x7fc5e810e480 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eca41640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5e81008d0 0x7fc5e819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eca41640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5e81008d0 0x7fc5e819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52650/0 (socket says 172.21.15.42:52650) 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eca41640 1 -- 172.21.15.42:0/2204487697 learned_addr learned my addr 172.21.15.42:0/2204487697 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5e7fff640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5e8101280 0x7fc5e819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5ed242640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5e810e480 0x7fc5e819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eca41640 1 -- 172.21.15.42:0/2204487697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5e810e480 msgr2=0x7fc5e819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eca41640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5e810e480 0x7fc5e819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eca41640 1 -- 172.21.15.42:0/2204487697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5e8101280 msgr2=0x7fc5e819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eca41640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5e8101280 0x7fc5e819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eca41640 1 -- 172.21.15.42:0/2204487697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e819f690 con 0x7fc5e81008d0 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eca41640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5e81008d0 0x7fc5e819a6e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00b4a0 tx=0x7fc5dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5e5ffb640 1 -- 172.21.15.42:0/2204487697 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc014070 con 0x7fc5e81008d0 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5e5ffb640 1 -- 172.21.15.42:0/2204487697 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5dc010af0 con 0x7fc5e81008d0 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5eeca5640 1 -- 172.21.15.42:0/2204487697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e819f980 con 0x7fc5e81008d0 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.721+0000 7fc5e5ffb640 1 -- 172.21.15.42:0/2204487697 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc017d10 con 0x7fc5e81008d0 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.722+0000 7fc5eeca5640 1 -- 172.21.15.42:0/2204487697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e81a7260 con 0x7fc5e81008d0 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.723+0000 7fc5eeca5640 1 -- 172.21.15.42:0/2204487697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e8100cb0 con 0x7fc5e81008d0 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.724+0000 7fc5e5ffb640 1 -- 172.21.15.42:0/2204487697 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc5dc017070 con 0x7fc5e81008d0 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.724+0000 7fc5e5ffb640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5d80a3350 0x7fc5d80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.724+0000 7fc5e7fff640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5d80a3350 0x7fc5d80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:16.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.724+0000 7fc5e5ffb640 1 -- 172.21.15.42:0/2204487697 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc5dc0ced10 con 0x7fc5e81008d0 2024-09-19T09:38:16.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.725+0000 7fc5e7fff640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5d80a3350 0x7fc5d80a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc5e81022e0 tx=0x7fc5d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:16.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.728+0000 7fc5e5ffb640 1 -- 172.21.15.42:0/2204487697 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc5dc09b9c0 con 0x7fc5e81008d0 2024-09-19T09:38:16.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:16 smithi171 ceph-mon[35803]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:16.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:16 smithi171 ceph-mon[35803]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:16.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:16 smithi136 ceph-mon[34840]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:16.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:16 smithi136 ceph-mon[34840]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.941+0000 7fc5eeca5640 1 -- 172.21.15.42:0/2204487697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc5e802d7c0 con 0x7fc5e81008d0 2024-09-19T09:38:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.941+0000 7fc5e5ffb640 1 -- 172.21.15.42:0/2204487697 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc5dc09b2c0 con 0x7fc5e81008d0 2024-09-19T09:38:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:16.943 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T09:38:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.943+0000 7fc5eeca5640 1 -- 172.21.15.42:0/2204487697 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5d80a3350 msgr2=0x7fc5d80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.943+0000 7fc5eeca5640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5d80a3350 0x7fc5d80a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc5e81022e0 tx=0x7fc5d400b390 comp rx=0 tx=0).stop 2024-09-19T09:38:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.943+0000 7fc5eeca5640 1 -- 172.21.15.42:0/2204487697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5e81008d0 msgr2=0x7fc5e819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.943+0000 7fc5eeca5640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5e81008d0 0x7fc5e819a6e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00b4a0 tx=0x7fc5dc00b960 comp rx=0 tx=0).stop 2024-09-19T09:38:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.943+0000 7fc5eeca5640 1 -- 172.21.15.42:0/2204487697 shutdown_connections 2024-09-19T09:38:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.943+0000 7fc5eeca5640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5d80a3350 0x7fc5d80a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:16.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.943+0000 7fc5eeca5640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5e810e480 0x7fc5e819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:16.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.943+0000 7fc5eeca5640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5e8101280 0x7fc5e819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:16.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.943+0000 7fc5eeca5640 1 --2- 172.21.15.42:0/2204487697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5e81008d0 0x7fc5e819a6e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:16.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.943+0000 7fc5eeca5640 1 -- 172.21.15.42:0/2204487697 >> 172.21.15.42:0/2204487697 conn(0x7fc5e80fc7a0 msgr2=0x7fc5e80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:16.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.944+0000 7fc5eeca5640 1 -- 172.21.15.42:0/2204487697 shutdown_connections 2024-09-19T09:38:16.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:16.944+0000 7fc5eeca5640 1 -- 172.21.15.42:0/2204487697 wait complete. 2024-09-19T09:38:17.506 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:17 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2204487697' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:38:17.507 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T09:38:17.508 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:17.764 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:17 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2204487697' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:38:17.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:17 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2204487697' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:38:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 -- 172.21.15.42:0/1316371791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c074590 msgr2=0x7f4b5c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 --2- 172.21.15.42:0/1316371791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c074590 0x7f4b5c074970 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009900 tx=0x7f4b5802a480 comp rx=0 tx=0).stop 2024-09-19T09:38:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 -- 172.21.15.42:0/1316371791 shutdown_connections 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 --2- 172.21.15.42:0/1316371791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c112b90 0x7f4b5c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 --2- 172.21.15.42:0/1316371791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c074eb0 0x7f4b5c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 --2- 172.21.15.42:0/1316371791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c074590 0x7f4b5c074970 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 -- 172.21.15.42:0/1316371791 >> 172.21.15.42:0/1316371791 conn(0x7f4b5c0fd8c0 msgr2=0x7f4b5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 -- 172.21.15.42:0/1316371791 shutdown_connections 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 -- 172.21.15.42:0/1316371791 wait complete. 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 Processor -- start 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.211+0000 7f4b633e3640 1 -- start start 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b633e3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c074590 0x7f4b5c1a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b633e3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c074eb0 0x7f4b5c1a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b633e3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c112b90 0x7f4b5c19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b633e3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c118550 con 0x7f4b5c074590 2024-09-19T09:38:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b633e3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1183d0 con 0x7f4b5c074eb0 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b633e3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1186d0 con 0x7f4b5c112b90 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b6117f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c074590 0x7f4b5c1a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b6117f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c074590 0x7f4b5c1a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52664/0 (socket says 172.21.15.42:52664) 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b6117f640 1 -- 172.21.15.42:0/4247230207 learned_addr learned my addr 172.21.15.42:0/4247230207 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b6097e640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c074eb0 0x7f4b5c1a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b61980640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c112b90 0x7f4b5c19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b6117f640 1 -- 172.21.15.42:0/4247230207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c112b90 msgr2=0x7f4b5c19e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b6117f640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c112b90 0x7f4b5c19e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b6117f640 1 -- 172.21.15.42:0/4247230207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c074eb0 msgr2=0x7f4b5c1a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b6117f640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c074eb0 0x7f4b5c1a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b6117f640 1 -- 172.21.15.42:0/4247230207 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c19eff0 con 0x7f4b5c074590 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.212+0000 7f4b6117f640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c074590 0x7f4b5c1a4700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4b58005ab0 tx=0x7f4b580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:18.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.213+0000 7f4b527fc640 1 -- 172.21.15.42:0/4247230207 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5803f030 con 0x7f4b5c074590 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.213+0000 7f4b633e3640 1 -- 172.21.15.42:0/4247230207 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5c19f280 con 0x7f4b5c074590 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.213+0000 7f4b527fc640 1 -- 172.21.15.42:0/4247230207 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b58003ce0 con 0x7f4b5c074590 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.213+0000 7f4b527fc640 1 -- 172.21.15.42:0/4247230207 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58035070 con 0x7f4b5c074590 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.213+0000 7f4b633e3640 1 -- 172.21.15.42:0/4247230207 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5c1ab5d0 con 0x7f4b5c074590 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.214+0000 7f4b633e3640 1 -- 172.21.15.42:0/4247230207 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5c074970 con 0x7f4b5c074590 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.215+0000 7f4b527fc640 1 -- 172.21.15.42:0/4247230207 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4b58042030 con 0x7f4b5c074590 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.216+0000 7f4b527fc640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b480a32d0 0x7f4b480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.216+0000 7f4b6097e640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b480a32d0 0x7f4b480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.216+0000 7f4b527fc640 1 -- 172.21.15.42:0/4247230207 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4b580f0390 con 0x7f4b5c074590 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.216+0000 7f4b6097e640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b480a32d0 0x7f4b480a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c1000e0 tx=0x7f4b4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.220+0000 7f4b527fc640 1 -- 172.21.15.42:0/4247230207 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b580bcf30 con 0x7f4b5c074590 2024-09-19T09:38:18.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.434+0000 7f4b633e3640 1 -- 172.21.15.42:0/4247230207 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b5c19fdf0 con 0x7f4b5c074590 2024-09-19T09:38:18.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.434+0000 7f4b527fc640 1 -- 172.21.15.42:0/4247230207 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7f4b580bc830 con 0x7f4b5c074590 2024-09-19T09:38:18.436 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:18.436 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":27,"btime":"2024-09-19T09:37:23:003045+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:37:23.003018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:38:18.436 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 27 2024-09-19T09:38:18.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 -- 172.21.15.42:0/4247230207 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b480a32d0 msgr2=0x7f4b480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:18.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b480a32d0 0x7f4b480a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c1000e0 tx=0x7f4b4c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 -- 172.21.15.42:0/4247230207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c074590 msgr2=0x7f4b5c1a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:18.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c074590 0x7f4b5c1a4700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4b58005ab0 tx=0x7f4b580042f0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 -- 172.21.15.42:0/4247230207 shutdown_connections 2024-09-19T09:38:18.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b480a32d0 0x7f4b480a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c112b90 0x7f4b5c19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c074eb0 0x7f4b5c1a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 --2- 172.21.15.42:0/4247230207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c074590 0x7f4b5c1a4700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:18.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 -- 172.21.15.42:0/4247230207 >> 172.21.15.42:0/4247230207 conn(0x7f4b5c0fd8c0 msgr2=0x7f4b5c0ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:18.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 -- 172.21.15.42:0/4247230207 shutdown_connections 2024-09-19T09:38:18.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:18.436+0000 7f4b633e3640 1 -- 172.21.15.42:0/4247230207 wait complete. 2024-09-19T09:38:18.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:18 smithi042 ceph-mon[31223]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:18 smithi171 ceph-mon[35803]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:18 smithi136 ceph-mon[34840]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:19.152 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:19.411 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:19.687 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:19 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/4247230207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:19.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:19 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/4247230207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:19.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:19 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/4247230207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:19.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 -- 172.21.15.42:0/1805907995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f889c108300 msgr2=0x7f889c10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:19.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 --2- 172.21.15.42:0/1805907995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f889c108300 0x7f889c10ec70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8894009cd0 tx=0x7f889402a8d0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 -- 172.21.15.42:0/1805907995 shutdown_connections 2024-09-19T09:38:19.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 --2- 172.21.15.42:0/1805907995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f889c108300 0x7f889c10ec70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 --2- 172.21.15.42:0/1805907995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f889c103780 0x7f889c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 --2- 172.21.15.42:0/1805907995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c102dd0 0x7f889c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 -- 172.21.15.42:0/1805907995 >> 172.21.15.42:0/1805907995 conn(0x7f889c0fc7d0 msgr2=0x7f889c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 -- 172.21.15.42:0/1805907995 shutdown_connections 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 -- 172.21.15.42:0/1805907995 wait complete. 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 Processor -- start 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.886+0000 7f88a2321640 1 -- start start 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f88a2321640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f889c102dd0 0x7f889c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f88a2321640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c103780 0x7f889c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f88a2321640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f889c108300 0x7f889c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f88a2321640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f889c1120d0 con 0x7f889c102dd0 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f88a2321640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f889c111f50 con 0x7f889c103780 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f88a2321640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f889c112250 con 0x7f889c108300 2024-09-19T09:38:19.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f889c102dd0 0x7f889c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:19.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f889c102dd0 0x7f889c1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52692/0 (socket says 172.21.15.42:52692) 2024-09-19T09:38:19.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889bfff640 1 -- 172.21.15.42:0/2324611583 learned_addr learned my addr 172.21.15.42:0/2324611583 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:19.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889b7fe640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c103780 0x7f889c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:19.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f88a08be640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f889c108300 0x7f889c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:19.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889bfff640 1 -- 172.21.15.42:0/2324611583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f889c108300 msgr2=0x7f889c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:19.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889bfff640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f889c108300 0x7f889c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889bfff640 1 -- 172.21.15.42:0/2324611583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c103780 msgr2=0x7f889c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:19.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889bfff640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c103780 0x7f889c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889bfff640 1 -- 172.21.15.42:0/2324611583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c19d4a0 con 0x7f889c102dd0 2024-09-19T09:38:19.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889b7fe640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c103780 0x7f889c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:19.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.887+0000 7f889bfff640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f889c102dd0 0x7f889c1984f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f888c00e9f0 tx=0x7f888c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:19.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.888+0000 7f88997fa640 1 -- 172.21.15.42:0/2324611583 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c00cd80 con 0x7f889c102dd0 2024-09-19T09:38:19.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.888+0000 7f88997fa640 1 -- 172.21.15.42:0/2324611583 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f888c010910 con 0x7f889c102dd0 2024-09-19T09:38:19.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.888+0000 7f88a2321640 1 -- 172.21.15.42:0/2324611583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c19d790 con 0x7f889c102dd0 2024-09-19T09:38:19.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.888+0000 7f88997fa640 1 -- 172.21.15.42:0/2324611583 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c018990 con 0x7f889c102dd0 2024-09-19T09:38:19.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.888+0000 7f88a2321640 1 -- 172.21.15.42:0/2324611583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c1a5070 con 0x7f889c102dd0 2024-09-19T09:38:19.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.889+0000 7f88a2321640 1 -- 172.21.15.42:0/2324611583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c1031b0 con 0x7f889c102dd0 2024-09-19T09:38:19.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.890+0000 7f88997fa640 1 -- 172.21.15.42:0/2324611583 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f888c010ac0 con 0x7f889c102dd0 2024-09-19T09:38:19.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.891+0000 7f88997fa640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f88840a32d0 0x7f88840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:19.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.891+0000 7f889b7fe640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f88840a32d0 0x7f88840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:19.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.891+0000 7f88997fa640 1 -- 172.21.15.42:0/2324611583 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f888c0d0370 con 0x7f889c102dd0 2024-09-19T09:38:19.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.891+0000 7f889b7fe640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f88840a32d0 0x7f88840a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8890005e10 tx=0x7f8890005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:19.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:19.894+0000 7f88997fa640 1 -- 172.21.15.42:0/2324611583 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f888c09cf10 con 0x7f889c102dd0 2024-09-19T09:38:20.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.107+0000 7f88a2321640 1 -- 172.21.15.42:0/2324611583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f889c199850 con 0x7f889c102dd0 2024-09-19T09:38:20.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.108+0000 7f88997fa640 1 -- 172.21.15.42:0/2324611583 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7f888c09c810 con 0x7f889c102dd0 2024-09-19T09:38:20.110 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:20.110 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":27,"btime":"2024-09-19T09:37:23:003045+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:37:23.003018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:38:20.110 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 27 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 -- 172.21.15.42:0/2324611583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f88840a32d0 msgr2=0x7f88840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f88840a32d0 0x7f88840a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8890005e10 tx=0x7f8890005da0 comp rx=0 tx=0).stop 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 -- 172.21.15.42:0/2324611583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f889c102dd0 msgr2=0x7f889c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f889c102dd0 0x7f889c1984f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f888c00e9f0 tx=0x7f888c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 -- 172.21.15.42:0/2324611583 shutdown_connections 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f88840a32d0 0x7f88840a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f889c108300 0x7f889c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c103780 0x7f889c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 --2- 172.21.15.42:0/2324611583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f889c102dd0 0x7f889c1984f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 -- 172.21.15.42:0/2324611583 >> 172.21.15.42:0/2324611583 conn(0x7f889c0fc7d0 msgr2=0x7f889c105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 -- 172.21.15.42:0/2324611583 shutdown_connections 2024-09-19T09:38:20.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:20.110+0000 7f88a2321640 1 -- 172.21.15.42:0/2324611583 wait complete. 2024-09-19T09:38:20.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:20 smithi042 ceph-mon[31223]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:20.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:20 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2324611583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:20.785 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:38:20.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:20 smithi171 ceph-mon[35803]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:20.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:20 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2324611583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:20 smithi136 ceph-mon[34840]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:20 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2324611583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:21.049 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:21.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.551+0000 7ffb6b770640 1 -- 172.21.15.42:0/3447572785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb64100e20 msgr2=0x7ffb64101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:21.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.551+0000 7ffb6b770640 1 --2- 172.21.15.42:0/3447572785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb64100e20 0x7ffb64101200 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009900 tx=0x7ffb6002a480 comp rx=0 tx=0).stop 2024-09-19T09:38:21.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.551+0000 7ffb6b770640 1 -- 172.21.15.42:0/3447572785 shutdown_connections 2024-09-19T09:38:21.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.551+0000 7ffb6b770640 1 --2- 172.21.15.42:0/3447572785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb64102ef0 0x7ffb6410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.551+0000 7ffb6b770640 1 --2- 172.21.15.42:0/3447572785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb64102570 0x7ffb641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.551+0000 7ffb6b770640 1 --2- 172.21.15.42:0/3447572785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb64100e20 0x7ffb64101200 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.551+0000 7ffb6b770640 1 -- 172.21.15.42:0/3447572785 >> 172.21.15.42:0/3447572785 conn(0x7ffb640fc7d0 msgr2=0x7ffb640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.551+0000 7ffb6b770640 1 -- 172.21.15.42:0/3447572785 shutdown_connections 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.551+0000 7ffb6b770640 1 -- 172.21.15.42:0/3447572785 wait complete. 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.551+0000 7ffb6b770640 1 Processor -- start 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6b770640 1 -- start start 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6b770640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb64100e20 0x7ffb641971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6b770640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb64102570 0x7ffb64197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6b770640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb64102ef0 0x7ffb64197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6b770640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64110f80 con 0x7ffb64100e20 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6b770640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64110e00 con 0x7ffb64102ef0 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6b770640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64111100 con 0x7ffb64102570 2024-09-19T09:38:21.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6950c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb64100e20 0x7ffb641971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6950c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb64100e20 0x7ffb641971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58520/0 (socket says 172.21.15.42:58520) 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6950c640 1 -- 172.21.15.42:0/3627302760 learned_addr learned my addr 172.21.15.42:0/3627302760 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb69d0d640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb64102ef0 0x7ffb64197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb68d0b640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb64102570 0x7ffb64197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6950c640 1 -- 172.21.15.42:0/3627302760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb64102570 msgr2=0x7ffb64197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6950c640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb64102570 0x7ffb64197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6950c640 1 -- 172.21.15.42:0/3627302760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb64102ef0 msgr2=0x7ffb64197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6950c640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb64102ef0 0x7ffb64197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6950c640 1 -- 172.21.15.42:0/3627302760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb641a6a30 con 0x7ffb64100e20 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.552+0000 7ffb6950c640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb64100e20 0x7ffb641971c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb60006010 tx=0x7ffb60003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.553+0000 7ffb5a7fc640 1 -- 172.21.15.42:0/3627302760 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6003f070 con 0x7ffb64100e20 2024-09-19T09:38:21.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.553+0000 7ffb5a7fc640 1 -- 172.21.15.42:0/3627302760 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb60031c30 con 0x7ffb64100e20 2024-09-19T09:38:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.553+0000 7ffb6b770640 1 -- 172.21.15.42:0/3627302760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb641a6cc0 con 0x7ffb64100e20 2024-09-19T09:38:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.553+0000 7ffb5a7fc640 1 -- 172.21.15.42:0/3627302760 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60035030 con 0x7ffb64100e20 2024-09-19T09:38:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.553+0000 7ffb6b770640 1 -- 172.21.15.42:0/3627302760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb641a71a0 con 0x7ffb64100e20 2024-09-19T09:38:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.554+0000 7ffb6b770640 1 -- 172.21.15.42:0/3627302760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb64101200 con 0x7ffb64100e20 2024-09-19T09:38:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.556+0000 7ffb5a7fc640 1 -- 172.21.15.42:0/3627302760 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffb60042070 con 0x7ffb64100e20 2024-09-19T09:38:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.556+0000 7ffb5a7fc640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a3350 0x7ffb500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.556+0000 7ffb68d0b640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a3350 0x7ffb500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.557+0000 7ffb5a7fc640 1 -- 172.21.15.42:0/3627302760 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ffb600f0750 con 0x7ffb64100e20 2024-09-19T09:38:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.557+0000 7ffb68d0b640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a3350 0x7ffb500a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb54005fd0 tx=0x7ffb54005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:21.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.560+0000 7ffb5a7fc640 1 -- 172.21.15.42:0/3627302760 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb600bd2f0 con 0x7ffb64100e20 2024-09-19T09:38:21.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.735+0000 7ffb6b770640 1 -- 172.21.15.42:0/3627302760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb6406a560 con 0x7ffb64100e20 2024-09-19T09:38:21.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.736+0000 7ffb5a7fc640 1 -- 172.21.15.42:0/3627302760 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22852 (secure 0 0 0) 0x7ffb6406a560 con 0x7ffb64100e20 2024-09-19T09:38:21.738 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:21.739 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:28.010101+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:38:21.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 -- 172.21.15.42:0/3627302760 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a3350 msgr2=0x7ffb500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:21.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a3350 0x7ffb500a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb54005fd0 tx=0x7ffb54005850 comp rx=0 tx=0).stop 2024-09-19T09:38:21.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 -- 172.21.15.42:0/3627302760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb64100e20 msgr2=0x7ffb641971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:21.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb64100e20 0x7ffb641971c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb60006010 tx=0x7ffb60003c10 comp rx=0 tx=0).stop 2024-09-19T09:38:21.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 -- 172.21.15.42:0/3627302760 shutdown_connections 2024-09-19T09:38:21.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb500a3350 0x7ffb500a5810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb64102ef0 0x7ffb64197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb64102570 0x7ffb64197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 --2- 172.21.15.42:0/3627302760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb64100e20 0x7ffb641971c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 -- 172.21.15.42:0/3627302760 >> 172.21.15.42:0/3627302760 conn(0x7ffb640fc7d0 msgr2=0x7ffb640fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 -- 172.21.15.42:0/3627302760 shutdown_connections 2024-09-19T09:38:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:21.739+0000 7ffb6b770640 1 -- 172.21.15.42:0/3627302760 wait complete. 2024-09-19T09:38:22.373 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:22.643 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:22.661 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:22 smithi042 ceph-mon[31223]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:22.661 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:22 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3627302760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:22 smithi171 ceph-mon[35803]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:22 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3627302760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:22 smithi136 ceph-mon[34840]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:22 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3627302760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:23.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.078+0000 7f612cc88640 1 -- 172.21.15.42:0/2578677400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6128102d30 msgr2=0x7f6128103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.078+0000 7f612cc88640 1 --2- 172.21.15.42:0/2578677400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6128102d30 0x7f6128103110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6118009930 tx=0x7f611802a420 comp rx=0 tx=0).stop 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.078+0000 7f612cc88640 1 -- 172.21.15.42:0/2578677400 shutdown_connections 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.078+0000 7f612cc88640 1 --2- 172.21.15.42:0/2578677400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61281082a0 0x7f612810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.078+0000 7f612cc88640 1 --2- 172.21.15.42:0/2578677400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61281036e0 0x7f6128107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.078+0000 7f612cc88640 1 --2- 172.21.15.42:0/2578677400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6128102d30 0x7f6128103110 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.078+0000 7f612cc88640 1 -- 172.21.15.42:0/2578677400 >> 172.21.15.42:0/2578677400 conn(0x7f61280fc7d0 msgr2=0x7f61280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.078+0000 7f612cc88640 1 -- 172.21.15.42:0/2578677400 shutdown_connections 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.078+0000 7f612cc88640 1 -- 172.21.15.42:0/2578677400 wait complete. 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.079+0000 7f612cc88640 1 Processor -- start 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.079+0000 7f612cc88640 1 -- start start 2024-09-19T09:38:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.079+0000 7f612cc88640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6128102d30 0x7f6128198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.079+0000 7f612cc88640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61281036e0 0x7f6128198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.079+0000 7f612cc88640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61281082a0 0x7f612819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.079+0000 7f612cc88640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f61281120a0 con 0x7f6128102d30 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.079+0000 7f612cc88640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6128111f20 con 0x7f61281036e0 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.079+0000 7f612cc88640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6128112220 con 0x7f61281082a0 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6128102d30 0x7f6128198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6128102d30 0x7f6128198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58530/0 (socket says 172.21.15.42:58530) 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612659c640 1 -- 172.21.15.42:0/109348704 learned_addr learned my addr 172.21.15.42:0/109348704 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f6126d9d640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61281082a0 0x7f612819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f6125d9b640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61281036e0 0x7f6128198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612659c640 1 -- 172.21.15.42:0/109348704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61281082a0 msgr2=0x7f612819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612659c640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61281082a0 0x7f612819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612659c640 1 -- 172.21.15.42:0/109348704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61281036e0 msgr2=0x7f6128198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612659c640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61281036e0 0x7f6128198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612659c640 1 -- 172.21.15.42:0/109348704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612819d4e0 con 0x7f6128102d30 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612659c640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6128102d30 0x7f6128198530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6118009230 tx=0x7f6118004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f61177fe640 1 -- 172.21.15.42:0/109348704 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611803f030 con 0x7f6128102d30 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f61177fe640 1 -- 172.21.15.42:0/109348704 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6118003ad0 con 0x7f6128102d30 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612cc88640 1 -- 172.21.15.42:0/109348704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612819d770 con 0x7f6128102d30 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f61177fe640 1 -- 172.21.15.42:0/109348704 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6118035070 con 0x7f6128102d30 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.080+0000 7f612cc88640 1 -- 172.21.15.42:0/109348704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61281a50b0 con 0x7f6128102d30 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.082+0000 7f612cc88640 1 -- 172.21.15.42:0/109348704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6128103110 con 0x7f6128102d30 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.082+0000 7f61177fe640 1 -- 172.21.15.42:0/109348704 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6118042030 con 0x7f6128102d30 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.083+0000 7f61177fe640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f61100a3350 0x7f61100a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.084+0000 7f6125d9b640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f61100a3350 0x7f61100a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:23.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.084+0000 7f61177fe640 1 -- 172.21.15.42:0/109348704 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f61180eff50 con 0x7f6128102d30 2024-09-19T09:38:23.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.084+0000 7f6125d9b640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f61100a3350 0x7f61100a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f611c005fd0 tx=0x7f611c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:23.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.087+0000 7f61177fe640 1 -- 172.21.15.42:0/109348704 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f61180bcaf0 con 0x7f6128102d30 2024-09-19T09:38:23.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.305+0000 7f612cc88640 1 -- 172.21.15.42:0/109348704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f612810a2b0 con 0x7f6128102d30 2024-09-19T09:38:23.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.306+0000 7f61177fe640 1 -- 172.21.15.42:0/109348704 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7f61180bc3f0 con 0x7f6128102d30 2024-09-19T09:38:23.308 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:23.308 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":27,"btime":"2024-09-19T09:37:23:003045+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:37:23.003018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:38:23.309 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 27 2024-09-19T09:38:23.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.308+0000 7f612cc88640 1 -- 172.21.15.42:0/109348704 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f61100a3350 msgr2=0x7f61100a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:23.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.308+0000 7f612cc88640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f61100a3350 0x7f61100a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f611c005fd0 tx=0x7f611c005850 comp rx=0 tx=0).stop 2024-09-19T09:38:23.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.308+0000 7f612cc88640 1 -- 172.21.15.42:0/109348704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6128102d30 msgr2=0x7f6128198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:23.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.308+0000 7f612cc88640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6128102d30 0x7f6128198530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6118009230 tx=0x7f6118004270 comp rx=0 tx=0).stop 2024-09-19T09:38:23.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.309+0000 7f612cc88640 1 -- 172.21.15.42:0/109348704 shutdown_connections 2024-09-19T09:38:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.309+0000 7f612cc88640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f61100a3350 0x7f61100a5810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.309+0000 7f612cc88640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61281082a0 0x7f612819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.309+0000 7f612cc88640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61281036e0 0x7f6128198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.309+0000 7f612cc88640 1 --2- 172.21.15.42:0/109348704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6128102d30 0x7f6128198530 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.309+0000 7f612cc88640 1 -- 172.21.15.42:0/109348704 >> 172.21.15.42:0/109348704 conn(0x7f61280fc7d0 msgr2=0x7f6128105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.309+0000 7f612cc88640 1 -- 172.21.15.42:0/109348704 shutdown_connections 2024-09-19T09:38:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:23.309+0000 7f612cc88640 1 -- 172.21.15.42:0/109348704 wait complete. 2024-09-19T09:38:23.675 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:23 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/109348704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:23.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:23 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/109348704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:23 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/109348704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:24.003 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:37:11.524843+0000', 'modified': '2024-09-19T09:37:23.003018+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24506, 'mds_1': 24478, 'mds_2': 24473, 'mds_3': 24466, 'mds_4': 24454}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14622': {'gid': 14622, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6839/3152711275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6838', 'nonce': 3152711275}, {'type': 'v1', 'addr': '172.21.15.42:6839', 'nonce': 3152711275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14628': {'gid': 14628, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6841/649947071', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6840', 'nonce': 649947071}, {'type': 'v1', 'addr': '172.21.15.42:6841', 'nonce': 649947071}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6833/1004485926', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 1004485926}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 1004485926}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6833/1364803362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6832', 'nonce': 1364803362}, {'type': 'v1', 'addr': '172.21.15.136:6833', 'nonce': 1364803362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6835/3800275147', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 3800275147}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 3800275147}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.171:6835/3609400567', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 3609400567}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 3609400567}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.171:6837/512338141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 512338141}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 512338141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.136:6837/2776197166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 2776197166}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 2776197166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.171:6839/3148784527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6838', 'nonce': 3148784527}, {'type': 'v1', 'addr': '172.21.15.171:6839', 'nonce': 3148784527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.136:6839/2003809688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 2003809688}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 2003809688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24506, 'qdb_cluster': [24478, 24473, 24466, 24506, 24454]} 2024-09-19T09:38:24.003 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:38:24.003 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T09:38:24.263 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:24.686 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:24 smithi042 ceph-mon[31223]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.767+0000 7facbbb5d640 1 -- 172.21.15.42:0/1094375556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facb4101420 msgr2=0x7facb410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.767+0000 7facbbb5d640 1 --2- 172.21.15.42:0/1094375556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facb4101420 0x7facb410d950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7facac009cd0 tx=0x7facac02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.767+0000 7facbbb5d640 1 -- 172.21.15.42:0/1094375556 shutdown_connections 2024-09-19T09:38:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.767+0000 7facbbb5d640 1 --2- 172.21.15.42:0/1094375556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facb4101420 0x7facb410d950 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.767+0000 7facbbb5d640 1 --2- 172.21.15.42:0/1094375556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb4100a80 0x7facb4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.767+0000 7facbbb5d640 1 --2- 172.21.15.42:0/1094375556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facb4106a80 0x7facb4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.767+0000 7facbbb5d640 1 -- 172.21.15.42:0/1094375556 >> 172.21.15.42:0/1094375556 conn(0x7facb40fc7a0 msgr2=0x7facb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.768+0000 7facbbb5d640 1 -- 172.21.15.42:0/1094375556 shutdown_connections 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.768+0000 7facbbb5d640 1 -- 172.21.15.42:0/1094375556 wait complete. 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.768+0000 7facbbb5d640 1 Processor -- start 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.768+0000 7facbbb5d640 1 -- start start 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facbbb5d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb4100a80 0x7facb4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facbbb5d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facb4101420 0x7facb4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facbbb5d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facb4106a80 0x7facb41a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facbbb5d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7facb4110ec0 con 0x7facb4101420 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facbbb5d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7facb4110d40 con 0x7facb4106a80 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facbbb5d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7facb4111040 con 0x7facb4100a80 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facb90f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facb4101420 0x7facb4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facb90f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facb4101420 0x7facb4199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58542/0 (socket says 172.21.15.42:58542) 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facb90f8640 1 -- 172.21.15.42:0/1703600344 learned_addr learned my addr 172.21.15.42:0/1703600344 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facb98f9640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb4100a80 0x7facb4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facb90f8640 1 -- 172.21.15.42:0/1703600344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb4100a80 msgr2=0x7facb4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facb90f8640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb4100a80 0x7facb4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facb90f8640 1 -- 172.21.15.42:0/1703600344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facb4106a80 msgr2=0x7facb41a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facba0fa640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facb4106a80 0x7facb41a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facb90f8640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facb4106a80 0x7facb41a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facb90f8640 1 -- 172.21.15.42:0/1703600344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb41a48d0 con 0x7facb4101420 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facba0fa640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facb4106a80 0x7facb41a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facb90f8640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facb4101420 0x7facb4199850 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faca400d770 tx=0x7faca400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facaaffd640 1 -- 172.21.15.42:0/1703600344 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4017070 con 0x7facb4101420 2024-09-19T09:38:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facaaffd640 1 -- 172.21.15.42:0/1703600344 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca4005500 con 0x7facb4101420 2024-09-19T09:38:24.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facbbb5d640 1 -- 172.21.15.42:0/1703600344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb41a4aa0 con 0x7facb4101420 2024-09-19T09:38:24.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.769+0000 7facaaffd640 1 -- 172.21.15.42:0/1703600344 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4004e00 con 0x7facb4101420 2024-09-19T09:38:24.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.770+0000 7facbbb5d640 1 -- 172.21.15.42:0/1703600344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb41a4fb0 con 0x7facb4101420 2024-09-19T09:38:24.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.772+0000 7facaaffd640 1 -- 172.21.15.42:0/1703600344 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7faca4004fa0 con 0x7facb4101420 2024-09-19T09:38:24.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.772+0000 7facbdf36740 1 Processor -- start 2024-09-19T09:38:24.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.772+0000 7facbdf36740 1 -- start start 2024-09-19T09:38:24.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facbdf36740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea47f89d0 0x563ea47f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facbdf36740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea4803670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facbdf36740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea4803bb0 0x563ea4805fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facbdf36740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563ea475f090 con 0x563ea4803bb0 2024-09-19T09:38:24.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facbdf36740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563ea4706a70 con 0x563ea47f89d0 2024-09-19T09:38:24.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facbdf36740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563ea475b050 con 0x563ea47f92f0 2024-09-19T09:38:24.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facaaffd640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faca00a3350 0x7faca00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facb90f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea4803bb0 0x563ea4805fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facba0fa640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faca00a3350 0x7faca00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facba0fa640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea47f89d0 0x563ea47f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facb98f9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea4803670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facb90f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea4803bb0 0x563ea4805fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58558/0 (socket says 172.21.15.42:58558) 2024-09-19T09:38:24.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facb90f8640 1 -- 172.21.15.42:0/1459298193 learned_addr learned my addr 172.21.15.42:0/1459298193 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:24.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facaaffd640 1 -- 172.21.15.42:0/1703600344 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7faca40cf540 con 0x7facb4101420 2024-09-19T09:38:24.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facb90f8640 1 -- 172.21.15.42:0/1459298193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 msgr2=0x563ea4803670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facb90f8640 1 --2- 172.21.15.42:0/1459298193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea4803670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facb90f8640 1 -- 172.21.15.42:0/1459298193 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea47f89d0 msgr2=0x563ea47f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facb90f8640 1 --2- 172.21.15.42:0/1459298193 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea47f89d0 0x563ea47f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facb90f8640 1 -- 172.21.15.42:0/1459298193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ea4713130 con 0x563ea4803bb0 2024-09-19T09:38:24.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.773+0000 7facba0fa640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faca00a3350 0x7faca00a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facac031860 tx=0x7facac009910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.774+0000 7facb90f8640 1 --2- 172.21.15.42:0/1459298193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea4803bb0 0x563ea4805fa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faca40983b0 tx=0x7faca40bbc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a69a479b1b55c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.774+0000 7fac9ffff640 1 -- 172.21.15.42:0/1459298193 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4020030 con 0x563ea4803bb0 2024-09-19T09:38:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.774+0000 7fac9ffff640 1 -- 172.21.15.42:0/1459298193 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca40046c0 con 0x563ea4803bb0 2024-09-19T09:38:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.774+0000 7fac9ffff640 1 -- 172.21.15.42:0/1459298193 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4009cc0 con 0x563ea4803bb0 2024-09-19T09:38:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.774+0000 7facbdf36740 1 -- 172.21.15.42:0/1459298193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea4803bb0 msgr2=0x563ea4805fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.774+0000 7facbdf36740 1 --2- 172.21.15.42:0/1459298193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea4803bb0 0x563ea4805fa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faca40983b0 tx=0x7faca40bbc10 comp rx=0 tx=0).stop 2024-09-19T09:38:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 -- 172.21.15.42:0/1459298193 shutdown_connections 2024-09-19T09:38:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 --2- 172.21.15.42:0/1459298193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea4803bb0 0x563ea4805fa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 --2- 172.21.15.42:0/1459298193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea4803670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 --2- 172.21.15.42:0/1459298193 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea47f89d0 0x563ea47f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 -- 172.21.15.42:0/1459298193 >> 172.21.15.42:0/1459298193 conn(0x563ea47f4f60 msgr2=0x563ea47f5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 -- 172.21.15.42:0/1459298193 shutdown_connections 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 -- 172.21.15.42:0/1459298193 wait complete. 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 -- start start 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 Processor -- start 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48033e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea4800780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea4800cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563ea4806780 con 0x563ea47f89d0 2024-09-19T09:38:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563ea4719f20 con 0x563ea4803bb0 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563ea4806900 con 0x563ea47f92f0 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.775+0000 7facbdf36740 10 client.0 _ll_register_callbacks cb 0x563ea46e3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facb98f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48033e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facb98f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48033e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58562/0 (socket says 172.21.15.42:58562) 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facb98f9640 1 -- 172.21.15.42:0/2396183482 learned_addr learned my addr 172.21.15.42:0/2396183482 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facba0fa640 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea4800cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facb98f9640 1 -- 172.21.15.42:0/2396183482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 msgr2=0x563ea4800780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facb98f9640 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea4800780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facb98f9640 1 -- 172.21.15.42:0/2396183482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 msgr2=0x563ea4800cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facb98f9640 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea4800cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facb98f9640 1 -- 172.21.15.42:0/2396183482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ea44d02b0 con 0x563ea47f89d0 2024-09-19T09:38:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facb98f9640 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48033e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7facb00104d0 tx=0x7facb0010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6d37bc851843e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7fac9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2396183482 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb001a020 con 0x563ea47f89d0 2024-09-19T09:38:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2396183482 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7facb0016690 con 0x563ea47f89d0 2024-09-19T09:38:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facbdf36740 1 -- 172.21.15.42:0/2396183482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ea476c600 con 0x563ea47f89d0 2024-09-19T09:38:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2396183482 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7facb0025050 con 0x563ea47f89d0 2024-09-19T09:38:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facbdf36740 10 client.14985 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7facbdf36740 1 -- 172.21.15.42:0/2396183482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563ea48120c0 con 0x563ea47f89d0 2024-09-19T09:38:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.776+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2396183482 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563ea476c600 con 0x563ea47f89d0 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.777+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2396183482 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7facb0014aa0 con 0x563ea47f89d0 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.777+0000 7facbdf36740 10 client.14985 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.777+0000 7facbdf36740 10 client.14985 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.777+0000 7facbdf36740 20 client.14985 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.777+0000 7facbdf36740 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563ea4814800 0x563ea4815c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.777+0000 7facbdf36740 4 client.14985 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.777+0000 7facbdf36740 1 -- 172.21.15.42:0/2396183482 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ea4766b10 con 0x563ea4814800 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.777+0000 7facb90f8640 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563ea4814800 0x563ea4815c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.778+0000 7fac9d7fa640 10 client.14985 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.778+0000 7facb90f8640 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563ea4814800 0x563ea4815c70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7704b596504a4355 server_cookie=d61e0e0145de3d0e in_seq=0 out_seq=0 2024-09-19T09:38:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.778+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2396183482 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ea4766b10 con 0x563ea4814800 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.778+0000 7fac9d7fa640 10 client.14985 handle_command_reply: tid=0 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.778+0000 7facbdf36740 1 client.14985 shutdown 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.778+0000 7facbdf36740 1 -- 172.21.15.42:0/2396183482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 msgr2=0x563ea48033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.778+0000 7facbdf36740 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48033e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7facb00104d0 tx=0x7facb0010990 comp rx=0 tx=0).stop 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.779+0000 7facbdf36740 1 -- 172.21.15.42:0/2396183482 shutdown_connections 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.779+0000 7facbdf36740 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563ea4814800 0x563ea4815c70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.779+0000 7facbdf36740 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea4800cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.779+0000 7facbdf36740 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea4800780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.779+0000 7fac9d7fa640 0 client.14985 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.779+0000 7facbdf36740 1 --2- 172.21.15.42:0/2396183482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48033e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.779+0000 7facbdf36740 1 -- 172.21.15.42:0/2396183482 >> 172.21.15.42:0/2396183482 conn(0x563ea47f4f60 msgr2=0x563ea47fac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.779+0000 7facbdf36740 1 -- 172.21.15.42:0/2396183482 shutdown_connections 2024-09-19T09:38:24.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.779+0000 7facbdf36740 1 -- 172.21.15.42:0/2396183482 wait complete. 2024-09-19T09:38:24.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.779+0000 7facbdf36740 20 client.14985 trim_cache size 0 max 16384 2024-09-19T09:38:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facbdf36740 1 Processor -- start 2024-09-19T09:38:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facbdf36740 1 -- start start 2024-09-19T09:38:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facbdf36740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48025e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facbdf36740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea481df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facbdf36740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea481e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facbdf36740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563ea4813fb0 con 0x563ea47f89d0 2024-09-19T09:38:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facbdf36740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563ea4814680 con 0x563ea4803bb0 2024-09-19T09:38:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facbdf36740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563ea4814d50 con 0x563ea47f92f0 2024-09-19T09:38:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facb98f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facb98f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48025e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58572/0 (socket says 172.21.15.42:58572) 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facb98f9640 1 -- 172.21.15.42:0/1858306615 learned_addr learned my addr 172.21.15.42:0/1858306615 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facb98f9640 1 -- 172.21.15.42:0/1858306615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 msgr2=0x563ea481df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facb98f9640 1 --2- 172.21.15.42:0/1858306615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea481df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facb98f9640 1 -- 172.21.15.42:0/1858306615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 msgr2=0x563ea481e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facba0fa640 1 --2- 172.21.15.42:0/1858306615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea481e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.797+0000 7facb98f9640 1 --2- 172.21.15.42:0/1858306615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea481e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.798+0000 7facb98f9640 1 -- 172.21.15.42:0/1858306615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ea48062e0 con 0x563ea47f89d0 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.798+0000 7facba0fa640 1 --2- 172.21.15.42:0/1858306615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea481e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.798+0000 7facb98f9640 1 --2- 172.21.15.42:0/1858306615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48025e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7facb0001eb0 tx=0x7facb000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9514794391fafc79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.798+0000 7fac9f7fe640 1 -- 172.21.15.42:0/1858306615 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb001a070 con 0x563ea47f89d0 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.798+0000 7fac9f7fe640 1 -- 172.21.15.42:0/1858306615 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facb0010e90 con 0x563ea47f89d0 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.798+0000 7fac9f7fe640 1 -- 172.21.15.42:0/1858306615 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0012560 con 0x563ea47f89d0 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 -- 172.21.15.42:0/1858306615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 msgr2=0x563ea48025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 --2- 172.21.15.42:0/1858306615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48025e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7facb0001eb0 tx=0x7facb000b480 comp rx=0 tx=0).stop 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 -- 172.21.15.42:0/1858306615 shutdown_connections 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 --2- 172.21.15.42:0/1858306615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea481e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 --2- 172.21.15.42:0/1858306615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea481df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 --2- 172.21.15.42:0/1858306615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea48025e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 -- 172.21.15.42:0/1858306615 >> 172.21.15.42:0/1858306615 conn(0x563ea47f4f60 msgr2=0x563ea4801ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 -- 172.21.15.42:0/1858306615 shutdown_connections 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 -- 172.21.15.42:0/1858306615 wait complete. 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 -- start start 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.799+0000 7facbdf36740 1 Processor -- start 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facbdf36740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea481e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facbdf36740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea481ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facbdf36740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea481b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facbdf36740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563ea4815af0 con 0x563ea47f89d0 2024-09-19T09:38:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facbdf36740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563ea4815420 con 0x563ea4803bb0 2024-09-19T09:38:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facbdf36740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563ea48161c0 con 0x563ea47f92f0 2024-09-19T09:38:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facbdf36740 10 client.0 _ll_register_callbacks cb 0x7facb000b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facb98f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea481e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facb98f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea481e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58586/0 (socket says 172.21.15.42:58586) 2024-09-19T09:38:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facb98f9640 1 -- 172.21.15.42:0/2165057248 learned_addr learned my addr 172.21.15.42:0/2165057248 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facba0fa640 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea481b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facb98f9640 1 -- 172.21.15.42:0/2165057248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 msgr2=0x563ea481ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facb90f8640 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea481ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facb98f9640 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea481ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facb98f9640 1 -- 172.21.15.42:0/2165057248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 msgr2=0x563ea481b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facb98f9640 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea481b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facb98f9640 1 -- 172.21.15.42:0/2165057248 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ea487cf10 con 0x563ea47f89d0 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facb98f9640 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea481e830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7facb0000c00 tx=0x7facb00146a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e1a654b55a0a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7fac9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2165057248 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb001a040 con 0x563ea47f89d0 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7facbdf36740 1 -- 172.21.15.42:0/2165057248 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facb0010e90 con 0x563ea47f89d0 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.800+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2165057248 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7facb0005dd0 con 0x563ea47f89d0 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2165057248 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7facb0016690 con 0x563ea47f89d0 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7facbdf36740 10 client.14991 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7facbdf36740 1 -- 172.21.15.42:0/2165057248 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563ea487e040 con 0x563ea47f89d0 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2165057248 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facb0010e90 con 0x563ea47f89d0 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2165057248 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7facb0006630 con 0x563ea47f89d0 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7facbdf36740 10 client.14991 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7facbdf36740 10 client.14991 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7facbdf36740 20 client.14991 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7facbdf36740 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563ea4814800 0x563ea4881510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7facbdf36740 4 client.14991 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7facbdf36740 1 -- 172.21.15.42:0/2165057248 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "status"}) -- 0x563ea46e30e0 con 0x563ea4814800 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.801+0000 7facb90f8640 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563ea4814800 0x563ea4881510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facb90f8640 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563ea4814800 0x563ea4881510 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=174e0c572ce0b15a server_cookie=89558c1f7970f805 in_seq=0 out_seq=0 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7fac9d7fa640 10 client.14991 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7fac9d7fa640 1 -- 172.21.15.42:0/2165057248 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563ea46e30e0 con 0x563ea4814800 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7fac9d7fa640 10 client.14991 handle_command_reply: tid=0 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 client.14991 shutdown 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 -- 172.21.15.42:0/2165057248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 msgr2=0x563ea481e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea481e830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7facb0000c00 tx=0x7facb00146a0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 -- 172.21.15.42:0/2165057248 shutdown_connections 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563ea4814800 0x563ea4881510 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563ea4803bb0 0x563ea481b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ea47f92f0 0x563ea481ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7fac9d7fa640 0 client.14991 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 --2- 172.21.15.42:0/2165057248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ea47f89d0 0x563ea481e830 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 -- 172.21.15.42:0/2165057248 >> 172.21.15.42:0/2165057248 conn(0x563ea47f4f60 msgr2=0x563ea47f4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 -- 172.21.15.42:0/2165057248 shutdown_connections 2024-09-19T09:38:24.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 1 -- 172.21.15.42:0/2165057248 wait complete. 2024-09-19T09:38:24.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.802+0000 7facbdf36740 20 client.14991 trim_cache size 0 max 16384 2024-09-19T09:38:24.822 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:38:24.822 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:24.822 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 4, 2024-09-19T09:38:24.822 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24454, 2024-09-19T09:38:24.822 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:38:24.822 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:38:24.823 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:38:24.823 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 62.805787549999998, 2024-09-19T09:38:24.823 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 27, 2024-09-19T09:38:24.823 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:38:24.823 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T09:38:24.823 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 99.218759380999998 2024-09-19T09:38:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:38:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 -- 172.21.15.42:0/1703600344 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faca00a3350 msgr2=0x7faca00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faca00a3350 0x7faca00a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facac031860 tx=0x7facac009910 comp rx=0 tx=0).stop 2024-09-19T09:38:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 -- 172.21.15.42:0/1703600344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facb4101420 msgr2=0x7facb4199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facb4101420 0x7facb4199850 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faca400d770 tx=0x7faca400dc30 comp rx=0 tx=0).stop 2024-09-19T09:38:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 -- 172.21.15.42:0/1703600344 shutdown_connections 2024-09-19T09:38:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faca00a3350 0x7faca00a5810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facb4106a80 0x7facb41a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facb4101420 0x7facb4199850 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 --2- 172.21.15.42:0/1703600344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb4100a80 0x7facb4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 -- 172.21.15.42:0/1703600344 >> 172.21.15.42:0/1703600344 conn(0x7facb40fc7a0 msgr2=0x7facb40fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 -- 172.21.15.42:0/1703600344 shutdown_connections 2024-09-19T09:38:24.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:24.803+0000 7facbbb5d640 1 -- 172.21.15.42:0/1703600344 wait complete. 2024-09-19T09:38:24.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:24 smithi171 ceph-mon[35803]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:24 smithi136 ceph-mon[34840]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:25.480 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T09:38:25.740 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.191+0000 7f86b412b640 1 -- 172.21.15.42:0/3438280584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac106f10 msgr2=0x7f86ac10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.191+0000 7f86b412b640 1 --2- 172.21.15.42:0/3438280584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac106f10 0x7f86ac10ea90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009ca0 tx=0x7f86a402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.191+0000 7f86b412b640 1 -- 172.21.15.42:0/3438280584 shutdown_connections 2024-09-19T09:38:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.191+0000 7f86b412b640 1 --2- 172.21.15.42:0/3438280584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac106f10 0x7f86ac10ea90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.191+0000 7f86b412b640 1 --2- 172.21.15.42:0/3438280584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86ac102790 0x7f86ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.191+0000 7f86b412b640 1 --2- 172.21.15.42:0/3438280584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ac101de0 0x7f86ac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.191+0000 7f86b412b640 1 -- 172.21.15.42:0/3438280584 >> 172.21.15.42:0/3438280584 conn(0x7f86ac0fd8c0 msgr2=0x7f86ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.191+0000 7f86b412b640 1 -- 172.21.15.42:0/3438280584 shutdown_connections 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.191+0000 7f86b412b640 1 -- 172.21.15.42:0/3438280584 wait complete. 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.192+0000 7f86b412b640 1 Processor -- start 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.192+0000 7f86b412b640 1 -- start start 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.192+0000 7f86b412b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86ac101de0 0x7f86ac198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.192+0000 7f86b412b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ac102790 0x7f86ac1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.192+0000 7f86b412b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac106f10 0x7f86ac19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.192+0000 7f86b412b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac111fe0 con 0x7f86ac106f10 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.192+0000 7f86b412b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac111e60 con 0x7f86ac102790 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.192+0000 7f86b412b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac112160 con 0x7f86ac101de0 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b26c8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac106f10 0x7f86ac19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b26c8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac106f10 0x7f86ac19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58610/0 (socket says 172.21.15.42:58610) 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b26c8640 1 -- 172.21.15.42:0/2011365568 learned_addr learned my addr 172.21.15.42:0/2011365568 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86ac101de0 0x7f86ac198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b16c6640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ac102790 0x7f86ac1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b26c8640 1 -- 172.21.15.42:0/2011365568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86ac101de0 msgr2=0x7f86ac198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b26c8640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86ac101de0 0x7f86ac198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b26c8640 1 -- 172.21.15.42:0/2011365568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ac102790 msgr2=0x7f86ac1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b26c8640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ac102790 0x7f86ac1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b26c8640 1 -- 172.21.15.42:0/2011365568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ac19d340 con 0x7f86ac106f10 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b26c8640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac106f10 0x7f86ac19cc60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f86a4003f40 tx=0x7f86a4003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86a2ffd640 1 -- 172.21.15.42:0/2011365568 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4031800 con 0x7f86ac106f10 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86a2ffd640 1 -- 172.21.15.42:0/2011365568 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a40319a0 con 0x7f86ac106f10 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86a2ffd640 1 -- 172.21.15.42:0/2011365568 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a402fd00 con 0x7f86ac106f10 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b412b640 1 -- 172.21.15.42:0/2011365568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ac19d5d0 con 0x7f86ac106f10 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.193+0000 7f86b412b640 1 -- 172.21.15.42:0/2011365568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ac1a4f10 con 0x7f86ac106f10 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.196+0000 7f86a2ffd640 1 -- 172.21.15.42:0/2011365568 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f86a4004040 con 0x7f86ac106f10 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.196+0000 7f86b6504740 1 Processor -- start 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.196+0000 7f86b6504740 1 -- start start 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.196+0000 7f86b6504740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 0x55ed6674fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.196+0000 7f86b6504740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6675a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.196+0000 7f86b6504740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed6675abb0 0x55ed6675cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.196+0000 7f86b6504740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ed666b6090 con 0x55ed667502f0 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.196+0000 7f86b6504740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ed6665da70 con 0x55ed6674f9d0 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.196+0000 7f86b6504740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ed666b2050 con 0x55ed6675abb0 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.196+0000 7f86a2ffd640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86980a3350 0x7f86980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b1ec7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6675a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b1ec7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6675a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58622/0 (socket says 172.21.15.42:58622) 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b1ec7640 1 -- 172.21.15.42:0/146765354 learned_addr learned my addr 172.21.15.42:0/146765354 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b26c8640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86980a3350 0x7f86980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b16c6640 1 --2- 172.21.15.42:0/146765354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed6675abb0 0x55ed6675cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b16c6640 1 --2- 172.21.15.42:0/146765354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 0x55ed6674fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86a2ffd640 1 -- 172.21.15.42:0/2011365568 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f86a40f0f50 con 0x7f86ac106f10 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b1ec7640 1 -- 172.21.15.42:0/146765354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed6675abb0 msgr2=0x55ed6675cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/146765354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed6675abb0 0x55ed6675cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b1ec7640 1 -- 172.21.15.42:0/146765354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 msgr2=0x55ed6674fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/146765354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 0x55ed6674fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b1ec7640 1 -- 172.21.15.42:0/146765354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed6666a130 con 0x55ed667502f0 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b16c6640 1 --2- 172.21.15.42:0/146765354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 0x55ed6674fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/146765354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6675a670 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f86a800ad00 tx=0x7f86a800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a891bf1350378b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f86b26c8640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86980a3350 0x7f86980a5810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f86a40bd430 tx=0x7f86a40b2980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f8697fff640 1 -- 172.21.15.42:0/146765354 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a801d070 con 0x55ed667502f0 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f8697fff640 1 -- 172.21.15.42:0/146765354 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a8018b20 con 0x55ed667502f0 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.197+0000 7f8697fff640 1 -- 172.21.15.42:0/146765354 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8010bc0 con 0x55ed667502f0 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.198+0000 7f86b6504740 1 -- 172.21.15.42:0/146765354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 msgr2=0x55ed6675a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.198+0000 7f86b6504740 1 --2- 172.21.15.42:0/146765354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6675a670 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f86a800ad00 tx=0x7f86a800f790 comp rx=0 tx=0).stop 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.198+0000 7f86b6504740 1 -- 172.21.15.42:0/146765354 shutdown_connections 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.198+0000 7f86b6504740 1 --2- 172.21.15.42:0/146765354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed6675abb0 0x55ed6675cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.198+0000 7f86b6504740 1 --2- 172.21.15.42:0/146765354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6675a670 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.198+0000 7f86b6504740 1 --2- 172.21.15.42:0/146765354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 0x55ed6674fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.198+0000 7f86b6504740 1 -- 172.21.15.42:0/146765354 >> 172.21.15.42:0/146765354 conn(0x55ed6674bf60 msgr2=0x55ed6674c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.198+0000 7f86b6504740 1 -- 172.21.15.42:0/146765354 shutdown_connections 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.198+0000 7f86b6504740 1 -- 172.21.15.42:0/146765354 wait complete. 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b6504740 1 -- start start 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b6504740 1 Processor -- start 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b6504740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6674f9d0 0x55ed6675a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b6504740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 0x55ed667577c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b6504740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6675abb0 0x55ed66757d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b6504740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ed6675d780 con 0x55ed6674f9d0 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b6504740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ed66670f20 con 0x55ed6675abb0 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b6504740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ed6675d900 con 0x55ed667502f0 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b6504740 10 client.0 _ll_register_callbacks cb 0x55ed6663a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b16c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6674f9d0 0x55ed6675a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b16c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6674f9d0 0x55ed6675a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58634/0 (socket says 172.21.15.42:58634) 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b16c6640 1 -- 172.21.15.42:0/134445752 learned_addr learned my addr 172.21.15.42:0/134445752 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b16c6640 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6675abb0 0x55ed66757d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 0x55ed667577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b16c6640 1 -- 172.21.15.42:0/134445752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 msgr2=0x55ed667577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b16c6640 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 0x55ed667577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b16c6640 1 -- 172.21.15.42:0/134445752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6675abb0 msgr2=0x55ed66757d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.199+0000 7f86b16c6640 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6675abb0 0x55ed66757d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86b16c6640 1 -- 172.21.15.42:0/134445752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed664272b0 con 0x55ed6674f9d0 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 0x55ed667577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86b16c6640 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6674f9d0 0x55ed6675a470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f869c009f70 tx=0x7f869c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7137abb836f88790 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86957fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86957fa640 1 -- 172.21.15.42:0/134445752 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c015a40 con 0x55ed6674f9d0 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86957fa640 1 -- 172.21.15.42:0/134445752 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f869c015be0 con 0x55ed6674f9d0 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86b6504740 1 -- 172.21.15.42:0/134445752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86a8018b20 con 0x55ed6674f9d0 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86957fa640 1 -- 172.21.15.42:0/134445752 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f869c015de0 con 0x55ed6674f9d0 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86b6504740 10 client.15003 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86b6504740 1 -- 172.21.15.42:0/134445752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ed66769130 con 0x55ed6674f9d0 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86957fa640 1 -- 172.21.15.42:0/134445752 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a8018b20 con 0x55ed6674f9d0 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86957fa640 1 -- 172.21.15.42:0/134445752 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f869c017440 con 0x55ed6674f9d0 2024-09-19T09:38:26.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86b6504740 10 client.15003 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86b6504740 10 client.15003 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.200+0000 7f86b6504740 20 client.15003 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.201+0000 7f86b6504740 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55ed6676b7c0 0x55ed6676cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.201+0000 7f86b6504740 4 client.15003 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.201+0000 7f86b6504740 1 -- 172.21.15.42:0/134445752 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed666c3600 con 0x55ed6676b7c0 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.201+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55ed6676b7c0 0x55ed6676cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.201+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55ed6676b7c0 0x55ed6676cc30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6eba63d262f74c2c server_cookie=3755528827e67104 in_seq=0 out_seq=0 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.201+0000 7f86957fa640 10 client.15003 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86957fa640 1 -- 172.21.15.42:0/134445752 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed666c3600 con 0x55ed6676b7c0 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86957fa640 10 client.15003 handle_command_reply: tid=0 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 client.15003 shutdown 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 -- 172.21.15.42:0/134445752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6674f9d0 msgr2=0x55ed6675a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6674f9d0 0x55ed6675a470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f869c009f70 tx=0x7f869c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 -- 172.21.15.42:0/134445752 shutdown_connections 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55ed6676b7c0 0x55ed6676cc30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6675abb0 0x55ed66757d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 0x55ed667577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 --2- 172.21.15.42:0/134445752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6674f9d0 0x55ed6675a470 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86957fa640 0 client.15003 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 -- 172.21.15.42:0/134445752 >> 172.21.15.42:0/134445752 conn(0x55ed6674bf60 msgr2=0x55ed66751c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 -- 172.21.15.42:0/134445752 shutdown_connections 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 1 -- 172.21.15.42:0/134445752 wait complete. 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.202+0000 7f86b6504740 20 client.15003 trim_cache size 0 max 16384 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.220+0000 7f86b6504740 1 Processor -- start 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.220+0000 7f86b6504740 1 -- start start 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b6504740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed6674f9d0 0x55ed6676c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b6504740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6676be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b6504740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6675abb0 0x55ed6676b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b6504740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ed6676af70 con 0x55ed667502f0 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b6504740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ed6676b640 con 0x55ed6675abb0 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b6504740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ed6676bd10 con 0x55ed6674f9d0 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b1ec7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6676be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b1ec7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6676be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58648/0 (socket says 172.21.15.42:58648) 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b1ec7640 1 -- 172.21.15.42:0/2532396526 learned_addr learned my addr 172.21.15.42:0/2532396526 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b16c6640 1 --2- 172.21.15.42:0/2532396526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6675abb0 0x55ed6676b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b1ec7640 1 -- 172.21.15.42:0/2532396526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed6674f9d0 msgr2=0x55ed6676c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/2532396526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed6674f9d0 0x55ed6676c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b1ec7640 1 -- 172.21.15.42:0/2532396526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6675abb0 msgr2=0x55ed6676b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/2532396526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6675abb0 0x55ed6676b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b1ec7640 1 -- 172.21.15.42:0/2532396526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed6675a090 con 0x55ed667502f0 2024-09-19T09:38:26.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/2532396526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6676be90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f86a80107d0 tx=0x7f86a8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5de1438368d8993 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86977fe640 1 -- 172.21.15.42:0/2532396526 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8031070 con 0x55ed667502f0 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86977fe640 1 -- 172.21.15.42:0/2532396526 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a8028040 con 0x55ed667502f0 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.221+0000 7f86977fe640 1 -- 172.21.15.42:0/2532396526 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a801d030 con 0x55ed667502f0 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 -- 172.21.15.42:0/2532396526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 msgr2=0x55ed6676be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 --2- 172.21.15.42:0/2532396526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6676be90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f86a80107d0 tx=0x7f86a8010800 comp rx=0 tx=0).stop 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 -- 172.21.15.42:0/2532396526 shutdown_connections 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 --2- 172.21.15.42:0/2532396526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6675abb0 0x55ed6676b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 --2- 172.21.15.42:0/2532396526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed667502f0 0x55ed6676be90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 --2- 172.21.15.42:0/2532396526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed6674f9d0 0x55ed6676c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 -- 172.21.15.42:0/2532396526 >> 172.21.15.42:0/2532396526 conn(0x55ed6674bf60 msgr2=0x55ed66756090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 -- 172.21.15.42:0/2532396526 shutdown_connections 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 -- 172.21.15.42:0/2532396526 wait complete. 2024-09-19T09:38:26.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 -- start start 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.222+0000 7f86b6504740 1 Processor -- start 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b6504740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 0x55ed66770410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b6504740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 0x55ed66770950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b6504740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6675abb0 0x55ed667d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b6504740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ed6676cab0 con 0x55ed6675abb0 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b6504740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ed6676c3e0 con 0x55ed6674f9d0 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b6504740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ed6676d180 con 0x55ed667502f0 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b6504740 10 client.0 _ll_register_callbacks cb 0x7f869c01a6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b16c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6675abb0 0x55ed667d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b16c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6675abb0 0x55ed667d3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58654/0 (socket says 172.21.15.42:58654) 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b16c6640 1 -- 172.21.15.42:0/3001665931 learned_addr learned my addr 172.21.15.42:0/3001665931 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 0x55ed66770950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b16c6640 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 0x55ed66770410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b16c6640 1 -- 172.21.15.42:0/3001665931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 msgr2=0x55ed66770950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b16c6640 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 0x55ed66770950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b16c6640 1 -- 172.21.15.42:0/3001665931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 msgr2=0x55ed66770410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b16c6640 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 0x55ed66770410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b16c6640 1 -- 172.21.15.42:0/3001665931 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed667d4480 con 0x55ed6675abb0 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86b16c6640 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6675abb0 0x55ed667d3ec0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f869c009910 tx=0x7f869c01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf66f55b038a2fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.223+0000 7f86957fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86957fa640 1 -- 172.21.15.42:0/3001665931 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c015c40 con 0x55ed6675abb0 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86957fa640 1 -- 172.21.15.42:0/3001665931 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f869c017a00 con 0x55ed6675abb0 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86b6504740 1 -- 172.21.15.42:0/3001665931 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86a8028040 con 0x55ed6675abb0 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86957fa640 1 -- 172.21.15.42:0/3001665931 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f869c037070 con 0x55ed6675abb0 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86b6504740 10 client.15009 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86b6504740 1 -- 172.21.15.42:0/3001665931 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ed667d5720 con 0x55ed6675abb0 2024-09-19T09:38:26.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86957fa640 1 -- 172.21.15.42:0/3001665931 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a8028040 con 0x55ed6675abb0 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86957fa640 1 -- 172.21.15.42:0/3001665931 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f869c018a50 con 0x55ed6675abb0 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86b6504740 10 client.15009 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86b6504740 10 client.15009 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86b6504740 20 client.15009 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86b6504740 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55ed667da310 0x55ed667d9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86b6504740 4 client.15009 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.224+0000 7f86b6504740 1 -- 172.21.15.42:0/3001665931 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "status"}) -- 0x55ed666bdb10 con 0x55ed667da310 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.225+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55ed667da310 0x55ed667d9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.225+0000 7f86b1ec7640 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55ed667da310 0x55ed667d9020 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f1f8a5edaecc497d server_cookie=34e13d280b67df1a in_seq=0 out_seq=0 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.225+0000 7f86957fa640 10 client.15009 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.225+0000 7f86957fa640 1 -- 172.21.15.42:0/3001665931 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ed666bdb10 con 0x55ed667da310 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.225+0000 7f86957fa640 10 client.15009 handle_command_reply: tid=0 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.225+0000 7f86b6504740 1 client.15009 shutdown 2024-09-19T09:38:26.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.225+0000 7f86b6504740 1 -- 172.21.15.42:0/3001665931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6675abb0 msgr2=0x55ed667d3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.225+0000 7f86b6504740 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6675abb0 0x55ed667d3ec0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f869c009910 tx=0x7f869c01c040 comp rx=0 tx=0).stop 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b6504740 1 -- 172.21.15.42:0/3001665931 shutdown_connections 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b6504740 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55ed667da310 0x55ed667d9020 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b6504740 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed6675abb0 0x55ed667d3ec0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b6504740 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed667502f0 0x55ed66770950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b6504740 1 --2- 172.21.15.42:0/3001665931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ed6674f9d0 0x55ed66770410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86957fa640 0 client.15009 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b6504740 1 -- 172.21.15.42:0/3001665931 >> 172.21.15.42:0/3001665931 conn(0x55ed6674bf60 msgr2=0x55ed66758d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b6504740 1 -- 172.21.15.42:0/3001665931 shutdown_connections 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b6504740 1 -- 172.21.15.42:0/3001665931 wait complete. 2024-09-19T09:38:26.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b6504740 20 client.15009 trim_cache size 0 max 16384 2024-09-19T09:38:26.244 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:38:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 3, 2024-09-19T09:38:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24466, 2024-09-19T09:38:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:38:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:38:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:38:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 65.236242601000001, 2024-09-19T09:38:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 27, 2024-09-19T09:38:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:38:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T09:38:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 98.264668638000003 2024-09-19T09:38:26.245 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:38:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 -- 172.21.15.42:0/2011365568 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86980a3350 msgr2=0x7f86980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86980a3350 0x7f86980a5810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f86a40bd430 tx=0x7f86a40b2980 comp rx=0 tx=0).stop 2024-09-19T09:38:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 -- 172.21.15.42:0/2011365568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac106f10 msgr2=0x7f86ac19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac106f10 0x7f86ac19cc60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f86a4003f40 tx=0x7f86a4003f70 comp rx=0 tx=0).stop 2024-09-19T09:38:26.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 -- 172.21.15.42:0/2011365568 shutdown_connections 2024-09-19T09:38:26.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86980a3350 0x7f86980a5810 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac106f10 0x7f86ac19cc60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ac102790 0x7f86ac1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 --2- 172.21.15.42:0/2011365568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86ac101de0 0x7f86ac198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 -- 172.21.15.42:0/2011365568 >> 172.21.15.42:0/2011365568 conn(0x7f86ac0fd8c0 msgr2=0x7f86ac0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.226+0000 7f86b412b640 1 -- 172.21.15.42:0/2011365568 shutdown_connections 2024-09-19T09:38:26.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:26.227+0000 7f86b412b640 1 -- 172.21.15.42:0/2011365568 wait complete. 2024-09-19T09:38:26.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:26 smithi042 ceph-mon[31223]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:26.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:26 smithi171 ceph-mon[35803]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:26.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:26 smithi136 ceph-mon[34840]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:26.903 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:38:27.162 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.623+0000 7f0bd474f640 1 -- 172.21.15.42:0/3913242679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bcc101420 msgr2=0x7f0bcc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.623+0000 7f0bd474f640 1 --2- 172.21.15.42:0/3913242679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bcc101420 0x7f0bcc10d950 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009cd0 tx=0x7f0bc402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.623+0000 7f0bd474f640 1 -- 172.21.15.42:0/3913242679 shutdown_connections 2024-09-19T09:38:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.623+0000 7f0bd474f640 1 --2- 172.21.15.42:0/3913242679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bcc101420 0x7f0bcc10d950 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.623+0000 7f0bd474f640 1 --2- 172.21.15.42:0/3913242679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc100a80 0x7f0bcc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.623+0000 7f0bd474f640 1 --2- 172.21.15.42:0/3913242679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bcc106a80 0x7f0bcc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.623+0000 7f0bd474f640 1 -- 172.21.15.42:0/3913242679 >> 172.21.15.42:0/3913242679 conn(0x7f0bcc0fc7a0 msgr2=0x7f0bcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.623+0000 7f0bd474f640 1 -- 172.21.15.42:0/3913242679 shutdown_connections 2024-09-19T09:38:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.623+0000 7f0bd474f640 1 -- 172.21.15.42:0/3913242679 wait complete. 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd474f640 1 Processor -- start 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd474f640 1 -- start start 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd474f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bcc100a80 0x7f0bcc0fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd474f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc101420 0x7f0bcc0fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd474f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bcc106a80 0x7f0bcc0fd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd474f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc110ea0 con 0x7f0bcc100a80 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd474f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc110d20 con 0x7f0bcc106a80 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd474f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc111020 con 0x7f0bcc101420 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd24eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bcc100a80 0x7f0bcc0fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd24eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bcc100a80 0x7f0bcc0fcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58676/0 (socket says 172.21.15.42:58676) 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd24eb640 1 -- 172.21.15.42:0/2059587482 learned_addr learned my addr 172.21.15.42:0/2059587482 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd1cea640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc101420 0x7f0bcc0fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bcc106a80 0x7f0bcc0fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd24eb640 1 -- 172.21.15.42:0/2059587482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc101420 msgr2=0x7f0bcc0fd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc101420 0x7f0bcc0fd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd24eb640 1 -- 172.21.15.42:0/2059587482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bcc106a80 msgr2=0x7f0bcc0fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bcc106a80 0x7f0bcc0fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd24eb640 1 -- 172.21.15.42:0/2059587482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bcc1a6940 con 0x7f0bcc100a80 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd1cea640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc101420 0x7f0bcc0fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.624+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bcc106a80 0x7f0bcc0fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.625+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bcc100a80 0x7f0bcc0fcce0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800b4a0 tx=0x7f0bc800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.625+0000 7f0bc37fe640 1 -- 172.21.15.42:0/2059587482 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8014070 con 0x7f0bcc100a80 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.625+0000 7f0bc37fe640 1 -- 172.21.15.42:0/2059587482 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc8010af0 con 0x7f0bcc100a80 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.625+0000 7f0bd474f640 1 -- 172.21.15.42:0/2059587482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bcc1a6c30 con 0x7f0bcc100a80 2024-09-19T09:38:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.625+0000 7f0bc37fe640 1 -- 172.21.15.42:0/2059587482 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8017d10 con 0x7f0bcc100a80 2024-09-19T09:38:27.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.625+0000 7f0bd474f640 1 -- 172.21.15.42:0/2059587482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bcc1a71c0 con 0x7f0bcc100a80 2024-09-19T09:38:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.627+0000 7f0bc37fe640 1 -- 172.21.15.42:0/2059587482 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0bc8017070 con 0x7f0bcc100a80 2024-09-19T09:38:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd6b28740 1 Processor -- start 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd6b28740 1 -- start start 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d819db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d824670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 0x55750d826fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55750d780090 con 0x55750d8199d0 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55750d727a70 con 0x55750d81a2f0 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55750d77c050 con 0x55750d824bb0 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd2cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d819db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bc37fe640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3350 0x7f0bb80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd2cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d819db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58680/0 (socket says 172.21.15.42:58680) 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd2cec640 1 -- 172.21.15.42:0/2475479618 learned_addr learned my addr 172.21.15.42:0/2475479618 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.628+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/2475479618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d824670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3350 0x7f0bb80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bd1cea640 1 --2- 172.21.15.42:0/2475479618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 0x55750d826fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bc37fe640 1 -- 172.21.15.42:0/2059587482 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0bc80cedb0 con 0x7f0bcc100a80 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bd2cec640 1 -- 172.21.15.42:0/2475479618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 msgr2=0x55750d826fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/2475479618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 0x55750d826fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bd2cec640 1 -- 172.21.15.42:0/2475479618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 msgr2=0x55750d824670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/2475479618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d824670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bd2cec640 1 -- 172.21.15.42:0/2475479618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55750d734130 con 0x55750d8199d0 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/2475479618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d824670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/2475479618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d819db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4031b50 tx=0x7f0bc4031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecfc5d27a4bb0ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3350 0x7f0bb80a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4046000 tx=0x7f0bc4049000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bc0ff9640 1 -- 172.21.15.42:0/2475479618 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4004240 con 0x55750d8199d0 2024-09-19T09:38:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bc0ff9640 1 -- 172.21.15.42:0/2475479618 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc4036040 con 0x55750d8199d0 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.629+0000 7f0bc0ff9640 1 -- 172.21.15.42:0/2475479618 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4030ce0 con 0x55750d8199d0 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.630+0000 7f0bd6b28740 1 -- 172.21.15.42:0/2475479618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 msgr2=0x55750d819db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.630+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/2475479618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d819db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4031b50 tx=0x7f0bc4031b80 comp rx=0 tx=0).stop 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.630+0000 7f0bd6b28740 1 -- 172.21.15.42:0/2475479618 shutdown_connections 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.630+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/2475479618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 0x55750d826fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.630+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/2475479618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d824670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.630+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/2475479618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d819db0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.630+0000 7f0bd6b28740 1 -- 172.21.15.42:0/2475479618 >> 172.21.15.42:0/2475479618 conn(0x55750d815f60 msgr2=0x55750d816340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.630+0000 7f0bd6b28740 1 -- 172.21.15.42:0/2475479618 shutdown_connections 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.630+0000 7f0bd6b28740 1 -- 172.21.15.42:0/2475479618 wait complete. 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.630+0000 7f0bd6b28740 1 -- start start 2024-09-19T09:38:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd6b28740 1 Processor -- start 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d8199d0 0x55750d8244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d821820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d821d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55750d827720 con 0x55750d824bb0 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55750d73af20 con 0x55750d81a2f0 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55750d8278a0 con 0x55750d8199d0 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd6b28740 10 client.0 _ll_register_callbacks cb 0x55750d704030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd2cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d821d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd2cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d821d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58688/0 (socket says 172.21.15.42:58688) 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd2cec640 1 -- 172.21.15.42:0/3940454547 learned_addr learned my addr 172.21.15.42:0/3940454547 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d8199d0 0x55750d8244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd1cea640 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d821820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd2cec640 1 -- 172.21.15.42:0/3940454547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d8199d0 msgr2=0x55750d8244d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d8199d0 0x55750d8244d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd2cec640 1 -- 172.21.15.42:0/3940454547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 msgr2=0x55750d821820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d821820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.631+0000 7f0bd2cec640 1 -- 172.21.15.42:0/3940454547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55750d4f12b0 con 0x55750d824bb0 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d821d60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40309c0 tx=0x7f0bc40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbba48da1723ac6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/3940454547 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4059070 con 0x55750d824bb0 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/3940454547 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0bc4004240 con 0x55750d824bb0 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bd6b28740 1 -- 172.21.15.42:0/3940454547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc4036040 con 0x55750d824bb0 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/3940454547 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0bc4004440 con 0x55750d824bb0 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bd6b28740 10 client.15021 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bd6b28740 1 -- 172.21.15.42:0/3940454547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55750d8330d0 con 0x55750d824bb0 2024-09-19T09:38:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/3940454547 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc4036040 con 0x55750d824bb0 2024-09-19T09:38:27.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/3940454547 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0bc4030070 con 0x55750d824bb0 2024-09-19T09:38:27.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bd6b28740 10 client.15021 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:27.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bd6b28740 10 client.15021 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bd6b28740 20 client.15021 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55750d835360 0x55750d8367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bd6b28740 4 client.15021 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.632+0000 7f0bd6b28740 1 -- 172.21.15.42:0/3940454547 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55750d78d600 con 0x55750d835360 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.633+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55750d835360 0x55750d8367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.633+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55750d835360 0x55750d8367d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ec53d43635d6be28 server_cookie=516f83861a8af0dd in_seq=0 out_seq=0 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.633+0000 7f0bb5ffb640 10 client.15021 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/3940454547 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55750d78d600 con 0x55750d835360 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bb5ffb640 10 client.15021 handle_command_reply: tid=0 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 client.15021 shutdown 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 -- 172.21.15.42:0/3940454547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 msgr2=0x55750d821d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d821d60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40309c0 tx=0x7f0bc40095c0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 -- 172.21.15.42:0/3940454547 shutdown_connections 2024-09-19T09:38:27.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55750d835360 0x55750d8367d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d821d60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d821820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/3940454547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d8199d0 0x55750d8244d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 -- 172.21.15.42:0/3940454547 >> 172.21.15.42:0/3940454547 conn(0x55750d815f60 msgr2=0x55750d81bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bb5ffb640 0 client.15021 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:38:27.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 -- 172.21.15.42:0/3940454547 shutdown_connections 2024-09-19T09:38:27.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 1 -- 172.21.15.42:0/3940454547 wait complete. 2024-09-19T09:38:27.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.634+0000 7f0bd6b28740 20 client.15021 trim_cache size 0 max 16384 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.652+0000 7f0bd6b28740 1 Processor -- start 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.652+0000 7f0bd6b28740 1 -- start start 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.652+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d8199d0 0x55750d834c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.652+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d81a2f0 0x55750d836100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.652+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d83eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.652+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55750d834b10 con 0x55750d824bb0 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.652+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55750d8351e0 con 0x55750d8199d0 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.652+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55750d8358b0 con 0x55750d81a2f0 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bd2cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d83eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bd2cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d83eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58690/0 (socket says 172.21.15.42:58690) 2024-09-19T09:38:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bd2cec640 1 -- 172.21.15.42:0/1054701267 learned_addr learned my addr 172.21.15.42:0/1054701267 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/1054701267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d8199d0 0x55750d834c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bd2cec640 1 -- 172.21.15.42:0/1054701267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d81a2f0 msgr2=0x55750d836100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/1054701267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d81a2f0 0x55750d836100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bd2cec640 1 -- 172.21.15.42:0/1054701267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d8199d0 msgr2=0x55750d834c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/1054701267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d8199d0 0x55750d834c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bd2cec640 1 -- 172.21.15.42:0/1054701267 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55750d81a120 con 0x55750d824bb0 2024-09-19T09:38:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/1054701267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d83eab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4031860 tx=0x7f0bc4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe834574bebc06d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bb7fff640 1 -- 172.21.15.42:0/1054701267 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc406c030 con 0x55750d824bb0 2024-09-19T09:38:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bb7fff640 1 -- 172.21.15.42:0/1054701267 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc4036030 con 0x55750d824bb0 2024-09-19T09:38:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.653+0000 7f0bb7fff640 1 -- 172.21.15.42:0/1054701267 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4059070 con 0x55750d824bb0 2024-09-19T09:38:27.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 -- 172.21.15.42:0/1054701267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 msgr2=0x55750d83eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/1054701267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d83eab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4031860 tx=0x7f0bc4005ef0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 -- 172.21.15.42:0/1054701267 shutdown_connections 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/1054701267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d824bb0 0x55750d83eab0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/1054701267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d81a2f0 0x55750d836100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/1054701267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d8199d0 0x55750d834c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 -- 172.21.15.42:0/1054701267 >> 172.21.15.42:0/1054701267 conn(0x55750d815f60 msgr2=0x55750d810ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 -- 172.21.15.42:0/1054701267 shutdown_connections 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 -- 172.21.15.42:0/1054701267 wait complete. 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 -- start start 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 Processor -- start 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d838170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d8386b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.654+0000 7f0bd6b28740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 0x55750d89da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55750d836650 con 0x55750d8199d0 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55750d835f80 con 0x55750d81a2f0 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd6b28740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55750d836d20 con 0x55750d824bb0 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd6b28740 10 client.0 _ll_register_callbacks cb 0x7f0bbc008390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd24eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d838170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd24eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d838170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58696/0 (socket says 172.21.15.42:58696) 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd24eb640 1 -- 172.21.15.42:0/4017076191 learned_addr learned my addr 172.21.15.42:0/4017076191 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd1cea640 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d8386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 0x55750d89da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd24eb640 1 -- 172.21.15.42:0/4017076191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 msgr2=0x55750d89da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 0x55750d89da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd24eb640 1 -- 172.21.15.42:0/4017076191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 msgr2=0x55750d8386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d8386b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd24eb640 1 -- 172.21.15.42:0/4017076191 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55750d89dfd0 con 0x55750d8199d0 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd1cea640 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d8386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd2cec640 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 0x55750d89da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd24eb640 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d838170 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80093d0 tx=0x7f0bc806d0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600a868c25e6333a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/4017076191 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc809b300 con 0x55750d8199d0 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/4017076191 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0bc8010ca0 con 0x55750d8199d0 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd6b28740 1 -- 172.21.15.42:0/4017076191 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc4036030 con 0x55750d8199d0 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/4017076191 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0bc809f6b0 con 0x55750d8199d0 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd6b28740 10 client.15027 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.655+0000 7f0bd6b28740 1 -- 172.21.15.42:0/4017076191 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55750d89f2b0 con 0x55750d8199d0 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.656+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/4017076191 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc4036030 con 0x55750d8199d0 2024-09-19T09:38:27.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.656+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/4017076191 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0bc809a750 con 0x55750d8199d0 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.656+0000 7f0bd6b28740 10 client.15027 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.656+0000 7f0bd6b28740 10 client.15027 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.656+0000 7f0bd6b28740 20 client.15027 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.656+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55750d8a3dd0 0x55750d8a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.656+0000 7f0bd6b28740 4 client.15027 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.656+0000 7f0bd6b28740 1 -- 172.21.15.42:0/4017076191 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "status"}) -- 0x55750d787b10 con 0x55750d8a3dd0 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.656+0000 7f0bd1cea640 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55750d8a3dd0 0x55750d8a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bb5ffb640 10 client.15027 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd1cea640 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55750d8a3dd0 0x55750d8a2ae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d374294190d572d server_cookie=f7a65c4cb755e56c in_seq=0 out_seq=0 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bb5ffb640 1 -- 172.21.15.42:0/4017076191 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55750d787b10 con 0x55750d8a3dd0 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bb5ffb640 10 client.15027 handle_command_reply: tid=0 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 client.15027 shutdown 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 -- 172.21.15.42:0/4017076191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 msgr2=0x55750d838170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d838170 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80093d0 tx=0x7f0bc806d0d0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 -- 172.21.15.42:0/4017076191 shutdown_connections 2024-09-19T09:38:27.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55750d8a3dd0 0x55750d8a2ae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bb5ffb640 0 client.15027 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:38:27.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55750d824bb0 0x55750d89da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750d81a2f0 0x55750d8386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 --2- 172.21.15.42:0/4017076191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55750d8199d0 0x55750d838170 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 -- 172.21.15.42:0/4017076191 >> 172.21.15.42:0/4017076191 conn(0x55750d815f60 msgr2=0x55750d81b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 -- 172.21.15.42:0/4017076191 shutdown_connections 2024-09-19T09:38:27.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 1 -- 172.21.15.42:0/4017076191 wait complete. 2024-09-19T09:38:27.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.657+0000 7f0bd6b28740 20 client.15027 trim_cache size 0 max 16384 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 2, 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24473, 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 67.681958800999993, 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 27, 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 97.175729685999997 2024-09-19T09:38:27.665 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:38:27.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 -- 172.21.15.42:0/2059587482 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3350 msgr2=0x7f0bb80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3350 0x7f0bb80a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4046000 tx=0x7f0bc4049000 comp rx=0 tx=0).stop 2024-09-19T09:38:27.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 -- 172.21.15.42:0/2059587482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bcc100a80 msgr2=0x7f0bcc0fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bcc100a80 0x7f0bcc0fcce0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800b4a0 tx=0x7f0bc800b960 comp rx=0 tx=0).stop 2024-09-19T09:38:27.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 -- 172.21.15.42:0/2059587482 shutdown_connections 2024-09-19T09:38:27.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3350 0x7f0bb80a5810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bcc106a80 0x7f0bcc0fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc101420 0x7f0bcc0fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 --2- 172.21.15.42:0/2059587482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bcc100a80 0x7f0bcc0fcce0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 -- 172.21.15.42:0/2059587482 >> 172.21.15.42:0/2059587482 conn(0x7f0bcc0fc7a0 msgr2=0x7f0bcc06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 -- 172.21.15.42:0/2059587482 shutdown_connections 2024-09-19T09:38:27.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:27.658+0000 7f0bd474f640 1 -- 172.21.15.42:0/2059587482 wait complete. 2024-09-19T09:38:28.399 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:38:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:28.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:28 smithi042 ceph-mon[31223]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:28.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:28 smithi171 ceph-mon[35803]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:28 smithi136 ceph-mon[34840]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:29.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.123+0000 7f376e4be640 1 -- 172.21.15.42:0/3022678196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3768103660 msgr2=0x7f376810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.123+0000 7f376e4be640 1 --2- 172.21.15.42:0/3022678196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3768103660 0x7f376810bb50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f375c009900 tx=0x7f375c02a480 comp rx=0 tx=0).stop 2024-09-19T09:38:29.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.123+0000 7f376e4be640 1 -- 172.21.15.42:0/3022678196 shutdown_connections 2024-09-19T09:38:29.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.123+0000 7f376e4be640 1 --2- 172.21.15.42:0/3022678196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f376810c170 0x7f376810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.123+0000 7f376e4be640 1 --2- 172.21.15.42:0/3022678196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3768103660 0x7f376810bb50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.123+0000 7f376e4be640 1 --2- 172.21.15.42:0/3022678196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3768102d40 0x7f3768103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.123+0000 7f376e4be640 1 -- 172.21.15.42:0/3022678196 >> 172.21.15.42:0/3022678196 conn(0x7f37680fc7a0 msgr2=0x7f37680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.123+0000 7f376e4be640 1 -- 172.21.15.42:0/3022678196 shutdown_connections 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.123+0000 7f376e4be640 1 -- 172.21.15.42:0/3022678196 wait complete. 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f376e4be640 1 Processor -- start 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f376e4be640 1 -- start start 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f376e4be640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3768102d40 0x7f376819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f376e4be640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3768103660 0x7f376819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f376e4be640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f376810c170 0x7f376819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f376e4be640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3768111f70 con 0x7f3768103660 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f376e4be640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3768111df0 con 0x7f3768102d40 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f376e4be640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f37681120f0 con 0x7f376810c170 2024-09-19T09:38:29.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f37677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3768103660 0x7f376819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f37677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3768103660 0x7f376819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58704/0 (socket says 172.21.15.42:58704) 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f3767fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3768102d40 0x7f376819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f37677fe640 1 -- 172.21.15.42:0/1292800814 learned_addr learned my addr 172.21.15.42:0/1292800814 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.124+0000 7f376ca5b640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f376810c170 0x7f376819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f37677fe640 1 -- 172.21.15.42:0/1292800814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f376810c170 msgr2=0x7f376819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f37677fe640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f376810c170 0x7f376819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f37677fe640 1 -- 172.21.15.42:0/1292800814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3768102d40 msgr2=0x7f376819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f37677fe640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3768102d40 0x7f376819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f37677fe640 1 -- 172.21.15.42:0/1292800814 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376819f5b0 con 0x7f3768103660 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f3767fff640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3768102d40 0x7f376819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f37677fe640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3768103660 0x7f376819ab40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f375c006010 tx=0x7f375c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f37657fa640 1 -- 172.21.15.42:0/1292800814 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c03f030 con 0x7f3768103660 2024-09-19T09:38:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f37657fa640 1 -- 172.21.15.42:0/1292800814 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f375c003ce0 con 0x7f3768103660 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f376e4be640 1 -- 172.21.15.42:0/1292800814 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376819f840 con 0x7f3768103660 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f37657fa640 1 -- 172.21.15.42:0/1292800814 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c035070 con 0x7f3768103660 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.125+0000 7f376e4be640 1 -- 172.21.15.42:0/1292800814 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37681a7180 con 0x7f3768103660 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.128+0000 7f3770897740 1 Processor -- start 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.128+0000 7f37657fa640 1 -- 172.21.15.42:0/1292800814 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f375c042030 con 0x7f3768103660 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.128+0000 7f3770897740 1 -- start start 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.128+0000 7f3770897740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea6cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.128+0000 7f3770897740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea77670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.128+0000 7f3770897740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 0x564c7ea79fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.128+0000 7f3770897740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564c7e9d3090 con 0x564c7ea6d2f0 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.128+0000 7f3770897740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564c7e97aa70 con 0x564c7ea77bb0 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.128+0000 7f3770897740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564c7e9cf050 con 0x564c7ea6c9d0 2024-09-19T09:38:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f3767fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea77670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f3767fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea77670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58712/0 (socket says 172.21.15.42:58712) 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f3767fff640 1 -- 172.21.15.42:0/535964084 learned_addr learned my addr 172.21.15.42:0/535964084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f37677fe640 1 --2- 172.21.15.42:0/535964084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 0x564c7ea79fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f376ca5b640 1 --2- 172.21.15.42:0/535964084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea6cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f3767fff640 1 -- 172.21.15.42:0/535964084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 msgr2=0x564c7ea6cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f3767fff640 1 --2- 172.21.15.42:0/535964084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea6cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f3767fff640 1 -- 172.21.15.42:0/535964084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 msgr2=0x564c7ea79fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f3767fff640 1 --2- 172.21.15.42:0/535964084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 0x564c7ea79fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f3767fff640 1 -- 172.21.15.42:0/535964084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c7e987130 con 0x564c7ea6d2f0 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f376ca5b640 1 --2- 172.21.15.42:0/535964084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea6cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f37657fa640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f37500a3350 0x7f37500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f376ca5b640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f37500a3350 0x7f37500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f37657fa640 1 -- 172.21.15.42:0/1292800814 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f375c0eff70 con 0x7f3768103660 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f3767fff640 1 --2- 172.21.15.42:0/535964084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea77670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f37580104d0 tx=0x7f3758010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a82a08801ea6958 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f374e7fc640 1 -- 172.21.15.42:0/535964084 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758004220 con 0x564c7ea6d2f0 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f374e7fc640 1 -- 172.21.15.42:0/535964084 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37580043c0 con 0x564c7ea6d2f0 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.129+0000 7f374e7fc640 1 -- 172.21.15.42:0/535964084 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758011a70 con 0x564c7ea6d2f0 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f3770897740 1 -- 172.21.15.42:0/535964084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 msgr2=0x564c7ea77670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f3770897740 1 --2- 172.21.15.42:0/535964084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea77670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f37580104d0 tx=0x7f3758010990 comp rx=0 tx=0).stop 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f376ca5b640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f37500a3350 0x7f37500a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3760007f10 tx=0x7f3760007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f3770897740 1 -- 172.21.15.42:0/535964084 shutdown_connections 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f3770897740 1 --2- 172.21.15.42:0/535964084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 0x564c7ea79fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f3770897740 1 --2- 172.21.15.42:0/535964084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea77670 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f3770897740 1 --2- 172.21.15.42:0/535964084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea6cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f3770897740 1 -- 172.21.15.42:0/535964084 >> 172.21.15.42:0/535964084 conn(0x564c7ea68f60 msgr2=0x564c7ea69340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f3770897740 1 -- 172.21.15.42:0/535964084 shutdown_connections 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f3770897740 1 -- 172.21.15.42:0/535964084 wait complete. 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.130+0000 7f3770897740 1 -- start start 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f3770897740 1 Processor -- start 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f3770897740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea77440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f3770897740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea74790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f3770897740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 0x564c7ea74cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f3770897740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564c7ea7a780 con 0x564c7ea6d2f0 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f3770897740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564c7e98df20 con 0x564c7ea77bb0 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f3770897740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564c7ea7a900 con 0x564c7ea6c9d0 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f3770897740 10 client.0 _ll_register_callbacks cb 0x564c7e957030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:29.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f37677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea74790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f37677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea74790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58716/0 (socket says 172.21.15.42:58716) 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f37677fe640 1 -- 172.21.15.42:0/1331827549 learned_addr learned my addr 172.21.15.42:0/1331827549 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f376ca5b640 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 0x564c7ea74cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f3767fff640 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea77440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f37677fe640 1 -- 172.21.15.42:0/1331827549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 msgr2=0x564c7ea77440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f37677fe640 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea77440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f37677fe640 1 -- 172.21.15.42:0/1331827549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 msgr2=0x564c7ea74cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f37677fe640 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 0x564c7ea74cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f37677fe640 1 -- 172.21.15.42:0/1331827549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c7e7442b0 con 0x564c7ea6d2f0 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f376ca5b640 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 0x564c7ea74cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.131+0000 7f3767fff640 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea77440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f37677fe640 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea74790 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f375c0b89e0 tx=0x7f375c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4325a0c42a261021 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f37477fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f37477fe640 1 -- 172.21.15.42:0/1331827549 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c049070 con 0x564c7ea6d2f0 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f3770897740 1 -- 172.21.15.42:0/1331827549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37580043c0 con 0x564c7ea6d2f0 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f37477fe640 1 -- 172.21.15.42:0/1331827549 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f375c0f3c50 con 0x564c7ea6d2f0 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f37477fe640 1 -- 172.21.15.42:0/1331827549 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f375c0b8820 con 0x564c7ea6d2f0 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f3770897740 10 client.15039 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f3770897740 1 -- 172.21.15.42:0/1331827549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564c7ea86090 con 0x564c7ea6d2f0 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f37477fe640 1 -- 172.21.15.42:0/1331827549 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37580043c0 con 0x564c7ea6d2f0 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f37477fe640 1 -- 172.21.15.42:0/1331827549 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f375c0c4cb0 con 0x564c7ea6d2f0 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f3770897740 10 client.15039 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f3770897740 10 client.15039 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:38:29.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.132+0000 7f3770897740 20 client.15039 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.133+0000 7f3770897740 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x564c7ea886d0 0x564c7ea89b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.133+0000 7f3770897740 4 client.15039 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.133+0000 7f3770897740 1 -- 172.21.15.42:0/1331827549 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c7e9e0600 con 0x564c7ea886d0 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.133+0000 7f3767fff640 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x564c7ea886d0 0x564c7ea89b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.133+0000 7f37477fe640 10 client.15039 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.133+0000 7f3767fff640 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x564c7ea886d0 0x564c7ea89b40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4510000da6a839d7 server_cookie=887d62161d71f3e8 in_seq=0 out_seq=0 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f37477fe640 1 -- 172.21.15.42:0/1331827549 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c7e9e0600 con 0x564c7ea886d0 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f37477fe640 10 client.15039 handle_command_reply: tid=0 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 client.15039 shutdown 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 -- 172.21.15.42:0/1331827549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 msgr2=0x564c7ea74790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea74790 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f375c0b89e0 tx=0x7f375c004270 comp rx=0 tx=0).stop 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 -- 172.21.15.42:0/1331827549 shutdown_connections 2024-09-19T09:38:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x564c7ea886d0 0x564c7ea89b40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea77bb0 0x564c7ea74cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea6d2f0 0x564c7ea74790 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f37477fe640 0 client.15039 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 --2- 172.21.15.42:0/1331827549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea77440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 -- 172.21.15.42:0/1331827549 >> 172.21.15.42:0/1331827549 conn(0x564c7ea68f60 msgr2=0x564c7ea6ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 -- 172.21.15.42:0/1331827549 shutdown_connections 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 1 -- 172.21.15.42:0/1331827549 wait complete. 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.134+0000 7f3770897740 20 client.15039 trim_cache size 0 max 16384 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f3770897740 1 Processor -- start 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f3770897740 1 -- start start 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f3770897740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea89b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f3770897740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 0x564c7ea74050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f3770897740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea73060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f3770897740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564c7ea87e80 con 0x564c7ea77bb0 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f3770897740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564c7ea88550 con 0x564c7ea6d2f0 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f3770897740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564c7ea88c20 con 0x564c7ea6c9d0 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f376ca5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea73060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f376ca5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea73060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58732/0 (socket says 172.21.15.42:58732) 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.152+0000 7f376ca5b640 1 -- 172.21.15.42:0/3129706597 learned_addr learned my addr 172.21.15.42:0/3129706597 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f37677fe640 1 --2- 172.21.15.42:0/3129706597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 0x564c7ea74050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f3767fff640 1 --2- 172.21.15.42:0/3129706597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea89b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f376ca5b640 1 -- 172.21.15.42:0/3129706597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 msgr2=0x564c7ea89b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f376ca5b640 1 --2- 172.21.15.42:0/3129706597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea89b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f376ca5b640 1 -- 172.21.15.42:0/3129706597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 msgr2=0x564c7ea74050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f376ca5b640 1 --2- 172.21.15.42:0/3129706597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 0x564c7ea74050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f376ca5b640 1 -- 172.21.15.42:0/3129706597 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c7ea7a300 con 0x564c7ea77bb0 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f3767fff640 1 --2- 172.21.15.42:0/3129706597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea89b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f376ca5b640 1 --2- 172.21.15.42:0/3129706597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea73060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f376001e5a0 tx=0x7f3760014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6891fc26ee67e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f374dffb640 1 -- 172.21.15.42:0/3129706597 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376001c900 con 0x564c7ea77bb0 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f374dffb640 1 -- 172.21.15.42:0/3129706597 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37600263f0 con 0x564c7ea77bb0 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.153+0000 7f374dffb640 1 -- 172.21.15.42:0/3129706597 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376000f670 con 0x564c7ea77bb0 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 -- 172.21.15.42:0/3129706597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 msgr2=0x564c7ea73060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 --2- 172.21.15.42:0/3129706597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea73060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f376001e5a0 tx=0x7f3760014000 comp rx=0 tx=0).stop 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 -- 172.21.15.42:0/3129706597 shutdown_connections 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 --2- 172.21.15.42:0/3129706597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea73060 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 --2- 172.21.15.42:0/3129706597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 0x564c7ea74050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 --2- 172.21.15.42:0/3129706597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea89b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 -- 172.21.15.42:0/3129706597 >> 172.21.15.42:0/3129706597 conn(0x564c7ea68f60 msgr2=0x564c7ea69340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 -- 172.21.15.42:0/3129706597 shutdown_connections 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 -- 172.21.15.42:0/3129706597 wait complete. 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 -- start start 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 Processor -- start 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.154+0000 7f3770897740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea91f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f3770897740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 0x564c7ea924b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f3770897740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea8d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f3770897740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564c7ea899c0 con 0x564c7ea77bb0 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f3770897740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564c7ea892f0 con 0x564c7ea6d2f0 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f3770897740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564c7ea8a090 con 0x564c7ea6c9d0 2024-09-19T09:38:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f3770897740 10 client.0 _ll_register_callbacks cb 0x7f375c0f37b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f376ca5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea8d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f376ca5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea8d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58742/0 (socket says 172.21.15.42:58742) 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f376ca5b640 1 -- 172.21.15.42:0/623731197 learned_addr learned my addr 172.21.15.42:0/623731197 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f37677fe640 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 0x564c7ea924b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f3767fff640 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea91f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f376ca5b640 1 -- 172.21.15.42:0/623731197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 msgr2=0x564c7ea91f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f376ca5b640 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea91f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f376ca5b640 1 -- 172.21.15.42:0/623731197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 msgr2=0x564c7ea924b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f376ca5b640 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 0x564c7ea924b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f376ca5b640 1 -- 172.21.15.42:0/623731197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c7ea8db60 con 0x564c7ea77bb0 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f37677fe640 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 0x564c7ea924b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f376ca5b640 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea8d330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f376001ea60 tx=0x7f37600267d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a6c25b77ab5596 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f37477fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:29.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f37477fe640 1 -- 172.21.15.42:0/623731197 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760035070 con 0x564c7ea77bb0 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f37477fe640 1 -- 172.21.15.42:0/623731197 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f376001c700 con 0x564c7ea77bb0 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.155+0000 7f3770897740 1 -- 172.21.15.42:0/623731197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37600263f0 con 0x564c7ea77bb0 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f37477fe640 1 -- 172.21.15.42:0/623731197 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3760040050 con 0x564c7ea77bb0 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f3770897740 10 client.15045 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f3770897740 1 -- 172.21.15.42:0/623731197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564c7eaf28a0 con 0x564c7ea77bb0 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f37477fe640 1 -- 172.21.15.42:0/623731197 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37600263f0 con 0x564c7ea77bb0 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f37477fe640 1 -- 172.21.15.42:0/623731197 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3760025030 con 0x564c7ea77bb0 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f3770897740 10 client.15045 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f3770897740 10 client.15045 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f3770897740 20 client.15045 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:29.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f3770897740 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x564c7eaf6fa0 0x564c7eaf5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 1, 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24478, 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 70.188529621000001, 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 27, 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T09:38:29.184 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 96.185606265999994 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f3770897740 4 client.15045 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f3770897740 1 -- 172.21.15.42:0/623731197 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "status"}) -- 0x564c7e9dab10 con 0x564c7eaf6fa0 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.156+0000 7f3767fff640 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x564c7eaf6fa0 0x564c7eaf5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3767fff640 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x564c7eaf6fa0 0x564c7eaf5cb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=160971e9b40603e6 server_cookie=478daec12f6296c8 in_seq=0 out_seq=0 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f37477fe640 10 client.15045 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f37477fe640 1 -- 172.21.15.42:0/623731197 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564c7e9dab10 con 0x564c7eaf6fa0 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f37477fe640 10 client.15045 handle_command_reply: tid=0 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 client.15045 shutdown 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 -- 172.21.15.42:0/623731197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 msgr2=0x564c7ea8d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea8d330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f376001ea60 tx=0x7f37600267d0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 -- 172.21.15.42:0/623731197 shutdown_connections 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x564c7eaf6fa0 0x564c7eaf5cb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c7ea77bb0 0x564c7ea8d330 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c7ea6d2f0 0x564c7ea924b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 --2- 172.21.15.42:0/623731197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c7ea6c9d0 0x564c7ea91f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 -- 172.21.15.42:0/623731197 >> 172.21.15.42:0/623731197 conn(0x564c7ea68f60 msgr2=0x564c7ea72c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f37477fe640 0 client.15045 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 -- 172.21.15.42:0/623731197 shutdown_connections 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 1 -- 172.21.15.42:0/623731197 wait complete. 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.157+0000 7f3770897740 20 client.15045 trim_cache size 0 max 16384 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 -- 172.21.15.42:0/1292800814 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f37500a3350 msgr2=0x7f37500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f37500a3350 0x7f37500a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3760007f10 tx=0x7f3760007520 comp rx=0 tx=0).stop 2024-09-19T09:38:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 -- 172.21.15.42:0/1292800814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3768103660 msgr2=0x7f376819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3768103660 0x7f376819ab40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f375c006010 tx=0x7f375c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 -- 172.21.15.42:0/1292800814 shutdown_connections 2024-09-19T09:38:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f37500a3350 0x7f37500a5810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f376810c170 0x7f376819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3768103660 0x7f376819ab40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 --2- 172.21.15.42:0/1292800814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3768102d40 0x7f376819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 -- 172.21.15.42:0/1292800814 >> 172.21.15.42:0/1292800814 conn(0x7f37680fc7a0 msgr2=0x7f37681008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 -- 172.21.15.42:0/1292800814 shutdown_connections 2024-09-19T09:38:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:29.158+0000 7f376e4be640 1 -- 172.21.15.42:0/1292800814 wait complete. 2024-09-19T09:38:29.867 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:38:30.125 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:30.501 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:30 smithi042 ceph-mon[31223]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.583+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/1965528144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb08106f10 msgr2=0x7fcb0810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.583+0000 7fcb0fc3b640 1 --2- 172.21.15.42:0/1965528144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb08106f10 0x7fcb0810ea90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb00009ca0 tx=0x7fcb0002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.583+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/1965528144 shutdown_connections 2024-09-19T09:38:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.583+0000 7fcb0fc3b640 1 --2- 172.21.15.42:0/1965528144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb08106f10 0x7fcb0810ea90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.583+0000 7fcb0fc3b640 1 --2- 172.21.15.42:0/1965528144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb08102790 0x7fcb081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.583+0000 7fcb0fc3b640 1 --2- 172.21.15.42:0/1965528144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb08101de0 0x7fcb081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.583+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/1965528144 >> 172.21.15.42:0/1965528144 conn(0x7fcb080fd8c0 msgr2=0x7fcb080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.583+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/1965528144 shutdown_connections 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.583+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/1965528144 wait complete. 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0fc3b640 1 Processor -- start 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0fc3b640 1 -- start start 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0fc3b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb08101de0 0x7fcb080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0fc3b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb08102790 0x7fcb08074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0fc3b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb08106f10 0x7fcb08074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0fc3b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcb08111f90 con 0x7fcb08106f10 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0fc3b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcb08111e10 con 0x7fcb08101de0 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0fc3b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcb08112110 con 0x7fcb08102790 2024-09-19T09:38:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0e1d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb08106f10 0x7fcb08074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0e1d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb08106f10 0x7fcb08074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36828/0 (socket says 172.21.15.42:36828) 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0e1d8640 1 -- 172.21.15.42:0/2140812990 learned_addr learned my addr 172.21.15.42:0/2140812990 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb08102790 0x7fcb08074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb08101de0 0x7fcb080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0e1d8640 1 -- 172.21.15.42:0/2140812990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb08102790 msgr2=0x7fcb08074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0e1d8640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb08102790 0x7fcb08074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0e1d8640 1 -- 172.21.15.42:0/2140812990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb08101de0 msgr2=0x7fcb080744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.584+0000 7fcb0e1d8640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb08101de0 0x7fcb080744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.585+0000 7fcb0e1d8640 1 -- 172.21.15.42:0/2140812990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb081a68d0 con 0x7fcb08106f10 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.585+0000 7fcb0e1d8640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb08106f10 0x7fcb08074f70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb00031a60 tx=0x7fcb00031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.585+0000 7fcafeffd640 1 -- 172.21.15.42:0/2140812990 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00003b70 con 0x7fcb08106f10 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.585+0000 7fcafeffd640 1 -- 172.21.15.42:0/2140812990 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb00003d10 con 0x7fcb08106f10 2024-09-19T09:38:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.585+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/2140812990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb081a6b60 con 0x7fcb08106f10 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.585+0000 7fcafeffd640 1 -- 172.21.15.42:0/2140812990 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00004770 con 0x7fcb08106f10 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.585+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/2140812990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb081a70a0 con 0x7fcb08106f10 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.587+0000 7fcafeffd640 1 -- 172.21.15.42:0/2140812990 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcb0002f790 con 0x7fcb08106f10 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.587+0000 7fcb12014740 1 Processor -- start 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb12014740 1 -- start start 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb12014740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb12014740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 0x55c2fa6f2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb12014740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb12014740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa64e090 con 0x55c2fa6e79d0 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb12014740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa5f5a70 con 0x55c2fa6e82f0 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb12014740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa64a050 con 0x55c2fa6f2bb0 2024-09-19T09:38:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d1d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d1d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6e7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36842/0 (socket says 172.21.15.42:36842) 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/2790794017 learned_addr learned my addr 172.21.15.42:0/2790794017 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcafeffd640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaf40a32d0 0x7fcaf40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/2790794017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 0x55c2fa6f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/2790794017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0e1d8640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaf40a32d0 0x7fcaf40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/2790794017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 msgr2=0x55c2fa6f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/2790794017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/2790794017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 msgr2=0x55c2fa6f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/2790794017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 0x55c2fa6f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/2790794017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2fa602130 con 0x55c2fa6e79d0 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/2790794017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 0x55c2fa6f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:30.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.588+0000 7fcafeffd640 1 -- 172.21.15.42:0/2140812990 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fcb000f0f70 con 0x7fcb08106f10 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.589+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/2790794017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6e7db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8013560 tx=0x7fcaf800a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b31422711187869 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.589+0000 7fcaf3fff640 1 -- 172.21.15.42:0/2790794017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8019030 con 0x55c2fa6e79d0 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.589+0000 7fcb0e1d8640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaf40a32d0 0x7fcaf40a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcb000bd450 tx=0x7fcb00090340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.589+0000 7fcaf3fff640 1 -- 172.21.15.42:0/2790794017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf8011a00 con 0x55c2fa6e79d0 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.589+0000 7fcaf3fff640 1 -- 172.21.15.42:0/2790794017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800f840 con 0x55c2fa6e79d0 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 -- 172.21.15.42:0/2790794017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 msgr2=0x55c2fa6e7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 --2- 172.21.15.42:0/2790794017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6e7db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8013560 tx=0x7fcaf800a800 comp rx=0 tx=0).stop 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 -- 172.21.15.42:0/2790794017 shutdown_connections 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 --2- 172.21.15.42:0/2790794017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 --2- 172.21.15.42:0/2790794017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 0x55c2fa6f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 --2- 172.21.15.42:0/2790794017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6e7db0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 -- 172.21.15.42:0/2790794017 >> 172.21.15.42:0/2790794017 conn(0x55c2fa6e3f60 msgr2=0x55c2fa6e4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:30.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 -- 172.21.15.42:0/2790794017 shutdown_connections 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 -- 172.21.15.42:0/2790794017 wait complete. 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 -- start start 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.590+0000 7fcb12014740 1 Processor -- start 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb12014740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6f2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb12014740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6e82f0 0x55c2fa6ef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb12014740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6efca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb12014740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa6f5780 con 0x55c2fa6e79d0 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb12014740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa608f20 con 0x55c2fa6f2bb0 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb12014740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa6f5900 con 0x55c2fa6e82f0 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb0d1d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb12014740 10 client.0 _ll_register_callbacks cb 0x55c2fa5d2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb0d1d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6f2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36850/0 (socket says 172.21.15.42:36850) 2024-09-19T09:38:30.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/3997807332 learned_addr learned my addr 172.21.15.42:0/3997807332 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6e82f0 0x55c2fa6ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/3997807332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6e82f0 msgr2=0x55c2fa6ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6e82f0 0x55c2fa6ef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/3997807332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6f2bb0 msgr2=0x55c2fa6efca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/3997807332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2fa3bf2b0 con 0x55c2fa6e79d0 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6f2410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800a8f0 tx=0x7fcaf800adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc042addbb2a00e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcaf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcaf17fa640 1 -- 172.21.15.42:0/3997807332 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8019040 con 0x55c2fa6e79d0 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcb12014740 1 -- 172.21.15.42:0/3997807332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaf8011a00 con 0x55c2fa6e79d0 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.591+0000 7fcaf17fa640 1 -- 172.21.15.42:0/3997807332 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fcaf8005040 con 0x55c2fa6e79d0 2024-09-19T09:38:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcaf17fa640 1 -- 172.21.15.42:0/3997807332 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcaf8005240 con 0x55c2fa6e79d0 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcb12014740 10 client.15057 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcb12014740 1 -- 172.21.15.42:0/3997807332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c2fa7010a0 con 0x55c2fa6e79d0 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcaf17fa640 1 -- 172.21.15.42:0/3997807332 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf8011a00 con 0x55c2fa6e79d0 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcaf17fa640 1 -- 172.21.15.42:0/3997807332 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fcaf800f650 con 0x55c2fa6e79d0 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcb12014740 10 client.15057 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcb12014740 10 client.15057 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcb12014740 20 client.15057 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcb12014740 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2fa703360 0x55c2fa7047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcb12014740 4 client.15057 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcb12014740 1 -- 172.21.15.42:0/3997807332 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2fa65b600 con 0x55c2fa703360 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.592+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2fa703360 0x55c2fa7047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.593+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2fa703360 0x55c2fa7047d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=341a22da6f649b67 server_cookie=48eb91df9fbeda80 in_seq=0 out_seq=0 2024-09-19T09:38:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.593+0000 7fcaf17fa640 10 client.15057 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcaf17fa640 1 -- 172.21.15.42:0/3997807332 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2fa65b600 con 0x55c2fa703360 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcaf17fa640 10 client.15057 handle_command_reply: tid=0 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 client.15057 shutdown 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 -- 172.21.15.42:0/3997807332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 msgr2=0x55c2fa6f2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6f2410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800a8f0 tx=0x7fcaf800adb0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 -- 172.21.15.42:0/3997807332 shutdown_connections 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2fa703360 0x55c2fa7047d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6e82f0 0x55c2fa6ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 --2- 172.21.15.42:0/3997807332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa6f2410 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 -- 172.21.15.42:0/3997807332 >> 172.21.15.42:0/3997807332 conn(0x55c2fa6e3f60 msgr2=0x55c2fa6e9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcaf17fa640 0 client.15057 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:38:30.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 -- 172.21.15.42:0/3997807332 shutdown_connections 2024-09-19T09:38:30.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 1 -- 172.21.15.42:0/3997807332 wait complete. 2024-09-19T09:38:30.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.594+0000 7fcb12014740 20 client.15057 trim_cache size 0 max 16384 2024-09-19T09:38:30.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb12014740 1 Processor -- start 2024-09-19T09:38:30.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb12014740 1 -- start start 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb12014740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e79d0 0x55c2fa702c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb12014740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb12014740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6eca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb12014740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa702b10 con 0x55c2fa6e82f0 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb12014740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa7031e0 con 0x55c2fa6e79d0 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb12014740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa7038b0 con 0x55c2fa6f2bb0 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb0d9d7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb0d9d7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36852/0 (socket says 172.21.15.42:36852) 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.612+0000 7fcb0d9d7640 1 -- 172.21.15.42:0/1842256700 learned_addr learned my addr 172.21.15.42:0/1842256700 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/1842256700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6eca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcb0d9d7640 1 -- 172.21.15.42:0/1842256700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 msgr2=0x55c2fa6eca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:30.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/1842256700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6eca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/1842256700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e79d0 0x55c2fa702c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcb0d9d7640 1 -- 172.21.15.42:0/1842256700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e79d0 msgr2=0x55c2fa702c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/1842256700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e79d0 0x55c2fa702c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcb0d9d7640 1 -- 172.21.15.42:0/1842256700 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2fa6effd0 con 0x55c2fa6e82f0 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/1842256700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7047d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400b910 tx=0x7fcb0400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be097871c769254 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcaf37fe640 1 -- 172.21.15.42:0/1842256700 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400f040 con 0x55c2fa6e82f0 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcaf37fe640 1 -- 172.21.15.42:0/1842256700 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb04023070 con 0x55c2fa6e82f0 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.613+0000 7fcaf37fe640 1 -- 172.21.15.42:0/1842256700 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0401e690 con 0x55c2fa6e82f0 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 -- 172.21.15.42:0/1842256700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e82f0 msgr2=0x55c2fa7047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 --2- 172.21.15.42:0/1842256700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7047d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400b910 tx=0x7fcb0400be70 comp rx=0 tx=0).stop 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 -- 172.21.15.42:0/1842256700 shutdown_connections 2024-09-19T09:38:30.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 --2- 172.21.15.42:0/1842256700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa6eca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 --2- 172.21.15.42:0/1842256700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7047d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 --2- 172.21.15.42:0/1842256700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e79d0 0x55c2fa702c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 -- 172.21.15.42:0/1842256700 >> 172.21.15.42:0/1842256700 conn(0x55c2fa6e3f60 msgr2=0x55c2fa6dece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 -- 172.21.15.42:0/1842256700 shutdown_connections 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 -- 172.21.15.42:0/1842256700 wait complete. 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 -- start start 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.614+0000 7fcb12014740 1 Processor -- start 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb12014740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa707c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb12014740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7081b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb12014740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa76ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb12014740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa704650 con 0x55c2fa6e79d0 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb12014740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa703f80 con 0x55c2fa6e82f0 2024-09-19T09:38:30.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb12014740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c2fa704d20 con 0x55c2fa6f2bb0 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb12014740 10 client.0 _ll_register_callbacks cb 0x7fcaf8013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d1d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa707c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d1d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa707c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36862/0 (socket says 172.21.15.42:36862) 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/220423532 learned_addr learned my addr 172.21.15.42:0/220423532 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/220423532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 msgr2=0x55c2fa76ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa76ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/220423532 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 msgr2=0x55c2fa7081b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7081b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d1d6640 1 -- 172.21.15.42:0/220423532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2fa76bfa0 con 0x55c2fa6e79d0 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:30.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb0d1d6640 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa707c70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8001eb0 tx=0x7fcaf800a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60167c6b482c62bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcaf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcaf17fa640 1 -- 172.21.15.42:0/220423532 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8019040 con 0x55c2fa6e79d0 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcaf17fa640 1 -- 172.21.15.42:0/220423532 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fcaf800f550 con 0x55c2fa6e79d0 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.615+0000 7fcb12014740 1 -- 172.21.15.42:0/220423532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb04023070 con 0x55c2fa6e79d0 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcaf17fa640 1 -- 172.21.15.42:0/220423532 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcaf8040050 con 0x55c2fa6e79d0 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcb12014740 10 client.15063 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcb12014740 1 -- 172.21.15.42:0/220423532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c2fa76d160 con 0x55c2fa6e79d0 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcaf17fa640 1 -- 172.21.15.42:0/220423532 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb04023070 con 0x55c2fa6e79d0 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcaf17fa640 1 -- 172.21.15.42:0/220423532 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fcaf802aa90 con 0x55c2fa6e79d0 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcb12014740 10 client.15063 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcb12014740 10 client.15063 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcb12014740 20 client.15063 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcb12014740 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2fa771c50 0x55c2fa770960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:30.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcb12014740 4 client.15063 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcb12014740 1 -- 172.21.15.42:0/220423532 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "status"}) -- 0x55c2fa655b10 con 0x55c2fa771c50 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.616+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2fa771c50 0x55c2fa770960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb0d9d7640 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2fa771c50 0x55c2fa770960 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a8f3a4258393865 server_cookie=64fdfacea8c3db07 in_seq=0 out_seq=0 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcaf17fa640 10 client.15063 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcaf17fa640 1 -- 172.21.15.42:0/220423532 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55c2fa655b10 con 0x55c2fa771c50 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcaf17fa640 10 client.15063 handle_command_reply: tid=0 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 client.15063 shutdown 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 -- 172.21.15.42:0/220423532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 msgr2=0x55c2fa707c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa707c70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8001eb0 tx=0x7fcaf800a870 comp rx=0 tx=0).stop 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 -- 172.21.15.42:0/220423532 shutdown_connections 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2fa771c50 0x55c2fa770960 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2fa6f2bb0 0x55c2fa76ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcaf17fa640 0 client.15063 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:38:30.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2fa6e82f0 0x55c2fa7081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 --2- 172.21.15.42:0/220423532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2fa6e79d0 0x55c2fa707c70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 -- 172.21.15.42:0/220423532 >> 172.21.15.42:0/220423532 conn(0x55c2fa6e3f60 msgr2=0x55c2fa6ee070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:30.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 -- 172.21.15.42:0/220423532 shutdown_connections 2024-09-19T09:38:30.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 1 -- 172.21.15.42:0/220423532 wait complete. 2024-09-19T09:38:30.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.617+0000 7fcb12014740 20 client.15063 trim_cache size 0 max 16384 2024-09-19T09:38:30.631 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:38:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-19T09:38:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24506, 2024-09-19T09:38:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:38:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:38:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:38:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 78.605175333999995, 2024-09-19T09:38:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 27, 2024-09-19T09:38:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:38:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T09:38:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 89.198558151 2024-09-19T09:38:30.632 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:38:30.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/2140812990 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaf40a32d0 msgr2=0x7fcaf40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaf40a32d0 0x7fcaf40a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcb000bd450 tx=0x7fcb00090340 comp rx=0 tx=0).stop 2024-09-19T09:38:30.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/2140812990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb08106f10 msgr2=0x7fcb08074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:30.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb08106f10 0x7fcb08074f70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb00031a60 tx=0x7fcb00031a90 comp rx=0 tx=0).stop 2024-09-19T09:38:30.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/2140812990 shutdown_connections 2024-09-19T09:38:30.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcaf40a32d0 0x7fcaf40a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb08106f10 0x7fcb08074f70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb08102790 0x7fcb08074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 --2- 172.21.15.42:0/2140812990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb08101de0 0x7fcb080744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:30.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/2140812990 >> 172.21.15.42:0/2140812990 conn(0x7fcb080fd8c0 msgr2=0x7fcb080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:30.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/2140812990 shutdown_connections 2024-09-19T09:38:30.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:30.618+0000 7fcb0fc3b640 1 -- 172.21.15.42:0/2140812990 wait complete. 2024-09-19T09:38:30.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:30 smithi171 ceph-mon[35803]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:30 smithi136 ceph-mon[34840]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:31.267 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T09:38:31.267 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:38:31.277 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-09-19T09:38:31.277 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T09:38:31.532 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.014+0000 7f997e81b640 1 -- 172.21.15.42:0/3847924456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9978101cd0 msgr2=0x7f9978102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.015+0000 7f997e81b640 1 --2- 172.21.15.42:0/3847924456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9978101cd0 0x7f9978102150 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f996c009900 tx=0x7f996c02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.015+0000 7f997e81b640 1 -- 172.21.15.42:0/3847924456 shutdown_connections 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.015+0000 7f997e81b640 1 --2- 172.21.15.42:0/3847924456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9978102690 0x7f9978108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.015+0000 7f997e81b640 1 --2- 172.21.15.42:0/3847924456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9978101cd0 0x7f9978102150 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.015+0000 7f997e81b640 1 --2- 172.21.15.42:0/3847924456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9978100ad0 0x7f9978100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.015+0000 7f997e81b640 1 -- 172.21.15.42:0/3847924456 >> 172.21.15.42:0/3847924456 conn(0x7f99780fc280 msgr2=0x7f99780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.015+0000 7f997e81b640 1 -- 172.21.15.42:0/3847924456 shutdown_connections 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.015+0000 7f997e81b640 1 -- 172.21.15.42:0/3847924456 wait complete. 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.015+0000 7f997e81b640 1 Processor -- start 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.015+0000 7f997e81b640 1 -- start start 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997e81b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9978100ad0 0x7f997810b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997e81b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9978101cd0 0x7f9978109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997e81b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9978102690 0x7f9978109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997e81b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f997810d960 con 0x7f9978102690 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997e81b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f997810d7e0 con 0x7f9978101cd0 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997e81b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f997810dae0 con 0x7f9978100ad0 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997cdb8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9978102690 0x7f9978109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997cdb8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9978102690 0x7f9978109fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36874/0 (socket says 172.21.15.42:36874) 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997cdb8640 1 -- 172.21.15.42:0/51428206 learned_addr learned my addr 172.21.15.42:0/51428206 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f99777fe640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9978101cd0 0x7f9978109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f9977fff640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9978100ad0 0x7f997810b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997cdb8640 1 -- 172.21.15.42:0/51428206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9978100ad0 msgr2=0x7f997810b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997cdb8640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9978100ad0 0x7f997810b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997cdb8640 1 -- 172.21.15.42:0/51428206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9978101cd0 msgr2=0x7f9978109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997cdb8640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9978101cd0 0x7f9978109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997cdb8640 1 -- 172.21.15.42:0/51428206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997810a8a0 con 0x7f9978102690 2024-09-19T09:38:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f99777fe640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9978101cd0 0x7f9978109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f997cdb8640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9978102690 0x7f9978109fe0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f997000b970 tx=0x7f997000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.016+0000 7f99757fa640 1 -- 172.21.15.42:0/51428206 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970019070 con 0x7f9978102690 2024-09-19T09:38:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.017+0000 7f997e81b640 1 -- 172.21.15.42:0/51428206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99781a2230 con 0x7f9978102690 2024-09-19T09:38:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.017+0000 7f99757fa640 1 -- 172.21.15.42:0/51428206 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f997000cb40 con 0x7f9978102690 2024-09-19T09:38:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.017+0000 7f99757fa640 1 -- 172.21.15.42:0/51428206 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970007610 con 0x7f9978102690 2024-09-19T09:38:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.017+0000 7f997e81b640 1 -- 172.21.15.42:0/51428206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99781a2810 con 0x7f9978102690 2024-09-19T09:38:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.018+0000 7f997e81b640 1 -- 172.21.15.42:0/51428206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9978107f60 con 0x7f9978102690 2024-09-19T09:38:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.019+0000 7f99757fa640 1 -- 172.21.15.42:0/51428206 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f997001c070 con 0x7f9978102690 2024-09-19T09:38:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.020+0000 7f99757fa640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f99600a32d0 0x7f99600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.020+0000 7f9977fff640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f99600a32d0 0x7f99600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.020+0000 7f99757fa640 1 -- 172.21.15.42:0/51428206 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f99700cf4e0 con 0x7f9978102690 2024-09-19T09:38:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.020+0000 7f9977fff640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f99600a32d0 0x7f99600a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9978101b30 tx=0x7f9968008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.023+0000 7f99757fa640 1 -- 172.21.15.42:0/51428206 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f997009c130 con 0x7f9978102690 2024-09-19T09:38:32.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.220+0000 7f997e81b640 1 -- 172.21.15.42:0/51428206 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9978062630 con 0x7f99600a32d0 2024-09-19T09:38:32.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.221+0000 7f99757fa640 1 -- 172.21.15.42:0/51428206 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9978062630 con 0x7f99600a32d0 2024-09-19T09:38:32.222 INFO:teuthology.orchestra.run.smithi042.stdout:Backend: cephadm 2024-09-19T09:38:32.222 INFO:teuthology.orchestra.run.smithi042.stdout:Available: Yes 2024-09-19T09:38:32.222 INFO:teuthology.orchestra.run.smithi042.stdout:Paused: No 2024-09-19T09:38:32.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.222+0000 7f997e81b640 1 -- 172.21.15.42:0/51428206 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f99600a32d0 msgr2=0x7f99600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.222+0000 7f997e81b640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f99600a32d0 0x7f99600a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9978101b30 tx=0x7f9968008040 comp rx=0 tx=0).stop 2024-09-19T09:38:32.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.222+0000 7f997e81b640 1 -- 172.21.15.42:0/51428206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9978102690 msgr2=0x7f9978109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.222+0000 7f997e81b640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9978102690 0x7f9978109fe0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f997000b970 tx=0x7f997000be30 comp rx=0 tx=0).stop 2024-09-19T09:38:32.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.223+0000 7f997e81b640 1 -- 172.21.15.42:0/51428206 shutdown_connections 2024-09-19T09:38:32.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.223+0000 7f997e81b640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f99600a32d0 0x7f99600a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.223+0000 7f997e81b640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9978102690 0x7f9978109fe0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.223+0000 7f997e81b640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9978101cd0 0x7f9978109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.223+0000 7f997e81b640 1 --2- 172.21.15.42:0/51428206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9978100ad0 0x7f997810b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.223+0000 7f997e81b640 1 -- 172.21.15.42:0/51428206 >> 172.21.15.42:0/51428206 conn(0x7f99780fc280 msgr2=0x7f9978105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:32.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.223+0000 7f997e81b640 1 -- 172.21.15.42:0/51428206 shutdown_connections 2024-09-19T09:38:32.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:32.223+0000 7f997e81b640 1 -- 172.21.15.42:0/51428206 wait complete. 2024-09-19T09:38:32.677 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:32 smithi042 ceph-mon[31223]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:32.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:32 smithi171 ceph-mon[35803]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:32.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T09:38:32.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:32 smithi136 ceph-mon[34840]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:33.123 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:33.548 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:33 smithi042 ceph-mon[31223]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.546+0000 7f2b32d7c640 1 -- 172.21.15.42:0/3129681126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c1037c0 msgr2=0x7f2b2c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.546+0000 7f2b32d7c640 1 --2- 172.21.15.42:0/3129681126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c1037c0 0x7f2b2c10a050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009ca0 tx=0x7f2b2402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.546+0000 7f2b32d7c640 1 -- 172.21.15.42:0/3129681126 shutdown_connections 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.546+0000 7f2b32d7c640 1 --2- 172.21.15.42:0/3129681126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c1037c0 0x7f2b2c10a050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.546+0000 7f2b32d7c640 1 --2- 172.21.15.42:0/3129681126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b2c102e00 0x7f2b2c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.546+0000 7f2b32d7c640 1 --2- 172.21.15.42:0/3129681126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c101c00 0x7f2b2c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.546+0000 7f2b32d7c640 1 -- 172.21.15.42:0/3129681126 >> 172.21.15.42:0/3129681126 conn(0x7f2b2c0fd390 msgr2=0x7f2b2c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.546+0000 7f2b32d7c640 1 -- 172.21.15.42:0/3129681126 shutdown_connections 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.546+0000 7f2b32d7c640 1 -- 172.21.15.42:0/3129681126 wait complete. 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b32d7c640 1 Processor -- start 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b32d7c640 1 -- start start 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b32d7c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c101c00 0x7f2b2c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b32d7c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b2c102e00 0x7f2b2c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b32d7c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c1037c0 0x7f2b2c19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b32d7c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c10d930 con 0x7f2b2c1037c0 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b32d7c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c10d7b0 con 0x7f2b2c101c00 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b32d7c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c10dab0 con 0x7f2b2c102e00 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b31319640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c1037c0 0x7f2b2c19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b31319640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c1037c0 0x7f2b2c19f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36894/0 (socket says 172.21.15.42:36894) 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b31319640 1 -- 172.21.15.42:0/97307749 learned_addr learned my addr 172.21.15.42:0/97307749 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b2bfff640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b2c102e00 0x7f2b2c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b31319640 1 -- 172.21.15.42:0/97307749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b2c102e00 msgr2=0x7f2b2c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b31319640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b2c102e00 0x7f2b2c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b30b18640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c101c00 0x7f2b2c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.547+0000 7f2b31319640 1 -- 172.21.15.42:0/97307749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c101c00 msgr2=0x7f2b2c197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.548+0000 7f2b31319640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c101c00 0x7f2b2c197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.548+0000 7f2b31319640 1 -- 172.21.15.42:0/97307749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c19fb50 con 0x7f2b2c1037c0 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.548+0000 7f2b2bfff640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b2c102e00 0x7f2b2c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.548+0000 7f2b30b18640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c101c00 0x7f2b2c197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.548+0000 7f2b31319640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c1037c0 0x7f2b2c19f4e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2b240098d0 tx=0x7f2b2402f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.548+0000 7f2b29ffb640 1 -- 172.21.15.42:0/97307749 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2402fc30 con 0x7f2b2c1037c0 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.548+0000 7f2b32d7c640 1 -- 172.21.15.42:0/97307749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2c19fde0 con 0x7f2b2c1037c0 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.548+0000 7f2b29ffb640 1 -- 172.21.15.42:0/97307749 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b24003e50 con 0x7f2b2c1037c0 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.548+0000 7f2b29ffb640 1 -- 172.21.15.42:0/97307749 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b240305c0 con 0x7f2b2c1037c0 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.548+0000 7f2b32d7c640 1 -- 172.21.15.42:0/97307749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2c1a0310 con 0x7f2b2c1037c0 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.549+0000 7f2b32d7c640 1 -- 172.21.15.42:0/97307749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2c108fb0 con 0x7f2b2c1037c0 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.550+0000 7f2b29ffb640 1 -- 172.21.15.42:0/97307749 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2b24003970 con 0x7f2b2c1037c0 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.551+0000 7f2b29ffb640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2b1c0a3300 0x7f2b1c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.551+0000 7f2b30b18640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2b1c0a3300 0x7f2b1c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.551+0000 7f2b29ffb640 1 -- 172.21.15.42:0/97307749 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2b240f0e20 con 0x7f2b2c1037c0 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.551+0000 7f2b30b18640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2b1c0a3300 0x7f2b1c0a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2b20006fd0 tx=0x7f2b20008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.555+0000 7f2b29ffb640 1 -- 172.21.15.42:0/97307749 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b240bdb90 con 0x7f2b2c1037c0 2024-09-19T09:38:33.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.739+0000 7f2b32d7c640 1 -- 172.21.15.42:0/97307749 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2b2c062630 con 0x7f2b1c0a3300 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.751+0000 7f2b29ffb640 1 -- 172.21.15.42:0/97307749 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f2b2c062630 con 0x7f2b1c0a3300 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds.a smithi042 running (95s) 19s ago 94s 16.9M - 19.1.1-361-g2f599a46 d2baa855c067 1dc74a60140c 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds.b smithi136 running (92s) 26s ago 92s 25.7M - 19.1.1-361-g2f599a46 d2baa855c067 4cc887f84449 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds.c smithi171 running (106s) 26s ago 105s 19.2M - 19.1.1-361-g2f599a46 d2baa855c067 fe1c194fe653 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds.d smithi042 running (114s) 19s ago 112s 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 6c1b1321c640 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mds.e smithi136 running (110s) 26s ago 110s 16.8M - 19.1.1-361-g2f599a46 d2baa855c067 ebc698cbb586 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mds.f smithi171 running (108s) 26s ago 108s 17.8M - 19.1.1-361-g2f599a46 d2baa855c067 1a3e427bc622 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mds.g smithi042 running (98s) 19s ago 97s 16.9M - 19.1.1-361-g2f599a46 d2baa855c067 09904629cc11 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mds.h smithi136 running (103s) 26s ago 103s 17.8M - 19.1.1-361-g2f599a46 d2baa855c067 3468ae2ee97b 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mds.i smithi171 running (101s) 26s ago 100s 20.1M - 19.1.1-361-g2f599a46 d2baa855c067 61a5122301e2 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mds.j smithi042 running (116s) 19s ago 116s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 3629a0169809 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mds.k smithi136 running (119s) 26s ago 119s 18.2M - 19.1.1-361-g2f599a46 d2baa855c067 f9225b660ddd 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mds.l smithi171 running (2m) 26s ago 2m 16.1M - 19.1.1-361-g2f599a46 d2baa855c067 b5e61c7101ad 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.x smithi042 *:9283,8765 running (8m) 19s ago 8m 509M - 19.1.1-361-g2f599a46 d2baa855c067 9fce6cbb9abf 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.y smithi136 *:8443,8765 running (7m) 26s ago 7m 440M - 19.1.1-361-g2f599a46 d2baa855c067 2e09be71da8f 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.z smithi171 *:8443,8765 running (7m) 26s ago 7m 443M - 19.1.1-361-g2f599a46 d2baa855c067 363a73a2b2e7 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mon.a smithi042 running (8m) 19s ago 8m 56.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 40a0eaaef04c 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:mon.b smithi136 running (7m) 26s ago 7m 43.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 c48bd911c510 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:mon.c smithi171 running (7m) 26s ago 7m 40.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 2c4e114d3c1e 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 smithi042 running (6m) 19s ago 6m 57.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 2244289fb686 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 smithi136 running (6m) 26s ago 6m 56.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 aee66299f419 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 smithi171 running (5m) 26s ago 5m 52.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 b30605ec195a 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 smithi042 running (5m) 19s ago 5m 54.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 34f14fa53644 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 smithi136 running (5m) 26s ago 5m 56.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 dfefea5c5620 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 smithi171 running (4m) 26s ago 4m 46.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 9e063e7cc04b 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 smithi042 running (4m) 19s ago 4m 45.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 850481ed1b9e 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 smithi136 running (3m) 26s ago 3m 46.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 459b45a1273e 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.8 smithi171 running (3m) 26s ago 3m 55.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 b2bc1edca2a5 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.9 smithi042 running (3m) 19s ago 3m 44.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 c7f8505596a1 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.10 smithi136 running (2m) 26s ago 2m 49.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 0a98ec2cba66 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.11 smithi171 running (2m) 26s ago 2m 46.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 c2b9e8d0a620 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.753+0000 7f2b32d7c640 1 -- 172.21.15.42:0/97307749 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2b1c0a3300 msgr2=0x7f2b1c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.753+0000 7f2b32d7c640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2b1c0a3300 0x7f2b1c0a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2b20006fd0 tx=0x7f2b20008040 comp rx=0 tx=0).stop 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.753+0000 7f2b32d7c640 1 -- 172.21.15.42:0/97307749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c1037c0 msgr2=0x7f2b2c19f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.753+0000 7f2b32d7c640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c1037c0 0x7f2b2c19f4e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2b240098d0 tx=0x7f2b2402f840 comp rx=0 tx=0).stop 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.753+0000 7f2b32d7c640 1 -- 172.21.15.42:0/97307749 shutdown_connections 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.753+0000 7f2b32d7c640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2b1c0a3300 0x7f2b1c0a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.753+0000 7f2b32d7c640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b2c1037c0 0x7f2b2c19f4e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.753+0000 7f2b32d7c640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b2c102e00 0x7f2b2c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.753+0000 7f2b32d7c640 1 --2- 172.21.15.42:0/97307749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c101c00 0x7f2b2c197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.753+0000 7f2b32d7c640 1 -- 172.21.15.42:0/97307749 >> 172.21.15.42:0/97307749 conn(0x7f2b2c0fd390 msgr2=0x7f2b2c106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.754+0000 7f2b32d7c640 1 -- 172.21.15.42:0/97307749 shutdown_connections 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:33.754+0000 7f2b32d7c640 1 -- 172.21.15.42:0/97307749 wait complete. 2024-09-19T09:38:33.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:33 smithi171 ceph-mon[35803]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:33.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:33 smithi136 ceph-mon[34840]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:34.342 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:34.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:34 smithi042 ceph-mon[31223]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:34.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:34 smithi171 ceph-mon[35803]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:34.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:34 smithi136 ceph-mon[34840]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:35.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.030+0000 7f392dfca640 1 -- 172.21.15.42:0/441366606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3928100ad0 msgr2=0x7f3928100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.030+0000 7f392dfca640 1 --2- 172.21.15.42:0/441366606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3928100ad0 0x7f3928100ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3918009ca0 tx=0x7f391802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.030+0000 7f392dfca640 1 -- 172.21.15.42:0/441366606 shutdown_connections 2024-09-19T09:38:35.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.030+0000 7f392dfca640 1 --2- 172.21.15.42:0/441366606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3928102690 0x7f3928108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.030+0000 7f392dfca640 1 --2- 172.21.15.42:0/441366606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3928101cd0 0x7f3928102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.030+0000 7f392dfca640 1 --2- 172.21.15.42:0/441366606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3928100ad0 0x7f3928100ed0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.030+0000 7f392dfca640 1 -- 172.21.15.42:0/441366606 >> 172.21.15.42:0/441366606 conn(0x7f39280fc280 msgr2=0x7f39280fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:35.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.030+0000 7f392dfca640 1 -- 172.21.15.42:0/441366606 shutdown_connections 2024-09-19T09:38:35.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.031+0000 7f392dfca640 1 -- 172.21.15.42:0/441366606 wait complete. 2024-09-19T09:38:35.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.031+0000 7f392dfca640 1 Processor -- start 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f392dfca640 1 -- start start 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f392dfca640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3928100ad0 0x7f3928104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f392dfca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3928101cd0 0x7f39281030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f392dfca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3928102690 0x7f39281035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f392dfca640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f392810c880 con 0x7f3928102690 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f392dfca640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f392810c700 con 0x7f3928100ad0 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f392dfca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f392810ca00 con 0x7f3928101cd0 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f3927fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3928102690 0x7f39281035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f3927fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3928102690 0x7f39281035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36906/0 (socket says 172.21.15.42:36906) 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f3927fff640 1 -- 172.21.15.42:0/4293091158 learned_addr learned my addr 172.21.15.42:0/4293091158 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f39277fe640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3928100ad0 0x7f3928104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f3926ffd640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3928101cd0 0x7f39281030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f3927fff640 1 -- 172.21.15.42:0/4293091158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3928101cd0 msgr2=0x7f39281030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f3927fff640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3928101cd0 0x7f39281030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f3927fff640 1 -- 172.21.15.42:0/4293091158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3928100ad0 msgr2=0x7f3928104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f3927fff640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3928100ad0 0x7f3928104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f3927fff640 1 -- 172.21.15.42:0/4293091158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3928103eb0 con 0x7f3928102690 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.032+0000 7f3926ffd640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3928101cd0 0x7f39281030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.033+0000 7f3927fff640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3928102690 0x7f39281035f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3920009fd0 tx=0x7f392000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.033+0000 7f3924ff9640 1 -- 172.21.15.42:0/4293091158 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920011830 con 0x7f3928102690 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.033+0000 7f3924ff9640 1 -- 172.21.15.42:0/4293091158 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3920016070 con 0x7f3928102690 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.033+0000 7f3924ff9640 1 -- 172.21.15.42:0/4293091158 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392000f2e0 con 0x7f3928102690 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.033+0000 7f392dfca640 1 -- 172.21.15.42:0/4293091158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39281a2260 con 0x7f3928102690 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.033+0000 7f392dfca640 1 -- 172.21.15.42:0/4293091158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39281a27a0 con 0x7f3928102690 2024-09-19T09:38:35.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.034+0000 7f392dfca640 1 -- 172.21.15.42:0/4293091158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39281a2a30 con 0x7f3928102690 2024-09-19T09:38:35.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.035+0000 7f3924ff9640 1 -- 172.21.15.42:0/4293091158 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f39200119d0 con 0x7f3928102690 2024-09-19T09:38:35.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.036+0000 7f3924ff9640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39100a32d0 0x7f39100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.036+0000 7f39277fe640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39100a32d0 0x7f39100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.036+0000 7f3924ff9640 1 -- 172.21.15.42:0/4293091158 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f39200cf040 con 0x7f3928102690 2024-09-19T09:38:35.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.036+0000 7f39277fe640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39100a32d0 0x7f39100a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3918000f80 tx=0x7f3918005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:35.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.041+0000 7f3924ff9640 1 -- 172.21.15.42:0/4293091158 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f392009bcf0 con 0x7f3928102690 2024-09-19T09:38:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.225+0000 7f392dfca640 1 -- 172.21.15.42:0/4293091158 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f39281a2c00 con 0x7f39100a32d0 2024-09-19T09:38:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.231+0000 7f3924ff9640 1 -- 172.21.15.42:0/4293091158 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f39281a2c00 con 0x7f39100a32d0 2024-09-19T09:38:35.233 INFO:teuthology.orchestra.run.smithi042.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T09:38:35.233 INFO:teuthology.orchestra.run.smithi042.stdout:mds.all 12/12 27s ago 2m smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-09-19T09:38:35.233 INFO:teuthology.orchestra.run.smithi042.stdout:mgr 3/3 27s ago 7m smithi042=x;smithi136=y;smithi171=z;count:3 2024-09-19T09:38:35.233 INFO:teuthology.orchestra.run.smithi042.stdout:mon 3/3 27s ago 7m smithi042:172.21.15.42=a;smithi136:172.21.15.136=b;smithi171:172.21.15.171=c;count:3 2024-09-19T09:38:35.233 INFO:teuthology.orchestra.run.smithi042.stdout:osd 12 27s ago - 2024-09-19T09:38:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 -- 172.21.15.42:0/4293091158 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39100a32d0 msgr2=0x7f39100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39100a32d0 0x7f39100a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3918000f80 tx=0x7f3918005ef0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 -- 172.21.15.42:0/4293091158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3928102690 msgr2=0x7f39281035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3928102690 0x7f39281035f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3920009fd0 tx=0x7f392000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 -- 172.21.15.42:0/4293091158 shutdown_connections 2024-09-19T09:38:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f39100a32d0 0x7f39100a5790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3928102690 0x7f39281035f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3928101cd0 0x7f39281030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 --2- 172.21.15.42:0/4293091158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3928100ad0 0x7f3928104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 -- 172.21.15.42:0/4293091158 >> 172.21.15.42:0/4293091158 conn(0x7f39280fc280 msgr2=0x7f3928069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 -- 172.21.15.42:0/4293091158 shutdown_connections 2024-09-19T09:38:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:35.233+0000 7f392dfca640 1 -- 172.21.15.42:0/4293091158 wait complete. 2024-09-19T09:38:35.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:35 smithi042 ceph-mon[31223]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:35.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:35 smithi171 ceph-mon[35803]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:35.873 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T09:38:35.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:35 smithi136 ceph-mon[34840]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:36.129 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:36.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:36 smithi042 ceph-mon[31223]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:36.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:36 smithi042 ceph-mon[31223]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:36.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.616+0000 7ffada089640 1 -- 172.21.15.42:0/1125231030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffad4104fd0 msgr2=0x7ffad41073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:36.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.616+0000 7ffada089640 1 --2- 172.21.15.42:0/1125231030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffad4104fd0 0x7ffad41073c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009900 tx=0x7ffabc02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.616+0000 7ffada089640 1 -- 172.21.15.42:0/1125231030 shutdown_connections 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.616+0000 7ffada089640 1 --2- 172.21.15.42:0/1125231030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffad4107900 0x7ffad4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.616+0000 7ffada089640 1 --2- 172.21.15.42:0/1125231030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffad4104fd0 0x7ffad41073c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.616+0000 7ffada089640 1 --2- 172.21.15.42:0/1125231030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffad41026a0 0x7ffad4104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.616+0000 7ffada089640 1 -- 172.21.15.42:0/1125231030 >> 172.21.15.42:0/1125231030 conn(0x7ffad40fc2a0 msgr2=0x7ffad40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.616+0000 7ffada089640 1 -- 172.21.15.42:0/1125231030 shutdown_connections 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.616+0000 7ffada089640 1 -- 172.21.15.42:0/1125231030 wait complete. 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.616+0000 7ffada089640 1 Processor -- start 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffada089640 1 -- start start 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffada089640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffad41026a0 0x7ffad4197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffada089640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffad4104fd0 0x7ffad41984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffada089640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffad4107900 0x7ffad419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffada089640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffad410d8a0 con 0x7ffad41026a0 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffada089640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffad410d720 con 0x7ffad4104fd0 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffada089640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffad410da20 con 0x7ffad4107900 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffad41026a0 0x7ffad4197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffad41026a0 0x7ffad4197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36920/0 (socket says 172.21.15.42:36920) 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad37fe640 1 -- 172.21.15.42:0/882499564 learned_addr learned my addr 172.21.15.42:0/882499564 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffacbfff640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffad4104fd0 0x7ffad41984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad3fff640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffad4107900 0x7ffad419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad37fe640 1 -- 172.21.15.42:0/882499564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffad4107900 msgr2=0x7ffad419f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad37fe640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffad4107900 0x7ffad419f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad37fe640 1 -- 172.21.15.42:0/882499564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffad4104fd0 msgr2=0x7ffad41984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad37fe640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffad4104fd0 0x7ffad41984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad37fe640 1 -- 172.21.15.42:0/882499564 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad419fbe0 con 0x7ffad41026a0 2024-09-19T09:38:36.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffacbfff640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffad4104fd0 0x7ffad41984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:36.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad3fff640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffad4107900 0x7ffad419f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:36.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.617+0000 7ffad37fe640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffad41026a0 0x7ffad4197fb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffac400c970 tx=0x7ffac400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:36.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.618+0000 7ffad17fa640 1 -- 172.21.15.42:0/882499564 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4007bb0 con 0x7ffad41026a0 2024-09-19T09:38:36.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.618+0000 7ffad17fa640 1 -- 172.21.15.42:0/882499564 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffac4007d50 con 0x7ffad41026a0 2024-09-19T09:38:36.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.618+0000 7ffada089640 1 -- 172.21.15.42:0/882499564 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad419fed0 con 0x7ffad41026a0 2024-09-19T09:38:36.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.618+0000 7ffad17fa640 1 -- 172.21.15.42:0/882499564 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac400f450 con 0x7ffad41026a0 2024-09-19T09:38:36.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.618+0000 7ffada089640 1 -- 172.21.15.42:0/882499564 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad41a0320 con 0x7ffad41026a0 2024-09-19T09:38:36.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.619+0000 7ffada089640 1 -- 172.21.15.42:0/882499564 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad40fdd90 con 0x7ffad41026a0 2024-09-19T09:38:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.620+0000 7ffad17fa640 1 -- 172.21.15.42:0/882499564 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffac4004fa0 con 0x7ffad41026a0 2024-09-19T09:38:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.621+0000 7ffad17fa640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffac00a3380 0x7ffac00a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.621+0000 7ffacbfff640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffac00a3380 0x7ffac00a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.621+0000 7ffad17fa640 1 -- 172.21.15.42:0/882499564 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ffac40cfca0 con 0x7ffad41026a0 2024-09-19T09:38:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.621+0000 7ffacbfff640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffac00a3380 0x7ffac00a5840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffabc006010 tx=0x7ffabc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:36.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.624+0000 7ffad17fa640 1 -- 172.21.15.42:0/882499564 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffac4014030 con 0x7ffad41026a0 2024-09-19T09:38:36.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.806+0000 7ffada089640 1 -- 172.21.15.42:0/882499564 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ffad4062630 con 0x7ffac00a3380 2024-09-19T09:38:36.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.808+0000 7ffad17fa640 1 -- 172.21.15.42:0/882499564 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7ffad4062630 con 0x7ffac00a3380 2024-09-19T09:38:36.809 INFO:teuthology.orchestra.run.smithi042.stdout:HOST ADDR LABELS STATUS 2024-09-19T09:38:36.810 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 172.21.15.42 2024-09-19T09:38:36.810 INFO:teuthology.orchestra.run.smithi042.stdout:smithi136 172.21.15.136 2024-09-19T09:38:36.810 INFO:teuthology.orchestra.run.smithi042.stdout:smithi171 172.21.15.171 2024-09-19T09:38:36.810 INFO:teuthology.orchestra.run.smithi042.stdout:3 hosts in cluster 2024-09-19T09:38:36.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 -- 172.21.15.42:0/882499564 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffac00a3380 msgr2=0x7ffac00a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffac00a3380 0x7ffac00a5840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffabc006010 tx=0x7ffabc000bc0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 -- 172.21.15.42:0/882499564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffad41026a0 msgr2=0x7ffad4197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffad41026a0 0x7ffad4197fb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffac400c970 tx=0x7ffac400ce30 comp rx=0 tx=0).stop 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 -- 172.21.15.42:0/882499564 shutdown_connections 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffac00a3380 0x7ffac00a5840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffad4107900 0x7ffad419f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffad4104fd0 0x7ffad41984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 --2- 172.21.15.42:0/882499564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffad41026a0 0x7ffad4197fb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 -- 172.21.15.42:0/882499564 >> 172.21.15.42:0/882499564 conn(0x7ffad40fc2a0 msgr2=0x7ffad4103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 -- 172.21.15.42:0/882499564 shutdown_connections 2024-09-19T09:38:36.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:36.810+0000 7ffada089640 1 -- 172.21.15.42:0/882499564 wait complete. 2024-09-19T09:38:36.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:36 smithi171 ceph-mon[35803]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:36.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:36 smithi171 ceph-mon[35803]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:36.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:36 smithi136 ceph-mon[34840]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:36.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:36 smithi136 ceph-mon[34840]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:37.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T09:38:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:38.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.211+0000 7f550bef8640 1 -- 172.21.15.42:0/2200570508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5504102e00 msgr2=0x7f5504103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:38.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.211+0000 7f550bef8640 1 --2- 172.21.15.42:0/2200570508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5504102e00 0x7f5504103280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009900 tx=0x7f54f402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.211+0000 7f550bef8640 1 -- 172.21.15.42:0/2200570508 shutdown_connections 2024-09-19T09:38:38.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.211+0000 7f550bef8640 1 --2- 172.21.15.42:0/2200570508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55041037c0 0x7f550410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.211+0000 7f550bef8640 1 --2- 172.21.15.42:0/2200570508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5504102e00 0x7f5504103280 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.211+0000 7f550bef8640 1 --2- 172.21.15.42:0/2200570508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5504101c00 0x7f5504102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.211+0000 7f550bef8640 1 -- 172.21.15.42:0/2200570508 >> 172.21.15.42:0/2200570508 conn(0x7f55040fd390 msgr2=0x7f55040ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:38.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.211+0000 7f550bef8640 1 -- 172.21.15.42:0/2200570508 shutdown_connections 2024-09-19T09:38:38.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.211+0000 7f550bef8640 1 -- 172.21.15.42:0/2200570508 wait complete. 2024-09-19T09:38:38.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f550bef8640 1 Processor -- start 2024-09-19T09:38:38.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f550bef8640 1 -- start start 2024-09-19T09:38:38.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f550bef8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5504101c00 0x7f550419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:38.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f550bef8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5504102e00 0x7f550419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:38.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f550bef8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55041037c0 0x7f55041a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:38.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f550bef8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f550410d860 con 0x7f5504101c00 2024-09-19T09:38:38.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f550bef8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f550410d6e0 con 0x7f55041037c0 2024-09-19T09:38:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f550bef8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f550410d9e0 con 0x7f5504102e00 2024-09-19T09:38:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f5509c94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5504101c00 0x7f550419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f5509c94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5504101c00 0x7f550419a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36940/0 (socket says 172.21.15.42:36940) 2024-09-19T09:38:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f5509c94640 1 -- 172.21.15.42:0/3051554269 learned_addr learned my addr 172.21.15.42:0/3051554269 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f5509c94640 1 -- 172.21.15.42:0/3051554269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5504102e00 msgr2=0x7f550419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:38.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f5509493640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5504102e00 0x7f550419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f550a495640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55041037c0 0x7f55041a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.212+0000 7f5509c94640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5504102e00 0x7f550419a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.213+0000 7f5509c94640 1 -- 172.21.15.42:0/3051554269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55041037c0 msgr2=0x7f55041a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.213+0000 7f5509c94640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55041037c0 0x7f55041a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.213+0000 7f5509c94640 1 -- 172.21.15.42:0/3051554269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55041a1c50 con 0x7f5504101c00 2024-09-19T09:38:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.213+0000 7f550a495640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55041037c0 0x7f55041a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.213+0000 7f5509c94640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5504101c00 0x7f550419a020 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f550000c970 tx=0x7f550000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.213+0000 7f54faffd640 1 -- 172.21.15.42:0/3051554269 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500007c10 con 0x7f5504101c00 2024-09-19T09:38:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.213+0000 7f54faffd640 1 -- 172.21.15.42:0/3051554269 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5500007db0 con 0x7f5504101c00 2024-09-19T09:38:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.213+0000 7f550bef8640 1 -- 172.21.15.42:0/3051554269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55041a1f40 con 0x7f5504101c00 2024-09-19T09:38:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.213+0000 7f54faffd640 1 -- 172.21.15.42:0/3051554269 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550000f940 con 0x7f5504101c00 2024-09-19T09:38:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.213+0000 7f550bef8640 1 -- 172.21.15.42:0/3051554269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55041a2390 con 0x7f5504101c00 2024-09-19T09:38:38.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.214+0000 7f550bef8640 1 -- 172.21.15.42:0/3051554269 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55041a2650 con 0x7f5504101c00 2024-09-19T09:38:38.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.215+0000 7f54faffd640 1 -- 172.21.15.42:0/3051554269 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f550000fae0 con 0x7f5504101c00 2024-09-19T09:38:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.216+0000 7f54faffd640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f54f00a3300 0x7f54f00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.216+0000 7f5509493640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f54f00a3300 0x7f54f00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.216+0000 7f54faffd640 1 -- 172.21.15.42:0/3051554269 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f55000cfe90 con 0x7f5504101c00 2024-09-19T09:38:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.216+0000 7f5509493640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f54f00a3300 0x7f54f00a57c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f54f4031610 tx=0x7f54f4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.220+0000 7f54faffd640 1 -- 172.21.15.42:0/3051554269 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f550009cac0 con 0x7f5504101c00 2024-09-19T09:38:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.401+0000 7f550bef8640 1 -- 172.21.15.42:0/3051554269 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f5504075b40 con 0x7f54f00a3300 2024-09-19T09:38:38.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.403+0000 7f54faffd640 1 -- 172.21.15.42:0/3051554269 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f5504075b40 con 0x7f54f00a3300 2024-09-19T09:38:38.405 INFO:teuthology.orchestra.run.smithi042.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T09:38:38.405 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130021480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T09:38:38.405 INFO:teuthology.orchestra.run.smithi042.stdout:smithi136 /dev/nvme0n1 ssd INTEL_SSDPEDMX020T4_CVPD514100122P0SGN 1863G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:38:38.405 INFO:teuthology.orchestra.run.smithi042.stdout:smithi171 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233001S400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 -- 172.21.15.42:0/3051554269 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f54f00a3300 msgr2=0x7f54f00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f54f00a3300 0x7f54f00a57c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f54f4031610 tx=0x7f54f4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 -- 172.21.15.42:0/3051554269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5504101c00 msgr2=0x7f550419a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5504101c00 0x7f550419a020 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f550000c970 tx=0x7f550000ce30 comp rx=0 tx=0).stop 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 -- 172.21.15.42:0/3051554269 shutdown_connections 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f54f00a3300 0x7f54f00a57c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55041037c0 0x7f55041a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5504102e00 0x7f550419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 --2- 172.21.15.42:0/3051554269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5504101c00 0x7f550419a020 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 -- 172.21.15.42:0/3051554269 >> 172.21.15.42:0/3051554269 conn(0x7f55040fd390 msgr2=0x7f5504074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:38.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 -- 172.21.15.42:0/3051554269 shutdown_connections 2024-09-19T09:38:38.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:38.405+0000 7f550bef8640 1 -- 172.21.15.42:0/3051554269 wait complete. 2024-09-19T09:38:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:38 smithi042 ceph-mon[31223]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:38 smithi042 ceph-mon[31223]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:38 smithi171 ceph-mon[35803]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:38.962 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:38 smithi171 ceph-mon[35803]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:38.963 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:38 smithi136 ceph-mon[34840]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:38.964 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:38 smithi136 ceph-mon[34840]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:39.072 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:38:39.084 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-09-19T09:38:39.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:38:39.340 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:39.773 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:39 smithi042 ceph-mon[31223]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.776+0000 7f321c3e9640 1 -- 172.21.15.42:0/732560269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3214100ad0 msgr2=0x7f3214100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.776+0000 7f321c3e9640 1 --2- 172.21.15.42:0/732560269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3214100ad0 0x7f3214100ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3210009900 tx=0x7f321002a410 comp rx=0 tx=0).stop 2024-09-19T09:38:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 -- 172.21.15.42:0/732560269 shutdown_connections 2024-09-19T09:38:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 --2- 172.21.15.42:0/732560269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214102690 0x7f3214108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 --2- 172.21.15.42:0/732560269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3214101cd0 0x7f3214102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 --2- 172.21.15.42:0/732560269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3214100ad0 0x7f3214100ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 -- 172.21.15.42:0/732560269 >> 172.21.15.42:0/732560269 conn(0x7f32140fc280 msgr2=0x7f32140fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 -- 172.21.15.42:0/732560269 shutdown_connections 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 -- 172.21.15.42:0/732560269 wait complete. 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 Processor -- start 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 -- start start 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214100ad0 0x7f3214104ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.777+0000 7f321c3e9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3214101cd0 0x7f32141031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f321c3e9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3214102690 0x7f3214103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f321c3e9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f321410c730 con 0x7f3214101cd0 2024-09-19T09:38:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f321c3e9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f321410c5b0 con 0x7f3214102690 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f321c3e9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f321410c8b0 con 0x7f3214100ad0 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f3219984640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3214101cd0 0x7f32141031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f3219984640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3214101cd0 0x7f32141031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36964/0 (socket says 172.21.15.42:36964) 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f3219984640 1 -- 172.21.15.42:0/2854907475 learned_addr learned my addr 172.21.15.42:0/2854907475 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f321a185640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214100ad0 0x7f3214104ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f321a986640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3214102690 0x7f3214103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f3219984640 1 -- 172.21.15.42:0/2854907475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214100ad0 msgr2=0x7f3214104ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f3219984640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214100ad0 0x7f3214104ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f3219984640 1 -- 172.21.15.42:0/2854907475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3214102690 msgr2=0x7f3214103730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f3219984640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3214102690 0x7f3214103730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f3219984640 1 -- 172.21.15.42:0/2854907475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3214103ff0 con 0x7f3214101cd0 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f321a185640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214100ad0 0x7f3214104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f321a986640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3214102690 0x7f3214103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f3219984640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3214101cd0 0x7f32141031f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f320400c920 tx=0x7f320400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f320b7fe640 1 -- 172.21.15.42:0/2854907475 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3204007c70 con 0x7f3214101cd0 2024-09-19T09:38:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f321c3e9640 1 -- 172.21.15.42:0/2854907475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32141a2060 con 0x7f3214101cd0 2024-09-19T09:38:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f320b7fe640 1 -- 172.21.15.42:0/2854907475 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3204007e10 con 0x7f3214101cd0 2024-09-19T09:38:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.778+0000 7f320b7fe640 1 -- 172.21.15.42:0/2854907475 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3204018890 con 0x7f3214101cd0 2024-09-19T09:38:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.779+0000 7f321c3e9640 1 -- 172.21.15.42:0/2854907475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32141a25c0 con 0x7f3214101cd0 2024-09-19T09:38:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.779+0000 7f321c3e9640 1 -- 172.21.15.42:0/2854907475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32141a2850 con 0x7f3214101cd0 2024-09-19T09:38:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.781+0000 7f320b7fe640 1 -- 172.21.15.42:0/2854907475 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3204018a70 con 0x7f3214101cd0 2024-09-19T09:38:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.781+0000 7f320b7fe640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f32000a32d0 0x7f32000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.781+0000 7f321a185640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f32000a32d0 0x7f32000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.781+0000 7f320b7fe640 1 -- 172.21.15.42:0/2854907475 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f32040cfc90 con 0x7f3214101cd0 2024-09-19T09:38:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.782+0000 7f321a185640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f32000a32d0 0x7f32000a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3210006010 tx=0x7f3210000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.785+0000 7f320b7fe640 1 -- 172.21.15.42:0/2854907475 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f32040d5020 con 0x7f3214101cd0 2024-09-19T09:38:39.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:39 smithi171 ceph-mon[35803]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:39 smithi136 ceph-mon[34840]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:39.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.997+0000 7f321c3e9640 1 -- 172.21.15.42:0/2854907475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f32141a2a20 con 0x7f3214101cd0 2024-09-19T09:38:39.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:39.998+0000 7f320b7fe640 1 -- 172.21.15.42:0/2854907475 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3132 (secure 0 0 0) 0x7f3204014030 con 0x7f3214101cd0 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout:e27 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout:btime 2024-09-19T09:37:23:003045+0000 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout:legacy client fscid: 1 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout:fs_name cephfs 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 27 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:38:40.000 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-09-19T09:37:11.524843+0000 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:modified 2024-09-19T09:37:23.003018+0000 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:tableserver 0 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:root 0 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:session_timeout 300 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:session_autoclose 300 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:max_file_size 1099511627776 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:max_xattr_size 65536 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:required_client_features {} 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:last_failure 0 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:last_failure_osd_epoch 0 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:max_mds 5 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:in 0,1,2,3,4 2024-09-19T09:38:40.001 INFO:teuthology.orchestra.run.smithi042.stdout:up {0=24506,1=24478,2=24473,3=24466,4=24454} 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:failed 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:damaged 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:stopped 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:data_pools [3] 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:metadata_pool 2 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:inline_data disabled 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:balancer 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:bal_rank_mask -1 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:standby_count_wanted 0 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:qdb_cluster leader: 24506 members: 24478,24473,24466,24506,24454 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b{0:24506} state up:active seq 4 addr [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.e{0:24449} state up:standby-replay seq 1 addr [v2:172.21.15.136:6834/3800275147,v1:172.21.15.136:6835/3800275147] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.i{1:24478} state up:active seq 8 addr [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.002 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.k{1:24428} state up:standby-replay seq 1 addr [v2:172.21.15.136:6832/1364803362,v1:172.21.15.136:6833/1364803362] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.h{2:24473} state up:active seq 9 addr [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.l{2:24427} state up:standby-replay seq 1 addr [v2:172.21.15.171:6832/1004485926,v1:172.21.15.171:6833/1004485926] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c{3:24466} state up:active seq 10 addr [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a{3:14628} state up:standby-replay seq 1 addr [v2:172.21.15.42:6840/649947071,v1:172.21.15.42:6841/649947071] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.f{4:24454} state up:active seq 11 addr [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.g{4:14622} state up:standby-replay seq 1 addr [v2:172.21.15.42:6838/3152711275,v1:172.21.15.42:6839/3152711275] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout:Standby daemons: 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.j{-1:14562} state up:standby seq 1 addr [v2:172.21.15.42:6834/3597931561,v1:172.21.15.42:6835/3597931561] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.003 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d{-1:14574} state up:standby seq 1 addr [v2:172.21.15.42:6836/916691394,v1:172.21.15.42:6837/916691394] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:38:40.004 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 27 2024-09-19T09:38:40.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 -- 172.21.15.42:0/2854907475 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f32000a32d0 msgr2=0x7f32000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f32000a32d0 0x7f32000a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3210006010 tx=0x7f3210000bc0 comp rx=0 tx=0).stop 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 -- 172.21.15.42:0/2854907475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3214101cd0 msgr2=0x7f32141031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3214101cd0 0x7f32141031f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f320400c920 tx=0x7f320400cde0 comp rx=0 tx=0).stop 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 -- 172.21.15.42:0/2854907475 shutdown_connections 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f32000a32d0 0x7f32000a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3214102690 0x7f3214103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3214101cd0 0x7f32141031f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 --2- 172.21.15.42:0/2854907475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214100ad0 0x7f3214104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 -- 172.21.15.42:0/2854907475 >> 172.21.15.42:0/2854907475 conn(0x7f32140fc280 msgr2=0x7f3214069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 -- 172.21.15.42:0/2854907475 shutdown_connections 2024-09-19T09:38:40.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:40.000+0000 7f321c3e9640 1 -- 172.21.15.42:0/2854907475 wait complete. 2024-09-19T09:38:40.601 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:40 smithi042 ceph-mon[31223]: pgmap v317: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:40.601 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:40 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2854907475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:38:40.630 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T09:38:40.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:40 smithi171 ceph-mon[35803]: pgmap v317: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:40.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:40 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2854907475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:38:40.884 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:40 smithi136 ceph-mon[34840]: pgmap v317: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:40 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2854907475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:38:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.293+0000 7f6d48e1e640 1 -- 172.21.15.42:0/1904662167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d44107900 msgr2=0x7f6d44109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.293+0000 7f6d48e1e640 1 --2- 172.21.15.42:0/1904662167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d44107900 0x7f6d44109d50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009ca0 tx=0x7f6d3c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.293+0000 7f6d48e1e640 1 -- 172.21.15.42:0/1904662167 shutdown_connections 2024-09-19T09:38:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.293+0000 7f6d48e1e640 1 --2- 172.21.15.42:0/1904662167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d44107900 0x7f6d44109d50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.293+0000 7f6d48e1e640 1 --2- 172.21.15.42:0/1904662167 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d44104fd0 0x7f6d441073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.293+0000 7f6d48e1e640 1 --2- 172.21.15.42:0/1904662167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d441026a0 0x7f6d44104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.293+0000 7f6d48e1e640 1 -- 172.21.15.42:0/1904662167 >> 172.21.15.42:0/1904662167 conn(0x7f6d440fc2a0 msgr2=0x7f6d440fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.293+0000 7f6d48e1e640 1 -- 172.21.15.42:0/1904662167 shutdown_connections 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.293+0000 7f6d48e1e640 1 -- 172.21.15.42:0/1904662167 wait complete. 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d48e1e640 1 Processor -- start 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d48e1e640 1 -- start start 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d48e1e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d441026a0 0x7f6d4419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d48e1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d44104fd0 0x7f6d4419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d48e1e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d44107900 0x7f6d441a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d48e1e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4410d910 con 0x7f6d44107900 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d48e1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4410d790 con 0x7f6d44104fd0 2024-09-19T09:38:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d48e1e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4410da90 con 0x7f6d441026a0 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d42d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d44107900 0x7f6d441a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d42d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d44107900 0x7f6d441a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42060/0 (socket says 172.21.15.42:42060) 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d42d9d640 1 -- 172.21.15.42:0/2548408195 learned_addr learned my addr 172.21.15.42:0/2548408195 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d4259c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d441026a0 0x7f6d4419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d41d9b640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d44104fd0 0x7f6d4419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d42d9d640 1 -- 172.21.15.42:0/2548408195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d441026a0 msgr2=0x7f6d4419a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d42d9d640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d441026a0 0x7f6d4419a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d42d9d640 1 -- 172.21.15.42:0/2548408195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d44104fd0 msgr2=0x7f6d4419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d42d9d640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d44104fd0 0x7f6d4419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.294+0000 7f6d42d9d640 1 -- 172.21.15.42:0/2548408195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d441a1d90 con 0x7f6d44107900 2024-09-19T09:38:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.295+0000 7f6d42d9d640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d44107900 0x7f6d441a1720 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c005e30 tx=0x7f6d3c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:41.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.295+0000 7f6d3b7fe640 1 -- 172.21.15.42:0/2548408195 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c003c30 con 0x7f6d44107900 2024-09-19T09:38:41.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.295+0000 7f6d48e1e640 1 -- 172.21.15.42:0/2548408195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d441a2020 con 0x7f6d44107900 2024-09-19T09:38:41.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.295+0000 7f6d3b7fe640 1 -- 172.21.15.42:0/2548408195 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d3c003dd0 con 0x7f6d44107900 2024-09-19T09:38:41.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.295+0000 7f6d3b7fe640 1 -- 172.21.15.42:0/2548408195 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c02fde0 con 0x7f6d44107900 2024-09-19T09:38:41.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.295+0000 7f6d48e1e640 1 -- 172.21.15.42:0/2548408195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d441a2630 con 0x7f6d44107900 2024-09-19T09:38:41.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.296+0000 7f6d48e1e640 1 -- 172.21.15.42:0/2548408195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d441093f0 con 0x7f6d44107900 2024-09-19T09:38:41.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.297+0000 7f6d3b7fe640 1 -- 172.21.15.42:0/2548408195 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6d3c004050 con 0x7f6d44107900 2024-09-19T09:38:41.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.298+0000 7f6d3b7fe640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6d300a3300 0x7f6d300a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.298+0000 7f6d4259c640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6d300a3300 0x7f6d300a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.298+0000 7f6d3b7fe640 1 -- 172.21.15.42:0/2548408195 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f6d3c0f0dc0 con 0x7f6d44107900 2024-09-19T09:38:41.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.299+0000 7f6d4259c640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6d300a3300 0x7f6d300a57c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00bbe0 tx=0x7f6d2c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:41.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.302+0000 7f6d3b7fe640 1 -- 172.21.15.42:0/2548408195 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d3c0bda70 con 0x7f6d44107900 2024-09-19T09:38:41.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.480+0000 7f6d48e1e640 1 -- 172.21.15.42:0/2548408195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f6d44062df0 con 0x7f6d44107900 2024-09-19T09:38:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.482+0000 7f6d3b7fe640 1 -- 172.21.15.42:0/2548408195 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v81) ==== 56+0+5345 (secure 0 0 0) 0x7f6d3c0bd370 con 0x7f6d44107900 2024-09-19T09:38:41.483 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 81 2024-09-19T09:38:41.483 INFO:teuthology.orchestra.run.smithi042.stdout:fsid 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-09-19T09:29:39.579012+0000 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:modified 2024-09-19T09:37:28.010101+0000 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:crush_version 26 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:full_ratio 0.95 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:backfillfull_ratio 0.9 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:nearfull_ratio 0.85 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:require_min_compat_client luminous 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:min_compat_client luminous 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:require_osd_release squid 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:stretch_mode_enabled false 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T09:38:41.484 INFO:teuthology.orchestra.run.smithi042.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:max_osd 12 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 up in weight 1 up_from 8 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6802/2566861265,v1:172.21.15.42:6803/2566861265] [v2:172.21.15.42:6804/2566861265,v1:172.21.15.42:6805/2566861265] exists,up 706a099a-50d4-4bf6-aeec-397188b1607e 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 up in weight 1 up_from 12 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/2317267026,v1:172.21.15.136:6801/2317267026] [v2:172.21.15.136:6802/2317267026,v1:172.21.15.136:6803/2317267026] exists,up 675db66c-0434-4791-bb50-8c598eefd010 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 up in weight 1 up_from 16 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6800/1649199499,v1:172.21.15.171:6801/1649199499] [v2:172.21.15.171:6802/1649199499,v1:172.21.15.171:6803/1649199499] exists,up 2ca55d67-6869-44ad-b68f-fee2caa72f44 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 up in weight 1 up_from 22 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6810/3782422248,v1:172.21.15.42:6811/3782422248] [v2:172.21.15.42:6812/3782422248,v1:172.21.15.42:6813/3782422248] exists,up 31859291-9497-400b-9dec-5ce253a06cda 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 up in weight 1 up_from 29 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6808/1987544741,v1:172.21.15.136:6809/1987544741] [v2:172.21.15.136:6810/1987544741,v1:172.21.15.136:6811/1987544741] exists,up f45ebe54-a9d3-4af4-bf11-99bc0038141d 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 up in weight 1 up_from 34 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6808/2964439242,v1:172.21.15.171:6809/2964439242] [v2:172.21.15.171:6810/2964439242,v1:172.21.15.171:6811/2964439242] exists,up 852fe127-e1d5-4a0e-9f0f-358680473508 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 up in weight 1 up_from 41 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6818/1896771810,v1:172.21.15.42:6819/1896771810] [v2:172.21.15.42:6820/1896771810,v1:172.21.15.42:6821/1896771810] exists,up cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 up in weight 1 up_from 46 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6816/1586327351,v1:172.21.15.136:6817/1586327351] [v2:172.21.15.136:6818/1586327351,v1:172.21.15.136:6819/1586327351] exists,up 9db03bdf-bab4-45b9-98af-9a827cd5f52a 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:osd.8 up in weight 1 up_from 53 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6816/4167633089,v1:172.21.15.171:6817/4167633089] [v2:172.21.15.171:6818/4167633089,v1:172.21.15.171:6819/4167633089] exists,up 1d24baff-7b48-42e7-8de3-c63bae1df94d 2024-09-19T09:38:41.485 INFO:teuthology.orchestra.run.smithi042.stdout:osd.9 up in weight 1 up_from 61 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6826/1760632261,v1:172.21.15.42:6827/1760632261] [v2:172.21.15.42:6828/1760632261,v1:172.21.15.42:6829/1760632261] exists,up 1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:osd.10 up in weight 1 up_from 66 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6824/3459426707,v1:172.21.15.136:6825/3459426707] [v2:172.21.15.136:6826/3459426707,v1:172.21.15.136:6827/3459426707] exists,up 39e6662d-70d8-47a8-8cce-822de973672e 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:osd.11 up in weight 1 up_from 73 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6824/2813410869,v1:172.21.15.171:6825/2813410869] [v2:172.21.15.171:6826/2813410869,v1:172.21.15.171:6827/2813410869] exists,up bfbb71e1-73ac-4766-9b71-c81701b94a58 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.0 [7,11] 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.b [8,11] 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.c [2,4] 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.14 [2,4] 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.1f [8,1] 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.0 [5,9] 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.5 [3,9] 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.14 [4,6] 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.17 [4,8] 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.3c [4,9] 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/1318707645 expires 2024-09-20T09:30:26.412318+0000 2024-09-19T09:38:41.486 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/3819076248 expires 2024-09-20T09:30:26.412318+0000 2024-09-19T09:38:41.487 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6801/203737163 expires 2024-09-20T09:30:26.412318+0000 2024-09-19T09:38:41.487 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/4286810038 expires 2024-09-20T09:30:26.412318+0000 2024-09-19T09:38:41.487 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6800/203737163 expires 2024-09-20T09:30:26.412318+0000 2024-09-19T09:38:41.487 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/2538224361 expires 2024-09-20T09:30:02.111922+0000 2024-09-19T09:38:41.487 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6801/2557927084 expires 2024-09-20T09:30:02.111922+0000 2024-09-19T09:38:41.487 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6800/2557927084 expires 2024-09-20T09:30:02.111922+0000 2024-09-19T09:38:41.487 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/3197478490 expires 2024-09-20T09:30:02.111922+0000 2024-09-19T09:38:41.487 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/4227587843 expires 2024-09-20T09:30:02.111922+0000 2024-09-19T09:38:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 -- 172.21.15.42:0/2548408195 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6d300a3300 msgr2=0x7f6d300a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6d300a3300 0x7f6d300a57c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00bbe0 tx=0x7f6d2c00b390 comp rx=0 tx=0).stop 2024-09-19T09:38:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 -- 172.21.15.42:0/2548408195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d44107900 msgr2=0x7f6d441a1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d44107900 0x7f6d441a1720 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c005e30 tx=0x7f6d3c031ee0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 -- 172.21.15.42:0/2548408195 shutdown_connections 2024-09-19T09:38:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f6d300a3300 0x7f6d300a57c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d44107900 0x7f6d441a1720 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d44104fd0 0x7f6d4419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 --2- 172.21.15.42:0/2548408195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d441026a0 0x7f6d4419a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:41.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 -- 172.21.15.42:0/2548408195 >> 172.21.15.42:0/2548408195 conn(0x7f6d440fc2a0 msgr2=0x7f6d44101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:41.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 -- 172.21.15.42:0/2548408195 shutdown_connections 2024-09-19T09:38:41.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:41.484+0000 7f6d48e1e640 1 -- 172.21.15.42:0/2548408195 wait complete. 2024-09-19T09:38:41.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:41 smithi042 ceph-mon[31223]: pgmap v318: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:41.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:41 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2548408195' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:38:41.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:41 smithi171 ceph-mon[35803]: pgmap v318: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:41.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:41 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2548408195' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:38:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:41 smithi136 ceph-mon[34840]: pgmap v318: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:41 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2548408195' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:38:42.126 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T09:38:42.144 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:42.405 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 -- 172.21.15.42:0/1387275565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2250103660 msgr2=0x7f225010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 --2- 172.21.15.42:0/1387275565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2250103660 0x7f225010bb50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2244009900 tx=0x7f224402a480 comp rx=0 tx=0).stop 2024-09-19T09:38:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 -- 172.21.15.42:0/1387275565 shutdown_connections 2024-09-19T09:38:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 --2- 172.21.15.42:0/1387275565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f225010c170 0x7f225010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 --2- 172.21.15.42:0/1387275565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2250103660 0x7f225010bb50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 --2- 172.21.15.42:0/1387275565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2250102d40 0x7f2250103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 -- 172.21.15.42:0/1387275565 >> 172.21.15.42:0/1387275565 conn(0x7f22500fc7a0 msgr2=0x7f22500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 -- 172.21.15.42:0/1387275565 shutdown_connections 2024-09-19T09:38:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 -- 172.21.15.42:0/1387275565 wait complete. 2024-09-19T09:38:42.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 Processor -- start 2024-09-19T09:38:42.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.835+0000 7f225606d640 1 -- start start 2024-09-19T09:38:42.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f225606d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2250102d40 0x7f2250198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f225606d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2250103660 0x7f22501989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f225606d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f225010c170 0x7f225019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f225606d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2250111f70 con 0x7f225010c170 2024-09-19T09:38:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f225606d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2250111df0 con 0x7f2250103660 2024-09-19T09:38:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f225606d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22501120f0 con 0x7f2250102d40 2024-09-19T09:38:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f224ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f225010c170 0x7f225019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f224ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f225010c170 0x7f225019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42076/0 (socket says 172.21.15.42:42076) 2024-09-19T09:38:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f224ffff640 1 -- 172.21.15.42:0/3097213816 learned_addr learned my addr 172.21.15.42:0/3097213816 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f224f7fe640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2250102d40 0x7f2250198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f224effd640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2250103660 0x7f22501989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f224ffff640 1 -- 172.21.15.42:0/3097213816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2250102d40 msgr2=0x7f2250198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f224ffff640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2250102d40 0x7f2250198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f224ffff640 1 -- 172.21.15.42:0/3097213816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2250103660 msgr2=0x7f22501989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f224ffff640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2250103660 0x7f22501989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.836+0000 7f224ffff640 1 -- 172.21.15.42:0/3097213816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225019d420 con 0x7f225010c170 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.837+0000 7f224ffff640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f225010c170 0x7f225019cd40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f224800eaa0 tx=0x7f224800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.837+0000 7f224cff9640 1 -- 172.21.15.42:0/3097213816 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224800cdb0 con 0x7f225010c170 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.837+0000 7f224cff9640 1 -- 172.21.15.42:0/3097213816 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2248005020 con 0x7f225010c170 2024-09-19T09:38:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.837+0000 7f225606d640 1 -- 172.21.15.42:0/3097213816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225019d710 con 0x7f225010c170 2024-09-19T09:38:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.837+0000 7f224cff9640 1 -- 172.21.15.42:0/3097213816 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22480116b0 con 0x7f225010c170 2024-09-19T09:38:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.837+0000 7f225606d640 1 -- 172.21.15.42:0/3097213816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22501a4ff0 con 0x7f225010c170 2024-09-19T09:38:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.838+0000 7f225606d640 1 -- 172.21.15.42:0/3097213816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2250103120 con 0x7f225010c170 2024-09-19T09:38:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.841+0000 7f224cff9640 1 -- 172.21.15.42:0/3097213816 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2248005560 con 0x7f225010c170 2024-09-19T09:38:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.841+0000 7f224cff9640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22380a3350 0x7f22380a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.841+0000 7f224f7fe640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22380a3350 0x7f22380a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.841+0000 7f224cff9640 1 -- 172.21.15.42:0/3097213816 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f22480cff10 con 0x7f225010c170 2024-09-19T09:38:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.841+0000 7f224f7fe640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22380a3350 0x7f22380a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f22400058c0 tx=0x7f224000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:42.845+0000 7f224cff9640 1 -- 172.21.15.42:0/3097213816 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2248016030 con 0x7f225010c170 2024-09-19T09:38:43.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.054+0000 7f225606d640 1 -- 172.21.15.42:0/3097213816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f225002d7c0 con 0x7f225010c170 2024-09-19T09:38:43.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.055+0000 7f224cff9640 1 -- 172.21.15.42:0/3097213816 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7f224809c4e0 con 0x7f225010c170 2024-09-19T09:38:43.058 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:43.058 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":27,"btime":"2024-09-19T09:37:23:003045+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:37:23.003018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:38:43.058 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 27 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 -- 172.21.15.42:0/3097213816 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22380a3350 msgr2=0x7f22380a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22380a3350 0x7f22380a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f22400058c0 tx=0x7f224000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 -- 172.21.15.42:0/3097213816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f225010c170 msgr2=0x7f225019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f225010c170 0x7f225019cd40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f224800eaa0 tx=0x7f224800ef60 comp rx=0 tx=0).stop 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 -- 172.21.15.42:0/3097213816 shutdown_connections 2024-09-19T09:38:43.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22380a3350 0x7f22380a5810 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f225010c170 0x7f225019cd40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2250103660 0x7f22501989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 --2- 172.21.15.42:0/3097213816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2250102d40 0x7f2250198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 -- 172.21.15.42:0/3097213816 >> 172.21.15.42:0/3097213816 conn(0x7f22500fc7a0 msgr2=0x7f22500fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:43.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 -- 172.21.15.42:0/3097213816 shutdown_connections 2024-09-19T09:38:43.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:43.057+0000 7f225606d640 1 -- 172.21.15.42:0/3097213816 wait complete. 2024-09-19T09:38:43.708 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:43.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:43 smithi171 ceph-mon[35803]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:43.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:43 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3097213816' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:43 smithi136 ceph-mon[34840]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:43 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3097213816' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:43.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:43 smithi042 ceph-mon[31223]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:43.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:43 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3097213816' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:43.964 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:44.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.384+0000 7eff63348640 1 -- 172.21.15.42:0/4173738273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff5c101280 msgr2=0x7eff5c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.384+0000 7eff63348640 1 --2- 172.21.15.42:0/4173738273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff5c101280 0x7eff5c10df40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009900 tx=0x7eff4c02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.384+0000 7eff63348640 1 -- 172.21.15.42:0/4173738273 shutdown_connections 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.384+0000 7eff63348640 1 --2- 172.21.15.42:0/4173738273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff5c10e480 0x7eff5c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.384+0000 7eff63348640 1 --2- 172.21.15.42:0/4173738273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff5c101280 0x7eff5c10df40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.384+0000 7eff63348640 1 --2- 172.21.15.42:0/4173738273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff5c1008d0 0x7eff5c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.384+0000 7eff63348640 1 -- 172.21.15.42:0/4173738273 >> 172.21.15.42:0/4173738273 conn(0x7eff5c0fc7a0 msgr2=0x7eff5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.384+0000 7eff63348640 1 -- 172.21.15.42:0/4173738273 shutdown_connections 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.384+0000 7eff63348640 1 -- 172.21.15.42:0/4173738273 wait complete. 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.384+0000 7eff63348640 1 Processor -- start 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff63348640 1 -- start start 2024-09-19T09:38:44.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff63348640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff5c1008d0 0x7eff5c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff63348640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff5c101280 0x7eff5c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff63348640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff5c10e480 0x7eff5c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff63348640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c114190 con 0x7eff5c1008d0 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff63348640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c114010 con 0x7eff5c10e480 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff63348640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c114310 con 0x7eff5c101280 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff610e4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff5c1008d0 0x7eff5c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff610e4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff5c1008d0 0x7eff5c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42092/0 (socket says 172.21.15.42:42092) 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff610e4640 1 -- 172.21.15.42:0/3279655370 learned_addr learned my addr 172.21.15.42:0/3279655370 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff608e3640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff5c101280 0x7eff5c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff618e5640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff5c10e480 0x7eff5c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff610e4640 1 -- 172.21.15.42:0/3279655370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff5c101280 msgr2=0x7eff5c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff610e4640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff5c101280 0x7eff5c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff610e4640 1 -- 172.21.15.42:0/3279655370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff5c10e480 msgr2=0x7eff5c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff610e4640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff5c10e480 0x7eff5c19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff610e4640 1 -- 172.21.15.42:0/3279655370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5c19f5e0 con 0x7eff5c1008d0 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff608e3640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff5c101280 0x7eff5c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.385+0000 7eff610e4640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff5c1008d0 0x7eff5c19a630 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7eff5800d950 tx=0x7eff5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.386+0000 7eff527fc640 1 -- 172.21.15.42:0/3279655370 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58017070 con 0x7eff5c1008d0 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.386+0000 7eff527fc640 1 -- 172.21.15.42:0/3279655370 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff58009c30 con 0x7eff5c1008d0 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.386+0000 7eff63348640 1 -- 172.21.15.42:0/3279655370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5c19f8d0 con 0x7eff5c1008d0 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.386+0000 7eff527fc640 1 -- 172.21.15.42:0/3279655370 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5800f6b0 con 0x7eff5c1008d0 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.386+0000 7eff63348640 1 -- 172.21.15.42:0/3279655370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5c1a71b0 con 0x7eff5c1008d0 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.387+0000 7eff63348640 1 -- 172.21.15.42:0/3279655370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff5c100cb0 con 0x7eff5c1008d0 2024-09-19T09:38:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.388+0000 7eff527fc640 1 -- 172.21.15.42:0/3279655370 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7eff580109d0 con 0x7eff5c1008d0 2024-09-19T09:38:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.388+0000 7eff527fc640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7eff480a3350 0x7eff480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.389+0000 7eff608e3640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7eff480a3350 0x7eff480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.389+0000 7eff527fc640 1 -- 172.21.15.42:0/3279655370 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7eff580cf760 con 0x7eff5c1008d0 2024-09-19T09:38:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.389+0000 7eff608e3640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7eff480a3350 0x7eff480a5810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7eff5c10ecb0 tx=0x7eff4c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.393+0000 7eff527fc640 1 -- 172.21.15.42:0/3279655370 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7eff58009de0 con 0x7eff5c1008d0 2024-09-19T09:38:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.604+0000 7eff63348640 1 -- 172.21.15.42:0/3279655370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff5c19b990 con 0x7eff5c1008d0 2024-09-19T09:38:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.605+0000 7eff527fc640 1 -- 172.21.15.42:0/3279655370 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7eff5809c300 con 0x7eff5c1008d0 2024-09-19T09:38:44.607 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:44.607 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":27,"btime":"2024-09-19T09:37:23:003045+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:37:23.003018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:38:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 27 2024-09-19T09:38:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 -- 172.21.15.42:0/3279655370 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7eff480a3350 msgr2=0x7eff480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7eff480a3350 0x7eff480a5810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7eff5c10ecb0 tx=0x7eff4c005a20 comp rx=0 tx=0).stop 2024-09-19T09:38:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 -- 172.21.15.42:0/3279655370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff5c1008d0 msgr2=0x7eff5c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff5c1008d0 0x7eff5c19a630 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7eff5800d950 tx=0x7eff5800de10 comp rx=0 tx=0).stop 2024-09-19T09:38:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 -- 172.21.15.42:0/3279655370 shutdown_connections 2024-09-19T09:38:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7eff480a3350 0x7eff480a5810 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff5c10e480 0x7eff5c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff5c101280 0x7eff5c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 --2- 172.21.15.42:0/3279655370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff5c1008d0 0x7eff5c19a630 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 -- 172.21.15.42:0/3279655370 >> 172.21.15.42:0/3279655370 conn(0x7eff5c0fc7a0 msgr2=0x7eff5c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 -- 172.21.15.42:0/3279655370 shutdown_connections 2024-09-19T09:38:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:44.607+0000 7eff63348640 1 -- 172.21.15.42:0/3279655370 wait complete. 2024-09-19T09:38:45.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:38:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:45.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:45 smithi042 ceph-mon[31223]: pgmap v320: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:45.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:45 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3279655370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:45.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:45 smithi171 ceph-mon[35803]: pgmap v320: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:45.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:45 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3279655370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:45 smithi136 ceph-mon[34840]: pgmap v320: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:45 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3279655370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.017+0000 7f08ca643640 1 -- 172.21.15.42:0/3474450520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08c4100a90 msgr2=0x7f08c4100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.017+0000 7f08ca643640 1 --2- 172.21.15.42:0/3474450520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08c4100a90 0x7f08c4100ef0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009930 tx=0x7f08b802a420 comp rx=0 tx=0).stop 2024-09-19T09:38:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.017+0000 7f08ca643640 1 -- 172.21.15.42:0/3474450520 shutdown_connections 2024-09-19T09:38:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.017+0000 7f08ca643640 1 --2- 172.21.15.42:0/3474450520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08c4101430 0x7f08c410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.017+0000 7f08ca643640 1 --2- 172.21.15.42:0/3474450520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08c4100a90 0x7f08c4100ef0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.017+0000 7f08ca643640 1 --2- 172.21.15.42:0/3474450520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c4106a90 0x7f08c4106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.017+0000 7f08ca643640 1 -- 172.21.15.42:0/3474450520 >> 172.21.15.42:0/3474450520 conn(0x7f08c40fc7d0 msgr2=0x7f08c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.018+0000 7f08ca643640 1 -- 172.21.15.42:0/3474450520 shutdown_connections 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.018+0000 7f08ca643640 1 -- 172.21.15.42:0/3474450520 wait complete. 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.018+0000 7f08ca643640 1 Processor -- start 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.018+0000 7f08ca643640 1 -- start start 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.018+0000 7f08ca643640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c4100a90 0x7f08c4102660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.018+0000 7f08ca643640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08c4101430 0x7f08c4102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.018+0000 7f08ca643640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08c4106a90 0x7f08c41030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.018+0000 7f08ca643640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f08c4110f30 con 0x7f08c4106a90 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08ca643640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f08c4110db0 con 0x7f08c4101430 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08ca643640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41110b0 con 0x7f08c4100a90 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c8be0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08c4106a90 0x7f08c41030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c8be0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08c4106a90 0x7f08c41030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42102/0 (socket says 172.21.15.42:42102) 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c8be0640 1 -- 172.21.15.42:0/175382432 learned_addr learned my addr 172.21.15.42:0/175382432 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c37fe640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08c4101430 0x7f08c4102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c3fff640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c4100a90 0x7f08c4102660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c8be0640 1 -- 172.21.15.42:0/175382432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c4100a90 msgr2=0x7f08c4102660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c8be0640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c4100a90 0x7f08c4102660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c8be0640 1 -- 172.21.15.42:0/175382432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08c4101430 msgr2=0x7f08c4102ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c8be0640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08c4101430 0x7f08c4102ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c8be0640 1 -- 172.21.15.42:0/175382432 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c41a6a60 con 0x7f08c4106a90 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c3fff640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c4100a90 0x7f08c4102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c8be0640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08c4106a90 0x7f08c41030e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00b970 tx=0x7f08bc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c17fa640 1 -- 172.21.15.42:0/175382432 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc019070 con 0x7f08c4106a90 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08ca643640 1 -- 172.21.15.42:0/175382432 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c41a6d50 con 0x7f08c4106a90 2024-09-19T09:38:46.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c17fa640 1 -- 172.21.15.42:0/175382432 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08bc00cb40 con 0x7f08c4106a90 2024-09-19T09:38:46.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08c17fa640 1 -- 172.21.15.42:0/175382432 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc007650 con 0x7f08c4106a90 2024-09-19T09:38:46.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.019+0000 7f08ca643640 1 -- 172.21.15.42:0/175382432 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c41a7210 con 0x7f08c4106a90 2024-09-19T09:38:46.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.020+0000 7f08ca643640 1 -- 172.21.15.42:0/175382432 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c4100f70 con 0x7f08c4106a90 2024-09-19T09:38:46.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.022+0000 7f08c17fa640 1 -- 172.21.15.42:0/175382432 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f08bc01c070 con 0x7f08c4106a90 2024-09-19T09:38:46.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.022+0000 7f08c17fa640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08ac0a32d0 0x7f08ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:46.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.022+0000 7f08c3fff640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08ac0a32d0 0x7f08ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:46.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.022+0000 7f08c17fa640 1 -- 172.21.15.42:0/175382432 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f08bc0cf020 con 0x7f08c4106a90 2024-09-19T09:38:46.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.023+0000 7f08c3fff640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08ac0a32d0 0x7f08ac0a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f08b4006fd0 tx=0x7f08b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:46.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.027+0000 7f08c17fa640 1 -- 172.21.15.42:0/175382432 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08bc09bcd0 con 0x7f08c4106a90 2024-09-19T09:38:46.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.202+0000 7f08ca643640 1 -- 172.21.15.42:0/175382432 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08c41a74a0 con 0x7f08c4106a90 2024-09-19T09:38:46.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.203+0000 7f08c17fa640 1 -- 172.21.15.42:0/175382432 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22852 (secure 0 0 0) 0x7f08bc09b5d0 con 0x7f08c4106a90 2024-09-19T09:38:46.205 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:46.206 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:28.010101+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:38:46.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 -- 172.21.15.42:0/175382432 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08ac0a32d0 msgr2=0x7f08ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:46.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08ac0a32d0 0x7f08ac0a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f08b4006fd0 tx=0x7f08b4008040 comp rx=0 tx=0).stop 2024-09-19T09:38:46.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 -- 172.21.15.42:0/175382432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08c4106a90 msgr2=0x7f08c41030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:46.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08c4106a90 0x7f08c41030e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00b970 tx=0x7f08bc00be30 comp rx=0 tx=0).stop 2024-09-19T09:38:46.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 -- 172.21.15.42:0/175382432 shutdown_connections 2024-09-19T09:38:46.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f08ac0a32d0 0x7f08ac0a5790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f08c4106a90 0x7f08c41030e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08c4101430 0x7f08c4102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 --2- 172.21.15.42:0/175382432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c4100a90 0x7f08c4102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 -- 172.21.15.42:0/175382432 >> 172.21.15.42:0/175382432 conn(0x7f08c40fc7d0 msgr2=0x7f08c4104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:46.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 -- 172.21.15.42:0/175382432 shutdown_connections 2024-09-19T09:38:46.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:46.206+0000 7f08ca643640 1 -- 172.21.15.42:0/175382432 wait complete. 2024-09-19T09:38:46.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:46 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/175382432' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:46.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:46 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/175382432' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:46.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:46 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/175382432' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:46.893 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:37:11.524843+0000', 'modified': '2024-09-19T09:37:23.003018+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24506, 'mds_1': 24478, 'mds_2': 24473, 'mds_3': 24466, 'mds_4': 24454}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14622': {'gid': 14622, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6839/3152711275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6838', 'nonce': 3152711275}, {'type': 'v1', 'addr': '172.21.15.42:6839', 'nonce': 3152711275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14628': {'gid': 14628, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6841/649947071', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6840', 'nonce': 649947071}, {'type': 'v1', 'addr': '172.21.15.42:6841', 'nonce': 649947071}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6833/1004485926', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 1004485926}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 1004485926}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6833/1364803362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6832', 'nonce': 1364803362}, {'type': 'v1', 'addr': '172.21.15.136:6833', 'nonce': 1364803362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6835/3800275147', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 3800275147}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 3800275147}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.171:6835/3609400567', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 3609400567}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 3609400567}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.171:6837/512338141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 512338141}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 512338141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.136:6837/2776197166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 2776197166}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 2776197166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.171:6839/3148784527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6838', 'nonce': 3148784527}, {'type': 'v1', 'addr': '172.21.15.171:6839', 'nonce': 3148784527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.136:6839/2003809688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 2003809688}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 2003809688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24506, 'qdb_cluster': [24478, 24473, 24466, 24506, 24454]} 2024-09-19T09:38:46.893 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:38:46.893 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T09:38:47.154 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.627+0000 7f95f3c66640 1 -- 172.21.15.42:0/3887913698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95ec1008d0 msgr2=0x7f95ec100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.627+0000 7f95f3c66640 1 --2- 172.21.15.42:0/3887913698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95ec1008d0 0x7f95ec100cb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009ca0 tx=0x7f95dc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.628+0000 7f95f3c66640 1 -- 172.21.15.42:0/3887913698 shutdown_connections 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.628+0000 7f95f3c66640 1 --2- 172.21.15.42:0/3887913698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec10e480 0x7f95ec110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.628+0000 7f95f3c66640 1 --2- 172.21.15.42:0/3887913698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec101280 0x7f95ec10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.628+0000 7f95f3c66640 1 --2- 172.21.15.42:0/3887913698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95ec1008d0 0x7f95ec100cb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.628+0000 7f95f3c66640 1 -- 172.21.15.42:0/3887913698 >> 172.21.15.42:0/3887913698 conn(0x7f95ec0fc7a0 msgr2=0x7f95ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.628+0000 7f95f3c66640 1 -- 172.21.15.42:0/3887913698 shutdown_connections 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.628+0000 7f95f3c66640 1 -- 172.21.15.42:0/3887913698 wait complete. 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.628+0000 7f95f3c66640 1 Processor -- start 2024-09-19T09:38:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.628+0000 7f95f3c66640 1 -- start start 2024-09-19T09:38:47.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f3c66640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec1008d0 0x7f95ec19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f3c66640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95ec101280 0x7f95ec19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f3c66640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec10e480 0x7f95ec19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f3c66640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec1141b0 con 0x7f95ec101280 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f3c66640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec114030 con 0x7f95ec1008d0 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f3c66640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec114330 con 0x7f95ec10e480 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f1201640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95ec101280 0x7f95ec19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f1201640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95ec101280 0x7f95ec19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42122/0 (socket says 172.21.15.42:42122) 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f1201640 1 -- 172.21.15.42:0/331863229 learned_addr learned my addr 172.21.15.42:0/331863229 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f1a02640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec1008d0 0x7f95ec19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f2203640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec10e480 0x7f95ec19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f1201640 1 -- 172.21.15.42:0/331863229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec10e480 msgr2=0x7f95ec19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f1201640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec10e480 0x7f95ec19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f1201640 1 -- 172.21.15.42:0/331863229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec1008d0 msgr2=0x7f95ec19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f1201640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec1008d0 0x7f95ec19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f1201640 1 -- 172.21.15.42:0/331863229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec19f640 con 0x7f95ec101280 2024-09-19T09:38:47.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f2203640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec10e480 0x7f95ec19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:47.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.629+0000 7f95f1201640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95ec101280 0x7f95ec19abd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f95e000d770 tx=0x7f95e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:47.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.630+0000 7f95eaffd640 1 -- 172.21.15.42:0/331863229 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0017070 con 0x7f95ec101280 2024-09-19T09:38:47.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.630+0000 7f95eaffd640 1 -- 172.21.15.42:0/331863229 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95e0005500 con 0x7f95ec101280 2024-09-19T09:38:47.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.630+0000 7f95f3c66640 1 -- 172.21.15.42:0/331863229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec19f930 con 0x7f95ec101280 2024-09-19T09:38:47.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.630+0000 7f95eaffd640 1 -- 172.21.15.42:0/331863229 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0004e00 con 0x7f95ec101280 2024-09-19T09:38:47.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.630+0000 7f95f3c66640 1 -- 172.21.15.42:0/331863229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec1a7210 con 0x7f95ec101280 2024-09-19T09:38:47.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.632+0000 7f95eaffd640 1 -- 172.21.15.42:0/331863229 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f95e0004fa0 con 0x7f95ec101280 2024-09-19T09:38:47.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.632+0000 7f95f603f740 1 Processor -- start 2024-09-19T09:38:47.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95eaffd640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f95d40a32d0 0x7f95d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f603f740 1 -- start start 2024-09-19T09:38:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f2203640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f95d40a32d0 0x7f95d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95eaffd640 1 -- 172.21.15.42:0/331863229 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f95e00cf5a0 con 0x7f95ec101280 2024-09-19T09:38:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f603f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 0x5555bbca8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f603f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbca92f0 0x5555bbcb3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f603f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbcb3bb0 0x5555bbcb5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f603f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5555bbc0f090 con 0x5555bbcb3bb0 2024-09-19T09:38:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f603f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5555bbbb6a70 con 0x5555bbca89d0 2024-09-19T09:38:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f603f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5555bbc0b050 con 0x5555bbca92f0 2024-09-19T09:38:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f2203640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbcb3bb0 0x5555bbcb5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f2203640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbcb3bb0 0x5555bbcb5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42130/0 (socket says 172.21.15.42:42130) 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f2203640 1 -- 172.21.15.42:0/2631443370 learned_addr learned my addr 172.21.15.42:0/2631443370 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f1a02640 1 --2- 172.21.15.42:0/2631443370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 0x5555bbca8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f1201640 1 --2- 172.21.15.42:0/2631443370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbca92f0 0x5555bbcb3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.633+0000 7f95f2203640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f95d40a32d0 0x7f95d40a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95e4013510 tx=0x7f95e4013910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.634+0000 7f95f2203640 1 -- 172.21.15.42:0/2631443370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbca92f0 msgr2=0x5555bbcb3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.634+0000 7f95f2203640 1 --2- 172.21.15.42:0/2631443370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbca92f0 0x5555bbcb3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.634+0000 7f95f2203640 1 -- 172.21.15.42:0/2631443370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 msgr2=0x5555bbca8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.634+0000 7f95f2203640 1 --2- 172.21.15.42:0/2631443370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 0x5555bbca8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.634+0000 7f95f2203640 1 -- 172.21.15.42:0/2631443370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555bbbc3130 con 0x5555bbcb3bb0 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.634+0000 7f95f1a02640 1 --2- 172.21.15.42:0/2631443370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 0x5555bbca8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.634+0000 7f95f2203640 1 --2- 172.21.15.42:0/2631443370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbcb3bb0 0x5555bbcb5fa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f95e4013e10 tx=0x7f95e401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3515f05f9284edc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.634+0000 7f95d3fff640 1 -- 172.21.15.42:0/2631443370 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4005220 con 0x5555bbcb3bb0 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.634+0000 7f95d3fff640 1 -- 172.21.15.42:0/2631443370 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95e4004c80 con 0x5555bbcb3bb0 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.634+0000 7f95d3fff640 1 -- 172.21.15.42:0/2631443370 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e401fb20 con 0x5555bbcb3bb0 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 -- 172.21.15.42:0/2631443370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbcb3bb0 msgr2=0x5555bbcb5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 --2- 172.21.15.42:0/2631443370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbcb3bb0 0x5555bbcb5fa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f95e4013e10 tx=0x7f95e401d000 comp rx=0 tx=0).stop 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 -- 172.21.15.42:0/2631443370 shutdown_connections 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 --2- 172.21.15.42:0/2631443370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbcb3bb0 0x5555bbcb5fa0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 --2- 172.21.15.42:0/2631443370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbca92f0 0x5555bbcb3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 --2- 172.21.15.42:0/2631443370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 0x5555bbca8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 -- 172.21.15.42:0/2631443370 >> 172.21.15.42:0/2631443370 conn(0x5555bbca4f60 msgr2=0x5555bbca5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 -- 172.21.15.42:0/2631443370 shutdown_connections 2024-09-19T09:38:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 -- 172.21.15.42:0/2631443370 wait complete. 2024-09-19T09:38:47.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 -- start start 2024-09-19T09:38:47.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.635+0000 7f95f603f740 1 Processor -- start 2024-09-19T09:38:47.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f603f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 0x5555bbcb3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f603f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca92f0 0x5555bbcb0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f603f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 0x5555bbcb0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f603f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5555bbcb6780 con 0x5555bbca92f0 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f603f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5555bbbc9f20 con 0x5555bbca89d0 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f603f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5555bbcb6900 con 0x5555bbcb3bb0 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f603f740 10 client.0 _ll_register_callbacks cb 0x5555bbb93030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f1201640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca92f0 0x5555bbcb0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f1201640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca92f0 0x5555bbcb0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42140/0 (socket says 172.21.15.42:42140) 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f1201640 1 -- 172.21.15.42:0/295486834 learned_addr learned my addr 172.21.15.42:0/295486834 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f2203640 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 0x5555bbcb0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f1a02640 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 0x5555bbcb3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f1201640 1 -- 172.21.15.42:0/295486834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 msgr2=0x5555bbcb0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f1201640 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 0x5555bbcb0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f1201640 1 -- 172.21.15.42:0/295486834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 msgr2=0x5555bbcb3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f1201640 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 0x5555bbcb3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.636+0000 7f95f1201640 1 -- 172.21.15.42:0/295486834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555bb9802b0 con 0x5555bbca92f0 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95f1201640 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca92f0 0x5555bbcb0790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f95e009b970 tx=0x7f95e0004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba79f5a3cff6b9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95d17fa640 1 -- 172.21.15.42:0/295486834 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e00b4060 con 0x5555bbca92f0 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95d17fa640 1 -- 172.21.15.42:0/295486834 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f95e0009cc0 con 0x5555bbca92f0 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95f603f740 1 -- 172.21.15.42:0/295486834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95e4004c80 con 0x5555bbca92f0 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95d17fa640 1 -- 172.21.15.42:0/295486834 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f95e0020040 con 0x5555bbca92f0 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95f603f740 10 client.15135 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95f603f740 1 -- 172.21.15.42:0/295486834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5555bbcc2140 con 0x5555bbca92f0 2024-09-19T09:38:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95d17fa640 1 -- 172.21.15.42:0/295486834 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95e4004c80 con 0x5555bbca92f0 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95d17fa640 1 -- 172.21.15.42:0/295486834 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f95e0098050 con 0x5555bbca92f0 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95f603f740 10 client.15135 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95f603f740 10 client.15135 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95f603f740 20 client.15135 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95f603f740 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5555bbcc46b0 0x5555bbcc5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95f603f740 4 client.15135 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.637+0000 7f95f603f740 1 -- 172.21.15.42:0/295486834 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555bbc1c600 con 0x5555bbcc46b0 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.638+0000 7f95f1a02640 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5555bbcc46b0 0x5555bbcc5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.638+0000 7f95d17fa640 10 client.15135 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.638+0000 7f95f1a02640 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5555bbcc46b0 0x5555bbcc5b20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b45806b42ce2d235 server_cookie=5875888536d7286d in_seq=0 out_seq=0 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95d17fa640 1 -- 172.21.15.42:0/295486834 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555bbc1c600 con 0x5555bbcc46b0 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95d17fa640 10 client.15135 handle_command_reply: tid=0 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 client.15135 shutdown 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 -- 172.21.15.42:0/295486834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca92f0 msgr2=0x5555bbcb0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca92f0 0x5555bbcb0790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f95e009b970 tx=0x7f95e0004780 comp rx=0 tx=0).stop 2024-09-19T09:38:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 -- 172.21.15.42:0/295486834 shutdown_connections 2024-09-19T09:38:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5555bbcc46b0 0x5555bbcc5b20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 0x5555bbcb0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca92f0 0x5555bbcb0790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 --2- 172.21.15.42:0/295486834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca89d0 0x5555bbcb3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 -- 172.21.15.42:0/295486834 >> 172.21.15.42:0/295486834 conn(0x5555bbca4f60 msgr2=0x5555bbcaac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95d17fa640 0 client.15135 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:38:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 -- 172.21.15.42:0/295486834 shutdown_connections 2024-09-19T09:38:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 1 -- 172.21.15.42:0/295486834 wait complete. 2024-09-19T09:38:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.639+0000 7f95f603f740 20 client.15135 trim_cache size 0 max 16384 2024-09-19T09:38:47.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.657+0000 7f95f603f740 1 Processor -- start 2024-09-19T09:38:47.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.657+0000 7f95f603f740 1 -- start start 2024-09-19T09:38:47.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.657+0000 7f95f603f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcb0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.657+0000 7f95f603f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca92f0 0x5555bbcaf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.657+0000 7f95f603f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 0x5555bbcaf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.657+0000 7f95f603f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5555bbcc3e60 con 0x5555bbca89d0 2024-09-19T09:38:47.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.657+0000 7f95f603f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5555bbcc4530 con 0x5555bbca92f0 2024-09-19T09:38:47.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.657+0000 7f95f603f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5555bbcc4c00 con 0x5555bbcb3bb0 2024-09-19T09:38:47.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1a02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcb0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1a02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcb0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42144/0 (socket says 172.21.15.42:42144) 2024-09-19T09:38:47.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1a02640 1 -- 172.21.15.42:0/3502403438 learned_addr learned my addr 172.21.15.42:0/3502403438 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:47.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f2203640 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 0x5555bbcaf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1201640 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca92f0 0x5555bbcaf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1a02640 1 -- 172.21.15.42:0/3502403438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 msgr2=0x5555bbcaf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:47.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1a02640 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 0x5555bbcaf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1a02640 1 -- 172.21.15.42:0/3502403438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca92f0 msgr2=0x5555bbcaf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:47.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1a02640 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca92f0 0x5555bbcaf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1a02640 1 -- 172.21.15.42:0/3502403438 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555bbca9120 con 0x5555bbca89d0 2024-09-19T09:38:47.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f2203640 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 0x5555bbcaf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1201640 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca92f0 0x5555bbcaf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95f1a02640 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcb0050 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009ca0 tx=0x7f95dc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ad99846fbfa25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95d37fe640 1 -- 172.21.15.42:0/3502403438 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc031450 con 0x5555bbca89d0 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95d37fe640 1 -- 172.21.15.42:0/3502403438 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95dc036040 con 0x5555bbca89d0 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.658+0000 7f95d37fe640 1 -- 172.21.15.42:0/3502403438 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0305c0 con 0x5555bbca89d0 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 -- 172.21.15.42:0/3502403438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 msgr2=0x5555bbcb0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcb0050 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009ca0 tx=0x7f95dc005ef0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 -- 172.21.15.42:0/3502403438 shutdown_connections 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbcb3bb0 0x5555bbcaf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbca92f0 0x5555bbcaf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 --2- 172.21.15.42:0/3502403438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcb0050 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 -- 172.21.15.42:0/3502403438 >> 172.21.15.42:0/3502403438 conn(0x5555bbca4f60 msgr2=0x5555bbcb0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 -- 172.21.15.42:0/3502403438 shutdown_connections 2024-09-19T09:38:47.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 -- 172.21.15.42:0/3502403438 wait complete. 2024-09-19T09:38:47.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 -- start start 2024-09-19T09:38:47.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.659+0000 7f95f603f740 1 Processor -- start 2024-09-19T09:38:47.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f603f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f603f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbca92f0 0x5555bbcce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f603f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbcb3bb0 0x5555bbcad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f603f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5555bbcc59a0 con 0x5555bbca89d0 2024-09-19T09:38:47.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f603f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5555bbcc52d0 con 0x5555bbcb3bb0 2024-09-19T09:38:47.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f603f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5555bbcc6070 con 0x5555bbca92f0 2024-09-19T09:38:47.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f603f740 10 client.0 _ll_register_callbacks cb 0x7f95e000de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:47.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f1a02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f1a02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42154/0 (socket says 172.21.15.42:42154) 2024-09-19T09:38:47.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f1a02640 1 -- 172.21.15.42:0/1392659406 learned_addr learned my addr 172.21.15.42:0/1392659406 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f1201640 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbca92f0 0x5555bbcce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f2203640 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbcb3bb0 0x5555bbcad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f1a02640 1 -- 172.21.15.42:0/1392659406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbca92f0 msgr2=0x5555bbcce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f1a02640 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbca92f0 0x5555bbcce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f1a02640 1 -- 172.21.15.42:0/1392659406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbcb3bb0 msgr2=0x5555bbcad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f1a02640 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbcb3bb0 0x5555bbcad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f1a02640 1 -- 172.21.15.42:0/1392659406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555bbcad8f0 con 0x5555bbca89d0 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95f1a02640 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcce080 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009430 tx=0x7f95dc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d199c8d0483a2542 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.660+0000 7f95d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95d17fa640 1 -- 172.21.15.42:0/1392659406 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc060060 con 0x5555bbca89d0 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95d17fa640 1 -- 172.21.15.42:0/1392659406 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f95dc02f810 con 0x5555bbca89d0 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95f603f740 1 -- 172.21.15.42:0/1392659406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95dc036040 con 0x5555bbca89d0 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95d17fa640 1 -- 172.21.15.42:0/1392659406 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f95dc02fe50 con 0x5555bbca89d0 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95f603f740 10 client.15141 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:47.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95f603f740 1 -- 172.21.15.42:0/1392659406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5555bbccd8b0 con 0x5555bbca89d0 2024-09-19T09:38:47.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95d17fa640 1 -- 172.21.15.42:0/1392659406 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95dc036040 con 0x5555bbca89d0 2024-09-19T09:38:47.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95d17fa640 1 -- 172.21.15.42:0/1392659406 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f95dc044040 con 0x5555bbca89d0 2024-09-19T09:38:47.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95f603f740 10 client.15141 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:47.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95f603f740 10 client.15141 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:38:47.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95f603f740 20 client.15141 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:47.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95f603f740 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5555bbd32e90 0x5555bbd31ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:47.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95f603f740 4 client.15141 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:47.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.661+0000 7f95f603f740 1 -- 172.21.15.42:0/1392659406 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "status"}) -- 0x5555bbc16b10 con 0x5555bbd32e90 2024-09-19T09:38:47.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f1201640 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5555bbd32e90 0x5555bbd31ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:47.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f1201640 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5555bbd32e90 0x5555bbd31ba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d53da568af79f693 server_cookie=1f0f5abdd5dfd66f in_seq=0 out_seq=0 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95d17fa640 10 client.15141 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95d17fa640 1 -- 172.21.15.42:0/1392659406 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5555bbc16b10 con 0x5555bbd32e90 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95d17fa640 10 client.15141 handle_command_reply: tid=0 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 client.15141 shutdown 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 -- 172.21.15.42:0/1392659406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 msgr2=0x5555bbcce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcce080 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009430 tx=0x7f95dc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 -- 172.21.15.42:0/1392659406 shutdown_connections 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5555bbd32e90 0x5555bbd31ba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555bbcb3bb0 0x5555bbcad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5555bbca92f0 0x5555bbcce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95d17fa640 0 client.15141 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:38:47.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 --2- 172.21.15.42:0/1392659406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555bbca89d0 0x5555bbcce080 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 -- 172.21.15.42:0/1392659406 >> 172.21.15.42:0/1392659406 conn(0x5555bbca4f60 msgr2=0x5555bbcaf020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:47.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 -- 172.21.15.42:0/1392659406 shutdown_connections 2024-09-19T09:38:47.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.662+0000 7f95f603f740 1 -- 172.21.15.42:0/1392659406 wait complete. 2024-09-19T09:38:47.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f603f740 20 client.15141 trim_cache size 0 max 16384 2024-09-19T09:38:47.671 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:38:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 4, 2024-09-19T09:38:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24454, 2024-09-19T09:38:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:38:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:38:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:38:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 85.665923777000003, 2024-09-19T09:38:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 27, 2024-09-19T09:38:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:38:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T09:38:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 122.07889674099999 2024-09-19T09:38:47.672 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:38:47.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 -- 172.21.15.42:0/331863229 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f95d40a32d0 msgr2=0x7f95d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:47.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f95d40a32d0 0x7f95d40a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95e4013510 tx=0x7f95e4013910 comp rx=0 tx=0).stop 2024-09-19T09:38:47.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 -- 172.21.15.42:0/331863229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95ec101280 msgr2=0x7f95ec19abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:47.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95ec101280 0x7f95ec19abd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f95e000d770 tx=0x7f95e000dc30 comp rx=0 tx=0).stop 2024-09-19T09:38:47.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 -- 172.21.15.42:0/331863229 shutdown_connections 2024-09-19T09:38:47.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f95d40a32d0 0x7f95d40a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec10e480 0x7f95ec19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95ec101280 0x7f95ec19abd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 --2- 172.21.15.42:0/331863229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec1008d0 0x7f95ec19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:47.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 -- 172.21.15.42:0/331863229 >> 172.21.15.42:0/331863229 conn(0x7f95ec0fc7a0 msgr2=0x7f95ec0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:47.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 -- 172.21.15.42:0/331863229 shutdown_connections 2024-09-19T09:38:47.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:47.663+0000 7f95f3c66640 1 -- 172.21.15.42:0/331863229 wait complete. 2024-09-19T09:38:47.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:47 smithi171 ceph-mon[35803]: pgmap v321: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:47.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:47 smithi136 ceph-mon[34840]: pgmap v321: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:47.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:47 smithi042 ceph-mon[31223]: pgmap v321: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:48.319 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T09:38:48.575 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.035+0000 7fd4b37b1640 1 -- 172.21.15.42:0/2000391522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4ac100e20 msgr2=0x7fd4ac101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.035+0000 7fd4b37b1640 1 --2- 172.21.15.42:0/2000391522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4ac100e20 0x7fd4ac101200 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009900 tx=0x7fd4a802a480 comp rx=0 tx=0).stop 2024-09-19T09:38:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.035+0000 7fd4b37b1640 1 -- 172.21.15.42:0/2000391522 shutdown_connections 2024-09-19T09:38:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.035+0000 7fd4b37b1640 1 --2- 172.21.15.42:0/2000391522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4ac102ef0 0x7fd4ac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.035+0000 7fd4b37b1640 1 --2- 172.21.15.42:0/2000391522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ac102570 0x7fd4ac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.035+0000 7fd4b37b1640 1 --2- 172.21.15.42:0/2000391522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4ac100e20 0x7fd4ac101200 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.035+0000 7fd4b37b1640 1 -- 172.21.15.42:0/2000391522 >> 172.21.15.42:0/2000391522 conn(0x7fd4ac0fc7d0 msgr2=0x7fd4ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.035+0000 7fd4b37b1640 1 -- 172.21.15.42:0/2000391522 shutdown_connections 2024-09-19T09:38:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.035+0000 7fd4b37b1640 1 -- 172.21.15.42:0/2000391522 wait complete. 2024-09-19T09:38:49.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.036+0000 7fd4b37b1640 1 Processor -- start 2024-09-19T09:38:49.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.036+0000 7fd4b37b1640 1 -- start start 2024-09-19T09:38:49.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b37b1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4ac100e20 0x7fd4ac1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b37b1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4ac102570 0x7fd4ac197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b37b1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ac102ef0 0x7fd4ac19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b37b1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac110f80 con 0x7fd4ac100e20 2024-09-19T09:38:49.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b37b1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac110e00 con 0x7fd4ac102ef0 2024-09-19T09:38:49.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b37b1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac111100 con 0x7fd4ac102570 2024-09-19T09:38:49.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b154d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4ac100e20 0x7fd4ac1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b154d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4ac100e20 0x7fd4ac1972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42178/0 (socket says 172.21.15.42:42178) 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b154d640 1 -- 172.21.15.42:0/4264499356 learned_addr learned my addr 172.21.15.42:0/4264499356 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ac102ef0 0x7fd4ac19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b0d4c640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4ac102570 0x7fd4ac197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b154d640 1 -- 172.21.15.42:0/4264499356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4ac102570 msgr2=0x7fd4ac197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b154d640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4ac102570 0x7fd4ac197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b154d640 1 -- 172.21.15.42:0/4264499356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ac102ef0 msgr2=0x7fd4ac19bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b154d640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ac102ef0 0x7fd4ac19bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b154d640 1 -- 172.21.15.42:0/4264499356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ac19c270 con 0x7fd4ac100e20 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b0d4c640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4ac102570 0x7fd4ac197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ac102ef0 0x7fd4ac19bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4b154d640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4ac100e20 0x7fd4ac1972c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8006010 tx=0x7fd4a8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.037+0000 7fd4a27fc640 1 -- 172.21.15.42:0/4264499356 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8035030 con 0x7fd4ac100e20 2024-09-19T09:38:49.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.038+0000 7fd4b37b1640 1 -- 172.21.15.42:0/4264499356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4ac19c500 con 0x7fd4ac100e20 2024-09-19T09:38:49.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.038+0000 7fd4a27fc640 1 -- 172.21.15.42:0/4264499356 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4a803f070 con 0x7fd4ac100e20 2024-09-19T09:38:49.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.038+0000 7fd4a27fc640 1 -- 172.21.15.42:0/4264499356 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8044470 con 0x7fd4ac100e20 2024-09-19T09:38:49.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.038+0000 7fd4b37b1640 1 -- 172.21.15.42:0/4264499356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4ac069f70 con 0x7fd4ac100e20 2024-09-19T09:38:49.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.040+0000 7fd4a27fc640 1 -- 172.21.15.42:0/4264499356 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd4a8031540 con 0x7fd4ac100e20 2024-09-19T09:38:49.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.040+0000 7fd4b5b8a740 1 Processor -- start 2024-09-19T09:38:49.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.040+0000 7fd4b5b8a740 1 -- start start 2024-09-19T09:38:49.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x5567044e8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044f3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55670444f090 con 0x5567044f3bb0 2024-09-19T09:38:49.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5567043f6a70 con 0x5567044e89d0 2024-09-19T09:38:49.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55670444b050 con 0x5567044e92f0 2024-09-19T09:38:49.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b0d4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4a27fc640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd4980a3350 0x7fd4980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b0d4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42182/0 (socket says 172.21.15.42:42182) 2024-09-19T09:38:49.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b0d4c640 1 -- 172.21.15.42:0/2104370776 learned_addr learned my addr 172.21.15.42:0/2104370776 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:49.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b154d640 1 --2- 172.21.15.42:0/2104370776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd4980a3350 0x7fd4980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/2104370776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x5567044e8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b0d4c640 1 -- 172.21.15.42:0/2104370776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 msgr2=0x5567044f3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:49.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b0d4c640 1 --2- 172.21.15.42:0/2104370776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044f3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b0d4c640 1 -- 172.21.15.42:0/2104370776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 msgr2=0x5567044e8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:49.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b0d4c640 1 --2- 172.21.15.42:0/2104370776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x5567044e8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4b0d4c640 1 -- 172.21.15.42:0/2104370776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556704403130 con 0x5567044f3bb0 2024-09-19T09:38:49.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.041+0000 7fd4a27fc640 1 -- 172.21.15.42:0/4264499356 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd4a80f24c0 con 0x7fd4ac100e20 2024-09-19T09:38:49.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.042+0000 7fd4b0d4c640 1 --2- 172.21.15.42:0/2104370776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f5fa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd49c008c10 tx=0x7fd49c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97563b04df230539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:49.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.042+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd4980a3350 0x7fd4980a5810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4013c20 tx=0x7fd4a4007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:49.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.042+0000 7fd4977fe640 1 -- 172.21.15.42:0/2104370776 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c014070 con 0x5567044f3bb0 2024-09-19T09:38:49.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.042+0000 7fd4977fe640 1 -- 172.21.15.42:0/2104370776 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd49c0047a0 con 0x5567044f3bb0 2024-09-19T09:38:49.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.042+0000 7fd4977fe640 1 -- 172.21.15.42:0/2104370776 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c010720 con 0x5567044f3bb0 2024-09-19T09:38:49.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2104370776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 msgr2=0x5567044f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:49.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/2104370776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f5fa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd49c008c10 tx=0x7fd49c00e720 comp rx=0 tx=0).stop 2024-09-19T09:38:49.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2104370776 shutdown_connections 2024-09-19T09:38:49.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/2104370776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f5fa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/2104370776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044f3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/2104370776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x5567044e8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2104370776 >> 172.21.15.42:0/2104370776 conn(0x5567044e4f60 msgr2=0x5567044e5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:49.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2104370776 shutdown_connections 2024-09-19T09:38:49.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2104370776 wait complete. 2024-09-19T09:38:49.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 -- start start 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.043+0000 7fd4b5b8a740 1 Processor -- start 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x5567044f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044f0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5567044f6780 con 0x5567044f3bb0 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556704409f20 con 0x5567044e89d0 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5567044f6900 con 0x5567044e92f0 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b5b8a740 10 client.0 _ll_register_callbacks cb 0x5567043d3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b1d4e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b1d4e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42194/0 (socket says 172.21.15.42:42194) 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b1d4e640 1 -- 172.21.15.42:0/1468149021 learned_addr learned my addr 172.21.15.42:0/1468149021 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b154d640 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x5567044f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b0d4c640 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b1d4e640 1 -- 172.21.15.42:0/1468149021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 msgr2=0x5567044f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b1d4e640 1 -- 172.21.15.42:0/1468149021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 msgr2=0x5567044f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x5567044f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b1d4e640 1 -- 172.21.15.42:0/1468149021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567041c02b0 con 0x5567044f3bb0 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f0c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400fa00 tx=0x7fd4a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29f1cbe0db64d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd494ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd494ff9640 1 -- 172.21.15.42:0/1468149021 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4024020 con 0x5567044f3bb0 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd494ff9640 1 -- 172.21.15.42:0/1468149021 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd4a400db30 con 0x5567044f3bb0 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.044+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/1468149021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd49c0047a0 con 0x5567044f3bb0 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd494ff9640 1 -- 172.21.15.42:0/1468149021 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd4a402f050 con 0x5567044f3bb0 2024-09-19T09:38:49.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd4b5b8a740 10 client.15153 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/1468149021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5567045020c0 con 0x5567044f3bb0 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd494ff9640 1 -- 172.21.15.42:0/1468149021 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd49c0047a0 con 0x5567044f3bb0 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd494ff9640 1 -- 172.21.15.42:0/1468149021 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd4a4020c00 con 0x5567044f3bb0 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd4b5b8a740 10 client.15153 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd4b5b8a740 10 client.15153 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd4b5b8a740 20 client.15153 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556704504770 0x556704505be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd4b5b8a740 4 client.15153 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.045+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/1468149021 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55670445c600 con 0x556704504770 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.046+0000 7fd4b154d640 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556704504770 0x556704505be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.046+0000 7fd4b154d640 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556704504770 0x556704505be0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b8666343b26747ff server_cookie=2848330c96fed3bb in_seq=0 out_seq=0 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.046+0000 7fd494ff9640 10 client.15153 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:38:49.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd494ff9640 1 -- 172.21.15.42:0/1468149021 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55670445c600 con 0x556704504770 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd494ff9640 10 client.15153 handle_command_reply: tid=0 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 client.15153 shutdown 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/1468149021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 msgr2=0x5567044f0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f0c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400fa00 tx=0x7fd4a4004a40 comp rx=0 tx=0).stop 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/1468149021 shutdown_connections 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556704504770 0x556704505be0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044f0c40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd494ff9640 0 client.15153 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/1468149021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x5567044f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/1468149021 >> 172.21.15.42:0/1468149021 conn(0x5567044e4f60 msgr2=0x5567044eac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/1468149021 shutdown_connections 2024-09-19T09:38:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/1468149021 wait complete. 2024-09-19T09:38:49.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.047+0000 7fd4b5b8a740 20 client.15153 trim_cache size 0 max 16384 2024-09-19T09:38:49.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b5b8a740 1 Processor -- start 2024-09-19T09:38:49.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b5b8a740 1 -- start start 2024-09-19T09:38:49.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x55670450e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044e5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044e5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556704503f20 con 0x5567044f3bb0 2024-09-19T09:38:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5567045045f0 con 0x5567044e89d0 2024-09-19T09:38:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556704504cc0 con 0x5567044e92f0 2024-09-19T09:38:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b1d4e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044e5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b1d4e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044e5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42208/0 (socket says 172.21.15.42:42208) 2024-09-19T09:38:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b1d4e640 1 -- 172.21.15.42:0/4213398008 learned_addr learned my addr 172.21.15.42:0/4213398008 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b1d4e640 1 -- 172.21.15.42:0/4213398008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 msgr2=0x5567044e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b154d640 1 --2- 172.21.15.42:0/4213398008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x55670450e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/4213398008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b1d4e640 1 -- 172.21.15.42:0/4213398008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 msgr2=0x55670450e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/4213398008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x55670450e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.065+0000 7fd4b1d4e640 1 -- 172.21.15.42:0/4213398008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567044e4d90 con 0x5567044f3bb0 2024-09-19T09:38:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/4213398008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044e5880 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4007f60 tx=0x7fd4a4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ade0650c194e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd496ffd640 1 -- 172.21.15.42:0/4213398008 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4037020 con 0x5567044f3bb0 2024-09-19T09:38:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd496ffd640 1 -- 172.21.15.42:0/4213398008 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4a400db30 con 0x5567044f3bb0 2024-09-19T09:38:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd496ffd640 1 -- 172.21.15.42:0/4213398008 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4024070 con 0x5567044f3bb0 2024-09-19T09:38:49.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/4213398008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 msgr2=0x5567044e5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:49.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/4213398008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044e5880 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4007f60 tx=0x7fd4a4007f90 comp rx=0 tx=0).stop 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/4213398008 shutdown_connections 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/4213398008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044f3bb0 0x5567044e5880 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/4213398008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044e92f0 0x5567044e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/4213398008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e89d0 0x55670450e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/4213398008 >> 172.21.15.42:0/4213398008 conn(0x5567044e4f60 msgr2=0x5567044efc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.066+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/4213398008 shutdown_connections 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/4213398008 wait complete. 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b5b8a740 1 -- start start 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b5b8a740 1 Processor -- start 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044e89d0 0x556704507860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e92f0 0x556704507da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b5b8a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044f3bb0 0x556704569e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556704505a60 con 0x5567044e89d0 2024-09-19T09:38:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556704505390 con 0x5567044e92f0 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b5b8a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556704506130 con 0x5567044f3bb0 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b5b8a740 10 client.0 _ll_register_callbacks cb 0x7fd4a400f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.067+0000 7fd4b154d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044e89d0 0x556704507860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b154d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044e89d0 0x556704507860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42210/0 (socket says 172.21.15.42:42210) 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b154d640 1 -- 172.21.15.42:0/2370682840 learned_addr learned my addr 172.21.15.42:0/2370682840 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b0d4c640 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e92f0 0x556704507da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044f3bb0 0x556704569e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b154d640 1 -- 172.21.15.42:0/2370682840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044f3bb0 msgr2=0x556704569e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b154d640 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044f3bb0 0x556704569e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b154d640 1 -- 172.21.15.42:0/2370682840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e92f0 msgr2=0x556704507da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b154d640 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e92f0 0x556704507da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b154d640 1 -- 172.21.15.42:0/2370682840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55670456a510 con 0x5567044e89d0 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b1d4e640 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044f3bb0 0x556704569e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b154d640 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044e89d0 0x556704507860 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80bae70 tx=0x7fd4a80e97e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9925f022b06e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd494ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd494ff9640 1 -- 172.21.15.42:0/2370682840 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a80be370 con 0x5567044e89d0 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd494ff9640 1 -- 172.21.15.42:0/2370682840 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd4a80a90b0 con 0x5567044e89d0 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2370682840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4a400db30 con 0x5567044e89d0 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd494ff9640 1 -- 172.21.15.42:0/2370682840 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd4a80bf110 con 0x5567044e89d0 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b5b8a740 10 client.15159 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.068+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2370682840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556704572ae0 con 0x5567044e89d0 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.069+0000 7fd494ff9640 1 -- 172.21.15.42:0/2370682840 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4a400db30 con 0x5567044e89d0 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.069+0000 7fd494ff9640 1 -- 172.21.15.42:0/2370682840 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd4a804c030 con 0x5567044e89d0 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.069+0000 7fd4b5b8a740 10 client.15159 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.069+0000 7fd4b5b8a740 10 client.15159 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.069+0000 7fd4b5b8a740 20 client.15159 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.069+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5567045776a0 0x5567045763b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:49.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.069+0000 7fd4b5b8a740 4 client.15159 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.069+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2370682840 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "status"}) -- 0x556704456b10 con 0x5567045776a0 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.069+0000 7fd4b0d4c640 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5567045776a0 0x5567045763b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd494ff9640 10 client.15159 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b0d4c640 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5567045776a0 0x5567045763b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fff91aa7f6a98543 server_cookie=5496cc579e293528 in_seq=0 out_seq=0 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd494ff9640 1 -- 172.21.15.42:0/2370682840 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556704456b10 con 0x5567045776a0 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd494ff9640 10 client.15159 handle_command_reply: tid=0 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 client.15159 shutdown 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2370682840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044e89d0 msgr2=0x556704507860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044e89d0 0x556704507860 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80bae70 tx=0x7fd4a80e97e0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2370682840 shutdown_connections 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5567045776a0 0x5567045763b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567044f3bb0 0x556704569e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5567044e92f0 0x556704507da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 --2- 172.21.15.42:0/2370682840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5567044e89d0 0x556704507860 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2370682840 >> 172.21.15.42:0/2370682840 conn(0x5567044e4f60 msgr2=0x5567044f06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd494ff9640 0 client.15159 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:38:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2370682840 shutdown_connections 2024-09-19T09:38:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 1 -- 172.21.15.42:0/2370682840 wait complete. 2024-09-19T09:38:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.070+0000 7fd4b5b8a740 20 client.15159 trim_cache size 0 max 16384 2024-09-19T09:38:49.077 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:38:49.077 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:49.077 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 3, 2024-09-19T09:38:49.078 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24466, 2024-09-19T09:38:49.078 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:38:49.078 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:38:49.078 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:38:49.078 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 88.080788924000004, 2024-09-19T09:38:49.078 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 27, 2024-09-19T09:38:49.078 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:38:49.078 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T09:38:49.078 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 121.109214533 2024-09-19T09:38:49.078 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:38:49.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 -- 172.21.15.42:0/4264499356 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd4980a3350 msgr2=0x7fd4980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:49.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd4980a3350 0x7fd4980a5810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4013c20 tx=0x7fd4a4007400 comp rx=0 tx=0).stop 2024-09-19T09:38:49.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 -- 172.21.15.42:0/4264499356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4ac100e20 msgr2=0x7fd4ac1972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:49.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4ac100e20 0x7fd4ac1972c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8006010 tx=0x7fd4a8003c80 comp rx=0 tx=0).stop 2024-09-19T09:38:49.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 -- 172.21.15.42:0/4264499356 shutdown_connections 2024-09-19T09:38:49.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd4980a3350 0x7fd4980a5810 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ac102ef0 0x7fd4ac19bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4ac102570 0x7fd4ac197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 --2- 172.21.15.42:0/4264499356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4ac100e20 0x7fd4ac1972c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:49.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 -- 172.21.15.42:0/4264499356 >> 172.21.15.42:0/4264499356 conn(0x7fd4ac0fc7d0 msgr2=0x7fd4ac0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:49.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 -- 172.21.15.42:0/4264499356 shutdown_connections 2024-09-19T09:38:49.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:49.071+0000 7fd4b37b1640 1 -- 172.21.15.42:0/4264499356 wait complete. 2024-09-19T09:38:49.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:49 smithi042 ceph-mon[31223]: pgmap v322: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:49.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:49 smithi171 ceph-mon[35803]: pgmap v322: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:49.863 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:38:49.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:49 smithi136 ceph-mon[34840]: pgmap v322: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:38:50.124 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.539+0000 7fb849d84640 1 -- 172.21.15.42:0/4225265718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb844102570 msgr2=0x7fb8441029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.539+0000 7fb849d84640 1 --2- 172.21.15.42:0/4225265718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb844102570 0x7fb8441029b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009900 tx=0x7fb82c02a480 comp rx=0 tx=0).stop 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.539+0000 7fb849d84640 1 -- 172.21.15.42:0/4225265718 shutdown_connections 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.539+0000 7fb849d84640 1 --2- 172.21.15.42:0/4225265718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb844102ef0 0x7fb84410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.539+0000 7fb849d84640 1 --2- 172.21.15.42:0/4225265718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb844102570 0x7fb8441029b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.539+0000 7fb849d84640 1 --2- 172.21.15.42:0/4225265718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb844100e20 0x7fb844101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.539+0000 7fb849d84640 1 -- 172.21.15.42:0/4225265718 >> 172.21.15.42:0/4225265718 conn(0x7fb8440fc7d0 msgr2=0x7fb8440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.539+0000 7fb849d84640 1 -- 172.21.15.42:0/4225265718 shutdown_connections 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.539+0000 7fb849d84640 1 -- 172.21.15.42:0/4225265718 wait complete. 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.540+0000 7fb849d84640 1 Processor -- start 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.540+0000 7fb849d84640 1 -- start start 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.540+0000 7fb849d84640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb844100e20 0x7fb844198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.540+0000 7fb849d84640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb844102570 0x7fb844198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.540+0000 7fb849d84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb844102ef0 0x7fb84419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.540+0000 7fb849d84640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb844111020 con 0x7fb844102ef0 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.540+0000 7fb849d84640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb844110ea0 con 0x7fb844100e20 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.540+0000 7fb849d84640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb8441111a0 con 0x7fb844102570 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb843fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb844102ef0 0x7fb84419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb843fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb844102ef0 0x7fb84419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34416/0 (socket says 172.21.15.42:34416) 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb843fff640 1 -- 172.21.15.42:0/4122698634 learned_addr learned my addr 172.21.15.42:0/4122698634 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb83bfff640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb844102570 0x7fb844198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb8437fe640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb844100e20 0x7fb844198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb843fff640 1 -- 172.21.15.42:0/4122698634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb844102570 msgr2=0x7fb844198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb843fff640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb844102570 0x7fb844198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb843fff640 1 -- 172.21.15.42:0/4122698634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb844100e20 msgr2=0x7fb844198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb843fff640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb844100e20 0x7fb844198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb843fff640 1 -- 172.21.15.42:0/4122698634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84419d620 con 0x7fb844102ef0 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb8437fe640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb844100e20 0x7fb844198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb843fff640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb844102ef0 0x7fb84419cf40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00b970 tx=0x7fb83c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb8417fa640 1 -- 172.21.15.42:0/4122698634 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c019070 con 0x7fb844102ef0 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb849d84640 1 -- 172.21.15.42:0/4122698634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84419d910 con 0x7fb844102ef0 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb8417fa640 1 -- 172.21.15.42:0/4122698634 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb83c00cb40 con 0x7fb844102ef0 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb8417fa640 1 -- 172.21.15.42:0/4122698634 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c007650 con 0x7fb844102ef0 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.541+0000 7fb849d84640 1 -- 172.21.15.42:0/4122698634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8441a51f0 con 0x7fb844102ef0 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb8417fa640 1 -- 172.21.15.42:0/4122698634 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb83c01c070 con 0x7fb844102ef0 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb84c15d740 1 Processor -- start 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb84c15d740 1 -- start start 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7439d0 0x562c5d743db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7442f0 0x562c5d74e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d750fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb84c15d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c5d6aa090 con 0x562c5d74ebb0 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb84c15d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562c5d651a70 con 0x562c5d7442f0 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb84c15d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562c5d6a6050 con 0x562c5d7439d0 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d750fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7439d0 0x562c5d743db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7439d0 0x562c5d743db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:32858/0 (socket says 172.21.15.42:32858) 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb8437fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7442f0 0x562c5d74e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.544+0000 7fb83bfff640 1 -- 172.21.15.42:0/2554532000 learned_addr learned my addr 172.21.15.42:0/2554532000 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.545+0000 7fb83bfff640 1 -- 172.21.15.42:0/2554532000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7439d0 msgr2=0x562c5d743db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.545+0000 7fb83bfff640 1 --2- 172.21.15.42:0/2554532000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7439d0 0x562c5d743db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.545+0000 7fb83bfff640 1 -- 172.21.15.42:0/2554532000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7442f0 msgr2=0x562c5d74e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.545+0000 7fb83bfff640 1 --2- 172.21.15.42:0/2554532000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7442f0 0x562c5d74e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.545+0000 7fb8417fa640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8300a32d0 0x7fb8300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.545+0000 7fb83bfff640 1 -- 172.21.15.42:0/2554532000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5d65e130 con 0x562c5d74ebb0 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.545+0000 7fb8437fe640 1 --2- 172.21.15.42:0/2554532000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7442f0 0x562c5d74e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.545+0000 7fb843fff640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8300a32d0 0x7fb8300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.545+0000 7fb8417fa640 1 -- 172.21.15.42:0/4122698634 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb83c0cf1e0 con 0x7fb844102ef0 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.545+0000 7fb83bfff640 1 --2- 172.21.15.42:0/2554532000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d750fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0314e0 tx=0x7fb82c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46f3ae5d34e22e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.546+0000 7fb843fff640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8300a32d0 0x7fb8300a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0ccc50 tx=0x7fb83c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.547+0000 7fb839ffb640 1 -- 172.21.15.42:0/2554532000 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c041020 con 0x562c5d74ebb0 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.547+0000 7fb839ffb640 1 -- 172.21.15.42:0/2554532000 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb82c003da0 con 0x562c5d74ebb0 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.547+0000 7fb839ffb640 1 -- 172.21.15.42:0/2554532000 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c035050 con 0x562c5d74ebb0 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.548+0000 7fb84c15d740 1 -- 172.21.15.42:0/2554532000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 msgr2=0x562c5d750fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.548+0000 7fb84c15d740 1 --2- 172.21.15.42:0/2554532000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d750fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0314e0 tx=0x7fb82c005a20 comp rx=0 tx=0).stop 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.548+0000 7fb84c15d740 1 -- 172.21.15.42:0/2554532000 shutdown_connections 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.548+0000 7fb84c15d740 1 --2- 172.21.15.42:0/2554532000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d750fa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.548+0000 7fb84c15d740 1 --2- 172.21.15.42:0/2554532000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7442f0 0x562c5d74e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.548+0000 7fb84c15d740 1 --2- 172.21.15.42:0/2554532000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7439d0 0x562c5d743db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.548+0000 7fb84c15d740 1 -- 172.21.15.42:0/2554532000 >> 172.21.15.42:0/2554532000 conn(0x562c5d73ff60 msgr2=0x562c5d740340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.548+0000 7fb84c15d740 1 -- 172.21.15.42:0/2554532000 shutdown_connections 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.548+0000 7fb84c15d740 1 -- 172.21.15.42:0/2554532000 wait complete. 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.549+0000 7fb84c15d740 1 -- start start 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.549+0000 7fb84c15d740 1 Processor -- start 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.549+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d7439d0 0x562c5d74e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.549+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d74b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.549+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d74ebb0 0x562c5d74bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.549+0000 7fb84c15d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c5d751720 con 0x562c5d7439d0 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.549+0000 7fb84c15d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562c5d664f20 con 0x562c5d74ebb0 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.549+0000 7fb84c15d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562c5d7518a0 con 0x562c5d7442f0 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.549+0000 7fb84c15d740 10 client.0 _ll_register_callbacks cb 0x562c5d62e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.549+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d7439d0 0x562c5d74e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb8437fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d74b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d7439d0 0x562c5d74e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34428/0 (socket says 172.21.15.42:34428) 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb8437fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d74b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:32862/0 (socket says 172.21.15.42:32862) 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb83bfff640 1 -- 172.21.15.42:0/1349232560 learned_addr learned my addr 172.21.15.42:0/1349232560 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb83bfff640 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d74ebb0 0x562c5d74bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb83bfff640 1 -- 172.21.15.42:0/1349232560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 msgr2=0x562c5d74b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb83bfff640 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d74b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb83bfff640 1 -- 172.21.15.42:0/1349232560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d74ebb0 msgr2=0x562c5d74bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb83bfff640 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d74ebb0 0x562c5d74bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb83bfff640 1 -- 172.21.15.42:0/1349232560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c5d41b2b0 con 0x562c5d7439d0 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb83bfff640 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d7439d0 0x562c5d74e410 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb82c02a9a0 tx=0x7fb82c048ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5dc9350d1277e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb822ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb822ffd640 1 -- 172.21.15.42:0/1349232560 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c041040 con 0x562c5d7439d0 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb822ffd640 1 -- 172.21.15.42:0/1349232560 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb82c048550 con 0x562c5d7439d0 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb84c15d740 1 -- 172.21.15.42:0/1349232560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb82c003da0 con 0x562c5d7439d0 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb822ffd640 1 -- 172.21.15.42:0/1349232560 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb82c05c070 con 0x562c5d7439d0 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb84c15d740 10 client.15171 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.550+0000 7fb84c15d740 1 -- 172.21.15.42:0/1349232560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562c5d75d040 con 0x562c5d7439d0 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.551+0000 7fb822ffd640 1 -- 172.21.15.42:0/1349232560 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb82c003da0 con 0x562c5d7439d0 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.551+0000 7fb822ffd640 1 -- 172.21.15.42:0/1349232560 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb82c054020 con 0x562c5d7439d0 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.551+0000 7fb84c15d740 10 client.15171 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.551+0000 7fb84c15d740 10 client.15171 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.551+0000 7fb84c15d740 20 client.15171 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.551+0000 7fb84c15d740 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x562c5d75e390 0x562c5d760520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.551+0000 7fb84c15d740 4 client.15171 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.551+0000 7fb84c15d740 1 -- 172.21.15.42:0/1349232560 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c5d6b7600 con 0x562c5d75e390 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.551+0000 7fb8437fe640 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x562c5d75e390 0x562c5d760520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.552+0000 7fb8437fe640 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x562c5d75e390 0x562c5d760520 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=95e4d645edce2788 server_cookie=1c2553703c7d0e8b in_seq=0 out_seq=0 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.552+0000 7fb822ffd640 10 client.15171 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.552+0000 7fb822ffd640 1 -- 172.21.15.42:0/1349232560 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c5d6b7600 con 0x562c5d75e390 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.552+0000 7fb822ffd640 10 client.15171 handle_command_reply: tid=0 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 client.15171 shutdown 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 -- 172.21.15.42:0/1349232560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d7439d0 msgr2=0x562c5d74e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d7439d0 0x562c5d74e410 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb82c02a9a0 tx=0x7fb82c048ac0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 -- 172.21.15.42:0/1349232560 shutdown_connections 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x562c5d75e390 0x562c5d760520 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb822ffd640 0 client.15171 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d74ebb0 0x562c5d74bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d74b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 --2- 172.21.15.42:0/1349232560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d7439d0 0x562c5d74e410 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 -- 172.21.15.42:0/1349232560 >> 172.21.15.42:0/1349232560 conn(0x562c5d73ff60 msgr2=0x562c5d745c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 -- 172.21.15.42:0/1349232560 shutdown_connections 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 1 -- 172.21.15.42:0/1349232560 wait complete. 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.553+0000 7fb84c15d740 20 client.15171 trim_cache size 0 max 16384 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb84c15d740 1 Processor -- start 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb84c15d740 1 -- start start 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7439d0 0x562c5d75fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d75f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d75e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb84c15d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c5d75e860 con 0x562c5d74ebb0 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb84c15d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562c5d75ef30 con 0x562c5d7439d0 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb84c15d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562c5d75f600 con 0x562c5d7442f0 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d75e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d75e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34436/0 (socket says 172.21.15.42:34436) 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb83bfff640 1 -- 172.21.15.42:0/1366561935 learned_addr learned my addr 172.21.15.42:0/1366561935 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb8437fe640 1 --2- 172.21.15.42:0/1366561935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d75f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb83bfff640 1 --2- 172.21.15.42:0/1366561935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7439d0 0x562c5d75fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb83bfff640 1 -- 172.21.15.42:0/1366561935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 msgr2=0x562c5d75f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb83bfff640 1 --2- 172.21.15.42:0/1366561935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d75f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb83bfff640 1 -- 172.21.15.42:0/1366561935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7439d0 msgr2=0x562c5d75fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb83bfff640 1 --2- 172.21.15.42:0/1366561935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7439d0 0x562c5d75fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb83bfff640 1 -- 172.21.15.42:0/1366561935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5d744120 con 0x562c5d74ebb0 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.571+0000 7fb83bfff640 1 --2- 172.21.15.42:0/1366561935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d75e9e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009900 tx=0x7fb82c03f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801531105e3dad8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.572+0000 7fb8397fa640 1 -- 172.21.15.42:0/1366561935 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c041070 con 0x562c5d74ebb0 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.572+0000 7fb8397fa640 1 -- 172.21.15.42:0/1366561935 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb82c03d770 con 0x562c5d74ebb0 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.572+0000 7fb8397fa640 1 -- 172.21.15.42:0/1366561935 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c035040 con 0x562c5d74ebb0 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.572+0000 7fb84c15d740 1 -- 172.21.15.42:0/1366561935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 msgr2=0x562c5d75e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.572+0000 7fb84c15d740 1 --2- 172.21.15.42:0/1366561935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d75e9e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009900 tx=0x7fb82c03f040 comp rx=0 tx=0).stop 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.572+0000 7fb84c15d740 1 -- 172.21.15.42:0/1366561935 shutdown_connections 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.572+0000 7fb84c15d740 1 --2- 172.21.15.42:0/1366561935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d75e9e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.572+0000 7fb84c15d740 1 --2- 172.21.15.42:0/1366561935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d75f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.572+0000 7fb84c15d740 1 --2- 172.21.15.42:0/1366561935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7439d0 0x562c5d75fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.572+0000 7fb84c15d740 1 -- 172.21.15.42:0/1366561935 >> 172.21.15.42:0/1366561935 conn(0x562c5d73ff60 msgr2=0x562c5d73ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 1 -- 172.21.15.42:0/1366561935 shutdown_connections 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 1 -- 172.21.15.42:0/1366561935 wait complete. 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 1 -- start start 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 1 Processor -- start 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7439d0 0x562c5d7479d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d747f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d748450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c5d7603a0 con 0x562c5d74ebb0 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562c5d75fcd0 con 0x562c5d7439d0 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562c5d760a70 con 0x562c5d7442f0 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.573+0000 7fb84c15d740 10 client.0 _ll_register_callbacks cb 0x7fb83400a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d748450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d748450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34444/0 (socket says 172.21.15.42:34444) 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb83bfff640 1 -- 172.21.15.42:0/708264012 learned_addr learned my addr 172.21.15.42:0/708264012 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb83bfff640 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7439d0 0x562c5d7479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb8437fe640 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d747f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb83bfff640 1 -- 172.21.15.42:0/708264012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 msgr2=0x562c5d747f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb83bfff640 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d747f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb83bfff640 1 -- 172.21.15.42:0/708264012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7439d0 msgr2=0x562c5d7479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb83bfff640 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7439d0 0x562c5d7479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb83bfff640 1 -- 172.21.15.42:0/708264012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c5d767860 con 0x562c5d74ebb0 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb8437fe640 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d747f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb83bfff640 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d748450 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb82c02a9a0 tx=0x7fb82c064040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d970e2839ecb7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb822ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb822ffd640 1 -- 172.21.15.42:0/708264012 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c035020 con 0x562c5d74ebb0 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb822ffd640 1 -- 172.21.15.42:0/708264012 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb82c003ce0 con 0x562c5d74ebb0 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb84c15d740 1 -- 172.21.15.42:0/708264012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb82c03d770 con 0x562c5d74ebb0 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb822ffd640 1 -- 172.21.15.42:0/708264012 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb82c041070 con 0x562c5d74ebb0 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb84c15d740 10 client.15177 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.574+0000 7fb84c15d740 1 -- 172.21.15.42:0/708264012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562c5d768b20 con 0x562c5d74ebb0 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.575+0000 7fb822ffd640 1 -- 172.21.15.42:0/708264012 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb82c03d770 con 0x562c5d74ebb0 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.575+0000 7fb822ffd640 1 -- 172.21.15.42:0/708264012 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb82c054070 con 0x562c5d74ebb0 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.575+0000 7fb84c15d740 10 client.15177 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.575+0000 7fb84c15d740 10 client.15177 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.575+0000 7fb84c15d740 20 client.15177 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.575+0000 7fb84c15d740 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x562c5d75e390 0x562c5d7cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.575+0000 7fb84c15d740 4 client.15177 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.575+0000 7fb84c15d740 1 -- 172.21.15.42:0/708264012 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "status"}) -- 0x562c5d6b1b10 con 0x562c5d75e390 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.575+0000 7fb8437fe640 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x562c5d75e390 0x562c5d7cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb8437fe640 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x562c5d75e390 0x562c5d7cc2d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ec03e98039aa39a server_cookie=abf08bc5cb148aa in_seq=0 out_seq=0 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb822ffd640 10 client.15177 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb822ffd640 1 -- 172.21.15.42:0/708264012 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562c5d6b1b10 con 0x562c5d75e390 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb822ffd640 10 client.15177 handle_command_reply: tid=0 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 client.15177 shutdown 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 -- 172.21.15.42:0/708264012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 msgr2=0x562c5d748450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d748450 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb82c02a9a0 tx=0x7fb82c064040 comp rx=0 tx=0).stop 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 -- 172.21.15.42:0/708264012 shutdown_connections 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x562c5d75e390 0x562c5d7cc2d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c5d74ebb0 0x562c5d748450 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562c5d7442f0 0x562c5d747f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 --2- 172.21.15.42:0/708264012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562c5d7439d0 0x562c5d7479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb822ffd640 0 client.15177 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 -- 172.21.15.42:0/708264012 >> 172.21.15.42:0/708264012 conn(0x562c5d73ff60 msgr2=0x562c5d746580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 -- 172.21.15.42:0/708264012 shutdown_connections 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 1 -- 172.21.15.42:0/708264012 wait complete. 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.576+0000 7fb84c15d740 20 client.15177 trim_cache size 0 max 16384 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 2, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24473, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 90.600943302000005, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 27, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 120.094716132 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 -- 172.21.15.42:0/4122698634 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8300a32d0 msgr2=0x7fb8300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8300a32d0 0x7fb8300a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0ccc50 tx=0x7fb83c004a40 comp rx=0 tx=0).stop 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 -- 172.21.15.42:0/4122698634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb844102ef0 msgr2=0x7fb84419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb844102ef0 0x7fb84419cf40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00b970 tx=0x7fb83c00be30 comp rx=0 tx=0).stop 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 -- 172.21.15.42:0/4122698634 shutdown_connections 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8300a32d0 0x7fb8300a5790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb844102ef0 0x7fb84419cf40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb844102570 0x7fb844198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 --2- 172.21.15.42:0/4122698634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb844100e20 0x7fb844198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 -- 172.21.15.42:0/4122698634 >> 172.21.15.42:0/4122698634 conn(0x7fb8440fc7d0 msgr2=0x7fb84406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 -- 172.21.15.42:0/4122698634 shutdown_connections 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:50.577+0000 7fb849d84640 1 -- 172.21.15.42:0/4122698634 wait complete. 2024-09-19T09:38:51.331 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:38:51.589 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:51.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:51 smithi042 ceph-mon[31223]: pgmap v323: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:51.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:51 smithi171 ceph-mon[35803]: pgmap v323: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:51 smithi136 ceph-mon[34840]: pgmap v323: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:52.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.042+0000 7f5871d4b640 1 -- 172.21.15.42:0/438747877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586c106f10 msgr2=0x7f586c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:52.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.042+0000 7f5871d4b640 1 --2- 172.21.15.42:0/438747877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586c106f10 0x7f586c10ea90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5864009ca0 tx=0x7f586402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.042+0000 7f5871d4b640 1 -- 172.21.15.42:0/438747877 shutdown_connections 2024-09-19T09:38:52.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.042+0000 7f5871d4b640 1 --2- 172.21.15.42:0/438747877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586c106f10 0x7f586c10ea90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.042+0000 7f5871d4b640 1 --2- 172.21.15.42:0/438747877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f586c102790 0x7f586c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.042+0000 7f5871d4b640 1 --2- 172.21.15.42:0/438747877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586c101de0 0x7f586c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.042+0000 7f5871d4b640 1 -- 172.21.15.42:0/438747877 >> 172.21.15.42:0/438747877 conn(0x7f586c0fd8c0 msgr2=0x7f586c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:52.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.042+0000 7f5871d4b640 1 -- 172.21.15.42:0/438747877 shutdown_connections 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.042+0000 7f5871d4b640 1 -- 172.21.15.42:0/438747877 wait complete. 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5871d4b640 1 Processor -- start 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5871d4b640 1 -- start start 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5871d4b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f586c101de0 0x7f586c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5871d4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586c102790 0x7f586c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5871d4b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586c106f10 0x7f586c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5871d4b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f586c111f90 con 0x7f586c102790 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5871d4b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f586c111e10 con 0x7f586c101de0 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5871d4b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f586c112110 con 0x7f586c106f10 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5863fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586c102790 0x7f586c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5863fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586c102790 0x7f586c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34470/0 (socket says 172.21.15.42:34470) 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f5863fff640 1 -- 172.21.15.42:0/610335784 learned_addr learned my addr 172.21.15.42:0/610335784 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:52.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.043+0000 7f586b7fe640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f586c101de0 0x7f586c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.044+0000 7f586bfff640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586c106f10 0x7f586c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.044+0000 7f586b7fe640 1 -- 172.21.15.42:0/610335784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586c106f10 msgr2=0x7f586c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:52.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.044+0000 7f586b7fe640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586c106f10 0x7f586c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.044+0000 7f586b7fe640 1 -- 172.21.15.42:0/610335784 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586c102790 msgr2=0x7f586c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:52.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.044+0000 7f586b7fe640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586c102790 0x7f586c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.044+0000 7f586b7fe640 1 -- 172.21.15.42:0/610335784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586c19d420 con 0x7f586c101de0 2024-09-19T09:38:52.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.044+0000 7f586b7fe640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f586c101de0 0x7f586c198470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f585c00b3f0 tx=0x7f585c00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:52.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.044+0000 7f58697fa640 1 -- 172.21.15.42:0/610335784 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c015020 con 0x7f586c101de0 2024-09-19T09:38:52.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.044+0000 7f5871d4b640 1 -- 172.21.15.42:0/610335784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586c19d710 con 0x7f586c101de0 2024-09-19T09:38:52.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.044+0000 7f58697fa640 1 -- 172.21.15.42:0/610335784 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f585c011d10 con 0x7f586c101de0 2024-09-19T09:38:52.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.045+0000 7f58697fa640 1 -- 172.21.15.42:0/610335784 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c00f2e0 con 0x7f586c101de0 2024-09-19T09:38:52.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.045+0000 7f5871d4b640 1 -- 172.21.15.42:0/610335784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586c1a4ff0 con 0x7f586c101de0 2024-09-19T09:38:52.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f5874124740 1 Processor -- start 2024-09-19T09:38:52.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f5874124740 1 -- start start 2024-09-19T09:38:52.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f58697fa640 1 -- 172.21.15.42:0/610335784 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f585c018020 con 0x7f586c101de0 2024-09-19T09:38:52.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f5874124740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f462cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f5874124740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4631f0 0x55c26f471a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f5874124740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 0x55c26f4743b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f5874124740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c26f3c9090 con 0x55c26f4631f0 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f5874124740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c26f370a70 con 0x55c26f471fc0 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f5874124740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c26f3c5050 con 0x55c26f4628d0 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f586b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4631f0 0x55c26f471a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f586b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4631f0 0x55c26f471a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34476/0 (socket says 172.21.15.42:34476) 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.047+0000 7f586b7fe640 1 -- 172.21.15.42:0/147836621 learned_addr learned my addr 172.21.15.42:0/147836621 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f586bfff640 1 --2- 172.21.15.42:0/147836621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f462cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f5863fff640 1 --2- 172.21.15.42:0/147836621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 0x55c26f4743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f586b7fe640 1 -- 172.21.15.42:0/147836621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 msgr2=0x55c26f462cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f586b7fe640 1 --2- 172.21.15.42:0/147836621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f462cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f586b7fe640 1 -- 172.21.15.42:0/147836621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 msgr2=0x55c26f4743b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f586b7fe640 1 --2- 172.21.15.42:0/147836621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 0x55c26f4743b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f586b7fe640 1 -- 172.21.15.42:0/147836621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26f37d130 con 0x55c26f4631f0 2024-09-19T09:38:52.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f586b7fe640 1 --2- 172.21.15.42:0/147836621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4631f0 0x55c26f471a80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f585c0ccbc0 tx=0x7f585c0d78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1070428634e659 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:52.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f58697fa640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58580a32d0 0x7f58580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f5861ffb640 1 -- 172.21.15.42:0/147836621 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c0e2070 con 0x55c26f4631f0 2024-09-19T09:38:52.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f586bfff640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58580a32d0 0x7f58580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f5861ffb640 1 -- 172.21.15.42:0/147836621 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f585c09be90 con 0x55c26f4631f0 2024-09-19T09:38:52.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f5861ffb640 1 -- 172.21.15.42:0/147836621 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c084b10 con 0x55c26f4631f0 2024-09-19T09:38:52.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.048+0000 7f58697fa640 1 -- 172.21.15.42:0/610335784 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f585c0cf1e0 con 0x7f586c101de0 2024-09-19T09:38:52.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.049+0000 7f5874124740 1 -- 172.21.15.42:0/147836621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4631f0 msgr2=0x55c26f471a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.049+0000 7f586bfff640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58580a32d0 0x7f58580a5790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5864006010 tx=0x7f586402f310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.049+0000 7f5874124740 1 --2- 172.21.15.42:0/147836621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4631f0 0x55c26f471a80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f585c0ccbc0 tx=0x7f585c0d78c0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.049+0000 7f5874124740 1 -- 172.21.15.42:0/147836621 shutdown_connections 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.049+0000 7f5874124740 1 --2- 172.21.15.42:0/147836621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 0x55c26f4743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.049+0000 7f5874124740 1 --2- 172.21.15.42:0/147836621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4631f0 0x55c26f471a80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.049+0000 7f5874124740 1 --2- 172.21.15.42:0/147836621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f462cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.049+0000 7f5874124740 1 -- 172.21.15.42:0/147836621 >> 172.21.15.42:0/147836621 conn(0x55c26f45ef60 msgr2=0x55c26f45f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.049+0000 7f5874124740 1 -- 172.21.15.42:0/147836621 shutdown_connections 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.049+0000 7f5874124740 1 -- 172.21.15.42:0/147836621 wait complete. 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f5874124740 1 -- start start 2024-09-19T09:38:52.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f5874124740 1 Processor -- start 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f5874124740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f4717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f5874124740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f4631f0 0x55c26f46eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f5874124740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f46f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f5874124740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c26f474a70 con 0x55c26f471fc0 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f5874124740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c26f383f20 con 0x55c26f4631f0 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f5874124740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c26f474bf0 con 0x55c26f4628d0 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f5874124740 10 client.0 _ll_register_callbacks cb 0x55c26f34d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f586bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f46f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f586bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f46f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34478/0 (socket says 172.21.15.42:34478) 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f586bfff640 1 -- 172.21.15.42:0/2382199493 learned_addr learned my addr 172.21.15.42:0/2382199493 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f586b7fe640 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f4717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.050+0000 7f5863fff640 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f4631f0 0x55c26f46eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f586bfff640 1 -- 172.21.15.42:0/2382199493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 msgr2=0x55c26f4717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f586bfff640 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f4717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f586bfff640 1 -- 172.21.15.42:0/2382199493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f4631f0 msgr2=0x55c26f46eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f586bfff640 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f4631f0 0x55c26f46eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f586bfff640 1 -- 172.21.15.42:0/2382199493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26f13a2b0 con 0x55c26f471fc0 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f586bfff640 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f46f070 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5864035000 tx=0x7f586402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c073bc205abc1725 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f584affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f584affd640 1 -- 172.21.15.42:0/2382199493 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5864004250 con 0x55c26f471fc0 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f584affd640 1 -- 172.21.15.42:0/2382199493 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f58640043f0 con 0x55c26f471fc0 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f5874124740 1 -- 172.21.15.42:0/2382199493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f585c09be90 con 0x55c26f471fc0 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f584affd640 1 -- 172.21.15.42:0/2382199493 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5864058070 con 0x55c26f471fc0 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f5874124740 10 client.15189 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f5874124740 1 -- 172.21.15.42:0/2382199493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c26f480390 con 0x55c26f471fc0 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.051+0000 7f584affd640 1 -- 172.21.15.42:0/2382199493 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f585c09be90 con 0x55c26f471fc0 2024-09-19T09:38:52.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.052+0000 7f584affd640 1 -- 172.21.15.42:0/2382199493 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f58640305c0 con 0x55c26f471fc0 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.052+0000 7f5874124740 10 client.15189 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.052+0000 7f5874124740 10 client.15189 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.052+0000 7f5874124740 20 client.15189 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.052+0000 7f5874124740 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55c26f482a60 0x55c26f483ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.052+0000 7f5874124740 4 client.15189 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.052+0000 7f5874124740 1 -- 172.21.15.42:0/2382199493 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c26f3d6600 con 0x55c26f482a60 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.052+0000 7f586b7fe640 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55c26f482a60 0x55c26f483ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.052+0000 7f584affd640 10 client.15189 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.052+0000 7f586b7fe640 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55c26f482a60 0x55c26f483ed0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c8d228751776ef4d server_cookie=1bfa178c10581277 in_seq=0 out_seq=0 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f584affd640 1 -- 172.21.15.42:0/2382199493 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c26f3d6600 con 0x55c26f482a60 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f584affd640 10 client.15189 handle_command_reply: tid=0 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f5874124740 1 client.15189 shutdown 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f5874124740 1 -- 172.21.15.42:0/2382199493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 msgr2=0x55c26f46f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f5874124740 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f46f070 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5864035000 tx=0x7f586402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f5874124740 1 -- 172.21.15.42:0/2382199493 shutdown_connections 2024-09-19T09:38:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f5874124740 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55c26f482a60 0x55c26f483ed0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f5874124740 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f46f070 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f5874124740 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f4631f0 0x55c26f46eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f5874124740 1 --2- 172.21.15.42:0/2382199493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f4717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f5874124740 1 -- 172.21.15.42:0/2382199493 >> 172.21.15.42:0/2382199493 conn(0x55c26f45ef60 msgr2=0x55c26f464cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.053+0000 7f584affd640 0 client.15189 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:38:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.054+0000 7f5874124740 1 -- 172.21.15.42:0/2382199493 shutdown_connections 2024-09-19T09:38:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.054+0000 7f5874124740 1 -- 172.21.15.42:0/2382199493 wait complete. 2024-09-19T09:38:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.054+0000 7f5874124740 20 client.15189 trim_cache size 0 max 16384 2024-09-19T09:38:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.071+0000 7f5874124740 1 Processor -- start 2024-09-19T09:38:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.071+0000 7f5874124740 1 -- start start 2024-09-19T09:38:52.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f5874124740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4628d0 0x55c26f483800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f5874124740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4631f0 0x55c26f46e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f5874124740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 0x55c26f4717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f5874124740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c26f482210 con 0x55c26f4628d0 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f5874124740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c26f4828e0 con 0x55c26f471fc0 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f5874124740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c26f482fb0 con 0x55c26f4631f0 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4628d0 0x55c26f483800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4628d0 0x55c26f483800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34484/0 (socket says 172.21.15.42:34484) 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586b7fe640 1 -- 172.21.15.42:0/1685228514 learned_addr learned my addr 172.21.15.42:0/1685228514 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f5863fff640 1 --2- 172.21.15.42:0/1685228514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4631f0 0x55c26f46e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586bfff640 1 --2- 172.21.15.42:0/1685228514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 0x55c26f4717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586b7fe640 1 -- 172.21.15.42:0/1685228514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4631f0 msgr2=0x55c26f46e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586b7fe640 1 --2- 172.21.15.42:0/1685228514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4631f0 0x55c26f46e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586b7fe640 1 -- 172.21.15.42:0/1685228514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 msgr2=0x55c26f4717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586b7fe640 1 --2- 172.21.15.42:0/1685228514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 0x55c26f4717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586b7fe640 1 -- 172.21.15.42:0/1685228514 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26f45ed90 con 0x55c26f4628d0 2024-09-19T09:38:52.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586bfff640 1 --2- 172.21.15.42:0/1685228514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 0x55c26f4717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:52.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.072+0000 7f586b7fe640 1 --2- 172.21.15.42:0/1685228514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4628d0 0x55c26f483800 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f585c09b720 tx=0x7f585c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb4ca558dcd9592 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:52.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.073+0000 7f58617fa640 1 -- 172.21.15.42:0/1685228514 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c088b10 con 0x55c26f4628d0 2024-09-19T09:38:52.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.073+0000 7f58617fa640 1 -- 172.21.15.42:0/1685228514 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f585c0ce040 con 0x55c26f4628d0 2024-09-19T09:38:52.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.073+0000 7f58617fa640 1 -- 172.21.15.42:0/1685228514 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c085f10 con 0x55c26f4628d0 2024-09-19T09:38:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.073+0000 7f5874124740 1 -- 172.21.15.42:0/1685228514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4628d0 msgr2=0x55c26f483800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.073+0000 7f5874124740 1 --2- 172.21.15.42:0/1685228514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4628d0 0x55c26f483800 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f585c09b720 tx=0x7f585c0047d0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.074+0000 7f5874124740 1 -- 172.21.15.42:0/1685228514 shutdown_connections 2024-09-19T09:38:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.074+0000 7f5874124740 1 --2- 172.21.15.42:0/1685228514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f471fc0 0x55c26f4717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.074+0000 7f5874124740 1 --2- 172.21.15.42:0/1685228514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4631f0 0x55c26f46e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.074+0000 7f5874124740 1 --2- 172.21.15.42:0/1685228514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f4628d0 0x55c26f483800 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.074+0000 7f5874124740 1 -- 172.21.15.42:0/1685228514 >> 172.21.15.42:0/1685228514 conn(0x55c26f45ef60 msgr2=0x55c26f45f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.074+0000 7f5874124740 1 -- 172.21.15.42:0/1685228514 shutdown_connections 2024-09-19T09:38:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.074+0000 7f5874124740 1 -- 172.21.15.42:0/1685228514 wait complete. 2024-09-19T09:38:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.074+0000 7f5874124740 1 -- start start 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.074+0000 7f5874124740 1 Processor -- start 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f5874124740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f48c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f5874124740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f4631f0 0x55c26f48ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f5874124740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f48a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f5874124740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c26f483d50 con 0x55c26f471fc0 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f5874124740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c26f483680 con 0x55c26f4631f0 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f5874124740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c26f484420 con 0x55c26f4628d0 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f5874124740 10 client.0 _ll_register_callbacks cb 0x7f5864009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f586bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f48a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f586bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f48a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34498/0 (socket says 172.21.15.42:34498) 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f586bfff640 1 -- 172.21.15.42:0/2107902355 learned_addr learned my addr 172.21.15.42:0/2107902355 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f5863fff640 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f4631f0 0x55c26f48ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f586b7fe640 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f48c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f586bfff640 1 -- 172.21.15.42:0/2107902355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 msgr2=0x55c26f48c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f586bfff640 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f48c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f586bfff640 1 -- 172.21.15.42:0/2107902355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f4631f0 msgr2=0x55c26f48ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f586bfff640 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f4631f0 0x55c26f48ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f586bfff640 1 -- 172.21.15.42:0/2107902355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26f48ab90 con 0x55c26f471fc0 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f586bfff640 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f48a360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5864042040 tx=0x7f5864030870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2311a2e429a72fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.075+0000 7f584affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f584affd640 1 -- 172.21.15.42:0/2107902355 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5864061020 con 0x55c26f471fc0 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f584affd640 1 -- 172.21.15.42:0/2107902355 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f5864004450 con 0x55c26f471fc0 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f5874124740 1 -- 172.21.15.42:0/2107902355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f585c0ce040 con 0x55c26f471fc0 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f584affd640 1 -- 172.21.15.42:0/2107902355 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f586406c050 con 0x55c26f471fc0 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f5874124740 10 client.15195 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:52.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f5874124740 1 -- 172.21.15.42:0/2107902355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c26f4ebde0 con 0x55c26f471fc0 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f584affd640 1 -- 172.21.15.42:0/2107902355 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f585c0ce040 con 0x55c26f471fc0 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f584affd640 1 -- 172.21.15.42:0/2107902355 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f586402fb80 con 0x55c26f471fc0 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f5874124740 10 client.15195 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f5874124740 10 client.15195 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f5874124740 20 client.15195 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f5874124740 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55c26f4f0a30 0x55c26f4ef740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f5874124740 4 client.15195 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.076+0000 7f5874124740 1 -- 172.21.15.42:0/2107902355 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "status"}) -- 0x55c26f3d0b10 con 0x55c26f4f0a30 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.077+0000 7f586b7fe640 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55c26f4f0a30 0x55c26f4ef740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.077+0000 7f584affd640 10 client.15195 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.077+0000 7f586b7fe640 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55c26f4f0a30 0x55c26f4ef740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b0d68502e43c35c server_cookie=9bf6983c4531629 in_seq=0 out_seq=0 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.077+0000 7f584affd640 1 -- 172.21.15.42:0/2107902355 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c26f3d0b10 con 0x55c26f4f0a30 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.077+0000 7f584affd640 10 client.15195 handle_command_reply: tid=0 2024-09-19T09:38:52.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.077+0000 7f5874124740 1 client.15195 shutdown 2024-09-19T09:38:52.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 1 -- 172.21.15.42:0/2107902355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 msgr2=0x55c26f48a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f48a360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5864042040 tx=0x7f5864030870 comp rx=0 tx=0).stop 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 1 -- 172.21.15.42:0/2107902355 shutdown_connections 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55c26f4f0a30 0x55c26f4ef740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c26f471fc0 0x55c26f48a360 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26f4631f0 0x55c26f48ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 1 --2- 172.21.15.42:0/2107902355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c26f4628d0 0x55c26f48c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 1 -- 172.21.15.42:0/2107902355 >> 172.21.15.42:0/2107902355 conn(0x55c26f45ef60 msgr2=0x55c26f459ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f584affd640 0 client.15195 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 1 -- 172.21.15.42:0/2107902355 shutdown_connections 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 1 -- 172.21.15.42:0/2107902355 wait complete. 2024-09-19T09:38:52.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5874124740 20 client.15195 trim_cache size 0 max 16384 2024-09-19T09:38:52.085 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:38:52.085 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:52.085 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 1, 2024-09-19T09:38:52.085 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24478, 2024-09-19T09:38:52.085 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:38:52.085 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:38:52.085 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:38:52.085 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 93.109041700000006, 2024-09-19T09:38:52.085 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 27, 2024-09-19T09:38:52.085 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:38:52.086 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T09:38:52.086 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 119.106118172 2024-09-19T09:38:52.086 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:38:52.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5871d4b640 1 -- 172.21.15.42:0/610335784 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58580a32d0 msgr2=0x7f58580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:52.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5871d4b640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58580a32d0 0x7f58580a5790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5864006010 tx=0x7f586402f310 comp rx=0 tx=0).stop 2024-09-19T09:38:52.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5871d4b640 1 -- 172.21.15.42:0/610335784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f586c101de0 msgr2=0x7f586c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:52.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.078+0000 7f5871d4b640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f586c101de0 0x7f586c198470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f585c00b3f0 tx=0x7f585c00b8b0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.079+0000 7f5871d4b640 1 -- 172.21.15.42:0/610335784 shutdown_connections 2024-09-19T09:38:52.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.079+0000 7f5871d4b640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58580a32d0 0x7f58580a5790 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.079+0000 7f5871d4b640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586c106f10 0x7f586c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.079+0000 7f5871d4b640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586c102790 0x7f586c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.079+0000 7f5871d4b640 1 --2- 172.21.15.42:0/610335784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f586c101de0 0x7f586c198470 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:52.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.079+0000 7f5871d4b640 1 -- 172.21.15.42:0/610335784 >> 172.21.15.42:0/610335784 conn(0x7f586c0fd8c0 msgr2=0x7f586c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:52.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.079+0000 7f5871d4b640 1 -- 172.21.15.42:0/610335784 shutdown_connections 2024-09-19T09:38:52.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:52.079+0000 7f5871d4b640 1 -- 172.21.15.42:0/610335784 wait complete. 2024-09-19T09:38:52.767 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:38:53.030 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.504+0000 7f2d6df94640 1 -- 172.21.15.42:0/1152289604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d68102d40 msgr2=0x7f2d68103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.504+0000 7f2d6df94640 1 --2- 172.21.15.42:0/1152289604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d68102d40 0x7f2d68103120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009900 tx=0x7f2d5802a480 comp rx=0 tx=0).stop 2024-09-19T09:38:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.504+0000 7f2d6df94640 1 -- 172.21.15.42:0/1152289604 shutdown_connections 2024-09-19T09:38:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.504+0000 7f2d6df94640 1 --2- 172.21.15.42:0/1152289604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d6810c170 0x7f2d6810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.504+0000 7f2d6df94640 1 --2- 172.21.15.42:0/1152289604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d68103660 0x7f2d6810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.504+0000 7f2d6df94640 1 --2- 172.21.15.42:0/1152289604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d68102d40 0x7f2d68103120 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.504+0000 7f2d6df94640 1 -- 172.21.15.42:0/1152289604 >> 172.21.15.42:0/1152289604 conn(0x7f2d680fc7a0 msgr2=0x7f2d680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.504+0000 7f2d6df94640 1 -- 172.21.15.42:0/1152289604 shutdown_connections 2024-09-19T09:38:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.504+0000 7f2d6df94640 1 -- 172.21.15.42:0/1152289604 wait complete. 2024-09-19T09:38:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d6df94640 1 Processor -- start 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d6df94640 1 -- start start 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d6df94640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d68102d40 0x7f2d68198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d6df94640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d68103660 0x7f2d68198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d6df94640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d6810c170 0x7f2d6819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d6df94640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2d68111fb0 con 0x7f2d68103660 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d6df94640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2d68111e30 con 0x7f2d68102d40 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d6df94640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2d68112130 con 0x7f2d6810c170 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d68103660 0x7f2d68198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d68103660 0x7f2d68198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34516/0 (socket says 172.21.15.42:34516) 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d66ffd640 1 -- 172.21.15.42:0/4206437960 learned_addr learned my addr 172.21.15.42:0/4206437960 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.505+0000 7f2d66ffd640 1 -- 172.21.15.42:0/4206437960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d6810c170 msgr2=0x7f2d6819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d67fff640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d6810c170 0x7f2d6819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d677fe640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d68102d40 0x7f2d68198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d6810c170 0x7f2d6819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d66ffd640 1 -- 172.21.15.42:0/4206437960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d68102d40 msgr2=0x7f2d68198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d68102d40 0x7f2d68198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d66ffd640 1 -- 172.21.15.42:0/4206437960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6819d4c0 con 0x7f2d68103660 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d67fff640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d6810c170 0x7f2d6819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d68103660 0x7f2d68198a50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00b3f0 tx=0x7f2d5c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d64ff9640 1 -- 172.21.15.42:0/4206437960 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c015020 con 0x7f2d68103660 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d64ff9640 1 -- 172.21.15.42:0/4206437960 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d5c011d10 con 0x7f2d68103660 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d6df94640 1 -- 172.21.15.42:0/4206437960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6819d7b0 con 0x7f2d68103660 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d64ff9640 1 -- 172.21.15.42:0/4206437960 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00f2e0 con 0x7f2d68103660 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.506+0000 7f2d6df94640 1 -- 172.21.15.42:0/4206437960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d681a5090 con 0x7f2d68103660 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.508+0000 7f2d64ff9640 1 -- 172.21.15.42:0/4206437960 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2d5c018020 con 0x7f2d68103660 2024-09-19T09:38:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.508+0000 7f2d7036d740 1 Processor -- start 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d7036d740 1 -- start start 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7830239d0 0x55a783023db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a78302ebb0 0x55a783030fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d7036d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a782f8a090 con 0x55a7830242f0 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d7036d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a782f31a70 con 0x55a78302ebb0 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d7036d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a782f86050 con 0x55a7830239d0 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34518/0 (socket says 172.21.15.42:34518) 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d67fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7830239d0 0x55a783023db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d677fe640 1 -- 172.21.15.42:0/128859859 learned_addr learned my addr 172.21.15.42:0/128859859 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d64ff9640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2d500a32d0 0x7f2d500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/128859859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a78302ebb0 0x55a783030fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d67fff640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2d500a32d0 0x7f2d500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d677fe640 1 -- 172.21.15.42:0/128859859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7830239d0 msgr2=0x55a783023db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d677fe640 1 --2- 172.21.15.42:0/128859859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7830239d0 0x55a783023db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d677fe640 1 -- 172.21.15.42:0/128859859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a78302ebb0 msgr2=0x55a783030fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d677fe640 1 --2- 172.21.15.42:0/128859859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a78302ebb0 0x55a783030fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.509+0000 7f2d677fe640 1 -- 172.21.15.42:0/128859859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a782f3e130 con 0x55a7830242f0 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.510+0000 7f2d64ff9640 1 -- 172.21.15.42:0/4206437960 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2d5c0cf350 con 0x7f2d68103660 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.510+0000 7f2d677fe640 1 --2- 172.21.15.42:0/128859859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302e670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2d58006010 tx=0x7f2d58032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e05c4de016adf65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.510+0000 7f2d67fff640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2d500a32d0 0x7f2d500a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2d60005fd0 tx=0x7f2d60004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.510+0000 7f2d4dffb640 1 -- 172.21.15.42:0/128859859 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5803f070 con 0x55a7830242f0 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.510+0000 7f2d4dffb640 1 -- 172.21.15.42:0/128859859 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d580317b0 con 0x55a7830242f0 2024-09-19T09:38:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.510+0000 7f2d4dffb640 1 -- 172.21.15.42:0/128859859 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58035070 con 0x55a7830242f0 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 -- 172.21.15.42:0/128859859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 msgr2=0x55a78302e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 --2- 172.21.15.42:0/128859859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302e670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2d58006010 tx=0x7f2d58032ce0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 -- 172.21.15.42:0/128859859 shutdown_connections 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 --2- 172.21.15.42:0/128859859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a78302ebb0 0x55a783030fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 --2- 172.21.15.42:0/128859859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302e670 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 --2- 172.21.15.42:0/128859859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7830239d0 0x55a783023db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 -- 172.21.15.42:0/128859859 >> 172.21.15.42:0/128859859 conn(0x55a78301ff60 msgr2=0x55a783020340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 -- 172.21.15.42:0/128859859 shutdown_connections 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 -- 172.21.15.42:0/128859859 wait complete. 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 -- start start 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.511+0000 7f2d7036d740 1 Processor -- start 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a78302e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a78302ebb0 0x55a78302bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d7036d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a783031780 con 0x55a7830242f0 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d7036d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a782f44f20 con 0x55a7830239d0 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d7036d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a783031900 con 0x55a78302ebb0 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d7036d740 10 client.0 _ll_register_callbacks cb 0x55a782f0e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34530/0 (socket says 172.21.15.42:34530) 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d66ffd640 1 -- 172.21.15.42:0/1646026696 learned_addr learned my addr 172.21.15.42:0/1646026696 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d677fe640 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a78302e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d67fff640 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a78302ebb0 0x55a78302bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d66ffd640 1 -- 172.21.15.42:0/1646026696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a78302ebb0 msgr2=0x55a78302bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a78302ebb0 0x55a78302bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d66ffd640 1 -- 172.21.15.42:0/1646026696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 msgr2=0x55a78302e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a78302e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d66ffd640 1 -- 172.21.15.42:0/1646026696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a782cfb2b0 con 0x55a7830242f0 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302b6d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c097d00 tx=0x7f2d5c06d670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11a7701bc8f2f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d46ffd640 1 -- 172.21.15.42:0/1646026696 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c010eb0 con 0x55a7830242f0 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d46ffd640 1 -- 172.21.15.42:0/1646026696 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2d5c097f10 con 0x55a7830242f0 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.512+0000 7f2d7036d740 1 -- 172.21.15.42:0/1646026696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d580317b0 con 0x55a7830242f0 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d46ffd640 1 -- 172.21.15.42:0/1646026696 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2d5c09bfa0 con 0x55a7830242f0 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d7036d740 10 client.15207 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d7036d740 1 -- 172.21.15.42:0/1646026696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a78303d060 con 0x55a7830242f0 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d46ffd640 1 -- 172.21.15.42:0/1646026696 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d580317b0 con 0x55a7830242f0 2024-09-19T09:38:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d46ffd640 1 -- 172.21.15.42:0/1646026696 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2d5c0cced0 con 0x55a7830242f0 2024-09-19T09:38:53.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d7036d740 10 client.15207 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:53.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d7036d740 10 client.15207 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:38:53.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d7036d740 20 client.15207 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:53.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d7036d740 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a78303f680 0x55a783040af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d7036d740 4 client.15207 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:53.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.513+0000 7f2d7036d740 1 -- 172.21.15.42:0/1646026696 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a782f97600 con 0x55a78303f680 2024-09-19T09:38:53.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.514+0000 7f2d677fe640 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a78303f680 0x55a783040af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.514+0000 7f2d46ffd640 10 client.15207 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:38:53.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.514+0000 7f2d677fe640 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a78303f680 0x55a783040af0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=848bb53e4e23716c server_cookie=b7846ebdd0f6065b in_seq=0 out_seq=0 2024-09-19T09:38:53.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d46ffd640 1 -- 172.21.15.42:0/1646026696 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a782f97600 con 0x55a78303f680 2024-09-19T09:38:53.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d46ffd640 10 client.15207 handle_command_reply: tid=0 2024-09-19T09:38:53.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 client.15207 shutdown 2024-09-19T09:38:53.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 -- 172.21.15.42:0/1646026696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 msgr2=0x55a78302b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302b6d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c097d00 tx=0x7f2d5c06d670 comp rx=0 tx=0).stop 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 -- 172.21.15.42:0/1646026696 shutdown_connections 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a78303f680 0x55a783040af0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a78302ebb0 0x55a78302bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78302b6d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 --2- 172.21.15.42:0/1646026696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a78302e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 -- 172.21.15.42:0/1646026696 >> 172.21.15.42:0/1646026696 conn(0x55a78301ff60 msgr2=0x55a783025c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d46ffd640 0 client.15207 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 -- 172.21.15.42:0/1646026696 shutdown_connections 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.515+0000 7f2d7036d740 1 -- 172.21.15.42:0/1646026696 wait complete. 2024-09-19T09:38:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.516+0000 7f2d7036d740 20 client.15207 trim_cache size 0 max 16384 2024-09-19T09:38:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.533+0000 7f2d7036d740 1 Processor -- start 2024-09-19T09:38:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.533+0000 7f2d7036d740 1 -- start start 2024-09-19T09:38:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.533+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a78303f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.533+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78303ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.533+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a78302ebb0 0x55a783029fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d7036d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a78303ee30 con 0x55a7830242f0 2024-09-19T09:38:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d7036d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a78303f500 con 0x55a7830239d0 2024-09-19T09:38:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d7036d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a78303fbd0 con 0x55a78302ebb0 2024-09-19T09:38:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78303ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78303ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34544/0 (socket says 172.21.15.42:34544) 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d66ffd640 1 -- 172.21.15.42:0/942904414 learned_addr learned my addr 172.21.15.42:0/942904414 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d67fff640 1 --2- 172.21.15.42:0/942904414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a78302ebb0 0x55a783029fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d677fe640 1 --2- 172.21.15.42:0/942904414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a78303f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d66ffd640 1 -- 172.21.15.42:0/942904414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a78302ebb0 msgr2=0x55a783029fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/942904414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a78302ebb0 0x55a783029fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d66ffd640 1 -- 172.21.15.42:0/942904414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 msgr2=0x55a78303f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/942904414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a78303f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d66ffd640 1 -- 172.21.15.42:0/942904414 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a78302e6f0 con 0x55a7830242f0 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/942904414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78303ab60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c099b50 tx=0x7f2d5c099db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef35ea93bcbe3f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d4d7fa640 1 -- 172.21.15.42:0/942904414 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c09b200 con 0x55a7830242f0 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d4d7fa640 1 -- 172.21.15.42:0/942904414 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d5c010eb0 con 0x55a7830242f0 2024-09-19T09:38:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.534+0000 7f2d4d7fa640 1 -- 172.21.15.42:0/942904414 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c09fc50 con 0x55a7830242f0 2024-09-19T09:38:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 -- 172.21.15.42:0/942904414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 msgr2=0x55a78303ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 --2- 172.21.15.42:0/942904414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78303ab60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c099b50 tx=0x7f2d5c099db0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 -- 172.21.15.42:0/942904414 shutdown_connections 2024-09-19T09:38:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 --2- 172.21.15.42:0/942904414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a78302ebb0 0x55a783029fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 --2- 172.21.15.42:0/942904414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7830242f0 0x55a78303ab60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 --2- 172.21.15.42:0/942904414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a78303f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 -- 172.21.15.42:0/942904414 >> 172.21.15.42:0/942904414 conn(0x55a78301ff60 msgr2=0x55a78301ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 -- 172.21.15.42:0/942904414 shutdown_connections 2024-09-19T09:38:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 -- 172.21.15.42:0/942904414 wait complete. 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 -- start start 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.535+0000 7f2d7036d740 1 Processor -- start 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a783047660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7830242f0 0x55a783047ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d7036d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a78302ebb0 0x55a783041cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d7036d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a783040970 con 0x55a78302ebb0 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d7036d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a7830402a0 con 0x55a7830239d0 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d7036d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a783041040 con 0x55a7830242f0 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d7036d740 10 client.0 _ll_register_callbacks cb 0x7f2d5c00b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d67fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a78302ebb0 0x55a783041cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d677fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a783047660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d67fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a78302ebb0 0x55a783041cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34554/0 (socket says 172.21.15.42:34554) 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d67fff640 1 -- 172.21.15.42:0/3686627730 learned_addr learned my addr 172.21.15.42:0/3686627730 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d66ffd640 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7830242f0 0x55a783047ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d67fff640 1 -- 172.21.15.42:0/3686627730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7830242f0 msgr2=0x55a783047ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d67fff640 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7830242f0 0x55a783047ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d67fff640 1 -- 172.21.15.42:0/3686627730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 msgr2=0x55a783047660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d67fff640 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a783047660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d67fff640 1 -- 172.21.15.42:0/3686627730 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a783048160 con 0x55a78302ebb0 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d67fff640 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a78302ebb0 0x55a783041cf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2d60011eb0 tx=0x7f2d60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5679f40667213cae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.536+0000 7f2d46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d46ffd640 1 -- 172.21.15.42:0/3686627730 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60027020 con 0x55a78302ebb0 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d46ffd640 1 -- 172.21.15.42:0/3686627730 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2d60023890 con 0x55a78302ebb0 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d7036d740 1 -- 172.21.15.42:0/3686627730 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a782f91b10 con 0x55a78302ebb0 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d46ffd640 1 -- 172.21.15.42:0/3686627730 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2d60032050 con 0x55a78302ebb0 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d7036d740 10 client.15213 fetch_fsmap learned FSMap version 27 2024-09-19T09:38:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d7036d740 1 -- 172.21.15.42:0/3686627730 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a783046740 con 0x55a78302ebb0 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d46ffd640 1 -- 172.21.15.42:0/3686627730 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a782f91b10 con 0x55a78302ebb0 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d46ffd640 1 -- 172.21.15.42:0/3686627730 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2d60020050 con 0x55a78302ebb0 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d7036d740 10 client.15213 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d7036d740 10 client.15213 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d7036d740 20 client.15213 populate_metadata read hostname 'smithi042' 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d7036d740 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a7830ade70 0x55a7830acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d7036d740 4 client.15213 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.537+0000 7f2d7036d740 1 -- 172.21.15.42:0/3686627730 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "status"}) -- 0x55a782f0e0e0 con 0x55a7830ade70 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d677fe640 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a7830ade70 0x55a7830acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d46ffd640 10 client.15213 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d677fe640 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a7830ade70 0x55a7830acb80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0e0aebaba5f897 server_cookie=4104e4a9cc6e1ec9 in_seq=0 out_seq=0 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d46ffd640 1 -- 172.21.15.42:0/3686627730 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55a782f0e0e0 con 0x55a7830ade70 2024-09-19T09:38:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d46ffd640 10 client.15213 handle_command_reply: tid=0 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d7036d740 1 client.15213 shutdown 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d7036d740 1 -- 172.21.15.42:0/3686627730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a78302ebb0 msgr2=0x55a783041cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d7036d740 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a78302ebb0 0x55a783041cf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2d60011eb0 tx=0x7f2d60004a40 comp rx=0 tx=0).stop 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d7036d740 1 -- 172.21.15.42:0/3686627730 shutdown_connections 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d7036d740 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a7830ade70 0x55a7830acb80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d7036d740 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a78302ebb0 0x55a783041cf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d7036d740 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7830242f0 0x55a783047ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.538+0000 7f2d7036d740 1 --2- 172.21.15.42:0/3686627730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7830239d0 0x55a783047660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d7036d740 1 -- 172.21.15.42:0/3686627730 >> 172.21.15.42:0/3686627730 conn(0x55a78301ff60 msgr2=0x55a783029f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d46ffd640 0 client.15213 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d7036d740 1 -- 172.21.15.42:0/3686627730 shutdown_connections 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d7036d740 1 -- 172.21.15.42:0/3686627730 wait complete. 2024-09-19T09:38:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d7036d740 20 client.15213 trim_cache size 0 max 16384 2024-09-19T09:38:53.546 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:38:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-19T09:38:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24506, 2024-09-19T09:38:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:38:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:38:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:38:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 101.526505027, 2024-09-19T09:38:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 27, 2024-09-19T09:38:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:38:53.547 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T09:38:53.547 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 112.119876542 2024-09-19T09:38:53.547 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:38:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d6df94640 1 -- 172.21.15.42:0/4206437960 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2d500a32d0 msgr2=0x7f2d500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d6df94640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2d500a32d0 0x7f2d500a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2d60005fd0 tx=0x7f2d60004ab0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d6df94640 1 -- 172.21.15.42:0/4206437960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d68103660 msgr2=0x7f2d68198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d6df94640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d68103660 0x7f2d68198a50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00b3f0 tx=0x7f2d5c00b8b0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d6df94640 1 -- 172.21.15.42:0/4206437960 shutdown_connections 2024-09-19T09:38:53.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d6df94640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2d500a32d0 0x7f2d500a5790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d6df94640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d6810c170 0x7f2d6819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d6df94640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d68103660 0x7f2d68198a50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d6df94640 1 --2- 172.21.15.42:0/4206437960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d68102d40 0x7f2d68198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.539+0000 7f2d6df94640 1 -- 172.21.15.42:0/4206437960 >> 172.21.15.42:0/4206437960 conn(0x7f2d680fc7a0 msgr2=0x7f2d680fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.540+0000 7f2d6df94640 1 -- 172.21.15.42:0/4206437960 shutdown_connections 2024-09-19T09:38:53.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:53.540+0000 7f2d6df94640 1 -- 172.21.15.42:0/4206437960 wait complete. 2024-09-19T09:38:53.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:53 smithi042 ceph-mon[31223]: pgmap v324: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:53.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:53 smithi171 ceph-mon[35803]: pgmap v324: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:53 smithi136 ceph-mon[34840]: pgmap v324: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:54.334 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T09:38:54.344 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T09:38:54.344 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T09:38:54.345 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T09:38:54.345 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T09:38:54.386 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T09:38:54.386 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T09:38:54.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:54.387 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-19T09:38:54.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:54.406 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-09-19T09:38:54.477 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-09-19T09:38:54.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:38:54.479 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-19T09:38:54.479 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:38:54.479 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:54.479 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:38:54.776 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.279+0000 7fb244ac9640 1 -- 172.21.15.42:0/2930913127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240101de0 msgr2=0x7fb2401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.279+0000 7fb244ac9640 1 --2- 172.21.15.42:0/2930913127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240101de0 0x7fb2401021c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb230009900 tx=0x7fb23002a410 comp rx=0 tx=0).stop 2024-09-19T09:38:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.279+0000 7fb244ac9640 1 -- 172.21.15.42:0/2930913127 shutdown_connections 2024-09-19T09:38:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.279+0000 7fb244ac9640 1 --2- 172.21.15.42:0/2930913127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb240106f10 0x7fb24010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.279+0000 7fb244ac9640 1 --2- 172.21.15.42:0/2930913127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb240102790 0x7fb2401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.279+0000 7fb244ac9640 1 --2- 172.21.15.42:0/2930913127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240101de0 0x7fb2401021c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.279+0000 7fb244ac9640 1 -- 172.21.15.42:0/2930913127 >> 172.21.15.42:0/2930913127 conn(0x7fb2400fd8c0 msgr2=0x7fb2400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.280+0000 7fb244ac9640 1 -- 172.21.15.42:0/2930913127 shutdown_connections 2024-09-19T09:38:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.280+0000 7fb244ac9640 1 -- 172.21.15.42:0/2930913127 wait complete. 2024-09-19T09:38:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.280+0000 7fb244ac9640 1 Processor -- start 2024-09-19T09:38:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.280+0000 7fb244ac9640 1 -- start start 2024-09-19T09:38:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb244ac9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240101de0 0x7fb2400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb244ac9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb240102790 0x7fb240074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb244ac9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb240106f10 0x7fb240074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb244ac9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb240111f70 con 0x7fb240101de0 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb244ac9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb240111df0 con 0x7fb240102790 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb244ac9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb2401120f0 con 0x7fb240106f10 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240101de0 0x7fb2400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240101de0 0x7fb2400744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34584/0 (socket says 172.21.15.42:34584) 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23e59c640 1 -- 172.21.15.42:0/1208608502 learned_addr learned my addr 172.21.15.42:0/1208608502 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23dd9b640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb240102790 0x7fb240074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23ed9d640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb240106f10 0x7fb240074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23e59c640 1 -- 172.21.15.42:0/1208608502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb240106f10 msgr2=0x7fb240074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23e59c640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb240106f10 0x7fb240074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23e59c640 1 -- 172.21.15.42:0/1208608502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb240102790 msgr2=0x7fb240074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23e59c640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb240102790 0x7fb240074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23e59c640 1 -- 172.21.15.42:0/1208608502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2401a6990 con 0x7fb240101de0 2024-09-19T09:38:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23dd9b640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb240102790 0x7fb240074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23ed9d640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb240106f10 0x7fb240074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb23e59c640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240101de0 0x7fb2400744f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb230006010 tx=0x7fb2300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.281+0000 7fb22f7fe640 1 -- 172.21.15.42:0/1208608502 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23003f030 con 0x7fb240101de0 2024-09-19T09:38:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.282+0000 7fb244ac9640 1 -- 172.21.15.42:0/1208608502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2401a6c20 con 0x7fb240101de0 2024-09-19T09:38:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.282+0000 7fb22f7fe640 1 -- 172.21.15.42:0/1208608502 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb230003ce0 con 0x7fb240101de0 2024-09-19T09:38:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.282+0000 7fb22f7fe640 1 -- 172.21.15.42:0/1208608502 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230035070 con 0x7fb240101de0 2024-09-19T09:38:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.282+0000 7fb244ac9640 1 -- 172.21.15.42:0/1208608502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2401a7100 con 0x7fb240101de0 2024-09-19T09:38:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.283+0000 7fb244ac9640 1 -- 172.21.15.42:0/1208608502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2401021c0 con 0x7fb240101de0 2024-09-19T09:38:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.284+0000 7fb22f7fe640 1 -- 172.21.15.42:0/1208608502 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb230042030 con 0x7fb240101de0 2024-09-19T09:38:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.284+0000 7fb22f7fe640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2280a32d0 0x7fb2280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.285+0000 7fb23dd9b640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2280a32d0 0x7fb2280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.285+0000 7fb22f7fe640 1 -- 172.21.15.42:0/1208608502 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb2300f0150 con 0x7fb240101de0 2024-09-19T09:38:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.285+0000 7fb23dd9b640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2280a32d0 0x7fb2280a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb240075f80 tx=0x7fb234005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:55.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.289+0000 7fb22f7fe640 1 -- 172.21.15.42:0/1208608502 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2300bcdb0 con 0x7fb240101de0 2024-09-19T09:38:55.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.500+0000 7fb244ac9640 1 -- 172.21.15.42:0/1208608502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb24010a0f0 con 0x7fb240101de0 2024-09-19T09:38:55.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.500+0000 7fb22f7fe640 1 -- 172.21.15.42:0/1208608502 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fb2300bc6b0 con 0x7fb240101de0 2024-09-19T09:38:55.504 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:38:55.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.502+0000 7fb244ac9640 1 -- 172.21.15.42:0/1208608502 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2280a32d0 msgr2=0x7fb2280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.502+0000 7fb244ac9640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2280a32d0 0x7fb2280a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb240075f80 tx=0x7fb234005f90 comp rx=0 tx=0).stop 2024-09-19T09:38:55.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.502+0000 7fb244ac9640 1 -- 172.21.15.42:0/1208608502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240101de0 msgr2=0x7fb2400744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.502+0000 7fb244ac9640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240101de0 0x7fb2400744f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb230006010 tx=0x7fb2300042f0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.502+0000 7fb244ac9640 1 -- 172.21.15.42:0/1208608502 shutdown_connections 2024-09-19T09:38:55.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.502+0000 7fb244ac9640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb2280a32d0 0x7fb2280a5790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.502+0000 7fb244ac9640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb240106f10 0x7fb240074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.502+0000 7fb244ac9640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb240102790 0x7fb240074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.502+0000 7fb244ac9640 1 --2- 172.21.15.42:0/1208608502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240101de0 0x7fb2400744f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.502+0000 7fb244ac9640 1 -- 172.21.15.42:0/1208608502 >> 172.21.15.42:0/1208608502 conn(0x7fb2400fd8c0 msgr2=0x7fb2400fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.503+0000 7fb244ac9640 1 -- 172.21.15.42:0/1208608502 shutdown_connections 2024-09-19T09:38:55.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:55.503+0000 7fb244ac9640 1 -- 172.21.15.42:0/1208608502 wait complete. 2024-09-19T09:38:55.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:55 smithi171 ceph-mon[35803]: pgmap v325: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:55.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:55 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1208608502' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:38:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:55 smithi136 ceph-mon[34840]: pgmap v325: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:55 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1208608502' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:38:55.923 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:55 smithi042 ceph-mon[31223]: pgmap v325: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:38:55.923 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:55 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1208608502' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:38:56.253 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:38:56.253 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:38:56.253 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-19T09:38:56.253 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:38:56.253 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:56.253 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:38:56.253 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:38:56.253 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:38:56.253 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:38:56.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:56.254 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-19T09:38:56.273 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:38:56.273 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:38:56.273 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:38:56.273 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:38:56.273 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-19T09:38:56.273 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:38:56.273 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:38:56.273 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42214sec preferred_lft 42214sec 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:38:56.274 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:38:56.275 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-19T09:38:56.275 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:38:56.275 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:38:56.275 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-19T09:38:56.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:38:56.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2024-09-19T09:38:56.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2024-09-19T09:38:56.276 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:38:56.276 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-19T09:38:56.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:56.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:56.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:56.521 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:38:56.547 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-19T09:38:56.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:56.549 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-19T09:38:56.620 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-19T09:38:56.620 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:38:56.620 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:38:56.620 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:38:56.620 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:38:56.621 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:38:56.621 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-19T09:38:56.621 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:38:56.621 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:38:56.621 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:38:56.621 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-19T09:38:56.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:56.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:56.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:56.929 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-19T09:38:56.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:56.946 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-09-19T09:38:57.003 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:38:57.003 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-19T09:38:57.003 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:38:57.003 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:38:57.003 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-19T09:38:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:57.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:57.122 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:38:57.123 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:38:57.123 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-19T09:38:57.123 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:38:57.123 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:38:57.123 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:38:57.123 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:38:57.123 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:38:57.123 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-19T09:38:57.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:57.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:57.255 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:38:57.256 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-19T09:38:57.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-19T09:38:57.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:38:57.256 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-19T09:38:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:57.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:38:57.335 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:57.351 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:38:57.351 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:38:57.351 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:57.407 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T09:38:57.407 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T09:38:57.407 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/94e4dcd3-edf0-4b47-9d1e-7e59a8a791d4 2024-09-19T09:38:57.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:57.408 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/94e4dcd3-edf0-4b47-9d1e-7e59a8a791d4 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T09:38:57.509 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T09:38:57.509 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-19T09:38:57.651 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T09:38:57.652 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-19T09:38:57.652 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.136:3300,172.21.15.171:3300" 2024-09-19T09:38:57.652 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with new device syntax: 0@90ecc87a-7669-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/94e4dcd3-edf0-4b47-9d1e-7e59a8a791d4 2024-09-19T09:38:57.652 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.42:3300/172.21.15.136:3300/172.21.15.171:3300" will pass to kernel 2024-09-19T09:38:57.652 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:38:57.652 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:38:57.653 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:38:57.653 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:38:57.653 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:38:57.654 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:38:57.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:57.654 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:57.682 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:38:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:38:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:57.780 INFO:teuthology.orchestra.run.smithi042.stdout:client15222 2024-09-19T09:38:57.781 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:38:57.781 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:38:57.798 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:38:57.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:57 smithi171 ceph-mon[35803]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:57 smithi136 ceph-mon[34840]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:57.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:38:57.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:57.895 INFO:teuthology.orchestra.run.smithi042.stdout:client15222 2024-09-19T09:38:57.896 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:38:57.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:38:57.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:57.954 INFO:teuthology.orchestra.run.smithi042.stdout:client15222 2024-09-19T09:38:57.955 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/90ecc87a-7669-11ef-bceb-c7b262605968.client15222/status') 2024-09-19T09:38:57.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:57 smithi042 ceph-mon[31223]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:38:58.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:58.014 INFO:teuthology.orchestra.run.smithi042.stdout:instance: client.15222 (3)192.168.0.1:0/375598468 2024-09-19T09:38:58.015 INFO:teuthology.orchestra.run.smithi042.stdout:blocklisted: false 2024-09-19T09:38:58.015 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records in 2024-09-19T09:38:58.015 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records out 2024-09-19T09:38:58.015 INFO:teuthology.orchestra.run.smithi042.stderr:69 bytes copied, 2.5999e-05 s, 2.7 MB/s 2024-09-19T09:38:58.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:58.022 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T09:38:58.032 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T09:38:58.032 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-09-19T09:38:58.033 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-19T09:38:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.135+0000 7fd5b230a640 1 -- 172.21.15.42:0/897589858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5ac1025f0 msgr2=0x7fd5ac108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.135+0000 7fd5b230a640 1 --2- 172.21.15.42:0/897589858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5ac1025f0 0x7fd5ac108e80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009ca0 tx=0x7fd5a402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.135+0000 7fd5b230a640 1 -- 172.21.15.42:0/897589858 shutdown_connections 2024-09-19T09:38:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.135+0000 7fd5b230a640 1 --2- 172.21.15.42:0/897589858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5ac1025f0 0x7fd5ac108e80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.135+0000 7fd5b230a640 1 --2- 172.21.15.42:0/897589858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5ac101c30 0x7fd5ac1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.135+0000 7fd5b230a640 1 --2- 172.21.15.42:0/897589858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5ac100a40 0x7fd5ac100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.135+0000 7fd5b230a640 1 -- 172.21.15.42:0/897589858 >> 172.21.15.42:0/897589858 conn(0x7fd5ac0fc1e0 msgr2=0x7fd5ac0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.135+0000 7fd5b230a640 1 -- 172.21.15.42:0/897589858 shutdown_connections 2024-09-19T09:38:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.135+0000 7fd5b230a640 1 -- 172.21.15.42:0/897589858 wait complete. 2024-09-19T09:38:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5b230a640 1 Processor -- start 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5b230a640 1 -- start start 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5b230a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5ac100a40 0x7fd5ac197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5b230a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5ac101c30 0x7fd5ac198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5b230a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5ac1025f0 0x7fd5ac19f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5b230a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ac10c6c0 con 0x7fd5ac100a40 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5b230a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ac10c540 con 0x7fd5ac1025f0 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5b230a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ac10c840 con 0x7fd5ac101c30 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5abfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5ac100a40 0x7fd5ac197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5abfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5ac100a40 0x7fd5ac197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34606/0 (socket says 172.21.15.42:34606) 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5abfff640 1 -- 172.21.15.42:0/2308668440 learned_addr learned my addr 172.21.15.42:0/2308668440 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5ab7fe640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5ac101c30 0x7fd5ac198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5abfff640 1 -- 172.21.15.42:0/2308668440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5ac101c30 msgr2=0x7fd5ac198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5abfff640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5ac101c30 0x7fd5ac198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5abfff640 1 -- 172.21.15.42:0/2308668440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5ac1025f0 msgr2=0x7fd5ac19f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.136+0000 7fd5abfff640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5ac1025f0 0x7fd5ac19f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.137+0000 7fd5abfff640 1 -- 172.21.15.42:0/2308668440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ac19f9d0 con 0x7fd5ac100a40 2024-09-19T09:38:58.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.137+0000 7fd5abfff640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5ac100a40 0x7fd5ac197dc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00d950 tx=0x7fd59c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:58.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.137+0000 7fd5a97fa640 1 -- 172.21.15.42:0/2308668440 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c017070 con 0x7fd5ac100a40 2024-09-19T09:38:58.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.137+0000 7fd5a97fa640 1 -- 172.21.15.42:0/2308668440 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd59c009c30 con 0x7fd5ac100a40 2024-09-19T09:38:58.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.137+0000 7fd5b230a640 1 -- 172.21.15.42:0/2308668440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5ac19fcc0 con 0x7fd5ac100a40 2024-09-19T09:38:58.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.137+0000 7fd5a97fa640 1 -- 172.21.15.42:0/2308668440 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00f600 con 0x7fd5ac100a40 2024-09-19T09:38:58.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.137+0000 7fd5b230a640 1 -- 172.21.15.42:0/2308668440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5ac1a01c0 con 0x7fd5ac100a40 2024-09-19T09:38:58.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.138+0000 7fd5b230a640 1 -- 172.21.15.42:0/2308668440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5ac1a0390 con 0x7fd5ac100a40 2024-09-19T09:38:58.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.139+0000 7fd5a97fa640 1 -- 172.21.15.42:0/2308668440 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd59c01a070 con 0x7fd5ac100a40 2024-09-19T09:38:58.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.140+0000 7fd5a97fa640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5940a32f0 0x7fd5940a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.140+0000 7fd5ab7fe640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5940a32f0 0x7fd5940a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.140+0000 7fd5a97fa640 1 -- 172.21.15.42:0/2308668440 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd59c0cf450 con 0x7fd5ac100a40 2024-09-19T09:38:58.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.140+0000 7fd5ab7fe640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5940a32f0 0x7fd5940a57b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0005d00 tx=0x7fd5a000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:58.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.144+0000 7fd5a97fa640 1 -- 172.21.15.42:0/2308668440 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd59c009de0 con 0x7fd5ac100a40 2024-09-19T09:38:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.360+0000 7fd5b230a640 1 -- 172.21.15.42:0/2308668440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fd5ac108890 con 0x7fd5ac100a40 2024-09-19T09:38:58.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.573+0000 7fd5a97fa640 1 -- 172.21.15.42:0/2308668440 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7fd59c09c150 con 0x7fd5ac100a40 2024-09-19T09:38:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 -- 172.21.15.42:0/2308668440 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5940a32f0 msgr2=0x7fd5940a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5940a32f0 0x7fd5940a57b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0005d00 tx=0x7fd5a000b410 comp rx=0 tx=0).stop 2024-09-19T09:38:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 -- 172.21.15.42:0/2308668440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5ac100a40 msgr2=0x7fd5ac197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5ac100a40 0x7fd5ac197dc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00d950 tx=0x7fd59c00de10 comp rx=0 tx=0).stop 2024-09-19T09:38:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 -- 172.21.15.42:0/2308668440 shutdown_connections 2024-09-19T09:38:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd5940a32f0 0x7fd5940a57b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5ac1025f0 0x7fd5ac19f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5ac101c30 0x7fd5ac198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 --2- 172.21.15.42:0/2308668440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5ac100a40 0x7fd5ac197dc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 -- 172.21.15.42:0/2308668440 >> 172.21.15.42:0/2308668440 conn(0x7fd5ac0fc1e0 msgr2=0x7fd5ac0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:58.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 -- 172.21.15.42:0/2308668440 shutdown_connections 2024-09-19T09:38:58.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.576+0000 7fd5b230a640 1 -- 172.21.15.42:0/2308668440 wait complete. 2024-09-19T09:38:58.590 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-19T09:38:58.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.695+0000 7f62f9531640 1 -- 172.21.15.42:0/1202074026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f4102610 msgr2=0x7f62f4108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.695+0000 7f62f9531640 1 --2- 172.21.15.42:0/1202074026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f4102610 0x7f62f4108ea0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009900 tx=0x7f62ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:58.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.695+0000 7f62f9531640 1 -- 172.21.15.42:0/1202074026 shutdown_connections 2024-09-19T09:38:58.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.695+0000 7f62f9531640 1 --2- 172.21.15.42:0/1202074026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f4102610 0x7f62f4108ea0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.695+0000 7f62f9531640 1 --2- 172.21.15.42:0/1202074026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62f4101c50 0x7f62f41020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.695+0000 7f62f9531640 1 --2- 172.21.15.42:0/1202074026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62f4100a60 0x7f62f4100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.695+0000 7f62f9531640 1 -- 172.21.15.42:0/1202074026 >> 172.21.15.42:0/1202074026 conn(0x7f62f40fc1e0 msgr2=0x7f62f40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.695+0000 7f62f9531640 1 -- 172.21.15.42:0/1202074026 shutdown_connections 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.695+0000 7f62f9531640 1 -- 172.21.15.42:0/1202074026 wait complete. 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.696+0000 7f62f9531640 1 Processor -- start 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.696+0000 7f62f9531640 1 -- start start 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.696+0000 7f62f9531640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62f4100a60 0x7f62f406aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.696+0000 7f62f9531640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f4101c50 0x7f62f419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.696+0000 7f62f9531640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62f4102610 0x7f62f419f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.696+0000 7f62f9531640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f62f410c6c0 con 0x7f62f4101c50 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.696+0000 7f62f9531640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f62f410c540 con 0x7f62f4100a60 2024-09-19T09:38:58.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.696+0000 7f62f9531640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f62f410c840 con 0x7f62f4102610 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f27fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f4101c50 0x7f62f419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f27fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f4101c50 0x7f62f419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34634/0 (socket says 172.21.15.42:34634) 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f27fc640 1 -- 172.21.15.42:0/2447135447 learned_addr learned my addr 172.21.15.42:0/2447135447 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f2ffd640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62f4100a60 0x7f62f406aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f37fe640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62f4102610 0x7f62f419f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f27fc640 1 -- 172.21.15.42:0/2447135447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62f4102610 msgr2=0x7f62f419f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f27fc640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62f4102610 0x7f62f419f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f27fc640 1 -- 172.21.15.42:0/2447135447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62f4100a60 msgr2=0x7f62f406aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f27fc640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62f4100a60 0x7f62f406aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f27fc640 1 -- 172.21.15.42:0/2447135447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f419f900 con 0x7f62f4101c50 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f37fe640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62f4102610 0x7f62f419f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f27fc640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f4101c50 0x7f62f419c9f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f62e800c890 tx=0x7f62e800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62dbfff640 1 -- 172.21.15.42:0/2447135447 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8004220 con 0x7f62f4101c50 2024-09-19T09:38:58.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f9531640 1 -- 172.21.15.42:0/2447135447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f419fbf0 con 0x7f62f4101c50 2024-09-19T09:38:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62dbfff640 1 -- 172.21.15.42:0/2447135447 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62e80043c0 con 0x7f62f4101c50 2024-09-19T09:38:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62dbfff640 1 -- 172.21.15.42:0/2447135447 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e80049e0 con 0x7f62f4101c50 2024-09-19T09:38:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.697+0000 7f62f9531640 1 -- 172.21.15.42:0/2447135447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f41a0140 con 0x7f62f4101c50 2024-09-19T09:38:58.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.698+0000 7f62f9531640 1 -- 172.21.15.42:0/2447135447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f4107d20 con 0x7f62f4101c50 2024-09-19T09:38:58.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.700+0000 7f62dbfff640 1 -- 172.21.15.42:0/2447135447 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f62e80079b0 con 0x7f62f4101c50 2024-09-19T09:38:58.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.700+0000 7f62dbfff640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f62dc0a32f0 0x7f62dc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.700+0000 7f62f2ffd640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f62dc0a32f0 0x7f62dc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.700+0000 7f62dbfff640 1 -- 172.21.15.42:0/2447135447 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f62e80cf990 con 0x7f62f4101c50 2024-09-19T09:38:58.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.701+0000 7f62f2ffd640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f62dc0a32f0 0x7f62dc0a57b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f62f4101ab0 tx=0x7f62e4007600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.704+0000 7f62dbfff640 1 -- 172.21.15.42:0/2447135447 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f62e8014030 con 0x7f62f4101c50 2024-09-19T09:38:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:58 smithi171 ceph-mon[35803]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:38:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:58 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2308668440' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T09:38:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:58 smithi136 ceph-mon[34840]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:38:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:58 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2308668440' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T09:38:58.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.907+0000 7f62f9531640 1 -- 172.21.15.42:0/2447135447 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f62f40626d0 con 0x7f62dc0a32f0 2024-09-19T09:38:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:58 smithi042 ceph-mon[31223]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:38:58.914 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:58 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2308668440' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T09:38:58.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.928+0000 7f62dbfff640 1 -- 172.21.15.42:0/2447135447 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f62f40626d0 con 0x7f62dc0a32f0 2024-09-19T09:38:58.930 INFO:teuthology.orchestra.run.smithi042.stdout:{} 2024-09-19T09:38:58.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 -- 172.21.15.42:0/2447135447 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f62dc0a32f0 msgr2=0x7f62dc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f62dc0a32f0 0x7f62dc0a57b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f62f4101ab0 tx=0x7f62e4007600 comp rx=0 tx=0).stop 2024-09-19T09:38:58.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 -- 172.21.15.42:0/2447135447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f4101c50 msgr2=0x7f62f419c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f4101c50 0x7f62f419c9f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f62e800c890 tx=0x7f62e800cd50 comp rx=0 tx=0).stop 2024-09-19T09:38:58.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 -- 172.21.15.42:0/2447135447 shutdown_connections 2024-09-19T09:38:58.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f62dc0a32f0 0x7f62dc0a57b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62f4102610 0x7f62f419f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f4101c50 0x7f62f419c9f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 --2- 172.21.15.42:0/2447135447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62f4100a60 0x7f62f406aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 -- 172.21.15.42:0/2447135447 >> 172.21.15.42:0/2447135447 conn(0x7f62f40fc1e0 msgr2=0x7f62f4104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:58.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 -- 172.21.15.42:0/2447135447 shutdown_connections 2024-09-19T09:38:58.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:58.930+0000 7f62f9531640 1 -- 172.21.15.42:0/2447135447 wait complete. 2024-09-19T09:38:58.943 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T09:38:58.954 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T09:38:58.974 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:38:59.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.076+0000 7f85290d0640 1 -- 172.21.15.42:0/3554631841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85241078b0 msgr2=0x7f8524109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.076+0000 7f85290d0640 1 --2- 172.21.15.42:0/3554631841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85241078b0 0x7f8524109ca0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f851c009ca0 tx=0x7f851c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.076+0000 7f85290d0640 1 -- 172.21.15.42:0/3554631841 shutdown_connections 2024-09-19T09:38:59.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.076+0000 7f85290d0640 1 --2- 172.21.15.42:0/3554631841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85241078b0 0x7f8524109ca0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.076+0000 7f85290d0640 1 --2- 172.21.15.42:0/3554631841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524104f80 0x7f8524107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.076+0000 7f85290d0640 1 --2- 172.21.15.42:0/3554631841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8524102650 0x7f8524104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.076+0000 7f85290d0640 1 -- 172.21.15.42:0/3554631841 >> 172.21.15.42:0/3554631841 conn(0x7f85240fc170 msgr2=0x7f85240fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:59.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.077+0000 7f85290d0640 1 -- 172.21.15.42:0/3554631841 shutdown_connections 2024-09-19T09:38:59.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.077+0000 7f85290d0640 1 -- 172.21.15.42:0/3554631841 wait complete. 2024-09-19T09:38:59.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.077+0000 7f85290d0640 1 Processor -- start 2024-09-19T09:38:59.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.077+0000 7f85290d0640 1 -- start start 2024-09-19T09:38:59.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f85290d0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524102650 0x7f8524197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f85290d0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8524104f80 0x7f8524198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f85290d0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85241078b0 0x7f852419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f85290d0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f852410d7c0 con 0x7f8524104f80 2024-09-19T09:38:59.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f85290d0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f852410d640 con 0x7f8524102650 2024-09-19T09:38:59.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f85290d0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f852410d940 con 0x7f85241078b0 2024-09-19T09:38:59.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f852259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8524104f80 0x7f8524198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f852259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8524104f80 0x7f8524198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34662/0 (socket says 172.21.15.42:34662) 2024-09-19T09:38:59.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f852259c640 1 -- 172.21.15.42:0/4199177920 learned_addr learned my addr 172.21.15.42:0/4199177920 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:59.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f8522d9d640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524102650 0x7f8524197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f852359e640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85241078b0 0x7f852419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f852259c640 1 -- 172.21.15.42:0/4199177920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85241078b0 msgr2=0x7f852419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f852259c640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85241078b0 0x7f852419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f852259c640 1 -- 172.21.15.42:0/4199177920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524102650 msgr2=0x7f8524197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f852259c640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524102650 0x7f8524197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f852259c640 1 -- 172.21.15.42:0/4199177920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852419fa60 con 0x7f8524104f80 2024-09-19T09:38:59.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f852259c640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8524104f80 0x7f8524198380 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f851800c970 tx=0x7f851800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:59.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f850bfff640 1 -- 172.21.15.42:0/4199177920 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518007bb0 con 0x7f8524104f80 2024-09-19T09:38:59.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f850bfff640 1 -- 172.21.15.42:0/4199177920 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8518007d50 con 0x7f8524104f80 2024-09-19T09:38:59.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.078+0000 7f85290d0640 1 -- 172.21.15.42:0/4199177920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852419fd50 con 0x7f8524104f80 2024-09-19T09:38:59.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.079+0000 7f850bfff640 1 -- 172.21.15.42:0/4199177920 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851800f450 con 0x7f8524104f80 2024-09-19T09:38:59.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.079+0000 7f85290d0640 1 -- 172.21.15.42:0/4199177920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85241a0240 con 0x7f8524104f80 2024-09-19T09:38:59.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.080+0000 7f85290d0640 1 -- 172.21.15.42:0/4199177920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85240fdc60 con 0x7f8524104f80 2024-09-19T09:38:59.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.081+0000 7f850bfff640 1 -- 172.21.15.42:0/4199177920 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f85180046c0 con 0x7f8524104f80 2024-09-19T09:38:59.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.082+0000 7f850bfff640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f850c0a3250 0x7f850c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.082+0000 7f8522d9d640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f850c0a3250 0x7f850c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.082+0000 7f850bfff640 1 -- 172.21.15.42:0/4199177920 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f85180cf8b0 con 0x7f8524104f80 2024-09-19T09:38:59.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.082+0000 7f8522d9d640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f850c0a3250 0x7f850c0a5710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8514005fd0 tx=0x7f851400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:59.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.086+0000 7f850bfff640 1 -- 172.21.15.42:0/4199177920 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8518014030 con 0x7f8524104f80 2024-09-19T09:38:59.204 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:38:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:38:58.911+0000 7ffa1e9b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:38:59.205 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:38:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:38:58.911+0000 7ffa1e9b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:38:59.205 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:38:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:38:58.911+0000 7ffa1e9b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:38:59.205 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:38:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:38:58.911+0000 7ffa1e9b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:38:59.205 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:38:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:38:58.911+0000 7ffa1e9b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:38:59.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.265+0000 7f85290d0640 1 -- 172.21.15.42:0/4199177920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8524062e90 con 0x7f8524104f80 2024-09-19T09:38:59.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.266+0000 7f850bfff640 1 -- 172.21.15.42:0/4199177920 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22852 (secure 0 0 0) 0x7f851809bf60 con 0x7f8524104f80 2024-09-19T09:38:59.322 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:38:59.323 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:28.010101+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:38:59.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 -- 172.21.15.42:0/4199177920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f850c0a3250 msgr2=0x7f850c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f850c0a3250 0x7f850c0a5710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8514005fd0 tx=0x7f851400b390 comp rx=0 tx=0).stop 2024-09-19T09:38:59.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 -- 172.21.15.42:0/4199177920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8524104f80 msgr2=0x7f8524198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8524104f80 0x7f8524198380 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f851800c970 tx=0x7f851800ce30 comp rx=0 tx=0).stop 2024-09-19T09:38:59.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 -- 172.21.15.42:0/4199177920 shutdown_connections 2024-09-19T09:38:59.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f850c0a3250 0x7f850c0a5710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85241078b0 0x7f852419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8524104f80 0x7f8524198380 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 --2- 172.21.15.42:0/4199177920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8524102650 0x7f8524197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 -- 172.21.15.42:0/4199177920 >> 172.21.15.42:0/4199177920 conn(0x7f85240fc170 msgr2=0x7f8524103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:59.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 -- 172.21.15.42:0/4199177920 shutdown_connections 2024-09-19T09:38:59.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.269+0000 7f85290d0640 1 -- 172.21.15.42:0/4199177920 wait complete. 2024-09-19T09:38:59.326 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:32:44.950596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:37:07.882800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:37:09.916139+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:38:59.326 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:38:59.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.431+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3558906982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a901025b0 msgr2=0x7f0a901049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.431+0000 7f0a95b0a640 1 --2- 172.21.15.42:0/3558906982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a901025b0 0x7f0a901049a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009900 tx=0x7f0a8002a410 comp rx=0 tx=0).stop 2024-09-19T09:38:59.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.431+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3558906982 shutdown_connections 2024-09-19T09:38:59.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.431+0000 7f0a95b0a640 1 --2- 172.21.15.42:0/3558906982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a90107810 0x7f0a90109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.431+0000 7f0a95b0a640 1 --2- 172.21.15.42:0/3558906982 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a90104ee0 0x7f0a901072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.431+0000 7f0a95b0a640 1 --2- 172.21.15.42:0/3558906982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a901025b0 0x7f0a901049a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.431+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3558906982 >> 172.21.15.42:0/3558906982 conn(0x7f0a900fc1b0 msgr2=0x7f0a900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.431+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3558906982 shutdown_connections 2024-09-19T09:38:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.431+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3558906982 wait complete. 2024-09-19T09:38:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a95b0a640 1 Processor -- start 2024-09-19T09:38:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a95b0a640 1 -- start start 2024-09-19T09:38:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a95b0a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a901025b0 0x7f0a90197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a95b0a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a90104ee0 0x7f0a90198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a95b0a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a90107810 0x7f0a9019f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a95b0a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9010d860 con 0x7f0a90107810 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a95b0a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9010d6e0 con 0x7f0a90104ee0 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a95b0a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9010d9e0 con 0x7f0a901025b0 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a8ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a90107810 0x7f0a9019f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a8ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a90107810 0x7f0a9019f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34686/0 (socket says 172.21.15.42:34686) 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.432+0000 7f0a8ffff640 1 -- 172.21.15.42:0/3140015126 learned_addr learned my addr 172.21.15.42:0/3140015126 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8ffff640 1 -- 172.21.15.42:0/3140015126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a901025b0 msgr2=0x7f0a90197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8f7fe640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a901025b0 0x7f0a90197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8ffff640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a901025b0 0x7f0a90197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8effd640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a90104ee0 0x7f0a90198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8ffff640 1 -- 172.21.15.42:0/3140015126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a90104ee0 msgr2=0x7f0a90198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8ffff640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a90104ee0 0x7f0a90198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8ffff640 1 -- 172.21.15.42:0/3140015126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9019fbf0 con 0x7f0a90107810 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8ffff640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a90107810 0x7f0a9019f580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800cab0 tx=0x7f0a8800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8cff9640 1 -- 172.21.15.42:0/3140015126 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800ae20 con 0x7f0a90107810 2024-09-19T09:38:59.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8cff9640 1 -- 172.21.15.42:0/3140015126 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a8800f930 con 0x7f0a90107810 2024-09-19T09:38:59.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3140015126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9019fee0 con 0x7f0a90107810 2024-09-19T09:38:59.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a8cff9640 1 -- 172.21.15.42:0/3140015126 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a88018b80 con 0x7f0a90107810 2024-09-19T09:38:59.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.433+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3140015126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a901a03d0 con 0x7f0a90107810 2024-09-19T09:38:59.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.434+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3140015126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a900fdca0 con 0x7f0a90107810 2024-09-19T09:38:59.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.435+0000 7f0a8cff9640 1 -- 172.21.15.42:0/3140015126 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0a8800fae0 con 0x7f0a90107810 2024-09-19T09:38:59.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.436+0000 7f0a8cff9640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0a780a3250 0x7f0a780a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.436+0000 7f0a8f7fe640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0a780a3250 0x7f0a780a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.436+0000 7f0a8cff9640 1 -- 172.21.15.42:0/3140015126 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0a880d0150 con 0x7f0a90107810 2024-09-19T09:38:59.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.437+0000 7f0a8f7fe640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0a780a3250 0x7f0a780a5710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a800096c0 tx=0x7f0a80000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:59.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.440+0000 7f0a8cff9640 1 -- 172.21.15.42:0/3140015126 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a88014030 con 0x7f0a90107810 2024-09-19T09:38:59.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.617+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3140015126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0a90062e90 con 0x7f0a90107810 2024-09-19T09:38:59.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.617+0000 7f0a8cff9640 1 -- 172.21.15.42:0/3140015126 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f0a8809cdf0 con 0x7f0a90107810 2024-09-19T09:38:59.619 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-19T09:38:59.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3140015126 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0a780a3250 msgr2=0x7f0a780a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0a780a3250 0x7f0a780a5710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a800096c0 tx=0x7f0a80000bc0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3140015126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a90107810 msgr2=0x7f0a9019f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a90107810 0x7f0a9019f580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800cab0 tx=0x7f0a8800cf70 comp rx=0 tx=0).stop 2024-09-19T09:38:59.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3140015126 shutdown_connections 2024-09-19T09:38:59.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0a780a3250 0x7f0a780a5710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a90107810 0x7f0a9019f580 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a90104ee0 0x7f0a90198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 --2- 172.21.15.42:0/3140015126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a901025b0 0x7f0a90197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3140015126 >> 172.21.15.42:0/3140015126 conn(0x7f0a900fc1b0 msgr2=0x7f0a90103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:59.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3140015126 shutdown_connections 2024-09-19T09:38:59.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.619+0000 7f0a95b0a640 1 -- 172.21.15.42:0/3140015126 wait complete. 2024-09-19T09:38:59.632 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:38:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 -- 172.21.15.42:0/849001289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb001077e0 msgr2=0x7fdb00109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 --2- 172.21.15.42:0/849001289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb001077e0 0x7fdb00109c50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009ca0 tx=0x7fdaf002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 -- 172.21.15.42:0/849001289 shutdown_connections 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 --2- 172.21.15.42:0/849001289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb001077e0 0x7fdb00109c50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 --2- 172.21.15.42:0/849001289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb00104eb0 0x7fdb001072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 --2- 172.21.15.42:0/849001289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb00102580 0x7fdb00104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 -- 172.21.15.42:0/849001289 >> 172.21.15.42:0/849001289 conn(0x7fdb000fc140 msgr2=0x7fdb000fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 -- 172.21.15.42:0/849001289 shutdown_connections 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 -- 172.21.15.42:0/849001289 wait complete. 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 Processor -- start 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 -- start start 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb00102580 0x7fdb00197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.737+0000 7fdb082af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb00104eb0 0x7fdb00198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb082af640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb001077e0 0x7fdb0019f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb082af640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0010d7c0 con 0x7fdb00104eb0 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb082af640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0010d640 con 0x7fdb001077e0 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb082af640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0010d940 con 0x7fdb00102580 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0584a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb00104eb0 0x7fdb00198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0584a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb00104eb0 0x7fdb00198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34702/0 (socket says 172.21.15.42:34702) 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0584a640 1 -- 172.21.15.42:0/3690226503 learned_addr learned my addr 172.21.15.42:0/3690226503 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0604b640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb00102580 0x7fdb00197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0684c640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb001077e0 0x7fdb0019f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0584a640 1 -- 172.21.15.42:0/3690226503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb00102580 msgr2=0x7fdb00197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0584a640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb00102580 0x7fdb00197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0584a640 1 -- 172.21.15.42:0/3690226503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb001077e0 msgr2=0x7fdb0019f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0584a640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb001077e0 0x7fdb0019f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0584a640 1 -- 172.21.15.42:0/3690226503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0019fa40 con 0x7fdb00104eb0 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb0584a640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb00104eb0 0x7fdb00198360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400e9f0 tx=0x7fdaf400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:59.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdaff7fe640 1 -- 172.21.15.42:0/3690226503 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf400ccc0 con 0x7fdb00104eb0 2024-09-19T09:38:59.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdaff7fe640 1 -- 172.21.15.42:0/3690226503 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaf4005500 con 0x7fdb00104eb0 2024-09-19T09:38:59.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb082af640 1 -- 172.21.15.42:0/3690226503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0019fd30 con 0x7fdb00104eb0 2024-09-19T09:38:59.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdaff7fe640 1 -- 172.21.15.42:0/3690226503 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4010690 con 0x7fdb00104eb0 2024-09-19T09:38:59.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.738+0000 7fdb082af640 1 -- 172.21.15.42:0/3690226503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb001a0220 con 0x7fdb00104eb0 2024-09-19T09:38:59.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.739+0000 7fdb082af640 1 -- 172.21.15.42:0/3690226503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb000fdc30 con 0x7fdb00104eb0 2024-09-19T09:38:59.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.741+0000 7fdaff7fe640 1 -- 172.21.15.42:0/3690226503 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdaf40046c0 con 0x7fdb00104eb0 2024-09-19T09:38:59.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.742+0000 7fdaff7fe640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdae80a32d0 0x7fdae80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:59.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.742+0000 7fdb0604b640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdae80a32d0 0x7fdae80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:59.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.742+0000 7fdaff7fe640 1 -- 172.21.15.42:0/3690226503 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fdaf40cffb0 con 0x7fdb00104eb0 2024-09-19T09:38:59.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.743+0000 7fdb0604b640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdae80a32d0 0x7fdae80a5790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8005e10 tx=0x7fdaf8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:59.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.745+0000 7fdaff7fe640 1 -- 172.21.15.42:0/3690226503 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdaf4054210 con 0x7fdb00104eb0 2024-09-19T09:38:59.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:59 smithi171 ceph-mon[35803]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T09:38:59.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:59 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2308668440' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T09:38:59.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:59 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:38:59.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:59 smithi171 ceph-mon[35803]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:59.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:38:59 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/4199177920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:59 smithi136 ceph-mon[34840]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T09:38:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:59 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2308668440' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T09:38:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:59 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:38:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:59 smithi136 ceph-mon[34840]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:38:59 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/4199177920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:59.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.923+0000 7fdb082af640 1 -- 172.21.15.42:0/3690226503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdb0002da10 con 0x7fdb00104eb0 2024-09-19T09:38:59.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.923+0000 7fdaff7fe640 1 -- 172.21.15.42:0/3690226503 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7fdaf409cc50 con 0x7fdb00104eb0 2024-09-19T09:38:59.925 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-09-19T09:38:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 -- 172.21.15.42:0/3690226503 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdae80a32d0 msgr2=0x7fdae80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdae80a32d0 0x7fdae80a5790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8005e10 tx=0x7fdaf8005da0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 -- 172.21.15.42:0/3690226503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb00104eb0 msgr2=0x7fdb00198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb00104eb0 0x7fdb00198360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400e9f0 tx=0x7fdaf400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 -- 172.21.15.42:0/3690226503 shutdown_connections 2024-09-19T09:38:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdae80a32d0 0x7fdae80a5790 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb001077e0 0x7fdb0019f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb00104eb0 0x7fdb00198360 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 --2- 172.21.15.42:0/3690226503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb00102580 0x7fdb00197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 -- 172.21.15.42:0/3690226503 >> 172.21.15.42:0/3690226503 conn(0x7fdb000fc140 msgr2=0x7fdb00102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 -- 172.21.15.42:0/3690226503 shutdown_connections 2024-09-19T09:38:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:38:59.925+0000 7fdb082af640 1 -- 172.21.15.42:0/3690226503 wait complete. 2024-09-19T09:38:59.937 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:59 smithi042 ceph-mon[31223]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T09:38:59.937 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:59 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2308668440' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T09:38:59.937 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:59 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:38:59.937 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:59 smithi042 ceph-mon[31223]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:38:59.937 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:38:59 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/4199177920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:59.938 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:39:00.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 -- 172.21.15.42:0/1577853099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408101650 msgr2=0x7fc408101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 --2- 172.21.15.42:0/1577853099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408101650 0x7fc408101b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc400009900 tx=0x7fc40002a410 comp rx=0 tx=0).stop 2024-09-19T09:39:00.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 -- 172.21.15.42:0/1577853099 shutdown_connections 2024-09-19T09:39:00.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 --2- 172.21.15.42:0/1577853099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408101650 0x7fc408101b00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 --2- 172.21.15.42:0/1577853099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc408100cb0 0x7fc408101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 --2- 172.21.15.42:0/1577853099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc408100370 0x7fc408100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 -- 172.21.15.42:0/1577853099 >> 172.21.15.42:0/1577853099 conn(0x7fc4080fc140 msgr2=0x7fc4080fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:00.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 -- 172.21.15.42:0/1577853099 shutdown_connections 2024-09-19T09:39:00.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 -- 172.21.15.42:0/1577853099 wait complete. 2024-09-19T09:39:00.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 Processor -- start 2024-09-19T09:39:00.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.044+0000 7fc40dd31640 1 -- start start 2024-09-19T09:39:00.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc40dd31640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc408100370 0x7fc40819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc40dd31640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408100cb0 0x7fc40819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc40dd31640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc408101650 0x7fc4081a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc40dd31640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc40810f970 con 0x7fc408100cb0 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc40dd31640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc40810f7f0 con 0x7fc408100370 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc40dd31640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc40810faf0 con 0x7fc408101650 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408100cb0 0x7fc40819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408100cb0 0x7fc40819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34716/0 (socket says 172.21.15.42:34716) 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc406ffd640 1 -- 172.21.15.42:0/1482350935 learned_addr learned my addr 172.21.15.42:0/1482350935 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc4077fe640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc408100370 0x7fc40819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc407fff640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc408101650 0x7fc4081a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc406ffd640 1 -- 172.21.15.42:0/1482350935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc408101650 msgr2=0x7fc4081a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc406ffd640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc408101650 0x7fc4081a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc406ffd640 1 -- 172.21.15.42:0/1482350935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc408100370 msgr2=0x7fc40819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc406ffd640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc408100370 0x7fc40819a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc406ffd640 1 -- 172.21.15.42:0/1482350935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4081a1c20 con 0x7fc408100cb0 2024-09-19T09:39:00.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc406ffd640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408100cb0 0x7fc40819a540 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000e9f0 tx=0x7fc3f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:00.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc404ff9640 1 -- 172.21.15.42:0/1482350935 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f000cd80 con 0x7fc408100cb0 2024-09-19T09:39:00.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc404ff9640 1 -- 172.21.15.42:0/1482350935 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3f0005500 con 0x7fc408100cb0 2024-09-19T09:39:00.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc40dd31640 1 -- 172.21.15.42:0/1482350935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4081a1f10 con 0x7fc408100cb0 2024-09-19T09:39:00.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.045+0000 7fc404ff9640 1 -- 172.21.15.42:0/1482350935 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0010690 con 0x7fc408100cb0 2024-09-19T09:39:00.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.046+0000 7fc40dd31640 1 -- 172.21.15.42:0/1482350935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4081a23d0 con 0x7fc408100cb0 2024-09-19T09:39:00.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.046+0000 7fc40dd31640 1 -- 172.21.15.42:0/1482350935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40810b0c0 con 0x7fc408100cb0 2024-09-19T09:39:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.048+0000 7fc404ff9640 1 -- 172.21.15.42:0/1482350935 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc3f00046c0 con 0x7fc408100cb0 2024-09-19T09:39:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.048+0000 7fc404ff9640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc3f40a32d0 0x7fc3f40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.049+0000 7fc404ff9640 1 -- 172.21.15.42:0/1482350935 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc3f00cfe80 con 0x7fc408100cb0 2024-09-19T09:39:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.049+0000 7fc4077fe640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc3f40a32d0 0x7fc3f40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.049+0000 7fc4077fe640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc3f40a32d0 0x7fc3f40a5790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8005fd0 tx=0x7fc3f8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:00.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.052+0000 7fc404ff9640 1 -- 172.21.15.42:0/1482350935 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3f0054210 con 0x7fc408100cb0 2024-09-19T09:39:00.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.229+0000 7fc40dd31640 1 -- 172.21.15.42:0/1482350935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc40802d7c0 con 0x7fc408100cb0 2024-09-19T09:39:00.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.229+0000 7fc404ff9640 1 -- 172.21.15.42:0/1482350935 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7fc3f009cb20 con 0x7fc408100cb0 2024-09-19T09:39:00.231 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-09-19T09:39:00.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 -- 172.21.15.42:0/1482350935 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc3f40a32d0 msgr2=0x7fc3f40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc3f40a32d0 0x7fc3f40a5790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8005fd0 tx=0x7fc3f8009680 comp rx=0 tx=0).stop 2024-09-19T09:39:00.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 -- 172.21.15.42:0/1482350935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408100cb0 msgr2=0x7fc40819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408100cb0 0x7fc40819a540 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000e9f0 tx=0x7fc3f000edf0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 -- 172.21.15.42:0/1482350935 shutdown_connections 2024-09-19T09:39:00.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc3f40a32d0 0x7fc3f40a5790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc408101650 0x7fc4081a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408100cb0 0x7fc40819a540 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 --2- 172.21.15.42:0/1482350935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc408100370 0x7fc40819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 -- 172.21.15.42:0/1482350935 >> 172.21.15.42:0/1482350935 conn(0x7fc4080fc140 msgr2=0x7fc4080fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:00.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 -- 172.21.15.42:0/1482350935 shutdown_connections 2024-09-19T09:39:00.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.231+0000 7fc40dd31640 1 -- 172.21.15.42:0/1482350935 wait complete. 2024-09-19T09:39:00.244 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T09:39:00.244 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:00.501 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:00.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:00 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3140015126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:39:00.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:00 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3690226503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:39:00.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:00 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1482350935' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:39:00.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:00 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3140015126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:39:00.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:00 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3690226503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:39:00.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:00 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1482350935' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:39:00.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:00 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3140015126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:39:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:00 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3690226503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:39:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:00 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1482350935' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:39:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.956+0000 7fd0a5066640 1 -- 172.21.15.42:0/1025487424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a0101de0 msgr2=0x7fd0a01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.956+0000 7fd0a5066640 1 --2- 172.21.15.42:0/1025487424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a0101de0 0x7fd0a01021c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd090009900 tx=0x7fd09002a410 comp rx=0 tx=0).stop 2024-09-19T09:39:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.956+0000 7fd0a5066640 1 -- 172.21.15.42:0/1025487424 shutdown_connections 2024-09-19T09:39:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.956+0000 7fd0a5066640 1 --2- 172.21.15.42:0/1025487424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0a0106f10 0x7fd0a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.956+0000 7fd0a5066640 1 --2- 172.21.15.42:0/1025487424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a0102790 0x7fd0a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.956+0000 7fd0a5066640 1 --2- 172.21.15.42:0/1025487424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a0101de0 0x7fd0a01021c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.956+0000 7fd0a5066640 1 -- 172.21.15.42:0/1025487424 >> 172.21.15.42:0/1025487424 conn(0x7fd0a00fd880 msgr2=0x7fd0a00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.956+0000 7fd0a5066640 1 -- 172.21.15.42:0/1025487424 shutdown_connections 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.956+0000 7fd0a5066640 1 -- 172.21.15.42:0/1025487424 wait complete. 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd0a5066640 1 Processor -- start 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd0a5066640 1 -- start start 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd0a5066640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a0101de0 0x7fd0a010bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd0a5066640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a0102790 0x7fd0a010c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd0a5066640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0a0106f10 0x7fd0a010c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd0a5066640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a0076140 con 0x7fd0a0101de0 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd0a5066640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a0075fc0 con 0x7fd0a0102790 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd0a5066640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a00762c0 con 0x7fd0a0106f10 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd09ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a0101de0 0x7fd0a010bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd09ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a0101de0 0x7fd0a010bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47480/0 (socket says 172.21.15.42:47480) 2024-09-19T09:39:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd09ed9d640 1 -- 172.21.15.42:0/1852035928 learned_addr learned my addr 172.21.15.42:0/1852035928 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd09e59c640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a0102790 0x7fd0a010c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.957+0000 7fd09f59e640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0a0106f10 0x7fd0a010c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd09ed9d640 1 -- 172.21.15.42:0/1852035928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0a0106f10 msgr2=0x7fd0a010c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd09ed9d640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0a0106f10 0x7fd0a010c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd09ed9d640 1 -- 172.21.15.42:0/1852035928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a0102790 msgr2=0x7fd0a010c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd09ed9d640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a0102790 0x7fd0a010c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd09ed9d640 1 -- 172.21.15.42:0/1852035928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a01aad40 con 0x7fd0a0101de0 2024-09-19T09:39:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd09ed9d640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a0101de0 0x7fd0a010bce0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd09002aa00 tx=0x7fd090003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd087fff640 1 -- 172.21.15.42:0/1852035928 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09003f070 con 0x7fd0a0101de0 2024-09-19T09:39:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd087fff640 1 -- 172.21.15.42:0/1852035928 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd090031c90 con 0x7fd0a0101de0 2024-09-19T09:39:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd0a5066640 1 -- 172.21.15.42:0/1852035928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a01aafd0 con 0x7fd0a0101de0 2024-09-19T09:39:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd087fff640 1 -- 172.21.15.42:0/1852035928 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090035030 con 0x7fd0a0101de0 2024-09-19T09:39:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.958+0000 7fd0a5066640 1 -- 172.21.15.42:0/1852035928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a01ab420 con 0x7fd0a0101de0 2024-09-19T09:39:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.959+0000 7fd0a5066640 1 -- 172.21.15.42:0/1852035928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a01032c0 con 0x7fd0a0101de0 2024-09-19T09:39:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.961+0000 7fd087fff640 1 -- 172.21.15.42:0/1852035928 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd090042070 con 0x7fd0a0101de0 2024-09-19T09:39:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.961+0000 7fd087fff640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0880a3280 0x7fd0880a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.961+0000 7fd09e59c640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0880a3280 0x7fd0880a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.961+0000 7fd087fff640 1 -- 172.21.15.42:0/1852035928 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd0900f0330 con 0x7fd0a0101de0 2024-09-19T09:39:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.962+0000 7fd09e59c640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0880a3280 0x7fd0880a5740 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd0a010d4a0 tx=0x7fd094005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:00.964+0000 7fd087fff640 1 -- 172.21.15.42:0/1852035928 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd0900bc9e0 con 0x7fd0a0101de0 2024-09-19T09:39:01.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.175+0000 7fd0a5066640 1 -- 172.21.15.42:0/1852035928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0a01021c0 con 0x7fd0a0101de0 2024-09-19T09:39:01.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.176+0000 7fd087fff640 1 -- 172.21.15.42:0/1852035928 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7fd0900c0ce0 con 0x7fd0a0101de0 2024-09-19T09:39:01.178 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:01.178 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:39:01.178 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:39:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 -- 172.21.15.42:0/1852035928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0880a3280 msgr2=0x7fd0880a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0880a3280 0x7fd0880a5740 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd0a010d4a0 tx=0x7fd094005f90 comp rx=0 tx=0).stop 2024-09-19T09:39:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 -- 172.21.15.42:0/1852035928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a0101de0 msgr2=0x7fd0a010bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a0101de0 0x7fd0a010bce0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd09002aa00 tx=0x7fd090003b90 comp rx=0 tx=0).stop 2024-09-19T09:39:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 -- 172.21.15.42:0/1852035928 shutdown_connections 2024-09-19T09:39:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0880a3280 0x7fd0880a5740 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0a0106f10 0x7fd0a010c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a0102790 0x7fd0a010c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 --2- 172.21.15.42:0/1852035928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a0101de0 0x7fd0a010bce0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 -- 172.21.15.42:0/1852035928 >> 172.21.15.42:0/1852035928 conn(0x7fd0a00fd880 msgr2=0x7fd0a00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:01.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 -- 172.21.15.42:0/1852035928 shutdown_connections 2024-09-19T09:39:01.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:01.178+0000 7fd0a5066640 1 -- 172.21.15.42:0/1852035928 wait complete. 2024-09-19T09:39:01.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:01 smithi171 ceph-mon[35803]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:39:01.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:01 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1852035928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:01 smithi136 ceph-mon[34840]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:39:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:01 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1852035928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:01.926 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:01 smithi042 ceph-mon[31223]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:39:01.926 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:01 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1852035928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:01.957 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T09:39:01.957 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T09:39:01.958 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:39:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 -- 172.21.15.42:0/3160398238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c1036e0 msgr2=0x7efe1c109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 --2- 172.21.15.42:0/3160398238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c1036e0 0x7efe1c109f70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efe14009ca0 tx=0x7efe1402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 -- 172.21.15.42:0/3160398238 shutdown_connections 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 --2- 172.21.15.42:0/3160398238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c1036e0 0x7efe1c109f70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 --2- 172.21.15.42:0/3160398238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe1c102d20 0x7efe1c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 --2- 172.21.15.42:0/3160398238 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe1c101b30 0x7efe1c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 -- 172.21.15.42:0/3160398238 >> 172.21.15.42:0/3160398238 conn(0x7efe1c0fd270 msgr2=0x7efe1c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 -- 172.21.15.42:0/3160398238 shutdown_connections 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 -- 172.21.15.42:0/3160398238 wait complete. 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 Processor -- start 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.065+0000 7efe21ee4640 1 -- start start 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe21ee4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe1c101b30 0x7efe1c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe21ee4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c102d20 0x7efe1c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe21ee4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe1c1036e0 0x7efe1c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe21ee4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10d7e0 con 0x7efe1c102d20 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe21ee4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10d660 con 0x7efe1c101b30 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe21ee4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10d960 con 0x7efe1c1036e0 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe12ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c102d20 0x7efe1c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe12ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c102d20 0x7efe1c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47498/0 (socket says 172.21.15.42:47498) 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe12ffd640 1 -- 172.21.15.42:0/1811966657 learned_addr learned my addr 172.21.15.42:0/1811966657 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe1b7fe640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe1c101b30 0x7efe1c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe1bfff640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe1c1036e0 0x7efe1c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe12ffd640 1 -- 172.21.15.42:0/1811966657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe1c1036e0 msgr2=0x7efe1c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe12ffd640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe1c1036e0 0x7efe1c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe12ffd640 1 -- 172.21.15.42:0/1811966657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe1c101b30 msgr2=0x7efe1c075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe12ffd640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe1c101b30 0x7efe1c075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe12ffd640 1 -- 172.21.15.42:0/1811966657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c0753b0 con 0x7efe1c102d20 2024-09-19T09:39:02.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe12ffd640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c102d20 0x7efe1c0745e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efe0400e9f0 tx=0x7efe0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:02.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe197fa640 1 -- 172.21.15.42:0/1811966657 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400cd80 con 0x7efe1c102d20 2024-09-19T09:39:02.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe197fa640 1 -- 172.21.15.42:0/1811966657 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe04010910 con 0x7efe1c102d20 2024-09-19T09:39:02.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.066+0000 7efe21ee4640 1 -- 172.21.15.42:0/1811966657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1c1a1f20 con 0x7efe1c102d20 2024-09-19T09:39:02.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.067+0000 7efe197fa640 1 -- 172.21.15.42:0/1811966657 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04018990 con 0x7efe1c102d20 2024-09-19T09:39:02.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.067+0000 7efe21ee4640 1 -- 172.21.15.42:0/1811966657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1c1a2380 con 0x7efe1c102d20 2024-09-19T09:39:02.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.067+0000 7efe21ee4640 1 -- 172.21.15.42:0/1811966657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c108f20 con 0x7efe1c102d20 2024-09-19T09:39:02.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.069+0000 7efe197fa640 1 -- 172.21.15.42:0/1811966657 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7efe04010ac0 con 0x7efe1c102d20 2024-09-19T09:39:02.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.069+0000 7efe197fa640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efe080a32e0 0x7efe080a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.070+0000 7efe1b7fe640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efe080a32e0 0x7efe080a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.070+0000 7efe197fa640 1 -- 172.21.15.42:0/1811966657 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7efe040cfe00 con 0x7efe1c102d20 2024-09-19T09:39:02.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.070+0000 7efe1b7fe640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efe080a32e0 0x7efe080a57a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe1c102b80 tx=0x7efe0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.074+0000 7efe197fa640 1 -- 172.21.15.42:0/1811966657 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efe0409c9a0 con 0x7efe1c102d20 2024-09-19T09:39:02.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.248+0000 7efe21ee4640 1 -- 172.21.15.42:0/1811966657 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe1c062630 con 0x7efe080a32e0 2024-09-19T09:39:02.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.254+0000 7efe197fa640 1 -- 172.21.15.42:0/1811966657 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259033 (secure 0 0 0) 0x7efe1c062630 con 0x7efe080a32e0 2024-09-19T09:39:02.259 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:02.260 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-19T09:39:02.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.257+0000 7efe21ee4640 1 -- 172.21.15.42:0/1811966657 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efe080a32e0 msgr2=0x7efe080a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.257+0000 7efe21ee4640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efe080a32e0 0x7efe080a57a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe1c102b80 tx=0x7efe0c005f90 comp rx=0 tx=0).stop 2024-09-19T09:39:02.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.257+0000 7efe21ee4640 1 -- 172.21.15.42:0/1811966657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c102d20 msgr2=0x7efe1c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.257+0000 7efe21ee4640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c102d20 0x7efe1c0745e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efe0400e9f0 tx=0x7efe0400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.258+0000 7efe21ee4640 1 -- 172.21.15.42:0/1811966657 shutdown_connections 2024-09-19T09:39:02.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.258+0000 7efe21ee4640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efe080a32e0 0x7efe080a57a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.258+0000 7efe21ee4640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe1c1036e0 0x7efe1c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.258+0000 7efe21ee4640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c102d20 0x7efe1c0745e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.258+0000 7efe21ee4640 1 --2- 172.21.15.42:0/1811966657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe1c101b30 0x7efe1c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.258+0000 7efe21ee4640 1 -- 172.21.15.42:0/1811966657 >> 172.21.15.42:0/1811966657 conn(0x7efe1c0fd270 msgr2=0x7efe1c1060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:02.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.258+0000 7efe21ee4640 1 -- 172.21.15.42:0/1811966657 shutdown_connections 2024-09-19T09:39:02.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.258+0000 7efe21ee4640 1 -- 172.21.15.42:0/1811966657 wait complete. 2024-09-19T09:39:02.270 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-09-19T09:39:00.525459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661211,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1112,"num_read_kb":680,"num_write":444,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":1209642,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":803,"ondisk_log_size":803,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382844,"kb_used_data":12796,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558980,"statfs":{"total":1151940427776,"available":1151548395520,"internally_reserved":0,"allocated":13103104,"data_stored":7221882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1091,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":58,"num_write":16,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002711"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514653+0000","last_change":"2024-09-19T09:37:10.964695+0000","last_active":"2024-09-19T09:38:56.514653+0000","last_peered":"2024-09-19T09:38:56.514653+0000","last_clean":"2024-09-19T09:38:56.514653+0000","last_became_active":"2024-09-19T09:37:10.964343+0000","last_became_peered":"2024-09-19T09:37:10.964343+0000","last_unstale":"2024-09-19T09:38:56.514653+0000","last_undegraded":"2024-09-19T09:38:56.514653+0000","last_fullsized":"2024-09-19T09:38:56.514653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:44.224621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.493324+0000","last_change":"2024-09-19T09:37:10.964163+0000","last_active":"2024-09-19T09:38:56.493324+0000","last_peered":"2024-09-19T09:38:56.493324+0000","last_clean":"2024-09-19T09:38:56.493324+0000","last_became_active":"2024-09-19T09:37:10.963758+0000","last_became_peered":"2024-09-19T09:37:10.963758+0000","last_unstale":"2024-09-19T09:38:56.493324+0000","last_undegraded":"2024-09-19T09:38:56.493324+0000","last_fullsized":"2024-09-19T09:38:56.493324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:49.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508867+0000","last_change":"2024-09-19T09:37:10.958145+0000","last_active":"2024-09-19T09:38:56.508867+0000","last_peered":"2024-09-19T09:38:56.508867+0000","last_clean":"2024-09-19T09:38:56.508867+0000","last_became_active":"2024-09-19T09:37:10.957666+0000","last_became_peered":"2024-09-19T09:37:10.957666+0000","last_unstale":"2024-09-19T09:38:56.508867+0000","last_undegraded":"2024-09-19T09:38:56.508867+0000","last_fullsized":"2024-09-19T09:38:56.508867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.479753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492252+0000","last_change":"2024-09-19T09:37:28.021681+0000","last_active":"2024-09-19T09:38:56.492252+0000","last_peered":"2024-09-19T09:38:56.492252+0000","last_clean":"2024-09-19T09:38:56.492252+0000","last_became_active":"2024-09-19T09:37:28.021294+0000","last_became_peered":"2024-09-19T09:37:28.021294+0000","last_unstale":"2024-09-19T09:38:56.492252+0000","last_undegraded":"2024-09-19T09:38:56.492252+0000","last_fullsized":"2024-09-19T09:38:56.492252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:36.535707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503476+0000","last_change":"2024-09-19T09:37:10.957138+0000","last_active":"2024-09-19T09:38:56.503476+0000","last_peered":"2024-09-19T09:38:56.503476+0000","last_clean":"2024-09-19T09:38:56.503476+0000","last_became_active":"2024-09-19T09:37:10.956824+0000","last_became_peered":"2024-09-19T09:37:10.956824+0000","last_unstale":"2024-09-19T09:38:56.503476+0000","last_undegraded":"2024-09-19T09:38:56.503476+0000","last_fullsized":"2024-09-19T09:38:56.503476+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.919747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510565+0000","last_change":"2024-09-19T09:37:10.969804+0000","last_active":"2024-09-19T09:38:56.510565+0000","last_peered":"2024-09-19T09:38:56.510565+0000","last_clean":"2024-09-19T09:38:56.510565+0000","last_became_active":"2024-09-19T09:37:10.969454+0000","last_became_peered":"2024-09-19T09:37:10.969454+0000","last_unstale":"2024-09-19T09:38:56.510565+0000","last_undegraded":"2024-09-19T09:38:56.510565+0000","last_fullsized":"2024-09-19T09:38:56.510565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:14.856255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017497+0000","last_change":"2024-09-19T09:37:10.962853+0000","last_active":"2024-09-19T09:37:28.017497+0000","last_peered":"2024-09-19T09:37:28.017497+0000","last_clean":"2024-09-19T09:37:28.017497+0000","last_became_active":"2024-09-19T09:37:10.961207+0000","last_became_peered":"2024-09-19T09:37:10.961207+0000","last_unstale":"2024-09-19T09:37:28.017497+0000","last_undegraded":"2024-09-19T09:37:28.017497+0000","last_fullsized":"2024-09-19T09:37:28.017497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511634+0000","last_change":"2024-09-19T09:37:10.970216+0000","last_active":"2024-09-19T09:38:56.511634+0000","last_peered":"2024-09-19T09:38:56.511634+0000","last_clean":"2024-09-19T09:38:56.511634+0000","last_became_active":"2024-09-19T09:37:10.969486+0000","last_became_peered":"2024-09-19T09:37:10.969486+0000","last_unstale":"2024-09-19T09:38:56.511634+0000","last_undegraded":"2024-09-19T09:38:56.511634+0000","last_fullsized":"2024-09-19T09:38:56.511634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:56.859228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515236+0000","last_change":"2024-09-19T09:37:10.962596+0000","last_active":"2024-09-19T09:38:56.515236+0000","last_peered":"2024-09-19T09:38:56.515236+0000","last_clean":"2024-09-19T09:38:56.515236+0000","last_became_active":"2024-09-19T09:37:10.962230+0000","last_became_peered":"2024-09-19T09:37:10.962230+0000","last_unstale":"2024-09-19T09:38:56.515236+0000","last_undegraded":"2024-09-19T09:38:56.515236+0000","last_fullsized":"2024-09-19T09:38:56.515236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:07.810793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510890+0000","last_change":"2024-09-19T09:37:10.962186+0000","last_active":"2024-09-19T09:38:56.510890+0000","last_peered":"2024-09-19T09:38:56.510890+0000","last_clean":"2024-09-19T09:38:56.510890+0000","last_became_active":"2024-09-19T09:37:10.961845+0000","last_became_peered":"2024-09-19T09:37:10.961845+0000","last_unstale":"2024-09-19T09:38:56.510890+0000","last_undegraded":"2024-09-19T09:38:56.510890+0000","last_fullsized":"2024-09-19T09:38:56.510890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:24.150103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018025+0000","last_change":"2024-09-19T09:37:10.958763+0000","last_active":"2024-09-19T09:37:28.018025+0000","last_peered":"2024-09-19T09:37:28.018025+0000","last_clean":"2024-09-19T09:37:28.018025+0000","last_became_active":"2024-09-19T09:37:10.958397+0000","last_became_peered":"2024-09-19T09:37:10.958397+0000","last_unstale":"2024-09-19T09:37:28.018025+0000","last_undegraded":"2024-09-19T09:37:28.018025+0000","last_fullsized":"2024-09-19T09:37:28.018025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:37.690594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.505751+0000","last_change":"2024-09-19T09:37:10.964787+0000","last_active":"2024-09-19T09:38:56.505751+0000","last_peered":"2024-09-19T09:38:56.505751+0000","last_clean":"2024-09-19T09:38:56.505751+0000","last_became_active":"2024-09-19T09:37:10.964121+0000","last_became_peered":"2024-09-19T09:37:10.964121+0000","last_unstale":"2024-09-19T09:38:56.505751+0000","last_undegraded":"2024-09-19T09:38:56.505751+0000","last_fullsized":"2024-09-19T09:38:56.505751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:02.456961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507798+0000","last_change":"2024-09-19T09:37:10.963290+0000","last_active":"2024-09-19T09:38:56.507798+0000","last_peered":"2024-09-19T09:38:56.507798+0000","last_clean":"2024-09-19T09:38:56.507798+0000","last_became_active":"2024-09-19T09:37:10.962961+0000","last_became_peered":"2024-09-19T09:37:10.962961+0000","last_unstale":"2024-09-19T09:38:56.507798+0000","last_undegraded":"2024-09-19T09:38:56.507798+0000","last_fullsized":"2024-09-19T09:38:56.507798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.266745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510553+0000","last_change":"2024-09-19T09:37:10.969742+0000","last_active":"2024-09-19T09:38:56.510553+0000","last_peered":"2024-09-19T09:38:56.510553+0000","last_clean":"2024-09-19T09:38:56.510553+0000","last_became_active":"2024-09-19T09:37:10.969399+0000","last_became_peered":"2024-09-19T09:37:10.969399+0000","last_unstale":"2024-09-19T09:38:56.510553+0000","last_undegraded":"2024-09-19T09:38:56.510553+0000","last_fullsized":"2024-09-19T09:38:56.510553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.386596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504556+0000","last_change":"2024-09-19T09:37:10.962406+0000","last_active":"2024-09-19T09:38:56.504556+0000","last_peered":"2024-09-19T09:38:56.504556+0000","last_clean":"2024-09-19T09:38:56.504556+0000","last_became_active":"2024-09-19T09:37:10.962130+0000","last_became_peered":"2024-09-19T09:37:10.962130+0000","last_unstale":"2024-09-19T09:38:56.504556+0000","last_undegraded":"2024-09-19T09:38:56.504556+0000","last_fullsized":"2024-09-19T09:38:56.504556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516451+0000","last_change":"2024-09-19T09:37:10.958465+0000","last_active":"2024-09-19T09:38:56.516451+0000","last_peered":"2024-09-19T09:38:56.516451+0000","last_clean":"2024-09-19T09:38:56.516451+0000","last_became_active":"2024-09-19T09:37:10.957600+0000","last_became_peered":"2024-09-19T09:37:10.957600+0000","last_unstale":"2024-09-19T09:38:56.516451+0000","last_undegraded":"2024-09-19T09:38:56.516451+0000","last_fullsized":"2024-09-19T09:38:56.516451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:39.232483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515449+0000","last_change":"2024-09-19T09:37:10.965463+0000","last_active":"2024-09-19T09:38:56.515449+0000","last_peered":"2024-09-19T09:38:56.515449+0000","last_clean":"2024-09-19T09:38:56.515449+0000","last_became_active":"2024-09-19T09:37:10.965137+0000","last_became_peered":"2024-09-19T09:37:10.965137+0000","last_unstale":"2024-09-19T09:38:56.515449+0000","last_undegraded":"2024-09-19T09:38:56.515449+0000","last_fullsized":"2024-09-19T09:38:56.515449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:19.582515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512633+0000","last_change":"2024-09-19T09:37:10.964897+0000","last_active":"2024-09-19T09:38:56.512633+0000","last_peered":"2024-09-19T09:38:56.512633+0000","last_clean":"2024-09-19T09:38:56.512633+0000","last_became_active":"2024-09-19T09:37:10.964527+0000","last_became_peered":"2024-09-19T09:37:10.964527+0000","last_unstale":"2024-09-19T09:38:56.512633+0000","last_undegraded":"2024-09-19T09:38:56.512633+0000","last_fullsized":"2024-09-19T09:38:56.512633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:29.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507468+0000","last_change":"2024-09-19T09:37:10.953645+0000","last_active":"2024-09-19T09:38:56.507468+0000","last_peered":"2024-09-19T09:38:56.507468+0000","last_clean":"2024-09-19T09:38:56.507468+0000","last_became_active":"2024-09-19T09:37:10.953326+0000","last_became_peered":"2024-09-19T09:37:10.953326+0000","last_unstale":"2024-09-19T09:38:56.507468+0000","last_undegraded":"2024-09-19T09:38:56.507468+0000","last_fullsized":"2024-09-19T09:38:56.507468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.644615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506388+0000","last_change":"2024-09-19T09:37:10.961384+0000","last_active":"2024-09-19T09:38:56.506388+0000","last_peered":"2024-09-19T09:38:56.506388+0000","last_clean":"2024-09-19T09:38:56.506388+0000","last_became_active":"2024-09-19T09:37:10.961038+0000","last_became_peered":"2024-09-19T09:37:10.961038+0000","last_unstale":"2024-09-19T09:38:56.506388+0000","last_undegraded":"2024-09-19T09:38:56.506388+0000","last_fullsized":"2024-09-19T09:38:56.506388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:54.876799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506443+0000","last_change":"2024-09-19T09:37:10.955789+0000","last_active":"2024-09-19T09:38:56.506443+0000","last_peered":"2024-09-19T09:38:56.506443+0000","last_clean":"2024-09-19T09:38:56.506443+0000","last_became_active":"2024-09-19T09:37:10.955447+0000","last_became_peered":"2024-09-19T09:37:10.955447+0000","last_unstale":"2024-09-19T09:38:56.506443+0000","last_undegraded":"2024-09-19T09:38:56.506443+0000","last_fullsized":"2024-09-19T09:38:56.506443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:28.512069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516852+0000","last_change":"2024-09-19T09:37:10.956501+0000","last_active":"2024-09-19T09:38:56.516852+0000","last_peered":"2024-09-19T09:38:56.516852+0000","last_clean":"2024-09-19T09:38:56.516852+0000","last_became_active":"2024-09-19T09:37:10.956161+0000","last_became_peered":"2024-09-19T09:37:10.956161+0000","last_unstale":"2024-09-19T09:38:56.516852+0000","last_undegraded":"2024-09-19T09:38:56.516852+0000","last_fullsized":"2024-09-19T09:38:56.516852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:31.738143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510649+0000","last_change":"2024-09-19T09:37:10.961486+0000","last_active":"2024-09-19T09:38:56.510649+0000","last_peered":"2024-09-19T09:38:56.510649+0000","last_clean":"2024-09-19T09:38:56.510649+0000","last_became_active":"2024-09-19T09:37:10.960877+0000","last_became_peered":"2024-09-19T09:37:10.960877+0000","last_unstale":"2024-09-19T09:38:56.510649+0000","last_undegraded":"2024-09-19T09:38:56.510649+0000","last_fullsized":"2024-09-19T09:38:56.510649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:34.889431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509905+0000","last_change":"2024-09-19T09:37:10.964400+0000","last_active":"2024-09-19T09:38:56.509905+0000","last_peered":"2024-09-19T09:38:56.509905+0000","last_clean":"2024-09-19T09:38:56.509905+0000","last_became_active":"2024-09-19T09:37:10.963394+0000","last_became_peered":"2024-09-19T09:37:10.963394+0000","last_unstale":"2024-09-19T09:38:56.509905+0000","last_undegraded":"2024-09-19T09:38:56.509905+0000","last_fullsized":"2024-09-19T09:38:56.509905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:22.185221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509856+0000","last_change":"2024-09-19T09:37:10.959661+0000","last_active":"2024-09-19T09:38:56.509856+0000","last_peered":"2024-09-19T09:38:56.509856+0000","last_clean":"2024-09-19T09:38:56.509856+0000","last_became_active":"2024-09-19T09:37:10.959371+0000","last_became_peered":"2024-09-19T09:37:10.959371+0000","last_unstale":"2024-09-19T09:38:56.509856+0000","last_undegraded":"2024-09-19T09:38:56.509856+0000","last_fullsized":"2024-09-19T09:38:56.509856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.752712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514203+0000","last_change":"2024-09-19T09:37:10.967310+0000","last_active":"2024-09-19T09:38:56.514203+0000","last_peered":"2024-09-19T09:38:56.514203+0000","last_clean":"2024-09-19T09:38:56.514203+0000","last_became_active":"2024-09-19T09:37:10.965415+0000","last_became_peered":"2024-09-19T09:37:10.965415+0000","last_unstale":"2024-09-19T09:38:56.514203+0000","last_undegraded":"2024-09-19T09:38:56.514203+0000","last_fullsized":"2024-09-19T09:38:56.514203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:16.968646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497702+0000","last_change":"2024-09-19T09:37:10.967301+0000","last_active":"2024-09-19T09:38:56.497702+0000","last_peered":"2024-09-19T09:38:56.497702+0000","last_clean":"2024-09-19T09:38:56.497702+0000","last_became_active":"2024-09-19T09:37:10.966397+0000","last_became_peered":"2024-09-19T09:37:10.966397+0000","last_unstale":"2024-09-19T09:38:56.497702+0000","last_undegraded":"2024-09-19T09:38:56.497702+0000","last_fullsized":"2024-09-19T09:38:56.497702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.621085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509302+0000","last_change":"2024-09-19T09:37:10.958069+0000","last_active":"2024-09-19T09:38:56.509302+0000","last_peered":"2024-09-19T09:38:56.509302+0000","last_clean":"2024-09-19T09:38:56.509302+0000","last_became_active":"2024-09-19T09:37:10.957670+0000","last_became_peered":"2024-09-19T09:37:10.957670+0000","last_unstale":"2024-09-19T09:38:56.509302+0000","last_undegraded":"2024-09-19T09:38:56.509302+0000","last_fullsized":"2024-09-19T09:38:56.509302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.412978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503454+0000","last_change":"2024-09-19T09:37:10.960490+0000","last_active":"2024-09-19T09:38:56.503454+0000","last_peered":"2024-09-19T09:38:56.503454+0000","last_clean":"2024-09-19T09:38:56.503454+0000","last_became_active":"2024-09-19T09:37:10.960239+0000","last_became_peered":"2024-09-19T09:37:10.960239+0000","last_unstale":"2024-09-19T09:38:56.503454+0000","last_undegraded":"2024-09-19T09:38:56.503454+0000","last_fullsized":"2024-09-19T09:38:56.503454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.384348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507069+0000","last_change":"2024-09-19T09:37:10.955930+0000","last_active":"2024-09-19T09:38:56.507069+0000","last_peered":"2024-09-19T09:38:56.507069+0000","last_clean":"2024-09-19T09:38:56.507069+0000","last_became_active":"2024-09-19T09:37:10.955605+0000","last_became_peered":"2024-09-19T09:37:10.955605+0000","last_unstale":"2024-09-19T09:38:56.507069+0000","last_undegraded":"2024-09-19T09:38:56.507069+0000","last_fullsized":"2024-09-19T09:38:56.507069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:36.033350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502819+0000","last_change":"2024-09-19T09:37:10.960467+0000","last_active":"2024-09-19T09:38:56.502819+0000","last_peered":"2024-09-19T09:38:56.502819+0000","last_clean":"2024-09-19T09:38:56.502819+0000","last_became_active":"2024-09-19T09:37:10.960082+0000","last_became_peered":"2024-09-19T09:37:10.960082+0000","last_unstale":"2024-09-19T09:38:56.502819+0000","last_undegraded":"2024-09-19T09:38:56.502819+0000","last_fullsized":"2024-09-19T09:38:56.502819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:07.451648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498620+0000","last_change":"2024-09-19T09:37:10.965674+0000","last_active":"2024-09-19T09:38:56.498620+0000","last_peered":"2024-09-19T09:38:56.498620+0000","last_clean":"2024-09-19T09:38:56.498620+0000","last_became_active":"2024-09-19T09:37:10.965368+0000","last_became_peered":"2024-09-19T09:37:10.965368+0000","last_unstale":"2024-09-19T09:38:56.498620+0000","last_undegraded":"2024-09-19T09:38:56.498620+0000","last_fullsized":"2024-09-19T09:38:56.498620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:23.712785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497701+0000","last_change":"2024-09-19T09:37:10.966972+0000","last_active":"2024-09-19T09:38:56.497701+0000","last_peered":"2024-09-19T09:38:56.497701+0000","last_clean":"2024-09-19T09:38:56.497701+0000","last_became_active":"2024-09-19T09:37:10.966642+0000","last_became_peered":"2024-09-19T09:37:10.966642+0000","last_unstale":"2024-09-19T09:38:56.497701+0000","last_undegraded":"2024-09-19T09:38:56.497701+0000","last_fullsized":"2024-09-19T09:38:56.497701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.416611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:57.143115+0000","last_change":"2024-09-19T09:37:08.953116+0000","last_active":"2024-09-19T09:38:57.143115+0000","last_peered":"2024-09-19T09:38:57.143115+0000","last_clean":"2024-09-19T09:38:57.143115+0000","last_became_active":"2024-09-19T09:37:08.952748+0000","last_became_peered":"2024-09-19T09:37:08.952748+0000","last_unstale":"2024-09-19T09:38:57.143115+0000","last_undegraded":"2024-09-19T09:38:57.143115+0000","last_fullsized":"2024-09-19T09:38:57.143115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:22.395359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509861+0000","last_change":"2024-09-19T09:37:10.969106+0000","last_active":"2024-09-19T09:38:56.509861+0000","last_peered":"2024-09-19T09:38:56.509861+0000","last_clean":"2024-09-19T09:38:56.509861+0000","last_became_active":"2024-09-19T09:37:10.968801+0000","last_became_peered":"2024-09-19T09:37:10.968801+0000","last_unstale":"2024-09-19T09:38:56.509861+0000","last_undegraded":"2024-09-19T09:38:56.509861+0000","last_fullsized":"2024-09-19T09:38:56.509861+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.674925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014739+0000","last_change":"2024-09-19T09:37:08.949604+0000","last_active":"2024-09-19T09:37:28.014739+0000","last_peered":"2024-09-19T09:37:28.014739+0000","last_clean":"2024-09-19T09:37:28.014739+0000","last_became_active":"2024-09-19T09:37:08.949143+0000","last_became_peered":"2024-09-19T09:37:08.949143+0000","last_unstale":"2024-09-19T09:37:28.014739+0000","last_undegraded":"2024-09-19T09:37:28.014739+0000","last_fullsized":"2024-09-19T09:37:28.014739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:37.933319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012827+0000","last_change":"2024-09-19T09:37:08.946277+0000","last_active":"2024-09-19T09:37:28.012827+0000","last_peered":"2024-09-19T09:37:28.012827+0000","last_clean":"2024-09-19T09:37:28.012827+0000","last_became_active":"2024-09-19T09:37:08.945808+0000","last_became_peered":"2024-09-19T09:37:08.945808+0000","last_unstale":"2024-09-19T09:37:28.012827+0000","last_undegraded":"2024-09-19T09:37:28.012827+0000","last_fullsized":"2024-09-19T09:37:28.012827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.060811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511056+0000","last_change":"2024-09-19T09:37:10.957765+0000","last_active":"2024-09-19T09:38:56.511056+0000","last_peered":"2024-09-19T09:38:56.511056+0000","last_clean":"2024-09-19T09:38:56.511056+0000","last_became_active":"2024-09-19T09:37:10.957458+0000","last_became_peered":"2024-09-19T09:37:10.957458+0000","last_unstale":"2024-09-19T09:38:56.511056+0000","last_undegraded":"2024-09-19T09:38:56.511056+0000","last_fullsized":"2024-09-19T09:38:56.511056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:49.418473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020344+0000","last_change":"2024-09-19T09:37:08.953124+0000","last_active":"2024-09-19T09:37:28.020344+0000","last_peered":"2024-09-19T09:37:28.020344+0000","last_clean":"2024-09-19T09:37:28.020344+0000","last_became_active":"2024-09-19T09:37:08.952159+0000","last_became_peered":"2024-09-19T09:37:08.952159+0000","last_unstale":"2024-09-19T09:37:28.020344+0000","last_undegraded":"2024-09-19T09:37:28.020344+0000","last_fullsized":"2024-09-19T09:37:28.020344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:24.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509006+0000","last_change":"2024-09-19T09:37:10.964038+0000","last_active":"2024-09-19T09:38:56.509006+0000","last_peered":"2024-09-19T09:38:56.509006+0000","last_clean":"2024-09-19T09:38:56.509006+0000","last_became_active":"2024-09-19T09:37:10.963671+0000","last_became_peered":"2024-09-19T09:37:10.963671+0000","last_unstale":"2024-09-19T09:38:56.509006+0000","last_undegraded":"2024-09-19T09:38:56.509006+0000","last_fullsized":"2024-09-19T09:38:56.509006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:19.743329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":217,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.143930+0000","last_change":"2024-09-19T09:37:08.949600+0000","last_active":"2024-09-19T09:38:58.143930+0000","last_peered":"2024-09-19T09:38:58.143930+0000","last_clean":"2024-09-19T09:38:58.143930+0000","last_became_active":"2024-09-19T09:37:08.949141+0000","last_became_peered":"2024-09-19T09:37:08.949141+0000","last_unstale":"2024-09-19T09:38:58.143930+0000","last_undegraded":"2024-09-19T09:38:58.143930+0000","last_fullsized":"2024-09-19T09:38:58.143930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:42.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515006+0000","last_change":"2024-09-19T09:37:10.967506+0000","last_active":"2024-09-19T09:38:56.515006+0000","last_peered":"2024-09-19T09:38:56.515006+0000","last_clean":"2024-09-19T09:38:56.515006+0000","last_became_active":"2024-09-19T09:37:10.967193+0000","last_became_peered":"2024-09-19T09:37:10.967193+0000","last_unstale":"2024-09-19T09:38:56.515006+0000","last_undegraded":"2024-09-19T09:38:56.515006+0000","last_fullsized":"2024-09-19T09:38:56.515006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:33.158325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017606+0000","last_change":"2024-09-19T09:37:08.955305+0000","last_active":"2024-09-19T09:37:28.017606+0000","last_peered":"2024-09-19T09:37:28.017606+0000","last_clean":"2024-09-19T09:37:28.017606+0000","last_became_active":"2024-09-19T09:37:08.954932+0000","last_became_peered":"2024-09-19T09:37:08.954932+0000","last_unstale":"2024-09-19T09:37:28.017606+0000","last_undegraded":"2024-09-19T09:37:28.017606+0000","last_fullsized":"2024-09-19T09:37:28.017606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.157466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502511+0000","last_change":"2024-09-19T09:37:28.021974+0000","last_active":"2024-09-19T09:38:56.502511+0000","last_peered":"2024-09-19T09:38:56.502511+0000","last_clean":"2024-09-19T09:38:56.502511+0000","last_became_active":"2024-09-19T09:37:28.021579+0000","last_became_peered":"2024-09-19T09:37:28.021579+0000","last_unstale":"2024-09-19T09:38:56.502511+0000","last_undegraded":"2024-09-19T09:38:56.502511+0000","last_fullsized":"2024-09-19T09:38:56.502511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:28.562862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021814+0000","last_change":"2024-09-19T09:37:08.976540+0000","last_active":"2024-09-19T09:37:28.021814+0000","last_peered":"2024-09-19T09:37:28.021814+0000","last_clean":"2024-09-19T09:37:28.021814+0000","last_became_active":"2024-09-19T09:37:08.976196+0000","last_became_peered":"2024-09-19T09:37:08.976196+0000","last_unstale":"2024-09-19T09:37:28.021814+0000","last_undegraded":"2024-09-19T09:37:28.021814+0000","last_fullsized":"2024-09-19T09:37:28.021814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:38.735947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515663+0000","last_change":"2024-09-19T09:37:28.021407+0000","last_active":"2024-09-19T09:38:56.515663+0000","last_peered":"2024-09-19T09:38:56.515663+0000","last_clean":"2024-09-19T09:38:56.515663+0000","last_became_active":"2024-09-19T09:37:28.021020+0000","last_became_peered":"2024-09-19T09:37:28.021020+0000","last_unstale":"2024-09-19T09:38:56.515663+0000","last_undegraded":"2024-09-19T09:38:56.515663+0000","last_fullsized":"2024-09-19T09:38:56.515663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:25.394012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'37","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.144752+0000","last_change":"2024-09-19T09:37:28.029037+0000","last_active":"2024-09-19T09:38:58.144752+0000","last_peered":"2024-09-19T09:38:58.144752+0000","last_clean":"2024-09-19T09:38:58.144752+0000","last_became_active":"2024-09-19T09:37:28.018325+0000","last_became_peered":"2024-09-19T09:37:28.018325+0000","last_unstale":"2024-09-19T09:38:58.144752+0000","last_undegraded":"2024-09-19T09:38:58.144752+0000","last_fullsized":"2024-09-19T09:38:58.144752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:56.121569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62867,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":162,"num_write":39,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492834+0000","last_change":"2024-09-19T09:37:10.963688+0000","last_active":"2024-09-19T09:38:56.492834+0000","last_peered":"2024-09-19T09:38:56.492834+0000","last_clean":"2024-09-19T09:38:56.492834+0000","last_became_active":"2024-09-19T09:37:10.963296+0000","last_became_peered":"2024-09-19T09:37:10.963296+0000","last_unstale":"2024-09-19T09:38:56.492834+0000","last_undegraded":"2024-09-19T09:38:56.492834+0000","last_fullsized":"2024-09-19T09:38:56.492834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:49.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015183+0000","last_change":"2024-09-19T09:37:08.952198+0000","last_active":"2024-09-19T09:37:28.015183+0000","last_peered":"2024-09-19T09:37:28.015183+0000","last_clean":"2024-09-19T09:37:28.015183+0000","last_became_active":"2024-09-19T09:37:08.951699+0000","last_became_peered":"2024-09-19T09:37:08.951699+0000","last_unstale":"2024-09-19T09:37:28.015183+0000","last_undegraded":"2024-09-19T09:37:28.015183+0000","last_fullsized":"2024-09-19T09:37:28.015183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:46.729847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510576+0000","last_change":"2024-09-19T09:37:10.955741+0000","last_active":"2024-09-19T09:38:56.510576+0000","last_peered":"2024-09-19T09:38:56.510576+0000","last_clean":"2024-09-19T09:38:56.510576+0000","last_became_active":"2024-09-19T09:37:10.955394+0000","last_became_peered":"2024-09-19T09:37:10.955394+0000","last_unstale":"2024-09-19T09:38:56.510576+0000","last_undegraded":"2024-09-19T09:38:56.510576+0000","last_fullsized":"2024-09-19T09:38:56.510576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:56.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021172+0000","last_change":"2024-09-19T09:37:08.949979+0000","last_active":"2024-09-19T09:37:28.021172+0000","last_peered":"2024-09-19T09:37:28.021172+0000","last_clean":"2024-09-19T09:37:28.021172+0000","last_became_active":"2024-09-19T09:37:08.949664+0000","last_became_peered":"2024-09-19T09:37:08.949664+0000","last_unstale":"2024-09-19T09:37:28.021172+0000","last_undegraded":"2024-09-19T09:37:28.021172+0000","last_fullsized":"2024-09-19T09:37:28.021172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:06.449337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017773+0000","last_change":"2024-09-19T09:37:10.957479+0000","last_active":"2024-09-19T09:37:28.017773+0000","last_peered":"2024-09-19T09:37:28.017773+0000","last_clean":"2024-09-19T09:37:28.017773+0000","last_became_active":"2024-09-19T09:37:10.957130+0000","last_became_peered":"2024-09-19T09:37:10.957130+0000","last_unstale":"2024-09-19T09:37:28.017773+0000","last_undegraded":"2024-09-19T09:37:28.017773+0000","last_fullsized":"2024-09-19T09:37:28.017773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:52.840857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'8","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.155534+0000","last_change":"2024-09-19T09:37:08.951558+0000","last_active":"2024-09-19T09:38:58.155534+0000","last_peered":"2024-09-19T09:38:58.155534+0000","last_clean":"2024-09-19T09:38:58.155534+0000","last_became_active":"2024-09-19T09:37:08.951092+0000","last_became_peered":"2024-09-19T09:37:08.951092+0000","last_unstale":"2024-09-19T09:38:58.155534+0000","last_undegraded":"2024-09-19T09:38:58.155534+0000","last_fullsized":"2024-09-19T09:38:58.155534+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:30.326253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018198+0000","last_change":"2024-09-19T09:37:10.962692+0000","last_active":"2024-09-19T09:37:28.018198+0000","last_peered":"2024-09-19T09:37:28.018198+0000","last_clean":"2024-09-19T09:37:28.018198+0000","last_became_active":"2024-09-19T09:37:10.962145+0000","last_became_peered":"2024-09-19T09:37:10.962145+0000","last_unstale":"2024-09-19T09:37:28.018198+0000","last_undegraded":"2024-09-19T09:37:28.018198+0000","last_fullsized":"2024-09-19T09:37:28.018198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:48.232759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020176+0000","last_change":"2024-09-19T09:37:08.976531+0000","last_active":"2024-09-19T09:37:28.020176+0000","last_peered":"2024-09-19T09:37:28.020176+0000","last_clean":"2024-09-19T09:37:28.020176+0000","last_became_active":"2024-09-19T09:37:08.975892+0000","last_became_peered":"2024-09-19T09:37:08.975892+0000","last_unstale":"2024-09-19T09:37:28.020176+0000","last_undegraded":"2024-09-19T09:37:28.020176+0000","last_fullsized":"2024-09-19T09:37:28.020176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.545504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508392+0000","last_change":"2024-09-19T09:37:10.968116+0000","last_active":"2024-09-19T09:38:56.508392+0000","last_peered":"2024-09-19T09:38:56.508392+0000","last_clean":"2024-09-19T09:38:56.508392+0000","last_became_active":"2024-09-19T09:37:10.967767+0000","last_became_peered":"2024-09-19T09:37:10.967767+0000","last_unstale":"2024-09-19T09:38:56.508392+0000","last_undegraded":"2024-09-19T09:38:56.508392+0000","last_fullsized":"2024-09-19T09:38:56.508392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:34.104712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020842+0000","last_change":"2024-09-19T09:37:08.949384+0000","last_active":"2024-09-19T09:37:28.020842+0000","last_peered":"2024-09-19T09:37:28.020842+0000","last_clean":"2024-09-19T09:37:28.020842+0000","last_became_active":"2024-09-19T09:37:08.948950+0000","last_became_peered":"2024-09-19T09:37:08.948950+0000","last_unstale":"2024-09-19T09:37:28.020842+0000","last_undegraded":"2024-09-19T09:37:28.020842+0000","last_fullsized":"2024-09-19T09:37:28.020842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:15.527608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506196+0000","last_change":"2024-09-19T09:37:10.965720+0000","last_active":"2024-09-19T09:38:56.506196+0000","last_peered":"2024-09-19T09:38:56.506196+0000","last_clean":"2024-09-19T09:38:56.506196+0000","last_became_active":"2024-09-19T09:37:10.965341+0000","last_became_peered":"2024-09-19T09:37:10.965341+0000","last_unstale":"2024-09-19T09:38:56.506196+0000","last_undegraded":"2024-09-19T09:38:56.506196+0000","last_fullsized":"2024-09-19T09:38:56.506196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:36.591438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013189+0000","last_change":"2024-09-19T09:37:08.953702+0000","last_active":"2024-09-19T09:37:28.013189+0000","last_peered":"2024-09-19T09:37:28.013189+0000","last_clean":"2024-09-19T09:37:28.013189+0000","last_became_active":"2024-09-19T09:37:08.953312+0000","last_became_peered":"2024-09-19T09:37:08.953312+0000","last_unstale":"2024-09-19T09:37:28.013189+0000","last_undegraded":"2024-09-19T09:37:28.013189+0000","last_fullsized":"2024-09-19T09:37:28.013189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:54.059096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017769+0000","last_change":"2024-09-19T09:37:10.959814+0000","last_active":"2024-09-19T09:37:28.017769+0000","last_peered":"2024-09-19T09:37:28.017769+0000","last_clean":"2024-09-19T09:37:28.017769+0000","last_became_active":"2024-09-19T09:37:10.959342+0000","last_became_peered":"2024-09-19T09:37:10.959342+0000","last_unstale":"2024-09-19T09:37:28.017769+0000","last_undegraded":"2024-09-19T09:37:28.017769+0000","last_fullsized":"2024-09-19T09:37:28.017769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021892+0000","last_change":"2024-09-19T09:37:08.947978+0000","last_active":"2024-09-19T09:37:28.021892+0000","last_peered":"2024-09-19T09:37:28.021892+0000","last_clean":"2024-09-19T09:37:28.021892+0000","last_became_active":"2024-09-19T09:37:08.947548+0000","last_became_peered":"2024-09-19T09:37:08.947548+0000","last_unstale":"2024-09-19T09:37:28.021892+0000","last_undegraded":"2024-09-19T09:37:28.021892+0000","last_fullsized":"2024-09-19T09:37:28.021892+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:38.283616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018434+0000","last_change":"2024-09-19T09:37:10.964008+0000","last_active":"2024-09-19T09:37:28.018434+0000","last_peered":"2024-09-19T09:37:28.018434+0000","last_clean":"2024-09-19T09:37:28.018434+0000","last_became_active":"2024-09-19T09:37:10.963554+0000","last_became_peered":"2024-09-19T09:37:10.963554+0000","last_unstale":"2024-09-19T09:37:28.018434+0000","last_undegraded":"2024-09-19T09:37:28.018434+0000","last_fullsized":"2024-09-19T09:37:28.018434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:57.320967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'5","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:57.154074+0000","last_change":"2024-09-19T09:37:28.027589+0000","last_active":"2024-09-19T09:38:57.154074+0000","last_peered":"2024-09-19T09:38:57.154074+0000","last_clean":"2024-09-19T09:38:57.154074+0000","last_became_active":"2024-09-19T09:37:28.020013+0000","last_became_peered":"2024-09-19T09:37:28.020013+0000","last_unstale":"2024-09-19T09:38:57.154074+0000","last_undegraded":"2024-09-19T09:38:57.154074+0000","last_fullsized":"2024-09-19T09:38:57.154074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:51.327069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018295+0000","last_change":"2024-09-19T09:37:10.960337+0000","last_active":"2024-09-19T09:37:28.018295+0000","last_peered":"2024-09-19T09:37:28.018295+0000","last_clean":"2024-09-19T09:37:28.018295+0000","last_became_active":"2024-09-19T09:37:10.960006+0000","last_became_peered":"2024-09-19T09:37:10.960006+0000","last_unstale":"2024-09-19T09:37:28.018295+0000","last_undegraded":"2024-09-19T09:37:28.018295+0000","last_fullsized":"2024-09-19T09:37:28.018295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:16.942098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019301+0000","last_change":"2024-09-19T09:36:01.923601+0000","last_active":"2024-09-19T09:37:28.019301+0000","last_peered":"2024-09-19T09:37:28.019301+0000","last_clean":"2024-09-19T09:37:28.019301+0000","last_became_active":"2024-09-19T09:36:01.923051+0000","last_became_peered":"2024-09-19T09:36:01.923051+0000","last_unstale":"2024-09-19T09:37:28.019301+0000","last_undegraded":"2024-09-19T09:37:28.019301+0000","last_fullsized":"2024-09-19T09:37:28.019301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_clean_scrub_stamp":"2024-09-19T09:32:45.321588+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:41.635565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013536+0000","last_change":"2024-09-19T09:37:08.948818+0000","last_active":"2024-09-19T09:37:28.013536+0000","last_peered":"2024-09-19T09:37:28.013536+0000","last_clean":"2024-09-19T09:37:28.013536+0000","last_became_active":"2024-09-19T09:37:08.948494+0000","last_became_peered":"2024-09-19T09:37:08.948494+0000","last_unstale":"2024-09-19T09:37:28.013536+0000","last_undegraded":"2024-09-19T09:37:28.013536+0000","last_fullsized":"2024-09-19T09:37:28.013536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:35.255778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514837+0000","last_change":"2024-09-19T09:37:10.966315+0000","last_active":"2024-09-19T09:38:56.514837+0000","last_peered":"2024-09-19T09:38:56.514837+0000","last_clean":"2024-09-19T09:38:56.514837+0000","last_became_active":"2024-09-19T09:37:10.965979+0000","last_became_peered":"2024-09-19T09:37:10.965979+0000","last_unstale":"2024-09-19T09:38:56.514837+0000","last_undegraded":"2024-09-19T09:38:56.514837+0000","last_fullsized":"2024-09-19T09:38:56.514837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:36.229434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.030136+0000","last_change":"2024-09-19T09:37:28.029598+0000","last_active":"2024-09-19T09:37:28.030136+0000","last_peered":"2024-09-19T09:37:28.030136+0000","last_clean":"2024-09-19T09:37:28.030136+0000","last_became_active":"2024-09-19T09:37:28.021459+0000","last_became_peered":"2024-09-19T09:37:28.021459+0000","last_unstale":"2024-09-19T09:37:28.030136+0000","last_undegraded":"2024-09-19T09:37:28.030136+0000","last_fullsized":"2024-09-19T09:37:28.030136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:00.755946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507049+0000","last_change":"2024-09-19T09:37:10.962825+0000","last_active":"2024-09-19T09:38:56.507049+0000","last_peered":"2024-09-19T09:38:56.507049+0000","last_clean":"2024-09-19T09:38:56.507049+0000","last_became_active":"2024-09-19T09:37:10.962475+0000","last_became_peered":"2024-09-19T09:37:10.962475+0000","last_unstale":"2024-09-19T09:38:56.507049+0000","last_undegraded":"2024-09-19T09:38:56.507049+0000","last_fullsized":"2024-09-19T09:38:56.507049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:30.650918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'6","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.465134+0000","last_change":"2024-09-19T09:37:08.976364+0000","last_active":"2024-09-19T09:38:56.465134+0000","last_peered":"2024-09-19T09:38:56.465134+0000","last_clean":"2024-09-19T09:38:56.465134+0000","last_became_active":"2024-09-19T09:37:08.975983+0000","last_became_peered":"2024-09-19T09:37:08.975983+0000","last_unstale":"2024-09-19T09:38:56.465134+0000","last_undegraded":"2024-09-19T09:38:56.465134+0000","last_fullsized":"2024-09-19T09:38:56.465134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.762847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.489815+0000","last_change":"2024-09-19T09:37:28.020341+0000","last_active":"2024-09-19T09:38:56.489815+0000","last_peered":"2024-09-19T09:38:56.489815+0000","last_clean":"2024-09-19T09:38:56.489815+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:56.489815+0000","last_undegraded":"2024-09-19T09:38:56.489815+0000","last_fullsized":"2024-09-19T09:38:56.489815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:24.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"79'6","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:55.139822+0000","last_change":"2024-09-19T09:37:08.950403+0000","last_active":"2024-09-19T09:38:55.139822+0000","last_peered":"2024-09-19T09:38:55.139822+0000","last_clean":"2024-09-19T09:38:55.139822+0000","last_became_active":"2024-09-19T09:37:08.950077+0000","last_became_peered":"2024-09-19T09:37:08.950077+0000","last_unstale":"2024-09-19T09:38:55.139822+0000","last_undegraded":"2024-09-19T09:38:55.139822+0000","last_fullsized":"2024-09-19T09:38:55.139822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:46.446439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509036+0000","last_change":"2024-09-19T09:37:10.969493+0000","last_active":"2024-09-19T09:38:56.509036+0000","last_peered":"2024-09-19T09:38:56.509036+0000","last_clean":"2024-09-19T09:38:56.509036+0000","last_became_active":"2024-09-19T09:37:10.969038+0000","last_became_peered":"2024-09-19T09:37:10.969038+0000","last_unstale":"2024-09-19T09:38:56.509036+0000","last_undegraded":"2024-09-19T09:38:56.509036+0000","last_fullsized":"2024-09-19T09:38:56.509036+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:55.518806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015137+0000","last_change":"2024-09-19T09:37:08.977207+0000","last_active":"2024-09-19T09:37:28.015137+0000","last_peered":"2024-09-19T09:37:28.015137+0000","last_clean":"2024-09-19T09:37:28.015137+0000","last_became_active":"2024-09-19T09:37:08.976859+0000","last_became_peered":"2024-09-19T09:37:08.976859+0000","last_unstale":"2024-09-19T09:37:28.015137+0000","last_undegraded":"2024-09-19T09:37:28.015137+0000","last_fullsized":"2024-09-19T09:37:28.015137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:25.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504626+0000","last_change":"2024-09-19T09:37:28.023437+0000","last_active":"2024-09-19T09:38:56.504626+0000","last_peered":"2024-09-19T09:38:56.504626+0000","last_clean":"2024-09-19T09:38:56.504626+0000","last_became_active":"2024-09-19T09:37:28.018678+0000","last_became_peered":"2024-09-19T09:37:28.018678+0000","last_unstale":"2024-09-19T09:38:56.504626+0000","last_undegraded":"2024-09-19T09:38:56.504626+0000","last_fullsized":"2024-09-19T09:38:56.504626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:44.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020845+0000","last_change":"2024-09-19T09:37:08.976594+0000","last_active":"2024-09-19T09:37:28.020845+0000","last_peered":"2024-09-19T09:37:28.020845+0000","last_clean":"2024-09-19T09:37:28.020845+0000","last_became_active":"2024-09-19T09:37:08.976222+0000","last_became_peered":"2024-09-19T09:37:08.976222+0000","last_unstale":"2024-09-19T09:37:28.020845+0000","last_undegraded":"2024-09-19T09:37:28.020845+0000","last_fullsized":"2024-09-19T09:37:28.020845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:53.492591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498775+0000","last_change":"2024-09-19T09:37:10.957096+0000","last_active":"2024-09-19T09:38:56.498775+0000","last_peered":"2024-09-19T09:38:56.498775+0000","last_clean":"2024-09-19T09:38:56.498775+0000","last_became_active":"2024-09-19T09:37:10.956740+0000","last_became_peered":"2024-09-19T09:37:10.956740+0000","last_unstale":"2024-09-19T09:38:56.498775+0000","last_undegraded":"2024-09-19T09:38:56.498775+0000","last_fullsized":"2024-09-19T09:38:56.498775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:40.358624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'17","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.032479+0000","last_change":"2024-09-19T09:37:08.948528+0000","last_active":"2024-09-19T09:38:58.032479+0000","last_peered":"2024-09-19T09:38:58.032479+0000","last_clean":"2024-09-19T09:38:58.032479+0000","last_became_active":"2024-09-19T09:37:08.948183+0000","last_became_peered":"2024-09-19T09:37:08.948183+0000","last_unstale":"2024-09-19T09:38:58.032479+0000","last_undegraded":"2024-09-19T09:38:58.032479+0000","last_fullsized":"2024-09-19T09:38:58.032479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:23.214471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508526+0000","last_change":"2024-09-19T09:37:10.959492+0000","last_active":"2024-09-19T09:38:56.508526+0000","last_peered":"2024-09-19T09:38:56.508526+0000","last_clean":"2024-09-19T09:38:56.508526+0000","last_became_active":"2024-09-19T09:37:10.959032+0000","last_became_peered":"2024-09-19T09:37:10.959032+0000","last_unstale":"2024-09-19T09:38:56.508526+0000","last_undegraded":"2024-09-19T09:38:56.508526+0000","last_fullsized":"2024-09-19T09:38:56.508526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.080976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013794+0000","last_change":"2024-09-19T09:37:09.270315+0000","last_active":"2024-09-19T09:37:28.013794+0000","last_peered":"2024-09-19T09:37:28.013794+0000","last_clean":"2024-09-19T09:37:28.013794+0000","last_became_active":"2024-09-19T09:37:09.269891+0000","last_became_peered":"2024-09-19T09:37:09.269891+0000","last_unstale":"2024-09-19T09:37:28.013794+0000","last_undegraded":"2024-09-19T09:37:28.013794+0000","last_fullsized":"2024-09-19T09:37:28.013794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:12.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509933+0000","last_change":"2024-09-19T09:37:10.961363+0000","last_active":"2024-09-19T09:38:56.509933+0000","last_peered":"2024-09-19T09:38:56.509933+0000","last_clean":"2024-09-19T09:38:56.509933+0000","last_became_active":"2024-09-19T09:37:10.960951+0000","last_became_peered":"2024-09-19T09:37:10.960951+0000","last_unstale":"2024-09-19T09:38:56.509933+0000","last_undegraded":"2024-09-19T09:38:56.509933+0000","last_fullsized":"2024-09-19T09:38:56.509933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:31.226355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015555+0000","last_change":"2024-09-19T09:37:08.976805+0000","last_active":"2024-09-19T09:37:28.015555+0000","last_peered":"2024-09-19T09:37:28.015555+0000","last_clean":"2024-09-19T09:37:28.015555+0000","last_became_active":"2024-09-19T09:37:08.976502+0000","last_became_peered":"2024-09-19T09:37:08.976502+0000","last_unstale":"2024-09-19T09:37:28.015555+0000","last_undegraded":"2024-09-19T09:37:28.015555+0000","last_fullsized":"2024-09-19T09:37:28.015555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:25.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.470670+0000","last_change":"2024-09-19T09:37:10.965723+0000","last_active":"2024-09-19T09:38:56.470670+0000","last_peered":"2024-09-19T09:38:56.470670+0000","last_clean":"2024-09-19T09:38:56.470670+0000","last_became_active":"2024-09-19T09:37:10.965385+0000","last_became_peered":"2024-09-19T09:37:10.965385+0000","last_unstale":"2024-09-19T09:38:56.470670+0000","last_undegraded":"2024-09-19T09:38:56.470670+0000","last_fullsized":"2024-09-19T09:38:56.470670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:15.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017690+0000","last_change":"2024-09-19T09:37:08.948028+0000","last_active":"2024-09-19T09:37:28.017690+0000","last_peered":"2024-09-19T09:37:28.017690+0000","last_clean":"2024-09-19T09:37:28.017690+0000","last_became_active":"2024-09-19T09:37:08.947583+0000","last_became_peered":"2024-09-19T09:37:08.947583+0000","last_unstale":"2024-09-19T09:37:28.017690+0000","last_undegraded":"2024-09-19T09:37:28.017690+0000","last_fullsized":"2024-09-19T09:37:28.017690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:15.485850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498875+0000","last_change":"2024-09-19T09:37:10.964577+0000","last_active":"2024-09-19T09:38:56.498875+0000","last_peered":"2024-09-19T09:38:56.498875+0000","last_clean":"2024-09-19T09:38:56.498875+0000","last_became_active":"2024-09-19T09:37:10.964226+0000","last_became_peered":"2024-09-19T09:37:10.964226+0000","last_unstale":"2024-09-19T09:38:56.498875+0000","last_undegraded":"2024-09-19T09:38:56.498875+0000","last_fullsized":"2024-09-19T09:38:56.498875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:44.074286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014911+0000","last_change":"2024-09-19T09:37:08.952257+0000","last_active":"2024-09-19T09:37:28.014911+0000","last_peered":"2024-09-19T09:37:28.014911+0000","last_clean":"2024-09-19T09:37:28.014911+0000","last_became_active":"2024-09-19T09:37:08.951056+0000","last_became_peered":"2024-09-19T09:37:08.951056+0000","last_unstale":"2024-09-19T09:37:28.014911+0000","last_undegraded":"2024-09-19T09:37:28.014911+0000","last_fullsized":"2024-09-19T09:37:28.014911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:35.238551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511292+0000","last_change":"2024-09-19T09:37:10.965956+0000","last_active":"2024-09-19T09:38:56.511292+0000","last_peered":"2024-09-19T09:38:56.511292+0000","last_clean":"2024-09-19T09:38:56.511292+0000","last_became_active":"2024-09-19T09:37:10.965367+0000","last_became_peered":"2024-09-19T09:37:10.965367+0000","last_unstale":"2024-09-19T09:38:56.511292+0000","last_undegraded":"2024-09-19T09:38:56.511292+0000","last_fullsized":"2024-09-19T09:38:56.511292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:23.280106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.027523+0000","last_change":"2024-09-19T09:37:28.026998+0000","last_active":"2024-09-19T09:37:28.027523+0000","last_peered":"2024-09-19T09:37:28.027523+0000","last_clean":"2024-09-19T09:37:28.027523+0000","last_became_active":"2024-09-19T09:37:28.021169+0000","last_became_peered":"2024-09-19T09:37:28.021169+0000","last_unstale":"2024-09-19T09:37:28.027523+0000","last_undegraded":"2024-09-19T09:37:28.027523+0000","last_fullsized":"2024-09-19T09:37:28.027523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.876143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017806+0000","last_change":"2024-09-19T09:37:10.959937+0000","last_active":"2024-09-19T09:37:28.017806+0000","last_peered":"2024-09-19T09:37:28.017806+0000","last_clean":"2024-09-19T09:37:28.017806+0000","last_became_active":"2024-09-19T09:37:10.959466+0000","last_became_peered":"2024-09-19T09:37:10.959466+0000","last_unstale":"2024-09-19T09:37:28.017806+0000","last_undegraded":"2024-09-19T09:37:28.017806+0000","last_fullsized":"2024-09-19T09:37:28.017806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:13.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508964+0000","last_change":"2024-09-19T09:37:10.966737+0000","last_active":"2024-09-19T09:38:56.508964+0000","last_peered":"2024-09-19T09:38:56.508964+0000","last_clean":"2024-09-19T09:38:56.508964+0000","last_became_active":"2024-09-19T09:37:10.966436+0000","last_became_peered":"2024-09-19T09:37:10.966436+0000","last_unstale":"2024-09-19T09:38:56.508964+0000","last_undegraded":"2024-09-19T09:38:56.508964+0000","last_fullsized":"2024-09-19T09:38:56.508964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:05.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020657+0000","last_change":"2024-09-19T09:37:08.950225+0000","last_active":"2024-09-19T09:37:28.020657+0000","last_peered":"2024-09-19T09:37:28.020657+0000","last_clean":"2024-09-19T09:37:28.020657+0000","last_became_active":"2024-09-19T09:37:08.949855+0000","last_became_peered":"2024-09-19T09:37:08.949855+0000","last_unstale":"2024-09-19T09:37:28.020657+0000","last_undegraded":"2024-09-19T09:37:28.020657+0000","last_fullsized":"2024-09-19T09:37:28.020657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:12.315407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515631+0000","last_change":"2024-09-19T09:37:10.965763+0000","last_active":"2024-09-19T09:38:56.515631+0000","last_peered":"2024-09-19T09:38:56.515631+0000","last_clean":"2024-09-19T09:38:56.515631+0000","last_became_active":"2024-09-19T09:37:10.965425+0000","last_became_peered":"2024-09-19T09:37:10.965425+0000","last_unstale":"2024-09-19T09:38:56.515631+0000","last_undegraded":"2024-09-19T09:38:56.515631+0000","last_fullsized":"2024-09-19T09:38:56.515631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:34.474506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'13","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020863+0000","last_change":"2024-09-19T09:37:08.954211+0000","last_active":"2024-09-19T09:37:28.020863+0000","last_peered":"2024-09-19T09:37:28.020863+0000","last_clean":"2024-09-19T09:37:28.020863+0000","last_became_active":"2024-09-19T09:37:08.953869+0000","last_became_peered":"2024-09-19T09:37:08.953869+0000","last_unstale":"2024-09-19T09:37:28.020863+0000","last_undegraded":"2024-09-19T09:37:28.020863+0000","last_fullsized":"2024-09-19T09:37:28.020863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:10.650227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508638+0000","last_change":"2024-09-19T09:37:10.957032+0000","last_active":"2024-09-19T09:38:56.508638+0000","last_peered":"2024-09-19T09:38:56.508638+0000","last_clean":"2024-09-19T09:38:56.508638+0000","last_became_active":"2024-09-19T09:37:10.955979+0000","last_became_peered":"2024-09-19T09:37:10.955979+0000","last_unstale":"2024-09-19T09:38:56.508638+0000","last_undegraded":"2024-09-19T09:38:56.508638+0000","last_fullsized":"2024-09-19T09:38:56.508638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.734353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018040+0000","last_change":"2024-09-19T09:37:08.976359+0000","last_active":"2024-09-19T09:37:28.018040+0000","last_peered":"2024-09-19T09:37:28.018040+0000","last_clean":"2024-09-19T09:37:28.018040+0000","last_became_active":"2024-09-19T09:37:08.976019+0000","last_became_peered":"2024-09-19T09:37:08.976019+0000","last_unstale":"2024-09-19T09:37:28.018040+0000","last_undegraded":"2024-09-19T09:37:28.018040+0000","last_fullsized":"2024-09-19T09:37:28.018040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:34.401585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509876+0000","last_change":"2024-09-19T09:37:10.954000+0000","last_active":"2024-09-19T09:38:56.509876+0000","last_peered":"2024-09-19T09:38:56.509876+0000","last_clean":"2024-09-19T09:38:56.509876+0000","last_became_active":"2024-09-19T09:37:10.953709+0000","last_became_peered":"2024-09-19T09:37:10.953709+0000","last_unstale":"2024-09-19T09:38:56.509876+0000","last_undegraded":"2024-09-19T09:38:56.509876+0000","last_fullsized":"2024-09-19T09:38:56.509876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:36.779680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'14","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.144149+0000","last_change":"2024-09-19T09:37:28.036392+0000","last_active":"2024-09-19T09:38:58.144149+0000","last_peered":"2024-09-19T09:38:58.144149+0000","last_clean":"2024-09-19T09:38:58.144149+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:58.144149+0000","last_undegraded":"2024-09-19T09:38:58.144149+0000","last_fullsized":"2024-09-19T09:38:58.144149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:56.344807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":443,"ondisk_log_size":443,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70609,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":986,"num_read_kb":571,"num_write":261,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":28789,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":223107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612643,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":437286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1609728,"data_stored":1091716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005101,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1030507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":437467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":501365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280585,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476815,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":508078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40416,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704736,"statfs":{"total":95995035648,"available":95953649664,"internally_reserved":0,"allocated":933888,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":71430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:39:02.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:39:02.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.411+0000 7f16150a5640 1 -- 172.21.15.42:0/2455036762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1610102dc0 msgr2=0x7f1610103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.411+0000 7f16150a5640 1 --2- 172.21.15.42:0/2455036762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1610102dc0 0x7f1610103240 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1604009900 tx=0x7f160402a410 comp rx=0 tx=0).stop 2024-09-19T09:39:02.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.411+0000 7f16150a5640 1 -- 172.21.15.42:0/2455036762 shutdown_connections 2024-09-19T09:39:02.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.411+0000 7f16150a5640 1 --2- 172.21.15.42:0/2455036762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1610103780 0x7f161010a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.411+0000 7f16150a5640 1 --2- 172.21.15.42:0/2455036762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1610102dc0 0x7f1610103240 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.411+0000 7f16150a5640 1 --2- 172.21.15.42:0/2455036762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16100ffdf0 0x7f16101001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.412+0000 7f16150a5640 1 -- 172.21.15.42:0/2455036762 >> 172.21.15.42:0/2455036762 conn(0x7f16100fb910 msgr2=0x7f16100fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:02.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.412+0000 7f16150a5640 1 -- 172.21.15.42:0/2455036762 shutdown_connections 2024-09-19T09:39:02.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.412+0000 7f16150a5640 1 -- 172.21.15.42:0/2455036762 wait complete. 2024-09-19T09:39:02.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.412+0000 7f16150a5640 1 Processor -- start 2024-09-19T09:39:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.412+0000 7f16150a5640 1 -- start start 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f16150a5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16100ffdf0 0x7f1610197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f16150a5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1610102dc0 0x7f1610198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f16150a5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1610103780 0x7f161019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f16150a5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f161010d7a0 con 0x7f16100ffdf0 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f16150a5640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f161010d620 con 0x7f1610102dc0 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f16150a5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f161010d920 con 0x7f1610103780 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16100ffdf0 0x7f1610197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16100ffdf0 0x7f1610197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47516/0 (socket says 172.21.15.42:47516) 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160ed9d640 1 -- 172.21.15.42:0/3284017508 learned_addr learned my addr 172.21.15.42:0/3284017508 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160e59c640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1610102dc0 0x7f1610198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160f59e640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1610103780 0x7f161019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160ed9d640 1 -- 172.21.15.42:0/3284017508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1610103780 msgr2=0x7f161019f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160ed9d640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1610103780 0x7f161019f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160ed9d640 1 -- 172.21.15.42:0/3284017508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1610102dc0 msgr2=0x7f1610198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160ed9d640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1610102dc0 0x7f1610198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160ed9d640 1 -- 172.21.15.42:0/3284017508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161019fb00 con 0x7f16100ffdf0 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f160ed9d640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16100ffdf0 0x7f1610197ee0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f160000d770 tx=0x7f160000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.413+0000 7f15f7fff640 1 -- 172.21.15.42:0/3284017508 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600017070 con 0x7f16100ffdf0 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.414+0000 7f15f7fff640 1 -- 172.21.15.42:0/3284017508 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1600009c30 con 0x7f16100ffdf0 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.414+0000 7f15f7fff640 1 -- 172.21.15.42:0/3284017508 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600003dd0 con 0x7f16100ffdf0 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.414+0000 7f16150a5640 1 -- 172.21.15.42:0/3284017508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161019fdf0 con 0x7f16100ffdf0 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.414+0000 7f16150a5640 1 -- 172.21.15.42:0/3284017508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16101a0200 con 0x7f16100ffdf0 2024-09-19T09:39:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.415+0000 7f16150a5640 1 -- 172.21.15.42:0/3284017508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1610109000 con 0x7f16100ffdf0 2024-09-19T09:39:02.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.416+0000 7f15f7fff640 1 -- 172.21.15.42:0/3284017508 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f1600003f70 con 0x7f16100ffdf0 2024-09-19T09:39:02.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.416+0000 7f15f7fff640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f80a32e0 0x7f15f80a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.417+0000 7f160e59c640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f80a32e0 0x7f15f80a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.417+0000 7f15f7fff640 1 -- 172.21.15.42:0/3284017508 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f16000cf830 con 0x7f16100ffdf0 2024-09-19T09:39:02.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.417+0000 7f160e59c640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f80a32e0 0x7f15f80a57a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1604000c00 tx=0x7f16040315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:02.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.420+0000 7f15f7fff640 1 -- 172.21.15.42:0/3284017508 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1600009de0 con 0x7f16100ffdf0 2024-09-19T09:39:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.592+0000 7f16150a5640 1 -- 172.21.15.42:0/3284017508 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1610062630 con 0x7f15f80a32e0 2024-09-19T09:39:02.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.599+0000 7f15f7fff640 1 -- 172.21.15.42:0/3284017508 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259047 (secure 0 0 0) 0x7f1610062630 con 0x7f15f80a32e0 2024-09-19T09:39:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:02.604 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-19T09:39:02.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 -- 172.21.15.42:0/3284017508 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f80a32e0 msgr2=0x7f15f80a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f80a32e0 0x7f15f80a57a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1604000c00 tx=0x7f16040315b0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 -- 172.21.15.42:0/3284017508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16100ffdf0 msgr2=0x7f1610197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16100ffdf0 0x7f1610197ee0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f160000d770 tx=0x7f160000dc30 comp rx=0 tx=0).stop 2024-09-19T09:39:02.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 -- 172.21.15.42:0/3284017508 shutdown_connections 2024-09-19T09:39:02.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f80a32e0 0x7f15f80a57a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1610103780 0x7f161019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1610102dc0 0x7f1610198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 --2- 172.21.15.42:0/3284017508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16100ffdf0 0x7f1610197ee0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 -- 172.21.15.42:0/3284017508 >> 172.21.15.42:0/3284017508 conn(0x7f16100fb910 msgr2=0x7f16101061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:02.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 -- 172.21.15.42:0/3284017508 shutdown_connections 2024-09-19T09:39:02.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.602+0000 7f16150a5640 1 -- 172.21.15.42:0/3284017508 wait complete. 2024-09-19T09:39:02.615 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-19T09:39:02.526040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661745,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1124,"num_read_kb":687,"num_write":446,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":1209642,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382844,"kb_used_data":12796,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558980,"statfs":{"total":1151940427776,"available":1151548395520,"internally_reserved":0,"allocated":13103104,"data_stored":7223343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1625,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":18,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002698"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514653+0000","last_change":"2024-09-19T09:37:10.964695+0000","last_active":"2024-09-19T09:38:56.514653+0000","last_peered":"2024-09-19T09:38:56.514653+0000","last_clean":"2024-09-19T09:38:56.514653+0000","last_became_active":"2024-09-19T09:37:10.964343+0000","last_became_peered":"2024-09-19T09:37:10.964343+0000","last_unstale":"2024-09-19T09:38:56.514653+0000","last_undegraded":"2024-09-19T09:38:56.514653+0000","last_fullsized":"2024-09-19T09:38:56.514653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:44.224621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.493324+0000","last_change":"2024-09-19T09:37:10.964163+0000","last_active":"2024-09-19T09:38:56.493324+0000","last_peered":"2024-09-19T09:38:56.493324+0000","last_clean":"2024-09-19T09:38:56.493324+0000","last_became_active":"2024-09-19T09:37:10.963758+0000","last_became_peered":"2024-09-19T09:37:10.963758+0000","last_unstale":"2024-09-19T09:38:56.493324+0000","last_undegraded":"2024-09-19T09:38:56.493324+0000","last_fullsized":"2024-09-19T09:38:56.493324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:49.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508867+0000","last_change":"2024-09-19T09:37:10.958145+0000","last_active":"2024-09-19T09:38:56.508867+0000","last_peered":"2024-09-19T09:38:56.508867+0000","last_clean":"2024-09-19T09:38:56.508867+0000","last_became_active":"2024-09-19T09:37:10.957666+0000","last_became_peered":"2024-09-19T09:37:10.957666+0000","last_unstale":"2024-09-19T09:38:56.508867+0000","last_undegraded":"2024-09-19T09:38:56.508867+0000","last_fullsized":"2024-09-19T09:38:56.508867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.479753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492252+0000","last_change":"2024-09-19T09:37:28.021681+0000","last_active":"2024-09-19T09:38:56.492252+0000","last_peered":"2024-09-19T09:38:56.492252+0000","last_clean":"2024-09-19T09:38:56.492252+0000","last_became_active":"2024-09-19T09:37:28.021294+0000","last_became_peered":"2024-09-19T09:37:28.021294+0000","last_unstale":"2024-09-19T09:38:56.492252+0000","last_undegraded":"2024-09-19T09:38:56.492252+0000","last_fullsized":"2024-09-19T09:38:56.492252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:36.535707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503476+0000","last_change":"2024-09-19T09:37:10.957138+0000","last_active":"2024-09-19T09:38:56.503476+0000","last_peered":"2024-09-19T09:38:56.503476+0000","last_clean":"2024-09-19T09:38:56.503476+0000","last_became_active":"2024-09-19T09:37:10.956824+0000","last_became_peered":"2024-09-19T09:37:10.956824+0000","last_unstale":"2024-09-19T09:38:56.503476+0000","last_undegraded":"2024-09-19T09:38:56.503476+0000","last_fullsized":"2024-09-19T09:38:56.503476+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.919747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510565+0000","last_change":"2024-09-19T09:37:10.969804+0000","last_active":"2024-09-19T09:38:56.510565+0000","last_peered":"2024-09-19T09:38:56.510565+0000","last_clean":"2024-09-19T09:38:56.510565+0000","last_became_active":"2024-09-19T09:37:10.969454+0000","last_became_peered":"2024-09-19T09:37:10.969454+0000","last_unstale":"2024-09-19T09:38:56.510565+0000","last_undegraded":"2024-09-19T09:38:56.510565+0000","last_fullsized":"2024-09-19T09:38:56.510565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:14.856255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503058+0000","last_change":"2024-09-19T09:37:10.962853+0000","last_active":"2024-09-19T09:38:56.503058+0000","last_peered":"2024-09-19T09:38:56.503058+0000","last_clean":"2024-09-19T09:38:56.503058+0000","last_became_active":"2024-09-19T09:37:10.961207+0000","last_became_peered":"2024-09-19T09:37:10.961207+0000","last_unstale":"2024-09-19T09:38:56.503058+0000","last_undegraded":"2024-09-19T09:38:56.503058+0000","last_fullsized":"2024-09-19T09:38:56.503058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511634+0000","last_change":"2024-09-19T09:37:10.970216+0000","last_active":"2024-09-19T09:38:56.511634+0000","last_peered":"2024-09-19T09:38:56.511634+0000","last_clean":"2024-09-19T09:38:56.511634+0000","last_became_active":"2024-09-19T09:37:10.969486+0000","last_became_peered":"2024-09-19T09:37:10.969486+0000","last_unstale":"2024-09-19T09:38:56.511634+0000","last_undegraded":"2024-09-19T09:38:56.511634+0000","last_fullsized":"2024-09-19T09:38:56.511634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:56.859228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515236+0000","last_change":"2024-09-19T09:37:10.962596+0000","last_active":"2024-09-19T09:38:56.515236+0000","last_peered":"2024-09-19T09:38:56.515236+0000","last_clean":"2024-09-19T09:38:56.515236+0000","last_became_active":"2024-09-19T09:37:10.962230+0000","last_became_peered":"2024-09-19T09:37:10.962230+0000","last_unstale":"2024-09-19T09:38:56.515236+0000","last_undegraded":"2024-09-19T09:38:56.515236+0000","last_fullsized":"2024-09-19T09:38:56.515236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:07.810793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510890+0000","last_change":"2024-09-19T09:37:10.962186+0000","last_active":"2024-09-19T09:38:56.510890+0000","last_peered":"2024-09-19T09:38:56.510890+0000","last_clean":"2024-09-19T09:38:56.510890+0000","last_became_active":"2024-09-19T09:37:10.961845+0000","last_became_peered":"2024-09-19T09:37:10.961845+0000","last_unstale":"2024-09-19T09:38:56.510890+0000","last_undegraded":"2024-09-19T09:38:56.510890+0000","last_fullsized":"2024-09-19T09:38:56.510890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:24.150103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512962+0000","last_change":"2024-09-19T09:37:10.958763+0000","last_active":"2024-09-19T09:38:56.512962+0000","last_peered":"2024-09-19T09:38:56.512962+0000","last_clean":"2024-09-19T09:38:56.512962+0000","last_became_active":"2024-09-19T09:37:10.958397+0000","last_became_peered":"2024-09-19T09:37:10.958397+0000","last_unstale":"2024-09-19T09:38:56.512962+0000","last_undegraded":"2024-09-19T09:38:56.512962+0000","last_fullsized":"2024-09-19T09:38:56.512962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:37.690594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.505751+0000","last_change":"2024-09-19T09:37:10.964787+0000","last_active":"2024-09-19T09:38:56.505751+0000","last_peered":"2024-09-19T09:38:56.505751+0000","last_clean":"2024-09-19T09:38:56.505751+0000","last_became_active":"2024-09-19T09:37:10.964121+0000","last_became_peered":"2024-09-19T09:37:10.964121+0000","last_unstale":"2024-09-19T09:38:56.505751+0000","last_undegraded":"2024-09-19T09:38:56.505751+0000","last_fullsized":"2024-09-19T09:38:56.505751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:02.456961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507798+0000","last_change":"2024-09-19T09:37:10.963290+0000","last_active":"2024-09-19T09:38:56.507798+0000","last_peered":"2024-09-19T09:38:56.507798+0000","last_clean":"2024-09-19T09:38:56.507798+0000","last_became_active":"2024-09-19T09:37:10.962961+0000","last_became_peered":"2024-09-19T09:37:10.962961+0000","last_unstale":"2024-09-19T09:38:56.507798+0000","last_undegraded":"2024-09-19T09:38:56.507798+0000","last_fullsized":"2024-09-19T09:38:56.507798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.266745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510553+0000","last_change":"2024-09-19T09:37:10.969742+0000","last_active":"2024-09-19T09:38:56.510553+0000","last_peered":"2024-09-19T09:38:56.510553+0000","last_clean":"2024-09-19T09:38:56.510553+0000","last_became_active":"2024-09-19T09:37:10.969399+0000","last_became_peered":"2024-09-19T09:37:10.969399+0000","last_unstale":"2024-09-19T09:38:56.510553+0000","last_undegraded":"2024-09-19T09:38:56.510553+0000","last_fullsized":"2024-09-19T09:38:56.510553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.386596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504556+0000","last_change":"2024-09-19T09:37:10.962406+0000","last_active":"2024-09-19T09:38:56.504556+0000","last_peered":"2024-09-19T09:38:56.504556+0000","last_clean":"2024-09-19T09:38:56.504556+0000","last_became_active":"2024-09-19T09:37:10.962130+0000","last_became_peered":"2024-09-19T09:37:10.962130+0000","last_unstale":"2024-09-19T09:38:56.504556+0000","last_undegraded":"2024-09-19T09:38:56.504556+0000","last_fullsized":"2024-09-19T09:38:56.504556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516451+0000","last_change":"2024-09-19T09:37:10.958465+0000","last_active":"2024-09-19T09:38:56.516451+0000","last_peered":"2024-09-19T09:38:56.516451+0000","last_clean":"2024-09-19T09:38:56.516451+0000","last_became_active":"2024-09-19T09:37:10.957600+0000","last_became_peered":"2024-09-19T09:37:10.957600+0000","last_unstale":"2024-09-19T09:38:56.516451+0000","last_undegraded":"2024-09-19T09:38:56.516451+0000","last_fullsized":"2024-09-19T09:38:56.516451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:39.232483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515449+0000","last_change":"2024-09-19T09:37:10.965463+0000","last_active":"2024-09-19T09:38:56.515449+0000","last_peered":"2024-09-19T09:38:56.515449+0000","last_clean":"2024-09-19T09:38:56.515449+0000","last_became_active":"2024-09-19T09:37:10.965137+0000","last_became_peered":"2024-09-19T09:37:10.965137+0000","last_unstale":"2024-09-19T09:38:56.515449+0000","last_undegraded":"2024-09-19T09:38:56.515449+0000","last_fullsized":"2024-09-19T09:38:56.515449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:19.582515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512633+0000","last_change":"2024-09-19T09:37:10.964897+0000","last_active":"2024-09-19T09:38:56.512633+0000","last_peered":"2024-09-19T09:38:56.512633+0000","last_clean":"2024-09-19T09:38:56.512633+0000","last_became_active":"2024-09-19T09:37:10.964527+0000","last_became_peered":"2024-09-19T09:37:10.964527+0000","last_unstale":"2024-09-19T09:38:56.512633+0000","last_undegraded":"2024-09-19T09:38:56.512633+0000","last_fullsized":"2024-09-19T09:38:56.512633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:29.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507468+0000","last_change":"2024-09-19T09:37:10.953645+0000","last_active":"2024-09-19T09:38:56.507468+0000","last_peered":"2024-09-19T09:38:56.507468+0000","last_clean":"2024-09-19T09:38:56.507468+0000","last_became_active":"2024-09-19T09:37:10.953326+0000","last_became_peered":"2024-09-19T09:37:10.953326+0000","last_unstale":"2024-09-19T09:38:56.507468+0000","last_undegraded":"2024-09-19T09:38:56.507468+0000","last_fullsized":"2024-09-19T09:38:56.507468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.644615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506388+0000","last_change":"2024-09-19T09:37:10.961384+0000","last_active":"2024-09-19T09:38:56.506388+0000","last_peered":"2024-09-19T09:38:56.506388+0000","last_clean":"2024-09-19T09:38:56.506388+0000","last_became_active":"2024-09-19T09:37:10.961038+0000","last_became_peered":"2024-09-19T09:37:10.961038+0000","last_unstale":"2024-09-19T09:38:56.506388+0000","last_undegraded":"2024-09-19T09:38:56.506388+0000","last_fullsized":"2024-09-19T09:38:56.506388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:54.876799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506443+0000","last_change":"2024-09-19T09:37:10.955789+0000","last_active":"2024-09-19T09:38:56.506443+0000","last_peered":"2024-09-19T09:38:56.506443+0000","last_clean":"2024-09-19T09:38:56.506443+0000","last_became_active":"2024-09-19T09:37:10.955447+0000","last_became_peered":"2024-09-19T09:37:10.955447+0000","last_unstale":"2024-09-19T09:38:56.506443+0000","last_undegraded":"2024-09-19T09:38:56.506443+0000","last_fullsized":"2024-09-19T09:38:56.506443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:28.512069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516852+0000","last_change":"2024-09-19T09:37:10.956501+0000","last_active":"2024-09-19T09:38:56.516852+0000","last_peered":"2024-09-19T09:38:56.516852+0000","last_clean":"2024-09-19T09:38:56.516852+0000","last_became_active":"2024-09-19T09:37:10.956161+0000","last_became_peered":"2024-09-19T09:37:10.956161+0000","last_unstale":"2024-09-19T09:38:56.516852+0000","last_undegraded":"2024-09-19T09:38:56.516852+0000","last_fullsized":"2024-09-19T09:38:56.516852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:31.738143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510649+0000","last_change":"2024-09-19T09:37:10.961486+0000","last_active":"2024-09-19T09:38:56.510649+0000","last_peered":"2024-09-19T09:38:56.510649+0000","last_clean":"2024-09-19T09:38:56.510649+0000","last_became_active":"2024-09-19T09:37:10.960877+0000","last_became_peered":"2024-09-19T09:37:10.960877+0000","last_unstale":"2024-09-19T09:38:56.510649+0000","last_undegraded":"2024-09-19T09:38:56.510649+0000","last_fullsized":"2024-09-19T09:38:56.510649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:34.889431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509905+0000","last_change":"2024-09-19T09:37:10.964400+0000","last_active":"2024-09-19T09:38:56.509905+0000","last_peered":"2024-09-19T09:38:56.509905+0000","last_clean":"2024-09-19T09:38:56.509905+0000","last_became_active":"2024-09-19T09:37:10.963394+0000","last_became_peered":"2024-09-19T09:37:10.963394+0000","last_unstale":"2024-09-19T09:38:56.509905+0000","last_undegraded":"2024-09-19T09:38:56.509905+0000","last_fullsized":"2024-09-19T09:38:56.509905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:22.185221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509856+0000","last_change":"2024-09-19T09:37:10.959661+0000","last_active":"2024-09-19T09:38:56.509856+0000","last_peered":"2024-09-19T09:38:56.509856+0000","last_clean":"2024-09-19T09:38:56.509856+0000","last_became_active":"2024-09-19T09:37:10.959371+0000","last_became_peered":"2024-09-19T09:37:10.959371+0000","last_unstale":"2024-09-19T09:38:56.509856+0000","last_undegraded":"2024-09-19T09:38:56.509856+0000","last_fullsized":"2024-09-19T09:38:56.509856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.752712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514203+0000","last_change":"2024-09-19T09:37:10.967310+0000","last_active":"2024-09-19T09:38:56.514203+0000","last_peered":"2024-09-19T09:38:56.514203+0000","last_clean":"2024-09-19T09:38:56.514203+0000","last_became_active":"2024-09-19T09:37:10.965415+0000","last_became_peered":"2024-09-19T09:37:10.965415+0000","last_unstale":"2024-09-19T09:38:56.514203+0000","last_undegraded":"2024-09-19T09:38:56.514203+0000","last_fullsized":"2024-09-19T09:38:56.514203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:16.968646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497702+0000","last_change":"2024-09-19T09:37:10.967301+0000","last_active":"2024-09-19T09:38:56.497702+0000","last_peered":"2024-09-19T09:38:56.497702+0000","last_clean":"2024-09-19T09:38:56.497702+0000","last_became_active":"2024-09-19T09:37:10.966397+0000","last_became_peered":"2024-09-19T09:37:10.966397+0000","last_unstale":"2024-09-19T09:38:56.497702+0000","last_undegraded":"2024-09-19T09:38:56.497702+0000","last_fullsized":"2024-09-19T09:38:56.497702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.621085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509302+0000","last_change":"2024-09-19T09:37:10.958069+0000","last_active":"2024-09-19T09:38:56.509302+0000","last_peered":"2024-09-19T09:38:56.509302+0000","last_clean":"2024-09-19T09:38:56.509302+0000","last_became_active":"2024-09-19T09:37:10.957670+0000","last_became_peered":"2024-09-19T09:37:10.957670+0000","last_unstale":"2024-09-19T09:38:56.509302+0000","last_undegraded":"2024-09-19T09:38:56.509302+0000","last_fullsized":"2024-09-19T09:38:56.509302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.412978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503454+0000","last_change":"2024-09-19T09:37:10.960490+0000","last_active":"2024-09-19T09:38:56.503454+0000","last_peered":"2024-09-19T09:38:56.503454+0000","last_clean":"2024-09-19T09:38:56.503454+0000","last_became_active":"2024-09-19T09:37:10.960239+0000","last_became_peered":"2024-09-19T09:37:10.960239+0000","last_unstale":"2024-09-19T09:38:56.503454+0000","last_undegraded":"2024-09-19T09:38:56.503454+0000","last_fullsized":"2024-09-19T09:38:56.503454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.384348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507069+0000","last_change":"2024-09-19T09:37:10.955930+0000","last_active":"2024-09-19T09:38:56.507069+0000","last_peered":"2024-09-19T09:38:56.507069+0000","last_clean":"2024-09-19T09:38:56.507069+0000","last_became_active":"2024-09-19T09:37:10.955605+0000","last_became_peered":"2024-09-19T09:37:10.955605+0000","last_unstale":"2024-09-19T09:38:56.507069+0000","last_undegraded":"2024-09-19T09:38:56.507069+0000","last_fullsized":"2024-09-19T09:38:56.507069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:36.033350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502819+0000","last_change":"2024-09-19T09:37:10.960467+0000","last_active":"2024-09-19T09:38:56.502819+0000","last_peered":"2024-09-19T09:38:56.502819+0000","last_clean":"2024-09-19T09:38:56.502819+0000","last_became_active":"2024-09-19T09:37:10.960082+0000","last_became_peered":"2024-09-19T09:37:10.960082+0000","last_unstale":"2024-09-19T09:38:56.502819+0000","last_undegraded":"2024-09-19T09:38:56.502819+0000","last_fullsized":"2024-09-19T09:38:56.502819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:07.451648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498620+0000","last_change":"2024-09-19T09:37:10.965674+0000","last_active":"2024-09-19T09:38:56.498620+0000","last_peered":"2024-09-19T09:38:56.498620+0000","last_clean":"2024-09-19T09:38:56.498620+0000","last_became_active":"2024-09-19T09:37:10.965368+0000","last_became_peered":"2024-09-19T09:37:10.965368+0000","last_unstale":"2024-09-19T09:38:56.498620+0000","last_undegraded":"2024-09-19T09:38:56.498620+0000","last_fullsized":"2024-09-19T09:38:56.498620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:23.712785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497701+0000","last_change":"2024-09-19T09:37:10.966972+0000","last_active":"2024-09-19T09:38:56.497701+0000","last_peered":"2024-09-19T09:38:56.497701+0000","last_clean":"2024-09-19T09:38:56.497701+0000","last_became_active":"2024-09-19T09:37:10.966642+0000","last_became_peered":"2024-09-19T09:37:10.966642+0000","last_unstale":"2024-09-19T09:38:56.497701+0000","last_undegraded":"2024-09-19T09:38:56.497701+0000","last_fullsized":"2024-09-19T09:38:56.497701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.416611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:57.143115+0000","last_change":"2024-09-19T09:37:08.953116+0000","last_active":"2024-09-19T09:38:57.143115+0000","last_peered":"2024-09-19T09:38:57.143115+0000","last_clean":"2024-09-19T09:38:57.143115+0000","last_became_active":"2024-09-19T09:37:08.952748+0000","last_became_peered":"2024-09-19T09:37:08.952748+0000","last_unstale":"2024-09-19T09:38:57.143115+0000","last_undegraded":"2024-09-19T09:38:57.143115+0000","last_fullsized":"2024-09-19T09:38:57.143115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:22.395359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509861+0000","last_change":"2024-09-19T09:37:10.969106+0000","last_active":"2024-09-19T09:38:56.509861+0000","last_peered":"2024-09-19T09:38:56.509861+0000","last_clean":"2024-09-19T09:38:56.509861+0000","last_became_active":"2024-09-19T09:37:10.968801+0000","last_became_peered":"2024-09-19T09:37:10.968801+0000","last_unstale":"2024-09-19T09:38:56.509861+0000","last_undegraded":"2024-09-19T09:38:56.509861+0000","last_fullsized":"2024-09-19T09:38:56.509861+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.674925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014739+0000","last_change":"2024-09-19T09:37:08.949604+0000","last_active":"2024-09-19T09:37:28.014739+0000","last_peered":"2024-09-19T09:37:28.014739+0000","last_clean":"2024-09-19T09:37:28.014739+0000","last_became_active":"2024-09-19T09:37:08.949143+0000","last_became_peered":"2024-09-19T09:37:08.949143+0000","last_unstale":"2024-09-19T09:37:28.014739+0000","last_undegraded":"2024-09-19T09:37:28.014739+0000","last_fullsized":"2024-09-19T09:37:28.014739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:37.933319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012827+0000","last_change":"2024-09-19T09:37:08.946277+0000","last_active":"2024-09-19T09:37:28.012827+0000","last_peered":"2024-09-19T09:37:28.012827+0000","last_clean":"2024-09-19T09:37:28.012827+0000","last_became_active":"2024-09-19T09:37:08.945808+0000","last_became_peered":"2024-09-19T09:37:08.945808+0000","last_unstale":"2024-09-19T09:37:28.012827+0000","last_undegraded":"2024-09-19T09:37:28.012827+0000","last_fullsized":"2024-09-19T09:37:28.012827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.060811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511056+0000","last_change":"2024-09-19T09:37:10.957765+0000","last_active":"2024-09-19T09:38:56.511056+0000","last_peered":"2024-09-19T09:38:56.511056+0000","last_clean":"2024-09-19T09:38:56.511056+0000","last_became_active":"2024-09-19T09:37:10.957458+0000","last_became_peered":"2024-09-19T09:37:10.957458+0000","last_unstale":"2024-09-19T09:38:56.511056+0000","last_undegraded":"2024-09-19T09:38:56.511056+0000","last_fullsized":"2024-09-19T09:38:56.511056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:49.418473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020344+0000","last_change":"2024-09-19T09:37:08.953124+0000","last_active":"2024-09-19T09:37:28.020344+0000","last_peered":"2024-09-19T09:37:28.020344+0000","last_clean":"2024-09-19T09:37:28.020344+0000","last_became_active":"2024-09-19T09:37:08.952159+0000","last_became_peered":"2024-09-19T09:37:08.952159+0000","last_unstale":"2024-09-19T09:37:28.020344+0000","last_undegraded":"2024-09-19T09:37:28.020344+0000","last_fullsized":"2024-09-19T09:37:28.020344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:24.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509006+0000","last_change":"2024-09-19T09:37:10.964038+0000","last_active":"2024-09-19T09:38:56.509006+0000","last_peered":"2024-09-19T09:38:56.509006+0000","last_clean":"2024-09-19T09:38:56.509006+0000","last_became_active":"2024-09-19T09:37:10.963671+0000","last_became_peered":"2024-09-19T09:37:10.963671+0000","last_unstale":"2024-09-19T09:38:56.509006+0000","last_undegraded":"2024-09-19T09:38:56.509006+0000","last_fullsized":"2024-09-19T09:38:56.509006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:19.743329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":217,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.143930+0000","last_change":"2024-09-19T09:37:08.949600+0000","last_active":"2024-09-19T09:38:58.143930+0000","last_peered":"2024-09-19T09:38:58.143930+0000","last_clean":"2024-09-19T09:38:58.143930+0000","last_became_active":"2024-09-19T09:37:08.949141+0000","last_became_peered":"2024-09-19T09:37:08.949141+0000","last_unstale":"2024-09-19T09:38:58.143930+0000","last_undegraded":"2024-09-19T09:38:58.143930+0000","last_fullsized":"2024-09-19T09:38:58.143930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:42.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515006+0000","last_change":"2024-09-19T09:37:10.967506+0000","last_active":"2024-09-19T09:38:56.515006+0000","last_peered":"2024-09-19T09:38:56.515006+0000","last_clean":"2024-09-19T09:38:56.515006+0000","last_became_active":"2024-09-19T09:37:10.967193+0000","last_became_peered":"2024-09-19T09:37:10.967193+0000","last_unstale":"2024-09-19T09:38:56.515006+0000","last_undegraded":"2024-09-19T09:38:56.515006+0000","last_fullsized":"2024-09-19T09:38:56.515006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:33.158325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017606+0000","last_change":"2024-09-19T09:37:08.955305+0000","last_active":"2024-09-19T09:37:28.017606+0000","last_peered":"2024-09-19T09:37:28.017606+0000","last_clean":"2024-09-19T09:37:28.017606+0000","last_became_active":"2024-09-19T09:37:08.954932+0000","last_became_peered":"2024-09-19T09:37:08.954932+0000","last_unstale":"2024-09-19T09:37:28.017606+0000","last_undegraded":"2024-09-19T09:37:28.017606+0000","last_fullsized":"2024-09-19T09:37:28.017606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.157466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502511+0000","last_change":"2024-09-19T09:37:28.021974+0000","last_active":"2024-09-19T09:38:56.502511+0000","last_peered":"2024-09-19T09:38:56.502511+0000","last_clean":"2024-09-19T09:38:56.502511+0000","last_became_active":"2024-09-19T09:37:28.021579+0000","last_became_peered":"2024-09-19T09:37:28.021579+0000","last_unstale":"2024-09-19T09:38:56.502511+0000","last_undegraded":"2024-09-19T09:38:56.502511+0000","last_fullsized":"2024-09-19T09:38:56.502511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:28.562862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021814+0000","last_change":"2024-09-19T09:37:08.976540+0000","last_active":"2024-09-19T09:37:28.021814+0000","last_peered":"2024-09-19T09:37:28.021814+0000","last_clean":"2024-09-19T09:37:28.021814+0000","last_became_active":"2024-09-19T09:37:08.976196+0000","last_became_peered":"2024-09-19T09:37:08.976196+0000","last_unstale":"2024-09-19T09:37:28.021814+0000","last_undegraded":"2024-09-19T09:37:28.021814+0000","last_fullsized":"2024-09-19T09:37:28.021814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:38.735947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515663+0000","last_change":"2024-09-19T09:37:28.021407+0000","last_active":"2024-09-19T09:38:56.515663+0000","last_peered":"2024-09-19T09:38:56.515663+0000","last_clean":"2024-09-19T09:38:56.515663+0000","last_became_active":"2024-09-19T09:37:28.021020+0000","last_became_peered":"2024-09-19T09:37:28.021020+0000","last_unstale":"2024-09-19T09:38:56.515663+0000","last_undegraded":"2024-09-19T09:38:56.515663+0000","last_fullsized":"2024-09-19T09:38:56.515663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:25.394012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'37","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.144752+0000","last_change":"2024-09-19T09:37:28.029037+0000","last_active":"2024-09-19T09:38:58.144752+0000","last_peered":"2024-09-19T09:38:58.144752+0000","last_clean":"2024-09-19T09:38:58.144752+0000","last_became_active":"2024-09-19T09:37:28.018325+0000","last_became_peered":"2024-09-19T09:37:28.018325+0000","last_unstale":"2024-09-19T09:38:58.144752+0000","last_undegraded":"2024-09-19T09:38:58.144752+0000","last_fullsized":"2024-09-19T09:38:58.144752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:56.121569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62867,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":162,"num_write":39,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492834+0000","last_change":"2024-09-19T09:37:10.963688+0000","last_active":"2024-09-19T09:38:56.492834+0000","last_peered":"2024-09-19T09:38:56.492834+0000","last_clean":"2024-09-19T09:38:56.492834+0000","last_became_active":"2024-09-19T09:37:10.963296+0000","last_became_peered":"2024-09-19T09:37:10.963296+0000","last_unstale":"2024-09-19T09:38:56.492834+0000","last_undegraded":"2024-09-19T09:38:56.492834+0000","last_fullsized":"2024-09-19T09:38:56.492834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:49.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015183+0000","last_change":"2024-09-19T09:37:08.952198+0000","last_active":"2024-09-19T09:37:28.015183+0000","last_peered":"2024-09-19T09:37:28.015183+0000","last_clean":"2024-09-19T09:37:28.015183+0000","last_became_active":"2024-09-19T09:37:08.951699+0000","last_became_peered":"2024-09-19T09:37:08.951699+0000","last_unstale":"2024-09-19T09:37:28.015183+0000","last_undegraded":"2024-09-19T09:37:28.015183+0000","last_fullsized":"2024-09-19T09:37:28.015183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:46.729847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510576+0000","last_change":"2024-09-19T09:37:10.955741+0000","last_active":"2024-09-19T09:38:56.510576+0000","last_peered":"2024-09-19T09:38:56.510576+0000","last_clean":"2024-09-19T09:38:56.510576+0000","last_became_active":"2024-09-19T09:37:10.955394+0000","last_became_peered":"2024-09-19T09:37:10.955394+0000","last_unstale":"2024-09-19T09:38:56.510576+0000","last_undegraded":"2024-09-19T09:38:56.510576+0000","last_fullsized":"2024-09-19T09:38:56.510576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:56.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021172+0000","last_change":"2024-09-19T09:37:08.949979+0000","last_active":"2024-09-19T09:37:28.021172+0000","last_peered":"2024-09-19T09:37:28.021172+0000","last_clean":"2024-09-19T09:37:28.021172+0000","last_became_active":"2024-09-19T09:37:08.949664+0000","last_became_peered":"2024-09-19T09:37:08.949664+0000","last_unstale":"2024-09-19T09:37:28.021172+0000","last_undegraded":"2024-09-19T09:37:28.021172+0000","last_fullsized":"2024-09-19T09:37:28.021172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:06.449337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509647+0000","last_change":"2024-09-19T09:37:10.957479+0000","last_active":"2024-09-19T09:38:56.509647+0000","last_peered":"2024-09-19T09:38:56.509647+0000","last_clean":"2024-09-19T09:38:56.509647+0000","last_became_active":"2024-09-19T09:37:10.957130+0000","last_became_peered":"2024-09-19T09:37:10.957130+0000","last_unstale":"2024-09-19T09:38:56.509647+0000","last_undegraded":"2024-09-19T09:38:56.509647+0000","last_fullsized":"2024-09-19T09:38:56.509647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:52.840857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'8","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.155534+0000","last_change":"2024-09-19T09:37:08.951558+0000","last_active":"2024-09-19T09:38:58.155534+0000","last_peered":"2024-09-19T09:38:58.155534+0000","last_clean":"2024-09-19T09:38:58.155534+0000","last_became_active":"2024-09-19T09:37:08.951092+0000","last_became_peered":"2024-09-19T09:37:08.951092+0000","last_unstale":"2024-09-19T09:38:58.155534+0000","last_undegraded":"2024-09-19T09:38:58.155534+0000","last_fullsized":"2024-09-19T09:38:58.155534+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:30.326253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503051+0000","last_change":"2024-09-19T09:37:10.962692+0000","last_active":"2024-09-19T09:38:56.503051+0000","last_peered":"2024-09-19T09:38:56.503051+0000","last_clean":"2024-09-19T09:38:56.503051+0000","last_became_active":"2024-09-19T09:37:10.962145+0000","last_became_peered":"2024-09-19T09:37:10.962145+0000","last_unstale":"2024-09-19T09:38:56.503051+0000","last_undegraded":"2024-09-19T09:38:56.503051+0000","last_fullsized":"2024-09-19T09:38:56.503051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:48.232759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020176+0000","last_change":"2024-09-19T09:37:08.976531+0000","last_active":"2024-09-19T09:37:28.020176+0000","last_peered":"2024-09-19T09:37:28.020176+0000","last_clean":"2024-09-19T09:37:28.020176+0000","last_became_active":"2024-09-19T09:37:08.975892+0000","last_became_peered":"2024-09-19T09:37:08.975892+0000","last_unstale":"2024-09-19T09:37:28.020176+0000","last_undegraded":"2024-09-19T09:37:28.020176+0000","last_fullsized":"2024-09-19T09:37:28.020176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.545504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508392+0000","last_change":"2024-09-19T09:37:10.968116+0000","last_active":"2024-09-19T09:38:56.508392+0000","last_peered":"2024-09-19T09:38:56.508392+0000","last_clean":"2024-09-19T09:38:56.508392+0000","last_became_active":"2024-09-19T09:37:10.967767+0000","last_became_peered":"2024-09-19T09:37:10.967767+0000","last_unstale":"2024-09-19T09:38:56.508392+0000","last_undegraded":"2024-09-19T09:38:56.508392+0000","last_fullsized":"2024-09-19T09:38:56.508392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:34.104712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020842+0000","last_change":"2024-09-19T09:37:08.949384+0000","last_active":"2024-09-19T09:37:28.020842+0000","last_peered":"2024-09-19T09:37:28.020842+0000","last_clean":"2024-09-19T09:37:28.020842+0000","last_became_active":"2024-09-19T09:37:08.948950+0000","last_became_peered":"2024-09-19T09:37:08.948950+0000","last_unstale":"2024-09-19T09:37:28.020842+0000","last_undegraded":"2024-09-19T09:37:28.020842+0000","last_fullsized":"2024-09-19T09:37:28.020842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:15.527608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506196+0000","last_change":"2024-09-19T09:37:10.965720+0000","last_active":"2024-09-19T09:38:56.506196+0000","last_peered":"2024-09-19T09:38:56.506196+0000","last_clean":"2024-09-19T09:38:56.506196+0000","last_became_active":"2024-09-19T09:37:10.965341+0000","last_became_peered":"2024-09-19T09:37:10.965341+0000","last_unstale":"2024-09-19T09:38:56.506196+0000","last_undegraded":"2024-09-19T09:38:56.506196+0000","last_fullsized":"2024-09-19T09:38:56.506196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:36.591438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013189+0000","last_change":"2024-09-19T09:37:08.953702+0000","last_active":"2024-09-19T09:37:28.013189+0000","last_peered":"2024-09-19T09:37:28.013189+0000","last_clean":"2024-09-19T09:37:28.013189+0000","last_became_active":"2024-09-19T09:37:08.953312+0000","last_became_peered":"2024-09-19T09:37:08.953312+0000","last_unstale":"2024-09-19T09:37:28.013189+0000","last_undegraded":"2024-09-19T09:37:28.013189+0000","last_fullsized":"2024-09-19T09:37:28.013189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:54.059096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498384+0000","last_change":"2024-09-19T09:37:10.959814+0000","last_active":"2024-09-19T09:38:56.498384+0000","last_peered":"2024-09-19T09:38:56.498384+0000","last_clean":"2024-09-19T09:38:56.498384+0000","last_became_active":"2024-09-19T09:37:10.959342+0000","last_became_peered":"2024-09-19T09:37:10.959342+0000","last_unstale":"2024-09-19T09:38:56.498384+0000","last_undegraded":"2024-09-19T09:38:56.498384+0000","last_fullsized":"2024-09-19T09:38:56.498384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021892+0000","last_change":"2024-09-19T09:37:08.947978+0000","last_active":"2024-09-19T09:37:28.021892+0000","last_peered":"2024-09-19T09:37:28.021892+0000","last_clean":"2024-09-19T09:37:28.021892+0000","last_became_active":"2024-09-19T09:37:08.947548+0000","last_became_peered":"2024-09-19T09:37:08.947548+0000","last_unstale":"2024-09-19T09:37:28.021892+0000","last_undegraded":"2024-09-19T09:37:28.021892+0000","last_fullsized":"2024-09-19T09:37:28.021892+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:38.283616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509716+0000","last_change":"2024-09-19T09:37:10.964008+0000","last_active":"2024-09-19T09:38:56.509716+0000","last_peered":"2024-09-19T09:38:56.509716+0000","last_clean":"2024-09-19T09:38:56.509716+0000","last_became_active":"2024-09-19T09:37:10.963554+0000","last_became_peered":"2024-09-19T09:37:10.963554+0000","last_unstale":"2024-09-19T09:38:56.509716+0000","last_undegraded":"2024-09-19T09:38:56.509716+0000","last_fullsized":"2024-09-19T09:38:56.509716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:57.320967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'5","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:57.154074+0000","last_change":"2024-09-19T09:37:28.027589+0000","last_active":"2024-09-19T09:38:57.154074+0000","last_peered":"2024-09-19T09:38:57.154074+0000","last_clean":"2024-09-19T09:38:57.154074+0000","last_became_active":"2024-09-19T09:37:28.020013+0000","last_became_peered":"2024-09-19T09:37:28.020013+0000","last_unstale":"2024-09-19T09:38:57.154074+0000","last_undegraded":"2024-09-19T09:38:57.154074+0000","last_fullsized":"2024-09-19T09:38:57.154074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:51.327069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.513503+0000","last_change":"2024-09-19T09:37:10.960337+0000","last_active":"2024-09-19T09:38:56.513503+0000","last_peered":"2024-09-19T09:38:56.513503+0000","last_clean":"2024-09-19T09:38:56.513503+0000","last_became_active":"2024-09-19T09:37:10.960006+0000","last_became_peered":"2024-09-19T09:37:10.960006+0000","last_unstale":"2024-09-19T09:38:56.513503+0000","last_undegraded":"2024-09-19T09:38:56.513503+0000","last_fullsized":"2024-09-19T09:38:56.513503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:16.942098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019301+0000","last_change":"2024-09-19T09:36:01.923601+0000","last_active":"2024-09-19T09:37:28.019301+0000","last_peered":"2024-09-19T09:37:28.019301+0000","last_clean":"2024-09-19T09:37:28.019301+0000","last_became_active":"2024-09-19T09:36:01.923051+0000","last_became_peered":"2024-09-19T09:36:01.923051+0000","last_unstale":"2024-09-19T09:37:28.019301+0000","last_undegraded":"2024-09-19T09:37:28.019301+0000","last_fullsized":"2024-09-19T09:37:28.019301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_clean_scrub_stamp":"2024-09-19T09:32:45.321588+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:41.635565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013536+0000","last_change":"2024-09-19T09:37:08.948818+0000","last_active":"2024-09-19T09:37:28.013536+0000","last_peered":"2024-09-19T09:37:28.013536+0000","last_clean":"2024-09-19T09:37:28.013536+0000","last_became_active":"2024-09-19T09:37:08.948494+0000","last_became_peered":"2024-09-19T09:37:08.948494+0000","last_unstale":"2024-09-19T09:37:28.013536+0000","last_undegraded":"2024-09-19T09:37:28.013536+0000","last_fullsized":"2024-09-19T09:37:28.013536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:35.255778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514837+0000","last_change":"2024-09-19T09:37:10.966315+0000","last_active":"2024-09-19T09:38:56.514837+0000","last_peered":"2024-09-19T09:38:56.514837+0000","last_clean":"2024-09-19T09:38:56.514837+0000","last_became_active":"2024-09-19T09:37:10.965979+0000","last_became_peered":"2024-09-19T09:37:10.965979+0000","last_unstale":"2024-09-19T09:38:56.514837+0000","last_undegraded":"2024-09-19T09:38:56.514837+0000","last_fullsized":"2024-09-19T09:38:56.514837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:36.229434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.030136+0000","last_change":"2024-09-19T09:37:28.029598+0000","last_active":"2024-09-19T09:37:28.030136+0000","last_peered":"2024-09-19T09:37:28.030136+0000","last_clean":"2024-09-19T09:37:28.030136+0000","last_became_active":"2024-09-19T09:37:28.021459+0000","last_became_peered":"2024-09-19T09:37:28.021459+0000","last_unstale":"2024-09-19T09:37:28.030136+0000","last_undegraded":"2024-09-19T09:37:28.030136+0000","last_fullsized":"2024-09-19T09:37:28.030136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:00.755946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507049+0000","last_change":"2024-09-19T09:37:10.962825+0000","last_active":"2024-09-19T09:38:56.507049+0000","last_peered":"2024-09-19T09:38:56.507049+0000","last_clean":"2024-09-19T09:38:56.507049+0000","last_became_active":"2024-09-19T09:37:10.962475+0000","last_became_peered":"2024-09-19T09:37:10.962475+0000","last_unstale":"2024-09-19T09:38:56.507049+0000","last_undegraded":"2024-09-19T09:38:56.507049+0000","last_fullsized":"2024-09-19T09:38:56.507049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:30.650918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'6","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:01.159676+0000","last_change":"2024-09-19T09:37:08.976364+0000","last_active":"2024-09-19T09:39:01.159676+0000","last_peered":"2024-09-19T09:39:01.159676+0000","last_clean":"2024-09-19T09:39:01.159676+0000","last_became_active":"2024-09-19T09:37:08.975983+0000","last_became_peered":"2024-09-19T09:37:08.975983+0000","last_unstale":"2024-09-19T09:39:01.159676+0000","last_undegraded":"2024-09-19T09:39:01.159676+0000","last_fullsized":"2024-09-19T09:39:01.159676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.762847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.489815+0000","last_change":"2024-09-19T09:37:28.020341+0000","last_active":"2024-09-19T09:38:56.489815+0000","last_peered":"2024-09-19T09:38:56.489815+0000","last_clean":"2024-09-19T09:38:56.489815+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:56.489815+0000","last_undegraded":"2024-09-19T09:38:56.489815+0000","last_fullsized":"2024-09-19T09:38:56.489815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:24.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'8","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:00.147322+0000","last_change":"2024-09-19T09:37:08.950403+0000","last_active":"2024-09-19T09:39:00.147322+0000","last_peered":"2024-09-19T09:39:00.147322+0000","last_clean":"2024-09-19T09:39:00.147322+0000","last_became_active":"2024-09-19T09:37:08.950077+0000","last_became_peered":"2024-09-19T09:37:08.950077+0000","last_unstale":"2024-09-19T09:39:00.147322+0000","last_undegraded":"2024-09-19T09:39:00.147322+0000","last_fullsized":"2024-09-19T09:39:00.147322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:46.446439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509036+0000","last_change":"2024-09-19T09:37:10.969493+0000","last_active":"2024-09-19T09:38:56.509036+0000","last_peered":"2024-09-19T09:38:56.509036+0000","last_clean":"2024-09-19T09:38:56.509036+0000","last_became_active":"2024-09-19T09:37:10.969038+0000","last_became_peered":"2024-09-19T09:37:10.969038+0000","last_unstale":"2024-09-19T09:38:56.509036+0000","last_undegraded":"2024-09-19T09:38:56.509036+0000","last_fullsized":"2024-09-19T09:38:56.509036+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:55.518806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015137+0000","last_change":"2024-09-19T09:37:08.977207+0000","last_active":"2024-09-19T09:37:28.015137+0000","last_peered":"2024-09-19T09:37:28.015137+0000","last_clean":"2024-09-19T09:37:28.015137+0000","last_became_active":"2024-09-19T09:37:08.976859+0000","last_became_peered":"2024-09-19T09:37:08.976859+0000","last_unstale":"2024-09-19T09:37:28.015137+0000","last_undegraded":"2024-09-19T09:37:28.015137+0000","last_fullsized":"2024-09-19T09:37:28.015137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:25.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504626+0000","last_change":"2024-09-19T09:37:28.023437+0000","last_active":"2024-09-19T09:38:56.504626+0000","last_peered":"2024-09-19T09:38:56.504626+0000","last_clean":"2024-09-19T09:38:56.504626+0000","last_became_active":"2024-09-19T09:37:28.018678+0000","last_became_peered":"2024-09-19T09:37:28.018678+0000","last_unstale":"2024-09-19T09:38:56.504626+0000","last_undegraded":"2024-09-19T09:38:56.504626+0000","last_fullsized":"2024-09-19T09:38:56.504626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:44.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020845+0000","last_change":"2024-09-19T09:37:08.976594+0000","last_active":"2024-09-19T09:37:28.020845+0000","last_peered":"2024-09-19T09:37:28.020845+0000","last_clean":"2024-09-19T09:37:28.020845+0000","last_became_active":"2024-09-19T09:37:08.976222+0000","last_became_peered":"2024-09-19T09:37:08.976222+0000","last_unstale":"2024-09-19T09:37:28.020845+0000","last_undegraded":"2024-09-19T09:37:28.020845+0000","last_fullsized":"2024-09-19T09:37:28.020845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:53.492591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498775+0000","last_change":"2024-09-19T09:37:10.957096+0000","last_active":"2024-09-19T09:38:56.498775+0000","last_peered":"2024-09-19T09:38:56.498775+0000","last_clean":"2024-09-19T09:38:56.498775+0000","last_became_active":"2024-09-19T09:37:10.956740+0000","last_became_peered":"2024-09-19T09:37:10.956740+0000","last_unstale":"2024-09-19T09:38:56.498775+0000","last_undegraded":"2024-09-19T09:38:56.498775+0000","last_fullsized":"2024-09-19T09:38:56.498775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:40.358624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'17","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.032479+0000","last_change":"2024-09-19T09:37:08.948528+0000","last_active":"2024-09-19T09:38:58.032479+0000","last_peered":"2024-09-19T09:38:58.032479+0000","last_clean":"2024-09-19T09:38:58.032479+0000","last_became_active":"2024-09-19T09:37:08.948183+0000","last_became_peered":"2024-09-19T09:37:08.948183+0000","last_unstale":"2024-09-19T09:38:58.032479+0000","last_undegraded":"2024-09-19T09:38:58.032479+0000","last_fullsized":"2024-09-19T09:38:58.032479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:23.214471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508526+0000","last_change":"2024-09-19T09:37:10.959492+0000","last_active":"2024-09-19T09:38:56.508526+0000","last_peered":"2024-09-19T09:38:56.508526+0000","last_clean":"2024-09-19T09:38:56.508526+0000","last_became_active":"2024-09-19T09:37:10.959032+0000","last_became_peered":"2024-09-19T09:37:10.959032+0000","last_unstale":"2024-09-19T09:38:56.508526+0000","last_undegraded":"2024-09-19T09:38:56.508526+0000","last_fullsized":"2024-09-19T09:38:56.508526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.080976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013794+0000","last_change":"2024-09-19T09:37:09.270315+0000","last_active":"2024-09-19T09:37:28.013794+0000","last_peered":"2024-09-19T09:37:28.013794+0000","last_clean":"2024-09-19T09:37:28.013794+0000","last_became_active":"2024-09-19T09:37:09.269891+0000","last_became_peered":"2024-09-19T09:37:09.269891+0000","last_unstale":"2024-09-19T09:37:28.013794+0000","last_undegraded":"2024-09-19T09:37:28.013794+0000","last_fullsized":"2024-09-19T09:37:28.013794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:12.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509933+0000","last_change":"2024-09-19T09:37:10.961363+0000","last_active":"2024-09-19T09:38:56.509933+0000","last_peered":"2024-09-19T09:38:56.509933+0000","last_clean":"2024-09-19T09:38:56.509933+0000","last_became_active":"2024-09-19T09:37:10.960951+0000","last_became_peered":"2024-09-19T09:37:10.960951+0000","last_unstale":"2024-09-19T09:38:56.509933+0000","last_undegraded":"2024-09-19T09:38:56.509933+0000","last_fullsized":"2024-09-19T09:38:56.509933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:31.226355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015555+0000","last_change":"2024-09-19T09:37:08.976805+0000","last_active":"2024-09-19T09:37:28.015555+0000","last_peered":"2024-09-19T09:37:28.015555+0000","last_clean":"2024-09-19T09:37:28.015555+0000","last_became_active":"2024-09-19T09:37:08.976502+0000","last_became_peered":"2024-09-19T09:37:08.976502+0000","last_unstale":"2024-09-19T09:37:28.015555+0000","last_undegraded":"2024-09-19T09:37:28.015555+0000","last_fullsized":"2024-09-19T09:37:28.015555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:25.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.470670+0000","last_change":"2024-09-19T09:37:10.965723+0000","last_active":"2024-09-19T09:38:56.470670+0000","last_peered":"2024-09-19T09:38:56.470670+0000","last_clean":"2024-09-19T09:38:56.470670+0000","last_became_active":"2024-09-19T09:37:10.965385+0000","last_became_peered":"2024-09-19T09:37:10.965385+0000","last_unstale":"2024-09-19T09:38:56.470670+0000","last_undegraded":"2024-09-19T09:38:56.470670+0000","last_fullsized":"2024-09-19T09:38:56.470670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:15.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017690+0000","last_change":"2024-09-19T09:37:08.948028+0000","last_active":"2024-09-19T09:37:28.017690+0000","last_peered":"2024-09-19T09:37:28.017690+0000","last_clean":"2024-09-19T09:37:28.017690+0000","last_became_active":"2024-09-19T09:37:08.947583+0000","last_became_peered":"2024-09-19T09:37:08.947583+0000","last_unstale":"2024-09-19T09:37:28.017690+0000","last_undegraded":"2024-09-19T09:37:28.017690+0000","last_fullsized":"2024-09-19T09:37:28.017690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:15.485850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498875+0000","last_change":"2024-09-19T09:37:10.964577+0000","last_active":"2024-09-19T09:38:56.498875+0000","last_peered":"2024-09-19T09:38:56.498875+0000","last_clean":"2024-09-19T09:38:56.498875+0000","last_became_active":"2024-09-19T09:37:10.964226+0000","last_became_peered":"2024-09-19T09:37:10.964226+0000","last_unstale":"2024-09-19T09:38:56.498875+0000","last_undegraded":"2024-09-19T09:38:56.498875+0000","last_fullsized":"2024-09-19T09:38:56.498875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:44.074286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014911+0000","last_change":"2024-09-19T09:37:08.952257+0000","last_active":"2024-09-19T09:37:28.014911+0000","last_peered":"2024-09-19T09:37:28.014911+0000","last_clean":"2024-09-19T09:37:28.014911+0000","last_became_active":"2024-09-19T09:37:08.951056+0000","last_became_peered":"2024-09-19T09:37:08.951056+0000","last_unstale":"2024-09-19T09:37:28.014911+0000","last_undegraded":"2024-09-19T09:37:28.014911+0000","last_fullsized":"2024-09-19T09:37:28.014911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:35.238551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511292+0000","last_change":"2024-09-19T09:37:10.965956+0000","last_active":"2024-09-19T09:38:56.511292+0000","last_peered":"2024-09-19T09:38:56.511292+0000","last_clean":"2024-09-19T09:38:56.511292+0000","last_became_active":"2024-09-19T09:37:10.965367+0000","last_became_peered":"2024-09-19T09:37:10.965367+0000","last_unstale":"2024-09-19T09:38:56.511292+0000","last_undegraded":"2024-09-19T09:38:56.511292+0000","last_fullsized":"2024-09-19T09:38:56.511292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:23.280106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.027523+0000","last_change":"2024-09-19T09:37:28.026998+0000","last_active":"2024-09-19T09:37:28.027523+0000","last_peered":"2024-09-19T09:37:28.027523+0000","last_clean":"2024-09-19T09:37:28.027523+0000","last_became_active":"2024-09-19T09:37:28.021169+0000","last_became_peered":"2024-09-19T09:37:28.021169+0000","last_unstale":"2024-09-19T09:37:28.027523+0000","last_undegraded":"2024-09-19T09:37:28.027523+0000","last_fullsized":"2024-09-19T09:37:28.027523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.876143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.513741+0000","last_change":"2024-09-19T09:37:10.959937+0000","last_active":"2024-09-19T09:38:56.513741+0000","last_peered":"2024-09-19T09:38:56.513741+0000","last_clean":"2024-09-19T09:38:56.513741+0000","last_became_active":"2024-09-19T09:37:10.959466+0000","last_became_peered":"2024-09-19T09:37:10.959466+0000","last_unstale":"2024-09-19T09:38:56.513741+0000","last_undegraded":"2024-09-19T09:38:56.513741+0000","last_fullsized":"2024-09-19T09:38:56.513741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:13.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508964+0000","last_change":"2024-09-19T09:37:10.966737+0000","last_active":"2024-09-19T09:38:56.508964+0000","last_peered":"2024-09-19T09:38:56.508964+0000","last_clean":"2024-09-19T09:38:56.508964+0000","last_became_active":"2024-09-19T09:37:10.966436+0000","last_became_peered":"2024-09-19T09:37:10.966436+0000","last_unstale":"2024-09-19T09:38:56.508964+0000","last_undegraded":"2024-09-19T09:38:56.508964+0000","last_fullsized":"2024-09-19T09:38:56.508964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:05.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020657+0000","last_change":"2024-09-19T09:37:08.950225+0000","last_active":"2024-09-19T09:37:28.020657+0000","last_peered":"2024-09-19T09:37:28.020657+0000","last_clean":"2024-09-19T09:37:28.020657+0000","last_became_active":"2024-09-19T09:37:08.949855+0000","last_became_peered":"2024-09-19T09:37:08.949855+0000","last_unstale":"2024-09-19T09:37:28.020657+0000","last_undegraded":"2024-09-19T09:37:28.020657+0000","last_fullsized":"2024-09-19T09:37:28.020657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:12.315407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515631+0000","last_change":"2024-09-19T09:37:10.965763+0000","last_active":"2024-09-19T09:38:56.515631+0000","last_peered":"2024-09-19T09:38:56.515631+0000","last_clean":"2024-09-19T09:38:56.515631+0000","last_became_active":"2024-09-19T09:37:10.965425+0000","last_became_peered":"2024-09-19T09:37:10.965425+0000","last_unstale":"2024-09-19T09:38:56.515631+0000","last_undegraded":"2024-09-19T09:38:56.515631+0000","last_fullsized":"2024-09-19T09:38:56.515631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:34.474506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'13","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020863+0000","last_change":"2024-09-19T09:37:08.954211+0000","last_active":"2024-09-19T09:37:28.020863+0000","last_peered":"2024-09-19T09:37:28.020863+0000","last_clean":"2024-09-19T09:37:28.020863+0000","last_became_active":"2024-09-19T09:37:08.953869+0000","last_became_peered":"2024-09-19T09:37:08.953869+0000","last_unstale":"2024-09-19T09:37:28.020863+0000","last_undegraded":"2024-09-19T09:37:28.020863+0000","last_fullsized":"2024-09-19T09:37:28.020863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:10.650227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508638+0000","last_change":"2024-09-19T09:37:10.957032+0000","last_active":"2024-09-19T09:38:56.508638+0000","last_peered":"2024-09-19T09:38:56.508638+0000","last_clean":"2024-09-19T09:38:56.508638+0000","last_became_active":"2024-09-19T09:37:10.955979+0000","last_became_peered":"2024-09-19T09:37:10.955979+0000","last_unstale":"2024-09-19T09:38:56.508638+0000","last_undegraded":"2024-09-19T09:38:56.508638+0000","last_fullsized":"2024-09-19T09:38:56.508638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.734353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018040+0000","last_change":"2024-09-19T09:37:08.976359+0000","last_active":"2024-09-19T09:37:28.018040+0000","last_peered":"2024-09-19T09:37:28.018040+0000","last_clean":"2024-09-19T09:37:28.018040+0000","last_became_active":"2024-09-19T09:37:08.976019+0000","last_became_peered":"2024-09-19T09:37:08.976019+0000","last_unstale":"2024-09-19T09:37:28.018040+0000","last_undegraded":"2024-09-19T09:37:28.018040+0000","last_fullsized":"2024-09-19T09:37:28.018040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:34.401585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509876+0000","last_change":"2024-09-19T09:37:10.954000+0000","last_active":"2024-09-19T09:38:56.509876+0000","last_peered":"2024-09-19T09:38:56.509876+0000","last_clean":"2024-09-19T09:38:56.509876+0000","last_became_active":"2024-09-19T09:37:10.953709+0000","last_became_peered":"2024-09-19T09:37:10.953709+0000","last_unstale":"2024-09-19T09:38:56.509876+0000","last_undegraded":"2024-09-19T09:38:56.509876+0000","last_fullsized":"2024-09-19T09:38:56.509876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:36.779680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'14","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.144149+0000","last_change":"2024-09-19T09:37:28.036392+0000","last_active":"2024-09-19T09:38:58.144149+0000","last_peered":"2024-09-19T09:38:58.144149+0000","last_clean":"2024-09-19T09:38:58.144149+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:58.144149+0000","last_undegraded":"2024-09-19T09:38:58.144149+0000","last_fullsized":"2024-09-19T09:38:58.144149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:56.344807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71143,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":998,"num_read_kb":578,"num_write":263,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":28789,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":224568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612643,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":437286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1609728,"data_stored":1091716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005101,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495670,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":437860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":501365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280585,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476815,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":508078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40416,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704736,"statfs":{"total":95995035648,"available":95953649664,"internally_reserved":0,"allocated":933888,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":71430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:39:02.619 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T09:39:02.619 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:39:02.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.757+0000 7fb76c25e640 1 -- 172.21.15.42:0/1190970736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb764102d20 msgr2=0x7fb7641031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.757+0000 7fb76c25e640 1 --2- 172.21.15.42:0/1190970736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb764102d20 0x7fb7641031a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb760009900 tx=0x7fb76002a410 comp rx=0 tx=0).stop 2024-09-19T09:39:02.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.757+0000 7fb76c25e640 1 -- 172.21.15.42:0/1190970736 shutdown_connections 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.757+0000 7fb76c25e640 1 --2- 172.21.15.42:0/1190970736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7641036e0 0x7fb764109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.757+0000 7fb76c25e640 1 --2- 172.21.15.42:0/1190970736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb764102d20 0x7fb7641031a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.757+0000 7fb76c25e640 1 --2- 172.21.15.42:0/1190970736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764101b30 0x7fb764101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.757+0000 7fb76c25e640 1 -- 172.21.15.42:0/1190970736 >> 172.21.15.42:0/1190970736 conn(0x7fb7640fd2b0 msgr2=0x7fb7640ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.758+0000 7fb76c25e640 1 -- 172.21.15.42:0/1190970736 shutdown_connections 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.758+0000 7fb76c25e640 1 -- 172.21.15.42:0/1190970736 wait complete. 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.758+0000 7fb76c25e640 1 Processor -- start 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.758+0000 7fb76c25e640 1 -- start start 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.758+0000 7fb76c25e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764101b30 0x7fb764197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.758+0000 7fb76c25e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb764102d20 0x7fb7641983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.758+0000 7fb76c25e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7641036e0 0x7fb76419f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.758+0000 7fb76c25e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb76410d790 con 0x7fb7641036e0 2024-09-19T09:39:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.758+0000 7fb76c25e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb76410d610 con 0x7fb764101b30 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.758+0000 7fb76c25e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb76410d910 con 0x7fb764102d20 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76a7fb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7641036e0 0x7fb76419f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76a7fb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7641036e0 0x7fb76419f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47544/0 (socket says 172.21.15.42:47544) 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76a7fb640 1 -- 172.21.15.42:0/3003721007 learned_addr learned my addr 172.21.15.42:0/3003721007 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb769ffa640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764101b30 0x7fb764197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb7697f9640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb764102d20 0x7fb7641983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76a7fb640 1 -- 172.21.15.42:0/3003721007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb764102d20 msgr2=0x7fb7641983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76a7fb640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb764102d20 0x7fb7641983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76a7fb640 1 -- 172.21.15.42:0/3003721007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764101b30 msgr2=0x7fb764197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76a7fb640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764101b30 0x7fb764197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76a7fb640 1 -- 172.21.15.42:0/3003721007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76419fa90 con 0x7fb7641036e0 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb769ffa640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764101b30 0x7fb764197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76a7fb640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7641036e0 0x7fb76419f420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009fd0 tx=0x7fb75c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:02.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb756ffd640 1 -- 172.21.15.42:0/3003721007 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c017070 con 0x7fb7641036e0 2024-09-19T09:39:02.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76c25e640 1 -- 172.21.15.42:0/3003721007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76419fd80 con 0x7fb7641036e0 2024-09-19T09:39:02.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb756ffd640 1 -- 172.21.15.42:0/3003721007 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb75c003e50 con 0x7fb7641036e0 2024-09-19T09:39:02.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb756ffd640 1 -- 172.21.15.42:0/3003721007 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0106c0 con 0x7fb7641036e0 2024-09-19T09:39:02.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.759+0000 7fb76c25e640 1 -- 172.21.15.42:0/3003721007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7641a01f0 con 0x7fb7641036e0 2024-09-19T09:39:02.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.760+0000 7fb76c25e640 1 -- 172.21.15.42:0/3003721007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb764108f70 con 0x7fb7641036e0 2024-09-19T09:39:02.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.761+0000 7fb756ffd640 1 -- 172.21.15.42:0/3003721007 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fb75c003970 con 0x7fb7641036e0 2024-09-19T09:39:02.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.762+0000 7fb756ffd640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7500a32e0 0x7fb7500a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:02.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.762+0000 7fb756ffd640 1 -- 172.21.15.42:0/3003721007 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb75c0cf910 con 0x7fb7641036e0 2024-09-19T09:39:02.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.762+0000 7fb769ffa640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7500a32e0 0x7fb7500a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:02.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.763+0000 7fb769ffa640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7500a32e0 0x7fb7500a57a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb764102b80 tx=0x7fb758005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:02.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.766+0000 7fb756ffd640 1 -- 172.21.15.42:0/3003721007 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb75c09c4b0 con 0x7fb7641036e0 2024-09-19T09:39:02.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:02 smithi136 ceph-mon[34840]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T09:39:02.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:02 smithi136 ceph-mon[34840]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:02.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.939+0000 7fb76c25e640 1 -- 172.21.15.42:0/3003721007 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb764062630 con 0x7fb7500a32e0 2024-09-19T09:39:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.946+0000 7fb756ffd640 1 -- 172.21.15.42:0/3003721007 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259047 (secure 0 0 0) 0x7fb764062630 con 0x7fb7500a32e0 2024-09-19T09:39:02.951 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-19T09:39:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 -- 172.21.15.42:0/3003721007 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7500a32e0 msgr2=0x7fb7500a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7500a32e0 0x7fb7500a57a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb764102b80 tx=0x7fb758005e70 comp rx=0 tx=0).stop 2024-09-19T09:39:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 -- 172.21.15.42:0/3003721007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7641036e0 msgr2=0x7fb76419f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7641036e0 0x7fb76419f420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009fd0 tx=0x7fb75c00b260 comp rx=0 tx=0).stop 2024-09-19T09:39:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 -- 172.21.15.42:0/3003721007 shutdown_connections 2024-09-19T09:39:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7500a32e0 0x7fb7500a57a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7641036e0 0x7fb76419f420 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb764102d20 0x7fb7641983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 --2- 172.21.15.42:0/3003721007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764101b30 0x7fb764197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 -- 172.21.15.42:0/3003721007 >> 172.21.15.42:0/3003721007 conn(0x7fb7640fd2b0 msgr2=0x7fb764106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 -- 172.21.15.42:0/3003721007 shutdown_connections 2024-09-19T09:39:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:02.949+0000 7fb76c25e640 1 -- 172.21.15.42:0/3003721007 wait complete. 2024-09-19T09:39:02.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:02 smithi042 ceph-mon[31223]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T09:39:02.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:02 smithi042 ceph-mon[31223]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:02.962 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-19T09:39:02.526040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661745,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1124,"num_read_kb":687,"num_write":446,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":1209642,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382844,"kb_used_data":12796,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558980,"statfs":{"total":1151940427776,"available":1151548395520,"internally_reserved":0,"allocated":13103104,"data_stored":7223343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1625,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":18,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002698"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514653+0000","last_change":"2024-09-19T09:37:10.964695+0000","last_active":"2024-09-19T09:38:56.514653+0000","last_peered":"2024-09-19T09:38:56.514653+0000","last_clean":"2024-09-19T09:38:56.514653+0000","last_became_active":"2024-09-19T09:37:10.964343+0000","last_became_peered":"2024-09-19T09:37:10.964343+0000","last_unstale":"2024-09-19T09:38:56.514653+0000","last_undegraded":"2024-09-19T09:38:56.514653+0000","last_fullsized":"2024-09-19T09:38:56.514653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:44.224621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.493324+0000","last_change":"2024-09-19T09:37:10.964163+0000","last_active":"2024-09-19T09:38:56.493324+0000","last_peered":"2024-09-19T09:38:56.493324+0000","last_clean":"2024-09-19T09:38:56.493324+0000","last_became_active":"2024-09-19T09:37:10.963758+0000","last_became_peered":"2024-09-19T09:37:10.963758+0000","last_unstale":"2024-09-19T09:38:56.493324+0000","last_undegraded":"2024-09-19T09:38:56.493324+0000","last_fullsized":"2024-09-19T09:38:56.493324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:49.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508867+0000","last_change":"2024-09-19T09:37:10.958145+0000","last_active":"2024-09-19T09:38:56.508867+0000","last_peered":"2024-09-19T09:38:56.508867+0000","last_clean":"2024-09-19T09:38:56.508867+0000","last_became_active":"2024-09-19T09:37:10.957666+0000","last_became_peered":"2024-09-19T09:37:10.957666+0000","last_unstale":"2024-09-19T09:38:56.508867+0000","last_undegraded":"2024-09-19T09:38:56.508867+0000","last_fullsized":"2024-09-19T09:38:56.508867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.479753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492252+0000","last_change":"2024-09-19T09:37:28.021681+0000","last_active":"2024-09-19T09:38:56.492252+0000","last_peered":"2024-09-19T09:38:56.492252+0000","last_clean":"2024-09-19T09:38:56.492252+0000","last_became_active":"2024-09-19T09:37:28.021294+0000","last_became_peered":"2024-09-19T09:37:28.021294+0000","last_unstale":"2024-09-19T09:38:56.492252+0000","last_undegraded":"2024-09-19T09:38:56.492252+0000","last_fullsized":"2024-09-19T09:38:56.492252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:36.535707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503476+0000","last_change":"2024-09-19T09:37:10.957138+0000","last_active":"2024-09-19T09:38:56.503476+0000","last_peered":"2024-09-19T09:38:56.503476+0000","last_clean":"2024-09-19T09:38:56.503476+0000","last_became_active":"2024-09-19T09:37:10.956824+0000","last_became_peered":"2024-09-19T09:37:10.956824+0000","last_unstale":"2024-09-19T09:38:56.503476+0000","last_undegraded":"2024-09-19T09:38:56.503476+0000","last_fullsized":"2024-09-19T09:38:56.503476+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.919747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510565+0000","last_change":"2024-09-19T09:37:10.969804+0000","last_active":"2024-09-19T09:38:56.510565+0000","last_peered":"2024-09-19T09:38:56.510565+0000","last_clean":"2024-09-19T09:38:56.510565+0000","last_became_active":"2024-09-19T09:37:10.969454+0000","last_became_peered":"2024-09-19T09:37:10.969454+0000","last_unstale":"2024-09-19T09:38:56.510565+0000","last_undegraded":"2024-09-19T09:38:56.510565+0000","last_fullsized":"2024-09-19T09:38:56.510565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:14.856255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503058+0000","last_change":"2024-09-19T09:37:10.962853+0000","last_active":"2024-09-19T09:38:56.503058+0000","last_peered":"2024-09-19T09:38:56.503058+0000","last_clean":"2024-09-19T09:38:56.503058+0000","last_became_active":"2024-09-19T09:37:10.961207+0000","last_became_peered":"2024-09-19T09:37:10.961207+0000","last_unstale":"2024-09-19T09:38:56.503058+0000","last_undegraded":"2024-09-19T09:38:56.503058+0000","last_fullsized":"2024-09-19T09:38:56.503058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511634+0000","last_change":"2024-09-19T09:37:10.970216+0000","last_active":"2024-09-19T09:38:56.511634+0000","last_peered":"2024-09-19T09:38:56.511634+0000","last_clean":"2024-09-19T09:38:56.511634+0000","last_became_active":"2024-09-19T09:37:10.969486+0000","last_became_peered":"2024-09-19T09:37:10.969486+0000","last_unstale":"2024-09-19T09:38:56.511634+0000","last_undegraded":"2024-09-19T09:38:56.511634+0000","last_fullsized":"2024-09-19T09:38:56.511634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:56.859228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515236+0000","last_change":"2024-09-19T09:37:10.962596+0000","last_active":"2024-09-19T09:38:56.515236+0000","last_peered":"2024-09-19T09:38:56.515236+0000","last_clean":"2024-09-19T09:38:56.515236+0000","last_became_active":"2024-09-19T09:37:10.962230+0000","last_became_peered":"2024-09-19T09:37:10.962230+0000","last_unstale":"2024-09-19T09:38:56.515236+0000","last_undegraded":"2024-09-19T09:38:56.515236+0000","last_fullsized":"2024-09-19T09:38:56.515236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:07.810793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510890+0000","last_change":"2024-09-19T09:37:10.962186+0000","last_active":"2024-09-19T09:38:56.510890+0000","last_peered":"2024-09-19T09:38:56.510890+0000","last_clean":"2024-09-19T09:38:56.510890+0000","last_became_active":"2024-09-19T09:37:10.961845+0000","last_became_peered":"2024-09-19T09:37:10.961845+0000","last_unstale":"2024-09-19T09:38:56.510890+0000","last_undegraded":"2024-09-19T09:38:56.510890+0000","last_fullsized":"2024-09-19T09:38:56.510890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:24.150103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512962+0000","last_change":"2024-09-19T09:37:10.958763+0000","last_active":"2024-09-19T09:38:56.512962+0000","last_peered":"2024-09-19T09:38:56.512962+0000","last_clean":"2024-09-19T09:38:56.512962+0000","last_became_active":"2024-09-19T09:37:10.958397+0000","last_became_peered":"2024-09-19T09:37:10.958397+0000","last_unstale":"2024-09-19T09:38:56.512962+0000","last_undegraded":"2024-09-19T09:38:56.512962+0000","last_fullsized":"2024-09-19T09:38:56.512962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:37.690594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.505751+0000","last_change":"2024-09-19T09:37:10.964787+0000","last_active":"2024-09-19T09:38:56.505751+0000","last_peered":"2024-09-19T09:38:56.505751+0000","last_clean":"2024-09-19T09:38:56.505751+0000","last_became_active":"2024-09-19T09:37:10.964121+0000","last_became_peered":"2024-09-19T09:37:10.964121+0000","last_unstale":"2024-09-19T09:38:56.505751+0000","last_undegraded":"2024-09-19T09:38:56.505751+0000","last_fullsized":"2024-09-19T09:38:56.505751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:02.456961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507798+0000","last_change":"2024-09-19T09:37:10.963290+0000","last_active":"2024-09-19T09:38:56.507798+0000","last_peered":"2024-09-19T09:38:56.507798+0000","last_clean":"2024-09-19T09:38:56.507798+0000","last_became_active":"2024-09-19T09:37:10.962961+0000","last_became_peered":"2024-09-19T09:37:10.962961+0000","last_unstale":"2024-09-19T09:38:56.507798+0000","last_undegraded":"2024-09-19T09:38:56.507798+0000","last_fullsized":"2024-09-19T09:38:56.507798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.266745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510553+0000","last_change":"2024-09-19T09:37:10.969742+0000","last_active":"2024-09-19T09:38:56.510553+0000","last_peered":"2024-09-19T09:38:56.510553+0000","last_clean":"2024-09-19T09:38:56.510553+0000","last_became_active":"2024-09-19T09:37:10.969399+0000","last_became_peered":"2024-09-19T09:37:10.969399+0000","last_unstale":"2024-09-19T09:38:56.510553+0000","last_undegraded":"2024-09-19T09:38:56.510553+0000","last_fullsized":"2024-09-19T09:38:56.510553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.386596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504556+0000","last_change":"2024-09-19T09:37:10.962406+0000","last_active":"2024-09-19T09:38:56.504556+0000","last_peered":"2024-09-19T09:38:56.504556+0000","last_clean":"2024-09-19T09:38:56.504556+0000","last_became_active":"2024-09-19T09:37:10.962130+0000","last_became_peered":"2024-09-19T09:37:10.962130+0000","last_unstale":"2024-09-19T09:38:56.504556+0000","last_undegraded":"2024-09-19T09:38:56.504556+0000","last_fullsized":"2024-09-19T09:38:56.504556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516451+0000","last_change":"2024-09-19T09:37:10.958465+0000","last_active":"2024-09-19T09:38:56.516451+0000","last_peered":"2024-09-19T09:38:56.516451+0000","last_clean":"2024-09-19T09:38:56.516451+0000","last_became_active":"2024-09-19T09:37:10.957600+0000","last_became_peered":"2024-09-19T09:37:10.957600+0000","last_unstale":"2024-09-19T09:38:56.516451+0000","last_undegraded":"2024-09-19T09:38:56.516451+0000","last_fullsized":"2024-09-19T09:38:56.516451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:39.232483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515449+0000","last_change":"2024-09-19T09:37:10.965463+0000","last_active":"2024-09-19T09:38:56.515449+0000","last_peered":"2024-09-19T09:38:56.515449+0000","last_clean":"2024-09-19T09:38:56.515449+0000","last_became_active":"2024-09-19T09:37:10.965137+0000","last_became_peered":"2024-09-19T09:37:10.965137+0000","last_unstale":"2024-09-19T09:38:56.515449+0000","last_undegraded":"2024-09-19T09:38:56.515449+0000","last_fullsized":"2024-09-19T09:38:56.515449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:19.582515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512633+0000","last_change":"2024-09-19T09:37:10.964897+0000","last_active":"2024-09-19T09:38:56.512633+0000","last_peered":"2024-09-19T09:38:56.512633+0000","last_clean":"2024-09-19T09:38:56.512633+0000","last_became_active":"2024-09-19T09:37:10.964527+0000","last_became_peered":"2024-09-19T09:37:10.964527+0000","last_unstale":"2024-09-19T09:38:56.512633+0000","last_undegraded":"2024-09-19T09:38:56.512633+0000","last_fullsized":"2024-09-19T09:38:56.512633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:29.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507468+0000","last_change":"2024-09-19T09:37:10.953645+0000","last_active":"2024-09-19T09:38:56.507468+0000","last_peered":"2024-09-19T09:38:56.507468+0000","last_clean":"2024-09-19T09:38:56.507468+0000","last_became_active":"2024-09-19T09:37:10.953326+0000","last_became_peered":"2024-09-19T09:37:10.953326+0000","last_unstale":"2024-09-19T09:38:56.507468+0000","last_undegraded":"2024-09-19T09:38:56.507468+0000","last_fullsized":"2024-09-19T09:38:56.507468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.644615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506388+0000","last_change":"2024-09-19T09:37:10.961384+0000","last_active":"2024-09-19T09:38:56.506388+0000","last_peered":"2024-09-19T09:38:56.506388+0000","last_clean":"2024-09-19T09:38:56.506388+0000","last_became_active":"2024-09-19T09:37:10.961038+0000","last_became_peered":"2024-09-19T09:37:10.961038+0000","last_unstale":"2024-09-19T09:38:56.506388+0000","last_undegraded":"2024-09-19T09:38:56.506388+0000","last_fullsized":"2024-09-19T09:38:56.506388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:54.876799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506443+0000","last_change":"2024-09-19T09:37:10.955789+0000","last_active":"2024-09-19T09:38:56.506443+0000","last_peered":"2024-09-19T09:38:56.506443+0000","last_clean":"2024-09-19T09:38:56.506443+0000","last_became_active":"2024-09-19T09:37:10.955447+0000","last_became_peered":"2024-09-19T09:37:10.955447+0000","last_unstale":"2024-09-19T09:38:56.506443+0000","last_undegraded":"2024-09-19T09:38:56.506443+0000","last_fullsized":"2024-09-19T09:38:56.506443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:28.512069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516852+0000","last_change":"2024-09-19T09:37:10.956501+0000","last_active":"2024-09-19T09:38:56.516852+0000","last_peered":"2024-09-19T09:38:56.516852+0000","last_clean":"2024-09-19T09:38:56.516852+0000","last_became_active":"2024-09-19T09:37:10.956161+0000","last_became_peered":"2024-09-19T09:37:10.956161+0000","last_unstale":"2024-09-19T09:38:56.516852+0000","last_undegraded":"2024-09-19T09:38:56.516852+0000","last_fullsized":"2024-09-19T09:38:56.516852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:31.738143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510649+0000","last_change":"2024-09-19T09:37:10.961486+0000","last_active":"2024-09-19T09:38:56.510649+0000","last_peered":"2024-09-19T09:38:56.510649+0000","last_clean":"2024-09-19T09:38:56.510649+0000","last_became_active":"2024-09-19T09:37:10.960877+0000","last_became_peered":"2024-09-19T09:37:10.960877+0000","last_unstale":"2024-09-19T09:38:56.510649+0000","last_undegraded":"2024-09-19T09:38:56.510649+0000","last_fullsized":"2024-09-19T09:38:56.510649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:34.889431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509905+0000","last_change":"2024-09-19T09:37:10.964400+0000","last_active":"2024-09-19T09:38:56.509905+0000","last_peered":"2024-09-19T09:38:56.509905+0000","last_clean":"2024-09-19T09:38:56.509905+0000","last_became_active":"2024-09-19T09:37:10.963394+0000","last_became_peered":"2024-09-19T09:37:10.963394+0000","last_unstale":"2024-09-19T09:38:56.509905+0000","last_undegraded":"2024-09-19T09:38:56.509905+0000","last_fullsized":"2024-09-19T09:38:56.509905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:22.185221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509856+0000","last_change":"2024-09-19T09:37:10.959661+0000","last_active":"2024-09-19T09:38:56.509856+0000","last_peered":"2024-09-19T09:38:56.509856+0000","last_clean":"2024-09-19T09:38:56.509856+0000","last_became_active":"2024-09-19T09:37:10.959371+0000","last_became_peered":"2024-09-19T09:37:10.959371+0000","last_unstale":"2024-09-19T09:38:56.509856+0000","last_undegraded":"2024-09-19T09:38:56.509856+0000","last_fullsized":"2024-09-19T09:38:56.509856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.752712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514203+0000","last_change":"2024-09-19T09:37:10.967310+0000","last_active":"2024-09-19T09:38:56.514203+0000","last_peered":"2024-09-19T09:38:56.514203+0000","last_clean":"2024-09-19T09:38:56.514203+0000","last_became_active":"2024-09-19T09:37:10.965415+0000","last_became_peered":"2024-09-19T09:37:10.965415+0000","last_unstale":"2024-09-19T09:38:56.514203+0000","last_undegraded":"2024-09-19T09:38:56.514203+0000","last_fullsized":"2024-09-19T09:38:56.514203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:16.968646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497702+0000","last_change":"2024-09-19T09:37:10.967301+0000","last_active":"2024-09-19T09:38:56.497702+0000","last_peered":"2024-09-19T09:38:56.497702+0000","last_clean":"2024-09-19T09:38:56.497702+0000","last_became_active":"2024-09-19T09:37:10.966397+0000","last_became_peered":"2024-09-19T09:37:10.966397+0000","last_unstale":"2024-09-19T09:38:56.497702+0000","last_undegraded":"2024-09-19T09:38:56.497702+0000","last_fullsized":"2024-09-19T09:38:56.497702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.621085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509302+0000","last_change":"2024-09-19T09:37:10.958069+0000","last_active":"2024-09-19T09:38:56.509302+0000","last_peered":"2024-09-19T09:38:56.509302+0000","last_clean":"2024-09-19T09:38:56.509302+0000","last_became_active":"2024-09-19T09:37:10.957670+0000","last_became_peered":"2024-09-19T09:37:10.957670+0000","last_unstale":"2024-09-19T09:38:56.509302+0000","last_undegraded":"2024-09-19T09:38:56.509302+0000","last_fullsized":"2024-09-19T09:38:56.509302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.412978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503454+0000","last_change":"2024-09-19T09:37:10.960490+0000","last_active":"2024-09-19T09:38:56.503454+0000","last_peered":"2024-09-19T09:38:56.503454+0000","last_clean":"2024-09-19T09:38:56.503454+0000","last_became_active":"2024-09-19T09:37:10.960239+0000","last_became_peered":"2024-09-19T09:37:10.960239+0000","last_unstale":"2024-09-19T09:38:56.503454+0000","last_undegraded":"2024-09-19T09:38:56.503454+0000","last_fullsized":"2024-09-19T09:38:56.503454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.384348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507069+0000","last_change":"2024-09-19T09:37:10.955930+0000","last_active":"2024-09-19T09:38:56.507069+0000","last_peered":"2024-09-19T09:38:56.507069+0000","last_clean":"2024-09-19T09:38:56.507069+0000","last_became_active":"2024-09-19T09:37:10.955605+0000","last_became_peered":"2024-09-19T09:37:10.955605+0000","last_unstale":"2024-09-19T09:38:56.507069+0000","last_undegraded":"2024-09-19T09:38:56.507069+0000","last_fullsized":"2024-09-19T09:38:56.507069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:36.033350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502819+0000","last_change":"2024-09-19T09:37:10.960467+0000","last_active":"2024-09-19T09:38:56.502819+0000","last_peered":"2024-09-19T09:38:56.502819+0000","last_clean":"2024-09-19T09:38:56.502819+0000","last_became_active":"2024-09-19T09:37:10.960082+0000","last_became_peered":"2024-09-19T09:37:10.960082+0000","last_unstale":"2024-09-19T09:38:56.502819+0000","last_undegraded":"2024-09-19T09:38:56.502819+0000","last_fullsized":"2024-09-19T09:38:56.502819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:07.451648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498620+0000","last_change":"2024-09-19T09:37:10.965674+0000","last_active":"2024-09-19T09:38:56.498620+0000","last_peered":"2024-09-19T09:38:56.498620+0000","last_clean":"2024-09-19T09:38:56.498620+0000","last_became_active":"2024-09-19T09:37:10.965368+0000","last_became_peered":"2024-09-19T09:37:10.965368+0000","last_unstale":"2024-09-19T09:38:56.498620+0000","last_undegraded":"2024-09-19T09:38:56.498620+0000","last_fullsized":"2024-09-19T09:38:56.498620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:23.712785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497701+0000","last_change":"2024-09-19T09:37:10.966972+0000","last_active":"2024-09-19T09:38:56.497701+0000","last_peered":"2024-09-19T09:38:56.497701+0000","last_clean":"2024-09-19T09:38:56.497701+0000","last_became_active":"2024-09-19T09:37:10.966642+0000","last_became_peered":"2024-09-19T09:37:10.966642+0000","last_unstale":"2024-09-19T09:38:56.497701+0000","last_undegraded":"2024-09-19T09:38:56.497701+0000","last_fullsized":"2024-09-19T09:38:56.497701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.416611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:57.143115+0000","last_change":"2024-09-19T09:37:08.953116+0000","last_active":"2024-09-19T09:38:57.143115+0000","last_peered":"2024-09-19T09:38:57.143115+0000","last_clean":"2024-09-19T09:38:57.143115+0000","last_became_active":"2024-09-19T09:37:08.952748+0000","last_became_peered":"2024-09-19T09:37:08.952748+0000","last_unstale":"2024-09-19T09:38:57.143115+0000","last_undegraded":"2024-09-19T09:38:57.143115+0000","last_fullsized":"2024-09-19T09:38:57.143115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:22.395359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509861+0000","last_change":"2024-09-19T09:37:10.969106+0000","last_active":"2024-09-19T09:38:56.509861+0000","last_peered":"2024-09-19T09:38:56.509861+0000","last_clean":"2024-09-19T09:38:56.509861+0000","last_became_active":"2024-09-19T09:37:10.968801+0000","last_became_peered":"2024-09-19T09:37:10.968801+0000","last_unstale":"2024-09-19T09:38:56.509861+0000","last_undegraded":"2024-09-19T09:38:56.509861+0000","last_fullsized":"2024-09-19T09:38:56.509861+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.674925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014739+0000","last_change":"2024-09-19T09:37:08.949604+0000","last_active":"2024-09-19T09:37:28.014739+0000","last_peered":"2024-09-19T09:37:28.014739+0000","last_clean":"2024-09-19T09:37:28.014739+0000","last_became_active":"2024-09-19T09:37:08.949143+0000","last_became_peered":"2024-09-19T09:37:08.949143+0000","last_unstale":"2024-09-19T09:37:28.014739+0000","last_undegraded":"2024-09-19T09:37:28.014739+0000","last_fullsized":"2024-09-19T09:37:28.014739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:37.933319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012827+0000","last_change":"2024-09-19T09:37:08.946277+0000","last_active":"2024-09-19T09:37:28.012827+0000","last_peered":"2024-09-19T09:37:28.012827+0000","last_clean":"2024-09-19T09:37:28.012827+0000","last_became_active":"2024-09-19T09:37:08.945808+0000","last_became_peered":"2024-09-19T09:37:08.945808+0000","last_unstale":"2024-09-19T09:37:28.012827+0000","last_undegraded":"2024-09-19T09:37:28.012827+0000","last_fullsized":"2024-09-19T09:37:28.012827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.060811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511056+0000","last_change":"2024-09-19T09:37:10.957765+0000","last_active":"2024-09-19T09:38:56.511056+0000","last_peered":"2024-09-19T09:38:56.511056+0000","last_clean":"2024-09-19T09:38:56.511056+0000","last_became_active":"2024-09-19T09:37:10.957458+0000","last_became_peered":"2024-09-19T09:37:10.957458+0000","last_unstale":"2024-09-19T09:38:56.511056+0000","last_undegraded":"2024-09-19T09:38:56.511056+0000","last_fullsized":"2024-09-19T09:38:56.511056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:49.418473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020344+0000","last_change":"2024-09-19T09:37:08.953124+0000","last_active":"2024-09-19T09:37:28.020344+0000","last_peered":"2024-09-19T09:37:28.020344+0000","last_clean":"2024-09-19T09:37:28.020344+0000","last_became_active":"2024-09-19T09:37:08.952159+0000","last_became_peered":"2024-09-19T09:37:08.952159+0000","last_unstale":"2024-09-19T09:37:28.020344+0000","last_undegraded":"2024-09-19T09:37:28.020344+0000","last_fullsized":"2024-09-19T09:37:28.020344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:24.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509006+0000","last_change":"2024-09-19T09:37:10.964038+0000","last_active":"2024-09-19T09:38:56.509006+0000","last_peered":"2024-09-19T09:38:56.509006+0000","last_clean":"2024-09-19T09:38:56.509006+0000","last_became_active":"2024-09-19T09:37:10.963671+0000","last_became_peered":"2024-09-19T09:37:10.963671+0000","last_unstale":"2024-09-19T09:38:56.509006+0000","last_undegraded":"2024-09-19T09:38:56.509006+0000","last_fullsized":"2024-09-19T09:38:56.509006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:19.743329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":217,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.143930+0000","last_change":"2024-09-19T09:37:08.949600+0000","last_active":"2024-09-19T09:38:58.143930+0000","last_peered":"2024-09-19T09:38:58.143930+0000","last_clean":"2024-09-19T09:38:58.143930+0000","last_became_active":"2024-09-19T09:37:08.949141+0000","last_became_peered":"2024-09-19T09:37:08.949141+0000","last_unstale":"2024-09-19T09:38:58.143930+0000","last_undegraded":"2024-09-19T09:38:58.143930+0000","last_fullsized":"2024-09-19T09:38:58.143930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:42.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515006+0000","last_change":"2024-09-19T09:37:10.967506+0000","last_active":"2024-09-19T09:38:56.515006+0000","last_peered":"2024-09-19T09:38:56.515006+0000","last_clean":"2024-09-19T09:38:56.515006+0000","last_became_active":"2024-09-19T09:37:10.967193+0000","last_became_peered":"2024-09-19T09:37:10.967193+0000","last_unstale":"2024-09-19T09:38:56.515006+0000","last_undegraded":"2024-09-19T09:38:56.515006+0000","last_fullsized":"2024-09-19T09:38:56.515006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:33.158325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017606+0000","last_change":"2024-09-19T09:37:08.955305+0000","last_active":"2024-09-19T09:37:28.017606+0000","last_peered":"2024-09-19T09:37:28.017606+0000","last_clean":"2024-09-19T09:37:28.017606+0000","last_became_active":"2024-09-19T09:37:08.954932+0000","last_became_peered":"2024-09-19T09:37:08.954932+0000","last_unstale":"2024-09-19T09:37:28.017606+0000","last_undegraded":"2024-09-19T09:37:28.017606+0000","last_fullsized":"2024-09-19T09:37:28.017606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.157466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502511+0000","last_change":"2024-09-19T09:37:28.021974+0000","last_active":"2024-09-19T09:38:56.502511+0000","last_peered":"2024-09-19T09:38:56.502511+0000","last_clean":"2024-09-19T09:38:56.502511+0000","last_became_active":"2024-09-19T09:37:28.021579+0000","last_became_peered":"2024-09-19T09:37:28.021579+0000","last_unstale":"2024-09-19T09:38:56.502511+0000","last_undegraded":"2024-09-19T09:38:56.502511+0000","last_fullsized":"2024-09-19T09:38:56.502511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:28.562862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021814+0000","last_change":"2024-09-19T09:37:08.976540+0000","last_active":"2024-09-19T09:37:28.021814+0000","last_peered":"2024-09-19T09:37:28.021814+0000","last_clean":"2024-09-19T09:37:28.021814+0000","last_became_active":"2024-09-19T09:37:08.976196+0000","last_became_peered":"2024-09-19T09:37:08.976196+0000","last_unstale":"2024-09-19T09:37:28.021814+0000","last_undegraded":"2024-09-19T09:37:28.021814+0000","last_fullsized":"2024-09-19T09:37:28.021814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:38.735947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515663+0000","last_change":"2024-09-19T09:37:28.021407+0000","last_active":"2024-09-19T09:38:56.515663+0000","last_peered":"2024-09-19T09:38:56.515663+0000","last_clean":"2024-09-19T09:38:56.515663+0000","last_became_active":"2024-09-19T09:37:28.021020+0000","last_became_peered":"2024-09-19T09:37:28.021020+0000","last_unstale":"2024-09-19T09:38:56.515663+0000","last_undegraded":"2024-09-19T09:38:56.515663+0000","last_fullsized":"2024-09-19T09:38:56.515663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:25.394012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'37","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.144752+0000","last_change":"2024-09-19T09:37:28.029037+0000","last_active":"2024-09-19T09:38:58.144752+0000","last_peered":"2024-09-19T09:38:58.144752+0000","last_clean":"2024-09-19T09:38:58.144752+0000","last_became_active":"2024-09-19T09:37:28.018325+0000","last_became_peered":"2024-09-19T09:37:28.018325+0000","last_unstale":"2024-09-19T09:38:58.144752+0000","last_undegraded":"2024-09-19T09:38:58.144752+0000","last_fullsized":"2024-09-19T09:38:58.144752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:56.121569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62867,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":162,"num_write":39,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492834+0000","last_change":"2024-09-19T09:37:10.963688+0000","last_active":"2024-09-19T09:38:56.492834+0000","last_peered":"2024-09-19T09:38:56.492834+0000","last_clean":"2024-09-19T09:38:56.492834+0000","last_became_active":"2024-09-19T09:37:10.963296+0000","last_became_peered":"2024-09-19T09:37:10.963296+0000","last_unstale":"2024-09-19T09:38:56.492834+0000","last_undegraded":"2024-09-19T09:38:56.492834+0000","last_fullsized":"2024-09-19T09:38:56.492834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:49.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015183+0000","last_change":"2024-09-19T09:37:08.952198+0000","last_active":"2024-09-19T09:37:28.015183+0000","last_peered":"2024-09-19T09:37:28.015183+0000","last_clean":"2024-09-19T09:37:28.015183+0000","last_became_active":"2024-09-19T09:37:08.951699+0000","last_became_peered":"2024-09-19T09:37:08.951699+0000","last_unstale":"2024-09-19T09:37:28.015183+0000","last_undegraded":"2024-09-19T09:37:28.015183+0000","last_fullsized":"2024-09-19T09:37:28.015183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:46.729847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510576+0000","last_change":"2024-09-19T09:37:10.955741+0000","last_active":"2024-09-19T09:38:56.510576+0000","last_peered":"2024-09-19T09:38:56.510576+0000","last_clean":"2024-09-19T09:38:56.510576+0000","last_became_active":"2024-09-19T09:37:10.955394+0000","last_became_peered":"2024-09-19T09:37:10.955394+0000","last_unstale":"2024-09-19T09:38:56.510576+0000","last_undegraded":"2024-09-19T09:38:56.510576+0000","last_fullsized":"2024-09-19T09:38:56.510576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:56.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021172+0000","last_change":"2024-09-19T09:37:08.949979+0000","last_active":"2024-09-19T09:37:28.021172+0000","last_peered":"2024-09-19T09:37:28.021172+0000","last_clean":"2024-09-19T09:37:28.021172+0000","last_became_active":"2024-09-19T09:37:08.949664+0000","last_became_peered":"2024-09-19T09:37:08.949664+0000","last_unstale":"2024-09-19T09:37:28.021172+0000","last_undegraded":"2024-09-19T09:37:28.021172+0000","last_fullsized":"2024-09-19T09:37:28.021172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:06.449337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509647+0000","last_change":"2024-09-19T09:37:10.957479+0000","last_active":"2024-09-19T09:38:56.509647+0000","last_peered":"2024-09-19T09:38:56.509647+0000","last_clean":"2024-09-19T09:38:56.509647+0000","last_became_active":"2024-09-19T09:37:10.957130+0000","last_became_peered":"2024-09-19T09:37:10.957130+0000","last_unstale":"2024-09-19T09:38:56.509647+0000","last_undegraded":"2024-09-19T09:38:56.509647+0000","last_fullsized":"2024-09-19T09:38:56.509647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:52.840857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'8","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.155534+0000","last_change":"2024-09-19T09:37:08.951558+0000","last_active":"2024-09-19T09:38:58.155534+0000","last_peered":"2024-09-19T09:38:58.155534+0000","last_clean":"2024-09-19T09:38:58.155534+0000","last_became_active":"2024-09-19T09:37:08.951092+0000","last_became_peered":"2024-09-19T09:37:08.951092+0000","last_unstale":"2024-09-19T09:38:58.155534+0000","last_undegraded":"2024-09-19T09:38:58.155534+0000","last_fullsized":"2024-09-19T09:38:58.155534+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:30.326253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503051+0000","last_change":"2024-09-19T09:37:10.962692+0000","last_active":"2024-09-19T09:38:56.503051+0000","last_peered":"2024-09-19T09:38:56.503051+0000","last_clean":"2024-09-19T09:38:56.503051+0000","last_became_active":"2024-09-19T09:37:10.962145+0000","last_became_peered":"2024-09-19T09:37:10.962145+0000","last_unstale":"2024-09-19T09:38:56.503051+0000","last_undegraded":"2024-09-19T09:38:56.503051+0000","last_fullsized":"2024-09-19T09:38:56.503051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:48.232759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020176+0000","last_change":"2024-09-19T09:37:08.976531+0000","last_active":"2024-09-19T09:37:28.020176+0000","last_peered":"2024-09-19T09:37:28.020176+0000","last_clean":"2024-09-19T09:37:28.020176+0000","last_became_active":"2024-09-19T09:37:08.975892+0000","last_became_peered":"2024-09-19T09:37:08.975892+0000","last_unstale":"2024-09-19T09:37:28.020176+0000","last_undegraded":"2024-09-19T09:37:28.020176+0000","last_fullsized":"2024-09-19T09:37:28.020176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.545504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508392+0000","last_change":"2024-09-19T09:37:10.968116+0000","last_active":"2024-09-19T09:38:56.508392+0000","last_peered":"2024-09-19T09:38:56.508392+0000","last_clean":"2024-09-19T09:38:56.508392+0000","last_became_active":"2024-09-19T09:37:10.967767+0000","last_became_peered":"2024-09-19T09:37:10.967767+0000","last_unstale":"2024-09-19T09:38:56.508392+0000","last_undegraded":"2024-09-19T09:38:56.508392+0000","last_fullsized":"2024-09-19T09:38:56.508392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:34.104712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020842+0000","last_change":"2024-09-19T09:37:08.949384+0000","last_active":"2024-09-19T09:37:28.020842+0000","last_peered":"2024-09-19T09:37:28.020842+0000","last_clean":"2024-09-19T09:37:28.020842+0000","last_became_active":"2024-09-19T09:37:08.948950+0000","last_became_peered":"2024-09-19T09:37:08.948950+0000","last_unstale":"2024-09-19T09:37:28.020842+0000","last_undegraded":"2024-09-19T09:37:28.020842+0000","last_fullsized":"2024-09-19T09:37:28.020842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:15.527608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506196+0000","last_change":"2024-09-19T09:37:10.965720+0000","last_active":"2024-09-19T09:38:56.506196+0000","last_peered":"2024-09-19T09:38:56.506196+0000","last_clean":"2024-09-19T09:38:56.506196+0000","last_became_active":"2024-09-19T09:37:10.965341+0000","last_became_peered":"2024-09-19T09:37:10.965341+0000","last_unstale":"2024-09-19T09:38:56.506196+0000","last_undegraded":"2024-09-19T09:38:56.506196+0000","last_fullsized":"2024-09-19T09:38:56.506196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:36.591438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013189+0000","last_change":"2024-09-19T09:37:08.953702+0000","last_active":"2024-09-19T09:37:28.013189+0000","last_peered":"2024-09-19T09:37:28.013189+0000","last_clean":"2024-09-19T09:37:28.013189+0000","last_became_active":"2024-09-19T09:37:08.953312+0000","last_became_peered":"2024-09-19T09:37:08.953312+0000","last_unstale":"2024-09-19T09:37:28.013189+0000","last_undegraded":"2024-09-19T09:37:28.013189+0000","last_fullsized":"2024-09-19T09:37:28.013189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:54.059096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498384+0000","last_change":"2024-09-19T09:37:10.959814+0000","last_active":"2024-09-19T09:38:56.498384+0000","last_peered":"2024-09-19T09:38:56.498384+0000","last_clean":"2024-09-19T09:38:56.498384+0000","last_became_active":"2024-09-19T09:37:10.959342+0000","last_became_peered":"2024-09-19T09:37:10.959342+0000","last_unstale":"2024-09-19T09:38:56.498384+0000","last_undegraded":"2024-09-19T09:38:56.498384+0000","last_fullsized":"2024-09-19T09:38:56.498384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021892+0000","last_change":"2024-09-19T09:37:08.947978+0000","last_active":"2024-09-19T09:37:28.021892+0000","last_peered":"2024-09-19T09:37:28.021892+0000","last_clean":"2024-09-19T09:37:28.021892+0000","last_became_active":"2024-09-19T09:37:08.947548+0000","last_became_peered":"2024-09-19T09:37:08.947548+0000","last_unstale":"2024-09-19T09:37:28.021892+0000","last_undegraded":"2024-09-19T09:37:28.021892+0000","last_fullsized":"2024-09-19T09:37:28.021892+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:38.283616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509716+0000","last_change":"2024-09-19T09:37:10.964008+0000","last_active":"2024-09-19T09:38:56.509716+0000","last_peered":"2024-09-19T09:38:56.509716+0000","last_clean":"2024-09-19T09:38:56.509716+0000","last_became_active":"2024-09-19T09:37:10.963554+0000","last_became_peered":"2024-09-19T09:37:10.963554+0000","last_unstale":"2024-09-19T09:38:56.509716+0000","last_undegraded":"2024-09-19T09:38:56.509716+0000","last_fullsized":"2024-09-19T09:38:56.509716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:57.320967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'5","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:57.154074+0000","last_change":"2024-09-19T09:37:28.027589+0000","last_active":"2024-09-19T09:38:57.154074+0000","last_peered":"2024-09-19T09:38:57.154074+0000","last_clean":"2024-09-19T09:38:57.154074+0000","last_became_active":"2024-09-19T09:37:28.020013+0000","last_became_peered":"2024-09-19T09:37:28.020013+0000","last_unstale":"2024-09-19T09:38:57.154074+0000","last_undegraded":"2024-09-19T09:38:57.154074+0000","last_fullsized":"2024-09-19T09:38:57.154074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:51.327069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.513503+0000","last_change":"2024-09-19T09:37:10.960337+0000","last_active":"2024-09-19T09:38:56.513503+0000","last_peered":"2024-09-19T09:38:56.513503+0000","last_clean":"2024-09-19T09:38:56.513503+0000","last_became_active":"2024-09-19T09:37:10.960006+0000","last_became_peered":"2024-09-19T09:37:10.960006+0000","last_unstale":"2024-09-19T09:38:56.513503+0000","last_undegraded":"2024-09-19T09:38:56.513503+0000","last_fullsized":"2024-09-19T09:38:56.513503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:16.942098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019301+0000","last_change":"2024-09-19T09:36:01.923601+0000","last_active":"2024-09-19T09:37:28.019301+0000","last_peered":"2024-09-19T09:37:28.019301+0000","last_clean":"2024-09-19T09:37:28.019301+0000","last_became_active":"2024-09-19T09:36:01.923051+0000","last_became_peered":"2024-09-19T09:36:01.923051+0000","last_unstale":"2024-09-19T09:37:28.019301+0000","last_undegraded":"2024-09-19T09:37:28.019301+0000","last_fullsized":"2024-09-19T09:37:28.019301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_clean_scrub_stamp":"2024-09-19T09:32:45.321588+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:41.635565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013536+0000","last_change":"2024-09-19T09:37:08.948818+0000","last_active":"2024-09-19T09:37:28.013536+0000","last_peered":"2024-09-19T09:37:28.013536+0000","last_clean":"2024-09-19T09:37:28.013536+0000","last_became_active":"2024-09-19T09:37:08.948494+0000","last_became_peered":"2024-09-19T09:37:08.948494+0000","last_unstale":"2024-09-19T09:37:28.013536+0000","last_undegraded":"2024-09-19T09:37:28.013536+0000","last_fullsized":"2024-09-19T09:37:28.013536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:35.255778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514837+0000","last_change":"2024-09-19T09:37:10.966315+0000","last_active":"2024-09-19T09:38:56.514837+0000","last_peered":"2024-09-19T09:38:56.514837+0000","last_clean":"2024-09-19T09:38:56.514837+0000","last_became_active":"2024-09-19T09:37:10.965979+0000","last_became_peered":"2024-09-19T09:37:10.965979+0000","last_unstale":"2024-09-19T09:38:56.514837+0000","last_undegraded":"2024-09-19T09:38:56.514837+0000","last_fullsized":"2024-09-19T09:38:56.514837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:36.229434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.030136+0000","last_change":"2024-09-19T09:37:28.029598+0000","last_active":"2024-09-19T09:37:28.030136+0000","last_peered":"2024-09-19T09:37:28.030136+0000","last_clean":"2024-09-19T09:37:28.030136+0000","last_became_active":"2024-09-19T09:37:28.021459+0000","last_became_peered":"2024-09-19T09:37:28.021459+0000","last_unstale":"2024-09-19T09:37:28.030136+0000","last_undegraded":"2024-09-19T09:37:28.030136+0000","last_fullsized":"2024-09-19T09:37:28.030136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:00.755946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507049+0000","last_change":"2024-09-19T09:37:10.962825+0000","last_active":"2024-09-19T09:38:56.507049+0000","last_peered":"2024-09-19T09:38:56.507049+0000","last_clean":"2024-09-19T09:38:56.507049+0000","last_became_active":"2024-09-19T09:37:10.962475+0000","last_became_peered":"2024-09-19T09:37:10.962475+0000","last_unstale":"2024-09-19T09:38:56.507049+0000","last_undegraded":"2024-09-19T09:38:56.507049+0000","last_fullsized":"2024-09-19T09:38:56.507049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:30.650918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'6","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:01.159676+0000","last_change":"2024-09-19T09:37:08.976364+0000","last_active":"2024-09-19T09:39:01.159676+0000","last_peered":"2024-09-19T09:39:01.159676+0000","last_clean":"2024-09-19T09:39:01.159676+0000","last_became_active":"2024-09-19T09:37:08.975983+0000","last_became_peered":"2024-09-19T09:37:08.975983+0000","last_unstale":"2024-09-19T09:39:01.159676+0000","last_undegraded":"2024-09-19T09:39:01.159676+0000","last_fullsized":"2024-09-19T09:39:01.159676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.762847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.489815+0000","last_change":"2024-09-19T09:37:28.020341+0000","last_active":"2024-09-19T09:38:56.489815+0000","last_peered":"2024-09-19T09:38:56.489815+0000","last_clean":"2024-09-19T09:38:56.489815+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:56.489815+0000","last_undegraded":"2024-09-19T09:38:56.489815+0000","last_fullsized":"2024-09-19T09:38:56.489815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:24.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'8","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:00.147322+0000","last_change":"2024-09-19T09:37:08.950403+0000","last_active":"2024-09-19T09:39:00.147322+0000","last_peered":"2024-09-19T09:39:00.147322+0000","last_clean":"2024-09-19T09:39:00.147322+0000","last_became_active":"2024-09-19T09:37:08.950077+0000","last_became_peered":"2024-09-19T09:37:08.950077+0000","last_unstale":"2024-09-19T09:39:00.147322+0000","last_undegraded":"2024-09-19T09:39:00.147322+0000","last_fullsized":"2024-09-19T09:39:00.147322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:46.446439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509036+0000","last_change":"2024-09-19T09:37:10.969493+0000","last_active":"2024-09-19T09:38:56.509036+0000","last_peered":"2024-09-19T09:38:56.509036+0000","last_clean":"2024-09-19T09:38:56.509036+0000","last_became_active":"2024-09-19T09:37:10.969038+0000","last_became_peered":"2024-09-19T09:37:10.969038+0000","last_unstale":"2024-09-19T09:38:56.509036+0000","last_undegraded":"2024-09-19T09:38:56.509036+0000","last_fullsized":"2024-09-19T09:38:56.509036+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:55.518806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015137+0000","last_change":"2024-09-19T09:37:08.977207+0000","last_active":"2024-09-19T09:37:28.015137+0000","last_peered":"2024-09-19T09:37:28.015137+0000","last_clean":"2024-09-19T09:37:28.015137+0000","last_became_active":"2024-09-19T09:37:08.976859+0000","last_became_peered":"2024-09-19T09:37:08.976859+0000","last_unstale":"2024-09-19T09:37:28.015137+0000","last_undegraded":"2024-09-19T09:37:28.015137+0000","last_fullsized":"2024-09-19T09:37:28.015137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:25.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504626+0000","last_change":"2024-09-19T09:37:28.023437+0000","last_active":"2024-09-19T09:38:56.504626+0000","last_peered":"2024-09-19T09:38:56.504626+0000","last_clean":"2024-09-19T09:38:56.504626+0000","last_became_active":"2024-09-19T09:37:28.018678+0000","last_became_peered":"2024-09-19T09:37:28.018678+0000","last_unstale":"2024-09-19T09:38:56.504626+0000","last_undegraded":"2024-09-19T09:38:56.504626+0000","last_fullsized":"2024-09-19T09:38:56.504626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:44.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020845+0000","last_change":"2024-09-19T09:37:08.976594+0000","last_active":"2024-09-19T09:37:28.020845+0000","last_peered":"2024-09-19T09:37:28.020845+0000","last_clean":"2024-09-19T09:37:28.020845+0000","last_became_active":"2024-09-19T09:37:08.976222+0000","last_became_peered":"2024-09-19T09:37:08.976222+0000","last_unstale":"2024-09-19T09:37:28.020845+0000","last_undegraded":"2024-09-19T09:37:28.020845+0000","last_fullsized":"2024-09-19T09:37:28.020845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:53.492591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498775+0000","last_change":"2024-09-19T09:37:10.957096+0000","last_active":"2024-09-19T09:38:56.498775+0000","last_peered":"2024-09-19T09:38:56.498775+0000","last_clean":"2024-09-19T09:38:56.498775+0000","last_became_active":"2024-09-19T09:37:10.956740+0000","last_became_peered":"2024-09-19T09:37:10.956740+0000","last_unstale":"2024-09-19T09:38:56.498775+0000","last_undegraded":"2024-09-19T09:38:56.498775+0000","last_fullsized":"2024-09-19T09:38:56.498775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:40.358624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'17","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.032479+0000","last_change":"2024-09-19T09:37:08.948528+0000","last_active":"2024-09-19T09:38:58.032479+0000","last_peered":"2024-09-19T09:38:58.032479+0000","last_clean":"2024-09-19T09:38:58.032479+0000","last_became_active":"2024-09-19T09:37:08.948183+0000","last_became_peered":"2024-09-19T09:37:08.948183+0000","last_unstale":"2024-09-19T09:38:58.032479+0000","last_undegraded":"2024-09-19T09:38:58.032479+0000","last_fullsized":"2024-09-19T09:38:58.032479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:23.214471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508526+0000","last_change":"2024-09-19T09:37:10.959492+0000","last_active":"2024-09-19T09:38:56.508526+0000","last_peered":"2024-09-19T09:38:56.508526+0000","last_clean":"2024-09-19T09:38:56.508526+0000","last_became_active":"2024-09-19T09:37:10.959032+0000","last_became_peered":"2024-09-19T09:37:10.959032+0000","last_unstale":"2024-09-19T09:38:56.508526+0000","last_undegraded":"2024-09-19T09:38:56.508526+0000","last_fullsized":"2024-09-19T09:38:56.508526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.080976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013794+0000","last_change":"2024-09-19T09:37:09.270315+0000","last_active":"2024-09-19T09:37:28.013794+0000","last_peered":"2024-09-19T09:37:28.013794+0000","last_clean":"2024-09-19T09:37:28.013794+0000","last_became_active":"2024-09-19T09:37:09.269891+0000","last_became_peered":"2024-09-19T09:37:09.269891+0000","last_unstale":"2024-09-19T09:37:28.013794+0000","last_undegraded":"2024-09-19T09:37:28.013794+0000","last_fullsized":"2024-09-19T09:37:28.013794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:12.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509933+0000","last_change":"2024-09-19T09:37:10.961363+0000","last_active":"2024-09-19T09:38:56.509933+0000","last_peered":"2024-09-19T09:38:56.509933+0000","last_clean":"2024-09-19T09:38:56.509933+0000","last_became_active":"2024-09-19T09:37:10.960951+0000","last_became_peered":"2024-09-19T09:37:10.960951+0000","last_unstale":"2024-09-19T09:38:56.509933+0000","last_undegraded":"2024-09-19T09:38:56.509933+0000","last_fullsized":"2024-09-19T09:38:56.509933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:31.226355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015555+0000","last_change":"2024-09-19T09:37:08.976805+0000","last_active":"2024-09-19T09:37:28.015555+0000","last_peered":"2024-09-19T09:37:28.015555+0000","last_clean":"2024-09-19T09:37:28.015555+0000","last_became_active":"2024-09-19T09:37:08.976502+0000","last_became_peered":"2024-09-19T09:37:08.976502+0000","last_unstale":"2024-09-19T09:37:28.015555+0000","last_undegraded":"2024-09-19T09:37:28.015555+0000","last_fullsized":"2024-09-19T09:37:28.015555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:25.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.470670+0000","last_change":"2024-09-19T09:37:10.965723+0000","last_active":"2024-09-19T09:38:56.470670+0000","last_peered":"2024-09-19T09:38:56.470670+0000","last_clean":"2024-09-19T09:38:56.470670+0000","last_became_active":"2024-09-19T09:37:10.965385+0000","last_became_peered":"2024-09-19T09:37:10.965385+0000","last_unstale":"2024-09-19T09:38:56.470670+0000","last_undegraded":"2024-09-19T09:38:56.470670+0000","last_fullsized":"2024-09-19T09:38:56.470670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:15.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017690+0000","last_change":"2024-09-19T09:37:08.948028+0000","last_active":"2024-09-19T09:37:28.017690+0000","last_peered":"2024-09-19T09:37:28.017690+0000","last_clean":"2024-09-19T09:37:28.017690+0000","last_became_active":"2024-09-19T09:37:08.947583+0000","last_became_peered":"2024-09-19T09:37:08.947583+0000","last_unstale":"2024-09-19T09:37:28.017690+0000","last_undegraded":"2024-09-19T09:37:28.017690+0000","last_fullsized":"2024-09-19T09:37:28.017690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:15.485850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498875+0000","last_change":"2024-09-19T09:37:10.964577+0000","last_active":"2024-09-19T09:38:56.498875+0000","last_peered":"2024-09-19T09:38:56.498875+0000","last_clean":"2024-09-19T09:38:56.498875+0000","last_became_active":"2024-09-19T09:37:10.964226+0000","last_became_peered":"2024-09-19T09:37:10.964226+0000","last_unstale":"2024-09-19T09:38:56.498875+0000","last_undegraded":"2024-09-19T09:38:56.498875+0000","last_fullsized":"2024-09-19T09:38:56.498875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:44.074286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014911+0000","last_change":"2024-09-19T09:37:08.952257+0000","last_active":"2024-09-19T09:37:28.014911+0000","last_peered":"2024-09-19T09:37:28.014911+0000","last_clean":"2024-09-19T09:37:28.014911+0000","last_became_active":"2024-09-19T09:37:08.951056+0000","last_became_peered":"2024-09-19T09:37:08.951056+0000","last_unstale":"2024-09-19T09:37:28.014911+0000","last_undegraded":"2024-09-19T09:37:28.014911+0000","last_fullsized":"2024-09-19T09:37:28.014911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:35.238551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511292+0000","last_change":"2024-09-19T09:37:10.965956+0000","last_active":"2024-09-19T09:38:56.511292+0000","last_peered":"2024-09-19T09:38:56.511292+0000","last_clean":"2024-09-19T09:38:56.511292+0000","last_became_active":"2024-09-19T09:37:10.965367+0000","last_became_peered":"2024-09-19T09:37:10.965367+0000","last_unstale":"2024-09-19T09:38:56.511292+0000","last_undegraded":"2024-09-19T09:38:56.511292+0000","last_fullsized":"2024-09-19T09:38:56.511292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:23.280106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.027523+0000","last_change":"2024-09-19T09:37:28.026998+0000","last_active":"2024-09-19T09:37:28.027523+0000","last_peered":"2024-09-19T09:37:28.027523+0000","last_clean":"2024-09-19T09:37:28.027523+0000","last_became_active":"2024-09-19T09:37:28.021169+0000","last_became_peered":"2024-09-19T09:37:28.021169+0000","last_unstale":"2024-09-19T09:37:28.027523+0000","last_undegraded":"2024-09-19T09:37:28.027523+0000","last_fullsized":"2024-09-19T09:37:28.027523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.876143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.513741+0000","last_change":"2024-09-19T09:37:10.959937+0000","last_active":"2024-09-19T09:38:56.513741+0000","last_peered":"2024-09-19T09:38:56.513741+0000","last_clean":"2024-09-19T09:38:56.513741+0000","last_became_active":"2024-09-19T09:37:10.959466+0000","last_became_peered":"2024-09-19T09:37:10.959466+0000","last_unstale":"2024-09-19T09:38:56.513741+0000","last_undegraded":"2024-09-19T09:38:56.513741+0000","last_fullsized":"2024-09-19T09:38:56.513741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:13.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508964+0000","last_change":"2024-09-19T09:37:10.966737+0000","last_active":"2024-09-19T09:38:56.508964+0000","last_peered":"2024-09-19T09:38:56.508964+0000","last_clean":"2024-09-19T09:38:56.508964+0000","last_became_active":"2024-09-19T09:37:10.966436+0000","last_became_peered":"2024-09-19T09:37:10.966436+0000","last_unstale":"2024-09-19T09:38:56.508964+0000","last_undegraded":"2024-09-19T09:38:56.508964+0000","last_fullsized":"2024-09-19T09:38:56.508964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:05.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020657+0000","last_change":"2024-09-19T09:37:08.950225+0000","last_active":"2024-09-19T09:37:28.020657+0000","last_peered":"2024-09-19T09:37:28.020657+0000","last_clean":"2024-09-19T09:37:28.020657+0000","last_became_active":"2024-09-19T09:37:08.949855+0000","last_became_peered":"2024-09-19T09:37:08.949855+0000","last_unstale":"2024-09-19T09:37:28.020657+0000","last_undegraded":"2024-09-19T09:37:28.020657+0000","last_fullsized":"2024-09-19T09:37:28.020657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:12.315407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515631+0000","last_change":"2024-09-19T09:37:10.965763+0000","last_active":"2024-09-19T09:38:56.515631+0000","last_peered":"2024-09-19T09:38:56.515631+0000","last_clean":"2024-09-19T09:38:56.515631+0000","last_became_active":"2024-09-19T09:37:10.965425+0000","last_became_peered":"2024-09-19T09:37:10.965425+0000","last_unstale":"2024-09-19T09:38:56.515631+0000","last_undegraded":"2024-09-19T09:38:56.515631+0000","last_fullsized":"2024-09-19T09:38:56.515631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:34.474506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'13","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020863+0000","last_change":"2024-09-19T09:37:08.954211+0000","last_active":"2024-09-19T09:37:28.020863+0000","last_peered":"2024-09-19T09:37:28.020863+0000","last_clean":"2024-09-19T09:37:28.020863+0000","last_became_active":"2024-09-19T09:37:08.953869+0000","last_became_peered":"2024-09-19T09:37:08.953869+0000","last_unstale":"2024-09-19T09:37:28.020863+0000","last_undegraded":"2024-09-19T09:37:28.020863+0000","last_fullsized":"2024-09-19T09:37:28.020863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:10.650227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508638+0000","last_change":"2024-09-19T09:37:10.957032+0000","last_active":"2024-09-19T09:38:56.508638+0000","last_peered":"2024-09-19T09:38:56.508638+0000","last_clean":"2024-09-19T09:38:56.508638+0000","last_became_active":"2024-09-19T09:37:10.955979+0000","last_became_peered":"2024-09-19T09:37:10.955979+0000","last_unstale":"2024-09-19T09:38:56.508638+0000","last_undegraded":"2024-09-19T09:38:56.508638+0000","last_fullsized":"2024-09-19T09:38:56.508638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.734353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018040+0000","last_change":"2024-09-19T09:37:08.976359+0000","last_active":"2024-09-19T09:37:28.018040+0000","last_peered":"2024-09-19T09:37:28.018040+0000","last_clean":"2024-09-19T09:37:28.018040+0000","last_became_active":"2024-09-19T09:37:08.976019+0000","last_became_peered":"2024-09-19T09:37:08.976019+0000","last_unstale":"2024-09-19T09:37:28.018040+0000","last_undegraded":"2024-09-19T09:37:28.018040+0000","last_fullsized":"2024-09-19T09:37:28.018040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:34.401585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509876+0000","last_change":"2024-09-19T09:37:10.954000+0000","last_active":"2024-09-19T09:38:56.509876+0000","last_peered":"2024-09-19T09:38:56.509876+0000","last_clean":"2024-09-19T09:38:56.509876+0000","last_became_active":"2024-09-19T09:37:10.953709+0000","last_became_peered":"2024-09-19T09:37:10.953709+0000","last_unstale":"2024-09-19T09:38:56.509876+0000","last_undegraded":"2024-09-19T09:38:56.509876+0000","last_fullsized":"2024-09-19T09:38:56.509876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:36.779680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'14","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.144149+0000","last_change":"2024-09-19T09:37:28.036392+0000","last_active":"2024-09-19T09:38:58.144149+0000","last_peered":"2024-09-19T09:38:58.144149+0000","last_clean":"2024-09-19T09:38:58.144149+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:58.144149+0000","last_undegraded":"2024-09-19T09:38:58.144149+0000","last_fullsized":"2024-09-19T09:38:58.144149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:56.344807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71143,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":998,"num_read_kb":578,"num_write":263,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":28789,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":224568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612643,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":437286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1609728,"data_stored":1091716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005101,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495670,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":437860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":501365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280585,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476815,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":508078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40416,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704736,"statfs":{"total":95995035648,"available":95953649664,"internally_reserved":0,"allocated":933888,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":71430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:39:02.966 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:03.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:02 smithi171 ceph-mon[35803]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T09:39:03.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:02 smithi171 ceph-mon[35803]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:03.260 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:03.687 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:03 smithi042 ceph-mon[31223]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:39:03.688 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:03 smithi042 ceph-mon[31223]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:03.688 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:03 smithi042 ceph-mon[31223]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:03.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.685+0000 7f163a291640 1 -- 172.21.15.42:0/3430417816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1634101de0 msgr2=0x7f16341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.685+0000 7f163a291640 1 --2- 172.21.15.42:0/3430417816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1634101de0 0x7f16341021c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1624009900 tx=0x7f162402a410 comp rx=0 tx=0).stop 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.686+0000 7f163a291640 1 -- 172.21.15.42:0/3430417816 shutdown_connections 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.686+0000 7f163a291640 1 --2- 172.21.15.42:0/3430417816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1634106f10 0x7f163410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.686+0000 7f163a291640 1 --2- 172.21.15.42:0/3430417816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1634102790 0x7f16341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.686+0000 7f163a291640 1 --2- 172.21.15.42:0/3430417816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1634101de0 0x7f16341021c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.686+0000 7f163a291640 1 -- 172.21.15.42:0/3430417816 >> 172.21.15.42:0/3430417816 conn(0x7f16340fd8c0 msgr2=0x7f16340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.686+0000 7f163a291640 1 -- 172.21.15.42:0/3430417816 shutdown_connections 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.686+0000 7f163a291640 1 -- 172.21.15.42:0/3430417816 wait complete. 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.686+0000 7f163a291640 1 Processor -- start 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.686+0000 7f163a291640 1 -- start start 2024-09-19T09:39:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f163a291640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1634101de0 0x7f16340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f163a291640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1634102790 0x7f1634074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f163a291640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1634106f10 0x7f1634074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f163a291640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1634111f90 con 0x7f1634102790 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f163a291640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1634111e10 con 0x7f1634101de0 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f163a291640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1634112110 con 0x7f1634106f10 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f16337fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1634102790 0x7f1634074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f16337fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1634102790 0x7f1634074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47564/0 (socket says 172.21.15.42:47564) 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f16337fe640 1 -- 172.21.15.42:0/3363408192 learned_addr learned my addr 172.21.15.42:0/3363408192 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f163882e640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1634106f10 0x7f1634074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f1633fff640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1634101de0 0x7f16340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f16337fe640 1 -- 172.21.15.42:0/3363408192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1634106f10 msgr2=0x7f1634074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f16337fe640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1634106f10 0x7f1634074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f16337fe640 1 -- 172.21.15.42:0/3363408192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1634101de0 msgr2=0x7f16340744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f16337fe640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1634101de0 0x7f16340744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.687+0000 7f16337fe640 1 -- 172.21.15.42:0/3363408192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16341a6950 con 0x7f1634102790 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.688+0000 7f16337fe640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1634102790 0x7f1634074a30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f162800d950 tx=0x7f162800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.688+0000 7f16317fa640 1 -- 172.21.15.42:0/3363408192 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628017070 con 0x7f1634102790 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.688+0000 7f163a291640 1 -- 172.21.15.42:0/3363408192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16341a6c40 con 0x7f1634102790 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.688+0000 7f16317fa640 1 -- 172.21.15.42:0/3363408192 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1628009c30 con 0x7f1634102790 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.688+0000 7f16317fa640 1 -- 172.21.15.42:0/3363408192 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162800f6b0 con 0x7f1634102790 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.688+0000 7f163a291640 1 -- 172.21.15.42:0/3363408192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16341a7180 con 0x7f1634102790 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.689+0000 7f163a291640 1 -- 172.21.15.42:0/3363408192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16341021c0 con 0x7f1634102790 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.690+0000 7f16317fa640 1 -- 172.21.15.42:0/3363408192 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f16280109d0 con 0x7f1634102790 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.691+0000 7f16317fa640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f161c0a32d0 0x7f161c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.691+0000 7f1633fff640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f161c0a32d0 0x7f161c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.691+0000 7f16317fa640 1 -- 172.21.15.42:0/3363408192 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f16280cf6e0 con 0x7f1634102790 2024-09-19T09:39:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.691+0000 7f1633fff640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f161c0a32d0 0x7f161c0a5790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1624005ab0 tx=0x7f1624005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.694+0000 7f16317fa640 1 -- 172.21.15.42:0/3363408192 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1628009de0 con 0x7f1634102790 2024-09-19T09:39:03.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:03 smithi136 ceph-mon[34840]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:39:03.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:03 smithi136 ceph-mon[34840]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:03.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:03 smithi136 ceph-mon[34840]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:03.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.906+0000 7f163a291640 1 -- 172.21.15.42:0/3363408192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1634075a20 con 0x7f1634102790 2024-09-19T09:39:03.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.907+0000 7f16317fa640 1 -- 172.21.15.42:0/3363408192 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f1634075a20 con 0x7f1634102790 2024-09-19T09:39:03.909 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:03.909 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:39:03.909 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:39:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 -- 172.21.15.42:0/3363408192 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f161c0a32d0 msgr2=0x7f161c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f161c0a32d0 0x7f161c0a5790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1624005ab0 tx=0x7f1624005a20 comp rx=0 tx=0).stop 2024-09-19T09:39:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 -- 172.21.15.42:0/3363408192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1634102790 msgr2=0x7f1634074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1634102790 0x7f1634074a30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f162800d950 tx=0x7f162800de10 comp rx=0 tx=0).stop 2024-09-19T09:39:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 -- 172.21.15.42:0/3363408192 shutdown_connections 2024-09-19T09:39:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f161c0a32d0 0x7f161c0a5790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1634106f10 0x7f1634074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1634102790 0x7f1634074a30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 --2- 172.21.15.42:0/3363408192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1634101de0 0x7f16340744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 -- 172.21.15.42:0/3363408192 >> 172.21.15.42:0/3363408192 conn(0x7f16340fd8c0 msgr2=0x7f16340fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 -- 172.21.15.42:0/3363408192 shutdown_connections 2024-09-19T09:39:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:03.909+0000 7f163a291640 1 -- 172.21.15.42:0/3363408192 wait complete. 2024-09-19T09:39:04.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:03 smithi171 ceph-mon[35803]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:39:04.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:03 smithi171 ceph-mon[35803]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:04.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:03 smithi171 ceph-mon[35803]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:04.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:04 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3363408192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:04.705 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:39:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:04 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3363408192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:04.971 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:05.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:04 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3363408192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:05.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:05 smithi042 ceph-mon[31223]: pgmap v330: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-09-19T09:39:05.707 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.453+0000 7f0be9480640 1 -- 172.21.15.42:0/3766263146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be4106a80 msgr2=0x7f0be4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.453+0000 7f0be9480640 1 --2- 172.21.15.42:0/3766263146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be4106a80 0x7f0be4106e60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009930 tx=0x7f0bd402a420 comp rx=0 tx=0).stop 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.453+0000 7f0be9480640 1 -- 172.21.15.42:0/3766263146 shutdown_connections 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.453+0000 7f0be9480640 1 --2- 172.21.15.42:0/3766263146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0be4101420 0x7f0be410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.453+0000 7f0be9480640 1 --2- 172.21.15.42:0/3766263146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0be4100a80 0x7f0be4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.453+0000 7f0be9480640 1 --2- 172.21.15.42:0/3766263146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be4106a80 0x7f0be4106e60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.453+0000 7f0be9480640 1 -- 172.21.15.42:0/3766263146 >> 172.21.15.42:0/3766263146 conn(0x7f0be40fc7a0 msgr2=0x7f0be40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.453+0000 7f0be9480640 1 -- 172.21.15.42:0/3766263146 shutdown_connections 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.453+0000 7f0be9480640 1 -- 172.21.15.42:0/3766263146 wait complete. 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.453+0000 7f0be9480640 1 Processor -- start 2024-09-19T09:39:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be9480640 1 -- start start 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be9480640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be4100a80 0x7f0be419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be9480640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0be4101420 0x7f0be419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be9480640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0be4106a80 0x7f0be419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be9480640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0be4110e80 con 0x7f0be4100a80 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be9480640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0be4110d00 con 0x7f0be4106a80 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be9480640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0be4111000 con 0x7f0be4101420 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be4100a80 0x7f0be419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be4100a80 0x7f0be419a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47584/0 (socket says 172.21.15.42:47584) 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be2ffd640 1 -- 172.21.15.42:0/1369651129 learned_addr learned my addr 172.21.15.42:0/1369651129 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be27fc640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0be4101420 0x7f0be419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be2ffd640 1 -- 172.21.15.42:0/1369651129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0be4101420 msgr2=0x7f0be419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be2ffd640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0be4101420 0x7f0be419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be2ffd640 1 -- 172.21.15.42:0/1369651129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0be4106a80 msgr2=0x7f0be419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be2ffd640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0be4106a80 0x7f0be419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be2ffd640 1 -- 172.21.15.42:0/1369651129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be419f630 con 0x7f0be4100a80 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.454+0000 7f0be27fc640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0be4101420 0x7f0be419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.455+0000 7f0be2ffd640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be4100a80 0x7f0be419a680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009230 tx=0x7f0bd4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.455+0000 7f0bcbfff640 1 -- 172.21.15.42:0/1369651129 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd403f030 con 0x7f0be4100a80 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.455+0000 7f0bcbfff640 1 -- 172.21.15.42:0/1369651129 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bd4003ad0 con 0x7f0be4100a80 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.455+0000 7f0be9480640 1 -- 172.21.15.42:0/1369651129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be419f8c0 con 0x7f0be4100a80 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.455+0000 7f0bcbfff640 1 -- 172.21.15.42:0/1369651129 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4035070 con 0x7f0be4100a80 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.455+0000 7f0be9480640 1 -- 172.21.15.42:0/1369651129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be41a7200 con 0x7f0be4100a80 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.456+0000 7f0be9480640 1 -- 172.21.15.42:0/1369651129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be41021c0 con 0x7f0be4100a80 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.457+0000 7f0bcbfff640 1 -- 172.21.15.42:0/1369651129 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f0bd4042030 con 0x7f0be4100a80 2024-09-19T09:39:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.458+0000 7f0bcbfff640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bcc0a32d0 0x7f0bcc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.458+0000 7f0bcbfff640 1 -- 172.21.15.42:0/1369651129 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0bd40f00c0 con 0x7f0be4100a80 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.458+0000 7f0be27fc640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bcc0a32d0 0x7f0bcc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.458+0000 7f0be27fc640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bcc0a32d0 0x7f0bcc0a5790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0be406b870 tx=0x7f0bd8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.462+0000 7f0bcbfff640 1 -- 172.21.15.42:0/1369651129 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0bd40bcc00 con 0x7f0be4100a80 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.640+0000 7f0be9480640 1 -- 172.21.15.42:0/1369651129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0be41a7430 con 0x7f0be4100a80 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.641+0000 7f0bcbfff640 1 -- 172.21.15.42:0/1369651129 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22852 (secure 0 0 0) 0x7f0bd40bc500 con 0x7f0be4100a80 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 -- 172.21.15.42:0/1369651129 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bcc0a32d0 msgr2=0x7f0bcc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bcc0a32d0 0x7f0bcc0a5790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0be406b870 tx=0x7f0bd8005e50 comp rx=0 tx=0).stop 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 -- 172.21.15.42:0/1369651129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be4100a80 msgr2=0x7f0be419a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be4100a80 0x7f0be419a680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009230 tx=0x7f0bd4004270 comp rx=0 tx=0).stop 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 -- 172.21.15.42:0/1369651129 shutdown_connections 2024-09-19T09:39:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bcc0a32d0 0x7f0bcc0a5790 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0be4106a80 0x7f0be419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0be4101420 0x7f0be419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 --2- 172.21.15.42:0/1369651129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be4100a80 0x7f0be419a680 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 -- 172.21.15.42:0/1369651129 >> 172.21.15.42:0/1369651129 conn(0x7f0be40fc7a0 msgr2=0x7f0be40fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:05.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 -- 172.21.15.42:0/1369651129 shutdown_connections 2024-09-19T09:39:05.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:05.644+0000 7f0be9480640 1 -- 172.21.15.42:0/1369651129 wait complete. 2024-09-19T09:39:05.712 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:28.010101+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:39:05.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:05 smithi136 ceph-mon[34840]: pgmap v330: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-09-19T09:39:06.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:05 smithi171 ceph-mon[35803]: pgmap v330: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-09-19T09:39:06.408 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T09:39:06.409 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T09:39:06.422 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-09-19T09:39:06.423 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T09:39:06.423 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T09:39:06.423 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:39:06.423 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:39:06.425 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T09:39:06.446 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:39:06.446 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:39:06.694 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:06.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:06 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1369651129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:39:06.716 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:06 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1369651129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:39:07.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:06 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1369651129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:39:07.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.380+0000 7f773eb01640 1 -- 172.21.15.42:0/4280033240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738100a80 msgr2=0x7f7738100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.380+0000 7f773eb01640 1 --2- 172.21.15.42:0/4280033240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738100a80 0x7f7738100ee0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f772c009930 tx=0x7f772c02a420 comp rx=0 tx=0).stop 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.380+0000 7f773eb01640 1 -- 172.21.15.42:0/4280033240 shutdown_connections 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.380+0000 7f773eb01640 1 --2- 172.21.15.42:0/4280033240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7738101420 0x7f773810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.380+0000 7f773eb01640 1 --2- 172.21.15.42:0/4280033240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738100a80 0x7f7738100ee0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.380+0000 7f773eb01640 1 --2- 172.21.15.42:0/4280033240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7738106a80 0x7f7738106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.380+0000 7f773eb01640 1 -- 172.21.15.42:0/4280033240 >> 172.21.15.42:0/4280033240 conn(0x7f77380fc7a0 msgr2=0x7f77380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.380+0000 7f773eb01640 1 -- 172.21.15.42:0/4280033240 shutdown_connections 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.380+0000 7f773eb01640 1 -- 172.21.15.42:0/4280033240 wait complete. 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773eb01640 1 Processor -- start 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773eb01640 1 -- start start 2024-09-19T09:39:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773eb01640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7738100a80 0x7f773810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773eb01640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7738101420 0x7f773810e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773eb01640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738106a80 0x7f773810ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773eb01640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7738111fa0 con 0x7f7738106a80 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773eb01640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7738111e20 con 0x7f7738100a80 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773eb01640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7738112120 con 0x7f7738101420 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773d09e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738106a80 0x7f773810ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773d09e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738106a80 0x7f773810ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47606/0 (socket says 172.21.15.42:47606) 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.381+0000 7f773d09e640 1 -- 172.21.15.42:0/2729042411 learned_addr learned my addr 172.21.15.42:0/2729042411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f7737fff640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7738101420 0x7f773810e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f773c89d640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7738100a80 0x7f773810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f773d09e640 1 -- 172.21.15.42:0/2729042411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7738101420 msgr2=0x7f773810e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f773d09e640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7738101420 0x7f773810e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f773d09e640 1 -- 172.21.15.42:0/2729042411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7738100a80 msgr2=0x7f773810e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f773d09e640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7738100a80 0x7f773810e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f773d09e640 1 -- 172.21.15.42:0/2729042411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77381a68e0 con 0x7f7738106a80 2024-09-19T09:39:07.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f773d09e640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738106a80 0x7f773810ee60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f773000b970 tx=0x7f773000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:07.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f7735ffb640 1 -- 172.21.15.42:0/2729042411 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730019070 con 0x7f7738106a80 2024-09-19T09:39:07.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f7735ffb640 1 -- 172.21.15.42:0/2729042411 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7730014440 con 0x7f7738106a80 2024-09-19T09:39:07.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f773eb01640 1 -- 172.21.15.42:0/2729042411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77381a6bd0 con 0x7f7738106a80 2024-09-19T09:39:07.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.382+0000 7f7735ffb640 1 -- 172.21.15.42:0/2729042411 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77300075d0 con 0x7f7738106a80 2024-09-19T09:39:07.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.383+0000 7f773eb01640 1 -- 172.21.15.42:0/2729042411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77381a7090 con 0x7f7738106a80 2024-09-19T09:39:07.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.385+0000 7f7735ffb640 1 -- 172.21.15.42:0/2729042411 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f773001c070 con 0x7f7738106a80 2024-09-19T09:39:07.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.385+0000 7f7740eda740 1 Processor -- start 2024-09-19T09:39:07.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7740eda740 1 -- start start 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7735ffb640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77200a32d0 0x7f77200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7740eda740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8798b60 0x55c2c8798f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7740eda740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8799480 0x55c2c87a3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7737fff640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77200a32d0 0x7f77200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7740eda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87a3d40 0x55c2c87a6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7740eda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c2c86fe280 con 0x55c2c87a3d40 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7740eda740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c2c86a5b10 con 0x55c2c8799480 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7740eda740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c2c86fa240 con 0x55c2c8798b60 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7735ffb640 1 -- 172.21.15.42:0/2729042411 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f77300cef90 con 0x7f7738106a80 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f773c89d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8798b60 0x55c2c8798f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f773d09e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87a3d40 0x55c2c87a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f773d09e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87a3d40 0x55c2c87a6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47614/0 (socket says 172.21.15.42:47614) 2024-09-19T09:39:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7737fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8799480 0x55c2c87a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f773d09e640 1 -- 172.21.15.42:0/3647311988 learned_addr learned my addr 172.21.15.42:0/3647311988 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f773d09e640 1 -- 172.21.15.42:0/3647311988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8798b60 msgr2=0x55c2c8798f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f773d09e640 1 --2- 172.21.15.42:0/3647311988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8798b60 0x55c2c8798f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f773d09e640 1 -- 172.21.15.42:0/3647311988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8799480 msgr2=0x55c2c87a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f773d09e640 1 --2- 172.21.15.42:0/3647311988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8799480 0x55c2c87a3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f773d09e640 1 -- 172.21.15.42:0/3647311988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c86b21f0 con 0x55c2c87a3d40 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.386+0000 7f7737fff640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77200a32d0 0x7f77200a5790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f772c009900 tx=0x7f772c0319b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.387+0000 7f773d09e640 1 --2- 172.21.15.42:0/3647311988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87a3d40 0x55c2c87a6130 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f773009b520 tx=0x7f773009b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1f32a875f45390 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.387+0000 7f771effd640 1 -- 172.21.15.42:0/3647311988 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77300ccb10 con 0x55c2c87a3d40 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.387+0000 7f771effd640 1 -- 172.21.15.42:0/3647311988 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77300149a0 con 0x55c2c87a3d40 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.387+0000 7f771effd640 1 -- 172.21.15.42:0/3647311988 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77300a3f20 con 0x55c2c87a3d40 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.387+0000 7f7740eda740 1 -- 172.21.15.42:0/3647311988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87a3d40 msgr2=0x55c2c87a6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.387+0000 7f7740eda740 1 --2- 172.21.15.42:0/3647311988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87a3d40 0x55c2c87a6130 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f773009b520 tx=0x7f773009b650 comp rx=0 tx=0).stop 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.388+0000 7f7740eda740 1 -- 172.21.15.42:0/3647311988 shutdown_connections 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.388+0000 7f7740eda740 1 --2- 172.21.15.42:0/3647311988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87a3d40 0x55c2c87a6130 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.388+0000 7f7740eda740 1 --2- 172.21.15.42:0/3647311988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8799480 0x55c2c87a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.388+0000 7f7740eda740 1 --2- 172.21.15.42:0/3647311988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8798b60 0x55c2c8798f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.388+0000 7f7740eda740 1 -- 172.21.15.42:0/3647311988 >> 172.21.15.42:0/3647311988 conn(0x55c2c87950f0 msgr2=0x55c2c87954d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.388+0000 7f7740eda740 1 -- 172.21.15.42:0/3647311988 shutdown_connections 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.388+0000 7f7740eda740 1 -- 172.21.15.42:0/3647311988 wait complete. 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.388+0000 7f7740eda740 1 -- start start 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.388+0000 7f7740eda740 1 Processor -- start 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.388+0000 7f7740eda740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 0x55c2c87a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7740eda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8799480 0x55c2c87a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7740eda740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c87a3d40 0x55c2c87a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7740eda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c2c87a6910 con 0x55c2c8799480 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7740eda740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c2c86b8f10 con 0x55c2c8798b60 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7740eda740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c2c87a6a90 con 0x55c2c87a3d40 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7740eda740 10 client.0 _ll_register_callbacks cb 0x55c2c8681a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7737fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8799480 0x55c2c87a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7737fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8799480 0x55c2c87a11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47624/0 (socket says 172.21.15.42:47624) 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7737fff640 1 -- 172.21.15.42:0/1608168927 learned_addr learned my addr 172.21.15.42:0/1608168927 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f773c89d640 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 0x55c2c87a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f773d09e640 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c87a3d40 0x55c2c87a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7737fff640 1 -- 172.21.15.42:0/1608168927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c87a3d40 msgr2=0x55c2c87a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7737fff640 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c87a3d40 0x55c2c87a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7737fff640 1 -- 172.21.15.42:0/1608168927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 msgr2=0x55c2c87a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7737fff640 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 0x55c2c87a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7737fff640 1 -- 172.21.15.42:0/1608168927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c846f6a0 con 0x55c2c8799480 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f773d09e640 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c87a3d40 0x55c2c87a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f773c89d640 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 0x55c2c87a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7737fff640 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8799480 0x55c2c87a11b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f772c033000 tx=0x7f772c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd878e3a67060a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7717fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7717fff640 1 -- 172.21.15.42:0/1608168927 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c035040 con 0x55c2c8799480 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7740eda740 1 -- 172.21.15.42:0/1608168927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77300149a0 con 0x55c2c8799480 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.389+0000 7f7717fff640 1 -- 172.21.15.42:0/1608168927 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f772c04a440 con 0x55c2c8799480 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7717fff640 1 -- 172.21.15.42:0/1608168927 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f772c04a640 con 0x55c2c8799480 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7740eda740 10 client.15312 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7740eda740 1 -- 172.21.15.42:0/1608168927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c2c87b25a0 con 0x55c2c8799480 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7717fff640 1 -- 172.21.15.42:0/1608168927 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77300149a0 con 0x55c2c8799480 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7717fff640 1 -- 172.21.15.42:0/1608168927 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f772c03d7c0 con 0x55c2c8799480 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7740eda740 10 client.15312 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:07.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7740eda740 10 client.15312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:07.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7740eda740 20 client.15312 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:07.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7740eda740 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2c87b39b0 0x55c2c87b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7740eda740 4 client.15312 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:07.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f7740eda740 1 -- 172.21.15.42:0/1608168927 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2c870b7f0 con 0x55c2c87b39b0 2024-09-19T09:39:07.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.390+0000 7f773c89d640 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2c87b39b0 0x55c2c87b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.391+0000 7f7717fff640 10 client.15312 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:07.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.391+0000 7f773c89d640 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2c87b39b0 0x55c2c87b5de0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed411fe06826dde5 server_cookie=ccb8b7b8336ba5ab in_seq=0 out_seq=0 2024-09-19T09:39:07.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.391+0000 7f7717fff640 1 -- 172.21.15.42:0/1608168927 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2c870b7f0 con 0x55c2c87b39b0 2024-09-19T09:39:07.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.391+0000 7f7717fff640 10 client.15312 handle_command_reply: tid=0 2024-09-19T09:39:07.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 client.15312 shutdown 2024-09-19T09:39:07.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 -- 172.21.15.42:0/1608168927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8799480 msgr2=0x55c2c87a11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8799480 0x55c2c87a11b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f772c033000 tx=0x7f772c02a420 comp rx=0 tx=0).stop 2024-09-19T09:39:07.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 -- 172.21.15.42:0/1608168927 shutdown_connections 2024-09-19T09:39:07.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2c87b39b0 0x55c2c87b5de0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c87a3d40 0x55c2c87a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8799480 0x55c2c87a11b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 --2- 172.21.15.42:0/1608168927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 0x55c2c87a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7717fff640 0 client.15312 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:07.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 -- 172.21.15.42:0/1608168927 >> 172.21.15.42:0/1608168927 conn(0x55c2c87950f0 msgr2=0x55c2c8794270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:07.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 -- 172.21.15.42:0/1608168927 shutdown_connections 2024-09-19T09:39:07.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 1 -- 172.21.15.42:0/1608168927 wait complete. 2024-09-19T09:39:07.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.392+0000 7f7740eda740 20 client.15312 trim_cache size 0 max 16384 2024-09-19T09:39:07.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.409+0000 7f7740eda740 1 Processor -- start 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.409+0000 7f7740eda740 1 -- start start 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.409+0000 7f7740eda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87950f0 0x55c2c87a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.409+0000 7f7740eda740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 0x55c2c87bb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.409+0000 7f7740eda740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 0x55c2c87bbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.409+0000 7f7740eda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77381af860 con 0x55c2c87950f0 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.409+0000 7f7740eda740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f77381b13a0 con 0x55c2c8798b60 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.409+0000 7f7740eda740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f77381aff30 con 0x55c2c8799480 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773c89d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87950f0 0x55c2c87a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773c89d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87950f0 0x55c2c87a2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47640/0 (socket says 172.21.15.42:47640) 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773c89d640 1 -- 172.21.15.42:0/3594506770 learned_addr learned my addr 172.21.15.42:0/3594506770 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f7737fff640 1 --2- 172.21.15.42:0/3594506770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 0x55c2c87bb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773c89d640 1 -- 172.21.15.42:0/3594506770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 msgr2=0x55c2c87bbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:07.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773d09e640 1 --2- 172.21.15.42:0/3594506770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 0x55c2c87bbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773c89d640 1 --2- 172.21.15.42:0/3594506770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 0x55c2c87bbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773c89d640 1 -- 172.21.15.42:0/3594506770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 msgr2=0x55c2c87bb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:07.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773c89d640 1 --2- 172.21.15.42:0/3594506770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 0x55c2c87bb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773c89d640 1 -- 172.21.15.42:0/3594506770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c879fc20 con 0x55c2c87950f0 2024-09-19T09:39:07.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773d09e640 1 --2- 172.21.15.42:0/3594506770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 0x55c2c87bbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:07.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f773c89d640 1 --2- 172.21.15.42:0/3594506770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87950f0 0x55c2c87a2ad0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f772800ae20 tx=0x7f772800afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8b06a7789a1116 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:07.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f771e7fc640 1 -- 172.21.15.42:0/3594506770 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772802a070 con 0x55c2c87950f0 2024-09-19T09:39:07.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f771e7fc640 1 -- 172.21.15.42:0/3594506770 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f772801ebb0 con 0x55c2c87950f0 2024-09-19T09:39:07.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.410+0000 7f771e7fc640 1 -- 172.21.15.42:0/3594506770 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728025d30 con 0x55c2c87950f0 2024-09-19T09:39:07.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 -- 172.21.15.42:0/3594506770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87950f0 msgr2=0x55c2c87a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 --2- 172.21.15.42:0/3594506770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87950f0 0x55c2c87a2ad0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f772800ae20 tx=0x7f772800afd0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 -- 172.21.15.42:0/3594506770 shutdown_connections 2024-09-19T09:39:07.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 --2- 172.21.15.42:0/3594506770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 0x55c2c87bbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 --2- 172.21.15.42:0/3594506770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c8798b60 0x55c2c87bb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 --2- 172.21.15.42:0/3594506770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c87950f0 0x55c2c87a2ad0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 -- 172.21.15.42:0/3594506770 >> 172.21.15.42:0/3594506770 conn(0x55c2c879c660 msgr2=0x55c2c87a23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 -- 172.21.15.42:0/3594506770 shutdown_connections 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 -- 172.21.15.42:0/3594506770 wait complete. 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 -- start start 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.411+0000 7f7740eda740 1 Processor -- start 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7740eda740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c87950f0 0x55c2c87a7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7740eda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8798b60 0x55c2c87a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7740eda740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 0x55c2c881d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7740eda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77381b0cd0 con 0x55c2c8798b60 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7740eda740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f77381b0600 con 0x55c2c87950f0 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7740eda740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f77381ad840 con 0x55c2c8799480 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7740eda740 10 client.0 _ll_register_callbacks cb 0x7f772c0315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7737fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8798b60 0x55c2c87a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7737fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8798b60 0x55c2c87a82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47656/0 (socket says 172.21.15.42:47656) 2024-09-19T09:39:07.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7737fff640 1 -- 172.21.15.42:0/1169189459 learned_addr learned my addr 172.21.15.42:0/1169189459 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f773c89d640 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c87950f0 0x55c2c87a7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f773d09e640 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 0x55c2c881d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7737fff640 1 -- 172.21.15.42:0/1169189459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 msgr2=0x55c2c881d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7737fff640 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 0x55c2c881d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7737fff640 1 -- 172.21.15.42:0/1169189459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c87950f0 msgr2=0x55c2c87a7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7737fff640 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c87950f0 0x55c2c87a7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f7737fff640 1 -- 172.21.15.42:0/1169189459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c87a8b30 con 0x55c2c8798b60 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.412+0000 7f773d09e640 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 0x55c2c881d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7737fff640 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8798b60 0x55c2c87a82a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f772c0493f0 tx=0x7f772c03d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8270b433614f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7717fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7717fff640 1 -- 172.21.15.42:0/1169189459 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c063020 con 0x55c2c8798b60 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7717fff640 1 -- 172.21.15.42:0/1169189459 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f772c04a7e0 con 0x55c2c8798b60 2024-09-19T09:39:07.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7740eda740 1 -- 172.21.15.42:0/1169189459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f772801ebb0 con 0x55c2c8798b60 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7717fff640 1 -- 172.21.15.42:0/1169189459 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f772c004180 con 0x55c2c8798b60 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7740eda740 10 client.15318 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7740eda740 1 -- 172.21.15.42:0/1169189459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c2c881ec40 con 0x55c2c8798b60 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7717fff640 1 -- 172.21.15.42:0/1169189459 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f772801ebb0 con 0x55c2c8798b60 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7717fff640 1 -- 172.21.15.42:0/1169189459 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f772c053830 con 0x55c2c8798b60 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7740eda740 10 client.15318 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7740eda740 10 client.15318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7740eda740 20 client.15318 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7740eda740 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2c87a3d40 0x55c2c88213f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7740eda740 4 client.15318 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.413+0000 7f7740eda740 1 -- 172.21.15.42:0/1169189459 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c2c8705d00 con 0x55c2c87a3d40 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.414+0000 7f773c89d640 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2c87a3d40 0x55c2c88213f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.414+0000 7f773c89d640 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2c87a3d40 0x55c2c88213f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff03ba869f8ad7be server_cookie=76d2098a539a63a9 in_seq=0 out_seq=0 2024-09-19T09:39:07.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.414+0000 7f7717fff640 10 client.15318 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:07.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7717fff640 1 -- 172.21.15.42:0/1169189459 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c2c8705d00 con 0x55c2c87a3d40 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7717fff640 10 client.15318 handle_command_reply: tid=0 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7740eda740 1 client.15318 shutdown 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7740eda740 1 -- 172.21.15.42:0/1169189459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8798b60 msgr2=0x55c2c87a82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7740eda740 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8798b60 0x55c2c87a82a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f772c0493f0 tx=0x7f772c03d720 comp rx=0 tx=0).stop 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7740eda740 1 -- 172.21.15.42:0/1169189459 shutdown_connections 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7740eda740 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c2c87a3d40 0x55c2c88213f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7717fff640 0 client.15318 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7740eda740 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2c8799480 0x55c2c881d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7740eda740 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2c8798b60 0x55c2c87a82a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7740eda740 1 --2- 172.21.15.42:0/1169189459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2c87950f0 0x55c2c87a7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.415+0000 7f7740eda740 1 -- 172.21.15.42:0/1169189459 >> 172.21.15.42:0/1169189459 conn(0x55c2c879c660 msgr2=0x55c2c8794270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f7740eda740 1 -- 172.21.15.42:0/1169189459 shutdown_connections 2024-09-19T09:39:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f7740eda740 1 -- 172.21.15.42:0/1169189459 wait complete. 2024-09-19T09:39:07.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f7740eda740 20 client.15318 trim_cache size 0 max 16384 2024-09-19T09:39:07.422 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:39:07.422 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-19T09:39:07.422 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "8be96a11-dbfa-4ee8-84c9-aee3dd977d51", 2024-09-19T09:39:07.422 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-19T09:39:07.422 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 -- 172.21.15.42:0/2729042411 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77200a32d0 msgr2=0x7f77200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77200a32d0 0x7f77200a5790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f772c009900 tx=0x7f772c0319b0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 -- 172.21.15.42:0/2729042411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738106a80 msgr2=0x7f773810ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738106a80 0x7f773810ee60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f773000b970 tx=0x7f773000bd70 comp rx=0 tx=0).stop 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 -- 172.21.15.42:0/2729042411 shutdown_connections 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77200a32d0 0x7f77200a5790 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738106a80 0x7f773810ee60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7738101420 0x7f773810e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 --2- 172.21.15.42:0/2729042411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7738100a80 0x7f773810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 -- 172.21.15.42:0/2729042411 >> 172.21.15.42:0/2729042411 conn(0x7f77380fc7a0 msgr2=0x7f77380fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:07.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 -- 172.21.15.42:0/2729042411 shutdown_connections 2024-09-19T09:39:07.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.416+0000 7f773eb01640 1 -- 172.21.15.42:0/2729042411 wait complete. 2024-09-19T09:39:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.576+0000 7f5f33cf4640 1 -- 172.21.15.42:0/3810277700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f2c106a80 msgr2=0x7f5f2c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.576+0000 7f5f33cf4640 1 --2- 172.21.15.42:0/3810277700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f2c106a80 0x7f5f2c106e60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009930 tx=0x7f5f2802a420 comp rx=0 tx=0).stop 2024-09-19T09:39:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.576+0000 7f5f33cf4640 1 -- 172.21.15.42:0/3810277700 shutdown_connections 2024-09-19T09:39:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.576+0000 7f5f33cf4640 1 --2- 172.21.15.42:0/3810277700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c101420 0x7f5f2c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.576+0000 7f5f33cf4640 1 --2- 172.21.15.42:0/3810277700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c100a80 0x7f5f2c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.576+0000 7f5f33cf4640 1 --2- 172.21.15.42:0/3810277700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f2c106a80 0x7f5f2c106e60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.576+0000 7f5f33cf4640 1 -- 172.21.15.42:0/3810277700 >> 172.21.15.42:0/3810277700 conn(0x7f5f2c0fc7a0 msgr2=0x7f5f2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.576+0000 7f5f33cf4640 1 -- 172.21.15.42:0/3810277700 shutdown_connections 2024-09-19T09:39:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.576+0000 7f5f33cf4640 1 -- 172.21.15.42:0/3810277700 wait complete. 2024-09-19T09:39:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f33cf4640 1 Processor -- start 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f33cf4640 1 -- start start 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f33cf4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f2c100a80 0x7f5f2c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f33cf4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c101420 0x7f5f2c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f33cf4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c106a80 0x7f5f2c1a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f33cf4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c110e40 con 0x7f5f2c100a80 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f33cf4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c110cc0 con 0x7f5f2c106a80 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f33cf4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c110fc0 con 0x7f5f2c101420 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f31a90640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f2c100a80 0x7f5f2c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f31a90640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f2c100a80 0x7f5f2c1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47666/0 (socket says 172.21.15.42:47666) 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f31a90640 1 -- 172.21.15.42:0/4018210648 learned_addr learned my addr 172.21.15.42:0/4018210648 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f3128f640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c101420 0x7f5f2c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f32291640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c106a80 0x7f5f2c1a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f31a90640 1 -- 172.21.15.42:0/4018210648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c101420 msgr2=0x7f5f2c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f31a90640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c101420 0x7f5f2c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f31a90640 1 -- 172.21.15.42:0/4018210648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c106a80 msgr2=0x7f5f2c1a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f31a90640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c106a80 0x7f5f2c1a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f31a90640 1 -- 172.21.15.42:0/4018210648 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c1a4860 con 0x7f5f2c100a80 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f32291640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c106a80 0x7f5f2c1a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.577+0000 7f5f3128f640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c101420 0x7f5f2c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.578+0000 7f5f31a90640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f2c100a80 0x7f5f2c1992a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009230 tx=0x7f5f28004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.578+0000 7f5f22ffd640 1 -- 172.21.15.42:0/4018210648 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2803f030 con 0x7f5f2c100a80 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.578+0000 7f5f22ffd640 1 -- 172.21.15.42:0/4018210648 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f28003ad0 con 0x7f5f2c100a80 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.578+0000 7f5f33cf4640 1 -- 172.21.15.42:0/4018210648 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2c1a4a30 con 0x7f5f2c100a80 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.578+0000 7f5f22ffd640 1 -- 172.21.15.42:0/4018210648 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f28035070 con 0x7f5f2c100a80 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.578+0000 7f5f33cf4640 1 -- 172.21.15.42:0/4018210648 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2c1a4e80 con 0x7f5f2c100a80 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.579+0000 7f5f33cf4640 1 -- 172.21.15.42:0/4018210648 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f2c100ee0 con 0x7f5f2c100a80 2024-09-19T09:39:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.580+0000 7f5f22ffd640 1 -- 172.21.15.42:0/4018210648 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f5f28042030 con 0x7f5f2c100a80 2024-09-19T09:39:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.581+0000 7f5f22ffd640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5f180a32d0 0x7f5f180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.581+0000 7f5f3128f640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5f180a32d0 0x7f5f180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.581+0000 7f5f22ffd640 1 -- 172.21.15.42:0/4018210648 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f5f280f00c0 con 0x7f5f2c100a80 2024-09-19T09:39:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.581+0000 7f5f3128f640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5f180a32d0 0x7f5f180a5790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c06b2e0 tx=0x7f5f1c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.585+0000 7f5f22ffd640 1 -- 172.21.15.42:0/4018210648 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f280bcc00 con 0x7f5f2c100a80 2024-09-19T09:39:07.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:07 smithi042 ceph-mon[31223]: pgmap v331: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-19T09:39:07.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:07 smithi042 ceph-mon[31223]: scrub queued for path: / 2024-09-19T09:39:07.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:39:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:07.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.762+0000 7f5f33cf4640 1 -- 172.21.15.42:0/4018210648 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f2c062630 con 0x7f5f180a32d0 2024-09-19T09:39:07.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.768+0000 7f5f22ffd640 1 -- 172.21.15.42:0/4018210648 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258905 (secure 0 0 0) 0x7f5f2c062630 con 0x7f5f180a32d0 2024-09-19T09:39:07.772 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:07.773 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-19T09:39:07.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.772+0000 7f5f33cf4640 1 -- 172.21.15.42:0/4018210648 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5f180a32d0 msgr2=0x7f5f180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.772+0000 7f5f33cf4640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5f180a32d0 0x7f5f180a5790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c06b2e0 tx=0x7f5f1c00a5c0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.772+0000 7f5f33cf4640 1 -- 172.21.15.42:0/4018210648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f2c100a80 msgr2=0x7f5f2c1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.772+0000 7f5f33cf4640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f2c100a80 0x7f5f2c1992a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009230 tx=0x7f5f28004270 comp rx=0 tx=0).stop 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.772+0000 7f5f33cf4640 1 -- 172.21.15.42:0/4018210648 shutdown_connections 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.772+0000 7f5f33cf4640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5f180a32d0 0x7f5f180a5790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.772+0000 7f5f33cf4640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c106a80 0x7f5f2c1a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.772+0000 7f5f33cf4640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c101420 0x7f5f2c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.772+0000 7f5f33cf4640 1 --2- 172.21.15.42:0/4018210648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f2c100a80 0x7f5f2c1992a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.772+0000 7f5f33cf4640 1 -- 172.21.15.42:0/4018210648 >> 172.21.15.42:0/4018210648 conn(0x7f5f2c0fc7a0 msgr2=0x7f5f2c0fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.773+0000 7f5f33cf4640 1 -- 172.21.15.42:0/4018210648 shutdown_connections 2024-09-19T09:39:07.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:07.773+0000 7f5f33cf4640 1 -- 172.21.15.42:0/4018210648 wait complete. 2024-09-19T09:39:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:07 smithi136 ceph-mon[34840]: pgmap v331: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-19T09:39:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:07 smithi136 ceph-mon[34840]: scrub queued for path: / 2024-09-19T09:39:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:39:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:08.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:07 smithi171 ceph-mon[35803]: pgmap v331: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-19T09:39:08.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:07 smithi171 ceph-mon[35803]: scrub queued for path: / 2024-09-19T09:39:08.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:08.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:39:08.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:08.391 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:39:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:08 smithi136 ceph-mon[34840]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:08.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:08 smithi042 ceph-mon[31223]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:09.069 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-19T09:39:06.526940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":670031,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1172,"num_read_kb":717,"num_write":448,"num_write_kb":3100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":1209642,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382864,"kb_used_data":12816,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558960,"statfs":{"total":1151940427776,"available":1151548375040,"internally_reserved":0,"allocated":13123584,"data_stored":7243221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9911,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":70,"num_write":20,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002743"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514653+0000","last_change":"2024-09-19T09:37:10.964695+0000","last_active":"2024-09-19T09:38:56.514653+0000","last_peered":"2024-09-19T09:38:56.514653+0000","last_clean":"2024-09-19T09:38:56.514653+0000","last_became_active":"2024-09-19T09:37:10.964343+0000","last_became_peered":"2024-09-19T09:37:10.964343+0000","last_unstale":"2024-09-19T09:38:56.514653+0000","last_undegraded":"2024-09-19T09:38:56.514653+0000","last_fullsized":"2024-09-19T09:38:56.514653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:44.224621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.493324+0000","last_change":"2024-09-19T09:37:10.964163+0000","last_active":"2024-09-19T09:38:56.493324+0000","last_peered":"2024-09-19T09:38:56.493324+0000","last_clean":"2024-09-19T09:38:56.493324+0000","last_became_active":"2024-09-19T09:37:10.963758+0000","last_became_peered":"2024-09-19T09:37:10.963758+0000","last_unstale":"2024-09-19T09:38:56.493324+0000","last_undegraded":"2024-09-19T09:38:56.493324+0000","last_fullsized":"2024-09-19T09:38:56.493324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:49.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508867+0000","last_change":"2024-09-19T09:37:10.958145+0000","last_active":"2024-09-19T09:38:56.508867+0000","last_peered":"2024-09-19T09:38:56.508867+0000","last_clean":"2024-09-19T09:38:56.508867+0000","last_became_active":"2024-09-19T09:37:10.957666+0000","last_became_peered":"2024-09-19T09:37:10.957666+0000","last_unstale":"2024-09-19T09:38:56.508867+0000","last_undegraded":"2024-09-19T09:38:56.508867+0000","last_fullsized":"2024-09-19T09:38:56.508867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.479753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492252+0000","last_change":"2024-09-19T09:37:28.021681+0000","last_active":"2024-09-19T09:38:56.492252+0000","last_peered":"2024-09-19T09:38:56.492252+0000","last_clean":"2024-09-19T09:38:56.492252+0000","last_became_active":"2024-09-19T09:37:28.021294+0000","last_became_peered":"2024-09-19T09:37:28.021294+0000","last_unstale":"2024-09-19T09:38:56.492252+0000","last_undegraded":"2024-09-19T09:38:56.492252+0000","last_fullsized":"2024-09-19T09:38:56.492252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:36.535707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503476+0000","last_change":"2024-09-19T09:37:10.957138+0000","last_active":"2024-09-19T09:38:56.503476+0000","last_peered":"2024-09-19T09:38:56.503476+0000","last_clean":"2024-09-19T09:38:56.503476+0000","last_became_active":"2024-09-19T09:37:10.956824+0000","last_became_peered":"2024-09-19T09:37:10.956824+0000","last_unstale":"2024-09-19T09:38:56.503476+0000","last_undegraded":"2024-09-19T09:38:56.503476+0000","last_fullsized":"2024-09-19T09:38:56.503476+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.919747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510565+0000","last_change":"2024-09-19T09:37:10.969804+0000","last_active":"2024-09-19T09:38:56.510565+0000","last_peered":"2024-09-19T09:38:56.510565+0000","last_clean":"2024-09-19T09:38:56.510565+0000","last_became_active":"2024-09-19T09:37:10.969454+0000","last_became_peered":"2024-09-19T09:37:10.969454+0000","last_unstale":"2024-09-19T09:38:56.510565+0000","last_undegraded":"2024-09-19T09:38:56.510565+0000","last_fullsized":"2024-09-19T09:38:56.510565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:14.856255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503058+0000","last_change":"2024-09-19T09:37:10.962853+0000","last_active":"2024-09-19T09:38:56.503058+0000","last_peered":"2024-09-19T09:38:56.503058+0000","last_clean":"2024-09-19T09:38:56.503058+0000","last_became_active":"2024-09-19T09:37:10.961207+0000","last_became_peered":"2024-09-19T09:37:10.961207+0000","last_unstale":"2024-09-19T09:38:56.503058+0000","last_undegraded":"2024-09-19T09:38:56.503058+0000","last_fullsized":"2024-09-19T09:38:56.503058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511634+0000","last_change":"2024-09-19T09:37:10.970216+0000","last_active":"2024-09-19T09:38:56.511634+0000","last_peered":"2024-09-19T09:38:56.511634+0000","last_clean":"2024-09-19T09:38:56.511634+0000","last_became_active":"2024-09-19T09:37:10.969486+0000","last_became_peered":"2024-09-19T09:37:10.969486+0000","last_unstale":"2024-09-19T09:38:56.511634+0000","last_undegraded":"2024-09-19T09:38:56.511634+0000","last_fullsized":"2024-09-19T09:38:56.511634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:56.859228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515236+0000","last_change":"2024-09-19T09:37:10.962596+0000","last_active":"2024-09-19T09:38:56.515236+0000","last_peered":"2024-09-19T09:38:56.515236+0000","last_clean":"2024-09-19T09:38:56.515236+0000","last_became_active":"2024-09-19T09:37:10.962230+0000","last_became_peered":"2024-09-19T09:37:10.962230+0000","last_unstale":"2024-09-19T09:38:56.515236+0000","last_undegraded":"2024-09-19T09:38:56.515236+0000","last_fullsized":"2024-09-19T09:38:56.515236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:07.810793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510890+0000","last_change":"2024-09-19T09:37:10.962186+0000","last_active":"2024-09-19T09:38:56.510890+0000","last_peered":"2024-09-19T09:38:56.510890+0000","last_clean":"2024-09-19T09:38:56.510890+0000","last_became_active":"2024-09-19T09:37:10.961845+0000","last_became_peered":"2024-09-19T09:37:10.961845+0000","last_unstale":"2024-09-19T09:38:56.510890+0000","last_undegraded":"2024-09-19T09:38:56.510890+0000","last_fullsized":"2024-09-19T09:38:56.510890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:24.150103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512962+0000","last_change":"2024-09-19T09:37:10.958763+0000","last_active":"2024-09-19T09:38:56.512962+0000","last_peered":"2024-09-19T09:38:56.512962+0000","last_clean":"2024-09-19T09:38:56.512962+0000","last_became_active":"2024-09-19T09:37:10.958397+0000","last_became_peered":"2024-09-19T09:37:10.958397+0000","last_unstale":"2024-09-19T09:38:56.512962+0000","last_undegraded":"2024-09-19T09:38:56.512962+0000","last_fullsized":"2024-09-19T09:38:56.512962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:37.690594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.505751+0000","last_change":"2024-09-19T09:37:10.964787+0000","last_active":"2024-09-19T09:38:56.505751+0000","last_peered":"2024-09-19T09:38:56.505751+0000","last_clean":"2024-09-19T09:38:56.505751+0000","last_became_active":"2024-09-19T09:37:10.964121+0000","last_became_peered":"2024-09-19T09:37:10.964121+0000","last_unstale":"2024-09-19T09:38:56.505751+0000","last_undegraded":"2024-09-19T09:38:56.505751+0000","last_fullsized":"2024-09-19T09:38:56.505751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:02.456961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507798+0000","last_change":"2024-09-19T09:37:10.963290+0000","last_active":"2024-09-19T09:38:56.507798+0000","last_peered":"2024-09-19T09:38:56.507798+0000","last_clean":"2024-09-19T09:38:56.507798+0000","last_became_active":"2024-09-19T09:37:10.962961+0000","last_became_peered":"2024-09-19T09:37:10.962961+0000","last_unstale":"2024-09-19T09:38:56.507798+0000","last_undegraded":"2024-09-19T09:38:56.507798+0000","last_fullsized":"2024-09-19T09:38:56.507798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.266745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510553+0000","last_change":"2024-09-19T09:37:10.969742+0000","last_active":"2024-09-19T09:38:56.510553+0000","last_peered":"2024-09-19T09:38:56.510553+0000","last_clean":"2024-09-19T09:38:56.510553+0000","last_became_active":"2024-09-19T09:37:10.969399+0000","last_became_peered":"2024-09-19T09:37:10.969399+0000","last_unstale":"2024-09-19T09:38:56.510553+0000","last_undegraded":"2024-09-19T09:38:56.510553+0000","last_fullsized":"2024-09-19T09:38:56.510553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.386596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504556+0000","last_change":"2024-09-19T09:37:10.962406+0000","last_active":"2024-09-19T09:38:56.504556+0000","last_peered":"2024-09-19T09:38:56.504556+0000","last_clean":"2024-09-19T09:38:56.504556+0000","last_became_active":"2024-09-19T09:37:10.962130+0000","last_became_peered":"2024-09-19T09:37:10.962130+0000","last_unstale":"2024-09-19T09:38:56.504556+0000","last_undegraded":"2024-09-19T09:38:56.504556+0000","last_fullsized":"2024-09-19T09:38:56.504556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516451+0000","last_change":"2024-09-19T09:37:10.958465+0000","last_active":"2024-09-19T09:38:56.516451+0000","last_peered":"2024-09-19T09:38:56.516451+0000","last_clean":"2024-09-19T09:38:56.516451+0000","last_became_active":"2024-09-19T09:37:10.957600+0000","last_became_peered":"2024-09-19T09:37:10.957600+0000","last_unstale":"2024-09-19T09:38:56.516451+0000","last_undegraded":"2024-09-19T09:38:56.516451+0000","last_fullsized":"2024-09-19T09:38:56.516451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:39.232483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515449+0000","last_change":"2024-09-19T09:37:10.965463+0000","last_active":"2024-09-19T09:38:56.515449+0000","last_peered":"2024-09-19T09:38:56.515449+0000","last_clean":"2024-09-19T09:38:56.515449+0000","last_became_active":"2024-09-19T09:37:10.965137+0000","last_became_peered":"2024-09-19T09:37:10.965137+0000","last_unstale":"2024-09-19T09:38:56.515449+0000","last_undegraded":"2024-09-19T09:38:56.515449+0000","last_fullsized":"2024-09-19T09:38:56.515449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:19.582515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512633+0000","last_change":"2024-09-19T09:37:10.964897+0000","last_active":"2024-09-19T09:38:56.512633+0000","last_peered":"2024-09-19T09:38:56.512633+0000","last_clean":"2024-09-19T09:38:56.512633+0000","last_became_active":"2024-09-19T09:37:10.964527+0000","last_became_peered":"2024-09-19T09:37:10.964527+0000","last_unstale":"2024-09-19T09:38:56.512633+0000","last_undegraded":"2024-09-19T09:38:56.512633+0000","last_fullsized":"2024-09-19T09:38:56.512633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:29.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507468+0000","last_change":"2024-09-19T09:37:10.953645+0000","last_active":"2024-09-19T09:38:56.507468+0000","last_peered":"2024-09-19T09:38:56.507468+0000","last_clean":"2024-09-19T09:38:56.507468+0000","last_became_active":"2024-09-19T09:37:10.953326+0000","last_became_peered":"2024-09-19T09:37:10.953326+0000","last_unstale":"2024-09-19T09:38:56.507468+0000","last_undegraded":"2024-09-19T09:38:56.507468+0000","last_fullsized":"2024-09-19T09:38:56.507468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.644615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506388+0000","last_change":"2024-09-19T09:37:10.961384+0000","last_active":"2024-09-19T09:38:56.506388+0000","last_peered":"2024-09-19T09:38:56.506388+0000","last_clean":"2024-09-19T09:38:56.506388+0000","last_became_active":"2024-09-19T09:37:10.961038+0000","last_became_peered":"2024-09-19T09:37:10.961038+0000","last_unstale":"2024-09-19T09:38:56.506388+0000","last_undegraded":"2024-09-19T09:38:56.506388+0000","last_fullsized":"2024-09-19T09:38:56.506388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:54.876799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506443+0000","last_change":"2024-09-19T09:37:10.955789+0000","last_active":"2024-09-19T09:38:56.506443+0000","last_peered":"2024-09-19T09:38:56.506443+0000","last_clean":"2024-09-19T09:38:56.506443+0000","last_became_active":"2024-09-19T09:37:10.955447+0000","last_became_peered":"2024-09-19T09:37:10.955447+0000","last_unstale":"2024-09-19T09:38:56.506443+0000","last_undegraded":"2024-09-19T09:38:56.506443+0000","last_fullsized":"2024-09-19T09:38:56.506443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:28.512069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516852+0000","last_change":"2024-09-19T09:37:10.956501+0000","last_active":"2024-09-19T09:38:56.516852+0000","last_peered":"2024-09-19T09:38:56.516852+0000","last_clean":"2024-09-19T09:38:56.516852+0000","last_became_active":"2024-09-19T09:37:10.956161+0000","last_became_peered":"2024-09-19T09:37:10.956161+0000","last_unstale":"2024-09-19T09:38:56.516852+0000","last_undegraded":"2024-09-19T09:38:56.516852+0000","last_fullsized":"2024-09-19T09:38:56.516852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:31.738143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510649+0000","last_change":"2024-09-19T09:37:10.961486+0000","last_active":"2024-09-19T09:38:56.510649+0000","last_peered":"2024-09-19T09:38:56.510649+0000","last_clean":"2024-09-19T09:38:56.510649+0000","last_became_active":"2024-09-19T09:37:10.960877+0000","last_became_peered":"2024-09-19T09:37:10.960877+0000","last_unstale":"2024-09-19T09:38:56.510649+0000","last_undegraded":"2024-09-19T09:38:56.510649+0000","last_fullsized":"2024-09-19T09:38:56.510649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:34.889431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509905+0000","last_change":"2024-09-19T09:37:10.964400+0000","last_active":"2024-09-19T09:38:56.509905+0000","last_peered":"2024-09-19T09:38:56.509905+0000","last_clean":"2024-09-19T09:38:56.509905+0000","last_became_active":"2024-09-19T09:37:10.963394+0000","last_became_peered":"2024-09-19T09:37:10.963394+0000","last_unstale":"2024-09-19T09:38:56.509905+0000","last_undegraded":"2024-09-19T09:38:56.509905+0000","last_fullsized":"2024-09-19T09:38:56.509905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:22.185221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509856+0000","last_change":"2024-09-19T09:37:10.959661+0000","last_active":"2024-09-19T09:38:56.509856+0000","last_peered":"2024-09-19T09:38:56.509856+0000","last_clean":"2024-09-19T09:38:56.509856+0000","last_became_active":"2024-09-19T09:37:10.959371+0000","last_became_peered":"2024-09-19T09:37:10.959371+0000","last_unstale":"2024-09-19T09:38:56.509856+0000","last_undegraded":"2024-09-19T09:38:56.509856+0000","last_fullsized":"2024-09-19T09:38:56.509856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.752712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514203+0000","last_change":"2024-09-19T09:37:10.967310+0000","last_active":"2024-09-19T09:38:56.514203+0000","last_peered":"2024-09-19T09:38:56.514203+0000","last_clean":"2024-09-19T09:38:56.514203+0000","last_became_active":"2024-09-19T09:37:10.965415+0000","last_became_peered":"2024-09-19T09:37:10.965415+0000","last_unstale":"2024-09-19T09:38:56.514203+0000","last_undegraded":"2024-09-19T09:38:56.514203+0000","last_fullsized":"2024-09-19T09:38:56.514203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:16.968646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497702+0000","last_change":"2024-09-19T09:37:10.967301+0000","last_active":"2024-09-19T09:38:56.497702+0000","last_peered":"2024-09-19T09:38:56.497702+0000","last_clean":"2024-09-19T09:38:56.497702+0000","last_became_active":"2024-09-19T09:37:10.966397+0000","last_became_peered":"2024-09-19T09:37:10.966397+0000","last_unstale":"2024-09-19T09:38:56.497702+0000","last_undegraded":"2024-09-19T09:38:56.497702+0000","last_fullsized":"2024-09-19T09:38:56.497702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.621085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509302+0000","last_change":"2024-09-19T09:37:10.958069+0000","last_active":"2024-09-19T09:38:56.509302+0000","last_peered":"2024-09-19T09:38:56.509302+0000","last_clean":"2024-09-19T09:38:56.509302+0000","last_became_active":"2024-09-19T09:37:10.957670+0000","last_became_peered":"2024-09-19T09:37:10.957670+0000","last_unstale":"2024-09-19T09:38:56.509302+0000","last_undegraded":"2024-09-19T09:38:56.509302+0000","last_fullsized":"2024-09-19T09:38:56.509302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.412978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503454+0000","last_change":"2024-09-19T09:37:10.960490+0000","last_active":"2024-09-19T09:38:56.503454+0000","last_peered":"2024-09-19T09:38:56.503454+0000","last_clean":"2024-09-19T09:38:56.503454+0000","last_became_active":"2024-09-19T09:37:10.960239+0000","last_became_peered":"2024-09-19T09:37:10.960239+0000","last_unstale":"2024-09-19T09:38:56.503454+0000","last_undegraded":"2024-09-19T09:38:56.503454+0000","last_fullsized":"2024-09-19T09:38:56.503454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.384348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507069+0000","last_change":"2024-09-19T09:37:10.955930+0000","last_active":"2024-09-19T09:38:56.507069+0000","last_peered":"2024-09-19T09:38:56.507069+0000","last_clean":"2024-09-19T09:38:56.507069+0000","last_became_active":"2024-09-19T09:37:10.955605+0000","last_became_peered":"2024-09-19T09:37:10.955605+0000","last_unstale":"2024-09-19T09:38:56.507069+0000","last_undegraded":"2024-09-19T09:38:56.507069+0000","last_fullsized":"2024-09-19T09:38:56.507069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:36.033350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502819+0000","last_change":"2024-09-19T09:37:10.960467+0000","last_active":"2024-09-19T09:38:56.502819+0000","last_peered":"2024-09-19T09:38:56.502819+0000","last_clean":"2024-09-19T09:38:56.502819+0000","last_became_active":"2024-09-19T09:37:10.960082+0000","last_became_peered":"2024-09-19T09:37:10.960082+0000","last_unstale":"2024-09-19T09:38:56.502819+0000","last_undegraded":"2024-09-19T09:38:56.502819+0000","last_fullsized":"2024-09-19T09:38:56.502819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:07.451648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498620+0000","last_change":"2024-09-19T09:37:10.965674+0000","last_active":"2024-09-19T09:38:56.498620+0000","last_peered":"2024-09-19T09:38:56.498620+0000","last_clean":"2024-09-19T09:38:56.498620+0000","last_became_active":"2024-09-19T09:37:10.965368+0000","last_became_peered":"2024-09-19T09:37:10.965368+0000","last_unstale":"2024-09-19T09:38:56.498620+0000","last_undegraded":"2024-09-19T09:38:56.498620+0000","last_fullsized":"2024-09-19T09:38:56.498620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:23.712785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497701+0000","last_change":"2024-09-19T09:37:10.966972+0000","last_active":"2024-09-19T09:38:56.497701+0000","last_peered":"2024-09-19T09:38:56.497701+0000","last_clean":"2024-09-19T09:38:56.497701+0000","last_became_active":"2024-09-19T09:37:10.966642+0000","last_became_peered":"2024-09-19T09:37:10.966642+0000","last_unstale":"2024-09-19T09:38:56.497701+0000","last_undegraded":"2024-09-19T09:38:56.497701+0000","last_fullsized":"2024-09-19T09:38:56.497701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.416611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:02.150259+0000","last_change":"2024-09-19T09:37:08.953116+0000","last_active":"2024-09-19T09:39:02.150259+0000","last_peered":"2024-09-19T09:39:02.150259+0000","last_clean":"2024-09-19T09:39:02.150259+0000","last_became_active":"2024-09-19T09:37:08.952748+0000","last_became_peered":"2024-09-19T09:37:08.952748+0000","last_unstale":"2024-09-19T09:39:02.150259+0000","last_undegraded":"2024-09-19T09:39:02.150259+0000","last_fullsized":"2024-09-19T09:39:02.150259+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:22.395359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509861+0000","last_change":"2024-09-19T09:37:10.969106+0000","last_active":"2024-09-19T09:38:56.509861+0000","last_peered":"2024-09-19T09:38:56.509861+0000","last_clean":"2024-09-19T09:38:56.509861+0000","last_became_active":"2024-09-19T09:37:10.968801+0000","last_became_peered":"2024-09-19T09:37:10.968801+0000","last_unstale":"2024-09-19T09:38:56.509861+0000","last_undegraded":"2024-09-19T09:38:56.509861+0000","last_fullsized":"2024-09-19T09:38:56.509861+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.674925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014739+0000","last_change":"2024-09-19T09:37:08.949604+0000","last_active":"2024-09-19T09:37:28.014739+0000","last_peered":"2024-09-19T09:37:28.014739+0000","last_clean":"2024-09-19T09:37:28.014739+0000","last_became_active":"2024-09-19T09:37:08.949143+0000","last_became_peered":"2024-09-19T09:37:08.949143+0000","last_unstale":"2024-09-19T09:37:28.014739+0000","last_undegraded":"2024-09-19T09:37:28.014739+0000","last_fullsized":"2024-09-19T09:37:28.014739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:37.933319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012827+0000","last_change":"2024-09-19T09:37:08.946277+0000","last_active":"2024-09-19T09:37:28.012827+0000","last_peered":"2024-09-19T09:37:28.012827+0000","last_clean":"2024-09-19T09:37:28.012827+0000","last_became_active":"2024-09-19T09:37:08.945808+0000","last_became_peered":"2024-09-19T09:37:08.945808+0000","last_unstale":"2024-09-19T09:37:28.012827+0000","last_undegraded":"2024-09-19T09:37:28.012827+0000","last_fullsized":"2024-09-19T09:37:28.012827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.060811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511056+0000","last_change":"2024-09-19T09:37:10.957765+0000","last_active":"2024-09-19T09:38:56.511056+0000","last_peered":"2024-09-19T09:38:56.511056+0000","last_clean":"2024-09-19T09:38:56.511056+0000","last_became_active":"2024-09-19T09:37:10.957458+0000","last_became_peered":"2024-09-19T09:37:10.957458+0000","last_unstale":"2024-09-19T09:38:56.511056+0000","last_undegraded":"2024-09-19T09:38:56.511056+0000","last_fullsized":"2024-09-19T09:38:56.511056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:49.418473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020344+0000","last_change":"2024-09-19T09:37:08.953124+0000","last_active":"2024-09-19T09:37:28.020344+0000","last_peered":"2024-09-19T09:37:28.020344+0000","last_clean":"2024-09-19T09:37:28.020344+0000","last_became_active":"2024-09-19T09:37:08.952159+0000","last_became_peered":"2024-09-19T09:37:08.952159+0000","last_unstale":"2024-09-19T09:37:28.020344+0000","last_undegraded":"2024-09-19T09:37:28.020344+0000","last_fullsized":"2024-09-19T09:37:28.020344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:24.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509006+0000","last_change":"2024-09-19T09:37:10.964038+0000","last_active":"2024-09-19T09:38:56.509006+0000","last_peered":"2024-09-19T09:38:56.509006+0000","last_clean":"2024-09-19T09:38:56.509006+0000","last_became_active":"2024-09-19T09:37:10.963671+0000","last_became_peered":"2024-09-19T09:37:10.963671+0000","last_unstale":"2024-09-19T09:38:56.509006+0000","last_undegraded":"2024-09-19T09:38:56.509006+0000","last_fullsized":"2024-09-19T09:38:56.509006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:19.743329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":227,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:03.150891+0000","last_change":"2024-09-19T09:37:08.949600+0000","last_active":"2024-09-19T09:39:03.150891+0000","last_peered":"2024-09-19T09:39:03.150891+0000","last_clean":"2024-09-19T09:39:03.150891+0000","last_became_active":"2024-09-19T09:37:08.949141+0000","last_became_peered":"2024-09-19T09:37:08.949141+0000","last_unstale":"2024-09-19T09:39:03.150891+0000","last_undegraded":"2024-09-19T09:39:03.150891+0000","last_fullsized":"2024-09-19T09:39:03.150891+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:42.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":201,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515006+0000","last_change":"2024-09-19T09:37:10.967506+0000","last_active":"2024-09-19T09:38:56.515006+0000","last_peered":"2024-09-19T09:38:56.515006+0000","last_clean":"2024-09-19T09:38:56.515006+0000","last_became_active":"2024-09-19T09:37:10.967193+0000","last_became_peered":"2024-09-19T09:37:10.967193+0000","last_unstale":"2024-09-19T09:38:56.515006+0000","last_undegraded":"2024-09-19T09:38:56.515006+0000","last_fullsized":"2024-09-19T09:38:56.515006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:33.158325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017606+0000","last_change":"2024-09-19T09:37:08.955305+0000","last_active":"2024-09-19T09:37:28.017606+0000","last_peered":"2024-09-19T09:37:28.017606+0000","last_clean":"2024-09-19T09:37:28.017606+0000","last_became_active":"2024-09-19T09:37:08.954932+0000","last_became_peered":"2024-09-19T09:37:08.954932+0000","last_unstale":"2024-09-19T09:37:28.017606+0000","last_undegraded":"2024-09-19T09:37:28.017606+0000","last_fullsized":"2024-09-19T09:37:28.017606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.157466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502511+0000","last_change":"2024-09-19T09:37:28.021974+0000","last_active":"2024-09-19T09:38:56.502511+0000","last_peered":"2024-09-19T09:38:56.502511+0000","last_clean":"2024-09-19T09:38:56.502511+0000","last_became_active":"2024-09-19T09:37:28.021579+0000","last_became_peered":"2024-09-19T09:37:28.021579+0000","last_unstale":"2024-09-19T09:38:56.502511+0000","last_undegraded":"2024-09-19T09:38:56.502511+0000","last_fullsized":"2024-09-19T09:38:56.502511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:28.562862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021814+0000","last_change":"2024-09-19T09:37:08.976540+0000","last_active":"2024-09-19T09:37:28.021814+0000","last_peered":"2024-09-19T09:37:28.021814+0000","last_clean":"2024-09-19T09:37:28.021814+0000","last_became_active":"2024-09-19T09:37:08.976196+0000","last_became_peered":"2024-09-19T09:37:08.976196+0000","last_unstale":"2024-09-19T09:37:28.021814+0000","last_undegraded":"2024-09-19T09:37:28.021814+0000","last_fullsized":"2024-09-19T09:37:28.021814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:38.735947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515663+0000","last_change":"2024-09-19T09:37:28.021407+0000","last_active":"2024-09-19T09:38:56.515663+0000","last_peered":"2024-09-19T09:38:56.515663+0000","last_clean":"2024-09-19T09:38:56.515663+0000","last_became_active":"2024-09-19T09:37:28.021020+0000","last_became_peered":"2024-09-19T09:37:28.021020+0000","last_unstale":"2024-09-19T09:38:56.515663+0000","last_undegraded":"2024-09-19T09:38:56.515663+0000","last_fullsized":"2024-09-19T09:38:56.515663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:25.394012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'39","reported_seq":294,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:03.151689+0000","last_change":"2024-09-19T09:37:28.029037+0000","last_active":"2024-09-19T09:39:03.151689+0000","last_peered":"2024-09-19T09:39:03.151689+0000","last_clean":"2024-09-19T09:39:03.151689+0000","last_became_active":"2024-09-19T09:37:28.018325+0000","last_became_peered":"2024-09-19T09:37:28.018325+0000","last_unstale":"2024-09-19T09:39:03.151689+0000","last_undegraded":"2024-09-19T09:39:03.151689+0000","last_fullsized":"2024-09-19T09:39:03.151689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:56.121569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71153,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":176,"num_write":41,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492834+0000","last_change":"2024-09-19T09:37:10.963688+0000","last_active":"2024-09-19T09:38:56.492834+0000","last_peered":"2024-09-19T09:38:56.492834+0000","last_clean":"2024-09-19T09:38:56.492834+0000","last_became_active":"2024-09-19T09:37:10.963296+0000","last_became_peered":"2024-09-19T09:37:10.963296+0000","last_unstale":"2024-09-19T09:38:56.492834+0000","last_undegraded":"2024-09-19T09:38:56.492834+0000","last_fullsized":"2024-09-19T09:38:56.492834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:49.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015183+0000","last_change":"2024-09-19T09:37:08.952198+0000","last_active":"2024-09-19T09:37:28.015183+0000","last_peered":"2024-09-19T09:37:28.015183+0000","last_clean":"2024-09-19T09:37:28.015183+0000","last_became_active":"2024-09-19T09:37:08.951699+0000","last_became_peered":"2024-09-19T09:37:08.951699+0000","last_unstale":"2024-09-19T09:37:28.015183+0000","last_undegraded":"2024-09-19T09:37:28.015183+0000","last_fullsized":"2024-09-19T09:37:28.015183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:46.729847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510576+0000","last_change":"2024-09-19T09:37:10.955741+0000","last_active":"2024-09-19T09:38:56.510576+0000","last_peered":"2024-09-19T09:38:56.510576+0000","last_clean":"2024-09-19T09:38:56.510576+0000","last_became_active":"2024-09-19T09:37:10.955394+0000","last_became_peered":"2024-09-19T09:37:10.955394+0000","last_unstale":"2024-09-19T09:38:56.510576+0000","last_undegraded":"2024-09-19T09:38:56.510576+0000","last_fullsized":"2024-09-19T09:38:56.510576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:56.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021172+0000","last_change":"2024-09-19T09:37:08.949979+0000","last_active":"2024-09-19T09:37:28.021172+0000","last_peered":"2024-09-19T09:37:28.021172+0000","last_clean":"2024-09-19T09:37:28.021172+0000","last_became_active":"2024-09-19T09:37:08.949664+0000","last_became_peered":"2024-09-19T09:37:08.949664+0000","last_unstale":"2024-09-19T09:37:28.021172+0000","last_undegraded":"2024-09-19T09:37:28.021172+0000","last_fullsized":"2024-09-19T09:37:28.021172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:06.449337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509647+0000","last_change":"2024-09-19T09:37:10.957479+0000","last_active":"2024-09-19T09:38:56.509647+0000","last_peered":"2024-09-19T09:38:56.509647+0000","last_clean":"2024-09-19T09:38:56.509647+0000","last_became_active":"2024-09-19T09:37:10.957130+0000","last_became_peered":"2024-09-19T09:37:10.957130+0000","last_unstale":"2024-09-19T09:38:56.509647+0000","last_undegraded":"2024-09-19T09:38:56.509647+0000","last_fullsized":"2024-09-19T09:38:56.509647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:52.840857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'8","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:02.161772+0000","last_change":"2024-09-19T09:37:08.951558+0000","last_active":"2024-09-19T09:39:02.161772+0000","last_peered":"2024-09-19T09:39:02.161772+0000","last_clean":"2024-09-19T09:39:02.161772+0000","last_became_active":"2024-09-19T09:37:08.951092+0000","last_became_peered":"2024-09-19T09:37:08.951092+0000","last_unstale":"2024-09-19T09:39:02.161772+0000","last_undegraded":"2024-09-19T09:39:02.161772+0000","last_fullsized":"2024-09-19T09:39:02.161772+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:30.326253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503051+0000","last_change":"2024-09-19T09:37:10.962692+0000","last_active":"2024-09-19T09:38:56.503051+0000","last_peered":"2024-09-19T09:38:56.503051+0000","last_clean":"2024-09-19T09:38:56.503051+0000","last_became_active":"2024-09-19T09:37:10.962145+0000","last_became_peered":"2024-09-19T09:37:10.962145+0000","last_unstale":"2024-09-19T09:38:56.503051+0000","last_undegraded":"2024-09-19T09:38:56.503051+0000","last_fullsized":"2024-09-19T09:38:56.503051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:48.232759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020176+0000","last_change":"2024-09-19T09:37:08.976531+0000","last_active":"2024-09-19T09:37:28.020176+0000","last_peered":"2024-09-19T09:37:28.020176+0000","last_clean":"2024-09-19T09:37:28.020176+0000","last_became_active":"2024-09-19T09:37:08.975892+0000","last_became_peered":"2024-09-19T09:37:08.975892+0000","last_unstale":"2024-09-19T09:37:28.020176+0000","last_undegraded":"2024-09-19T09:37:28.020176+0000","last_fullsized":"2024-09-19T09:37:28.020176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.545504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508392+0000","last_change":"2024-09-19T09:37:10.968116+0000","last_active":"2024-09-19T09:38:56.508392+0000","last_peered":"2024-09-19T09:38:56.508392+0000","last_clean":"2024-09-19T09:38:56.508392+0000","last_became_active":"2024-09-19T09:37:10.967767+0000","last_became_peered":"2024-09-19T09:37:10.967767+0000","last_unstale":"2024-09-19T09:38:56.508392+0000","last_undegraded":"2024-09-19T09:38:56.508392+0000","last_fullsized":"2024-09-19T09:38:56.508392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:34.104712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020842+0000","last_change":"2024-09-19T09:37:08.949384+0000","last_active":"2024-09-19T09:37:28.020842+0000","last_peered":"2024-09-19T09:37:28.020842+0000","last_clean":"2024-09-19T09:37:28.020842+0000","last_became_active":"2024-09-19T09:37:08.948950+0000","last_became_peered":"2024-09-19T09:37:08.948950+0000","last_unstale":"2024-09-19T09:37:28.020842+0000","last_undegraded":"2024-09-19T09:37:28.020842+0000","last_fullsized":"2024-09-19T09:37:28.020842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:15.527608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506196+0000","last_change":"2024-09-19T09:37:10.965720+0000","last_active":"2024-09-19T09:38:56.506196+0000","last_peered":"2024-09-19T09:38:56.506196+0000","last_clean":"2024-09-19T09:38:56.506196+0000","last_became_active":"2024-09-19T09:37:10.965341+0000","last_became_peered":"2024-09-19T09:37:10.965341+0000","last_unstale":"2024-09-19T09:38:56.506196+0000","last_undegraded":"2024-09-19T09:38:56.506196+0000","last_fullsized":"2024-09-19T09:38:56.506196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:36.591438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013189+0000","last_change":"2024-09-19T09:37:08.953702+0000","last_active":"2024-09-19T09:37:28.013189+0000","last_peered":"2024-09-19T09:37:28.013189+0000","last_clean":"2024-09-19T09:37:28.013189+0000","last_became_active":"2024-09-19T09:37:08.953312+0000","last_became_peered":"2024-09-19T09:37:08.953312+0000","last_unstale":"2024-09-19T09:37:28.013189+0000","last_undegraded":"2024-09-19T09:37:28.013189+0000","last_fullsized":"2024-09-19T09:37:28.013189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:54.059096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498384+0000","last_change":"2024-09-19T09:37:10.959814+0000","last_active":"2024-09-19T09:38:56.498384+0000","last_peered":"2024-09-19T09:38:56.498384+0000","last_clean":"2024-09-19T09:38:56.498384+0000","last_became_active":"2024-09-19T09:37:10.959342+0000","last_became_peered":"2024-09-19T09:37:10.959342+0000","last_unstale":"2024-09-19T09:38:56.498384+0000","last_undegraded":"2024-09-19T09:38:56.498384+0000","last_fullsized":"2024-09-19T09:38:56.498384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021892+0000","last_change":"2024-09-19T09:37:08.947978+0000","last_active":"2024-09-19T09:37:28.021892+0000","last_peered":"2024-09-19T09:37:28.021892+0000","last_clean":"2024-09-19T09:37:28.021892+0000","last_became_active":"2024-09-19T09:37:08.947548+0000","last_became_peered":"2024-09-19T09:37:08.947548+0000","last_unstale":"2024-09-19T09:37:28.021892+0000","last_undegraded":"2024-09-19T09:37:28.021892+0000","last_fullsized":"2024-09-19T09:37:28.021892+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:38.283616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509716+0000","last_change":"2024-09-19T09:37:10.964008+0000","last_active":"2024-09-19T09:38:56.509716+0000","last_peered":"2024-09-19T09:38:56.509716+0000","last_clean":"2024-09-19T09:38:56.509716+0000","last_became_active":"2024-09-19T09:37:10.963554+0000","last_became_peered":"2024-09-19T09:37:10.963554+0000","last_unstale":"2024-09-19T09:38:56.509716+0000","last_undegraded":"2024-09-19T09:38:56.509716+0000","last_fullsized":"2024-09-19T09:38:56.509716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:57.320967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'5","reported_seq":115,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:02.160400+0000","last_change":"2024-09-19T09:37:28.027589+0000","last_active":"2024-09-19T09:39:02.160400+0000","last_peered":"2024-09-19T09:39:02.160400+0000","last_clean":"2024-09-19T09:39:02.160400+0000","last_became_active":"2024-09-19T09:37:28.020013+0000","last_became_peered":"2024-09-19T09:37:28.020013+0000","last_unstale":"2024-09-19T09:39:02.160400+0000","last_undegraded":"2024-09-19T09:39:02.160400+0000","last_fullsized":"2024-09-19T09:39:02.160400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:51.327069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.513503+0000","last_change":"2024-09-19T09:37:10.960337+0000","last_active":"2024-09-19T09:38:56.513503+0000","last_peered":"2024-09-19T09:38:56.513503+0000","last_clean":"2024-09-19T09:38:56.513503+0000","last_became_active":"2024-09-19T09:37:10.960006+0000","last_became_peered":"2024-09-19T09:37:10.960006+0000","last_unstale":"2024-09-19T09:38:56.513503+0000","last_undegraded":"2024-09-19T09:38:56.513503+0000","last_fullsized":"2024-09-19T09:38:56.513503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:16.942098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019301+0000","last_change":"2024-09-19T09:36:01.923601+0000","last_active":"2024-09-19T09:37:28.019301+0000","last_peered":"2024-09-19T09:37:28.019301+0000","last_clean":"2024-09-19T09:37:28.019301+0000","last_became_active":"2024-09-19T09:36:01.923051+0000","last_became_peered":"2024-09-19T09:36:01.923051+0000","last_unstale":"2024-09-19T09:37:28.019301+0000","last_undegraded":"2024-09-19T09:37:28.019301+0000","last_fullsized":"2024-09-19T09:37:28.019301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_clean_scrub_stamp":"2024-09-19T09:32:45.321588+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:41.635565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013536+0000","last_change":"2024-09-19T09:37:08.948818+0000","last_active":"2024-09-19T09:37:28.013536+0000","last_peered":"2024-09-19T09:37:28.013536+0000","last_clean":"2024-09-19T09:37:28.013536+0000","last_became_active":"2024-09-19T09:37:08.948494+0000","last_became_peered":"2024-09-19T09:37:08.948494+0000","last_unstale":"2024-09-19T09:37:28.013536+0000","last_undegraded":"2024-09-19T09:37:28.013536+0000","last_fullsized":"2024-09-19T09:37:28.013536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:35.255778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514837+0000","last_change":"2024-09-19T09:37:10.966315+0000","last_active":"2024-09-19T09:38:56.514837+0000","last_peered":"2024-09-19T09:38:56.514837+0000","last_clean":"2024-09-19T09:38:56.514837+0000","last_became_active":"2024-09-19T09:37:10.965979+0000","last_became_peered":"2024-09-19T09:37:10.965979+0000","last_unstale":"2024-09-19T09:38:56.514837+0000","last_undegraded":"2024-09-19T09:38:56.514837+0000","last_fullsized":"2024-09-19T09:38:56.514837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:36.229434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.030136+0000","last_change":"2024-09-19T09:37:28.029598+0000","last_active":"2024-09-19T09:37:28.030136+0000","last_peered":"2024-09-19T09:37:28.030136+0000","last_clean":"2024-09-19T09:37:28.030136+0000","last_became_active":"2024-09-19T09:37:28.021459+0000","last_became_peered":"2024-09-19T09:37:28.021459+0000","last_unstale":"2024-09-19T09:37:28.030136+0000","last_undegraded":"2024-09-19T09:37:28.030136+0000","last_fullsized":"2024-09-19T09:37:28.030136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:00.755946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507049+0000","last_change":"2024-09-19T09:37:10.962825+0000","last_active":"2024-09-19T09:38:56.507049+0000","last_peered":"2024-09-19T09:38:56.507049+0000","last_clean":"2024-09-19T09:38:56.507049+0000","last_became_active":"2024-09-19T09:37:10.962475+0000","last_became_peered":"2024-09-19T09:37:10.962475+0000","last_unstale":"2024-09-19T09:38:56.507049+0000","last_undegraded":"2024-09-19T09:38:56.507049+0000","last_fullsized":"2024-09-19T09:38:56.507049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:30.650918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'6","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:01.159676+0000","last_change":"2024-09-19T09:37:08.976364+0000","last_active":"2024-09-19T09:39:01.159676+0000","last_peered":"2024-09-19T09:39:01.159676+0000","last_clean":"2024-09-19T09:39:01.159676+0000","last_became_active":"2024-09-19T09:37:08.975983+0000","last_became_peered":"2024-09-19T09:37:08.975983+0000","last_unstale":"2024-09-19T09:39:01.159676+0000","last_undegraded":"2024-09-19T09:39:01.159676+0000","last_fullsized":"2024-09-19T09:39:01.159676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.762847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.489815+0000","last_change":"2024-09-19T09:37:28.020341+0000","last_active":"2024-09-19T09:38:56.489815+0000","last_peered":"2024-09-19T09:38:56.489815+0000","last_clean":"2024-09-19T09:38:56.489815+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:56.489815+0000","last_undegraded":"2024-09-19T09:38:56.489815+0000","last_fullsized":"2024-09-19T09:38:56.489815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:24.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'8","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:05.153874+0000","last_change":"2024-09-19T09:37:08.950403+0000","last_active":"2024-09-19T09:39:05.153874+0000","last_peered":"2024-09-19T09:39:05.153874+0000","last_clean":"2024-09-19T09:39:05.153874+0000","last_became_active":"2024-09-19T09:37:08.950077+0000","last_became_peered":"2024-09-19T09:37:08.950077+0000","last_unstale":"2024-09-19T09:39:05.153874+0000","last_undegraded":"2024-09-19T09:39:05.153874+0000","last_fullsized":"2024-09-19T09:39:05.153874+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:46.446439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509036+0000","last_change":"2024-09-19T09:37:10.969493+0000","last_active":"2024-09-19T09:38:56.509036+0000","last_peered":"2024-09-19T09:38:56.509036+0000","last_clean":"2024-09-19T09:38:56.509036+0000","last_became_active":"2024-09-19T09:37:10.969038+0000","last_became_peered":"2024-09-19T09:37:10.969038+0000","last_unstale":"2024-09-19T09:38:56.509036+0000","last_undegraded":"2024-09-19T09:38:56.509036+0000","last_fullsized":"2024-09-19T09:38:56.509036+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:55.518806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015137+0000","last_change":"2024-09-19T09:37:08.977207+0000","last_active":"2024-09-19T09:37:28.015137+0000","last_peered":"2024-09-19T09:37:28.015137+0000","last_clean":"2024-09-19T09:37:28.015137+0000","last_became_active":"2024-09-19T09:37:08.976859+0000","last_became_peered":"2024-09-19T09:37:08.976859+0000","last_unstale":"2024-09-19T09:37:28.015137+0000","last_undegraded":"2024-09-19T09:37:28.015137+0000","last_fullsized":"2024-09-19T09:37:28.015137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:25.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504626+0000","last_change":"2024-09-19T09:37:28.023437+0000","last_active":"2024-09-19T09:38:56.504626+0000","last_peered":"2024-09-19T09:38:56.504626+0000","last_clean":"2024-09-19T09:38:56.504626+0000","last_became_active":"2024-09-19T09:37:28.018678+0000","last_became_peered":"2024-09-19T09:37:28.018678+0000","last_unstale":"2024-09-19T09:38:56.504626+0000","last_undegraded":"2024-09-19T09:38:56.504626+0000","last_fullsized":"2024-09-19T09:38:56.504626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:44.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020845+0000","last_change":"2024-09-19T09:37:08.976594+0000","last_active":"2024-09-19T09:37:28.020845+0000","last_peered":"2024-09-19T09:37:28.020845+0000","last_clean":"2024-09-19T09:37:28.020845+0000","last_became_active":"2024-09-19T09:37:08.976222+0000","last_became_peered":"2024-09-19T09:37:08.976222+0000","last_unstale":"2024-09-19T09:37:28.020845+0000","last_undegraded":"2024-09-19T09:37:28.020845+0000","last_fullsized":"2024-09-19T09:37:28.020845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:53.492591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498775+0000","last_change":"2024-09-19T09:37:10.957096+0000","last_active":"2024-09-19T09:38:56.498775+0000","last_peered":"2024-09-19T09:38:56.498775+0000","last_clean":"2024-09-19T09:38:56.498775+0000","last_became_active":"2024-09-19T09:37:10.956740+0000","last_became_peered":"2024-09-19T09:37:10.956740+0000","last_unstale":"2024-09-19T09:38:56.498775+0000","last_undegraded":"2024-09-19T09:38:56.498775+0000","last_fullsized":"2024-09-19T09:38:56.498775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:40.358624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'17","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.032479+0000","last_change":"2024-09-19T09:37:08.948528+0000","last_active":"2024-09-19T09:38:58.032479+0000","last_peered":"2024-09-19T09:38:58.032479+0000","last_clean":"2024-09-19T09:38:58.032479+0000","last_became_active":"2024-09-19T09:37:08.948183+0000","last_became_peered":"2024-09-19T09:37:08.948183+0000","last_unstale":"2024-09-19T09:38:58.032479+0000","last_undegraded":"2024-09-19T09:38:58.032479+0000","last_fullsized":"2024-09-19T09:38:58.032479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:23.214471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508526+0000","last_change":"2024-09-19T09:37:10.959492+0000","last_active":"2024-09-19T09:38:56.508526+0000","last_peered":"2024-09-19T09:38:56.508526+0000","last_clean":"2024-09-19T09:38:56.508526+0000","last_became_active":"2024-09-19T09:37:10.959032+0000","last_became_peered":"2024-09-19T09:37:10.959032+0000","last_unstale":"2024-09-19T09:38:56.508526+0000","last_undegraded":"2024-09-19T09:38:56.508526+0000","last_fullsized":"2024-09-19T09:38:56.508526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.080976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013794+0000","last_change":"2024-09-19T09:37:09.270315+0000","last_active":"2024-09-19T09:37:28.013794+0000","last_peered":"2024-09-19T09:37:28.013794+0000","last_clean":"2024-09-19T09:37:28.013794+0000","last_became_active":"2024-09-19T09:37:09.269891+0000","last_became_peered":"2024-09-19T09:37:09.269891+0000","last_unstale":"2024-09-19T09:37:28.013794+0000","last_undegraded":"2024-09-19T09:37:28.013794+0000","last_fullsized":"2024-09-19T09:37:28.013794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:12.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509933+0000","last_change":"2024-09-19T09:37:10.961363+0000","last_active":"2024-09-19T09:38:56.509933+0000","last_peered":"2024-09-19T09:38:56.509933+0000","last_clean":"2024-09-19T09:38:56.509933+0000","last_became_active":"2024-09-19T09:37:10.960951+0000","last_became_peered":"2024-09-19T09:37:10.960951+0000","last_unstale":"2024-09-19T09:38:56.509933+0000","last_undegraded":"2024-09-19T09:38:56.509933+0000","last_fullsized":"2024-09-19T09:38:56.509933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:31.226355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015555+0000","last_change":"2024-09-19T09:37:08.976805+0000","last_active":"2024-09-19T09:37:28.015555+0000","last_peered":"2024-09-19T09:37:28.015555+0000","last_clean":"2024-09-19T09:37:28.015555+0000","last_became_active":"2024-09-19T09:37:08.976502+0000","last_became_peered":"2024-09-19T09:37:08.976502+0000","last_unstale":"2024-09-19T09:37:28.015555+0000","last_undegraded":"2024-09-19T09:37:28.015555+0000","last_fullsized":"2024-09-19T09:37:28.015555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:25.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.470670+0000","last_change":"2024-09-19T09:37:10.965723+0000","last_active":"2024-09-19T09:38:56.470670+0000","last_peered":"2024-09-19T09:38:56.470670+0000","last_clean":"2024-09-19T09:38:56.470670+0000","last_became_active":"2024-09-19T09:37:10.965385+0000","last_became_peered":"2024-09-19T09:37:10.965385+0000","last_unstale":"2024-09-19T09:38:56.470670+0000","last_undegraded":"2024-09-19T09:38:56.470670+0000","last_fullsized":"2024-09-19T09:38:56.470670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:15.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017690+0000","last_change":"2024-09-19T09:37:08.948028+0000","last_active":"2024-09-19T09:37:28.017690+0000","last_peered":"2024-09-19T09:37:28.017690+0000","last_clean":"2024-09-19T09:37:28.017690+0000","last_became_active":"2024-09-19T09:37:08.947583+0000","last_became_peered":"2024-09-19T09:37:08.947583+0000","last_unstale":"2024-09-19T09:37:28.017690+0000","last_undegraded":"2024-09-19T09:37:28.017690+0000","last_fullsized":"2024-09-19T09:37:28.017690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:15.485850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498875+0000","last_change":"2024-09-19T09:37:10.964577+0000","last_active":"2024-09-19T09:38:56.498875+0000","last_peered":"2024-09-19T09:38:56.498875+0000","last_clean":"2024-09-19T09:38:56.498875+0000","last_became_active":"2024-09-19T09:37:10.964226+0000","last_became_peered":"2024-09-19T09:37:10.964226+0000","last_unstale":"2024-09-19T09:38:56.498875+0000","last_undegraded":"2024-09-19T09:38:56.498875+0000","last_fullsized":"2024-09-19T09:38:56.498875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:44.074286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014911+0000","last_change":"2024-09-19T09:37:08.952257+0000","last_active":"2024-09-19T09:37:28.014911+0000","last_peered":"2024-09-19T09:37:28.014911+0000","last_clean":"2024-09-19T09:37:28.014911+0000","last_became_active":"2024-09-19T09:37:08.951056+0000","last_became_peered":"2024-09-19T09:37:08.951056+0000","last_unstale":"2024-09-19T09:37:28.014911+0000","last_undegraded":"2024-09-19T09:37:28.014911+0000","last_fullsized":"2024-09-19T09:37:28.014911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:35.238551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511292+0000","last_change":"2024-09-19T09:37:10.965956+0000","last_active":"2024-09-19T09:38:56.511292+0000","last_peered":"2024-09-19T09:38:56.511292+0000","last_clean":"2024-09-19T09:38:56.511292+0000","last_became_active":"2024-09-19T09:37:10.965367+0000","last_became_peered":"2024-09-19T09:37:10.965367+0000","last_unstale":"2024-09-19T09:38:56.511292+0000","last_undegraded":"2024-09-19T09:38:56.511292+0000","last_fullsized":"2024-09-19T09:38:56.511292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:23.280106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.027523+0000","last_change":"2024-09-19T09:37:28.026998+0000","last_active":"2024-09-19T09:37:28.027523+0000","last_peered":"2024-09-19T09:37:28.027523+0000","last_clean":"2024-09-19T09:37:28.027523+0000","last_became_active":"2024-09-19T09:37:28.021169+0000","last_became_peered":"2024-09-19T09:37:28.021169+0000","last_unstale":"2024-09-19T09:37:28.027523+0000","last_undegraded":"2024-09-19T09:37:28.027523+0000","last_fullsized":"2024-09-19T09:37:28.027523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.876143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.513741+0000","last_change":"2024-09-19T09:37:10.959937+0000","last_active":"2024-09-19T09:38:56.513741+0000","last_peered":"2024-09-19T09:38:56.513741+0000","last_clean":"2024-09-19T09:38:56.513741+0000","last_became_active":"2024-09-19T09:37:10.959466+0000","last_became_peered":"2024-09-19T09:37:10.959466+0000","last_unstale":"2024-09-19T09:38:56.513741+0000","last_undegraded":"2024-09-19T09:38:56.513741+0000","last_fullsized":"2024-09-19T09:38:56.513741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:13.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508964+0000","last_change":"2024-09-19T09:37:10.966737+0000","last_active":"2024-09-19T09:38:56.508964+0000","last_peered":"2024-09-19T09:38:56.508964+0000","last_clean":"2024-09-19T09:38:56.508964+0000","last_became_active":"2024-09-19T09:37:10.966436+0000","last_became_peered":"2024-09-19T09:37:10.966436+0000","last_unstale":"2024-09-19T09:38:56.508964+0000","last_undegraded":"2024-09-19T09:38:56.508964+0000","last_fullsized":"2024-09-19T09:38:56.508964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:05.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020657+0000","last_change":"2024-09-19T09:37:08.950225+0000","last_active":"2024-09-19T09:37:28.020657+0000","last_peered":"2024-09-19T09:37:28.020657+0000","last_clean":"2024-09-19T09:37:28.020657+0000","last_became_active":"2024-09-19T09:37:08.949855+0000","last_became_peered":"2024-09-19T09:37:08.949855+0000","last_unstale":"2024-09-19T09:37:28.020657+0000","last_undegraded":"2024-09-19T09:37:28.020657+0000","last_fullsized":"2024-09-19T09:37:28.020657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:12.315407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515631+0000","last_change":"2024-09-19T09:37:10.965763+0000","last_active":"2024-09-19T09:38:56.515631+0000","last_peered":"2024-09-19T09:38:56.515631+0000","last_clean":"2024-09-19T09:38:56.515631+0000","last_became_active":"2024-09-19T09:37:10.965425+0000","last_became_peered":"2024-09-19T09:37:10.965425+0000","last_unstale":"2024-09-19T09:38:56.515631+0000","last_undegraded":"2024-09-19T09:38:56.515631+0000","last_fullsized":"2024-09-19T09:38:56.515631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:34.474506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'13","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020863+0000","last_change":"2024-09-19T09:37:08.954211+0000","last_active":"2024-09-19T09:37:28.020863+0000","last_peered":"2024-09-19T09:37:28.020863+0000","last_clean":"2024-09-19T09:37:28.020863+0000","last_became_active":"2024-09-19T09:37:08.953869+0000","last_became_peered":"2024-09-19T09:37:08.953869+0000","last_unstale":"2024-09-19T09:37:28.020863+0000","last_undegraded":"2024-09-19T09:37:28.020863+0000","last_fullsized":"2024-09-19T09:37:28.020863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:10.650227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508638+0000","last_change":"2024-09-19T09:37:10.957032+0000","last_active":"2024-09-19T09:38:56.508638+0000","last_peered":"2024-09-19T09:38:56.508638+0000","last_clean":"2024-09-19T09:38:56.508638+0000","last_became_active":"2024-09-19T09:37:10.955979+0000","last_became_peered":"2024-09-19T09:37:10.955979+0000","last_unstale":"2024-09-19T09:38:56.508638+0000","last_undegraded":"2024-09-19T09:38:56.508638+0000","last_fullsized":"2024-09-19T09:38:56.508638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.734353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018040+0000","last_change":"2024-09-19T09:37:08.976359+0000","last_active":"2024-09-19T09:37:28.018040+0000","last_peered":"2024-09-19T09:37:28.018040+0000","last_clean":"2024-09-19T09:37:28.018040+0000","last_became_active":"2024-09-19T09:37:08.976019+0000","last_became_peered":"2024-09-19T09:37:08.976019+0000","last_unstale":"2024-09-19T09:37:28.018040+0000","last_undegraded":"2024-09-19T09:37:28.018040+0000","last_fullsized":"2024-09-19T09:37:28.018040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:34.401585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509876+0000","last_change":"2024-09-19T09:37:10.954000+0000","last_active":"2024-09-19T09:38:56.509876+0000","last_peered":"2024-09-19T09:38:56.509876+0000","last_clean":"2024-09-19T09:38:56.509876+0000","last_became_active":"2024-09-19T09:37:10.953709+0000","last_became_peered":"2024-09-19T09:37:10.953709+0000","last_unstale":"2024-09-19T09:38:56.509876+0000","last_undegraded":"2024-09-19T09:38:56.509876+0000","last_fullsized":"2024-09-19T09:38:56.509876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:36.779680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'14","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:03.150958+0000","last_change":"2024-09-19T09:37:28.036392+0000","last_active":"2024-09-19T09:39:03.150958+0000","last_peered":"2024-09-19T09:39:03.150958+0000","last_clean":"2024-09-19T09:39:03.150958+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:39:03.150958+0000","last_undegraded":"2024-09-19T09:39:03.150958+0000","last_fullsized":"2024-09-19T09:39:03.150958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:56.344807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":79429,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1046,"num_read_kb":608,"num_write":265,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":28789,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":238287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612644,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":437286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1617920,"data_stored":1100395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005102,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":437860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888128,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":510044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280586,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476816,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":510598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40416,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704736,"statfs":{"total":95995035648,"available":95953649664,"internally_reserved":0,"allocated":933888,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":74504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":73950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":73816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:39:09.074 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:39:09.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:08 smithi171 ceph-mon[35803]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:09.119 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:09.648 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:09 smithi042 ceph-mon[31223]: pgmap v332: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-09-19T09:39:09.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.617+0000 7f7b8758a640 1 -- 172.21.15.42:0/2321638873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b80102570 msgr2=0x7f7b801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:09.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.617+0000 7f7b8758a640 1 --2- 172.21.15.42:0/2321638873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b80102570 0x7f7b801029b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009ca0 tx=0x7f7b7402a950 comp rx=0 tx=0).stop 2024-09-19T09:39:09.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.617+0000 7f7b8758a640 1 -- 172.21.15.42:0/2321638873 shutdown_connections 2024-09-19T09:39:09.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.617+0000 7f7b8758a640 1 --2- 172.21.15.42:0/2321638873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b80102ef0 0x7f7b8010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.617+0000 7f7b8758a640 1 --2- 172.21.15.42:0/2321638873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b80102570 0x7f7b801029b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.617+0000 7f7b8758a640 1 --2- 172.21.15.42:0/2321638873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b80100e20 0x7f7b80101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.617+0000 7f7b8758a640 1 -- 172.21.15.42:0/2321638873 >> 172.21.15.42:0/2321638873 conn(0x7f7b800fc7d0 msgr2=0x7f7b800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:09.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.617+0000 7f7b8758a640 1 -- 172.21.15.42:0/2321638873 shutdown_connections 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.617+0000 7f7b8758a640 1 -- 172.21.15.42:0/2321638873 wait complete. 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b8758a640 1 Processor -- start 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b8758a640 1 -- start start 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b8758a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b80100e20 0x7f7b800fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b8758a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b80102570 0x7f7b800fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b8758a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b80102ef0 0x7f7b800fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b8758a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7b80111020 con 0x7f7b80100e20 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b8758a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7b80110ea0 con 0x7f7b80102570 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b8758a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7b801111a0 con 0x7f7b80102ef0 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b85326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b80100e20 0x7f7b800fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b85326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b80100e20 0x7f7b800fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47690/0 (socket says 172.21.15.42:47690) 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b85326640 1 -- 172.21.15.42:0/209649405 learned_addr learned my addr 172.21.15.42:0/209649405 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:09.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b84b25640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b80102570 0x7f7b800fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b85b27640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b80102ef0 0x7f7b800fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b85326640 1 -- 172.21.15.42:0/209649405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b80102ef0 msgr2=0x7f7b800fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b85326640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b80102ef0 0x7f7b800fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b85326640 1 -- 172.21.15.42:0/209649405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b80102570 msgr2=0x7f7b800fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b85326640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b80102570 0x7f7b800fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.618+0000 7f7b85326640 1 -- 172.21.15.42:0/209649405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b801a6bd0 con 0x7f7b80100e20 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.619+0000 7f7b85326640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b80100e20 0x7f7b800fcc80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000b4a0 tx=0x7f7b7000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.620+0000 7f7b7e7fc640 1 -- 172.21.15.42:0/209649405 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70014070 con 0x7f7b80100e20 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.620+0000 7f7b7e7fc640 1 -- 172.21.15.42:0/209649405 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b70010af0 con 0x7f7b80100e20 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.620+0000 7f7b7e7fc640 1 -- 172.21.15.42:0/209649405 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70017d10 con 0x7f7b80100e20 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.620+0000 7f7b8758a640 1 -- 172.21.15.42:0/209649405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b801a6ec0 con 0x7f7b80100e20 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.620+0000 7f7b8758a640 1 -- 172.21.15.42:0/209649405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b801a7320 con 0x7f7b80100e20 2024-09-19T09:39:09.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.622+0000 7f7b7e7fc640 1 -- 172.21.15.42:0/209649405 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f7b70017070 con 0x7f7b80100e20 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b89963740 1 Processor -- start 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b89963740 1 -- start start 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b89963740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add72704a0 0x55add7270880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b89963740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add727b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b89963740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add727b680 0x55add727da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b89963740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55add71d62e0 con 0x55add7270dc0 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b89963740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55add717dce0 con 0x55add72704a0 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b89963740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55add71d22a0 con 0x55add727b680 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b85326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add727b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b85326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add727b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47692/0 (socket says 172.21.15.42:47692) 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b85326640 1 -- 172.21.15.42:0/2288300241 learned_addr learned my addr 172.21.15.42:0/2288300241 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b7e7fc640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7b680a32d0 0x7f7b680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b84b25640 1 --2- 172.21.15.42:0/2288300241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add727b680 0x55add727da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.623+0000 7f7b85b27640 1 --2- 172.21.15.42:0/2288300241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add72704a0 0x55add7270880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b85b27640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7b680a32d0 0x7f7b680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b7e7fc640 1 -- 172.21.15.42:0/209649405 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7b700ced60 con 0x7f7b80100e20 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b85326640 1 -- 172.21.15.42:0/2288300241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add727b680 msgr2=0x55add727da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b85326640 1 --2- 172.21.15.42:0/2288300241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add727b680 0x55add727da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b85326640 1 -- 172.21.15.42:0/2288300241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add72704a0 msgr2=0x55add7270880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b85326640 1 --2- 172.21.15.42:0/2288300241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add72704a0 0x55add7270880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b85326640 1 -- 172.21.15.42:0/2288300241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55add7162440 con 0x55add7270dc0 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b85326640 1 --2- 172.21.15.42:0/2288300241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add727b140 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7b700cc6e0 tx=0x7f7b700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881b9aeef8456d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b85b27640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7b680a32d0 0x7f7b680a5790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7b78017700 tx=0x7f7b780090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b677fe640 1 -- 172.21.15.42:0/2288300241 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7001e070 con 0x55add7270dc0 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b677fe640 1 -- 172.21.15.42:0/2288300241 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b7009f660 con 0x55add7270dc0 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.624+0000 7f7b677fe640 1 -- 172.21.15.42:0/2288300241 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b700cc8e0 con 0x55add7270dc0 2024-09-19T09:39:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.625+0000 7f7b89963740 1 -- 172.21.15.42:0/2288300241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 msgr2=0x55add727b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.625+0000 7f7b89963740 1 --2- 172.21.15.42:0/2288300241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add727b140 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7b700cc6e0 tx=0x7f7b700046c0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.625+0000 7f7b89963740 1 -- 172.21.15.42:0/2288300241 shutdown_connections 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.625+0000 7f7b89963740 1 --2- 172.21.15.42:0/2288300241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add727b680 0x55add727da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.625+0000 7f7b89963740 1 --2- 172.21.15.42:0/2288300241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add727b140 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.625+0000 7f7b89963740 1 --2- 172.21.15.42:0/2288300241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add72704a0 0x55add7270880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.625+0000 7f7b89963740 1 -- 172.21.15.42:0/2288300241 >> 172.21.15.42:0/2288300241 conn(0x55add726ca30 msgr2=0x55add726ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.625+0000 7f7b89963740 1 -- 172.21.15.42:0/2288300241 shutdown_connections 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.625+0000 7f7b89963740 1 -- 172.21.15.42:0/2288300241 wait complete. 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.625+0000 7f7b89963740 1 -- start start 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b89963740 1 Processor -- start 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b89963740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add727afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b89963740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add7270dc0 0x55add7278290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b89963740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 0x55add72787f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b89963740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55add727e250 con 0x55add72704a0 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b89963740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55add7191050 con 0x55add727b680 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b89963740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55add727e3d0 con 0x55add7270dc0 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b89963740 10 client.0 _ll_register_callbacks cb 0x55add71d1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add727afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add727afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47708/0 (socket says 172.21.15.42:47708) 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85326640 1 -- 172.21.15.42:0/1268174840 learned_addr learned my addr 172.21.15.42:0/1268174840 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b84b25640 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add7270dc0 0x55add7278290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85b27640 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 0x55add72787f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85326640 1 -- 172.21.15.42:0/1268174840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add7270dc0 msgr2=0x55add7278290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85326640 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add7270dc0 0x55add7278290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85326640 1 -- 172.21.15.42:0/1268174840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 msgr2=0x55add72787f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85326640 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 0x55add72787f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85326640 1 -- 172.21.15.42:0/1268174840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55add6f473c0 con 0x55add72704a0 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85b27640 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 0x55add72787f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.626+0000 7f7b85326640 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add727afe0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7b700977c0 tx=0x7f7b70017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b228db3467fdfe9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b64ff9640 1 -- 172.21.15.42:0/1268174840 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7001e050 con 0x55add72704a0 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b64ff9640 1 -- 172.21.15.42:0/1268174840 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7b700979d0 con 0x55add72704a0 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b89963740 1 -- 172.21.15.42:0/1268174840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b7009f660 con 0x55add72704a0 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b64ff9640 1 -- 172.21.15.42:0/1268174840 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7b700cc8e0 con 0x55add72704a0 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b89963740 10 client.15336 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b89963740 1 -- 172.21.15.42:0/1268174840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55add727e250 con 0x55add72704a0 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b64ff9640 1 -- 172.21.15.42:0/1268174840 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b7009f660 con 0x55add72704a0 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b64ff9640 1 -- 172.21.15.42:0/1268174840 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7b7009a7b0 con 0x55add72704a0 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b89963740 10 client.15336 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:09.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b89963740 10 client.15336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b89963740 20 client.15336 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b89963740 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55add728ada0 0x55add728d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b89963740 4 client.15336 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.627+0000 7f7b89963740 1 -- 172.21.15.42:0/1268174840 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55add71e3850 con 0x55add728ada0 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.628+0000 7f7b84b25640 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55add728ada0 0x55add728d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.628+0000 7f7b84b25640 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55add728ada0 0x55add728d190 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a389ea3cd8bd5fed server_cookie=6407dc69701161d9 in_seq=0 out_seq=0 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.628+0000 7f7b64ff9640 10 client.15336 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b64ff9640 1 -- 172.21.15.42:0/1268174840 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55add71e3850 con 0x55add728ada0 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b64ff9640 10 client.15336 handle_command_reply: tid=0 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 client.15336 shutdown 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 -- 172.21.15.42:0/1268174840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 msgr2=0x55add727afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add727afe0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7b700977c0 tx=0x7f7b70017730 comp rx=0 tx=0).stop 2024-09-19T09:39:09.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 -- 172.21.15.42:0/1268174840 shutdown_connections 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55add728ada0 0x55add728d190 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 0x55add72787f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b64ff9640 0 client.15336 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add7270dc0 0x55add7278290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 --2- 172.21.15.42:0/1268174840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add727afe0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 -- 172.21.15.42:0/1268174840 >> 172.21.15.42:0/1268174840 conn(0x55add726ca30 msgr2=0x55add7272760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 -- 172.21.15.42:0/1268174840 shutdown_connections 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 1 -- 172.21.15.42:0/1268174840 wait complete. 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.629+0000 7f7b89963740 20 client.15336 trim_cache size 0 max 16384 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.646+0000 7f7b89963740 1 Processor -- start 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.646+0000 7f7b89963740 1 -- start start 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b89963740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add72704a0 0x55add72874b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b89963740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add72928d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b89963740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 0x55add7292e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b89963740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7b801afa10 con 0x55add7270dc0 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b89963740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7b801b1550 con 0x55add727b680 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b89963740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7b801b00e0 con 0x55add72704a0 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b84b25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add72928d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b84b25640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add72928d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47710/0 (socket says 172.21.15.42:47710) 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b84b25640 1 -- 172.21.15.42:0/667907679 learned_addr learned my addr 172.21.15.42:0/667907679 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b85b27640 1 --2- 172.21.15.42:0/667907679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 0x55add7292e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b85326640 1 --2- 172.21.15.42:0/667907679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add72704a0 0x55add72874b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b84b25640 1 -- 172.21.15.42:0/667907679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add72704a0 msgr2=0x55add72874b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b84b25640 1 --2- 172.21.15.42:0/667907679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add72704a0 0x55add72874b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b84b25640 1 -- 172.21.15.42:0/667907679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 msgr2=0x55add7292e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b84b25640 1 --2- 172.21.15.42:0/667907679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 0x55add7292e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b84b25640 1 -- 172.21.15.42:0/667907679 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55add7278b60 con 0x55add7270dc0 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b85326640 1 --2- 172.21.15.42:0/667907679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add72704a0 0x55add72874b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b84b25640 1 --2- 172.21.15.42:0/667907679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add72928d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009ca0 tx=0x7f7b7402fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48bdc98a2538a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.647+0000 7f7b66ffd640 1 -- 172.21.15.42:0/667907679 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74034040 con 0x55add7270dc0 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b66ffd640 1 -- 172.21.15.42:0/667907679 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b7404b070 con 0x55add7270dc0 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b66ffd640 1 -- 172.21.15.42:0/667907679 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b740046e0 con 0x55add7270dc0 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b89963740 1 -- 172.21.15.42:0/667907679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 msgr2=0x55add72928d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b89963740 1 --2- 172.21.15.42:0/667907679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add72928d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009ca0 tx=0x7f7b7402fcf0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b89963740 1 -- 172.21.15.42:0/667907679 shutdown_connections 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b89963740 1 --2- 172.21.15.42:0/667907679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add727b680 0x55add7292e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b89963740 1 --2- 172.21.15.42:0/667907679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add7270dc0 0x55add72928d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b89963740 1 --2- 172.21.15.42:0/667907679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add72704a0 0x55add72874b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b89963740 1 -- 172.21.15.42:0/667907679 >> 172.21.15.42:0/667907679 conn(0x55add726ca30 msgr2=0x55add7277250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b89963740 1 -- 172.21.15.42:0/667907679 shutdown_connections 2024-09-19T09:39:09.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.648+0000 7f7b89963740 1 -- 172.21.15.42:0/667907679 wait complete. 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b89963740 1 -- start start 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b89963740 1 Processor -- start 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b89963740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add7283bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b89963740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add7270dc0 0x55add7280f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b89963740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add727b680 0x55add7281460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b89963740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7b801b0e80 con 0x55add72704a0 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b89963740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7b801b07b0 con 0x55add7270dc0 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b89963740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7b801ad9f0 con 0x55add727b680 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b89963740 10 client.0 _ll_register_callbacks cb 0x7f7b78009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b85326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add7283bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b85326640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add7283bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47716/0 (socket says 172.21.15.42:47716) 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b85326640 1 -- 172.21.15.42:0/3073647409 learned_addr learned my addr 172.21.15.42:0/3073647409 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b84b25640 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add7270dc0 0x55add7280f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b85326640 1 -- 172.21.15.42:0/3073647409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add727b680 msgr2=0x55add7281460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b85326640 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add727b680 0x55add7281460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b85326640 1 -- 172.21.15.42:0/3073647409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add7270dc0 msgr2=0x55add7280f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b85326640 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add7270dc0 0x55add7280f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.649+0000 7f7b85326640 1 -- 172.21.15.42:0/3073647409 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55add7281ad0 con 0x55add72704a0 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b85326640 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add7283bd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7b7009abd0 tx=0x7f7b70017570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32eedb8573617ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b64ff9640 1 -- 172.21.15.42:0/3073647409 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7001e070 con 0x55add72704a0 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b64ff9640 1 -- 172.21.15.42:0/3073647409 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7b7009a7b0 con 0x55add72704a0 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b89963740 1 -- 172.21.15.42:0/3073647409 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b7404b070 con 0x55add72704a0 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b64ff9640 1 -- 172.21.15.42:0/3073647409 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7b70097600 con 0x55add72704a0 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b89963740 10 client.15342 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b89963740 1 -- 172.21.15.42:0/3073647409 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55add72f5730 con 0x55add72704a0 2024-09-19T09:39:09.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b64ff9640 1 -- 172.21.15.42:0/3073647409 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b7404b070 con 0x55add72704a0 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b64ff9640 1 -- 172.21.15.42:0/3073647409 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7b700970b0 con 0x55add72704a0 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b89963740 10 client.15342 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b89963740 10 client.15342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b89963740 20 client.15342 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b89963740 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55add72f5bb0 0x55add72f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b89963740 4 client.15342 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.650+0000 7f7b89963740 1 -- 172.21.15.42:0/3073647409 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55add71ddd60 con 0x55add72f5bb0 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.651+0000 7f7b84b25640 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55add72f5bb0 0x55add72f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.651+0000 7f7b84b25640 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55add72f5bb0 0x55add72f7fa0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a5ab580691a8b83 server_cookie=2f8bd72d4d892fb9 in_seq=0 out_seq=0 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.651+0000 7f7b64ff9640 10 client.15342 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.651+0000 7f7b64ff9640 1 -- 172.21.15.42:0/3073647409 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55add71ddd60 con 0x55add72f5bb0 2024-09-19T09:39:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.651+0000 7f7b64ff9640 10 client.15342 handle_command_reply: tid=0 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.651+0000 7f7b89963740 1 client.15342 shutdown 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.651+0000 7f7b89963740 1 -- 172.21.15.42:0/3073647409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 msgr2=0x55add7283bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.651+0000 7f7b89963740 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add7283bd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7b7009abd0 tx=0x7f7b70017570 comp rx=0 tx=0).stop 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b89963740 1 -- 172.21.15.42:0/3073647409 shutdown_connections 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b89963740 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55add72f5bb0 0x55add72f7fa0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b89963740 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55add727b680 0x55add7281460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b89963740 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55add7270dc0 0x55add7280f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b64ff9640 0 client.15342 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b89963740 1 --2- 172.21.15.42:0/3073647409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55add72704a0 0x55add7283bd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b89963740 1 -- 172.21.15.42:0/3073647409 >> 172.21.15.42:0/3073647409 conn(0x55add726ca30 msgr2=0x55add726b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:09.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b89963740 1 -- 172.21.15.42:0/3073647409 shutdown_connections 2024-09-19T09:39:09.682 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:39:09.682 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:39:09.682 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-19T09:39:09.682 INFO:teuthology.orchestra.run.smithi042.stdout: "8be96a11-dbfa-4ee8-84c9-aee3dd977d51": { 2024-09-19T09:39:09.682 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-19T09:39:09.682 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "8be96a11-dbfa-4ee8-84c9-aee3dd977d51", 2024-09-19T09:39:09.682 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-09-19T09:39:09.682 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:09.682 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:09.683 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:39:09.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b89963740 1 -- 172.21.15.42:0/3073647409 wait complete. 2024-09-19T09:39:09.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b89963740 20 client.15342 trim_cache size 0 max 16384 2024-09-19T09:39:09.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b8758a640 1 -- 172.21.15.42:0/209649405 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7b680a32d0 msgr2=0x7f7b680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:09.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b8758a640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7b680a32d0 0x7f7b680a5790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7b78017700 tx=0x7f7b780090e0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b8758a640 1 -- 172.21.15.42:0/209649405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b80100e20 msgr2=0x7f7b800fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b8758a640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b80100e20 0x7f7b800fcc80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000b4a0 tx=0x7f7b7000b960 comp rx=0 tx=0).stop 2024-09-19T09:39:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b8758a640 1 -- 172.21.15.42:0/209649405 shutdown_connections 2024-09-19T09:39:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b8758a640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7b680a32d0 0x7f7b680a5790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b8758a640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b80102ef0 0x7f7b800fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b8758a640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b80102570 0x7f7b800fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b8758a640 1 --2- 172.21.15.42:0/209649405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b80100e20 0x7f7b800fcc80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.652+0000 7f7b8758a640 1 -- 172.21.15.42:0/209649405 >> 172.21.15.42:0/209649405 conn(0x7f7b800fc7d0 msgr2=0x7f7b8006a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.653+0000 7f7b8758a640 1 -- 172.21.15.42:0/209649405 shutdown_connections 2024-09-19T09:39:09.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:09.653+0000 7f7b8758a640 1 -- 172.21.15.42:0/209649405 wait complete. 2024-09-19T09:39:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:09 smithi136 ceph-mon[34840]: pgmap v332: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-09-19T09:39:09.984 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:10.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:09 smithi171 ceph-mon[35803]: pgmap v332: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-09-19T09:39:10.642 INFO:tasks.cephfs.filesystem:scrub status for tag:8be96a11-dbfa-4ee8-84c9-aee3dd977d51 - {'path': '/', 'tag': '8be96a11-dbfa-4ee8-84c9-aee3dd977d51', 'options': 'recursive,force'} 2024-09-19T09:39:10.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.827+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1369305316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f44101430 msgr2=0x7f9f4410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.827+0000 7f9f4a3d9640 1 --2- 172.21.15.42:0/1369305316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f44101430 0x7f9f4410d960 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009cd0 tx=0x7f9f3c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:39:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.827+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1369305316 shutdown_connections 2024-09-19T09:39:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.827+0000 7f9f4a3d9640 1 --2- 172.21.15.42:0/1369305316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f44101430 0x7f9f4410d960 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.827+0000 7f9f4a3d9640 1 --2- 172.21.15.42:0/1369305316 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f44100a90 0x7f9f44100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.827+0000 7f9f4a3d9640 1 --2- 172.21.15.42:0/1369305316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f44106a90 0x7f9f44106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.827+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1369305316 >> 172.21.15.42:0/1369305316 conn(0x7f9f440fc7d0 msgr2=0x7f9f440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.827+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1369305316 shutdown_connections 2024-09-19T09:39:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.827+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1369305316 wait complete. 2024-09-19T09:39:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f4a3d9640 1 Processor -- start 2024-09-19T09:39:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f4a3d9640 1 -- start start 2024-09-19T09:39:10.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f4a3d9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f44100a90 0x7f9f44102660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:10.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f4a3d9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f44101430 0x7f9f44102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:10.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f4a3d9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f44106a90 0x7f9f441030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:10.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f4a3d9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9f44110e90 con 0x7f9f44106a90 2024-09-19T09:39:10.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f4a3d9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9f44110d10 con 0x7f9f44101430 2024-09-19T09:39:10.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f4a3d9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f44111010 con 0x7f9f44100a90 2024-09-19T09:39:10.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f48976640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f44106a90 0x7f9f441030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:10.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f48976640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f44106a90 0x7f9f441030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59378/0 (socket says 172.21.15.42:59378) 2024-09-19T09:39:10.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f48976640 1 -- 172.21.15.42:0/1594213137 learned_addr learned my addr 172.21.15.42:0/1594213137 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:10.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f43fff640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f44100a90 0x7f9f44102660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:10.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f3bfff640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f44101430 0x7f9f44102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:10.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f48976640 1 -- 172.21.15.42:0/1594213137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f44100a90 msgr2=0x7f9f44102660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:10.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f48976640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f44100a90 0x7f9f44102660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:10.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f48976640 1 -- 172.21.15.42:0/1594213137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f44101430 msgr2=0x7f9f44102ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:10.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f48976640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f44101430 0x7f9f44102ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:10.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.828+0000 7f9f48976640 1 -- 172.21.15.42:0/1594213137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f441a68d0 con 0x7f9f44106a90 2024-09-19T09:39:10.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.829+0000 7f9f48976640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f44106a90 0x7f9f441030e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c005cc0 tx=0x7f9f3c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:10.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.829+0000 7f9f41ffb640 1 -- 172.21.15.42:0/1594213137 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c004040 con 0x7f9f44106a90 2024-09-19T09:39:10.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.829+0000 7f9f41ffb640 1 -- 172.21.15.42:0/1594213137 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f3c0046c0 con 0x7f9f44106a90 2024-09-19T09:39:10.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.829+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1594213137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f441a6b60 con 0x7f9f44106a90 2024-09-19T09:39:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.829+0000 7f9f41ffb640 1 -- 172.21.15.42:0/1594213137 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c046480 con 0x7f9f44106a90 2024-09-19T09:39:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.829+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1594213137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f441a70a0 con 0x7f9f44106a90 2024-09-19T09:39:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.830+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1594213137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f44100ef0 con 0x7f9f44106a90 2024-09-19T09:39:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.831+0000 7f9f41ffb640 1 -- 172.21.15.42:0/1594213137 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f9f3c0305a0 con 0x7f9f44106a90 2024-09-19T09:39:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.832+0000 7f9f41ffb640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9f300a32d0 0x7f9f300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.832+0000 7f9f41ffb640 1 -- 172.21.15.42:0/1594213137 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f9f3c02e030 con 0x7f9f44106a90 2024-09-19T09:39:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.832+0000 7f9f43fff640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9f300a32d0 0x7f9f300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.832+0000 7f9f43fff640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9f300a32d0 0x7f9f300a5790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9f34005e00 tx=0x7f9f34005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:10.836+0000 7f9f41ffb640 1 -- 172.21.15.42:0/1594213137 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9f3c04b060 con 0x7f9f44106a90 2024-09-19T09:39:11.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.014+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1594213137 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f4406af00 con 0x7f9f300a32d0 2024-09-19T09:39:11.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.021+0000 7f9f41ffb640 1 -- 172.21.15.42:0/1594213137 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258906 (secure 0 0 0) 0x7f9f4406af00 con 0x7f9f300a32d0 2024-09-19T09:39:11.025 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:11.026 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-19T09:39:11.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.024+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1594213137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9f300a32d0 msgr2=0x7f9f300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:11.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.024+0000 7f9f4a3d9640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9f300a32d0 0x7f9f300a5790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9f34005e00 tx=0x7f9f34005c50 comp rx=0 tx=0).stop 2024-09-19T09:39:11.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.024+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1594213137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f44106a90 msgr2=0x7f9f441030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:11.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.024+0000 7f9f4a3d9640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f44106a90 0x7f9f441030e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c005cc0 tx=0x7f9f3c003970 comp rx=0 tx=0).stop 2024-09-19T09:39:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.024+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1594213137 shutdown_connections 2024-09-19T09:39:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.024+0000 7f9f4a3d9640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9f300a32d0 0x7f9f300a5790 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.024+0000 7f9f4a3d9640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f44106a90 0x7f9f441030e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.024+0000 7f9f4a3d9640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f44101430 0x7f9f44102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.024+0000 7f9f4a3d9640 1 --2- 172.21.15.42:0/1594213137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f44100a90 0x7f9f44102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.024+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1594213137 >> 172.21.15.42:0/1594213137 conn(0x7f9f440fc7d0 msgr2=0x7f9f4406a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.025+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1594213137 shutdown_connections 2024-09-19T09:39:11.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:11.025+0000 7f9f4a3d9640 1 -- 172.21.15.42:0/1594213137 wait complete. 2024-09-19T09:39:11.781 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-19T09:39:10.527842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":670031,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1219,"num_read_kb":744,"num_write":448,"num_write_kb":3100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":1209642,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382864,"kb_used_data":12816,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558960,"statfs":{"total":1151940427776,"available":1151548375040,"internally_reserved":0,"allocated":13123584,"data_stored":7243221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9354,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":70,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002786"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514653+0000","last_change":"2024-09-19T09:37:10.964695+0000","last_active":"2024-09-19T09:38:56.514653+0000","last_peered":"2024-09-19T09:38:56.514653+0000","last_clean":"2024-09-19T09:38:56.514653+0000","last_became_active":"2024-09-19T09:37:10.964343+0000","last_became_peered":"2024-09-19T09:37:10.964343+0000","last_unstale":"2024-09-19T09:38:56.514653+0000","last_undegraded":"2024-09-19T09:38:56.514653+0000","last_fullsized":"2024-09-19T09:38:56.514653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:44.224621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.493324+0000","last_change":"2024-09-19T09:37:10.964163+0000","last_active":"2024-09-19T09:38:56.493324+0000","last_peered":"2024-09-19T09:38:56.493324+0000","last_clean":"2024-09-19T09:38:56.493324+0000","last_became_active":"2024-09-19T09:37:10.963758+0000","last_became_peered":"2024-09-19T09:37:10.963758+0000","last_unstale":"2024-09-19T09:38:56.493324+0000","last_undegraded":"2024-09-19T09:38:56.493324+0000","last_fullsized":"2024-09-19T09:38:56.493324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:49.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508867+0000","last_change":"2024-09-19T09:37:10.958145+0000","last_active":"2024-09-19T09:38:56.508867+0000","last_peered":"2024-09-19T09:38:56.508867+0000","last_clean":"2024-09-19T09:38:56.508867+0000","last_became_active":"2024-09-19T09:37:10.957666+0000","last_became_peered":"2024-09-19T09:37:10.957666+0000","last_unstale":"2024-09-19T09:38:56.508867+0000","last_undegraded":"2024-09-19T09:38:56.508867+0000","last_fullsized":"2024-09-19T09:38:56.508867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.479753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492252+0000","last_change":"2024-09-19T09:37:28.021681+0000","last_active":"2024-09-19T09:38:56.492252+0000","last_peered":"2024-09-19T09:38:56.492252+0000","last_clean":"2024-09-19T09:38:56.492252+0000","last_became_active":"2024-09-19T09:37:28.021294+0000","last_became_peered":"2024-09-19T09:37:28.021294+0000","last_unstale":"2024-09-19T09:38:56.492252+0000","last_undegraded":"2024-09-19T09:38:56.492252+0000","last_fullsized":"2024-09-19T09:38:56.492252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:36.535707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503476+0000","last_change":"2024-09-19T09:37:10.957138+0000","last_active":"2024-09-19T09:38:56.503476+0000","last_peered":"2024-09-19T09:38:56.503476+0000","last_clean":"2024-09-19T09:38:56.503476+0000","last_became_active":"2024-09-19T09:37:10.956824+0000","last_became_peered":"2024-09-19T09:37:10.956824+0000","last_unstale":"2024-09-19T09:38:56.503476+0000","last_undegraded":"2024-09-19T09:38:56.503476+0000","last_fullsized":"2024-09-19T09:38:56.503476+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.919747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510565+0000","last_change":"2024-09-19T09:37:10.969804+0000","last_active":"2024-09-19T09:38:56.510565+0000","last_peered":"2024-09-19T09:38:56.510565+0000","last_clean":"2024-09-19T09:38:56.510565+0000","last_became_active":"2024-09-19T09:37:10.969454+0000","last_became_peered":"2024-09-19T09:37:10.969454+0000","last_unstale":"2024-09-19T09:38:56.510565+0000","last_undegraded":"2024-09-19T09:38:56.510565+0000","last_fullsized":"2024-09-19T09:38:56.510565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:14.856255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503058+0000","last_change":"2024-09-19T09:37:10.962853+0000","last_active":"2024-09-19T09:38:56.503058+0000","last_peered":"2024-09-19T09:38:56.503058+0000","last_clean":"2024-09-19T09:38:56.503058+0000","last_became_active":"2024-09-19T09:37:10.961207+0000","last_became_peered":"2024-09-19T09:37:10.961207+0000","last_unstale":"2024-09-19T09:38:56.503058+0000","last_undegraded":"2024-09-19T09:38:56.503058+0000","last_fullsized":"2024-09-19T09:38:56.503058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511634+0000","last_change":"2024-09-19T09:37:10.970216+0000","last_active":"2024-09-19T09:38:56.511634+0000","last_peered":"2024-09-19T09:38:56.511634+0000","last_clean":"2024-09-19T09:38:56.511634+0000","last_became_active":"2024-09-19T09:37:10.969486+0000","last_became_peered":"2024-09-19T09:37:10.969486+0000","last_unstale":"2024-09-19T09:38:56.511634+0000","last_undegraded":"2024-09-19T09:38:56.511634+0000","last_fullsized":"2024-09-19T09:38:56.511634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:56.859228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515236+0000","last_change":"2024-09-19T09:37:10.962596+0000","last_active":"2024-09-19T09:38:56.515236+0000","last_peered":"2024-09-19T09:38:56.515236+0000","last_clean":"2024-09-19T09:38:56.515236+0000","last_became_active":"2024-09-19T09:37:10.962230+0000","last_became_peered":"2024-09-19T09:37:10.962230+0000","last_unstale":"2024-09-19T09:38:56.515236+0000","last_undegraded":"2024-09-19T09:38:56.515236+0000","last_fullsized":"2024-09-19T09:38:56.515236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:07.810793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510890+0000","last_change":"2024-09-19T09:37:10.962186+0000","last_active":"2024-09-19T09:38:56.510890+0000","last_peered":"2024-09-19T09:38:56.510890+0000","last_clean":"2024-09-19T09:38:56.510890+0000","last_became_active":"2024-09-19T09:37:10.961845+0000","last_became_peered":"2024-09-19T09:37:10.961845+0000","last_unstale":"2024-09-19T09:38:56.510890+0000","last_undegraded":"2024-09-19T09:38:56.510890+0000","last_fullsized":"2024-09-19T09:38:56.510890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:24.150103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512962+0000","last_change":"2024-09-19T09:37:10.958763+0000","last_active":"2024-09-19T09:38:56.512962+0000","last_peered":"2024-09-19T09:38:56.512962+0000","last_clean":"2024-09-19T09:38:56.512962+0000","last_became_active":"2024-09-19T09:37:10.958397+0000","last_became_peered":"2024-09-19T09:37:10.958397+0000","last_unstale":"2024-09-19T09:38:56.512962+0000","last_undegraded":"2024-09-19T09:38:56.512962+0000","last_fullsized":"2024-09-19T09:38:56.512962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:37.690594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.505751+0000","last_change":"2024-09-19T09:37:10.964787+0000","last_active":"2024-09-19T09:38:56.505751+0000","last_peered":"2024-09-19T09:38:56.505751+0000","last_clean":"2024-09-19T09:38:56.505751+0000","last_became_active":"2024-09-19T09:37:10.964121+0000","last_became_peered":"2024-09-19T09:37:10.964121+0000","last_unstale":"2024-09-19T09:38:56.505751+0000","last_undegraded":"2024-09-19T09:38:56.505751+0000","last_fullsized":"2024-09-19T09:38:56.505751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:02.456961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507798+0000","last_change":"2024-09-19T09:37:10.963290+0000","last_active":"2024-09-19T09:38:56.507798+0000","last_peered":"2024-09-19T09:38:56.507798+0000","last_clean":"2024-09-19T09:38:56.507798+0000","last_became_active":"2024-09-19T09:37:10.962961+0000","last_became_peered":"2024-09-19T09:37:10.962961+0000","last_unstale":"2024-09-19T09:38:56.507798+0000","last_undegraded":"2024-09-19T09:38:56.507798+0000","last_fullsized":"2024-09-19T09:38:56.507798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.266745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510553+0000","last_change":"2024-09-19T09:37:10.969742+0000","last_active":"2024-09-19T09:38:56.510553+0000","last_peered":"2024-09-19T09:38:56.510553+0000","last_clean":"2024-09-19T09:38:56.510553+0000","last_became_active":"2024-09-19T09:37:10.969399+0000","last_became_peered":"2024-09-19T09:37:10.969399+0000","last_unstale":"2024-09-19T09:38:56.510553+0000","last_undegraded":"2024-09-19T09:38:56.510553+0000","last_fullsized":"2024-09-19T09:38:56.510553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.386596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504556+0000","last_change":"2024-09-19T09:37:10.962406+0000","last_active":"2024-09-19T09:38:56.504556+0000","last_peered":"2024-09-19T09:38:56.504556+0000","last_clean":"2024-09-19T09:38:56.504556+0000","last_became_active":"2024-09-19T09:37:10.962130+0000","last_became_peered":"2024-09-19T09:37:10.962130+0000","last_unstale":"2024-09-19T09:38:56.504556+0000","last_undegraded":"2024-09-19T09:38:56.504556+0000","last_fullsized":"2024-09-19T09:38:56.504556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516451+0000","last_change":"2024-09-19T09:37:10.958465+0000","last_active":"2024-09-19T09:38:56.516451+0000","last_peered":"2024-09-19T09:38:56.516451+0000","last_clean":"2024-09-19T09:38:56.516451+0000","last_became_active":"2024-09-19T09:37:10.957600+0000","last_became_peered":"2024-09-19T09:37:10.957600+0000","last_unstale":"2024-09-19T09:38:56.516451+0000","last_undegraded":"2024-09-19T09:38:56.516451+0000","last_fullsized":"2024-09-19T09:38:56.516451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:39.232483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515449+0000","last_change":"2024-09-19T09:37:10.965463+0000","last_active":"2024-09-19T09:38:56.515449+0000","last_peered":"2024-09-19T09:38:56.515449+0000","last_clean":"2024-09-19T09:38:56.515449+0000","last_became_active":"2024-09-19T09:37:10.965137+0000","last_became_peered":"2024-09-19T09:37:10.965137+0000","last_unstale":"2024-09-19T09:38:56.515449+0000","last_undegraded":"2024-09-19T09:38:56.515449+0000","last_fullsized":"2024-09-19T09:38:56.515449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:19.582515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512633+0000","last_change":"2024-09-19T09:37:10.964897+0000","last_active":"2024-09-19T09:38:56.512633+0000","last_peered":"2024-09-19T09:38:56.512633+0000","last_clean":"2024-09-19T09:38:56.512633+0000","last_became_active":"2024-09-19T09:37:10.964527+0000","last_became_peered":"2024-09-19T09:37:10.964527+0000","last_unstale":"2024-09-19T09:38:56.512633+0000","last_undegraded":"2024-09-19T09:38:56.512633+0000","last_fullsized":"2024-09-19T09:38:56.512633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:29.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507468+0000","last_change":"2024-09-19T09:37:10.953645+0000","last_active":"2024-09-19T09:38:56.507468+0000","last_peered":"2024-09-19T09:38:56.507468+0000","last_clean":"2024-09-19T09:38:56.507468+0000","last_became_active":"2024-09-19T09:37:10.953326+0000","last_became_peered":"2024-09-19T09:37:10.953326+0000","last_unstale":"2024-09-19T09:38:56.507468+0000","last_undegraded":"2024-09-19T09:38:56.507468+0000","last_fullsized":"2024-09-19T09:38:56.507468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.644615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506388+0000","last_change":"2024-09-19T09:37:10.961384+0000","last_active":"2024-09-19T09:38:56.506388+0000","last_peered":"2024-09-19T09:38:56.506388+0000","last_clean":"2024-09-19T09:38:56.506388+0000","last_became_active":"2024-09-19T09:37:10.961038+0000","last_became_peered":"2024-09-19T09:37:10.961038+0000","last_unstale":"2024-09-19T09:38:56.506388+0000","last_undegraded":"2024-09-19T09:38:56.506388+0000","last_fullsized":"2024-09-19T09:38:56.506388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:54.876799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506443+0000","last_change":"2024-09-19T09:37:10.955789+0000","last_active":"2024-09-19T09:38:56.506443+0000","last_peered":"2024-09-19T09:38:56.506443+0000","last_clean":"2024-09-19T09:38:56.506443+0000","last_became_active":"2024-09-19T09:37:10.955447+0000","last_became_peered":"2024-09-19T09:37:10.955447+0000","last_unstale":"2024-09-19T09:38:56.506443+0000","last_undegraded":"2024-09-19T09:38:56.506443+0000","last_fullsized":"2024-09-19T09:38:56.506443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:28.512069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516852+0000","last_change":"2024-09-19T09:37:10.956501+0000","last_active":"2024-09-19T09:38:56.516852+0000","last_peered":"2024-09-19T09:38:56.516852+0000","last_clean":"2024-09-19T09:38:56.516852+0000","last_became_active":"2024-09-19T09:37:10.956161+0000","last_became_peered":"2024-09-19T09:37:10.956161+0000","last_unstale":"2024-09-19T09:38:56.516852+0000","last_undegraded":"2024-09-19T09:38:56.516852+0000","last_fullsized":"2024-09-19T09:38:56.516852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:31.738143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510649+0000","last_change":"2024-09-19T09:37:10.961486+0000","last_active":"2024-09-19T09:38:56.510649+0000","last_peered":"2024-09-19T09:38:56.510649+0000","last_clean":"2024-09-19T09:38:56.510649+0000","last_became_active":"2024-09-19T09:37:10.960877+0000","last_became_peered":"2024-09-19T09:37:10.960877+0000","last_unstale":"2024-09-19T09:38:56.510649+0000","last_undegraded":"2024-09-19T09:38:56.510649+0000","last_fullsized":"2024-09-19T09:38:56.510649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:34.889431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509905+0000","last_change":"2024-09-19T09:37:10.964400+0000","last_active":"2024-09-19T09:38:56.509905+0000","last_peered":"2024-09-19T09:38:56.509905+0000","last_clean":"2024-09-19T09:38:56.509905+0000","last_became_active":"2024-09-19T09:37:10.963394+0000","last_became_peered":"2024-09-19T09:37:10.963394+0000","last_unstale":"2024-09-19T09:38:56.509905+0000","last_undegraded":"2024-09-19T09:38:56.509905+0000","last_fullsized":"2024-09-19T09:38:56.509905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:22.185221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509856+0000","last_change":"2024-09-19T09:37:10.959661+0000","last_active":"2024-09-19T09:38:56.509856+0000","last_peered":"2024-09-19T09:38:56.509856+0000","last_clean":"2024-09-19T09:38:56.509856+0000","last_became_active":"2024-09-19T09:37:10.959371+0000","last_became_peered":"2024-09-19T09:37:10.959371+0000","last_unstale":"2024-09-19T09:38:56.509856+0000","last_undegraded":"2024-09-19T09:38:56.509856+0000","last_fullsized":"2024-09-19T09:38:56.509856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.752712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514203+0000","last_change":"2024-09-19T09:37:10.967310+0000","last_active":"2024-09-19T09:38:56.514203+0000","last_peered":"2024-09-19T09:38:56.514203+0000","last_clean":"2024-09-19T09:38:56.514203+0000","last_became_active":"2024-09-19T09:37:10.965415+0000","last_became_peered":"2024-09-19T09:37:10.965415+0000","last_unstale":"2024-09-19T09:38:56.514203+0000","last_undegraded":"2024-09-19T09:38:56.514203+0000","last_fullsized":"2024-09-19T09:38:56.514203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:16.968646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497702+0000","last_change":"2024-09-19T09:37:10.967301+0000","last_active":"2024-09-19T09:38:56.497702+0000","last_peered":"2024-09-19T09:38:56.497702+0000","last_clean":"2024-09-19T09:38:56.497702+0000","last_became_active":"2024-09-19T09:37:10.966397+0000","last_became_peered":"2024-09-19T09:37:10.966397+0000","last_unstale":"2024-09-19T09:38:56.497702+0000","last_undegraded":"2024-09-19T09:38:56.497702+0000","last_fullsized":"2024-09-19T09:38:56.497702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.621085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509302+0000","last_change":"2024-09-19T09:37:10.958069+0000","last_active":"2024-09-19T09:38:56.509302+0000","last_peered":"2024-09-19T09:38:56.509302+0000","last_clean":"2024-09-19T09:38:56.509302+0000","last_became_active":"2024-09-19T09:37:10.957670+0000","last_became_peered":"2024-09-19T09:37:10.957670+0000","last_unstale":"2024-09-19T09:38:56.509302+0000","last_undegraded":"2024-09-19T09:38:56.509302+0000","last_fullsized":"2024-09-19T09:38:56.509302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.412978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503454+0000","last_change":"2024-09-19T09:37:10.960490+0000","last_active":"2024-09-19T09:38:56.503454+0000","last_peered":"2024-09-19T09:38:56.503454+0000","last_clean":"2024-09-19T09:38:56.503454+0000","last_became_active":"2024-09-19T09:37:10.960239+0000","last_became_peered":"2024-09-19T09:37:10.960239+0000","last_unstale":"2024-09-19T09:38:56.503454+0000","last_undegraded":"2024-09-19T09:38:56.503454+0000","last_fullsized":"2024-09-19T09:38:56.503454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.384348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507069+0000","last_change":"2024-09-19T09:37:10.955930+0000","last_active":"2024-09-19T09:38:56.507069+0000","last_peered":"2024-09-19T09:38:56.507069+0000","last_clean":"2024-09-19T09:38:56.507069+0000","last_became_active":"2024-09-19T09:37:10.955605+0000","last_became_peered":"2024-09-19T09:37:10.955605+0000","last_unstale":"2024-09-19T09:38:56.507069+0000","last_undegraded":"2024-09-19T09:38:56.507069+0000","last_fullsized":"2024-09-19T09:38:56.507069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:36.033350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502819+0000","last_change":"2024-09-19T09:37:10.960467+0000","last_active":"2024-09-19T09:38:56.502819+0000","last_peered":"2024-09-19T09:38:56.502819+0000","last_clean":"2024-09-19T09:38:56.502819+0000","last_became_active":"2024-09-19T09:37:10.960082+0000","last_became_peered":"2024-09-19T09:37:10.960082+0000","last_unstale":"2024-09-19T09:38:56.502819+0000","last_undegraded":"2024-09-19T09:38:56.502819+0000","last_fullsized":"2024-09-19T09:38:56.502819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:07.451648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498620+0000","last_change":"2024-09-19T09:37:10.965674+0000","last_active":"2024-09-19T09:38:56.498620+0000","last_peered":"2024-09-19T09:38:56.498620+0000","last_clean":"2024-09-19T09:38:56.498620+0000","last_became_active":"2024-09-19T09:37:10.965368+0000","last_became_peered":"2024-09-19T09:37:10.965368+0000","last_unstale":"2024-09-19T09:38:56.498620+0000","last_undegraded":"2024-09-19T09:38:56.498620+0000","last_fullsized":"2024-09-19T09:38:56.498620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:23.712785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497701+0000","last_change":"2024-09-19T09:37:10.966972+0000","last_active":"2024-09-19T09:38:56.497701+0000","last_peered":"2024-09-19T09:38:56.497701+0000","last_clean":"2024-09-19T09:38:56.497701+0000","last_became_active":"2024-09-19T09:37:10.966642+0000","last_became_peered":"2024-09-19T09:37:10.966642+0000","last_unstale":"2024-09-19T09:38:56.497701+0000","last_undegraded":"2024-09-19T09:38:56.497701+0000","last_fullsized":"2024-09-19T09:38:56.497701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.416611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:07.157059+0000","last_change":"2024-09-19T09:37:08.953116+0000","last_active":"2024-09-19T09:39:07.157059+0000","last_peered":"2024-09-19T09:39:07.157059+0000","last_clean":"2024-09-19T09:39:07.157059+0000","last_became_active":"2024-09-19T09:37:08.952748+0000","last_became_peered":"2024-09-19T09:37:08.952748+0000","last_unstale":"2024-09-19T09:39:07.157059+0000","last_undegraded":"2024-09-19T09:39:07.157059+0000","last_fullsized":"2024-09-19T09:39:07.157059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:22.395359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509861+0000","last_change":"2024-09-19T09:37:10.969106+0000","last_active":"2024-09-19T09:38:56.509861+0000","last_peered":"2024-09-19T09:38:56.509861+0000","last_clean":"2024-09-19T09:38:56.509861+0000","last_became_active":"2024-09-19T09:37:10.968801+0000","last_became_peered":"2024-09-19T09:37:10.968801+0000","last_unstale":"2024-09-19T09:38:56.509861+0000","last_undegraded":"2024-09-19T09:38:56.509861+0000","last_fullsized":"2024-09-19T09:38:56.509861+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.674925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014739+0000","last_change":"2024-09-19T09:37:08.949604+0000","last_active":"2024-09-19T09:37:28.014739+0000","last_peered":"2024-09-19T09:37:28.014739+0000","last_clean":"2024-09-19T09:37:28.014739+0000","last_became_active":"2024-09-19T09:37:08.949143+0000","last_became_peered":"2024-09-19T09:37:08.949143+0000","last_unstale":"2024-09-19T09:37:28.014739+0000","last_undegraded":"2024-09-19T09:37:28.014739+0000","last_fullsized":"2024-09-19T09:37:28.014739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:37.933319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012827+0000","last_change":"2024-09-19T09:37:08.946277+0000","last_active":"2024-09-19T09:37:28.012827+0000","last_peered":"2024-09-19T09:37:28.012827+0000","last_clean":"2024-09-19T09:37:28.012827+0000","last_became_active":"2024-09-19T09:37:08.945808+0000","last_became_peered":"2024-09-19T09:37:08.945808+0000","last_unstale":"2024-09-19T09:37:28.012827+0000","last_undegraded":"2024-09-19T09:37:28.012827+0000","last_fullsized":"2024-09-19T09:37:28.012827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.060811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511056+0000","last_change":"2024-09-19T09:37:10.957765+0000","last_active":"2024-09-19T09:38:56.511056+0000","last_peered":"2024-09-19T09:38:56.511056+0000","last_clean":"2024-09-19T09:38:56.511056+0000","last_became_active":"2024-09-19T09:37:10.957458+0000","last_became_peered":"2024-09-19T09:37:10.957458+0000","last_unstale":"2024-09-19T09:38:56.511056+0000","last_undegraded":"2024-09-19T09:38:56.511056+0000","last_fullsized":"2024-09-19T09:38:56.511056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:49.418473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020344+0000","last_change":"2024-09-19T09:37:08.953124+0000","last_active":"2024-09-19T09:37:28.020344+0000","last_peered":"2024-09-19T09:37:28.020344+0000","last_clean":"2024-09-19T09:37:28.020344+0000","last_became_active":"2024-09-19T09:37:08.952159+0000","last_became_peered":"2024-09-19T09:37:08.952159+0000","last_unstale":"2024-09-19T09:37:28.020344+0000","last_undegraded":"2024-09-19T09:37:28.020344+0000","last_fullsized":"2024-09-19T09:37:28.020344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:24.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509006+0000","last_change":"2024-09-19T09:37:10.964038+0000","last_active":"2024-09-19T09:38:56.509006+0000","last_peered":"2024-09-19T09:38:56.509006+0000","last_clean":"2024-09-19T09:38:56.509006+0000","last_became_active":"2024-09-19T09:37:10.963671+0000","last_became_peered":"2024-09-19T09:37:10.963671+0000","last_unstale":"2024-09-19T09:38:56.509006+0000","last_undegraded":"2024-09-19T09:38:56.509006+0000","last_fullsized":"2024-09-19T09:38:56.509006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:19.743329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":237,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:08.157779+0000","last_change":"2024-09-19T09:37:08.949600+0000","last_active":"2024-09-19T09:39:08.157779+0000","last_peered":"2024-09-19T09:39:08.157779+0000","last_clean":"2024-09-19T09:39:08.157779+0000","last_became_active":"2024-09-19T09:37:08.949141+0000","last_became_peered":"2024-09-19T09:37:08.949141+0000","last_unstale":"2024-09-19T09:39:08.157779+0000","last_undegraded":"2024-09-19T09:39:08.157779+0000","last_fullsized":"2024-09-19T09:39:08.157779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:42.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":211,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515006+0000","last_change":"2024-09-19T09:37:10.967506+0000","last_active":"2024-09-19T09:38:56.515006+0000","last_peered":"2024-09-19T09:38:56.515006+0000","last_clean":"2024-09-19T09:38:56.515006+0000","last_became_active":"2024-09-19T09:37:10.967193+0000","last_became_peered":"2024-09-19T09:37:10.967193+0000","last_unstale":"2024-09-19T09:38:56.515006+0000","last_undegraded":"2024-09-19T09:38:56.515006+0000","last_fullsized":"2024-09-19T09:38:56.515006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:33.158325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017606+0000","last_change":"2024-09-19T09:37:08.955305+0000","last_active":"2024-09-19T09:37:28.017606+0000","last_peered":"2024-09-19T09:37:28.017606+0000","last_clean":"2024-09-19T09:37:28.017606+0000","last_became_active":"2024-09-19T09:37:08.954932+0000","last_became_peered":"2024-09-19T09:37:08.954932+0000","last_unstale":"2024-09-19T09:37:28.017606+0000","last_undegraded":"2024-09-19T09:37:28.017606+0000","last_fullsized":"2024-09-19T09:37:28.017606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.157466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502511+0000","last_change":"2024-09-19T09:37:28.021974+0000","last_active":"2024-09-19T09:38:56.502511+0000","last_peered":"2024-09-19T09:38:56.502511+0000","last_clean":"2024-09-19T09:38:56.502511+0000","last_became_active":"2024-09-19T09:37:28.021579+0000","last_became_peered":"2024-09-19T09:37:28.021579+0000","last_unstale":"2024-09-19T09:38:56.502511+0000","last_undegraded":"2024-09-19T09:38:56.502511+0000","last_fullsized":"2024-09-19T09:38:56.502511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:28.562862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021814+0000","last_change":"2024-09-19T09:37:08.976540+0000","last_active":"2024-09-19T09:37:28.021814+0000","last_peered":"2024-09-19T09:37:28.021814+0000","last_clean":"2024-09-19T09:37:28.021814+0000","last_became_active":"2024-09-19T09:37:08.976196+0000","last_became_peered":"2024-09-19T09:37:08.976196+0000","last_unstale":"2024-09-19T09:37:28.021814+0000","last_undegraded":"2024-09-19T09:37:28.021814+0000","last_fullsized":"2024-09-19T09:37:28.021814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:38.735947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515663+0000","last_change":"2024-09-19T09:37:28.021407+0000","last_active":"2024-09-19T09:38:56.515663+0000","last_peered":"2024-09-19T09:38:56.515663+0000","last_clean":"2024-09-19T09:38:56.515663+0000","last_became_active":"2024-09-19T09:37:28.021020+0000","last_became_peered":"2024-09-19T09:37:28.021020+0000","last_unstale":"2024-09-19T09:38:56.515663+0000","last_undegraded":"2024-09-19T09:38:56.515663+0000","last_fullsized":"2024-09-19T09:38:56.515663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:25.394012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'39","reported_seq":305,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:08.157809+0000","last_change":"2024-09-19T09:37:28.029037+0000","last_active":"2024-09-19T09:39:08.157809+0000","last_peered":"2024-09-19T09:39:08.157809+0000","last_clean":"2024-09-19T09:39:08.157809+0000","last_became_active":"2024-09-19T09:37:28.018325+0000","last_became_peered":"2024-09-19T09:37:28.018325+0000","last_unstale":"2024-09-19T09:39:08.157809+0000","last_undegraded":"2024-09-19T09:39:08.157809+0000","last_fullsized":"2024-09-19T09:39:08.157809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:56.121569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71153,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":182,"num_write":41,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492834+0000","last_change":"2024-09-19T09:37:10.963688+0000","last_active":"2024-09-19T09:38:56.492834+0000","last_peered":"2024-09-19T09:38:56.492834+0000","last_clean":"2024-09-19T09:38:56.492834+0000","last_became_active":"2024-09-19T09:37:10.963296+0000","last_became_peered":"2024-09-19T09:37:10.963296+0000","last_unstale":"2024-09-19T09:38:56.492834+0000","last_undegraded":"2024-09-19T09:38:56.492834+0000","last_fullsized":"2024-09-19T09:38:56.492834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:49.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015183+0000","last_change":"2024-09-19T09:37:08.952198+0000","last_active":"2024-09-19T09:37:28.015183+0000","last_peered":"2024-09-19T09:37:28.015183+0000","last_clean":"2024-09-19T09:37:28.015183+0000","last_became_active":"2024-09-19T09:37:08.951699+0000","last_became_peered":"2024-09-19T09:37:08.951699+0000","last_unstale":"2024-09-19T09:37:28.015183+0000","last_undegraded":"2024-09-19T09:37:28.015183+0000","last_fullsized":"2024-09-19T09:37:28.015183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:46.729847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510576+0000","last_change":"2024-09-19T09:37:10.955741+0000","last_active":"2024-09-19T09:38:56.510576+0000","last_peered":"2024-09-19T09:38:56.510576+0000","last_clean":"2024-09-19T09:38:56.510576+0000","last_became_active":"2024-09-19T09:37:10.955394+0000","last_became_peered":"2024-09-19T09:37:10.955394+0000","last_unstale":"2024-09-19T09:38:56.510576+0000","last_undegraded":"2024-09-19T09:38:56.510576+0000","last_fullsized":"2024-09-19T09:38:56.510576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:56.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021172+0000","last_change":"2024-09-19T09:37:08.949979+0000","last_active":"2024-09-19T09:37:28.021172+0000","last_peered":"2024-09-19T09:37:28.021172+0000","last_clean":"2024-09-19T09:37:28.021172+0000","last_became_active":"2024-09-19T09:37:08.949664+0000","last_became_peered":"2024-09-19T09:37:08.949664+0000","last_unstale":"2024-09-19T09:37:28.021172+0000","last_undegraded":"2024-09-19T09:37:28.021172+0000","last_fullsized":"2024-09-19T09:37:28.021172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:06.449337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509647+0000","last_change":"2024-09-19T09:37:10.957479+0000","last_active":"2024-09-19T09:38:56.509647+0000","last_peered":"2024-09-19T09:38:56.509647+0000","last_clean":"2024-09-19T09:38:56.509647+0000","last_became_active":"2024-09-19T09:37:10.957130+0000","last_became_peered":"2024-09-19T09:37:10.957130+0000","last_unstale":"2024-09-19T09:38:56.509647+0000","last_undegraded":"2024-09-19T09:38:56.509647+0000","last_fullsized":"2024-09-19T09:38:56.509647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:52.840857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'8","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:07.169232+0000","last_change":"2024-09-19T09:37:08.951558+0000","last_active":"2024-09-19T09:39:07.169232+0000","last_peered":"2024-09-19T09:39:07.169232+0000","last_clean":"2024-09-19T09:39:07.169232+0000","last_became_active":"2024-09-19T09:37:08.951092+0000","last_became_peered":"2024-09-19T09:37:08.951092+0000","last_unstale":"2024-09-19T09:39:07.169232+0000","last_undegraded":"2024-09-19T09:39:07.169232+0000","last_fullsized":"2024-09-19T09:39:07.169232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:30.326253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503051+0000","last_change":"2024-09-19T09:37:10.962692+0000","last_active":"2024-09-19T09:38:56.503051+0000","last_peered":"2024-09-19T09:38:56.503051+0000","last_clean":"2024-09-19T09:38:56.503051+0000","last_became_active":"2024-09-19T09:37:10.962145+0000","last_became_peered":"2024-09-19T09:37:10.962145+0000","last_unstale":"2024-09-19T09:38:56.503051+0000","last_undegraded":"2024-09-19T09:38:56.503051+0000","last_fullsized":"2024-09-19T09:38:56.503051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:48.232759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020176+0000","last_change":"2024-09-19T09:37:08.976531+0000","last_active":"2024-09-19T09:37:28.020176+0000","last_peered":"2024-09-19T09:37:28.020176+0000","last_clean":"2024-09-19T09:37:28.020176+0000","last_became_active":"2024-09-19T09:37:08.975892+0000","last_became_peered":"2024-09-19T09:37:08.975892+0000","last_unstale":"2024-09-19T09:37:28.020176+0000","last_undegraded":"2024-09-19T09:37:28.020176+0000","last_fullsized":"2024-09-19T09:37:28.020176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.545504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508392+0000","last_change":"2024-09-19T09:37:10.968116+0000","last_active":"2024-09-19T09:38:56.508392+0000","last_peered":"2024-09-19T09:38:56.508392+0000","last_clean":"2024-09-19T09:38:56.508392+0000","last_became_active":"2024-09-19T09:37:10.967767+0000","last_became_peered":"2024-09-19T09:37:10.967767+0000","last_unstale":"2024-09-19T09:38:56.508392+0000","last_undegraded":"2024-09-19T09:38:56.508392+0000","last_fullsized":"2024-09-19T09:38:56.508392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:34.104712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020842+0000","last_change":"2024-09-19T09:37:08.949384+0000","last_active":"2024-09-19T09:37:28.020842+0000","last_peered":"2024-09-19T09:37:28.020842+0000","last_clean":"2024-09-19T09:37:28.020842+0000","last_became_active":"2024-09-19T09:37:08.948950+0000","last_became_peered":"2024-09-19T09:37:08.948950+0000","last_unstale":"2024-09-19T09:37:28.020842+0000","last_undegraded":"2024-09-19T09:37:28.020842+0000","last_fullsized":"2024-09-19T09:37:28.020842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:15.527608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506196+0000","last_change":"2024-09-19T09:37:10.965720+0000","last_active":"2024-09-19T09:38:56.506196+0000","last_peered":"2024-09-19T09:38:56.506196+0000","last_clean":"2024-09-19T09:38:56.506196+0000","last_became_active":"2024-09-19T09:37:10.965341+0000","last_became_peered":"2024-09-19T09:37:10.965341+0000","last_unstale":"2024-09-19T09:38:56.506196+0000","last_undegraded":"2024-09-19T09:38:56.506196+0000","last_fullsized":"2024-09-19T09:38:56.506196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:36.591438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013189+0000","last_change":"2024-09-19T09:37:08.953702+0000","last_active":"2024-09-19T09:37:28.013189+0000","last_peered":"2024-09-19T09:37:28.013189+0000","last_clean":"2024-09-19T09:37:28.013189+0000","last_became_active":"2024-09-19T09:37:08.953312+0000","last_became_peered":"2024-09-19T09:37:08.953312+0000","last_unstale":"2024-09-19T09:37:28.013189+0000","last_undegraded":"2024-09-19T09:37:28.013189+0000","last_fullsized":"2024-09-19T09:37:28.013189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:54.059096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498384+0000","last_change":"2024-09-19T09:37:10.959814+0000","last_active":"2024-09-19T09:38:56.498384+0000","last_peered":"2024-09-19T09:38:56.498384+0000","last_clean":"2024-09-19T09:38:56.498384+0000","last_became_active":"2024-09-19T09:37:10.959342+0000","last_became_peered":"2024-09-19T09:37:10.959342+0000","last_unstale":"2024-09-19T09:38:56.498384+0000","last_undegraded":"2024-09-19T09:38:56.498384+0000","last_fullsized":"2024-09-19T09:38:56.498384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021892+0000","last_change":"2024-09-19T09:37:08.947978+0000","last_active":"2024-09-19T09:37:28.021892+0000","last_peered":"2024-09-19T09:37:28.021892+0000","last_clean":"2024-09-19T09:37:28.021892+0000","last_became_active":"2024-09-19T09:37:08.947548+0000","last_became_peered":"2024-09-19T09:37:08.947548+0000","last_unstale":"2024-09-19T09:37:28.021892+0000","last_undegraded":"2024-09-19T09:37:28.021892+0000","last_fullsized":"2024-09-19T09:37:28.021892+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:38.283616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509716+0000","last_change":"2024-09-19T09:37:10.964008+0000","last_active":"2024-09-19T09:38:56.509716+0000","last_peered":"2024-09-19T09:38:56.509716+0000","last_clean":"2024-09-19T09:38:56.509716+0000","last_became_active":"2024-09-19T09:37:10.963554+0000","last_became_peered":"2024-09-19T09:37:10.963554+0000","last_unstale":"2024-09-19T09:38:56.509716+0000","last_undegraded":"2024-09-19T09:38:56.509716+0000","last_fullsized":"2024-09-19T09:38:56.509716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:57.320967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'5","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:07.167692+0000","last_change":"2024-09-19T09:37:28.027589+0000","last_active":"2024-09-19T09:39:07.167692+0000","last_peered":"2024-09-19T09:39:07.167692+0000","last_clean":"2024-09-19T09:39:07.167692+0000","last_became_active":"2024-09-19T09:37:28.020013+0000","last_became_peered":"2024-09-19T09:37:28.020013+0000","last_unstale":"2024-09-19T09:39:07.167692+0000","last_undegraded":"2024-09-19T09:39:07.167692+0000","last_fullsized":"2024-09-19T09:39:07.167692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:51.327069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.513503+0000","last_change":"2024-09-19T09:37:10.960337+0000","last_active":"2024-09-19T09:38:56.513503+0000","last_peered":"2024-09-19T09:38:56.513503+0000","last_clean":"2024-09-19T09:38:56.513503+0000","last_became_active":"2024-09-19T09:37:10.960006+0000","last_became_peered":"2024-09-19T09:37:10.960006+0000","last_unstale":"2024-09-19T09:38:56.513503+0000","last_undegraded":"2024-09-19T09:38:56.513503+0000","last_fullsized":"2024-09-19T09:38:56.513503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:16.942098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019301+0000","last_change":"2024-09-19T09:36:01.923601+0000","last_active":"2024-09-19T09:37:28.019301+0000","last_peered":"2024-09-19T09:37:28.019301+0000","last_clean":"2024-09-19T09:37:28.019301+0000","last_became_active":"2024-09-19T09:36:01.923051+0000","last_became_peered":"2024-09-19T09:36:01.923051+0000","last_unstale":"2024-09-19T09:37:28.019301+0000","last_undegraded":"2024-09-19T09:37:28.019301+0000","last_fullsized":"2024-09-19T09:37:28.019301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_clean_scrub_stamp":"2024-09-19T09:32:45.321588+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:41.635565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013536+0000","last_change":"2024-09-19T09:37:08.948818+0000","last_active":"2024-09-19T09:37:28.013536+0000","last_peered":"2024-09-19T09:37:28.013536+0000","last_clean":"2024-09-19T09:37:28.013536+0000","last_became_active":"2024-09-19T09:37:08.948494+0000","last_became_peered":"2024-09-19T09:37:08.948494+0000","last_unstale":"2024-09-19T09:37:28.013536+0000","last_undegraded":"2024-09-19T09:37:28.013536+0000","last_fullsized":"2024-09-19T09:37:28.013536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:35.255778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514837+0000","last_change":"2024-09-19T09:37:10.966315+0000","last_active":"2024-09-19T09:38:56.514837+0000","last_peered":"2024-09-19T09:38:56.514837+0000","last_clean":"2024-09-19T09:38:56.514837+0000","last_became_active":"2024-09-19T09:37:10.965979+0000","last_became_peered":"2024-09-19T09:37:10.965979+0000","last_unstale":"2024-09-19T09:38:56.514837+0000","last_undegraded":"2024-09-19T09:38:56.514837+0000","last_fullsized":"2024-09-19T09:38:56.514837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:36.229434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.030136+0000","last_change":"2024-09-19T09:37:28.029598+0000","last_active":"2024-09-19T09:37:28.030136+0000","last_peered":"2024-09-19T09:37:28.030136+0000","last_clean":"2024-09-19T09:37:28.030136+0000","last_became_active":"2024-09-19T09:37:28.021459+0000","last_became_peered":"2024-09-19T09:37:28.021459+0000","last_unstale":"2024-09-19T09:37:28.030136+0000","last_undegraded":"2024-09-19T09:37:28.030136+0000","last_fullsized":"2024-09-19T09:37:28.030136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:00.755946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507049+0000","last_change":"2024-09-19T09:37:10.962825+0000","last_active":"2024-09-19T09:38:56.507049+0000","last_peered":"2024-09-19T09:38:56.507049+0000","last_clean":"2024-09-19T09:38:56.507049+0000","last_became_active":"2024-09-19T09:37:10.962475+0000","last_became_peered":"2024-09-19T09:37:10.962475+0000","last_unstale":"2024-09-19T09:38:56.507049+0000","last_undegraded":"2024-09-19T09:38:56.507049+0000","last_fullsized":"2024-09-19T09:38:56.507049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:30.650918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'6","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:06.167034+0000","last_change":"2024-09-19T09:37:08.976364+0000","last_active":"2024-09-19T09:39:06.167034+0000","last_peered":"2024-09-19T09:39:06.167034+0000","last_clean":"2024-09-19T09:39:06.167034+0000","last_became_active":"2024-09-19T09:37:08.975983+0000","last_became_peered":"2024-09-19T09:37:08.975983+0000","last_unstale":"2024-09-19T09:39:06.167034+0000","last_undegraded":"2024-09-19T09:39:06.167034+0000","last_fullsized":"2024-09-19T09:39:06.167034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.762847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.489815+0000","last_change":"2024-09-19T09:37:28.020341+0000","last_active":"2024-09-19T09:38:56.489815+0000","last_peered":"2024-09-19T09:38:56.489815+0000","last_clean":"2024-09-19T09:38:56.489815+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:56.489815+0000","last_undegraded":"2024-09-19T09:38:56.489815+0000","last_fullsized":"2024-09-19T09:38:56.489815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:24.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'8","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:05.153874+0000","last_change":"2024-09-19T09:37:08.950403+0000","last_active":"2024-09-19T09:39:05.153874+0000","last_peered":"2024-09-19T09:39:05.153874+0000","last_clean":"2024-09-19T09:39:05.153874+0000","last_became_active":"2024-09-19T09:37:08.950077+0000","last_became_peered":"2024-09-19T09:37:08.950077+0000","last_unstale":"2024-09-19T09:39:05.153874+0000","last_undegraded":"2024-09-19T09:39:05.153874+0000","last_fullsized":"2024-09-19T09:39:05.153874+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:46.446439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509036+0000","last_change":"2024-09-19T09:37:10.969493+0000","last_active":"2024-09-19T09:38:56.509036+0000","last_peered":"2024-09-19T09:38:56.509036+0000","last_clean":"2024-09-19T09:38:56.509036+0000","last_became_active":"2024-09-19T09:37:10.969038+0000","last_became_peered":"2024-09-19T09:37:10.969038+0000","last_unstale":"2024-09-19T09:38:56.509036+0000","last_undegraded":"2024-09-19T09:38:56.509036+0000","last_fullsized":"2024-09-19T09:38:56.509036+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:55.518806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015137+0000","last_change":"2024-09-19T09:37:08.977207+0000","last_active":"2024-09-19T09:37:28.015137+0000","last_peered":"2024-09-19T09:37:28.015137+0000","last_clean":"2024-09-19T09:37:28.015137+0000","last_became_active":"2024-09-19T09:37:08.976859+0000","last_became_peered":"2024-09-19T09:37:08.976859+0000","last_unstale":"2024-09-19T09:37:28.015137+0000","last_undegraded":"2024-09-19T09:37:28.015137+0000","last_fullsized":"2024-09-19T09:37:28.015137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:25.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504626+0000","last_change":"2024-09-19T09:37:28.023437+0000","last_active":"2024-09-19T09:38:56.504626+0000","last_peered":"2024-09-19T09:38:56.504626+0000","last_clean":"2024-09-19T09:38:56.504626+0000","last_became_active":"2024-09-19T09:37:28.018678+0000","last_became_peered":"2024-09-19T09:37:28.018678+0000","last_unstale":"2024-09-19T09:38:56.504626+0000","last_undegraded":"2024-09-19T09:38:56.504626+0000","last_fullsized":"2024-09-19T09:38:56.504626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:44.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020845+0000","last_change":"2024-09-19T09:37:08.976594+0000","last_active":"2024-09-19T09:37:28.020845+0000","last_peered":"2024-09-19T09:37:28.020845+0000","last_clean":"2024-09-19T09:37:28.020845+0000","last_became_active":"2024-09-19T09:37:08.976222+0000","last_became_peered":"2024-09-19T09:37:08.976222+0000","last_unstale":"2024-09-19T09:37:28.020845+0000","last_undegraded":"2024-09-19T09:37:28.020845+0000","last_fullsized":"2024-09-19T09:37:28.020845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:53.492591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498775+0000","last_change":"2024-09-19T09:37:10.957096+0000","last_active":"2024-09-19T09:38:56.498775+0000","last_peered":"2024-09-19T09:38:56.498775+0000","last_clean":"2024-09-19T09:38:56.498775+0000","last_became_active":"2024-09-19T09:37:10.956740+0000","last_became_peered":"2024-09-19T09:37:10.956740+0000","last_unstale":"2024-09-19T09:38:56.498775+0000","last_undegraded":"2024-09-19T09:38:56.498775+0000","last_fullsized":"2024-09-19T09:38:56.498775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:40.358624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'17","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.032479+0000","last_change":"2024-09-19T09:37:08.948528+0000","last_active":"2024-09-19T09:38:58.032479+0000","last_peered":"2024-09-19T09:38:58.032479+0000","last_clean":"2024-09-19T09:38:58.032479+0000","last_became_active":"2024-09-19T09:37:08.948183+0000","last_became_peered":"2024-09-19T09:37:08.948183+0000","last_unstale":"2024-09-19T09:38:58.032479+0000","last_undegraded":"2024-09-19T09:38:58.032479+0000","last_fullsized":"2024-09-19T09:38:58.032479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:23.214471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508526+0000","last_change":"2024-09-19T09:37:10.959492+0000","last_active":"2024-09-19T09:38:56.508526+0000","last_peered":"2024-09-19T09:38:56.508526+0000","last_clean":"2024-09-19T09:38:56.508526+0000","last_became_active":"2024-09-19T09:37:10.959032+0000","last_became_peered":"2024-09-19T09:37:10.959032+0000","last_unstale":"2024-09-19T09:38:56.508526+0000","last_undegraded":"2024-09-19T09:38:56.508526+0000","last_fullsized":"2024-09-19T09:38:56.508526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.080976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013794+0000","last_change":"2024-09-19T09:37:09.270315+0000","last_active":"2024-09-19T09:37:28.013794+0000","last_peered":"2024-09-19T09:37:28.013794+0000","last_clean":"2024-09-19T09:37:28.013794+0000","last_became_active":"2024-09-19T09:37:09.269891+0000","last_became_peered":"2024-09-19T09:37:09.269891+0000","last_unstale":"2024-09-19T09:37:28.013794+0000","last_undegraded":"2024-09-19T09:37:28.013794+0000","last_fullsized":"2024-09-19T09:37:28.013794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:12.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509933+0000","last_change":"2024-09-19T09:37:10.961363+0000","last_active":"2024-09-19T09:38:56.509933+0000","last_peered":"2024-09-19T09:38:56.509933+0000","last_clean":"2024-09-19T09:38:56.509933+0000","last_became_active":"2024-09-19T09:37:10.960951+0000","last_became_peered":"2024-09-19T09:37:10.960951+0000","last_unstale":"2024-09-19T09:38:56.509933+0000","last_undegraded":"2024-09-19T09:38:56.509933+0000","last_fullsized":"2024-09-19T09:38:56.509933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:31.226355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015555+0000","last_change":"2024-09-19T09:37:08.976805+0000","last_active":"2024-09-19T09:37:28.015555+0000","last_peered":"2024-09-19T09:37:28.015555+0000","last_clean":"2024-09-19T09:37:28.015555+0000","last_became_active":"2024-09-19T09:37:08.976502+0000","last_became_peered":"2024-09-19T09:37:08.976502+0000","last_unstale":"2024-09-19T09:37:28.015555+0000","last_undegraded":"2024-09-19T09:37:28.015555+0000","last_fullsized":"2024-09-19T09:37:28.015555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:25.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.470670+0000","last_change":"2024-09-19T09:37:10.965723+0000","last_active":"2024-09-19T09:38:56.470670+0000","last_peered":"2024-09-19T09:38:56.470670+0000","last_clean":"2024-09-19T09:38:56.470670+0000","last_became_active":"2024-09-19T09:37:10.965385+0000","last_became_peered":"2024-09-19T09:37:10.965385+0000","last_unstale":"2024-09-19T09:38:56.470670+0000","last_undegraded":"2024-09-19T09:38:56.470670+0000","last_fullsized":"2024-09-19T09:38:56.470670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:15.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017690+0000","last_change":"2024-09-19T09:37:08.948028+0000","last_active":"2024-09-19T09:37:28.017690+0000","last_peered":"2024-09-19T09:37:28.017690+0000","last_clean":"2024-09-19T09:37:28.017690+0000","last_became_active":"2024-09-19T09:37:08.947583+0000","last_became_peered":"2024-09-19T09:37:08.947583+0000","last_unstale":"2024-09-19T09:37:28.017690+0000","last_undegraded":"2024-09-19T09:37:28.017690+0000","last_fullsized":"2024-09-19T09:37:28.017690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:15.485850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498875+0000","last_change":"2024-09-19T09:37:10.964577+0000","last_active":"2024-09-19T09:38:56.498875+0000","last_peered":"2024-09-19T09:38:56.498875+0000","last_clean":"2024-09-19T09:38:56.498875+0000","last_became_active":"2024-09-19T09:37:10.964226+0000","last_became_peered":"2024-09-19T09:37:10.964226+0000","last_unstale":"2024-09-19T09:38:56.498875+0000","last_undegraded":"2024-09-19T09:38:56.498875+0000","last_fullsized":"2024-09-19T09:38:56.498875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:44.074286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014911+0000","last_change":"2024-09-19T09:37:08.952257+0000","last_active":"2024-09-19T09:37:28.014911+0000","last_peered":"2024-09-19T09:37:28.014911+0000","last_clean":"2024-09-19T09:37:28.014911+0000","last_became_active":"2024-09-19T09:37:08.951056+0000","last_became_peered":"2024-09-19T09:37:08.951056+0000","last_unstale":"2024-09-19T09:37:28.014911+0000","last_undegraded":"2024-09-19T09:37:28.014911+0000","last_fullsized":"2024-09-19T09:37:28.014911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:35.238551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511292+0000","last_change":"2024-09-19T09:37:10.965956+0000","last_active":"2024-09-19T09:38:56.511292+0000","last_peered":"2024-09-19T09:38:56.511292+0000","last_clean":"2024-09-19T09:38:56.511292+0000","last_became_active":"2024-09-19T09:37:10.965367+0000","last_became_peered":"2024-09-19T09:37:10.965367+0000","last_unstale":"2024-09-19T09:38:56.511292+0000","last_undegraded":"2024-09-19T09:38:56.511292+0000","last_fullsized":"2024-09-19T09:38:56.511292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:23.280106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.027523+0000","last_change":"2024-09-19T09:37:28.026998+0000","last_active":"2024-09-19T09:37:28.027523+0000","last_peered":"2024-09-19T09:37:28.027523+0000","last_clean":"2024-09-19T09:37:28.027523+0000","last_became_active":"2024-09-19T09:37:28.021169+0000","last_became_peered":"2024-09-19T09:37:28.021169+0000","last_unstale":"2024-09-19T09:37:28.027523+0000","last_undegraded":"2024-09-19T09:37:28.027523+0000","last_fullsized":"2024-09-19T09:37:28.027523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.876143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.513741+0000","last_change":"2024-09-19T09:37:10.959937+0000","last_active":"2024-09-19T09:38:56.513741+0000","last_peered":"2024-09-19T09:38:56.513741+0000","last_clean":"2024-09-19T09:38:56.513741+0000","last_became_active":"2024-09-19T09:37:10.959466+0000","last_became_peered":"2024-09-19T09:37:10.959466+0000","last_unstale":"2024-09-19T09:38:56.513741+0000","last_undegraded":"2024-09-19T09:38:56.513741+0000","last_fullsized":"2024-09-19T09:38:56.513741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:13.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508964+0000","last_change":"2024-09-19T09:37:10.966737+0000","last_active":"2024-09-19T09:38:56.508964+0000","last_peered":"2024-09-19T09:38:56.508964+0000","last_clean":"2024-09-19T09:38:56.508964+0000","last_became_active":"2024-09-19T09:37:10.966436+0000","last_became_peered":"2024-09-19T09:37:10.966436+0000","last_unstale":"2024-09-19T09:38:56.508964+0000","last_undegraded":"2024-09-19T09:38:56.508964+0000","last_fullsized":"2024-09-19T09:38:56.508964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:05.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020657+0000","last_change":"2024-09-19T09:37:08.950225+0000","last_active":"2024-09-19T09:37:28.020657+0000","last_peered":"2024-09-19T09:37:28.020657+0000","last_clean":"2024-09-19T09:37:28.020657+0000","last_became_active":"2024-09-19T09:37:08.949855+0000","last_became_peered":"2024-09-19T09:37:08.949855+0000","last_unstale":"2024-09-19T09:37:28.020657+0000","last_undegraded":"2024-09-19T09:37:28.020657+0000","last_fullsized":"2024-09-19T09:37:28.020657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:12.315407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515631+0000","last_change":"2024-09-19T09:37:10.965763+0000","last_active":"2024-09-19T09:38:56.515631+0000","last_peered":"2024-09-19T09:38:56.515631+0000","last_clean":"2024-09-19T09:38:56.515631+0000","last_became_active":"2024-09-19T09:37:10.965425+0000","last_became_peered":"2024-09-19T09:37:10.965425+0000","last_unstale":"2024-09-19T09:38:56.515631+0000","last_undegraded":"2024-09-19T09:38:56.515631+0000","last_fullsized":"2024-09-19T09:38:56.515631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:34.474506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'13","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020863+0000","last_change":"2024-09-19T09:37:08.954211+0000","last_active":"2024-09-19T09:37:28.020863+0000","last_peered":"2024-09-19T09:37:28.020863+0000","last_clean":"2024-09-19T09:37:28.020863+0000","last_became_active":"2024-09-19T09:37:08.953869+0000","last_became_peered":"2024-09-19T09:37:08.953869+0000","last_unstale":"2024-09-19T09:37:28.020863+0000","last_undegraded":"2024-09-19T09:37:28.020863+0000","last_fullsized":"2024-09-19T09:37:28.020863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:10.650227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508638+0000","last_change":"2024-09-19T09:37:10.957032+0000","last_active":"2024-09-19T09:38:56.508638+0000","last_peered":"2024-09-19T09:38:56.508638+0000","last_clean":"2024-09-19T09:38:56.508638+0000","last_became_active":"2024-09-19T09:37:10.955979+0000","last_became_peered":"2024-09-19T09:37:10.955979+0000","last_unstale":"2024-09-19T09:38:56.508638+0000","last_undegraded":"2024-09-19T09:38:56.508638+0000","last_fullsized":"2024-09-19T09:38:56.508638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.734353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018090+0000","last_change":"2024-09-19T09:37:08.976359+0000","last_active":"2024-09-19T09:37:28.018090+0000","last_peered":"2024-09-19T09:37:28.018090+0000","last_clean":"2024-09-19T09:37:28.018090+0000","last_became_active":"2024-09-19T09:37:08.976019+0000","last_became_peered":"2024-09-19T09:37:08.976019+0000","last_unstale":"2024-09-19T09:37:28.018090+0000","last_undegraded":"2024-09-19T09:37:28.018090+0000","last_fullsized":"2024-09-19T09:37:28.018090+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:34.401585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510097+0000","last_change":"2024-09-19T09:37:10.954000+0000","last_active":"2024-09-19T09:38:56.510097+0000","last_peered":"2024-09-19T09:38:56.510097+0000","last_clean":"2024-09-19T09:38:56.510097+0000","last_became_active":"2024-09-19T09:37:10.953709+0000","last_became_peered":"2024-09-19T09:37:10.953709+0000","last_unstale":"2024-09-19T09:38:56.510097+0000","last_undegraded":"2024-09-19T09:38:56.510097+0000","last_fullsized":"2024-09-19T09:38:56.510097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:36.779680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'14","reported_seq":164,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:08.157529+0000","last_change":"2024-09-19T09:37:28.036392+0000","last_active":"2024-09-19T09:39:08.157529+0000","last_peered":"2024-09-19T09:39:08.157529+0000","last_clean":"2024-09-19T09:39:08.157529+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:39:08.157529+0000","last_undegraded":"2024-09-19T09:39:08.157529+0000","last_fullsized":"2024-09-19T09:39:08.157529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:56.344807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":79429,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1093,"num_read_kb":635,"num_write":265,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":28789,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":238287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612645,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":437286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841576,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1617920,"data_stored":1100395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005103,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266740,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":437860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051655,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":510044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280587,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476817,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607638,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":510598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40416,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704736,"statfs":{"total":95995035648,"available":95953649664,"internally_reserved":0,"allocated":933888,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":74504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":73950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":73816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:39:11.848 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:39:11.849 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:39:11.875 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:11 smithi042 ceph-mon[31223]: pgmap v333: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-19T09:39:11.875 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:11 smithi042 ceph-mon[31223]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:11.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:11 smithi136 ceph-mon[34840]: pgmap v333: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-19T09:39:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:11 smithi136 ceph-mon[34840]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:12.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:11 smithi171 ceph-mon[35803]: pgmap v333: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-19T09:39:12.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:11 smithi171 ceph-mon[35803]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:12.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.567+0000 7f583c543640 1 -- 172.21.15.42:0/2334228504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5834101de0 msgr2=0x7f58341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:12.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.567+0000 7f583c543640 1 --2- 172.21.15.42:0/2334228504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5834101de0 0x7f58341021c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5830009900 tx=0x7f583002a410 comp rx=0 tx=0).stop 2024-09-19T09:39:12.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.567+0000 7f583c543640 1 -- 172.21.15.42:0/2334228504 shutdown_connections 2024-09-19T09:39:12.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.567+0000 7f583c543640 1 --2- 172.21.15.42:0/2334228504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5834106f10 0x7f583410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:12.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.567+0000 7f583c543640 1 --2- 172.21.15.42:0/2334228504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5834102790 0x7f58341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:12.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.567+0000 7f583c543640 1 --2- 172.21.15.42:0/2334228504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5834101de0 0x7f58341021c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:12.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.567+0000 7f583c543640 1 -- 172.21.15.42:0/2334228504 >> 172.21.15.42:0/2334228504 conn(0x7f58340fd8c0 msgr2=0x7f58340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:12.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.567+0000 7f583c543640 1 -- 172.21.15.42:0/2334228504 shutdown_connections 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.567+0000 7f583c543640 1 -- 172.21.15.42:0/2334228504 wait complete. 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f583c543640 1 Processor -- start 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f583c543640 1 -- start start 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f583c543640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5834101de0 0x7f58341984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f583c543640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5834102790 0x7f5834198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f583c543640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5834106f10 0x7f583419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f583c543640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5834111f70 con 0x7f5834102790 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f583c543640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5834111df0 con 0x7f5834101de0 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f583c543640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58341120f0 con 0x7f5834106f10 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f5839ade640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5834102790 0x7f5834198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f5839ade640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5834102790 0x7f5834198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59394/0 (socket says 172.21.15.42:59394) 2024-09-19T09:39:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f5839ade640 1 -- 172.21.15.42:0/2761013685 learned_addr learned my addr 172.21.15.42:0/2761013685 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f583a2df640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5834101de0 0x7f58341984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.568+0000 7f583aae0640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5834106f10 0x7f583419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f5839ade640 1 -- 172.21.15.42:0/2761013685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5834106f10 msgr2=0x7f583419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f5839ade640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5834106f10 0x7f583419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f5839ade640 1 -- 172.21.15.42:0/2761013685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5834101de0 msgr2=0x7f58341984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f5839ade640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5834101de0 0x7f58341984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f5839ade640 1 -- 172.21.15.42:0/2761013685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583419d480 con 0x7f5834102790 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f583aae0640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5834106f10 0x7f583419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f5839ade640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5834102790 0x7f5834198a10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f582400d950 tx=0x7f582400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f582b7fe640 1 -- 172.21.15.42:0/2761013685 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5824017070 con 0x7f5834102790 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f582b7fe640 1 -- 172.21.15.42:0/2761013685 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5824009c30 con 0x7f5834102790 2024-09-19T09:39:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f583c543640 1 -- 172.21.15.42:0/2761013685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f583419d770 con 0x7f5834102790 2024-09-19T09:39:12.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f582b7fe640 1 -- 172.21.15.42:0/2761013685 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582400f6b0 con 0x7f5834102790 2024-09-19T09:39:12.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.569+0000 7f583c543640 1 -- 172.21.15.42:0/2761013685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58341a5050 con 0x7f5834102790 2024-09-19T09:39:12.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.570+0000 7f583c543640 1 -- 172.21.15.42:0/2761013685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58341021c0 con 0x7f5834102790 2024-09-19T09:39:12.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.572+0000 7f582b7fe640 1 -- 172.21.15.42:0/2761013685 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f58240109d0 con 0x7f5834102790 2024-09-19T09:39:12.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.573+0000 7f582b7fe640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58200a32d0 0x7f58200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:12.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.573+0000 7f583a2df640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58200a32d0 0x7f58200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:12.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.573+0000 7f582b7fe640 1 -- 172.21.15.42:0/2761013685 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f58240cf700 con 0x7f5834102790 2024-09-19T09:39:12.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.573+0000 7f583a2df640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58200a32d0 0x7f58200a5790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5830009230 tx=0x7f58300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:12.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.576+0000 7f582b7fe640 1 -- 172.21.15.42:0/2761013685 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5824009de0 con 0x7f5834102790 2024-09-19T09:39:12.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.751+0000 7f583c543640 1 -- 172.21.15.42:0/2761013685 --> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5834062630 con 0x7f58200a32d0 2024-09-19T09:39:12.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.758+0000 7f582b7fe640 1 -- 172.21.15.42:0/2761013685 <== mgr.14150 v2:172.21.15.42:6800/117232266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258905 (secure 0 0 0) 0x7f5834062630 con 0x7f58200a32d0 2024-09-19T09:39:12.761 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:12.762 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 -- 172.21.15.42:0/2761013685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58200a32d0 msgr2=0x7f58200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58200a32d0 0x7f58200a5790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5830009230 tx=0x7f58300058d0 comp rx=0 tx=0).stop 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 -- 172.21.15.42:0/2761013685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5834102790 msgr2=0x7f5834198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5834102790 0x7f5834198a10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f582400d950 tx=0x7f582400de10 comp rx=0 tx=0).stop 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 -- 172.21.15.42:0/2761013685 shutdown_connections 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f58200a32d0 0x7f58200a5790 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5834106f10 0x7f583419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5834102790 0x7f5834198a10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 --2- 172.21.15.42:0/2761013685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5834101de0 0x7f58341984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 -- 172.21.15.42:0/2761013685 >> 172.21.15.42:0/2761013685 conn(0x7f58340fd8c0 msgr2=0x7f58340fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:12.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 -- 172.21.15.42:0/2761013685 shutdown_connections 2024-09-19T09:39:12.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:12.761+0000 7f583c543640 1 -- 172.21.15.42:0/2761013685 wait complete. 2024-09-19T09:39:13.620 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-19T09:39:12.528284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":670031,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1229,"num_read_kb":749,"num_write":448,"num_write_kb":3100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":1209642,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382864,"kb_used_data":12816,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558960,"statfs":{"total":1151940427776,"available":1151548375040,"internally_reserved":0,"allocated":13123584,"data_stored":7243221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8820,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":69,"num_write":4,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514653+0000","last_change":"2024-09-19T09:37:10.964695+0000","last_active":"2024-09-19T09:38:56.514653+0000","last_peered":"2024-09-19T09:38:56.514653+0000","last_clean":"2024-09-19T09:38:56.514653+0000","last_became_active":"2024-09-19T09:37:10.964343+0000","last_became_peered":"2024-09-19T09:37:10.964343+0000","last_unstale":"2024-09-19T09:38:56.514653+0000","last_undegraded":"2024-09-19T09:38:56.514653+0000","last_fullsized":"2024-09-19T09:38:56.514653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:44.224621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.493324+0000","last_change":"2024-09-19T09:37:10.964163+0000","last_active":"2024-09-19T09:38:56.493324+0000","last_peered":"2024-09-19T09:38:56.493324+0000","last_clean":"2024-09-19T09:38:56.493324+0000","last_became_active":"2024-09-19T09:37:10.963758+0000","last_became_peered":"2024-09-19T09:37:10.963758+0000","last_unstale":"2024-09-19T09:38:56.493324+0000","last_undegraded":"2024-09-19T09:38:56.493324+0000","last_fullsized":"2024-09-19T09:38:56.493324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:49.934438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508867+0000","last_change":"2024-09-19T09:37:10.958145+0000","last_active":"2024-09-19T09:38:56.508867+0000","last_peered":"2024-09-19T09:38:56.508867+0000","last_clean":"2024-09-19T09:38:56.508867+0000","last_became_active":"2024-09-19T09:37:10.957666+0000","last_became_peered":"2024-09-19T09:37:10.957666+0000","last_unstale":"2024-09-19T09:38:56.508867+0000","last_undegraded":"2024-09-19T09:38:56.508867+0000","last_fullsized":"2024-09-19T09:38:56.508867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.479753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492252+0000","last_change":"2024-09-19T09:37:28.021681+0000","last_active":"2024-09-19T09:38:56.492252+0000","last_peered":"2024-09-19T09:38:56.492252+0000","last_clean":"2024-09-19T09:38:56.492252+0000","last_became_active":"2024-09-19T09:37:28.021294+0000","last_became_peered":"2024-09-19T09:37:28.021294+0000","last_unstale":"2024-09-19T09:38:56.492252+0000","last_undegraded":"2024-09-19T09:38:56.492252+0000","last_fullsized":"2024-09-19T09:38:56.492252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:36.535707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503476+0000","last_change":"2024-09-19T09:37:10.957138+0000","last_active":"2024-09-19T09:38:56.503476+0000","last_peered":"2024-09-19T09:38:56.503476+0000","last_clean":"2024-09-19T09:38:56.503476+0000","last_became_active":"2024-09-19T09:37:10.956824+0000","last_became_peered":"2024-09-19T09:37:10.956824+0000","last_unstale":"2024-09-19T09:38:56.503476+0000","last_undegraded":"2024-09-19T09:38:56.503476+0000","last_fullsized":"2024-09-19T09:38:56.503476+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:44.919747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510565+0000","last_change":"2024-09-19T09:37:10.969804+0000","last_active":"2024-09-19T09:38:56.510565+0000","last_peered":"2024-09-19T09:38:56.510565+0000","last_clean":"2024-09-19T09:38:56.510565+0000","last_became_active":"2024-09-19T09:37:10.969454+0000","last_became_peered":"2024-09-19T09:37:10.969454+0000","last_unstale":"2024-09-19T09:38:56.510565+0000","last_undegraded":"2024-09-19T09:38:56.510565+0000","last_fullsized":"2024-09-19T09:38:56.510565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:14.856255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503058+0000","last_change":"2024-09-19T09:37:10.962853+0000","last_active":"2024-09-19T09:38:56.503058+0000","last_peered":"2024-09-19T09:38:56.503058+0000","last_clean":"2024-09-19T09:38:56.503058+0000","last_became_active":"2024-09-19T09:37:10.961207+0000","last_became_peered":"2024-09-19T09:37:10.961207+0000","last_unstale":"2024-09-19T09:38:56.503058+0000","last_undegraded":"2024-09-19T09:38:56.503058+0000","last_fullsized":"2024-09-19T09:38:56.503058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511634+0000","last_change":"2024-09-19T09:37:10.970216+0000","last_active":"2024-09-19T09:38:56.511634+0000","last_peered":"2024-09-19T09:38:56.511634+0000","last_clean":"2024-09-19T09:38:56.511634+0000","last_became_active":"2024-09-19T09:37:10.969486+0000","last_became_peered":"2024-09-19T09:37:10.969486+0000","last_unstale":"2024-09-19T09:38:56.511634+0000","last_undegraded":"2024-09-19T09:38:56.511634+0000","last_fullsized":"2024-09-19T09:38:56.511634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:56.859228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515236+0000","last_change":"2024-09-19T09:37:10.962596+0000","last_active":"2024-09-19T09:38:56.515236+0000","last_peered":"2024-09-19T09:38:56.515236+0000","last_clean":"2024-09-19T09:38:56.515236+0000","last_became_active":"2024-09-19T09:37:10.962230+0000","last_became_peered":"2024-09-19T09:37:10.962230+0000","last_unstale":"2024-09-19T09:38:56.515236+0000","last_undegraded":"2024-09-19T09:38:56.515236+0000","last_fullsized":"2024-09-19T09:38:56.515236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:07.810793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510890+0000","last_change":"2024-09-19T09:37:10.962186+0000","last_active":"2024-09-19T09:38:56.510890+0000","last_peered":"2024-09-19T09:38:56.510890+0000","last_clean":"2024-09-19T09:38:56.510890+0000","last_became_active":"2024-09-19T09:37:10.961845+0000","last_became_peered":"2024-09-19T09:37:10.961845+0000","last_unstale":"2024-09-19T09:38:56.510890+0000","last_undegraded":"2024-09-19T09:38:56.510890+0000","last_fullsized":"2024-09-19T09:38:56.510890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:24.150103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512962+0000","last_change":"2024-09-19T09:37:10.958763+0000","last_active":"2024-09-19T09:38:56.512962+0000","last_peered":"2024-09-19T09:38:56.512962+0000","last_clean":"2024-09-19T09:38:56.512962+0000","last_became_active":"2024-09-19T09:37:10.958397+0000","last_became_peered":"2024-09-19T09:37:10.958397+0000","last_unstale":"2024-09-19T09:38:56.512962+0000","last_undegraded":"2024-09-19T09:38:56.512962+0000","last_fullsized":"2024-09-19T09:38:56.512962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:37.690594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.505751+0000","last_change":"2024-09-19T09:37:10.964787+0000","last_active":"2024-09-19T09:38:56.505751+0000","last_peered":"2024-09-19T09:38:56.505751+0000","last_clean":"2024-09-19T09:38:56.505751+0000","last_became_active":"2024-09-19T09:37:10.964121+0000","last_became_peered":"2024-09-19T09:37:10.964121+0000","last_unstale":"2024-09-19T09:38:56.505751+0000","last_undegraded":"2024-09-19T09:38:56.505751+0000","last_fullsized":"2024-09-19T09:38:56.505751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:02.456961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507798+0000","last_change":"2024-09-19T09:37:10.963290+0000","last_active":"2024-09-19T09:38:56.507798+0000","last_peered":"2024-09-19T09:38:56.507798+0000","last_clean":"2024-09-19T09:38:56.507798+0000","last_became_active":"2024-09-19T09:37:10.962961+0000","last_became_peered":"2024-09-19T09:37:10.962961+0000","last_unstale":"2024-09-19T09:38:56.507798+0000","last_undegraded":"2024-09-19T09:38:56.507798+0000","last_fullsized":"2024-09-19T09:38:56.507798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.266745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510553+0000","last_change":"2024-09-19T09:37:10.969742+0000","last_active":"2024-09-19T09:38:56.510553+0000","last_peered":"2024-09-19T09:38:56.510553+0000","last_clean":"2024-09-19T09:38:56.510553+0000","last_became_active":"2024-09-19T09:37:10.969399+0000","last_became_peered":"2024-09-19T09:37:10.969399+0000","last_unstale":"2024-09-19T09:38:56.510553+0000","last_undegraded":"2024-09-19T09:38:56.510553+0000","last_fullsized":"2024-09-19T09:38:56.510553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.386596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504556+0000","last_change":"2024-09-19T09:37:10.962406+0000","last_active":"2024-09-19T09:38:56.504556+0000","last_peered":"2024-09-19T09:38:56.504556+0000","last_clean":"2024-09-19T09:38:56.504556+0000","last_became_active":"2024-09-19T09:37:10.962130+0000","last_became_peered":"2024-09-19T09:37:10.962130+0000","last_unstale":"2024-09-19T09:38:56.504556+0000","last_undegraded":"2024-09-19T09:38:56.504556+0000","last_fullsized":"2024-09-19T09:38:56.504556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.064080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516451+0000","last_change":"2024-09-19T09:37:10.958465+0000","last_active":"2024-09-19T09:38:56.516451+0000","last_peered":"2024-09-19T09:38:56.516451+0000","last_clean":"2024-09-19T09:38:56.516451+0000","last_became_active":"2024-09-19T09:37:10.957600+0000","last_became_peered":"2024-09-19T09:37:10.957600+0000","last_unstale":"2024-09-19T09:38:56.516451+0000","last_undegraded":"2024-09-19T09:38:56.516451+0000","last_fullsized":"2024-09-19T09:38:56.516451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:39.232483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515449+0000","last_change":"2024-09-19T09:37:10.965463+0000","last_active":"2024-09-19T09:38:56.515449+0000","last_peered":"2024-09-19T09:38:56.515449+0000","last_clean":"2024-09-19T09:38:56.515449+0000","last_became_active":"2024-09-19T09:37:10.965137+0000","last_became_peered":"2024-09-19T09:37:10.965137+0000","last_unstale":"2024-09-19T09:38:56.515449+0000","last_undegraded":"2024-09-19T09:38:56.515449+0000","last_fullsized":"2024-09-19T09:38:56.515449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:19.582515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.512633+0000","last_change":"2024-09-19T09:37:10.964897+0000","last_active":"2024-09-19T09:38:56.512633+0000","last_peered":"2024-09-19T09:38:56.512633+0000","last_clean":"2024-09-19T09:38:56.512633+0000","last_became_active":"2024-09-19T09:37:10.964527+0000","last_became_peered":"2024-09-19T09:37:10.964527+0000","last_unstale":"2024-09-19T09:38:56.512633+0000","last_undegraded":"2024-09-19T09:38:56.512633+0000","last_fullsized":"2024-09-19T09:38:56.512633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:29.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507468+0000","last_change":"2024-09-19T09:37:10.953645+0000","last_active":"2024-09-19T09:38:56.507468+0000","last_peered":"2024-09-19T09:38:56.507468+0000","last_clean":"2024-09-19T09:38:56.507468+0000","last_became_active":"2024-09-19T09:37:10.953326+0000","last_became_peered":"2024-09-19T09:37:10.953326+0000","last_unstale":"2024-09-19T09:38:56.507468+0000","last_undegraded":"2024-09-19T09:38:56.507468+0000","last_fullsized":"2024-09-19T09:38:56.507468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.644615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506388+0000","last_change":"2024-09-19T09:37:10.961384+0000","last_active":"2024-09-19T09:38:56.506388+0000","last_peered":"2024-09-19T09:38:56.506388+0000","last_clean":"2024-09-19T09:38:56.506388+0000","last_became_active":"2024-09-19T09:37:10.961038+0000","last_became_peered":"2024-09-19T09:37:10.961038+0000","last_unstale":"2024-09-19T09:38:56.506388+0000","last_undegraded":"2024-09-19T09:38:56.506388+0000","last_fullsized":"2024-09-19T09:38:56.506388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:54.876799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506443+0000","last_change":"2024-09-19T09:37:10.955789+0000","last_active":"2024-09-19T09:38:56.506443+0000","last_peered":"2024-09-19T09:38:56.506443+0000","last_clean":"2024-09-19T09:38:56.506443+0000","last_became_active":"2024-09-19T09:37:10.955447+0000","last_became_peered":"2024-09-19T09:37:10.955447+0000","last_unstale":"2024-09-19T09:38:56.506443+0000","last_undegraded":"2024-09-19T09:38:56.506443+0000","last_fullsized":"2024-09-19T09:38:56.506443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:28.512069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.516852+0000","last_change":"2024-09-19T09:37:10.956501+0000","last_active":"2024-09-19T09:38:56.516852+0000","last_peered":"2024-09-19T09:38:56.516852+0000","last_clean":"2024-09-19T09:38:56.516852+0000","last_became_active":"2024-09-19T09:37:10.956161+0000","last_became_peered":"2024-09-19T09:37:10.956161+0000","last_unstale":"2024-09-19T09:38:56.516852+0000","last_undegraded":"2024-09-19T09:38:56.516852+0000","last_fullsized":"2024-09-19T09:38:56.516852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:31.738143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510649+0000","last_change":"2024-09-19T09:37:10.961486+0000","last_active":"2024-09-19T09:38:56.510649+0000","last_peered":"2024-09-19T09:38:56.510649+0000","last_clean":"2024-09-19T09:38:56.510649+0000","last_became_active":"2024-09-19T09:37:10.960877+0000","last_became_peered":"2024-09-19T09:37:10.960877+0000","last_unstale":"2024-09-19T09:38:56.510649+0000","last_undegraded":"2024-09-19T09:38:56.510649+0000","last_fullsized":"2024-09-19T09:38:56.510649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:34.889431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509905+0000","last_change":"2024-09-19T09:37:10.964400+0000","last_active":"2024-09-19T09:38:56.509905+0000","last_peered":"2024-09-19T09:38:56.509905+0000","last_clean":"2024-09-19T09:38:56.509905+0000","last_became_active":"2024-09-19T09:37:10.963394+0000","last_became_peered":"2024-09-19T09:37:10.963394+0000","last_unstale":"2024-09-19T09:38:56.509905+0000","last_undegraded":"2024-09-19T09:38:56.509905+0000","last_fullsized":"2024-09-19T09:38:56.509905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:22.185221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509856+0000","last_change":"2024-09-19T09:37:10.959661+0000","last_active":"2024-09-19T09:38:56.509856+0000","last_peered":"2024-09-19T09:38:56.509856+0000","last_clean":"2024-09-19T09:38:56.509856+0000","last_became_active":"2024-09-19T09:37:10.959371+0000","last_became_peered":"2024-09-19T09:37:10.959371+0000","last_unstale":"2024-09-19T09:38:56.509856+0000","last_undegraded":"2024-09-19T09:38:56.509856+0000","last_fullsized":"2024-09-19T09:38:56.509856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.752712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514203+0000","last_change":"2024-09-19T09:37:10.967310+0000","last_active":"2024-09-19T09:38:56.514203+0000","last_peered":"2024-09-19T09:38:56.514203+0000","last_clean":"2024-09-19T09:38:56.514203+0000","last_became_active":"2024-09-19T09:37:10.965415+0000","last_became_peered":"2024-09-19T09:37:10.965415+0000","last_unstale":"2024-09-19T09:38:56.514203+0000","last_undegraded":"2024-09-19T09:38:56.514203+0000","last_fullsized":"2024-09-19T09:38:56.514203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:16.968646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497702+0000","last_change":"2024-09-19T09:37:10.967301+0000","last_active":"2024-09-19T09:38:56.497702+0000","last_peered":"2024-09-19T09:38:56.497702+0000","last_clean":"2024-09-19T09:38:56.497702+0000","last_became_active":"2024-09-19T09:37:10.966397+0000","last_became_peered":"2024-09-19T09:37:10.966397+0000","last_unstale":"2024-09-19T09:38:56.497702+0000","last_undegraded":"2024-09-19T09:38:56.497702+0000","last_fullsized":"2024-09-19T09:38:56.497702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.621085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509302+0000","last_change":"2024-09-19T09:37:10.958069+0000","last_active":"2024-09-19T09:38:56.509302+0000","last_peered":"2024-09-19T09:38:56.509302+0000","last_clean":"2024-09-19T09:38:56.509302+0000","last_became_active":"2024-09-19T09:37:10.957670+0000","last_became_peered":"2024-09-19T09:37:10.957670+0000","last_unstale":"2024-09-19T09:38:56.509302+0000","last_undegraded":"2024-09-19T09:38:56.509302+0000","last_fullsized":"2024-09-19T09:38:56.509302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.412978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503454+0000","last_change":"2024-09-19T09:37:10.960490+0000","last_active":"2024-09-19T09:38:56.503454+0000","last_peered":"2024-09-19T09:38:56.503454+0000","last_clean":"2024-09-19T09:38:56.503454+0000","last_became_active":"2024-09-19T09:37:10.960239+0000","last_became_peered":"2024-09-19T09:37:10.960239+0000","last_unstale":"2024-09-19T09:38:56.503454+0000","last_undegraded":"2024-09-19T09:38:56.503454+0000","last_fullsized":"2024-09-19T09:38:56.503454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.384348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507069+0000","last_change":"2024-09-19T09:37:10.955930+0000","last_active":"2024-09-19T09:38:56.507069+0000","last_peered":"2024-09-19T09:38:56.507069+0000","last_clean":"2024-09-19T09:38:56.507069+0000","last_became_active":"2024-09-19T09:37:10.955605+0000","last_became_peered":"2024-09-19T09:37:10.955605+0000","last_unstale":"2024-09-19T09:38:56.507069+0000","last_undegraded":"2024-09-19T09:38:56.507069+0000","last_fullsized":"2024-09-19T09:38:56.507069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:36.033350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502819+0000","last_change":"2024-09-19T09:37:10.960467+0000","last_active":"2024-09-19T09:38:56.502819+0000","last_peered":"2024-09-19T09:38:56.502819+0000","last_clean":"2024-09-19T09:38:56.502819+0000","last_became_active":"2024-09-19T09:37:10.960082+0000","last_became_peered":"2024-09-19T09:37:10.960082+0000","last_unstale":"2024-09-19T09:38:56.502819+0000","last_undegraded":"2024-09-19T09:38:56.502819+0000","last_fullsized":"2024-09-19T09:38:56.502819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:07.451648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498620+0000","last_change":"2024-09-19T09:37:10.965674+0000","last_active":"2024-09-19T09:38:56.498620+0000","last_peered":"2024-09-19T09:38:56.498620+0000","last_clean":"2024-09-19T09:38:56.498620+0000","last_became_active":"2024-09-19T09:37:10.965368+0000","last_became_peered":"2024-09-19T09:37:10.965368+0000","last_unstale":"2024-09-19T09:38:56.498620+0000","last_undegraded":"2024-09-19T09:38:56.498620+0000","last_fullsized":"2024-09-19T09:38:56.498620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:23.712785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.497701+0000","last_change":"2024-09-19T09:37:10.966972+0000","last_active":"2024-09-19T09:38:56.497701+0000","last_peered":"2024-09-19T09:38:56.497701+0000","last_clean":"2024-09-19T09:38:56.497701+0000","last_became_active":"2024-09-19T09:37:10.966642+0000","last_became_peered":"2024-09-19T09:37:10.966642+0000","last_unstale":"2024-09-19T09:38:56.497701+0000","last_undegraded":"2024-09-19T09:38:56.497701+0000","last_fullsized":"2024-09-19T09:38:56.497701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.416611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:07.157059+0000","last_change":"2024-09-19T09:37:08.953116+0000","last_active":"2024-09-19T09:39:07.157059+0000","last_peered":"2024-09-19T09:39:07.157059+0000","last_clean":"2024-09-19T09:39:07.157059+0000","last_became_active":"2024-09-19T09:37:08.952748+0000","last_became_peered":"2024-09-19T09:37:08.952748+0000","last_unstale":"2024-09-19T09:39:07.157059+0000","last_undegraded":"2024-09-19T09:39:07.157059+0000","last_fullsized":"2024-09-19T09:39:07.157059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:22.395359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509861+0000","last_change":"2024-09-19T09:37:10.969106+0000","last_active":"2024-09-19T09:38:56.509861+0000","last_peered":"2024-09-19T09:38:56.509861+0000","last_clean":"2024-09-19T09:38:56.509861+0000","last_became_active":"2024-09-19T09:37:10.968801+0000","last_became_peered":"2024-09-19T09:37:10.968801+0000","last_unstale":"2024-09-19T09:38:56.509861+0000","last_undegraded":"2024-09-19T09:38:56.509861+0000","last_fullsized":"2024-09-19T09:38:56.509861+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.674925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014739+0000","last_change":"2024-09-19T09:37:08.949604+0000","last_active":"2024-09-19T09:37:28.014739+0000","last_peered":"2024-09-19T09:37:28.014739+0000","last_clean":"2024-09-19T09:37:28.014739+0000","last_became_active":"2024-09-19T09:37:08.949143+0000","last_became_peered":"2024-09-19T09:37:08.949143+0000","last_unstale":"2024-09-19T09:37:28.014739+0000","last_undegraded":"2024-09-19T09:37:28.014739+0000","last_fullsized":"2024-09-19T09:37:28.014739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:37.933319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.012827+0000","last_change":"2024-09-19T09:37:08.946277+0000","last_active":"2024-09-19T09:37:28.012827+0000","last_peered":"2024-09-19T09:37:28.012827+0000","last_clean":"2024-09-19T09:37:28.012827+0000","last_became_active":"2024-09-19T09:37:08.945808+0000","last_became_peered":"2024-09-19T09:37:08.945808+0000","last_unstale":"2024-09-19T09:37:28.012827+0000","last_undegraded":"2024-09-19T09:37:28.012827+0000","last_fullsized":"2024-09-19T09:37:28.012827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.060811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511056+0000","last_change":"2024-09-19T09:37:10.957765+0000","last_active":"2024-09-19T09:38:56.511056+0000","last_peered":"2024-09-19T09:38:56.511056+0000","last_clean":"2024-09-19T09:38:56.511056+0000","last_became_active":"2024-09-19T09:37:10.957458+0000","last_became_peered":"2024-09-19T09:37:10.957458+0000","last_unstale":"2024-09-19T09:38:56.511056+0000","last_undegraded":"2024-09-19T09:38:56.511056+0000","last_fullsized":"2024-09-19T09:38:56.511056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:49.418473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020344+0000","last_change":"2024-09-19T09:37:08.953124+0000","last_active":"2024-09-19T09:37:28.020344+0000","last_peered":"2024-09-19T09:37:28.020344+0000","last_clean":"2024-09-19T09:37:28.020344+0000","last_became_active":"2024-09-19T09:37:08.952159+0000","last_became_peered":"2024-09-19T09:37:08.952159+0000","last_unstale":"2024-09-19T09:37:28.020344+0000","last_undegraded":"2024-09-19T09:37:28.020344+0000","last_fullsized":"2024-09-19T09:37:28.020344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:24.890377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509006+0000","last_change":"2024-09-19T09:37:10.964038+0000","last_active":"2024-09-19T09:38:56.509006+0000","last_peered":"2024-09-19T09:38:56.509006+0000","last_clean":"2024-09-19T09:38:56.509006+0000","last_became_active":"2024-09-19T09:37:10.963671+0000","last_became_peered":"2024-09-19T09:37:10.963671+0000","last_unstale":"2024-09-19T09:38:56.509006+0000","last_undegraded":"2024-09-19T09:38:56.509006+0000","last_fullsized":"2024-09-19T09:38:56.509006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:19.743329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":237,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:08.157779+0000","last_change":"2024-09-19T09:37:08.949600+0000","last_active":"2024-09-19T09:39:08.157779+0000","last_peered":"2024-09-19T09:39:08.157779+0000","last_clean":"2024-09-19T09:39:08.157779+0000","last_became_active":"2024-09-19T09:37:08.949141+0000","last_became_peered":"2024-09-19T09:37:08.949141+0000","last_unstale":"2024-09-19T09:39:08.157779+0000","last_undegraded":"2024-09-19T09:39:08.157779+0000","last_fullsized":"2024-09-19T09:39:08.157779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:42.297198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":211,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515006+0000","last_change":"2024-09-19T09:37:10.967506+0000","last_active":"2024-09-19T09:38:56.515006+0000","last_peered":"2024-09-19T09:38:56.515006+0000","last_clean":"2024-09-19T09:38:56.515006+0000","last_became_active":"2024-09-19T09:37:10.967193+0000","last_became_peered":"2024-09-19T09:37:10.967193+0000","last_unstale":"2024-09-19T09:38:56.515006+0000","last_undegraded":"2024-09-19T09:38:56.515006+0000","last_fullsized":"2024-09-19T09:38:56.515006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:33.158325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017606+0000","last_change":"2024-09-19T09:37:08.955305+0000","last_active":"2024-09-19T09:37:28.017606+0000","last_peered":"2024-09-19T09:37:28.017606+0000","last_clean":"2024-09-19T09:37:28.017606+0000","last_became_active":"2024-09-19T09:37:08.954932+0000","last_became_peered":"2024-09-19T09:37:08.954932+0000","last_unstale":"2024-09-19T09:37:28.017606+0000","last_undegraded":"2024-09-19T09:37:28.017606+0000","last_fullsized":"2024-09-19T09:37:28.017606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.157466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.502511+0000","last_change":"2024-09-19T09:37:28.021974+0000","last_active":"2024-09-19T09:38:56.502511+0000","last_peered":"2024-09-19T09:38:56.502511+0000","last_clean":"2024-09-19T09:38:56.502511+0000","last_became_active":"2024-09-19T09:37:28.021579+0000","last_became_peered":"2024-09-19T09:37:28.021579+0000","last_unstale":"2024-09-19T09:38:56.502511+0000","last_undegraded":"2024-09-19T09:38:56.502511+0000","last_fullsized":"2024-09-19T09:38:56.502511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:28.562862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021814+0000","last_change":"2024-09-19T09:37:08.976540+0000","last_active":"2024-09-19T09:37:28.021814+0000","last_peered":"2024-09-19T09:37:28.021814+0000","last_clean":"2024-09-19T09:37:28.021814+0000","last_became_active":"2024-09-19T09:37:08.976196+0000","last_became_peered":"2024-09-19T09:37:08.976196+0000","last_unstale":"2024-09-19T09:37:28.021814+0000","last_undegraded":"2024-09-19T09:37:28.021814+0000","last_fullsized":"2024-09-19T09:37:28.021814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:38.735947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515663+0000","last_change":"2024-09-19T09:37:28.021407+0000","last_active":"2024-09-19T09:38:56.515663+0000","last_peered":"2024-09-19T09:38:56.515663+0000","last_clean":"2024-09-19T09:38:56.515663+0000","last_became_active":"2024-09-19T09:37:28.021020+0000","last_became_peered":"2024-09-19T09:37:28.021020+0000","last_unstale":"2024-09-19T09:38:56.515663+0000","last_undegraded":"2024-09-19T09:38:56.515663+0000","last_fullsized":"2024-09-19T09:38:56.515663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:25.394012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'39","reported_seq":305,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:08.157809+0000","last_change":"2024-09-19T09:37:28.029037+0000","last_active":"2024-09-19T09:39:08.157809+0000","last_peered":"2024-09-19T09:39:08.157809+0000","last_clean":"2024-09-19T09:39:08.157809+0000","last_became_active":"2024-09-19T09:37:28.018325+0000","last_became_peered":"2024-09-19T09:37:28.018325+0000","last_unstale":"2024-09-19T09:39:08.157809+0000","last_undegraded":"2024-09-19T09:39:08.157809+0000","last_fullsized":"2024-09-19T09:39:08.157809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:56.121569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71153,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":182,"num_write":41,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.492834+0000","last_change":"2024-09-19T09:37:10.963688+0000","last_active":"2024-09-19T09:38:56.492834+0000","last_peered":"2024-09-19T09:38:56.492834+0000","last_clean":"2024-09-19T09:38:56.492834+0000","last_became_active":"2024-09-19T09:37:10.963296+0000","last_became_peered":"2024-09-19T09:37:10.963296+0000","last_unstale":"2024-09-19T09:38:56.492834+0000","last_undegraded":"2024-09-19T09:38:56.492834+0000","last_fullsized":"2024-09-19T09:38:56.492834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:49.902384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015183+0000","last_change":"2024-09-19T09:37:08.952198+0000","last_active":"2024-09-19T09:37:28.015183+0000","last_peered":"2024-09-19T09:37:28.015183+0000","last_clean":"2024-09-19T09:37:28.015183+0000","last_became_active":"2024-09-19T09:37:08.951699+0000","last_became_peered":"2024-09-19T09:37:08.951699+0000","last_unstale":"2024-09-19T09:37:28.015183+0000","last_undegraded":"2024-09-19T09:37:28.015183+0000","last_fullsized":"2024-09-19T09:37:28.015183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:46.729847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510576+0000","last_change":"2024-09-19T09:37:10.955741+0000","last_active":"2024-09-19T09:38:56.510576+0000","last_peered":"2024-09-19T09:38:56.510576+0000","last_clean":"2024-09-19T09:38:56.510576+0000","last_became_active":"2024-09-19T09:37:10.955394+0000","last_became_peered":"2024-09-19T09:37:10.955394+0000","last_unstale":"2024-09-19T09:38:56.510576+0000","last_undegraded":"2024-09-19T09:38:56.510576+0000","last_fullsized":"2024-09-19T09:38:56.510576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:56.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021172+0000","last_change":"2024-09-19T09:37:08.949979+0000","last_active":"2024-09-19T09:37:28.021172+0000","last_peered":"2024-09-19T09:37:28.021172+0000","last_clean":"2024-09-19T09:37:28.021172+0000","last_became_active":"2024-09-19T09:37:08.949664+0000","last_became_peered":"2024-09-19T09:37:08.949664+0000","last_unstale":"2024-09-19T09:37:28.021172+0000","last_undegraded":"2024-09-19T09:37:28.021172+0000","last_fullsized":"2024-09-19T09:37:28.021172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:06.449337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509647+0000","last_change":"2024-09-19T09:37:10.957479+0000","last_active":"2024-09-19T09:38:56.509647+0000","last_peered":"2024-09-19T09:38:56.509647+0000","last_clean":"2024-09-19T09:38:56.509647+0000","last_became_active":"2024-09-19T09:37:10.957130+0000","last_became_peered":"2024-09-19T09:37:10.957130+0000","last_unstale":"2024-09-19T09:38:56.509647+0000","last_undegraded":"2024-09-19T09:38:56.509647+0000","last_fullsized":"2024-09-19T09:38:56.509647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:52.840857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'8","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:07.169232+0000","last_change":"2024-09-19T09:37:08.951558+0000","last_active":"2024-09-19T09:39:07.169232+0000","last_peered":"2024-09-19T09:39:07.169232+0000","last_clean":"2024-09-19T09:39:07.169232+0000","last_became_active":"2024-09-19T09:37:08.951092+0000","last_became_peered":"2024-09-19T09:37:08.951092+0000","last_unstale":"2024-09-19T09:39:07.169232+0000","last_undegraded":"2024-09-19T09:39:07.169232+0000","last_fullsized":"2024-09-19T09:39:07.169232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:30.326253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.503051+0000","last_change":"2024-09-19T09:37:10.962692+0000","last_active":"2024-09-19T09:38:56.503051+0000","last_peered":"2024-09-19T09:38:56.503051+0000","last_clean":"2024-09-19T09:38:56.503051+0000","last_became_active":"2024-09-19T09:37:10.962145+0000","last_became_peered":"2024-09-19T09:37:10.962145+0000","last_unstale":"2024-09-19T09:38:56.503051+0000","last_undegraded":"2024-09-19T09:38:56.503051+0000","last_fullsized":"2024-09-19T09:38:56.503051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:48.232759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020176+0000","last_change":"2024-09-19T09:37:08.976531+0000","last_active":"2024-09-19T09:37:28.020176+0000","last_peered":"2024-09-19T09:37:28.020176+0000","last_clean":"2024-09-19T09:37:28.020176+0000","last_became_active":"2024-09-19T09:37:08.975892+0000","last_became_peered":"2024-09-19T09:37:08.975892+0000","last_unstale":"2024-09-19T09:37:28.020176+0000","last_undegraded":"2024-09-19T09:37:28.020176+0000","last_fullsized":"2024-09-19T09:37:28.020176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.545504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508392+0000","last_change":"2024-09-19T09:37:10.968116+0000","last_active":"2024-09-19T09:38:56.508392+0000","last_peered":"2024-09-19T09:38:56.508392+0000","last_clean":"2024-09-19T09:38:56.508392+0000","last_became_active":"2024-09-19T09:37:10.967767+0000","last_became_peered":"2024-09-19T09:37:10.967767+0000","last_unstale":"2024-09-19T09:38:56.508392+0000","last_undegraded":"2024-09-19T09:38:56.508392+0000","last_fullsized":"2024-09-19T09:38:56.508392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:34.104712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020842+0000","last_change":"2024-09-19T09:37:08.949384+0000","last_active":"2024-09-19T09:37:28.020842+0000","last_peered":"2024-09-19T09:37:28.020842+0000","last_clean":"2024-09-19T09:37:28.020842+0000","last_became_active":"2024-09-19T09:37:08.948950+0000","last_became_peered":"2024-09-19T09:37:08.948950+0000","last_unstale":"2024-09-19T09:37:28.020842+0000","last_undegraded":"2024-09-19T09:37:28.020842+0000","last_fullsized":"2024-09-19T09:37:28.020842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:15.527608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.506196+0000","last_change":"2024-09-19T09:37:10.965720+0000","last_active":"2024-09-19T09:38:56.506196+0000","last_peered":"2024-09-19T09:38:56.506196+0000","last_clean":"2024-09-19T09:38:56.506196+0000","last_became_active":"2024-09-19T09:37:10.965341+0000","last_became_peered":"2024-09-19T09:37:10.965341+0000","last_unstale":"2024-09-19T09:38:56.506196+0000","last_undegraded":"2024-09-19T09:38:56.506196+0000","last_fullsized":"2024-09-19T09:38:56.506196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:36.591438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013189+0000","last_change":"2024-09-19T09:37:08.953702+0000","last_active":"2024-09-19T09:37:28.013189+0000","last_peered":"2024-09-19T09:37:28.013189+0000","last_clean":"2024-09-19T09:37:28.013189+0000","last_became_active":"2024-09-19T09:37:08.953312+0000","last_became_peered":"2024-09-19T09:37:08.953312+0000","last_unstale":"2024-09-19T09:37:28.013189+0000","last_undegraded":"2024-09-19T09:37:28.013189+0000","last_fullsized":"2024-09-19T09:37:28.013189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:54.059096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498384+0000","last_change":"2024-09-19T09:37:10.959814+0000","last_active":"2024-09-19T09:38:56.498384+0000","last_peered":"2024-09-19T09:38:56.498384+0000","last_clean":"2024-09-19T09:38:56.498384+0000","last_became_active":"2024-09-19T09:37:10.959342+0000","last_became_peered":"2024-09-19T09:37:10.959342+0000","last_unstale":"2024-09-19T09:38:56.498384+0000","last_undegraded":"2024-09-19T09:38:56.498384+0000","last_fullsized":"2024-09-19T09:38:56.498384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.021892+0000","last_change":"2024-09-19T09:37:08.947978+0000","last_active":"2024-09-19T09:37:28.021892+0000","last_peered":"2024-09-19T09:37:28.021892+0000","last_clean":"2024-09-19T09:37:28.021892+0000","last_became_active":"2024-09-19T09:37:08.947548+0000","last_became_peered":"2024-09-19T09:37:08.947548+0000","last_unstale":"2024-09-19T09:37:28.021892+0000","last_undegraded":"2024-09-19T09:37:28.021892+0000","last_fullsized":"2024-09-19T09:37:28.021892+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:38.283616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509716+0000","last_change":"2024-09-19T09:37:10.964008+0000","last_active":"2024-09-19T09:38:56.509716+0000","last_peered":"2024-09-19T09:38:56.509716+0000","last_clean":"2024-09-19T09:38:56.509716+0000","last_became_active":"2024-09-19T09:37:10.963554+0000","last_became_peered":"2024-09-19T09:37:10.963554+0000","last_unstale":"2024-09-19T09:38:56.509716+0000","last_undegraded":"2024-09-19T09:38:56.509716+0000","last_fullsized":"2024-09-19T09:38:56.509716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:57.320967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'5","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:07.167692+0000","last_change":"2024-09-19T09:37:28.027589+0000","last_active":"2024-09-19T09:39:07.167692+0000","last_peered":"2024-09-19T09:39:07.167692+0000","last_clean":"2024-09-19T09:39:07.167692+0000","last_became_active":"2024-09-19T09:37:28.020013+0000","last_became_peered":"2024-09-19T09:37:28.020013+0000","last_unstale":"2024-09-19T09:39:07.167692+0000","last_undegraded":"2024-09-19T09:39:07.167692+0000","last_fullsized":"2024-09-19T09:39:07.167692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:51.327069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.513503+0000","last_change":"2024-09-19T09:37:10.960337+0000","last_active":"2024-09-19T09:38:56.513503+0000","last_peered":"2024-09-19T09:38:56.513503+0000","last_clean":"2024-09-19T09:38:56.513503+0000","last_became_active":"2024-09-19T09:37:10.960006+0000","last_became_peered":"2024-09-19T09:37:10.960006+0000","last_unstale":"2024-09-19T09:38:56.513503+0000","last_undegraded":"2024-09-19T09:38:56.513503+0000","last_fullsized":"2024-09-19T09:38:56.513503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:16.942098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.019301+0000","last_change":"2024-09-19T09:36:01.923601+0000","last_active":"2024-09-19T09:37:28.019301+0000","last_peered":"2024-09-19T09:37:28.019301+0000","last_clean":"2024-09-19T09:37:28.019301+0000","last_became_active":"2024-09-19T09:36:01.923051+0000","last_became_peered":"2024-09-19T09:36:01.923051+0000","last_unstale":"2024-09-19T09:37:28.019301+0000","last_undegraded":"2024-09-19T09:37:28.019301+0000","last_fullsized":"2024-09-19T09:37:28.019301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:32:45.321588+0000","last_clean_scrub_stamp":"2024-09-19T09:32:45.321588+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:41.635565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013536+0000","last_change":"2024-09-19T09:37:08.948818+0000","last_active":"2024-09-19T09:37:28.013536+0000","last_peered":"2024-09-19T09:37:28.013536+0000","last_clean":"2024-09-19T09:37:28.013536+0000","last_became_active":"2024-09-19T09:37:08.948494+0000","last_became_peered":"2024-09-19T09:37:08.948494+0000","last_unstale":"2024-09-19T09:37:28.013536+0000","last_undegraded":"2024-09-19T09:37:28.013536+0000","last_fullsized":"2024-09-19T09:37:28.013536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:35.255778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.514837+0000","last_change":"2024-09-19T09:37:10.966315+0000","last_active":"2024-09-19T09:38:56.514837+0000","last_peered":"2024-09-19T09:38:56.514837+0000","last_clean":"2024-09-19T09:38:56.514837+0000","last_became_active":"2024-09-19T09:37:10.965979+0000","last_became_peered":"2024-09-19T09:37:10.965979+0000","last_unstale":"2024-09-19T09:38:56.514837+0000","last_undegraded":"2024-09-19T09:38:56.514837+0000","last_fullsized":"2024-09-19T09:38:56.514837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:36.229434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.030136+0000","last_change":"2024-09-19T09:37:28.029598+0000","last_active":"2024-09-19T09:37:28.030136+0000","last_peered":"2024-09-19T09:37:28.030136+0000","last_clean":"2024-09-19T09:37:28.030136+0000","last_became_active":"2024-09-19T09:37:28.021459+0000","last_became_peered":"2024-09-19T09:37:28.021459+0000","last_unstale":"2024-09-19T09:37:28.030136+0000","last_undegraded":"2024-09-19T09:37:28.030136+0000","last_fullsized":"2024-09-19T09:37:28.030136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:00.755946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.507049+0000","last_change":"2024-09-19T09:37:10.962825+0000","last_active":"2024-09-19T09:38:56.507049+0000","last_peered":"2024-09-19T09:38:56.507049+0000","last_clean":"2024-09-19T09:38:56.507049+0000","last_became_active":"2024-09-19T09:37:10.962475+0000","last_became_peered":"2024-09-19T09:37:10.962475+0000","last_unstale":"2024-09-19T09:38:56.507049+0000","last_undegraded":"2024-09-19T09:38:56.507049+0000","last_fullsized":"2024-09-19T09:38:56.507049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:30.650918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'6","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:11.175385+0000","last_change":"2024-09-19T09:37:08.976364+0000","last_active":"2024-09-19T09:39:11.175385+0000","last_peered":"2024-09-19T09:39:11.175385+0000","last_clean":"2024-09-19T09:39:11.175385+0000","last_became_active":"2024-09-19T09:37:08.975983+0000","last_became_peered":"2024-09-19T09:37:08.975983+0000","last_unstale":"2024-09-19T09:39:11.175385+0000","last_undegraded":"2024-09-19T09:39:11.175385+0000","last_fullsized":"2024-09-19T09:39:11.175385+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.762847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.489815+0000","last_change":"2024-09-19T09:37:28.020341+0000","last_active":"2024-09-19T09:38:56.489815+0000","last_peered":"2024-09-19T09:38:56.489815+0000","last_clean":"2024-09-19T09:38:56.489815+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:38:56.489815+0000","last_undegraded":"2024-09-19T09:38:56.489815+0000","last_fullsized":"2024-09-19T09:38:56.489815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:24.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'8","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:10.160503+0000","last_change":"2024-09-19T09:37:08.950403+0000","last_active":"2024-09-19T09:39:10.160503+0000","last_peered":"2024-09-19T09:39:10.160503+0000","last_clean":"2024-09-19T09:39:10.160503+0000","last_became_active":"2024-09-19T09:37:08.950077+0000","last_became_peered":"2024-09-19T09:37:08.950077+0000","last_unstale":"2024-09-19T09:39:10.160503+0000","last_undegraded":"2024-09-19T09:39:10.160503+0000","last_fullsized":"2024-09-19T09:39:10.160503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:46.446439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509036+0000","last_change":"2024-09-19T09:37:10.969493+0000","last_active":"2024-09-19T09:38:56.509036+0000","last_peered":"2024-09-19T09:38:56.509036+0000","last_clean":"2024-09-19T09:38:56.509036+0000","last_became_active":"2024-09-19T09:37:10.969038+0000","last_became_peered":"2024-09-19T09:37:10.969038+0000","last_unstale":"2024-09-19T09:38:56.509036+0000","last_undegraded":"2024-09-19T09:38:56.509036+0000","last_fullsized":"2024-09-19T09:38:56.509036+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:55.518806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015137+0000","last_change":"2024-09-19T09:37:08.977207+0000","last_active":"2024-09-19T09:37:28.015137+0000","last_peered":"2024-09-19T09:37:28.015137+0000","last_clean":"2024-09-19T09:37:28.015137+0000","last_became_active":"2024-09-19T09:37:08.976859+0000","last_became_peered":"2024-09-19T09:37:08.976859+0000","last_unstale":"2024-09-19T09:37:28.015137+0000","last_undegraded":"2024-09-19T09:37:28.015137+0000","last_fullsized":"2024-09-19T09:37:28.015137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:25.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.504626+0000","last_change":"2024-09-19T09:37:28.023437+0000","last_active":"2024-09-19T09:38:56.504626+0000","last_peered":"2024-09-19T09:38:56.504626+0000","last_clean":"2024-09-19T09:38:56.504626+0000","last_became_active":"2024-09-19T09:37:28.018678+0000","last_became_peered":"2024-09-19T09:37:28.018678+0000","last_unstale":"2024-09-19T09:38:56.504626+0000","last_undegraded":"2024-09-19T09:38:56.504626+0000","last_fullsized":"2024-09-19T09:38:56.504626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:44.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020845+0000","last_change":"2024-09-19T09:37:08.976594+0000","last_active":"2024-09-19T09:37:28.020845+0000","last_peered":"2024-09-19T09:37:28.020845+0000","last_clean":"2024-09-19T09:37:28.020845+0000","last_became_active":"2024-09-19T09:37:08.976222+0000","last_became_peered":"2024-09-19T09:37:08.976222+0000","last_unstale":"2024-09-19T09:37:28.020845+0000","last_undegraded":"2024-09-19T09:37:28.020845+0000","last_fullsized":"2024-09-19T09:37:28.020845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:53.492591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498775+0000","last_change":"2024-09-19T09:37:10.957096+0000","last_active":"2024-09-19T09:38:56.498775+0000","last_peered":"2024-09-19T09:38:56.498775+0000","last_clean":"2024-09-19T09:38:56.498775+0000","last_became_active":"2024-09-19T09:37:10.956740+0000","last_became_peered":"2024-09-19T09:37:10.956740+0000","last_unstale":"2024-09-19T09:38:56.498775+0000","last_undegraded":"2024-09-19T09:38:56.498775+0000","last_fullsized":"2024-09-19T09:38:56.498775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:40.358624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'17","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:58.032479+0000","last_change":"2024-09-19T09:37:08.948528+0000","last_active":"2024-09-19T09:38:58.032479+0000","last_peered":"2024-09-19T09:38:58.032479+0000","last_clean":"2024-09-19T09:38:58.032479+0000","last_became_active":"2024-09-19T09:37:08.948183+0000","last_became_peered":"2024-09-19T09:37:08.948183+0000","last_unstale":"2024-09-19T09:38:58.032479+0000","last_undegraded":"2024-09-19T09:38:58.032479+0000","last_fullsized":"2024-09-19T09:38:58.032479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:23.214471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508526+0000","last_change":"2024-09-19T09:37:10.959492+0000","last_active":"2024-09-19T09:38:56.508526+0000","last_peered":"2024-09-19T09:38:56.508526+0000","last_clean":"2024-09-19T09:38:56.508526+0000","last_became_active":"2024-09-19T09:37:10.959032+0000","last_became_peered":"2024-09-19T09:37:10.959032+0000","last_unstale":"2024-09-19T09:38:56.508526+0000","last_undegraded":"2024-09-19T09:38:56.508526+0000","last_fullsized":"2024-09-19T09:38:56.508526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.080976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.013794+0000","last_change":"2024-09-19T09:37:09.270315+0000","last_active":"2024-09-19T09:37:28.013794+0000","last_peered":"2024-09-19T09:37:28.013794+0000","last_clean":"2024-09-19T09:37:28.013794+0000","last_became_active":"2024-09-19T09:37:09.269891+0000","last_became_peered":"2024-09-19T09:37:09.269891+0000","last_unstale":"2024-09-19T09:37:28.013794+0000","last_undegraded":"2024-09-19T09:37:28.013794+0000","last_fullsized":"2024-09-19T09:37:28.013794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:12.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.509933+0000","last_change":"2024-09-19T09:37:10.961363+0000","last_active":"2024-09-19T09:38:56.509933+0000","last_peered":"2024-09-19T09:38:56.509933+0000","last_clean":"2024-09-19T09:38:56.509933+0000","last_became_active":"2024-09-19T09:37:10.960951+0000","last_became_peered":"2024-09-19T09:37:10.960951+0000","last_unstale":"2024-09-19T09:38:56.509933+0000","last_undegraded":"2024-09-19T09:38:56.509933+0000","last_fullsized":"2024-09-19T09:38:56.509933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:31.226355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.015555+0000","last_change":"2024-09-19T09:37:08.976805+0000","last_active":"2024-09-19T09:37:28.015555+0000","last_peered":"2024-09-19T09:37:28.015555+0000","last_clean":"2024-09-19T09:37:28.015555+0000","last_became_active":"2024-09-19T09:37:08.976502+0000","last_became_peered":"2024-09-19T09:37:08.976502+0000","last_unstale":"2024-09-19T09:37:28.015555+0000","last_undegraded":"2024-09-19T09:37:28.015555+0000","last_fullsized":"2024-09-19T09:37:28.015555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:25.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.470670+0000","last_change":"2024-09-19T09:37:10.965723+0000","last_active":"2024-09-19T09:38:56.470670+0000","last_peered":"2024-09-19T09:38:56.470670+0000","last_clean":"2024-09-19T09:38:56.470670+0000","last_became_active":"2024-09-19T09:37:10.965385+0000","last_became_peered":"2024-09-19T09:37:10.965385+0000","last_unstale":"2024-09-19T09:38:56.470670+0000","last_undegraded":"2024-09-19T09:38:56.470670+0000","last_fullsized":"2024-09-19T09:38:56.470670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:15.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.017690+0000","last_change":"2024-09-19T09:37:08.948028+0000","last_active":"2024-09-19T09:37:28.017690+0000","last_peered":"2024-09-19T09:37:28.017690+0000","last_clean":"2024-09-19T09:37:28.017690+0000","last_became_active":"2024-09-19T09:37:08.947583+0000","last_became_peered":"2024-09-19T09:37:08.947583+0000","last_unstale":"2024-09-19T09:37:28.017690+0000","last_undegraded":"2024-09-19T09:37:28.017690+0000","last_fullsized":"2024-09-19T09:37:28.017690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:15.485850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.498875+0000","last_change":"2024-09-19T09:37:10.964577+0000","last_active":"2024-09-19T09:38:56.498875+0000","last_peered":"2024-09-19T09:38:56.498875+0000","last_clean":"2024-09-19T09:38:56.498875+0000","last_became_active":"2024-09-19T09:37:10.964226+0000","last_became_peered":"2024-09-19T09:37:10.964226+0000","last_unstale":"2024-09-19T09:38:56.498875+0000","last_undegraded":"2024-09-19T09:38:56.498875+0000","last_fullsized":"2024-09-19T09:38:56.498875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:44.074286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.014911+0000","last_change":"2024-09-19T09:37:08.952257+0000","last_active":"2024-09-19T09:37:28.014911+0000","last_peered":"2024-09-19T09:37:28.014911+0000","last_clean":"2024-09-19T09:37:28.014911+0000","last_became_active":"2024-09-19T09:37:08.951056+0000","last_became_peered":"2024-09-19T09:37:08.951056+0000","last_unstale":"2024-09-19T09:37:28.014911+0000","last_undegraded":"2024-09-19T09:37:28.014911+0000","last_fullsized":"2024-09-19T09:37:28.014911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:35.238551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.511292+0000","last_change":"2024-09-19T09:37:10.965956+0000","last_active":"2024-09-19T09:38:56.511292+0000","last_peered":"2024-09-19T09:38:56.511292+0000","last_clean":"2024-09-19T09:38:56.511292+0000","last_became_active":"2024-09-19T09:37:10.965367+0000","last_became_peered":"2024-09-19T09:37:10.965367+0000","last_unstale":"2024-09-19T09:38:56.511292+0000","last_undegraded":"2024-09-19T09:38:56.511292+0000","last_fullsized":"2024-09-19T09:38:56.511292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:23.280106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.027523+0000","last_change":"2024-09-19T09:37:28.026998+0000","last_active":"2024-09-19T09:37:28.027523+0000","last_peered":"2024-09-19T09:37:28.027523+0000","last_clean":"2024-09-19T09:37:28.027523+0000","last_became_active":"2024-09-19T09:37:28.021169+0000","last_became_peered":"2024-09-19T09:37:28.021169+0000","last_unstale":"2024-09-19T09:37:28.027523+0000","last_undegraded":"2024-09-19T09:37:28.027523+0000","last_fullsized":"2024-09-19T09:37:28.027523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.876143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.513741+0000","last_change":"2024-09-19T09:37:10.959937+0000","last_active":"2024-09-19T09:38:56.513741+0000","last_peered":"2024-09-19T09:38:56.513741+0000","last_clean":"2024-09-19T09:38:56.513741+0000","last_became_active":"2024-09-19T09:37:10.959466+0000","last_became_peered":"2024-09-19T09:37:10.959466+0000","last_unstale":"2024-09-19T09:38:56.513741+0000","last_undegraded":"2024-09-19T09:38:56.513741+0000","last_fullsized":"2024-09-19T09:38:56.513741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:13.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508964+0000","last_change":"2024-09-19T09:37:10.966737+0000","last_active":"2024-09-19T09:38:56.508964+0000","last_peered":"2024-09-19T09:38:56.508964+0000","last_clean":"2024-09-19T09:38:56.508964+0000","last_became_active":"2024-09-19T09:37:10.966436+0000","last_became_peered":"2024-09-19T09:37:10.966436+0000","last_unstale":"2024-09-19T09:38:56.508964+0000","last_undegraded":"2024-09-19T09:38:56.508964+0000","last_fullsized":"2024-09-19T09:38:56.508964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:05.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020657+0000","last_change":"2024-09-19T09:37:08.950225+0000","last_active":"2024-09-19T09:37:28.020657+0000","last_peered":"2024-09-19T09:37:28.020657+0000","last_clean":"2024-09-19T09:37:28.020657+0000","last_became_active":"2024-09-19T09:37:08.949855+0000","last_became_peered":"2024-09-19T09:37:08.949855+0000","last_unstale":"2024-09-19T09:37:28.020657+0000","last_undegraded":"2024-09-19T09:37:28.020657+0000","last_fullsized":"2024-09-19T09:37:28.020657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:12.315407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.515631+0000","last_change":"2024-09-19T09:37:10.965763+0000","last_active":"2024-09-19T09:38:56.515631+0000","last_peered":"2024-09-19T09:38:56.515631+0000","last_clean":"2024-09-19T09:38:56.515631+0000","last_became_active":"2024-09-19T09:37:10.965425+0000","last_became_peered":"2024-09-19T09:37:10.965425+0000","last_unstale":"2024-09-19T09:38:56.515631+0000","last_undegraded":"2024-09-19T09:38:56.515631+0000","last_fullsized":"2024-09-19T09:38:56.515631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:34.474506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'13","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.020863+0000","last_change":"2024-09-19T09:37:08.954211+0000","last_active":"2024-09-19T09:37:28.020863+0000","last_peered":"2024-09-19T09:37:28.020863+0000","last_clean":"2024-09-19T09:37:28.020863+0000","last_became_active":"2024-09-19T09:37:08.953869+0000","last_became_peered":"2024-09-19T09:37:08.953869+0000","last_unstale":"2024-09-19T09:37:28.020863+0000","last_undegraded":"2024-09-19T09:37:28.020863+0000","last_fullsized":"2024-09-19T09:37:28.020863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:10.650227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.508638+0000","last_change":"2024-09-19T09:37:10.957032+0000","last_active":"2024-09-19T09:38:56.508638+0000","last_peered":"2024-09-19T09:38:56.508638+0000","last_clean":"2024-09-19T09:38:56.508638+0000","last_became_active":"2024-09-19T09:37:10.955979+0000","last_became_peered":"2024-09-19T09:37:10.955979+0000","last_unstale":"2024-09-19T09:38:56.508638+0000","last_undegraded":"2024-09-19T09:38:56.508638+0000","last_fullsized":"2024-09-19T09:38:56.508638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.734353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:37:28.018090+0000","last_change":"2024-09-19T09:37:08.976359+0000","last_active":"2024-09-19T09:37:28.018090+0000","last_peered":"2024-09-19T09:37:28.018090+0000","last_clean":"2024-09-19T09:37:28.018090+0000","last_became_active":"2024-09-19T09:37:08.976019+0000","last_became_peered":"2024-09-19T09:37:08.976019+0000","last_unstale":"2024-09-19T09:37:28.018090+0000","last_undegraded":"2024-09-19T09:37:28.018090+0000","last_fullsized":"2024-09-19T09:37:28.018090+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:34.401585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:38:56.510097+0000","last_change":"2024-09-19T09:37:10.954000+0000","last_active":"2024-09-19T09:38:56.510097+0000","last_peered":"2024-09-19T09:38:56.510097+0000","last_clean":"2024-09-19T09:38:56.510097+0000","last_became_active":"2024-09-19T09:37:10.953709+0000","last_became_peered":"2024-09-19T09:37:10.953709+0000","last_unstale":"2024-09-19T09:38:56.510097+0000","last_undegraded":"2024-09-19T09:38:56.510097+0000","last_fullsized":"2024-09-19T09:38:56.510097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:09.938815+0000","last_clean_scrub_stamp":"2024-09-19T09:37:09.938815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:36.779680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'14","reported_seq":164,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:39:08.157529+0000","last_change":"2024-09-19T09:37:28.036392+0000","last_active":"2024-09-19T09:39:08.157529+0000","last_peered":"2024-09-19T09:39:08.157529+0000","last_clean":"2024-09-19T09:39:08.157529+0000","last_became_active":"2024-09-19T09:37:28.019996+0000","last_became_peered":"2024-09-19T09:37:28.019996+0000","last_unstale":"2024-09-19T09:39:08.157529+0000","last_undegraded":"2024-09-19T09:39:08.157529+0000","last_fullsized":"2024-09-19T09:39:08.157529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:37:07.933008+0000","last_clean_scrub_stamp":"2024-09-19T09:37:07.933008+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:56.344807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":79429,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1103,"num_read_kb":640,"num_write":265,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":28789,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":238287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612645,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":437286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841576,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1617920,"data_stored":1100395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005103,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266740,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495672,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659198,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":437860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051655,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":510044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280587,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":436641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476817,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607638,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":510598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40416,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704736,"statfs":{"total":95995035648,"available":95953649664,"internally_reserved":0,"allocated":933888,"data_stored":438272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":74504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":73950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":73816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:39:13.625 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:13 smithi136 ceph-mon[34840]: pgmap v334: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-19T09:39:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:13 smithi136 ceph-mon[34840]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:13.889 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:13.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:13 smithi042 ceph-mon[31223]: pgmap v334: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-19T09:39:13.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:13 smithi042 ceph-mon[31223]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:14.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:13 smithi171 ceph-mon[35803]: pgmap v334: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-19T09:39:14.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:13 smithi171 ceph-mon[35803]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:39:14.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.393+0000 7fe74a386640 1 -- 172.21.15.42:0/1968793610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe744101de0 msgr2=0x7fe7441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.393+0000 7fe74a386640 1 --2- 172.21.15.42:0/1968793610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe744101de0 0x7fe7441021c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe734009900 tx=0x7fe73402a410 comp rx=0 tx=0).stop 2024-09-19T09:39:14.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.393+0000 7fe74a386640 1 -- 172.21.15.42:0/1968793610 shutdown_connections 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.393+0000 7fe74a386640 1 --2- 172.21.15.42:0/1968793610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe744106f10 0x7fe74410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.393+0000 7fe74a386640 1 --2- 172.21.15.42:0/1968793610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744102790 0x7fe7441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.393+0000 7fe74a386640 1 --2- 172.21.15.42:0/1968793610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe744101de0 0x7fe7441021c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.393+0000 7fe74a386640 1 -- 172.21.15.42:0/1968793610 >> 172.21.15.42:0/1968793610 conn(0x7fe7440fd8c0 msgr2=0x7fe7440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.393+0000 7fe74a386640 1 -- 172.21.15.42:0/1968793610 shutdown_connections 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.393+0000 7fe74a386640 1 -- 172.21.15.42:0/1968793610 wait complete. 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe74a386640 1 Processor -- start 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe74a386640 1 -- start start 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe74a386640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe744101de0 0x7fe7441984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe74a386640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe744102790 0x7fe744198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe74a386640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744106f10 0x7fe74419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe74a386640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe744111fb0 con 0x7fe744102790 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe74a386640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe744111e30 con 0x7fe744101de0 2024-09-19T09:39:14.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe74a386640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe744112130 con 0x7fe744106f10 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe7437fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe744102790 0x7fe744198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe7437fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe744102790 0x7fe744198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59408/0 (socket says 172.21.15.42:59408) 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.394+0000 7fe7437fe640 1 -- 172.21.15.42:0/3528150584 learned_addr learned my addr 172.21.15.42:0/3528150584 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe743fff640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe744101de0 0x7fe7441984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe748923640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744106f10 0x7fe74419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe7437fe640 1 -- 172.21.15.42:0/3528150584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744106f10 msgr2=0x7fe74419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe7437fe640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744106f10 0x7fe74419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe7437fe640 1 -- 172.21.15.42:0/3528150584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe744101de0 msgr2=0x7fe7441984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe7437fe640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe744101de0 0x7fe7441984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe7437fe640 1 -- 172.21.15.42:0/3528150584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74419d4a0 con 0x7fe744102790 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe743fff640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe744101de0 0x7fe7441984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe7437fe640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe744102790 0x7fe744198a30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe73800d770 tx=0x7fe73800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe7417fa640 1 -- 172.21.15.42:0/3528150584 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738017070 con 0x7fe744102790 2024-09-19T09:39:14.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe74a386640 1 -- 172.21.15.42:0/3528150584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74419d790 con 0x7fe744102790 2024-09-19T09:39:14.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe7417fa640 1 -- 172.21.15.42:0/3528150584 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe738005500 con 0x7fe744102790 2024-09-19T09:39:14.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe7417fa640 1 -- 172.21.15.42:0/3528150584 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738004e00 con 0x7fe744102790 2024-09-19T09:39:14.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.395+0000 7fe74a386640 1 -- 172.21.15.42:0/3528150584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7441a5070 con 0x7fe744102790 2024-09-19T09:39:14.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.396+0000 7fe74a386640 1 -- 172.21.15.42:0/3528150584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7441021c0 con 0x7fe744102790 2024-09-19T09:39:14.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.398+0000 7fe7417fa640 1 -- 172.21.15.42:0/3528150584 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fe738004fa0 con 0x7fe744102790 2024-09-19T09:39:14.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.398+0000 7fe7417fa640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe72c0a32d0 0x7fe72c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.398+0000 7fe743fff640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe72c0a32d0 0x7fe72c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.398+0000 7fe7417fa640 1 -- 172.21.15.42:0/3528150584 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fe7380cf5f0 con 0x7fe744102790 2024-09-19T09:39:14.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.399+0000 7fe743fff640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe72c0a32d0 0x7fe72c0a5790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe734005ab0 tx=0x7fe734005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.403+0000 7fe7417fa640 1 -- 172.21.15.42:0/3528150584 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe73809c190 con 0x7fe744102790 2024-09-19T09:39:14.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.613+0000 7fe74a386640 1 -- 172.21.15.42:0/3528150584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe74410a0f0 con 0x7fe744102790 2024-09-19T09:39:14.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.614+0000 7fe7417fa640 1 -- 172.21.15.42:0/3528150584 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7fe73809ba90 con 0x7fe744102790 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:39:14.616 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 -- 172.21.15.42:0/3528150584 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe72c0a32d0 msgr2=0x7fe72c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe72c0a32d0 0x7fe72c0a5790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe734005ab0 tx=0x7fe734005a20 comp rx=0 tx=0).stop 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 -- 172.21.15.42:0/3528150584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe744102790 msgr2=0x7fe744198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe744102790 0x7fe744198a30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe73800d770 tx=0x7fe73800dc30 comp rx=0 tx=0).stop 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 -- 172.21.15.42:0/3528150584 shutdown_connections 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe72c0a32d0 0x7fe72c0a5790 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744106f10 0x7fe74419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe744102790 0x7fe744198a30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 --2- 172.21.15.42:0/3528150584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe744101de0 0x7fe7441984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 -- 172.21.15.42:0/3528150584 >> 172.21.15.42:0/3528150584 conn(0x7fe7440fd8c0 msgr2=0x7fe7440febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 -- 172.21.15.42:0/3528150584 shutdown_connections 2024-09-19T09:39:14.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:14.617+0000 7fe74a386640 1 -- 172.21.15.42:0/3528150584 wait complete. 2024-09-19T09:39:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:14 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3528150584' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:14.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:14 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3528150584' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:15.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:14 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3528150584' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:15.351 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:15.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:15 smithi171 ceph-mon[35803]: pgmap v335: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:39:15.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:15 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:15 smithi136 ceph-mon[34840]: pgmap v335: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:39:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:15 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:15.896 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:15 smithi042 ceph-mon[31223]: pgmap v335: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:39:15.896 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:15 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:16.140 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.631+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3793394581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc48102d30 msgr2=0x7efc48103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.631+0000 7efc4fb6c640 1 --2- 172.21.15.42:0/3793394581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc48102d30 0x7efc48103110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efc44009930 tx=0x7efc4402a420 comp rx=0 tx=0).stop 2024-09-19T09:39:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.631+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3793394581 shutdown_connections 2024-09-19T09:39:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.631+0000 7efc4fb6c640 1 --2- 172.21.15.42:0/3793394581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc481082a0 0x7efc4810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.631+0000 7efc4fb6c640 1 --2- 172.21.15.42:0/3793394581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc481036e0 0x7efc48107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.631+0000 7efc4fb6c640 1 --2- 172.21.15.42:0/3793394581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc48102d30 0x7efc48103110 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.631+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3793394581 >> 172.21.15.42:0/3793394581 conn(0x7efc480fc7d0 msgr2=0x7efc480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.631+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3793394581 shutdown_connections 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.631+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3793394581 wait complete. 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4fb6c640 1 Processor -- start 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4fb6c640 1 -- start start 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4fb6c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc48102d30 0x7efc48198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4fb6c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc481036e0 0x7efc48198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4fb6c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc481082a0 0x7efc4819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4fb6c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efc481120f0 con 0x7efc481036e0 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4fb6c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efc48111f70 con 0x7efc48102d30 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4fb6c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efc48112270 con 0x7efc481082a0 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4d107640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc481036e0 0x7efc48198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4d107640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc481036e0 0x7efc48198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59438/0 (socket says 172.21.15.42:59438) 2024-09-19T09:39:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4d107640 1 -- 172.21.15.42:0/3944711585 learned_addr learned my addr 172.21.15.42:0/3944711585 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4e109640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc481082a0 0x7efc4819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4d908640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc48102d30 0x7efc48198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4d107640 1 -- 172.21.15.42:0/3944711585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc481082a0 msgr2=0x7efc4819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4d107640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc481082a0 0x7efc4819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4d107640 1 -- 172.21.15.42:0/3944711585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc48102d30 msgr2=0x7efc48198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4d107640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc48102d30 0x7efc48198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4d107640 1 -- 172.21.15.42:0/3944711585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4819d620 con 0x7efc481036e0 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4e109640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc481082a0 0x7efc4819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.632+0000 7efc4d908640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc48102d30 0x7efc48198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.633+0000 7efc4d107640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc481036e0 0x7efc48198bb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efc3800d740 tx=0x7efc3800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.633+0000 7efc3effd640 1 -- 172.21.15.42:0/3944711585 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38017070 con 0x7efc481036e0 2024-09-19T09:39:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.633+0000 7efc3effd640 1 -- 172.21.15.42:0/3944711585 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc3800de50 con 0x7efc481036e0 2024-09-19T09:39:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.633+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3944711585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4819d910 con 0x7efc481036e0 2024-09-19T09:39:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.633+0000 7efc3effd640 1 -- 172.21.15.42:0/3944711585 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3800f6b0 con 0x7efc481036e0 2024-09-19T09:39:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.633+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3944711585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc481008c0 con 0x7efc481036e0 2024-09-19T09:39:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.634+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3944711585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4806a850 con 0x7efc481036e0 2024-09-19T09:39:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.636+0000 7efc3effd640 1 -- 172.21.15.42:0/3944711585 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7efc3801a070 con 0x7efc481036e0 2024-09-19T09:39:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.637+0000 7efc3effd640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efc340a3350 0x7efc340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.637+0000 7efc4d908640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efc340a3350 0x7efc340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.637+0000 7efc3effd640 1 -- 172.21.15.42:0/3944711585 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7efc380cf410 con 0x7efc481036e0 2024-09-19T09:39:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.637+0000 7efc4d908640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efc340a3350 0x7efc340a5810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efc44006010 tx=0x7efc44005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.639+0000 7efc3effd640 1 -- 172.21.15.42:0/3944711585 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efc3809c030 con 0x7efc481036e0 2024-09-19T09:39:16.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.876+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3944711585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc48103110 con 0x7efc481036e0 2024-09-19T09:39:16.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.877+0000 7efc3effd640 1 -- 172.21.15.42:0/3944711585 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7efc48103110 con 0x7efc481036e0 2024-09-19T09:39:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:16.879 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:39:16.879 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:39:16.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3944711585 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efc340a3350 msgr2=0x7efc340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efc340a3350 0x7efc340a5810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efc44006010 tx=0x7efc44005a20 comp rx=0 tx=0).stop 2024-09-19T09:39:16.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3944711585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc481036e0 msgr2=0x7efc48198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:16.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc481036e0 0x7efc48198bb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efc3800d740 tx=0x7efc3800dc00 comp rx=0 tx=0).stop 2024-09-19T09:39:16.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3944711585 shutdown_connections 2024-09-19T09:39:16.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efc340a3350 0x7efc340a5810 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc481082a0 0x7efc4819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc481036e0 0x7efc48198bb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 --2- 172.21.15.42:0/3944711585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc48102d30 0x7efc48198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:16.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3944711585 >> 172.21.15.42:0/3944711585 conn(0x7efc480fc7d0 msgr2=0x7efc48106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:16.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3944711585 shutdown_connections 2024-09-19T09:39:16.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:16.879+0000 7efc4fb6c640 1 -- 172.21.15.42:0/3944711585 wait complete. 2024-09-19T09:39:17.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:17 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:17 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:17 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:17 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:17 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3944711585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:17.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:17 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:17 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:17 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:17 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:17 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3944711585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:17 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:17 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:17 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:17 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:17 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3944711585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:17.637 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:39:17.927 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:18.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.418+0000 7f82415ab640 1 -- 172.21.15.42:0/630039266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f823c100a80 msgr2=0x7f823c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.418+0000 7f82415ab640 1 --2- 172.21.15.42:0/630039266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f823c100a80 0x7f823c100ee0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8230009930 tx=0x7f823002a420 comp rx=0 tx=0).stop 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.418+0000 7f82415ab640 1 -- 172.21.15.42:0/630039266 shutdown_connections 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.418+0000 7f82415ab640 1 --2- 172.21.15.42:0/630039266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f823c101420 0x7f823c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.418+0000 7f82415ab640 1 --2- 172.21.15.42:0/630039266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f823c100a80 0x7f823c100ee0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.418+0000 7f82415ab640 1 --2- 172.21.15.42:0/630039266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f823c106a80 0x7f823c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.418+0000 7f82415ab640 1 -- 172.21.15.42:0/630039266 >> 172.21.15.42:0/630039266 conn(0x7f823c0fc7a0 msgr2=0x7f823c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.418+0000 7f82415ab640 1 -- 172.21.15.42:0/630039266 shutdown_connections 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.418+0000 7f82415ab640 1 -- 172.21.15.42:0/630039266 wait complete. 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f82415ab640 1 Processor -- start 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f82415ab640 1 -- start start 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f82415ab640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f823c100a80 0x7f823c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:18.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f82415ab640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f823c101420 0x7f823c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f82415ab640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f823c106a80 0x7f823c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f82415ab640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f823c110e80 con 0x7f823c100a80 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f82415ab640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f823c110d00 con 0x7f823c106a80 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f82415ab640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f823c111000 con 0x7f823c101420 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f823affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f823c100a80 0x7f823c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f823affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f823c100a80 0x7f823c198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59458/0 (socket says 172.21.15.42:59458) 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f823affd640 1 -- 172.21.15.42:0/3872827066 learned_addr learned my addr 172.21.15.42:0/3872827066 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.419+0000 7f823b7fe640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f823c106a80 0x7f823c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f823a7fc640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f823c101420 0x7f823c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f823affd640 1 -- 172.21.15.42:0/3872827066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f823c101420 msgr2=0x7f823c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f823affd640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f823c101420 0x7f823c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:18.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f823affd640 1 -- 172.21.15.42:0/3872827066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f823c106a80 msgr2=0x7f823c19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f823affd640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f823c106a80 0x7f823c19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f823affd640 1 -- 172.21.15.42:0/3872827066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c19d3f0 con 0x7f823c100a80 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f823affd640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f823c100a80 0x7f823c198440 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f822c00d950 tx=0x7f822c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f8223fff640 1 -- 172.21.15.42:0/3872827066 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c017070 con 0x7f823c100a80 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f82415ab640 1 -- 172.21.15.42:0/3872827066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823c19d6e0 con 0x7f823c100a80 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f8223fff640 1 -- 172.21.15.42:0/3872827066 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f822c009c30 con 0x7f823c100a80 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f8223fff640 1 -- 172.21.15.42:0/3872827066 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c00f6b0 con 0x7f823c100a80 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.420+0000 7f82415ab640 1 -- 172.21.15.42:0/3872827066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823c1a4fc0 con 0x7f823c100a80 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.421+0000 7f82415ab640 1 -- 172.21.15.42:0/3872827066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823c100ee0 con 0x7f823c100a80 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.422+0000 7f8223fff640 1 -- 172.21.15.42:0/3872827066 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f822c0109d0 con 0x7f823c100a80 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.423+0000 7f8223fff640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f82240a32d0 0x7f82240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.423+0000 7f823a7fc640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f82240a32d0 0x7f82240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:18.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.423+0000 7f8223fff640 1 -- 172.21.15.42:0/3872827066 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f822c0cf650 con 0x7f823c100a80 2024-09-19T09:39:18.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.424+0000 7f823a7fc640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f82240a32d0 0x7f82240a5790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8230000c00 tx=0x7f8230005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:18.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.427+0000 7f8223fff640 1 -- 172.21.15.42:0/3872827066 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f822c009de0 con 0x7f823c100a80 2024-09-19T09:39:18.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.605+0000 7f82415ab640 1 -- 172.21.15.42:0/3872827066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f823c10a000 con 0x7f823c100a80 2024-09-19T09:39:18.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:18 smithi042 ceph-mon[31223]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-19T09:39:18.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:18.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:18.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:18.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:18.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.606+0000 7f8223fff640 1 -- 172.21.15.42:0/3872827066 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22852 (secure 0 0 0) 0x7f822c09c1f0 con 0x7f823c100a80 2024-09-19T09:39:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:18.609 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:28.010101+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:39:18.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.608+0000 7f82415ab640 1 -- 172.21.15.42:0/3872827066 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f82240a32d0 msgr2=0x7f82240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:18.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f82240a32d0 0x7f82240a5790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8230000c00 tx=0x7f8230005a20 comp rx=0 tx=0).stop 2024-09-19T09:39:18.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 -- 172.21.15.42:0/3872827066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f823c100a80 msgr2=0x7f823c198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:18.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f823c100a80 0x7f823c198440 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f822c00d950 tx=0x7f822c00de10 comp rx=0 tx=0).stop 2024-09-19T09:39:18.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 -- 172.21.15.42:0/3872827066 shutdown_connections 2024-09-19T09:39:18.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f82240a32d0 0x7f82240a5790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:18.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f823c106a80 0x7f823c19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:18.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f823c101420 0x7f823c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:18.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 --2- 172.21.15.42:0/3872827066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f823c100a80 0x7f823c198440 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:18.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 -- 172.21.15.42:0/3872827066 >> 172.21.15.42:0/3872827066 conn(0x7f823c0fc7a0 msgr2=0x7f823c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:18.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 -- 172.21.15.42:0/3872827066 shutdown_connections 2024-09-19T09:39:18.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:18.609+0000 7f82415ab640 1 -- 172.21.15.42:0/3872827066 wait complete. 2024-09-19T09:39:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:18 smithi136 ceph-mon[34840]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-19T09:39:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:18 smithi171 ceph-mon[35803]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-19T09:39:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:39:19.389 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T09:39:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.560+0000 7f520ebcf640 1 -- 172.21.15.42:0/2692284215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5208101c30 msgr2=0x7f52081020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.560+0000 7f520ebcf640 1 --2- 172.21.15.42:0/2692284215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5208101c30 0x7f52081020b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009ca0 tx=0x7f51f802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.560+0000 7f520ebcf640 1 -- 172.21.15.42:0/2692284215 shutdown_connections 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.560+0000 7f520ebcf640 1 --2- 172.21.15.42:0/2692284215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52081025f0 0x7f5208108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.560+0000 7f520ebcf640 1 --2- 172.21.15.42:0/2692284215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5208101c30 0x7f52081020b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.560+0000 7f520ebcf640 1 --2- 172.21.15.42:0/2692284215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5208100a40 0x7f5208100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.560+0000 7f520ebcf640 1 -- 172.21.15.42:0/2692284215 >> 172.21.15.42:0/2692284215 conn(0x7f52080fc1e0 msgr2=0x7f52080fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.560+0000 7f520ebcf640 1 -- 172.21.15.42:0/2692284215 shutdown_connections 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.560+0000 7f520ebcf640 1 -- 172.21.15.42:0/2692284215 wait complete. 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520ebcf640 1 Processor -- start 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520ebcf640 1 -- start start 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520ebcf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5208100a40 0x7f520810b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520ebcf640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5208101c30 0x7f5208109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520ebcf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52081025f0 0x7f5208109f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520ebcf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f520810d810 con 0x7f52081025f0 2024-09-19T09:39:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520ebcf640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f520810d690 con 0x7f5208101c30 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520ebcf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f520810d990 con 0x7f5208100a40 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520d16c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52081025f0 0x7f5208109f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520d16c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52081025f0 0x7f5208109f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59462/0 (socket says 172.21.15.42:59462) 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520d16c640 1 -- 172.21.15.42:0/3111405618 learned_addr learned my addr 172.21.15.42:0/3111405618 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f520c96b640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5208100a40 0x7f520810b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.561+0000 7f5207fff640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5208101c30 0x7f5208109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f520d16c640 1 -- 172.21.15.42:0/3111405618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5208100a40 msgr2=0x7f520810b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f520d16c640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5208100a40 0x7f520810b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f520d16c640 1 -- 172.21.15.42:0/3111405618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5208101c30 msgr2=0x7f5208109a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f520d16c640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5208101c30 0x7f5208109a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f520d16c640 1 -- 172.21.15.42:0/3111405618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520810a7d0 con 0x7f52081025f0 2024-09-19T09:39:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f520d16c640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52081025f0 0x7f5208109f40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f520000d750 tx=0x7f520000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f5205ffb640 1 -- 172.21.15.42:0/3111405618 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200017070 con 0x7f52081025f0 2024-09-19T09:39:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f520ebcf640 1 -- 172.21.15.42:0/3111405618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52081a1ed0 con 0x7f52081025f0 2024-09-19T09:39:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f5205ffb640 1 -- 172.21.15.42:0/3111405618 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5200005500 con 0x7f52081025f0 2024-09-19T09:39:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f5205ffb640 1 -- 172.21.15.42:0/3111405618 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200004d90 con 0x7f52081025f0 2024-09-19T09:39:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.562+0000 7f520ebcf640 1 -- 172.21.15.42:0/3111405618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52081a22e0 con 0x7f52081025f0 2024-09-19T09:39:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.564+0000 7f5205ffb640 1 -- 172.21.15.42:0/3111405618 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f5200004f30 con 0x7f52081025f0 2024-09-19T09:39:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5211a44740 1 Processor -- start 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5211a44740 1 -- start start 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5211a44740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8bae1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5211a44740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 0x55ca8bae6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5205ffb640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51f40a3390 0x7f51f40a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5211a44740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae7370 0x55ca8bae9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5211a44740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ca8ba452f0 con 0x55ca8bae19a0 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5211a44740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ca8b9ed270 con 0x55ca8bae22e0 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5211a44740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ca8ba412b0 con 0x55ca8bae7370 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5207fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8bae1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5207fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8bae1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59478/0 (socket says 172.21.15.42:59478) 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5207fff640 1 -- 172.21.15.42:0/158883059 learned_addr learned my addr 172.21.15.42:0/158883059 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.565+0000 7f5205ffb640 1 -- 172.21.15.42:0/3111405618 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f52000cf3b0 con 0x7f52081025f0 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f5207fff640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51f40a3390 0x7f51f40a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f520c96b640 1 --2- 172.21.15.42:0/158883059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 0x55ca8bae6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f520d16c640 1 --2- 172.21.15.42:0/158883059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae7370 0x55ca8bae9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f5207fff640 1 -- 172.21.15.42:0/158883059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae7370 msgr2=0x55ca8bae9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f5207fff640 1 --2- 172.21.15.42:0/158883059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae7370 0x55ca8bae9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f5207fff640 1 -- 172.21.15.42:0/158883059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 msgr2=0x55ca8bae6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f5207fff640 1 --2- 172.21.15.42:0/158883059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 0x55ca8bae6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f5207fff640 1 -- 172.21.15.42:0/158883059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca8b9ec340 con 0x55ca8bae19a0 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f5207fff640 1 --2- 172.21.15.42:0/158883059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8bae1da0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f51f802ade0 tx=0x7f51f8031650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e992feb3be13af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f5207fff640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51f40a3390 0x7f51f40a5850 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009ca0 tx=0x7f51f8036000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f51feffd640 1 -- 172.21.15.42:0/158883059 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f804d070 con 0x55ca8bae19a0 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f51feffd640 1 -- 172.21.15.42:0/158883059 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51f8036070 con 0x55ca8bae19a0 2024-09-19T09:39:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.566+0000 7f51feffd640 1 -- 172.21.15.42:0/158883059 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8049660 con 0x55ca8bae19a0 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.567+0000 7f5211a44740 1 -- 172.21.15.42:0/158883059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 msgr2=0x55ca8bae1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.567+0000 7f5211a44740 1 --2- 172.21.15.42:0/158883059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8bae1da0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f51f802ade0 tx=0x7f51f8031650 comp rx=0 tx=0).stop 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.567+0000 7f5211a44740 1 -- 172.21.15.42:0/158883059 shutdown_connections 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.567+0000 7f5211a44740 1 --2- 172.21.15.42:0/158883059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae7370 0x55ca8bae9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.567+0000 7f5211a44740 1 --2- 172.21.15.42:0/158883059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 0x55ca8bae6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.567+0000 7f5211a44740 1 --2- 172.21.15.42:0/158883059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8bae1da0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.567+0000 7f5211a44740 1 -- 172.21.15.42:0/158883059 >> 172.21.15.42:0/158883059 conn(0x55ca8badd010 msgr2=0x55ca8badd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.567+0000 7f5211a44740 1 -- 172.21.15.42:0/158883059 shutdown_connections 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.567+0000 7f5211a44740 1 -- 172.21.15.42:0/158883059 wait complete. 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f5211a44740 1 -- start start 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f5211a44740 1 Processor -- start 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f5211a44740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8baeb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f5211a44740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae22e0 0x55ca8baebf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f5211a44740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae7370 0x55ca8baf2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f5211a44740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ca8baea100 con 0x55ca8bae19a0 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f5211a44740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ca8b9ce290 con 0x55ca8bae7370 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f5211a44740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ca8baea280 con 0x55ca8bae22e0 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f5211a44740 10 client.0 _ll_register_callbacks cb 0x55ca8b9ff140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f520c96b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8baeb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f520c96b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8baeb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59480/0 (socket says 172.21.15.42:59480) 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f520c96b640 1 -- 172.21.15.42:0/925510171 learned_addr learned my addr 172.21.15.42:0/925510171 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.568+0000 7f520d16c640 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae7370 0x55ca8baf2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f5207fff640 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae22e0 0x55ca8baebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f520c96b640 1 -- 172.21.15.42:0/925510171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae22e0 msgr2=0x55ca8baebf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f520c96b640 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae22e0 0x55ca8baebf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f520c96b640 1 -- 172.21.15.42:0/925510171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae7370 msgr2=0x55ca8baf2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f520c96b640 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae7370 0x55ca8baf2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f520c96b640 1 -- 172.21.15.42:0/925510171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca8b758210 con 0x55ca8bae19a0 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f520c96b640 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8baeb9f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f51f000bad0 tx=0x7f51f000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6313a9aab382f8a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f51e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f51e7fff640 1 -- 172.21.15.42:0/925510171 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0003e00 con 0x55ca8bae19a0 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f51e7fff640 1 -- 172.21.15.42:0/925510171 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f51f0005020 con 0x55ca8bae19a0 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f5211a44740 1 -- 172.21.15.42:0/925510171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51f8036070 con 0x55ca8bae19a0 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f51e7fff640 1 -- 172.21.15.42:0/925510171 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f51f0005220 con 0x55ca8bae19a0 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f5211a44740 10 client.15384 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.569+0000 7f5211a44740 1 -- 172.21.15.42:0/925510171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca8b824620 con 0x55ca8bae19a0 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.570+0000 7f51e7fff640 1 -- 172.21.15.42:0/925510171 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51f8036070 con 0x55ca8bae19a0 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.570+0000 7f51e7fff640 1 -- 172.21.15.42:0/925510171 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f51f001b630 con 0x55ca8bae19a0 2024-09-19T09:39:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.570+0000 7f5211a44740 10 client.15384 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.570+0000 7f5211a44740 10 client.15384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.570+0000 7f5211a44740 20 client.15384 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.570+0000 7f5211a44740 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ca8baf7710 0x55ca8baf9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.570+0000 7f5211a44740 4 client.15384 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.570+0000 7f5211a44740 1 -- 172.21.15.42:0/925510171 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca8ba52a20 con 0x55ca8baf7710 2024-09-19T09:39:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.570+0000 7f5207fff640 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ca8baf7710 0x55ca8baf9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.571+0000 7f5207fff640 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ca8baf7710 0x55ca8baf9bb0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5df8e0070495be03 server_cookie=28473fee9a50330e in_seq=0 out_seq=0 2024-09-19T09:39:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.571+0000 7f51e7fff640 10 client.15384 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.571+0000 7f51e7fff640 1 -- 172.21.15.42:0/925510171 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca8ba52a20 con 0x55ca8baf7710 2024-09-19T09:39:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.571+0000 7f51e7fff640 10 client.15384 handle_command_reply: tid=0 2024-09-19T09:39:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 client.15384 shutdown 2024-09-19T09:39:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 -- 172.21.15.42:0/925510171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 msgr2=0x55ca8baeb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8baeb9f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f51f000bad0 tx=0x7f51f000bf90 comp rx=0 tx=0).stop 2024-09-19T09:39:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 -- 172.21.15.42:0/925510171 shutdown_connections 2024-09-19T09:39:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ca8baf7710 0x55ca8baf9bb0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae7370 0x55ca8baf2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae22e0 0x55ca8baebf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f51e7fff640 0 client.15384 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 --2- 172.21.15.42:0/925510171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae19a0 0x55ca8baeb9f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 -- 172.21.15.42:0/925510171 >> 172.21.15.42:0/925510171 conn(0x55ca8badd010 msgr2=0x55ca8bade820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 -- 172.21.15.42:0/925510171 shutdown_connections 2024-09-19T09:39:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 1 -- 172.21.15.42:0/925510171 wait complete. 2024-09-19T09:39:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.572+0000 7f5211a44740 20 client.15384 trim_cache size 0 max 16384 2024-09-19T09:39:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.588+0000 7f5211a44740 1 Processor -- start 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.588+0000 7f5211a44740 1 -- start start 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f5211a44740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae19a0 0x55ca8baebe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f5211a44740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 0x55ca8baf2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f5211a44740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8bafe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f5211a44740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52081ab130 con 0x55ca8bae7370 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f5211a44740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f52081acc70 con 0x55ca8bae22e0 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f5211a44740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f52081ab800 con 0x55ca8bae19a0 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f520d16c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8bafe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f520d16c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8bafe4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59492/0 (socket says 172.21.15.42:59492) 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f520d16c640 1 -- 172.21.15.42:0/2307600559 learned_addr learned my addr 172.21.15.42:0/2307600559 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f520c96b640 1 --2- 172.21.15.42:0/2307600559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae19a0 0x55ca8baebe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f5207fff640 1 --2- 172.21.15.42:0/2307600559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 0x55ca8baf2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f520d16c640 1 -- 172.21.15.42:0/2307600559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae19a0 msgr2=0x55ca8baebe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f520d16c640 1 --2- 172.21.15.42:0/2307600559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae19a0 0x55ca8baebe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f520d16c640 1 -- 172.21.15.42:0/2307600559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 msgr2=0x55ca8baf2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f520d16c640 1 --2- 172.21.15.42:0/2307600559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 0x55ca8baf2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f520d16c640 1 -- 172.21.15.42:0/2307600559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca8badeea0 con 0x55ca8bae7370 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f5207fff640 1 --2- 172.21.15.42:0/2307600559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 0x55ca8baf2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f520d16c640 1 --2- 172.21.15.42:0/2307600559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8bafe4b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f52000982d0 tx=0x7f5200097ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7737962de7ecb5d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.589+0000 7f51fe7fc640 1 -- 172.21.15.42:0/2307600559 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200014030 con 0x55ca8bae7370 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f51fe7fc640 1 -- 172.21.15.42:0/2307600559 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52000a21a0 con 0x55ca8bae7370 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f51fe7fc640 1 -- 172.21.15.42:0/2307600559 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200020040 con 0x55ca8bae7370 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f5211a44740 1 -- 172.21.15.42:0/2307600559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 msgr2=0x55ca8bafe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f5211a44740 1 --2- 172.21.15.42:0/2307600559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8bafe4b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f52000982d0 tx=0x7f5200097ba0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f5211a44740 1 -- 172.21.15.42:0/2307600559 shutdown_connections 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f5211a44740 1 --2- 172.21.15.42:0/2307600559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8bafe4b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f5211a44740 1 --2- 172.21.15.42:0/2307600559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae22e0 0x55ca8baf2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f5211a44740 1 --2- 172.21.15.42:0/2307600559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae19a0 0x55ca8baebe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f5211a44740 1 -- 172.21.15.42:0/2307600559 >> 172.21.15.42:0/2307600559 conn(0x55ca8badd010 msgr2=0x55ca8badc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f5211a44740 1 -- 172.21.15.42:0/2307600559 shutdown_connections 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.590+0000 7f5211a44740 1 -- 172.21.15.42:0/2307600559 wait complete. 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f5211a44740 1 -- start start 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f5211a44740 1 Processor -- start 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f5211a44740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae19a0 0x55ca8baf27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f5211a44740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae22e0 0x55ca8baf2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f5211a44740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8baf0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f5211a44740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52081ac5a0 con 0x55ca8bae7370 2024-09-19T09:39:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f5211a44740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f52081abed0 con 0x55ca8bae19a0 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f5211a44740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f52081a9110 con 0x55ca8bae22e0 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f5211a44740 10 client.0 _ll_register_callbacks cb 0x7f51f0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f520d16c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8baf0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f520d16c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8baf0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59494/0 (socket says 172.21.15.42:59494) 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.591+0000 7f520d16c640 1 -- 172.21.15.42:0/2940813809 learned_addr learned my addr 172.21.15.42:0/2940813809 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f520c96b640 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae19a0 0x55ca8baf27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f5207fff640 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae22e0 0x55ca8baf2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f520d16c640 1 -- 172.21.15.42:0/2940813809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae22e0 msgr2=0x55ca8baf2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f520d16c640 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae22e0 0x55ca8baf2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f520d16c640 1 -- 172.21.15.42:0/2940813809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae19a0 msgr2=0x55ca8baf27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f520d16c640 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae19a0 0x55ca8baf27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f520d16c640 1 -- 172.21.15.42:0/2940813809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca8baf15f0 con 0x55ca8bae7370 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f520d16c640 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8baf0eb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5200097d60 tx=0x7f5200099c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bfe447dd498c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f51e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f51e7fff640 1 -- 172.21.15.42:0/2940813809 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52000b8070 con 0x55ca8bae7370 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f51e7fff640 1 -- 172.21.15.42:0/2940813809 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f5200009c60 con 0x55ca8bae7370 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f5211a44740 1 -- 172.21.15.42:0/2940813809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52000a21a0 con 0x55ca8bae7370 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f51e7fff640 1 -- 172.21.15.42:0/2940813809 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5200020070 con 0x55ca8bae7370 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f5211a44740 10 client.15390 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f5211a44740 1 -- 172.21.15.42:0/2940813809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca8bb62ee0 con 0x55ca8bae7370 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.592+0000 7f51e7fff640 1 -- 172.21.15.42:0/2940813809 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52000a21a0 con 0x55ca8bae7370 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.593+0000 7f51e7fff640 1 -- 172.21.15.42:0/2940813809 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f52000bac10 con 0x55ca8bae7370 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.593+0000 7f5211a44740 10 client.15390 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.593+0000 7f5211a44740 10 client.15390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.593+0000 7f5211a44740 20 client.15390 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.593+0000 7f5211a44740 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ca8bb63830 0x55ca8bb65c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.593+0000 7f5211a44740 4 client.15390 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:39:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.593+0000 7f5211a44740 1 -- 172.21.15.42:0/2940813809 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ca8ba4cd70 con 0x55ca8bb63830 2024-09-19T09:39:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.593+0000 7f520c96b640 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ca8bb63830 0x55ca8bb65c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.594+0000 7f51e7fff640 10 client.15390 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.594+0000 7f520c96b640 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ca8bb63830 0x55ca8bb65c20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21997c894118c05d server_cookie=a02761c9f26f1236 in_seq=0 out_seq=0 2024-09-19T09:39:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f51e7fff640 1 -- 172.21.15.42:0/2940813809 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ca8ba4cd70 con 0x55ca8bb63830 2024-09-19T09:39:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f51e7fff640 10 client.15390 handle_command_reply: tid=0 2024-09-19T09:39:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 client.15390 shutdown 2024-09-19T09:39:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 -- 172.21.15.42:0/2940813809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 msgr2=0x55ca8baf0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8baf0eb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5200097d60 tx=0x7f5200099c00 comp rx=0 tx=0).stop 2024-09-19T09:39:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 -- 172.21.15.42:0/2940813809 shutdown_connections 2024-09-19T09:39:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ca8bb63830 0x55ca8bb65c20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca8bae7370 0x55ca8baf0eb0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca8bae22e0 0x55ca8baf2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f51e7fff640 0 client.15390 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 --2- 172.21.15.42:0/2940813809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ca8bae19a0 0x55ca8baf27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 -- 172.21.15.42:0/2940813809 >> 172.21.15.42:0/2940813809 conn(0x55ca8badd010 msgr2=0x55ca8badb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 -- 172.21.15.42:0/2940813809 shutdown_connections 2024-09-19T09:39:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 1 -- 172.21.15.42:0/2940813809 wait complete. 2024-09-19T09:39:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.605+0000 7f5211a44740 20 client.15390 trim_cache size 0 max 16384 2024-09-19T09:39:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:39:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:39:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:39:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:39:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 -- 172.21.15.42:0/3111405618 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51f40a3390 msgr2=0x7f51f40a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51f40a3390 0x7f51f40a5850 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009ca0 tx=0x7f51f8036000 comp rx=0 tx=0).stop 2024-09-19T09:39:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 -- 172.21.15.42:0/3111405618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52081025f0 msgr2=0x7f5208109f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52081025f0 0x7f5208109f40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f520000d750 tx=0x7f520000dc10 comp rx=0 tx=0).stop 2024-09-19T09:39:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 -- 172.21.15.42:0/3111405618 shutdown_connections 2024-09-19T09:39:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51f40a3390 0x7f51f40a5850 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52081025f0 0x7f5208109f40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5208101c30 0x7f5208109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 --2- 172.21.15.42:0/3111405618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5208100a40 0x7f520810b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 -- 172.21.15.42:0/3111405618 >> 172.21.15.42:0/3111405618 conn(0x7f52080fc1e0 msgr2=0x7f5208104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 -- 172.21.15.42:0/3111405618 shutdown_connections 2024-09-19T09:39:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:19.606+0000 7f520ebcf640 1 -- 172.21.15.42:0/3111405618 wait complete. 2024-09-19T09:39:19.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:19 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3872827066' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:39:19.653 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:19.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:19 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3872827066' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:39:19.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:19 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3872827066' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:39:20.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:20 smithi042 ceph-mon[31223]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-19T09:39:20.761 INFO:teuthology.orchestra.run.smithi042.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T09:39:20.761 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T09:39:20.761 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T09:39:20.761 DEBUG:tasks.quiescer:Yielding 2024-09-19T09:39:20.761 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T09:39:20.777 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:39:20.777 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T09:39:20.777 INFO:tasks.workunit:timeout=6h 2024-09-19T09:39:20.778 INFO:tasks.workunit:cleanup=True 2024-09-19T09:39:20.778 DEBUG:teuthology.orchestra.run.smithi042:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:39:20.778 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T09:39:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T09:39:20.796 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T09:39:20.796 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:39:20.797 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T09:39:20.797 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-19 09:37:29.367702958 +0000 2024-09-19T09:39:20.797 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-19 09:37:29.367702958 +0000 2024-09-19T09:39:20.797 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-19 09:38:57.677855071 +0000 2024-09-19T09:39:20.797 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-19 09:37:29.367702958 +0000 2024-09-19T09:39:20.797 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T09:39:20.797 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T09:39:20.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:20 smithi171 ceph-mon[35803]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-19T09:39:20.875 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:39:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:20 smithi136 ceph-mon[34840]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-19T09:39:20.932 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T09:39:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.517+0000 7f86fb9da640 1 -- 172.21.15.42:0/2119437202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f4106f20 msgr2=0x7f86f410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.517+0000 7f86fb9da640 1 --2- 172.21.15.42:0/2119437202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f4106f20 0x7f86f410eaa0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009ca0 tx=0x7f86e402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.517+0000 7f86fb9da640 1 -- 172.21.15.42:0/2119437202 shutdown_connections 2024-09-19T09:39:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.517+0000 7f86fb9da640 1 --2- 172.21.15.42:0/2119437202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f4106f20 0x7f86f410eaa0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.517+0000 7f86fb9da640 1 --2- 172.21.15.42:0/2119437202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86f41027a0 0x7f86f41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.517+0000 7f86fb9da640 1 --2- 172.21.15.42:0/2119437202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f4101df0 0x7f86f41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.517+0000 7f86fb9da640 1 -- 172.21.15.42:0/2119437202 >> 172.21.15.42:0/2119437202 conn(0x7f86f40fd8f0 msgr2=0x7f86f40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.517+0000 7f86fb9da640 1 -- 172.21.15.42:0/2119437202 shutdown_connections 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.517+0000 7f86fb9da640 1 -- 172.21.15.42:0/2119437202 wait complete. 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.517+0000 7f86fb9da640 1 Processor -- start 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86fb9da640 1 -- start start 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86fb9da640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86f4101df0 0x7f86f4198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86fb9da640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f41027a0 0x7f86f4198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86fb9da640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f4106f20 0x7f86f419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86fb9da640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f86f4111f80 con 0x7f86f41027a0 2024-09-19T09:39:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86fb9da640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f86f4111e00 con 0x7f86f4106f20 2024-09-19T09:39:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86fb9da640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f86f4112100 con 0x7f86f4101df0 2024-09-19T09:39:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86f8f75640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f41027a0 0x7f86f4198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86f8f75640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f41027a0 0x7f86f4198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40610/0 (socket says 172.21.15.42:40610) 2024-09-19T09:39:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86f8f75640 1 -- 172.21.15.42:0/2863232437 learned_addr learned my addr 172.21.15.42:0/2863232437 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86f9f77640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f4106f20 0x7f86f419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86f9776640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86f4101df0 0x7f86f4198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86f8f75640 1 -- 172.21.15.42:0/2863232437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86f4101df0 msgr2=0x7f86f4198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86f8f75640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86f4101df0 0x7f86f4198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86f8f75640 1 -- 172.21.15.42:0/2863232437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f4106f20 msgr2=0x7f86f419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86f8f75640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f4106f20 0x7f86f419ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.518+0000 7f86f8f75640 1 -- 172.21.15.42:0/2863232437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f419d3b0 con 0x7f86f41027a0 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.519+0000 7f86f8f75640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f41027a0 0x7f86f4198940 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c920 tx=0x7f86e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.519+0000 7f86f27fc640 1 -- 172.21.15.42:0/2863232437 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8007c70 con 0x7f86f41027a0 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.519+0000 7f86f27fc640 1 -- 172.21.15.42:0/2863232437 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86e8007e10 con 0x7f86f41027a0 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.519+0000 7f86fb9da640 1 -- 172.21.15.42:0/2863232437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f419d6a0 con 0x7f86f41027a0 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.519+0000 7f86f27fc640 1 -- 172.21.15.42:0/2863232437 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8018890 con 0x7f86f41027a0 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.519+0000 7f86fb9da640 1 -- 172.21.15.42:0/2863232437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f41a4f80 con 0x7f86f41027a0 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.520+0000 7f86fb9da640 1 -- 172.21.15.42:0/2863232437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f41021d0 con 0x7f86f41027a0 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.521+0000 7f86f27fc640 1 -- 172.21.15.42:0/2863232437 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f86e8018b30 con 0x7f86f41027a0 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.522+0000 7f86f27fc640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86dc0a32d0 0x7f86dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.522+0000 7f86f9776640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86dc0a32d0 0x7f86dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.522+0000 7f86f27fc640 1 -- 172.21.15.42:0/2863232437 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f86e80cfad0 con 0x7f86f41027a0 2024-09-19T09:39:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.523+0000 7f86f9776640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86dc0a32d0 0x7f86dc0a5790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0058c0 tx=0x7f86ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.529+0000 7f86f27fc640 1 -- 172.21.15.42:0/2863232437 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f86e8014030 con 0x7f86f41027a0 2024-09-19T09:39:21.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.777+0000 7f86fb9da640 1 -- 172.21.15.42:0/2863232437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86f41a51e0 con 0x7f86f41027a0 2024-09-19T09:39:21.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.778+0000 7f86f27fc640 1 -- 172.21.15.42:0/2863232437 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f86e8018e20 con 0x7f86f41027a0 2024-09-19T09:39:21.780 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:21.781 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:39:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:39:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 -- 172.21.15.42:0/2863232437 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86dc0a32d0 msgr2=0x7f86dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86dc0a32d0 0x7f86dc0a5790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0058c0 tx=0x7f86ec00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 -- 172.21.15.42:0/2863232437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f41027a0 msgr2=0x7f86f4198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f41027a0 0x7f86f4198940 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c920 tx=0x7f86e800cde0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 -- 172.21.15.42:0/2863232437 shutdown_connections 2024-09-19T09:39:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f86dc0a32d0 0x7f86dc0a5790 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f4106f20 0x7f86f419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f41027a0 0x7f86f4198940 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 --2- 172.21.15.42:0/2863232437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86f4101df0 0x7f86f4198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 -- 172.21.15.42:0/2863232437 >> 172.21.15.42:0/2863232437 conn(0x7f86f40fd8f0 msgr2=0x7f86f40ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 -- 172.21.15.42:0/2863232437 shutdown_connections 2024-09-19T09:39:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:21.780+0000 7f86fb9da640 1 -- 172.21.15.42:0/2863232437 wait complete. 2024-09-19T09:39:22.406 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:22 smithi042 ceph-mon[31223]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:39:22.406 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:22 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:39:22.406 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:22 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2863232437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:22.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:37:11.524843+0000', 'modified': '2024-09-19T09:38:58.362185+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24506, 'mds_1': 24478, 'mds_2': 24473, 'mds_3': 24466, 'mds_4': 24454}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14622': {'gid': 14622, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6839/3152711275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6838', 'nonce': 3152711275}, {'type': 'v1', 'addr': '172.21.15.42:6839', 'nonce': 3152711275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14628': {'gid': 14628, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6841/649947071', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6840', 'nonce': 649947071}, {'type': 'v1', 'addr': '172.21.15.42:6841', 'nonce': 649947071}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6833/1004485926', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 1004485926}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 1004485926}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6833/1364803362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6832', 'nonce': 1364803362}, {'type': 'v1', 'addr': '172.21.15.136:6833', 'nonce': 1364803362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6835/3800275147', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 3800275147}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 3800275147}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.171:6835/3609400567', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 3609400567}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 3609400567}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.171:6837/512338141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 512338141}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 512338141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.136:6837/2776197166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 2776197166}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 2776197166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.171:6839/3148784527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6838', 'nonce': 3148784527}, {'type': 'v1', 'addr': '172.21.15.171:6839', 'nonce': 3148784527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.136:6839/2003809688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 2003809688}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 2003809688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24506, 'qdb_cluster': [24454, 24506, 24466, 24473, 24478]} 2024-09-19T09:39:22.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:39:22.435 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T09:39:22.732 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:22 smithi171 ceph-mon[35803]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:39:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:22 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:39:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:22 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2863232437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:22 smithi136 ceph-mon[34840]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:39:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:22 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:39:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:22 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2863232437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.187+0000 7f0414958640 1 -- 172.21.15.42:0/4273726547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04101082a0 msgr2=0x7f041010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.187+0000 7f0414958640 1 --2- 172.21.15.42:0/4273726547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04101082a0 0x7f041010ec40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0408009cd0 tx=0x7f040802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.188+0000 7f0414958640 1 -- 172.21.15.42:0/4273726547 shutdown_connections 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.188+0000 7f0414958640 1 --2- 172.21.15.42:0/4273726547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04101082a0 0x7f041010ec40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.188+0000 7f0414958640 1 --2- 172.21.15.42:0/4273726547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04101036e0 0x7f0410107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.188+0000 7f0414958640 1 --2- 172.21.15.42:0/4273726547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0410102d30 0x7f0410103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.188+0000 7f0414958640 1 -- 172.21.15.42:0/4273726547 >> 172.21.15.42:0/4273726547 conn(0x7f04100fc7d0 msgr2=0x7f04100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.188+0000 7f0414958640 1 -- 172.21.15.42:0/4273726547 shutdown_connections 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.188+0000 7f0414958640 1 -- 172.21.15.42:0/4273726547 wait complete. 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.188+0000 7f0414958640 1 Processor -- start 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.188+0000 7f0414958640 1 -- start start 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f0414958640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0410102d30 0x7f0410100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f0414958640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04101036e0 0x7f0410100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f0414958640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04101082a0 0x7f0410101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f0414958640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04101120a0 con 0x7f0410102d30 2024-09-19T09:39:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f0414958640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0410111f20 con 0x7f04101082a0 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f0414958640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0410112220 con 0x7f04101036e0 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0410102d30 0x7f0410100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0410102d30 0x7f0410100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40630/0 (socket says 172.21.15.42:40630) 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040e59c640 1 -- 172.21.15.42:0/970958855 learned_addr learned my addr 172.21.15.42:0/970958855 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040dd9b640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04101036e0 0x7f0410100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040ed9d640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04101082a0 0x7f0410101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040e59c640 1 -- 172.21.15.42:0/970958855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04101036e0 msgr2=0x7f0410100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040e59c640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04101036e0 0x7f0410100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040e59c640 1 -- 172.21.15.42:0/970958855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04101082a0 msgr2=0x7f0410101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040e59c640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04101082a0 0x7f0410101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040e59c640 1 -- 172.21.15.42:0/970958855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04101a6a10 con 0x7f0410102d30 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.189+0000 7f040e59c640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0410102d30 0x7f0410100990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f040000d950 tx=0x7f040000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.190+0000 7f03ff7fe640 1 -- 172.21.15.42:0/970958855 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400017070 con 0x7f0410102d30 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.190+0000 7f0414958640 1 -- 172.21.15.42:0/970958855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04101a6d00 con 0x7f0410102d30 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.190+0000 7f03ff7fe640 1 -- 172.21.15.42:0/970958855 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0400009c30 con 0x7f0410102d30 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.190+0000 7f03ff7fe640 1 -- 172.21.15.42:0/970958855 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040000f6b0 con 0x7f0410102d30 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.190+0000 7f0414958640 1 -- 172.21.15.42:0/970958855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04101a7230 con 0x7f0410102d30 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.192+0000 7f0416d31740 1 Processor -- start 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f0416d31740 1 -- start start 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f0416d31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x5606798f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f0416d31740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679904670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f0416d31740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560679904bb0 0x560679906fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f0416d31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560679860090 con 0x5606798f99d0 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f0416d31740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560679807a70 con 0x560679904bb0 2024-09-19T09:39:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f0416d31740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56067985c050 con 0x5606798fa2f0 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f03ff7fe640 1 -- 172.21.15.42:0/970958855 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f04000109d0 con 0x7f0410102d30 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f040ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x5606798f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f040ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x5606798f9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40642/0 (socket says 172.21.15.42:40642) 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f040ed9d640 1 -- 172.21.15.42:0/3831004379 learned_addr learned my addr 172.21.15.42:0/3831004379 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f040e59c640 1 --2- 172.21.15.42:0/3831004379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679904670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.193+0000 7f040dd9b640 1 --2- 172.21.15.42:0/3831004379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560679904bb0 0x560679906fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.194+0000 7f040ed9d640 1 -- 172.21.15.42:0/3831004379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 msgr2=0x560679904670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.194+0000 7f040ed9d640 1 --2- 172.21.15.42:0/3831004379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679904670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.194+0000 7f040ed9d640 1 -- 172.21.15.42:0/3831004379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560679904bb0 msgr2=0x560679906fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.194+0000 7f040ed9d640 1 --2- 172.21.15.42:0/3831004379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560679904bb0 0x560679906fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.194+0000 7f040ed9d640 1 -- 172.21.15.42:0/3831004379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560679814130 con 0x5606798f99d0 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.194+0000 7f040ed9d640 1 --2- 172.21.15.42:0/3831004379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x5606798f9db0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0408004ab0 tx=0x7f0408009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611bc2c846b451aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.194+0000 7f03fcff9640 1 -- 172.21.15.42:0/3831004379 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408048070 con 0x5606798f99d0 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.194+0000 7f03fcff9640 1 -- 172.21.15.42:0/3831004379 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0408036070 con 0x5606798f99d0 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.194+0000 7f03fcff9640 1 -- 172.21.15.42:0/3831004379 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408004520 con 0x5606798f99d0 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.194+0000 7f03ff7fe640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03f80a3350 0x7f03f80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f040e59c640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03f80a3350 0x7f03f80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f03ff7fe640 1 -- 172.21.15.42:0/970958855 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f04000cf680 con 0x7f0410102d30 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f040e59c640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03f80a3350 0x7f03f80a5810 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f040009bb00 tx=0x7f0400000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f0416d31740 1 -- 172.21.15.42:0/3831004379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 msgr2=0x5606798f9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f0416d31740 1 --2- 172.21.15.42:0/3831004379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x5606798f9db0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0408004ab0 tx=0x7f0408009a20 comp rx=0 tx=0).stop 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f0416d31740 1 -- 172.21.15.42:0/3831004379 shutdown_connections 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f0416d31740 1 --2- 172.21.15.42:0/3831004379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560679904bb0 0x560679906fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f0416d31740 1 --2- 172.21.15.42:0/3831004379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679904670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f0416d31740 1 --2- 172.21.15.42:0/3831004379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x5606798f9db0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f0416d31740 1 -- 172.21.15.42:0/3831004379 >> 172.21.15.42:0/3831004379 conn(0x5606798f5f60 msgr2=0x5606798f6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f0416d31740 1 -- 172.21.15.42:0/3831004379 shutdown_connections 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.195+0000 7f0416d31740 1 -- 172.21.15.42:0/3831004379 wait complete. 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f0416d31740 1 -- start start 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f0416d31740 1 Processor -- start 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f0416d31740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5606798f99d0 0x560679904410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f0416d31740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679901760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f0416d31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560679904bb0 0x560679901ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f0416d31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560679907780 con 0x560679904bb0 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f0416d31740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56067981af20 con 0x5606798f99d0 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f0416d31740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560679907900 con 0x5606798fa2f0 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f0416d31740 10 client.0 _ll_register_callbacks cb 0x5606797e4030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f040ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560679904bb0 0x560679901ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f040ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560679904bb0 0x560679901ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40652/0 (socket says 172.21.15.42:40652) 2024-09-19T09:39:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f040ed9d640 1 -- 172.21.15.42:0/3320876619 learned_addr learned my addr 172.21.15.42:0/3320876619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.196+0000 7f040ed9d640 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5606798f99d0 0x560679904410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f040dd9b640 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679901760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f040ed9d640 1 -- 172.21.15.42:0/3320876619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 msgr2=0x560679901760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f040ed9d640 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679901760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f040ed9d640 1 -- 172.21.15.42:0/3320876619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5606798f99d0 msgr2=0x560679904410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f040ed9d640 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5606798f99d0 0x560679904410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f040ed9d640 1 -- 172.21.15.42:0/3320876619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606795d12b0 con 0x560679904bb0 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f040ed9d640 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560679904bb0 0x560679901ca0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f040802ae00 tx=0x7f0408004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c948a950dda8c35f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f03f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f03f5ffb640 1 -- 172.21.15.42:0/3320876619 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408056060 con 0x560679904bb0 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f03f5ffb640 1 -- 172.21.15.42:0/3320876619 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0408003970 con 0x560679904bb0 2024-09-19T09:39:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f0416d31740 1 -- 172.21.15.42:0/3320876619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0408036070 con 0x560679904bb0 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f03f5ffb640 1 -- 172.21.15.42:0/3320876619 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0408048040 con 0x560679904bb0 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f0416d31740 10 client.15408 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f0416d31740 1 -- 172.21.15.42:0/3320876619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560679907780 con 0x560679904bb0 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.197+0000 7f03f5ffb640 1 -- 172.21.15.42:0/3320876619 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0408036070 con 0x560679904bb0 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.198+0000 7f03f5ffb640 1 -- 172.21.15.42:0/3320876619 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0408042030 con 0x560679904bb0 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.198+0000 7f0416d31740 10 client.15408 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.198+0000 7f0416d31740 10 client.15408 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.198+0000 7f0416d31740 20 client.15408 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.198+0000 7f0416d31740 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5606799151c0 0x560679916630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.198+0000 7f0416d31740 4 client.15408 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.198+0000 7f0416d31740 1 -- 172.21.15.42:0/3320876619 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56067986d600 con 0x5606799151c0 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.198+0000 7f040dd9b640 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5606799151c0 0x560679916630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.198+0000 7f040dd9b640 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5606799151c0 0x560679916630 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=30431a3a49d23937 server_cookie=38348f13a46954bc in_seq=0 out_seq=0 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.198+0000 7f03f5ffb640 10 client.15408 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.199+0000 7f03f5ffb640 1 -- 172.21.15.42:0/3320876619 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56067986d600 con 0x5606799151c0 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.199+0000 7f03f5ffb640 10 client.15408 handle_command_reply: tid=0 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.199+0000 7f0416d31740 1 client.15408 shutdown 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.199+0000 7f0416d31740 1 -- 172.21.15.42:0/3320876619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560679904bb0 msgr2=0x560679901ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.199+0000 7f0416d31740 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560679904bb0 0x560679901ca0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f040802ae00 tx=0x7f0408004180 comp rx=0 tx=0).stop 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.199+0000 7f0416d31740 1 -- 172.21.15.42:0/3320876619 shutdown_connections 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.199+0000 7f0416d31740 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5606799151c0 0x560679916630 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.200+0000 7f0416d31740 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560679904bb0 0x560679901ca0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.200+0000 7f03f5ffb640 0 client.15408 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.200+0000 7f0416d31740 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679901760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.200+0000 7f0416d31740 1 --2- 172.21.15.42:0/3320876619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5606798f99d0 0x560679904410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.200+0000 7f0416d31740 1 -- 172.21.15.42:0/3320876619 >> 172.21.15.42:0/3320876619 conn(0x5606798f5f60 msgr2=0x5606798fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.200+0000 7f0416d31740 1 -- 172.21.15.42:0/3320876619 shutdown_connections 2024-09-19T09:39:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.200+0000 7f0416d31740 1 -- 172.21.15.42:0/3320876619 wait complete. 2024-09-19T09:39:23.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.200+0000 7f0416d31740 20 client.15408 trim_cache size 0 max 16384 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.231+0000 7f0416d31740 1 Processor -- start 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.231+0000 7f0416d31740 1 -- start start 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f0416d31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x560679916630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f0416d31740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679900030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f0416d31740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560679904bb0 0x560679900570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f0416d31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560679914970 con 0x5606798f99d0 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f0416d31740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560679915040 con 0x560679904bb0 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f0416d31740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560679915710 con 0x5606798fa2f0 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x560679916630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x560679916630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40666/0 (socket says 172.21.15.42:40666) 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040ed9d640 1 -- 172.21.15.42:0/3392514032 learned_addr learned my addr 172.21.15.42:0/3392514032 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:23.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040dd9b640 1 --2- 172.21.15.42:0/3392514032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679900030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040ed9d640 1 -- 172.21.15.42:0/3392514032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 msgr2=0x560679900030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040ed9d640 1 --2- 172.21.15.42:0/3392514032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679900030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040ed9d640 1 -- 172.21.15.42:0/3392514032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560679904bb0 msgr2=0x560679900570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040ed9d640 1 --2- 172.21.15.42:0/3392514032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560679904bb0 0x560679900570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040ed9d640 1 -- 172.21.15.42:0/3392514032 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560679904030 con 0x5606798f99d0 2024-09-19T09:39:23.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040dd9b640 1 --2- 172.21.15.42:0/3392514032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679900030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:23.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.232+0000 7f040ed9d640 1 --2- 172.21.15.42:0/3392514032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x560679916630 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0408002230 tx=0x7f040802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debbc022f59ae813 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.233+0000 7f03f7fff640 1 -- 172.21.15.42:0/3392514032 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408056070 con 0x5606798f99d0 2024-09-19T09:39:23.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.233+0000 7f03f7fff640 1 -- 172.21.15.42:0/3392514032 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0408036040 con 0x5606798f99d0 2024-09-19T09:39:23.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.233+0000 7f03f7fff640 1 -- 172.21.15.42:0/3392514032 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04080305a0 con 0x5606798f99d0 2024-09-19T09:39:23.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.233+0000 7f0416d31740 1 -- 172.21.15.42:0/3392514032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 msgr2=0x560679916630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.233+0000 7f0416d31740 1 --2- 172.21.15.42:0/3392514032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x560679916630 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0408002230 tx=0x7f040802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 -- 172.21.15.42:0/3392514032 shutdown_connections 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 --2- 172.21.15.42:0/3392514032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560679904bb0 0x560679900570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 --2- 172.21.15.42:0/3392514032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5606798fa2f0 0x560679900030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 --2- 172.21.15.42:0/3392514032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798f99d0 0x560679916630 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 -- 172.21.15.42:0/3392514032 >> 172.21.15.42:0/3392514032 conn(0x5606798f5f60 msgr2=0x560679901720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 -- 172.21.15.42:0/3392514032 shutdown_connections 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 -- 172.21.15.42:0/3392514032 wait complete. 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 -- start start 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 Processor -- start 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5606798f99d0 0x560679977bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798fa2f0 0x560679978100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560679904bb0 0x560679919e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5606799164b0 con 0x5606798fa2f0 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560679915de0 con 0x5606798f99d0 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560679916b80 con 0x560679904bb0 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.234+0000 7f0416d31740 10 client.0 _ll_register_callbacks cb 0x7f0408046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798fa2f0 0x560679978100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798fa2f0 0x560679978100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40680/0 (socket says 172.21.15.42:40680) 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040dd9b640 1 -- 172.21.15.42:0/1908839633 learned_addr learned my addr 172.21.15.42:0/1908839633 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040ed9d640 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5606798f99d0 0x560679977bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040ed9d640 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560679904bb0 0x560679919e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040dd9b640 1 -- 172.21.15.42:0/1908839633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560679904bb0 msgr2=0x560679919e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040dd9b640 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560679904bb0 0x560679919e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040dd9b640 1 -- 172.21.15.42:0/1908839633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5606798f99d0 msgr2=0x560679977bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040dd9b640 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5606798f99d0 0x560679977bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040dd9b640 1 -- 172.21.15.42:0/1908839633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56067991a550 con 0x5606798fa2f0 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040ed9d640 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560679904bb0 0x560679919e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f040dd9b640 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798fa2f0 0x560679978100 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f041006a370 tx=0x7f04040118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b96cd5ac4e0e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f03f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f03f5ffb640 1 -- 172.21.15.42:0/1908839633 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404004220 con 0x5606798fa2f0 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f03f5ffb640 1 -- 172.21.15.42:0/1908839633 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f04040043c0 con 0x5606798fa2f0 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f0416d31740 1 -- 172.21.15.42:0/1908839633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0408036040 con 0x5606798fa2f0 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f03f5ffb640 1 -- 172.21.15.42:0/1908839633 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f040401e790 con 0x5606798fa2f0 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f0416d31740 10 client.15414 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.235+0000 7f0416d31740 1 -- 172.21.15.42:0/1908839633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56067997f360 con 0x5606798fa2f0 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.236+0000 7f03f5ffb640 1 -- 172.21.15.42:0/1908839633 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0408036040 con 0x5606798fa2f0 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.236+0000 7f03f5ffb640 1 -- 172.21.15.42:0/1908839633 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0404026450 con 0x5606798fa2f0 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.236+0000 7f0416d31740 10 client.15414 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.236+0000 7f0416d31740 10 client.15414 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.236+0000 7f0416d31740 20 client.15414 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.236+0000 7f0416d31740 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5606799151c0 0x560679982c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.236+0000 7f0416d31740 4 client.15414 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.236+0000 7f0416d31740 1 -- 172.21.15.42:0/1908839633 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "status"}) -- 0x560679867b10 con 0x5606799151c0 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.236+0000 7f040ed9d640 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5606799151c0 0x560679982c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f03f5ffb640 10 client.15414 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f040ed9d640 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5606799151c0 0x560679982c20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f0066d912bf0a741 server_cookie=72a77274d3faf46 in_seq=0 out_seq=0 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f03f5ffb640 1 -- 172.21.15.42:0/1908839633 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560679867b10 con 0x5606799151c0 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f03f5ffb640 10 client.15414 handle_command_reply: tid=0 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 client.15414 shutdown 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 -- 172.21.15.42:0/1908839633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798fa2f0 msgr2=0x560679978100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798fa2f0 0x560679978100 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f041006a370 tx=0x7f04040118d0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 -- 172.21.15.42:0/1908839633 shutdown_connections 2024-09-19T09:39:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x5606799151c0 0x560679982c20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f03f5ffb640 0 client.15414 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:39:23.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560679904bb0 0x560679919e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606798fa2f0 0x560679978100 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 --2- 172.21.15.42:0/1908839633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5606798f99d0 0x560679977bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 -- 172.21.15.42:0/1908839633 >> 172.21.15.42:0/1908839633 conn(0x5606798f5f60 msgr2=0x5606798ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 -- 172.21.15.42:0/1908839633 shutdown_connections 2024-09-19T09:39:23.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 1 -- 172.21.15.42:0/1908839633 wait complete. 2024-09-19T09:39:23.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.237+0000 7f0416d31740 20 client.15414 trim_cache size 0 max 16384 2024-09-19T09:39:23.244 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:39:23.244 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 4, 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24454, 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 121.24073805499999, 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 157.65371195899999 2024-09-19T09:39:23.245 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:39:23.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 -- 172.21.15.42:0/970958855 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03f80a3350 msgr2=0x7f03f80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03f80a3350 0x7f03f80a5810 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f040009bb00 tx=0x7f0400000bc0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 -- 172.21.15.42:0/970958855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0410102d30 msgr2=0x7f0410100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0410102d30 0x7f0410100990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f040000d950 tx=0x7f040000de10 comp rx=0 tx=0).stop 2024-09-19T09:39:23.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 -- 172.21.15.42:0/970958855 shutdown_connections 2024-09-19T09:39:23.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03f80a3350 0x7f03f80a5810 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04101082a0 0x7f0410101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04101036e0 0x7f0410100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 --2- 172.21.15.42:0/970958855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0410102d30 0x7f0410100990 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 -- 172.21.15.42:0/970958855 >> 172.21.15.42:0/970958855 conn(0x7f04100fc7d0 msgr2=0x7f0410105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 -- 172.21.15.42:0/970958855 shutdown_connections 2024-09-19T09:39:23.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:23.238+0000 7f0414958640 1 -- 172.21.15.42:0/970958855 wait complete. 2024-09-19T09:39:23.861 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T09:39:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:24.510 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:24 smithi042 ceph-mon[31223]: pgmap v339: 97 pgs: 97 active+clean; 655 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T09:39:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.593+0000 7fd983841640 1 -- 172.21.15.42:0/4038584049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd97c101420 msgr2=0x7fd97c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.593+0000 7fd983841640 1 --2- 172.21.15.42:0/4038584049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd97c101420 0x7fd97c10d950 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd974009cd0 tx=0x7fd97402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.593+0000 7fd983841640 1 -- 172.21.15.42:0/4038584049 shutdown_connections 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.593+0000 7fd983841640 1 --2- 172.21.15.42:0/4038584049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd97c101420 0x7fd97c10d950 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.593+0000 7fd983841640 1 --2- 172.21.15.42:0/4038584049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd97c100a80 0x7fd97c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.593+0000 7fd983841640 1 --2- 172.21.15.42:0/4038584049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97c106a80 0x7fd97c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.593+0000 7fd983841640 1 -- 172.21.15.42:0/4038584049 >> 172.21.15.42:0/4038584049 conn(0x7fd97c0fc7a0 msgr2=0x7fd97c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.593+0000 7fd983841640 1 -- 172.21.15.42:0/4038584049 shutdown_connections 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.593+0000 7fd983841640 1 -- 172.21.15.42:0/4038584049 wait complete. 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.594+0000 7fd983841640 1 Processor -- start 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.594+0000 7fd983841640 1 -- start start 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.594+0000 7fd983841640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97c100a80 0x7fd97c102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.594+0000 7fd983841640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd97c101420 0x7fd97c102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.594+0000 7fd983841640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd97c106a80 0x7fd97c1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.594+0000 7fd983841640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c110e80 con 0x7fd97c101420 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.594+0000 7fd983841640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c110d00 con 0x7fd97c106a80 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.594+0000 7fd983841640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c111000 con 0x7fd97c100a80 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.594+0000 7fd980ddc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd97c101420 0x7fd97c102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd980ddc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd97c101420 0x7fd97c102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40710/0 (socket says 172.21.15.42:40710) 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd980ddc640 1 -- 172.21.15.42:0/2624841402 learned_addr learned my addr 172.21.15.42:0/2624841402 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd981dde640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd97c106a80 0x7fd97c1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd9815dd640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97c100a80 0x7fd97c102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd980ddc640 1 -- 172.21.15.42:0/2624841402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97c100a80 msgr2=0x7fd97c102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd980ddc640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97c100a80 0x7fd97c102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd980ddc640 1 -- 172.21.15.42:0/2624841402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd97c106a80 msgr2=0x7fd97c1030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd980ddc640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd97c106a80 0x7fd97c1030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd980ddc640 1 -- 172.21.15.42:0/2624841402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c1a6870 con 0x7fd97c101420 2024-09-19T09:39:24.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd980ddc640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd97c101420 0x7fd97c102b90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd97800c890 tx=0x7fd97800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:24.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd96e7fc640 1 -- 172.21.15.42:0/2624841402 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978004220 con 0x7fd97c101420 2024-09-19T09:39:24.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd983841640 1 -- 172.21.15.42:0/2624841402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97c1a6b60 con 0x7fd97c101420 2024-09-19T09:39:24.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd96e7fc640 1 -- 172.21.15.42:0/2624841402 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9780043c0 con 0x7fd97c101420 2024-09-19T09:39:24.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd96e7fc640 1 -- 172.21.15.42:0/2624841402 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9780049e0 con 0x7fd97c101420 2024-09-19T09:39:24.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.595+0000 7fd983841640 1 -- 172.21.15.42:0/2624841402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97c1a70a0 con 0x7fd97c101420 2024-09-19T09:39:24.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.598+0000 7fd96e7fc640 1 -- 172.21.15.42:0/2624841402 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fd9780079b0 con 0x7fd97c101420 2024-09-19T09:39:24.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.598+0000 7fd985c1a740 1 Processor -- start 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.598+0000 7fd985c1a740 1 -- start start 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.598+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b79d0 0x5556670b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.598+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 0x5556670c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.598+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670c2bb0 0x5556670c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.598+0000 7fd985c1a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55566701e090 con 0x5556670c2bb0 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.598+0000 7fd985c1a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555666fc5a70 con 0x5556670b79d0 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.598+0000 7fd985c1a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55566701a050 con 0x5556670b82f0 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.598+0000 7fd96e7fc640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd9680a32d0 0x7fd9680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd981dde640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd9680a32d0 0x7fd9680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9815dd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 0x5556670c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd980ddc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670c2bb0 0x5556670c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9815dd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 0x5556670c2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:39322/0 (socket says 172.21.15.42:39322) 2024-09-19T09:39:24.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9815dd640 1 -- 172.21.15.42:0/1437111650 learned_addr learned my addr 172.21.15.42:0/1437111650 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:24.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd981dde640 1 --2- 172.21.15.42:0/1437111650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b79d0 0x5556670b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd96e7fc640 1 -- 172.21.15.42:0/2624841402 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd9780cfbd0 con 0x7fd97c101420 2024-09-19T09:39:24.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9815dd640 1 -- 172.21.15.42:0/1437111650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b79d0 msgr2=0x5556670b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:24.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9815dd640 1 --2- 172.21.15.42:0/1437111650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b79d0 0x5556670b7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9815dd640 1 -- 172.21.15.42:0/1437111650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670c2bb0 msgr2=0x5556670c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:24.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9815dd640 1 --2- 172.21.15.42:0/1437111650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670c2bb0 0x5556670c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9815dd640 1 -- 172.21.15.42:0/1437111650 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555666fd2130 con 0x5556670b82f0 2024-09-19T09:39:24.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd980ddc640 1 --2- 172.21.15.42:0/1437111650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670c2bb0 0x5556670c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:24.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd981dde640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd9680a32d0 0x7fd9680a5790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd974009a60 tx=0x7fd974009950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:24.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9815dd640 1 --2- 172.21.15.42:0/1437111650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 0x5556670c2670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd97000cbe0 tx=0x7fd97000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9efb4d488d34ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:24.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9677fe640 1 -- 172.21.15.42:0/1437111650 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970005220 con 0x5556670b82f0 2024-09-19T09:39:24.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9677fe640 1 -- 172.21.15.42:0/1437111650 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd970004c80 con 0x5556670b82f0 2024-09-19T09:39:24.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.599+0000 7fd9677fe640 1 -- 172.21.15.42:0/1437111650 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9700107b0 con 0x5556670b82f0 2024-09-19T09:39:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.600+0000 7fd985c1a740 1 -- 172.21.15.42:0/1437111650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 msgr2=0x5556670c2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.600+0000 7fd985c1a740 1 --2- 172.21.15.42:0/1437111650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 0x5556670c2670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd97000cbe0 tx=0x7fd97000e720 comp rx=0 tx=0).stop 2024-09-19T09:39:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.600+0000 7fd985c1a740 1 -- 172.21.15.42:0/1437111650 shutdown_connections 2024-09-19T09:39:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.600+0000 7fd985c1a740 1 --2- 172.21.15.42:0/1437111650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670c2bb0 0x5556670c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.600+0000 7fd985c1a740 1 --2- 172.21.15.42:0/1437111650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 0x5556670c2670 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.600+0000 7fd985c1a740 1 --2- 172.21.15.42:0/1437111650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b79d0 0x5556670b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.600+0000 7fd985c1a740 1 -- 172.21.15.42:0/1437111650 >> 172.21.15.42:0/1437111650 conn(0x5556670b3f60 msgr2=0x5556670b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.600+0000 7fd985c1a740 1 -- 172.21.15.42:0/1437111650 shutdown_connections 2024-09-19T09:39:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.600+0000 7fd985c1a740 1 -- 172.21.15.42:0/1437111650 wait complete. 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd985c1a740 1 -- start start 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd985c1a740 1 Processor -- start 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 0x5556670bf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670c2bb0 0x5556670bfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd985c1a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5556670c5780 con 0x5556670b79d0 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd985c1a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555666fd8f20 con 0x5556670c2bb0 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd985c1a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5556670c5900 con 0x5556670b82f0 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd985c1a740 10 client.0 _ll_register_callbacks cb 0x555666fa2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd9815dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd9815dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40720/0 (socket says 172.21.15.42:40720) 2024-09-19T09:39:24.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd9815dd640 1 -- 172.21.15.42:0/36136320 learned_addr learned my addr 172.21.15.42:0/36136320 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.601+0000 7fd981dde640 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670c2bb0 0x5556670bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd980ddc640 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 0x5556670bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd9815dd640 1 -- 172.21.15.42:0/36136320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 msgr2=0x5556670bf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd9815dd640 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 0x5556670bf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd9815dd640 1 -- 172.21.15.42:0/36136320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670c2bb0 msgr2=0x5556670bfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd9815dd640 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670c2bb0 0x5556670bfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd9815dd640 1 -- 172.21.15.42:0/36136320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555666d8f2b0 con 0x5556670b79d0 2024-09-19T09:39:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd9815dd640 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670c23c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd97000cbb0 tx=0x7fd97000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6da02984a8489b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd964ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd964ff9640 1 -- 172.21.15.42:0/36136320 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9700048d0 con 0x5556670b79d0 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd964ff9640 1 -- 172.21.15.42:0/36136320 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd970004a70 con 0x5556670b79d0 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd985c1a740 1 -- 172.21.15.42:0/36136320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd970004c80 con 0x5556670b79d0 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd964ff9640 1 -- 172.21.15.42:0/36136320 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd970004050 con 0x5556670b79d0 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd985c1a740 10 client.15426 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd985c1a740 1 -- 172.21.15.42:0/36136320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5556670d1010 con 0x5556670b79d0 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.602+0000 7fd964ff9640 1 -- 172.21.15.42:0/36136320 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd970004c80 con 0x5556670b79d0 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.603+0000 7fd964ff9640 1 -- 172.21.15.42:0/36136320 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd970010530 con 0x5556670b79d0 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.603+0000 7fd985c1a740 10 client.15426 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.603+0000 7fd985c1a740 10 client.15426 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.603+0000 7fd985c1a740 20 client.15426 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.603+0000 7fd985c1a740 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5556670d3470 0x5556670d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.603+0000 7fd985c1a740 4 client.15426 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.603+0000 7fd985c1a740 1 -- 172.21.15.42:0/36136320 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55566702b600 con 0x5556670d3470 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.603+0000 7fd980ddc640 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5556670d3470 0x5556670d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.604+0000 7fd980ddc640 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5556670d3470 0x5556670d48e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=43ab1d3c1f6e7a0 server_cookie=290454f212b91153 in_seq=0 out_seq=0 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.604+0000 7fd964ff9640 10 client.15426 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd964ff9640 1 -- 172.21.15.42:0/36136320 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55566702b600 con 0x5556670d3470 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd964ff9640 10 client.15426 handle_command_reply: tid=0 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 client.15426 shutdown 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 -- 172.21.15.42:0/36136320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 msgr2=0x5556670c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670c23c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd97000cbb0 tx=0x7fd97000c920 comp rx=0 tx=0).stop 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 -- 172.21.15.42:0/36136320 shutdown_connections 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5556670d3470 0x5556670d48e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670c2bb0 0x5556670bfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670b82f0 0x5556670bf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd964ff9640 0 client.15426 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:39:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 --2- 172.21.15.42:0/36136320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670c23c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 -- 172.21.15.42:0/36136320 >> 172.21.15.42:0/36136320 conn(0x5556670b3f60 msgr2=0x5556670b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 -- 172.21.15.42:0/36136320 shutdown_connections 2024-09-19T09:39:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 1 -- 172.21.15.42:0/36136320 wait complete. 2024-09-19T09:39:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.605+0000 7fd985c1a740 20 client.15426 trim_cache size 0 max 16384 2024-09-19T09:39:24.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.623+0000 7fd985c1a740 1 Processor -- start 2024-09-19T09:39:24.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.623+0000 7fd985c1a740 1 -- start start 2024-09-19T09:39:24.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.623+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.623+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b82f0 0x5556670bc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.623+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670c2bb0 0x5556670bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.623+0000 7fd985c1a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5556670d2c20 con 0x5556670b79d0 2024-09-19T09:39:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd985c1a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5556670d32f0 con 0x5556670b82f0 2024-09-19T09:39:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd985c1a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5556670d39c0 con 0x5556670c2bb0 2024-09-19T09:39:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd9815dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd9815dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670d48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40726/0 (socket says 172.21.15.42:40726) 2024-09-19T09:39:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd9815dd640 1 -- 172.21.15.42:0/296499456 learned_addr learned my addr 172.21.15.42:0/296499456 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd980ddc640 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b82f0 0x5556670bc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd981dde640 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670c2bb0 0x5556670bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd9815dd640 1 -- 172.21.15.42:0/296499456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670c2bb0 msgr2=0x5556670bceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd9815dd640 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670c2bb0 0x5556670bceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd9815dd640 1 -- 172.21.15.42:0/296499456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b82f0 msgr2=0x5556670bc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd9815dd640 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b82f0 0x5556670bc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd9815dd640 1 -- 172.21.15.42:0/296499456 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556670c2730 con 0x5556670b79d0 2024-09-19T09:39:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd981dde640 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670c2bb0 0x5556670bceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd980ddc640 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b82f0 0x5556670bc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd9815dd640 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670d48e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd97000ec20 tx=0x7fd970005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414e34dae5a8603e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd966ffd640 1 -- 172.21.15.42:0/296499456 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970005760 con 0x5556670b79d0 2024-09-19T09:39:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd966ffd640 1 -- 172.21.15.42:0/296499456 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd970010b90 con 0x5556670b79d0 2024-09-19T09:39:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.624+0000 7fd966ffd640 1 -- 172.21.15.42:0/296499456 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9700041f0 con 0x5556670b79d0 2024-09-19T09:39:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.625+0000 7fd985c1a740 1 -- 172.21.15.42:0/296499456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 msgr2=0x5556670d48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.625+0000 7fd985c1a740 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670d48e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd97000ec20 tx=0x7fd970005d60 comp rx=0 tx=0).stop 2024-09-19T09:39:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.625+0000 7fd985c1a740 1 -- 172.21.15.42:0/296499456 shutdown_connections 2024-09-19T09:39:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.625+0000 7fd985c1a740 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670c2bb0 0x5556670bceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.625+0000 7fd985c1a740 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b82f0 0x5556670bc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.625+0000 7fd985c1a740 1 --2- 172.21.15.42:0/296499456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670d48e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.625+0000 7fd985c1a740 1 -- 172.21.15.42:0/296499456 >> 172.21.15.42:0/296499456 conn(0x5556670b3f60 msgr2=0x5556670d2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.625+0000 7fd985c1a740 1 -- 172.21.15.42:0/296499456 shutdown_connections 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.625+0000 7fd985c1a740 1 -- 172.21.15.42:0/296499456 wait complete. 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd985c1a740 1 -- start start 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd985c1a740 1 Processor -- start 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670da990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b82f0 0x5556670daed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd985c1a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670c2bb0 0x5556670d5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd985c1a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5556670d4760 con 0x5556670b79d0 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd985c1a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5556670d4090 con 0x5556670b82f0 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd985c1a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5556670d4e30 con 0x5556670c2bb0 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd985c1a740 10 client.0 _ll_register_callbacks cb 0x7fd970014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd9815dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670da990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd9815dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670da990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40740/0 (socket says 172.21.15.42:40740) 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd9815dd640 1 -- 172.21.15.42:0/340725969 learned_addr learned my addr 172.21.15.42:0/340725969 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd9815dd640 1 -- 172.21.15.42:0/340725969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670c2bb0 msgr2=0x5556670d5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.626+0000 7fd9815dd640 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670c2bb0 0x5556670d5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd9815dd640 1 -- 172.21.15.42:0/340725969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b82f0 msgr2=0x5556670daed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd9815dd640 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b82f0 0x5556670daed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd9815dd640 1 -- 172.21.15.42:0/340725969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556670d6550 con 0x5556670b79d0 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd9815dd640 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670da990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd97000c3f0 tx=0x7fd97000c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40819c86f8c7770 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd964ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd964ff9640 1 -- 172.21.15.42:0/340725969 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970010490 con 0x5556670b79d0 2024-09-19T09:39:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd964ff9640 1 -- 172.21.15.42:0/340725969 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd970005480 con 0x5556670b79d0 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd985c1a740 1 -- 172.21.15.42:0/340725969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd970010b90 con 0x5556670b79d0 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd964ff9640 1 -- 172.21.15.42:0/340725969 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd9700048d0 con 0x5556670b79d0 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd985c1a740 10 client.15432 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd985c1a740 1 -- 172.21.15.42:0/340725969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5556670d9fc0 con 0x5556670b79d0 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd964ff9640 1 -- 172.21.15.42:0/340725969 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd970010b90 con 0x5556670b79d0 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd964ff9640 1 -- 172.21.15.42:0/340725969 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd970041030 con 0x5556670b79d0 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.627+0000 7fd985c1a740 10 client.15432 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd985c1a740 10 client.15432 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd985c1a740 20 client.15432 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd985c1a740 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x555667141e70 0x555667140b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd985c1a740 4 client.15432 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd985c1a740 1 -- 172.21.15.42:0/340725969 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "status"}) -- 0x555667025b10 con 0x555667141e70 2024-09-19T09:39:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd980ddc640 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x555667141e70 0x555667140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd980ddc640 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x555667141e70 0x555667140b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e6f943ac51b252c6 server_cookie=6672614324d717b2 in_seq=0 out_seq=0 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd964ff9640 10 client.15432 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd964ff9640 1 -- 172.21.15.42:0/340725969 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x555667025b10 con 0x555667141e70 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd964ff9640 10 client.15432 handle_command_reply: tid=0 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.628+0000 7fd985c1a740 1 client.15432 shutdown 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 1 -- 172.21.15.42:0/340725969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 msgr2=0x5556670da990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670da990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd97000c3f0 tx=0x7fd97000c600 comp rx=0 tx=0).stop 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 1 -- 172.21.15.42:0/340725969 shutdown_connections 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x555667141e70 0x555667140b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd964ff9640 0 client.15432 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556670c2bb0 0x5556670d5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556670b82f0 0x5556670daed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 1 --2- 172.21.15.42:0/340725969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556670b79d0 0x5556670da990 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 1 -- 172.21.15.42:0/340725969 >> 172.21.15.42:0/340725969 conn(0x5556670b3f60 msgr2=0x5556670b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:24.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 1 -- 172.21.15.42:0/340725969 shutdown_connections 2024-09-19T09:39:24.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 1 -- 172.21.15.42:0/340725969 wait complete. 2024-09-19T09:39:24.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd985c1a740 20 client.15432 trim_cache size 0 max 16384 2024-09-19T09:39:24.638 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:39:24.638 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:39:24.638 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 3, 2024-09-19T09:39:24.638 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24466, 2024-09-19T09:39:24.638 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:39:24.638 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:39:24.639 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:39:24.639 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 123.639441175, 2024-09-19T09:39:24.639 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-09-19T09:39:24.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:39:24.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:39:24.639 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 156.667866844 2024-09-19T09:39:24.639 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:39:24.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd983841640 1 -- 172.21.15.42:0/2624841402 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd9680a32d0 msgr2=0x7fd9680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:24.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd983841640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd9680a32d0 0x7fd9680a5790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd974009a60 tx=0x7fd974009950 comp rx=0 tx=0).stop 2024-09-19T09:39:24.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd983841640 1 -- 172.21.15.42:0/2624841402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd97c101420 msgr2=0x7fd97c102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:24.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.629+0000 7fd983841640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd97c101420 0x7fd97c102b90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd97800c890 tx=0x7fd97800cd50 comp rx=0 tx=0).stop 2024-09-19T09:39:24.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.630+0000 7fd983841640 1 -- 172.21.15.42:0/2624841402 shutdown_connections 2024-09-19T09:39:24.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.630+0000 7fd983841640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd9680a32d0 0x7fd9680a5790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.630+0000 7fd983841640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd97c106a80 0x7fd97c1030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.630+0000 7fd983841640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd97c101420 0x7fd97c102b90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.630+0000 7fd983841640 1 --2- 172.21.15.42:0/2624841402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97c100a80 0x7fd97c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:24.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.630+0000 7fd983841640 1 -- 172.21.15.42:0/2624841402 >> 172.21.15.42:0/2624841402 conn(0x7fd97c0fc7a0 msgr2=0x7fd97c06a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:24.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.630+0000 7fd983841640 1 -- 172.21.15.42:0/2624841402 shutdown_connections 2024-09-19T09:39:24.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:24.630+0000 7fd983841640 1 -- 172.21.15.42:0/2624841402 wait complete. 2024-09-19T09:39:24.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:24 smithi171 ceph-mon[35803]: pgmap v339: 97 pgs: 97 active+clean; 655 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T09:39:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:24 smithi136 ceph-mon[34840]: pgmap v339: 97 pgs: 97 active+clean; 655 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T09:39:25.413 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:39:25.673 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.091+0000 7f9123216640 1 -- 172.21.15.42:0/421475343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f911c101de0 msgr2=0x7f911c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.091+0000 7f9123216640 1 --2- 172.21.15.42:0/421475343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f911c101de0 0x7f911c1021c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f910c009900 tx=0x7f910c02a410 comp rx=0 tx=0).stop 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.091+0000 7f9123216640 1 -- 172.21.15.42:0/421475343 shutdown_connections 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.091+0000 7f9123216640 1 --2- 172.21.15.42:0/421475343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911c106f10 0x7f911c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.091+0000 7f9123216640 1 --2- 172.21.15.42:0/421475343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f911c102790 0x7f911c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.091+0000 7f9123216640 1 --2- 172.21.15.42:0/421475343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f911c101de0 0x7f911c1021c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.091+0000 7f9123216640 1 -- 172.21.15.42:0/421475343 >> 172.21.15.42:0/421475343 conn(0x7f911c0fd8c0 msgr2=0x7f911c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.091+0000 7f9123216640 1 -- 172.21.15.42:0/421475343 shutdown_connections 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.091+0000 7f9123216640 1 -- 172.21.15.42:0/421475343 wait complete. 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9123216640 1 Processor -- start 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9123216640 1 -- start start 2024-09-19T09:39:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9123216640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f911c101de0 0x7f911c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9123216640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f911c102790 0x7f911c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9123216640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911c106f10 0x7f911c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9123216640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f911c111f90 con 0x7f911c101de0 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9123216640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f911c111e10 con 0x7f911c106f10 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9123216640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f911c112110 con 0x7f911c102790 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9120fb2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f911c101de0 0x7f911c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9120fb2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f911c101de0 0x7f911c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40748/0 (socket says 172.21.15.42:40748) 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f9120fb2640 1 -- 172.21.15.42:0/1265236851 learned_addr learned my addr 172.21.15.42:0/1265236851 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f91217b3640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911c106f10 0x7f911c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.092+0000 7f911bfff640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f911c102790 0x7f911c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9120fb2640 1 -- 172.21.15.42:0/1265236851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f911c102790 msgr2=0x7f911c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9120fb2640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f911c102790 0x7f911c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9120fb2640 1 -- 172.21.15.42:0/1265236851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911c106f10 msgr2=0x7f911c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9120fb2640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911c106f10 0x7f911c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9120fb2640 1 -- 172.21.15.42:0/1265236851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911c1a69f0 con 0x7f911c101de0 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f91217b3640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911c106f10 0x7f911c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f911bfff640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f911c102790 0x7f911c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9120fb2640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f911c101de0 0x7f911c0744f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f910c006010 tx=0x7f910c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9119ffb640 1 -- 172.21.15.42:0/1265236851 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c03f030 con 0x7f911c101de0 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9123216640 1 -- 172.21.15.42:0/1265236851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f911c1a6c80 con 0x7f911c101de0 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9119ffb640 1 -- 172.21.15.42:0/1265236851 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f910c003ce0 con 0x7f911c101de0 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9119ffb640 1 -- 172.21.15.42:0/1265236851 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c035070 con 0x7f911c101de0 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.093+0000 7f9123216640 1 -- 172.21.15.42:0/1265236851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f911c1a7160 con 0x7f911c101de0 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.095+0000 7f9119ffb640 1 -- 172.21.15.42:0/1265236851 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f910c042030 con 0x7f911c101de0 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91255ef740 1 Processor -- start 2024-09-19T09:39:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91255ef740 1 -- start start 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91255ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced879d0 0x561dced87db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91255ef740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dced92670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91255ef740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced92bb0 0x561dced94fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91255ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561dcecee090 con 0x561dced879d0 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91255ef740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561dcec95a70 con 0x561dced882f0 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91255ef740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561dcecea050 con 0x561dced92bb0 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f9119ffb640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91040a32d0 0x7f91040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91217b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced879d0 0x561dced87db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91217b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced879d0 0x561dced87db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40760/0 (socket says 172.21.15.42:40760) 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91217b3640 1 -- 172.21.15.42:0/4080604078 learned_addr learned my addr 172.21.15.42:0/4080604078 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f91217b3640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91040a32d0 0x7f91040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f911bfff640 1 --2- 172.21.15.42:0/4080604078 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced92bb0 0x561dced94fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f9119ffb640 1 -- 172.21.15.42:0/1265236851 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f910c0f0010 con 0x7f911c101de0 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.096+0000 7f9120fb2640 1 --2- 172.21.15.42:0/4080604078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dced92670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.097+0000 7f91217b3640 1 -- 172.21.15.42:0/4080604078 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced92bb0 msgr2=0x561dced94fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.097+0000 7f91217b3640 1 --2- 172.21.15.42:0/4080604078 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced92bb0 0x561dced94fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.097+0000 7f91217b3640 1 -- 172.21.15.42:0/4080604078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 msgr2=0x561dced92670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.097+0000 7f91217b3640 1 --2- 172.21.15.42:0/4080604078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dced92670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.097+0000 7f91217b3640 1 -- 172.21.15.42:0/4080604078 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dceca2130 con 0x561dced879d0 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.097+0000 7f9120fb2640 1 --2- 172.21.15.42:0/4080604078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dced92670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.097+0000 7f91217b3640 1 --2- 172.21.15.42:0/4080604078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced879d0 0x561dced87db0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9114014ab0 tx=0x7f9114014f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eadcc8f2deba5a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.097+0000 7f9102ffd640 1 -- 172.21.15.42:0/4080604078 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9114023070 con 0x561dced879d0 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.097+0000 7f9102ffd640 1 -- 172.21.15.42:0/4080604078 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9114011e20 con 0x561dced879d0 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.097+0000 7f9102ffd640 1 -- 172.21.15.42:0/4080604078 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911400e3b0 con 0x561dced879d0 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 -- 172.21.15.42:0/4080604078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced879d0 msgr2=0x561dced87db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91217b3640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91040a32d0 0x7f91040a5790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9114020000 tx=0x7f911401b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 --2- 172.21.15.42:0/4080604078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced879d0 0x561dced87db0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9114014ab0 tx=0x7f9114014f70 comp rx=0 tx=0).stop 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 -- 172.21.15.42:0/4080604078 shutdown_connections 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 --2- 172.21.15.42:0/4080604078 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced92bb0 0x561dced94fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 --2- 172.21.15.42:0/4080604078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dced92670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 --2- 172.21.15.42:0/4080604078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced879d0 0x561dced87db0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 -- 172.21.15.42:0/4080604078 >> 172.21.15.42:0/4080604078 conn(0x561dced83f60 msgr2=0x561dced84340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 -- 172.21.15.42:0/4080604078 shutdown_connections 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 -- 172.21.15.42:0/4080604078 wait complete. 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 -- start start 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.098+0000 7f91255ef740 1 Processor -- start 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91255ef740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 0x561dced92430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91255ef740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dced8f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91255ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dced8fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91255ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561dced95780 con 0x561dced92bb0 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91255ef740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561dceca8f20 con 0x561dced882f0 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91255ef740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561dced95900 con 0x561dced879d0 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91255ef740 10 client.0 _ll_register_callbacks cb 0x561dcec72030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91217b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dced8fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91217b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dced8fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40770/0 (socket says 172.21.15.42:40770) 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91217b3640 1 -- 172.21.15.42:0/3428126624 learned_addr learned my addr 172.21.15.42:0/3428126624 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f9120fb2640 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 0x561dced92430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f911bfff640 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dced8f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91217b3640 1 -- 172.21.15.42:0/3428126624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 msgr2=0x561dced92430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91217b3640 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 0x561dced92430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91217b3640 1 -- 172.21.15.42:0/3428126624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 msgr2=0x561dced8f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:26.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91217b3640 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dced8f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91217b3640 1 -- 172.21.15.42:0/3428126624 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcea5f2b0 con 0x561dced92bb0 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f9120fb2640 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 0x561dced92430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f91217b3640 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dced8fcc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f91140097e0 tx=0x7f9114011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309b86a722dd166e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.099+0000 7f90fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.100+0000 7f90fbfff640 1 -- 172.21.15.42:0/3428126624 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911402d020 con 0x561dced92bb0 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.100+0000 7f91255ef740 1 -- 172.21.15.42:0/3428126624 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9114011e20 con 0x561dced92bb0 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.100+0000 7f90fbfff640 1 -- 172.21.15.42:0/3428126624 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f9114004c10 con 0x561dced92bb0 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.100+0000 7f90fbfff640 1 -- 172.21.15.42:0/3428126624 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9114038050 con 0x561dced92bb0 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.100+0000 7f91255ef740 10 client.15444 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.100+0000 7f91255ef740 1 -- 172.21.15.42:0/3428126624 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561dceda1000 con 0x561dced92bb0 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.100+0000 7f90fbfff640 1 -- 172.21.15.42:0/3428126624 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9114011e20 con 0x561dced92bb0 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.101+0000 7f90fbfff640 1 -- 172.21.15.42:0/3428126624 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f91140052d0 con 0x561dced92bb0 2024-09-19T09:39:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.101+0000 7f91255ef740 10 client.15444 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.101+0000 7f91255ef740 10 client.15444 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.101+0000 7f91255ef740 20 client.15444 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.101+0000 7f91255ef740 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x561dceda3b50 0x561dceda4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.101+0000 7f91255ef740 4 client.15444 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.101+0000 7f91255ef740 1 -- 172.21.15.42:0/3428126624 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561dcecfb600 con 0x561dceda3b50 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.101+0000 7f9120fb2640 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x561dceda3b50 0x561dceda4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.101+0000 7f9120fb2640 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x561dceda3b50 0x561dceda4fc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae1b637bd7d5f5a0 server_cookie=1d0716638481c2b0 in_seq=0 out_seq=0 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f90fbfff640 10 client.15444 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f90fbfff640 1 -- 172.21.15.42:0/3428126624 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561dcecfb600 con 0x561dceda3b50 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f90fbfff640 10 client.15444 handle_command_reply: tid=0 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f91255ef740 1 client.15444 shutdown 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f91255ef740 1 -- 172.21.15.42:0/3428126624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 msgr2=0x561dced8fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f91255ef740 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dced8fcc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f91140097e0 tx=0x7f9114011920 comp rx=0 tx=0).stop 2024-09-19T09:39:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f91255ef740 1 -- 172.21.15.42:0/3428126624 shutdown_connections 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f91255ef740 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x561dceda3b50 0x561dceda4fc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f91255ef740 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dced8fcc0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f91255ef740 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dced8f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f91255ef740 1 --2- 172.21.15.42:0/3428126624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 0x561dced92430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f91255ef740 1 -- 172.21.15.42:0/3428126624 >> 172.21.15.42:0/3428126624 conn(0x561dced83f60 msgr2=0x561dced89c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.102+0000 7f90fbfff640 0 client.15444 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.103+0000 7f91255ef740 1 -- 172.21.15.42:0/3428126624 shutdown_connections 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.103+0000 7f91255ef740 1 -- 172.21.15.42:0/3428126624 wait complete. 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.103+0000 7f91255ef740 20 client.15444 trim_cache size 0 max 16384 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91255ef740 1 Processor -- start 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91255ef740 1 -- start start 2024-09-19T09:39:26.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91255ef740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced879d0 0x561dceda4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91255ef740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced882f0 0x561dceda2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91255ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dcedad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91255ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561dceda3300 con 0x561dced92bb0 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91255ef740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561dceda39d0 con 0x561dced879d0 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91255ef740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561dceda40a0 con 0x561dced882f0 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91217b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dcedad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91217b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dcedad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40778/0 (socket says 172.21.15.42:40778) 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91217b3640 1 -- 172.21.15.42:0/2594265377 learned_addr learned my addr 172.21.15.42:0/2594265377 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f911bfff640 1 --2- 172.21.15.42:0/2594265377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced882f0 0x561dceda2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91217b3640 1 -- 172.21.15.42:0/2594265377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced882f0 msgr2=0x561dceda2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91217b3640 1 --2- 172.21.15.42:0/2594265377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced882f0 0x561dceda2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91217b3640 1 -- 172.21.15.42:0/2594265377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced879d0 msgr2=0x561dceda4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:26.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f9120fb2640 1 --2- 172.21.15.42:0/2594265377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced879d0 0x561dceda4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91217b3640 1 --2- 172.21.15.42:0/2594265377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced879d0 0x561dceda4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91217b3640 1 -- 172.21.15.42:0/2594265377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dced8dcd0 con 0x561dced92bb0 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f911bfff640 1 --2- 172.21.15.42:0/2594265377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced882f0 0x561dceda2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.121+0000 7f91217b3640 1 --2- 172.21.15.42:0/2594265377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dcedad2a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9114009b60 tx=0x7f9114014770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc0e30e43f4dc7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91027fc640 1 -- 172.21.15.42:0/2594265377 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911402d070 con 0x561dced92bb0 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91027fc640 1 -- 172.21.15.42:0/2594265377 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9114003e50 con 0x561dced92bb0 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91027fc640 1 -- 172.21.15.42:0/2594265377 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9114023040 con 0x561dced92bb0 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91255ef740 1 -- 172.21.15.42:0/2594265377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 msgr2=0x561dcedad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91255ef740 1 --2- 172.21.15.42:0/2594265377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dcedad2a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9114009b60 tx=0x7f9114014770 comp rx=0 tx=0).stop 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91255ef740 1 -- 172.21.15.42:0/2594265377 shutdown_connections 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91255ef740 1 --2- 172.21.15.42:0/2594265377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dcedad2a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91255ef740 1 --2- 172.21.15.42:0/2594265377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced882f0 0x561dceda2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91255ef740 1 --2- 172.21.15.42:0/2594265377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced879d0 0x561dceda4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91255ef740 1 -- 172.21.15.42:0/2594265377 >> 172.21.15.42:0/2594265377 conn(0x561dced83f60 msgr2=0x561dceda2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91255ef740 1 -- 172.21.15.42:0/2594265377 shutdown_connections 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.122+0000 7f91255ef740 1 -- 172.21.15.42:0/2594265377 wait complete. 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91255ef740 1 -- start start 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91255ef740 1 Processor -- start 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91255ef740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 0x561dcedad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91255ef740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dceda7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91255ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dceda80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91255ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561dceda4e40 con 0x561dced92bb0 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91255ef740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561dceda4770 con 0x561dced882f0 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91255ef740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561dceda5510 con 0x561dced879d0 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91255ef740 10 client.0 _ll_register_callbacks cb 0x7f9114021070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91217b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dceda80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91217b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dceda80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40794/0 (socket says 172.21.15.42:40794) 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f91217b3640 1 -- 172.21.15.42:0/3154717545 learned_addr learned my addr 172.21.15.42:0/3154717545 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.123+0000 7f911bfff640 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dceda7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f9120fb2640 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 0x561dcedad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f91217b3640 1 -- 172.21.15.42:0/3154717545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 msgr2=0x561dcedad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f91217b3640 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 0x561dcedad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f91217b3640 1 -- 172.21.15.42:0/3154717545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 msgr2=0x561dceda7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f91217b3640 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dceda7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f91217b3640 1 -- 172.21.15.42:0/3154717545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dceda8730 con 0x561dced92bb0 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f911bfff640 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dceda7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f91217b3640 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dceda80f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f91140099d0 tx=0x7f91140057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60ccb378bb3e2a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f90fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f90fbfff640 1 -- 172.21.15.42:0/3154717545 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911402d070 con 0x561dced92bb0 2024-09-19T09:39:26.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f91255ef740 1 -- 172.21.15.42:0/3154717545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9114003e50 con 0x561dced92bb0 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f90fbfff640 1 -- 172.21.15.42:0/3154717545 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f9114003970 con 0x561dced92bb0 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f90fbfff640 1 -- 172.21.15.42:0/3154717545 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f911404c050 con 0x561dced92bb0 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f91255ef740 10 client.15450 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.124+0000 7f91255ef740 1 -- 172.21.15.42:0/3154717545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561dcee0d010 con 0x561dced92bb0 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.125+0000 7f90fbfff640 1 -- 172.21.15.42:0/3154717545 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f911401d3e0 con 0x561dced92bb0 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.125+0000 7f90fbfff640 1 -- 172.21.15.42:0/3154717545 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9114004410 con 0x561dced92bb0 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.125+0000 7f91255ef740 10 client.15450 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.125+0000 7f91255ef740 10 client.15450 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.125+0000 7f91255ef740 20 client.15450 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.125+0000 7f91255ef740 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x561dcee11790 0x561dcee104a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.125+0000 7f91255ef740 4 client.15450 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.125+0000 7f91255ef740 1 -- 172.21.15.42:0/3154717545 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "status"}) -- 0x7f9114003e50 con 0x561dcee11790 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.125+0000 7f9120fb2640 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x561dcee11790 0x561dcee104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:26.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f9120fb2640 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x561dcee11790 0x561dcee104a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a01fb86004871d30 server_cookie=f57822dc6e94b72a in_seq=0 out_seq=0 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f90fbfff640 10 client.15450 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f90fbfff640 1 -- 172.21.15.42:0/3154717545 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x7f9114003e50 con 0x561dcee11790 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f90fbfff640 10 client.15450 handle_command_reply: tid=0 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f91255ef740 1 client.15450 shutdown 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f91255ef740 1 -- 172.21.15.42:0/3154717545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 msgr2=0x561dceda80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f91255ef740 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dceda80f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f91140099d0 tx=0x7f91140057c0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f91255ef740 1 -- 172.21.15.42:0/3154717545 shutdown_connections 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f91255ef740 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x561dcee11790 0x561dcee104a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f91255ef740 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561dced92bb0 0x561dceda80f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f91255ef740 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561dced882f0 0x561dceda7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f90fbfff640 0 client.15450 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f91255ef740 1 --2- 172.21.15.42:0/3154717545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561dced879d0 0x561dcedad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.126+0000 7f91255ef740 1 -- 172.21.15.42:0/3154717545 >> 172.21.15.42:0/3154717545 conn(0x561dced83f60 msgr2=0x561dced8f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f91255ef740 1 -- 172.21.15.42:0/3154717545 shutdown_connections 2024-09-19T09:39:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f91255ef740 1 -- 172.21.15.42:0/3154717545 wait complete. 2024-09-19T09:39:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f91255ef740 20 client.15450 trim_cache size 0 max 16384 2024-09-19T09:39:26.145 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:39:26.145 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:39:26.145 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 2, 2024-09-19T09:39:26.145 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24473, 2024-09-19T09:39:26.145 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:39:26.145 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:39:26.146 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:39:26.146 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 126.151271987, 2024-09-19T09:39:26.146 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-09-19T09:39:26.146 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:39:26.146 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:39:26.146 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 155.645041695 2024-09-19T09:39:26.146 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:39:26.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 -- 172.21.15.42:0/1265236851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91040a32d0 msgr2=0x7f91040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91040a32d0 0x7f91040a5790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9114020000 tx=0x7f911401b000 comp rx=0 tx=0).stop 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 -- 172.21.15.42:0/1265236851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f911c101de0 msgr2=0x7f911c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f911c101de0 0x7f911c0744f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f910c006010 tx=0x7f910c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 -- 172.21.15.42:0/1265236851 shutdown_connections 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f91040a32d0 0x7f91040a5790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f911c106f10 0x7f911c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f911c102790 0x7f911c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 --2- 172.21.15.42:0/1265236851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f911c101de0 0x7f911c0744f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 -- 172.21.15.42:0/1265236851 >> 172.21.15.42:0/1265236851 conn(0x7f911c0fd8c0 msgr2=0x7f911c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.127+0000 7f9123216640 1 -- 172.21.15.42:0/1265236851 shutdown_connections 2024-09-19T09:39:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:26.128+0000 7f9123216640 1 -- 172.21.15.42:0/1265236851 wait complete. 2024-09-19T09:39:26.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:26 smithi042 ceph-mon[31223]: pgmap v340: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-09-19T09:39:26.785 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:39:26.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:26 smithi171 ceph-mon[35803]: pgmap v340: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-09-19T09:39:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:26 smithi136 ceph-mon[34840]: pgmap v340: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-09-19T09:39:27.045 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.482+0000 7fdaa215e640 1 -- 172.21.15.42:0/2051171406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda9c101400 msgr2=0x7fda9c10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.482+0000 7fdaa215e640 1 --2- 172.21.15.42:0/2051171406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda9c101400 0x7fda9c10d930 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fda94009cd0 tx=0x7fda9402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.482+0000 7fdaa215e640 1 -- 172.21.15.42:0/2051171406 shutdown_connections 2024-09-19T09:39:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.482+0000 7fdaa215e640 1 --2- 172.21.15.42:0/2051171406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda9c101400 0x7fda9c10d930 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.482+0000 7fdaa215e640 1 --2- 172.21.15.42:0/2051171406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda9c100a60 0x7fda9c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.482+0000 7fdaa215e640 1 --2- 172.21.15.42:0/2051171406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda9c106a60 0x7fda9c106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.482+0000 7fdaa215e640 1 -- 172.21.15.42:0/2051171406 >> 172.21.15.42:0/2051171406 conn(0x7fda9c0fc780 msgr2=0x7fda9c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.482+0000 7fdaa215e640 1 -- 172.21.15.42:0/2051171406 shutdown_connections 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.482+0000 7fdaa215e640 1 -- 172.21.15.42:0/2051171406 wait complete. 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.482+0000 7fdaa215e640 1 Processor -- start 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fdaa215e640 1 -- start start 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fdaa215e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda9c100a60 0x7fda9c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fdaa215e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda9c101400 0x7fda9c1975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fdaa215e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda9c106a60 0x7fda9c197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fdaa215e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c110eb0 con 0x7fda9c100a60 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fdaa215e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c110d30 con 0x7fda9c101400 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fdaa215e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c111030 con 0x7fda9c106a60 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda9c100a60 0x7fda9c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda9c100a60 0x7fda9c1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40814/0 (socket says 172.21.15.42:40814) 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9b7fe640 1 -- 172.21.15.42:0/3857333251 learned_addr learned my addr 172.21.15.42:0/3857333251 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9bfff640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda9c106a60 0x7fda9c197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9affd640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda9c101400 0x7fda9c1975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9b7fe640 1 -- 172.21.15.42:0/3857333251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda9c106a60 msgr2=0x7fda9c197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda9c106a60 0x7fda9c197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9b7fe640 1 -- 172.21.15.42:0/3857333251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda9c101400 msgr2=0x7fda9c1975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda9c101400 0x7fda9c1975f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9b7fe640 1 -- 172.21.15.42:0/3857333251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c1a6920 con 0x7fda9c100a60 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9affd640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda9c101400 0x7fda9c1975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.483+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda9c100a60 0x7fda9c1970b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00d770 tx=0x7fda8c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.484+0000 7fda98ff9640 1 -- 172.21.15.42:0/3857333251 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c017070 con 0x7fda9c100a60 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.484+0000 7fdaa215e640 1 -- 172.21.15.42:0/3857333251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9c1a6c10 con 0x7fda9c100a60 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.484+0000 7fda98ff9640 1 -- 172.21.15.42:0/3857333251 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda8c005500 con 0x7fda9c100a60 2024-09-19T09:39:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.484+0000 7fda98ff9640 1 -- 172.21.15.42:0/3857333251 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c004e00 con 0x7fda9c100a60 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.484+0000 7fdaa215e640 1 -- 172.21.15.42:0/3857333251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9c1a7100 con 0x7fda9c100a60 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.486+0000 7fda98ff9640 1 -- 172.21.15.42:0/3857333251 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fda8c004fa0 con 0x7fda9c100a60 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.486+0000 7fdaa4537740 1 Processor -- start 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.486+0000 7fdaa4537740 1 -- start start 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb4edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb59670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb5bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fdaa4537740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e4dbab5090 con 0x55e4dbb59bb0 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fdaa4537740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e4dba5ca70 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fdaa4537740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e4dbab1050 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb5bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb4edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb5bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40828/0 (socket says 172.21.15.42:40828) 2024-09-19T09:39:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9affd640 1 -- 172.21.15.42:0/282606185 learned_addr learned my addr 172.21.15.42:0/282606185 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/282606185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb59670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9affd640 1 -- 172.21.15.42:0/282606185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb4e9d0 msgr2=0x55e4dbb4edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9affd640 1 --2- 172.21.15.42:0/282606185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb4edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9affd640 1 -- 172.21.15.42:0/282606185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4f2f0 msgr2=0x55e4dbb59670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9affd640 1 --2- 172.21.15.42:0/282606185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb59670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9affd640 1 -- 172.21.15.42:0/282606185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4dba69130 con 0x55e4dbb59bb0 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/282606185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb59670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda98ff9640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fda880a32d0 0x7fda880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9affd640 1 --2- 172.21.15.42:0/282606185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb5bfa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fda8400cc50 tx=0x7fda8400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2700c554ab6c9f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.487+0000 7fda9bfff640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fda880a32d0 0x7fda880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fda98ff9640 1 -- 172.21.15.42:0/3857333251 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fda8c0cf4f0 con 0x7fda9c100a60 2024-09-19T09:39:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fda91ffb640 1 -- 172.21.15.42:0/282606185 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84014070 con 0x55e4dbb59bb0 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fda91ffb640 1 -- 172.21.15.42:0/282606185 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda84019b40 con 0x55e4dbb59bb0 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fda91ffb640 1 -- 172.21.15.42:0/282606185 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84010cb0 con 0x55e4dbb59bb0 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fdaa4537740 1 -- 172.21.15.42:0/282606185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb59bb0 msgr2=0x55e4dbb5bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fda9bfff640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fda880a32d0 0x7fda880a5790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fda94005e30 tx=0x7fda9403d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fdaa4537740 1 --2- 172.21.15.42:0/282606185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb5bfa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fda8400cc50 tx=0x7fda8400e720 comp rx=0 tx=0).stop 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fdaa4537740 1 -- 172.21.15.42:0/282606185 shutdown_connections 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fdaa4537740 1 --2- 172.21.15.42:0/282606185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb5bfa0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fdaa4537740 1 --2- 172.21.15.42:0/282606185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb59670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fdaa4537740 1 --2- 172.21.15.42:0/282606185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb4edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fdaa4537740 1 -- 172.21.15.42:0/282606185 >> 172.21.15.42:0/282606185 conn(0x55e4dbb4af60 msgr2=0x55e4dbb4b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.488+0000 7fdaa4537740 1 -- 172.21.15.42:0/282606185 shutdown_connections 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fdaa4537740 1 -- 172.21.15.42:0/282606185 wait complete. 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fdaa4537740 1 -- start start 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fdaa4537740 1 Processor -- start 2024-09-19T09:39:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb56740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb56c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fdaa4537740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e4dbb5c780 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fdaa4537740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e4dba6ff20 con 0x55e4dbb59bb0 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fdaa4537740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e4dbb5c900 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fdaa4537740 10 client.0 _ll_register_callbacks cb 0x55e4dba39030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fda9b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fda9b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40838/0 (socket says 172.21.15.42:40838) 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.489+0000 7fda9b7fe640 1 -- 172.21.15.42:0/3684284895 learned_addr learned my addr 172.21.15.42:0/3684284895 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda9affd640 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb56740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda9b7fe640 1 -- 172.21.15.42:0/3684284895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb4f2f0 msgr2=0x55e4dbb56740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda9bfff640 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb56c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb56740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda9b7fe640 1 -- 172.21.15.42:0/3684284895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb59bb0 msgr2=0x55e4dbb56c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb56c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda9b7fe640 1 -- 172.21.15.42:0/3684284895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4db8262b0 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda9bfff640 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb56c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb593f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00d740 tx=0x7fda8c09b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d24d47ca5627737 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda7affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda7affd640 1 -- 172.21.15.42:0/3684284895 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c020070 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda7affd640 1 -- 172.21.15.42:0/3684284895 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fda8c009cc0 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fdaa4537740 1 -- 172.21.15.42:0/3684284895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda84019b40 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda7affd640 1 -- 172.21.15.42:0/3684284895 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fda8c0046c0 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fdaa4537740 10 client.15462 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fdaa4537740 1 -- 172.21.15.42:0/3684284895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e4dbb680d0 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.490+0000 7fda7affd640 1 -- 172.21.15.42:0/3684284895 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda84019b40 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.491+0000 7fda7affd640 1 -- 172.21.15.42:0/3684284895 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fda8c097fa0 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.491+0000 7fdaa4537740 10 client.15462 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.491+0000 7fdaa4537740 10 client.15462 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.491+0000 7fdaa4537740 20 client.15462 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.491+0000 7fdaa4537740 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55e4dbb6a680 0x55e4dbb6baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.491+0000 7fdaa4537740 4 client.15462 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.491+0000 7fdaa4537740 1 -- 172.21.15.42:0/3684284895 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4dbac2600 con 0x55e4dbb6a680 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.491+0000 7fda9affd640 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55e4dbb6a680 0x55e4dbb6baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.491+0000 7fda9affd640 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55e4dbb6a680 0x55e4dbb6baf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e911bdec7354ad12 server_cookie=5503c667819fae38 in_seq=0 out_seq=0 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.491+0000 7fda7affd640 10 client.15462 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fda7affd640 1 -- 172.21.15.42:0/3684284895 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4dbac2600 con 0x55e4dbb6a680 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fda7affd640 10 client.15462 handle_command_reply: tid=0 2024-09-19T09:39:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fdaa4537740 1 client.15462 shutdown 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fdaa4537740 1 -- 172.21.15.42:0/3684284895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4e9d0 msgr2=0x55e4dbb593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fdaa4537740 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb593f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00d740 tx=0x7fda8c09b700 comp rx=0 tx=0).stop 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fdaa4537740 1 -- 172.21.15.42:0/3684284895 shutdown_connections 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fdaa4537740 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55e4dbb6a680 0x55e4dbb6baf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fdaa4537740 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb56c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fdaa4537740 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb56740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fda7affd640 0 client.15462 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fdaa4537740 1 --2- 172.21.15.42:0/3684284895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb593f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.492+0000 7fdaa4537740 1 -- 172.21.15.42:0/3684284895 >> 172.21.15.42:0/3684284895 conn(0x55e4dbb4af60 msgr2=0x55e4dbb50c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.493+0000 7fdaa4537740 1 -- 172.21.15.42:0/3684284895 shutdown_connections 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.493+0000 7fdaa4537740 1 -- 172.21.15.42:0/3684284895 wait complete. 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.493+0000 7fdaa4537740 20 client.15462 trim_cache size 0 max 16384 2024-09-19T09:39:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.510+0000 7fdaa4537740 1 Processor -- start 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.510+0000 7fdaa4537740 1 -- start start 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb6baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb56700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb56c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fdaa4537740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e4dbb69e30 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fdaa4537740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e4dbb6a500 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fdaa4537740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e4dbb6abd0 con 0x55e4dbb59bb0 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb56700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb56700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40842/0 (socket says 172.21.15.42:40842) 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9affd640 1 -- 172.21.15.42:0/2333017760 learned_addr learned my addr 172.21.15.42:0/2333017760 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/2333017760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb6baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9affd640 1 -- 172.21.15.42:0/2333017760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb59bb0 msgr2=0x55e4dbb56c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9affd640 1 --2- 172.21.15.42:0/2333017760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb56c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9affd640 1 -- 172.21.15.42:0/2333017760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 msgr2=0x55e4dbb6baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9affd640 1 --2- 172.21.15.42:0/2333017760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb6baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9affd640 1 -- 172.21.15.42:0/2333017760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4dbb4ad90 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/2333017760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb6baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda9affd640 1 --2- 172.21.15.42:0/2333017760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb56700 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55e4dbb4c2e0 tx=0x7fda8400c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2faefa4252dfcc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda917fa640 1 -- 172.21.15.42:0/2333017760 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8402b070 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda917fa640 1 -- 172.21.15.42:0/2333017760 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda84010d90 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.511+0000 7fda917fa640 1 -- 172.21.15.42:0/2333017760 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84014040 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.512+0000 7fdaa4537740 1 -- 172.21.15.42:0/2333017760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 msgr2=0x55e4dbb56700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.512+0000 7fdaa4537740 1 --2- 172.21.15.42:0/2333017760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb56700 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55e4dbb4c2e0 tx=0x7fda8400c570 comp rx=0 tx=0).stop 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.512+0000 7fdaa4537740 1 -- 172.21.15.42:0/2333017760 shutdown_connections 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.512+0000 7fdaa4537740 1 --2- 172.21.15.42:0/2333017760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb59bb0 0x55e4dbb56c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.512+0000 7fdaa4537740 1 --2- 172.21.15.42:0/2333017760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb56700 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.512+0000 7fdaa4537740 1 --2- 172.21.15.42:0/2333017760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb6baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.512+0000 7fdaa4537740 1 -- 172.21.15.42:0/2333017760 >> 172.21.15.42:0/2333017760 conn(0x55e4dbb4af60 msgr2=0x55e4dbb55ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.512+0000 7fdaa4537740 1 -- 172.21.15.42:0/2333017760 shutdown_connections 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.512+0000 7fdaa4537740 1 -- 172.21.15.42:0/2333017760 wait complete. 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.512+0000 7fdaa4537740 1 -- start start 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fdaa4537740 1 Processor -- start 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb6cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb6d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fdaa4537740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb59bb0 0x55e4dbbd2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fdaa4537740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e4dbb6b970 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fdaa4537740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e4dbb6b2a0 con 0x55e4dbb4e9d0 2024-09-19T09:39:27.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fdaa4537740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e4dbb6c040 con 0x55e4dbb59bb0 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fdaa4537740 10 client.0 _ll_register_callbacks cb 0x7fda8c0d2e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda9affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb6d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda9affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb6d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40858/0 (socket says 172.21.15.42:40858) 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda9affd640 1 -- 172.21.15.42:0/1450585445 learned_addr learned my addr 172.21.15.42:0/1450585445 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb6cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda9affd640 1 -- 172.21.15.42:0/1450585445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb59bb0 msgr2=0x55e4dbbd2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda9affd640 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb59bb0 0x55e4dbbd2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda9affd640 1 -- 172.21.15.42:0/1450585445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 msgr2=0x55e4dbb6cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda9affd640 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb6cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda9affd640 1 -- 172.21.15.42:0/1450585445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4dbb6dda0 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda9affd640 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb6d4f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fda84005940 tx=0x7fda840058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14e7ae4c9962ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.513+0000 7fda7affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:27.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fda7affd640 1 -- 172.21.15.42:0/1450585445 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8402b070 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fda7affd640 1 -- 172.21.15.42:0/1450585445 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fda840108b0 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fdaa4537740 1 -- 172.21.15.42:0/1450585445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda84010d90 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fda7affd640 1 -- 172.21.15.42:0/1450585445 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fda84014040 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fdaa4537740 10 client.15468 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fdaa4537740 1 -- 172.21.15.42:0/1450585445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e4dbbd4310 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fda7affd640 1 -- 172.21.15.42:0/1450585445 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda84010d90 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fda7affd640 1 -- 172.21.15.42:0/1450585445 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fda84030810 con 0x55e4dbb4f2f0 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fdaa4537740 10 client.15468 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fdaa4537740 10 client.15468 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fdaa4537740 20 client.15468 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fdaa4537740 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55e4dbbd8930 0x55e4dbbd7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fdaa4537740 4 client.15468 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:39:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.514+0000 7fdaa4537740 1 -- 172.21.15.42:0/1450585445 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "status"}) -- 0x55e4dbabcb10 con 0x55e4dbbd8930 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55e4dbbd8930 0x55e4dbbd7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fda7affd640 10 client.15468 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fda9b7fe640 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55e4dbbd8930 0x55e4dbbd7640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=33b4ef6c88d27333 server_cookie=bf29646a705c578f in_seq=0 out_seq=0 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fda7affd640 1 -- 172.21.15.42:0/1450585445 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e4dbabcb10 con 0x55e4dbbd8930 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fda7affd640 10 client.15468 handle_command_reply: tid=0 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 client.15468 shutdown 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 -- 172.21.15.42:0/1450585445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 msgr2=0x55e4dbb6d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb6d4f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fda84005940 tx=0x7fda840058a0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 -- 172.21.15.42:0/1450585445 shutdown_connections 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55e4dbbd8930 0x55e4dbbd7640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4dbb59bb0 0x55e4dbbd2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4dbb4f2f0 0x55e4dbb6d4f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 --2- 172.21.15.42:0/1450585445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e4dbb4e9d0 0x55e4dbb6cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fda7affd640 0 client.15468 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:39:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 -- 172.21.15.42:0/1450585445 >> 172.21.15.42:0/1450585445 conn(0x55e4dbb4af60 msgr2=0x55e4dbb56700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 -- 172.21.15.42:0/1450585445 shutdown_connections 2024-09-19T09:39:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.515+0000 7fdaa4537740 1 -- 172.21.15.42:0/1450585445 wait complete. 2024-09-19T09:39:27.543 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:39:27.543 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:39:27.543 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 1, 2024-09-19T09:39:27.543 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24478, 2024-09-19T09:39:27.543 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:39:27.544 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:39:27.544 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:39:27.544 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 128.54686506199999, 2024-09-19T09:39:27.544 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-09-19T09:39:27.544 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:39:27.544 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:39:27.544 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 154.54394412400001 2024-09-19T09:39:27.544 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:39:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa4537740 20 client.15468 trim_cache size 0 max 16384 2024-09-19T09:39:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 -- 172.21.15.42:0/3857333251 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fda880a32d0 msgr2=0x7fda880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fda880a32d0 0x7fda880a5790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fda94005e30 tx=0x7fda9403d040 comp rx=0 tx=0).stop 2024-09-19T09:39:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 -- 172.21.15.42:0/3857333251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda9c100a60 msgr2=0x7fda9c1970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda9c100a60 0x7fda9c1970b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00d770 tx=0x7fda8c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:39:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 -- 172.21.15.42:0/3857333251 shutdown_connections 2024-09-19T09:39:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fda880a32d0 0x7fda880a5790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda9c106a60 0x7fda9c197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda9c101400 0x7fda9c1975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 --2- 172.21.15.42:0/3857333251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda9c100a60 0x7fda9c1970b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 -- 172.21.15.42:0/3857333251 >> 172.21.15.42:0/3857333251 conn(0x7fda9c0fc780 msgr2=0x7fda9c0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 -- 172.21.15.42:0/3857333251 shutdown_connections 2024-09-19T09:39:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:27.516+0000 7fdaa215e640 1 -- 172.21.15.42:0/3857333251 wait complete. 2024-09-19T09:39:28.251 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:39:28.508 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:28.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:28 smithi042 ceph-mon[31223]: pgmap v341: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-09-19T09:39:28.687 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:28 smithi136 ceph-mon[34840]: pgmap v341: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-09-19T09:39:28.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:28 smithi171 ceph-mon[35803]: pgmap v341: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-09-19T09:39:28.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 -- 172.21.15.42:0/4092855092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8930102570 msgr2=0x7f89301029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 --2- 172.21.15.42:0/4092855092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8930102570 0x7f89301029b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8918009900 tx=0x7f891802a480 comp rx=0 tx=0).stop 2024-09-19T09:39:28.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 -- 172.21.15.42:0/4092855092 shutdown_connections 2024-09-19T09:39:28.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 --2- 172.21.15.42:0/4092855092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8930102ef0 0x7f893010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 --2- 172.21.15.42:0/4092855092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8930102570 0x7f89301029b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 --2- 172.21.15.42:0/4092855092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8930100e20 0x7f8930101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 -- 172.21.15.42:0/4092855092 >> 172.21.15.42:0/4092855092 conn(0x7f89300fc7d0 msgr2=0x7f89300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 -- 172.21.15.42:0/4092855092 shutdown_connections 2024-09-19T09:39:28.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 -- 172.21.15.42:0/4092855092 wait complete. 2024-09-19T09:39:28.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 Processor -- start 2024-09-19T09:39:28.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.949+0000 7f8936d4a640 1 -- start start 2024-09-19T09:39:28.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f8936d4a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8930100e20 0x7f8930198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f8936d4a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8930102570 0x7f8930198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f8936d4a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8930102ef0 0x7f893019cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f8936d4a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8930111020 con 0x7f8930102570 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f8936d4a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8930110ea0 con 0x7f8930100e20 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f8936d4a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89301111a0 con 0x7f8930102ef0 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f892ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8930102570 0x7f8930198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f892ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8930102570 0x7f8930198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40874/0 (socket says 172.21.15.42:40874) 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f892ffff640 1 -- 172.21.15.42:0/2390023818 learned_addr learned my addr 172.21.15.42:0/2390023818 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f8934ae6640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8930100e20 0x7f8930198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f89352e7640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8930102ef0 0x7f893019cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f892ffff640 1 -- 172.21.15.42:0/2390023818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8930102ef0 msgr2=0x7f893019cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f892ffff640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8930102ef0 0x7f893019cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f892ffff640 1 -- 172.21.15.42:0/2390023818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8930100e20 msgr2=0x7f8930198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f892ffff640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8930100e20 0x7f8930198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f892ffff640 1 -- 172.21.15.42:0/2390023818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893019d6c0 con 0x7f8930102570 2024-09-19T09:39:28.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.950+0000 7f892ffff640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8930102570 0x7f8930198c50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8918006010 tx=0x7f8918003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.951+0000 7f892dffb640 1 -- 172.21.15.42:0/2390023818 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891803f070 con 0x7f8930102570 2024-09-19T09:39:28.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.951+0000 7f8936d4a640 1 -- 172.21.15.42:0/2390023818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893019d950 con 0x7f8930102570 2024-09-19T09:39:28.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.951+0000 7f892dffb640 1 -- 172.21.15.42:0/2390023818 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8918031e30 con 0x7f8930102570 2024-09-19T09:39:28.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.951+0000 7f892dffb640 1 -- 172.21.15.42:0/2390023818 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918035030 con 0x7f8930102570 2024-09-19T09:39:28.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.951+0000 7f8936d4a640 1 -- 172.21.15.42:0/2390023818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89301a5290 con 0x7f8930102570 2024-09-19T09:39:28.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.953+0000 7f892dffb640 1 -- 172.21.15.42:0/2390023818 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f8918042070 con 0x7f8930102570 2024-09-19T09:39:28.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.953+0000 7f8939123740 1 Processor -- start 2024-09-19T09:39:28.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f8939123740 1 -- start start 2024-09-19T09:39:28.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f8939123740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a3edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f892dffb640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f891c0a32d0 0x7f891c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f8939123740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a49670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f8939123740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a4bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f8939123740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d149a5090 con 0x562d14a3e9d0 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f8939123740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562d1494ca70 con 0x562d14a3f2f0 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f8939123740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562d149a1050 con 0x562d14a49bb0 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f892dffb640 1 -- 172.21.15.42:0/2390023818 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f89180f0380 con 0x7f8930102570 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f89352e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a3edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f8934ae6640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f891c0a32d0 0x7f891c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f89352e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a3edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40878/0 (socket says 172.21.15.42:40878) 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f89352e7640 1 -- 172.21.15.42:0/516732944 learned_addr learned my addr 172.21.15.42:0/516732944 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f892ffff640 1 --2- 172.21.15.42:0/516732944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a49670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f89352e7640 1 -- 172.21.15.42:0/516732944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 msgr2=0x562d14a4bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f89352e7640 1 --2- 172.21.15.42:0/516732944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a4bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f89352e7640 1 -- 172.21.15.42:0/516732944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 msgr2=0x562d14a49670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f89352e7640 1 --2- 172.21.15.42:0/516732944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a49670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.954+0000 7f89352e7640 1 -- 172.21.15.42:0/516732944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d14959130 con 0x562d14a3e9d0 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.955+0000 7f8934ae6640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f891c0a32d0 0x7f891c0a5790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8920009990 tx=0x7f8920009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.955+0000 7f89352e7640 1 --2- 172.21.15.42:0/516732944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a3edb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8928009900 tx=0x7f892800a990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5463890853e6531e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.955+0000 7f8926ffd640 1 -- 172.21.15.42:0/516732944 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8928010670 con 0x562d14a3e9d0 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.955+0000 7f8926ffd640 1 -- 172.21.15.42:0/516732944 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8928010cf0 con 0x562d14a3e9d0 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.955+0000 7f8926ffd640 1 -- 172.21.15.42:0/516732944 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89280153d0 con 0x562d14a3e9d0 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 -- 172.21.15.42:0/516732944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 msgr2=0x562d14a3edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 --2- 172.21.15.42:0/516732944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a3edb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8928009900 tx=0x7f892800a990 comp rx=0 tx=0).stop 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 -- 172.21.15.42:0/516732944 shutdown_connections 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 --2- 172.21.15.42:0/516732944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a4bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 --2- 172.21.15.42:0/516732944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a49670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 --2- 172.21.15.42:0/516732944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a3edb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 -- 172.21.15.42:0/516732944 >> 172.21.15.42:0/516732944 conn(0x562d14a3af60 msgr2=0x562d14a3b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 -- 172.21.15.42:0/516732944 shutdown_connections 2024-09-19T09:39:28.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 -- 172.21.15.42:0/516732944 wait complete. 2024-09-19T09:39:28.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 -- start start 2024-09-19T09:39:28.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.956+0000 7f8939123740 1 Processor -- start 2024-09-19T09:39:28.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f8939123740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3e9d0 0x562d14a49450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f8939123740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3f2f0 0x562d14a467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f8939123740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a46ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f8939123740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d14a4c780 con 0x562d14a3f2f0 2024-09-19T09:39:28.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f8939123740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562d1495ff20 con 0x562d14a3e9d0 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f8939123740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562d14a4c900 con 0x562d14a49bb0 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f8939123740 10 client.0 _ll_register_callbacks cb 0x562d14929030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f892ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3f2f0 0x562d14a467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f892ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3f2f0 0x562d14a467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40888/0 (socket says 172.21.15.42:40888) 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f892ffff640 1 -- 172.21.15.42:0/3902061281 learned_addr learned my addr 172.21.15.42:0/3902061281 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f8934ae6640 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3e9d0 0x562d14a49450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f89352e7640 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a46ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f892ffff640 1 -- 172.21.15.42:0/3902061281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 msgr2=0x562d14a46ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f892ffff640 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a46ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f892ffff640 1 -- 172.21.15.42:0/3902061281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3e9d0 msgr2=0x562d14a49450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f892ffff640 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3e9d0 0x562d14a49450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f892ffff640 1 -- 172.21.15.42:0/3902061281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d147162b0 con 0x562d14a3f2f0 2024-09-19T09:39:28.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f892ffff640 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3f2f0 0x562d14a467a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f89180bc750 tx=0x7f89180bc610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90940d0a0d7a42bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f890ffff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f890ffff640 1 -- 172.21.15.42:0/3902061281 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918049030 con 0x562d14a3f2f0 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f890ffff640 1 -- 172.21.15.42:0/3902061281 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f89180edf00 con 0x562d14a3f2f0 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.957+0000 7f8939123740 1 -- 172.21.15.42:0/3902061281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8928010cf0 con 0x562d14a3f2f0 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f890ffff640 1 -- 172.21.15.42:0/3902061281 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89180bc7c0 con 0x562d14a3f2f0 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f8939123740 10 client.15480 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f8939123740 1 -- 172.21.15.42:0/3902061281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d14a580a0 con 0x562d14a3f2f0 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f890ffff640 1 -- 172.21.15.42:0/3902061281 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8928010cf0 con 0x562d14a3f2f0 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f890ffff640 1 -- 172.21.15.42:0/3902061281 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f89180bca20 con 0x562d14a3f2f0 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f8939123740 10 client.15480 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f8939123740 10 client.15480 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f8939123740 20 client.15480 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:28.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f8939123740 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562d14a5a670 0x562d14a5bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f8939123740 4 client.15480 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f8939123740 1 -- 172.21.15.42:0/3902061281 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d149b2600 con 0x562d14a5a670 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.958+0000 7f8934ae6640 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562d14a5a670 0x562d14a5bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.959+0000 7f8934ae6640 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562d14a5a670 0x562d14a5bae0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c46d40022f58e08d server_cookie=aa01d319938fcd72 in_seq=0 out_seq=0 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.959+0000 7f890ffff640 10 client.15480 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.959+0000 7f890ffff640 1 -- 172.21.15.42:0/3902061281 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d149b2600 con 0x562d14a5a670 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.959+0000 7f890ffff640 10 client.15480 handle_command_reply: tid=0 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.959+0000 7f8939123740 1 client.15480 shutdown 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 1 -- 172.21.15.42:0/3902061281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3f2f0 msgr2=0x562d14a467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3f2f0 0x562d14a467a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f89180bc750 tx=0x7f89180bc610 comp rx=0 tx=0).stop 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 1 -- 172.21.15.42:0/3902061281 shutdown_connections 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562d14a5a670 0x562d14a5bae0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f890ffff640 0 client.15480 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:28.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a46ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3f2f0 0x562d14a467a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 1 --2- 172.21.15.42:0/3902061281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3e9d0 0x562d14a49450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 1 -- 172.21.15.42:0/3902061281 >> 172.21.15.42:0/3902061281 conn(0x562d14a3af60 msgr2=0x562d14a40c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 1 -- 172.21.15.42:0/3902061281 shutdown_connections 2024-09-19T09:39:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 1 -- 172.21.15.42:0/3902061281 wait complete. 2024-09-19T09:39:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.960+0000 7f8939123740 20 client.15480 trim_cache size 0 max 16384 2024-09-19T09:39:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8939123740 1 Processor -- start 2024-09-19T09:39:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8939123740 1 -- start start 2024-09-19T09:39:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8939123740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a5bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8939123740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a35ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8939123740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a46760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8939123740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d14a59e20 con 0x562d14a3e9d0 2024-09-19T09:39:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8939123740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562d14a5a4f0 con 0x562d14a3f2f0 2024-09-19T09:39:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8939123740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562d14a5abc0 con 0x562d14a49bb0 2024-09-19T09:39:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8934ae6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a5bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8934ae6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a5bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40892/0 (socket says 172.21.15.42:40892) 2024-09-19T09:39:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8934ae6640 1 -- 172.21.15.42:0/2406661847 learned_addr learned my addr 172.21.15.42:0/2406661847 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8934ae6640 1 -- 172.21.15.42:0/2406661847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 msgr2=0x562d14a46760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8934ae6640 1 --2- 172.21.15.42:0/2406661847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a46760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8934ae6640 1 -- 172.21.15.42:0/2406661847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 msgr2=0x562d14a35ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f892ffff640 1 --2- 172.21.15.42:0/2406661847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a35ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8934ae6640 1 --2- 172.21.15.42:0/2406661847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a35ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.978+0000 7f8934ae6640 1 -- 172.21.15.42:0/2406661847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d14a49070 con 0x562d14a3e9d0 2024-09-19T09:39:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f8934ae6640 1 --2- 172.21.15.42:0/2406661847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a5bae0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f892000eb40 tx=0x7f89200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2141a7c0b5d2a48e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f89267fc640 1 -- 172.21.15.42:0/2406661847 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892001b040 con 0x562d14a3e9d0 2024-09-19T09:39:28.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f89267fc640 1 -- 172.21.15.42:0/2406661847 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f892002b030 con 0x562d14a3e9d0 2024-09-19T09:39:28.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f89267fc640 1 -- 172.21.15.42:0/2406661847 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89200136b0 con 0x562d14a3e9d0 2024-09-19T09:39:28.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f8939123740 1 -- 172.21.15.42:0/2406661847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 msgr2=0x562d14a5bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f8939123740 1 --2- 172.21.15.42:0/2406661847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a5bae0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f892000eb40 tx=0x7f89200046c0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f8939123740 1 -- 172.21.15.42:0/2406661847 shutdown_connections 2024-09-19T09:39:28.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f8939123740 1 --2- 172.21.15.42:0/2406661847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a46760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f8939123740 1 --2- 172.21.15.42:0/2406661847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a35ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f8939123740 1 --2- 172.21.15.42:0/2406661847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a5bae0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f8939123740 1 -- 172.21.15.42:0/2406661847 >> 172.21.15.42:0/2406661847 conn(0x562d14a3af60 msgr2=0x562d14a45070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f8939123740 1 -- 172.21.15.42:0/2406661847 shutdown_connections 2024-09-19T09:39:28.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.979+0000 7f8939123740 1 -- 172.21.15.42:0/2406661847 wait complete. 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8939123740 1 -- start start 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8939123740 1 Processor -- start 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8939123740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a63e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8939123740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8939123740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a5f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8939123740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d14a5b960 con 0x562d14a3e9d0 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8939123740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562d14a5b290 con 0x562d14a3f2f0 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8939123740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562d14a5c030 con 0x562d14a49bb0 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8939123740 10 client.0 _ll_register_callbacks cb 0x7f8918031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8934ae6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a63e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8934ae6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a63e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40900/0 (socket says 172.21.15.42:40900) 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.980+0000 7f8934ae6640 1 -- 172.21.15.42:0/1730266480 learned_addr learned my addr 172.21.15.42:0/1730266480 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:28.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f892ffff640 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f89352e7640 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a5f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f8934ae6640 1 -- 172.21.15.42:0/1730266480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 msgr2=0x562d14a5f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f8934ae6640 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a5f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f8934ae6640 1 -- 172.21.15.42:0/1730266480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 msgr2=0x562d14a643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f8934ae6640 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f8934ae6640 1 -- 172.21.15.42:0/1730266480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d14a5fab0 con 0x562d14a3e9d0 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f89352e7640 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a5f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f8934ae6640 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a63e60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8920021b00 tx=0x7f89200047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f6fac587b9e07f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f890ffff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f890ffff640 1 -- 172.21.15.42:0/1730266480 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920034070 con 0x562d14a3e9d0 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f890ffff640 1 -- 172.21.15.42:0/1730266480 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8920021620 con 0x562d14a3e9d0 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f8939123740 1 -- 172.21.15.42:0/1730266480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f892002b030 con 0x562d14a3e9d0 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f890ffff640 1 -- 172.21.15.42:0/1730266480 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8920021820 con 0x562d14a3e9d0 2024-09-19T09:39:28.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f8939123740 10 client.15486 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:28.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.981+0000 7f8939123740 1 -- 172.21.15.42:0/1730266480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d14ac8c90 con 0x562d14a3e9d0 2024-09-19T09:39:28.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f890ffff640 1 -- 172.21.15.42:0/1730266480 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f892002b030 con 0x562d14a3e9d0 2024-09-19T09:39:28.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f890ffff640 1 -- 172.21.15.42:0/1730266480 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8920013550 con 0x562d14a3e9d0 2024-09-19T09:39:28.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f8939123740 10 client.15486 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:28.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f8939123740 10 client.15486 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:39:28.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f8939123740 20 client.15486 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f8939123740 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562d14a5a670 0x562d14acc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f8939123740 4 client.15486 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f8939123740 1 -- 172.21.15.42:0/1730266480 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "status"}) -- 0x562d149acb10 con 0x562d14a5a670 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f892ffff640 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562d14a5a670 0x562d14acc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f890ffff640 10 client.15486 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.982+0000 7f892ffff640 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562d14a5a670 0x562d14acc0c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f539381a2a435330 server_cookie=8fef9882b64f3c68 in_seq=0 out_seq=0 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f890ffff640 1 -- 172.21.15.42:0/1730266480 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562d149acb10 con 0x562d14a5a670 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f890ffff640 10 client.15486 handle_command_reply: tid=0 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 client.15486 shutdown 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 -- 172.21.15.42:0/1730266480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 msgr2=0x562d14a63e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a63e60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8920021b00 tx=0x7f89200047d0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 -- 172.21.15.42:0/1730266480 shutdown_connections 2024-09-19T09:39:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562d14a5a670 0x562d14acc0c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f890ffff640 0 client.15486 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562d14a49bb0 0x562d14a5f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562d14a3f2f0 0x562d14a643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 --2- 172.21.15.42:0/1730266480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d14a3e9d0 0x562d14a63e60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 -- 172.21.15.42:0/1730266480 >> 172.21.15.42:0/1730266480 conn(0x562d14a3af60 msgr2=0x562d14a44c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 -- 172.21.15.42:0/1730266480 shutdown_connections 2024-09-19T09:39:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 1 -- 172.21.15.42:0/1730266480 wait complete. 2024-09-19T09:39:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.983+0000 7f8939123740 20 client.15486 trim_cache size 0 max 16384 2024-09-19T09:39:28.992 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "90ecc87a-7669-11ef-bceb-c7b262605968", 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24506, 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 136.97089614699999, 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 81, 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 147.564268239 2024-09-19T09:39:28.993 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:39:28.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 -- 172.21.15.42:0/2390023818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f891c0a32d0 msgr2=0x7f891c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f891c0a32d0 0x7f891c0a5790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8920009990 tx=0x7f8920009110 comp rx=0 tx=0).stop 2024-09-19T09:39:28.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 -- 172.21.15.42:0/2390023818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8930102570 msgr2=0x7f8930198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8930102570 0x7f8930198c50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8918006010 tx=0x7f8918003c80 comp rx=0 tx=0).stop 2024-09-19T09:39:28.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 -- 172.21.15.42:0/2390023818 shutdown_connections 2024-09-19T09:39:28.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f891c0a32d0 0x7f891c0a5790 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8930102ef0 0x7f893019cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8930102570 0x7f8930198c50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 --2- 172.21.15.42:0/2390023818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8930100e20 0x7f8930198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 -- 172.21.15.42:0/2390023818 >> 172.21.15.42:0/2390023818 conn(0x7f89300fc7d0 msgr2=0x7f893006a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 -- 172.21.15.42:0/2390023818 shutdown_connections 2024-09-19T09:39:28.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:28.984+0000 7f8936d4a640 1 -- 172.21.15.42:0/2390023818 wait complete. 2024-09-19T09:39:29.737 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T09:39:30.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:30 smithi042 ceph-mon[31223]: pgmap v342: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.3 KiB/s wr, 15 op/s 2024-09-19T09:39:30.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:30 smithi171 ceph-mon[35803]: pgmap v342: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.3 KiB/s wr, 15 op/s 2024-09-19T09:39:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:30 smithi136 ceph-mon[34840]: pgmap v342: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.3 KiB/s wr, 15 op/s 2024-09-19T09:39:32.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:32 smithi042 ceph-mon[31223]: pgmap v343: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-09-19T09:39:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.707+0000 7feaabd78640 1 -- 172.21.15.42:0/1818670300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaa4100560 msgr2=0x7feaa410a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.707+0000 7feaabd78640 1 --2- 172.21.15.42:0/1818670300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaa4100560 0x7feaa410a110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009cd0 tx=0x7fea9c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.707+0000 7feaabd78640 1 -- 172.21.15.42:0/1818670300 shutdown_connections 2024-09-19T09:39:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.707+0000 7feaabd78640 1 --2- 172.21.15.42:0/1818670300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaa4100560 0x7feaa410a110 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.707+0000 7feaabd78640 1 --2- 172.21.15.42:0/1818670300 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feaa40ffba0 0x7feaa4100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.707+0000 7feaabd78640 1 --2- 172.21.15.42:0/1818670300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feaa4103130 0x7feaa4103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.707+0000 7feaabd78640 1 -- 172.21.15.42:0/1818670300 >> 172.21.15.42:0/1818670300 conn(0x7feaa40fb930 msgr2=0x7feaa40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.707+0000 7feaabd78640 1 -- 172.21.15.42:0/1818670300 shutdown_connections 2024-09-19T09:39:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.707+0000 7feaabd78640 1 -- 172.21.15.42:0/1818670300 wait complete. 2024-09-19T09:39:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.708+0000 7feaabd78640 1 Processor -- start 2024-09-19T09:39:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.708+0000 7feaabd78640 1 -- start start 2024-09-19T09:39:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.708+0000 7feaabd78640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaa40ffba0 0x7feaa4197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.708+0000 7feaabd78640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feaa4100560 0x7feaa41982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.708+0000 7feaabd78640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feaa4103130 0x7feaa419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.708+0000 7feaabd78640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feaa410d7f0 con 0x7feaa40ffba0 2024-09-19T09:39:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.708+0000 7feaabd78640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feaa410d670 con 0x7feaa4100560 2024-09-19T09:39:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.708+0000 7feaabd78640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feaa410d970 con 0x7feaa4103130 2024-09-19T09:39:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.708+0000 7feaa9b14640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaa40ffba0 0x7feaa4197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaa9b14640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaa40ffba0 0x7feaa4197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39596/0 (socket says 172.21.15.42:39596) 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaa9b14640 1 -- 172.21.15.42:0/3573322406 learned_addr learned my addr 172.21.15.42:0/3573322406 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaaa315640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feaa4103130 0x7feaa419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaa9313640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feaa4100560 0x7feaa41982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaa9b14640 1 -- 172.21.15.42:0/3573322406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feaa4103130 msgr2=0x7feaa419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaa9b14640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feaa4103130 0x7feaa419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaa9b14640 1 -- 172.21.15.42:0/3573322406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feaa4100560 msgr2=0x7feaa41982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaa9b14640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feaa4100560 0x7feaa41982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaa9b14640 1 -- 172.21.15.42:0/3573322406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa419f980 con 0x7feaa40ffba0 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaa9b14640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaa40ffba0 0x7feaa4197d60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7feaa000d950 tx=0x7feaa000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7fea9affd640 1 -- 172.21.15.42:0/3573322406 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa0017070 con 0x7feaa40ffba0 2024-09-19T09:39:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaabd78640 1 -- 172.21.15.42:0/3573322406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa419fc70 con 0x7feaa40ffba0 2024-09-19T09:39:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7fea9affd640 1 -- 172.21.15.42:0/3573322406 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaa000be10 con 0x7feaa40ffba0 2024-09-19T09:39:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7fea9affd640 1 -- 172.21.15.42:0/3573322406 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa000f620 con 0x7feaa40ffba0 2024-09-19T09:39:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.709+0000 7feaabd78640 1 -- 172.21.15.42:0/3573322406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa41a01c0 con 0x7feaa40ffba0 2024-09-19T09:39:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.712+0000 7feaaebf1740 1 Processor -- start 2024-09-19T09:39:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7fea9affd640 1 -- 172.21.15.42:0/3573322406 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7feaa001a070 con 0x7feaa40ffba0 2024-09-19T09:39:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaebf1740 1 -- start start 2024-09-19T09:39:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17289a0 0x561de1728da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17292e0 0x561de172dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de1730830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaebf1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561de168c2f0 con 0x561de17289a0 2024-09-19T09:39:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaebf1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561de1634270 con 0x561de17292e0 2024-09-19T09:39:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaebf1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561de16882b0 con 0x561de172e370 2024-09-19T09:39:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaa315640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17289a0 0x561de1728da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaa315640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17289a0 0x561de1728da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39604/0 (socket says 172.21.15.42:39604) 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaa315640 1 -- 172.21.15.42:0/478326396 learned_addr learned my addr 172.21.15.42:0/478326396 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaa9313640 1 --2- 172.21.15.42:0/478326396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de1730830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaa9b14640 1 --2- 172.21.15.42:0/478326396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17292e0 0x561de172dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaa315640 1 -- 172.21.15.42:0/478326396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 msgr2=0x561de1730830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaa315640 1 --2- 172.21.15.42:0/478326396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de1730830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaa315640 1 -- 172.21.15.42:0/478326396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17292e0 msgr2=0x561de172dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaa315640 1 --2- 172.21.15.42:0/478326396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17292e0 0x561de172dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaaa315640 1 -- 172.21.15.42:0/478326396 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de1633340 con 0x561de17289a0 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.713+0000 7feaa9b14640 1 --2- 172.21.15.42:0/478326396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17292e0 0x561de172dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.714+0000 7fea9affd640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fea900a3390 0x7fea900a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.714+0000 7feaaa315640 1 --2- 172.21.15.42:0/478326396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17289a0 0x561de1728da0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fea9c035000 tx=0x7fea9c005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a32b5e145bcbd46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.714+0000 7feaa9b14640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fea900a3390 0x7fea900a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.714+0000 7fea9affd640 1 -- 172.21.15.42:0/3573322406 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7feaa00cf4c0 con 0x7feaa40ffba0 2024-09-19T09:39:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.714+0000 7fea8ffff640 1 -- 172.21.15.42:0/478326396 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c049070 con 0x561de17289a0 2024-09-19T09:39:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.714+0000 7fea8ffff640 1 -- 172.21.15.42:0/478326396 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea9c036040 con 0x561de17289a0 2024-09-19T09:39:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.714+0000 7fea8ffff640 1 -- 172.21.15.42:0/478326396 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c004460 con 0x561de17289a0 2024-09-19T09:39:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 -- 172.21.15.42:0/478326396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17289a0 msgr2=0x561de1728da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 --2- 172.21.15.42:0/478326396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17289a0 0x561de1728da0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fea9c035000 tx=0x7fea9c005fa0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaa9b14640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fea900a3390 0x7fea900a5850 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x561de1729d10 tx=0x7feaa0086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 -- 172.21.15.42:0/478326396 shutdown_connections 2024-09-19T09:39:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 --2- 172.21.15.42:0/478326396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de1730830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 --2- 172.21.15.42:0/478326396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17292e0 0x561de172dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 --2- 172.21.15.42:0/478326396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17289a0 0x561de1728da0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 -- 172.21.15.42:0/478326396 >> 172.21.15.42:0/478326396 conn(0x561de1724010 msgr2=0x561de1724410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 -- 172.21.15.42:0/478326396 shutdown_connections 2024-09-19T09:39:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 -- 172.21.15.42:0/478326396 wait complete. 2024-09-19T09:39:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 -- start start 2024-09-19T09:39:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.715+0000 7feaaebf1740 1 Processor -- start 2024-09-19T09:39:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de1732b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de17330a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de173a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaaebf1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561de17312e0 con 0x561de17292e0 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaaebf1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561de1615290 con 0x561de17289a0 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaaebf1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561de1731460 con 0x561de172e370 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaaebf1740 10 client.0 _ll_register_callbacks cb 0x561de1646140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaa9313640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de17330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaa9313640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de17330a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39616/0 (socket says 172.21.15.42:39616) 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaa9313640 1 -- 172.21.15.42:0/2737465704 learned_addr learned my addr 172.21.15.42:0/2737465704 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaaa315640 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de173a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaaa315640 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de1732b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaa9313640 1 -- 172.21.15.42:0/2737465704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 msgr2=0x561de173a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaa9313640 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de173a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaa9313640 1 -- 172.21.15.42:0/2737465704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 msgr2=0x561de1732b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaa9313640 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de1732b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.716+0000 7feaa9313640 1 -- 172.21.15.42:0/2737465704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de139f210 con 0x561de17292e0 2024-09-19T09:39:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7feaa9313640 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de17330a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fea94010820 tx=0x7fea94010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c2a2729966f753 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7fea8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7fea8d7fa640 1 -- 172.21.15.42:0/2737465704 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9400fb90 con 0x561de17292e0 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7fea8d7fa640 1 -- 172.21.15.42:0/2737465704 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fea9400fd30 con 0x561de17292e0 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7feaaebf1740 1 -- 172.21.15.42:0/2737465704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea9c036040 con 0x561de17292e0 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7fea8d7fa640 1 -- 172.21.15.42:0/2737465704 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fea94005020 con 0x561de17292e0 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7feaaebf1740 10 client.15498 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7feaaebf1740 1 -- 172.21.15.42:0/2737465704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561de146b620 con 0x561de17292e0 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7fea8d7fa640 1 -- 172.21.15.42:0/2737465704 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea9c036040 con 0x561de17292e0 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7fea8d7fa640 1 -- 172.21.15.42:0/2737465704 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fea94019410 con 0x561de17292e0 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7feaaebf1740 10 client.15498 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7feaaebf1740 10 client.15498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.717+0000 7feaaebf1740 20 client.15498 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.718+0000 7feaaebf1740 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561de173e8a0 0x561de1740cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.718+0000 7feaaebf1740 4 client.15498 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.718+0000 7feaaebf1740 1 -- 172.21.15.42:0/2737465704 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561de1699a20 con 0x561de173e8a0 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.718+0000 7feaaa315640 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561de173e8a0 0x561de1740cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.718+0000 7feaaa315640 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561de173e8a0 0x561de1740cd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd18b23e8c5d367e server_cookie=74086f235b510a07 in_seq=0 out_seq=0 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.718+0000 7fea8d7fa640 10 client.15498 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7fea8d7fa640 1 -- 172.21.15.42:0/2737465704 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561de1699a20 con 0x561de173e8a0 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7fea8d7fa640 10 client.15498 handle_command_reply: tid=0 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 client.15498 shutdown 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 -- 172.21.15.42:0/2737465704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 msgr2=0x561de17330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de17330a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fea94010820 tx=0x7fea94010ce0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 -- 172.21.15.42:0/2737465704 shutdown_connections 2024-09-19T09:39:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561de173e8a0 0x561de1740cd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de173a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de17330a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7fea8d7fa640 0 client.15498 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 --2- 172.21.15.42:0/2737465704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de1732b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 -- 172.21.15.42:0/2737465704 >> 172.21.15.42:0/2737465704 conn(0x561de1724010 msgr2=0x561de1725820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 -- 172.21.15.42:0/2737465704 shutdown_connections 2024-09-19T09:39:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 1 -- 172.21.15.42:0/2737465704 wait complete. 2024-09-19T09:39:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.719+0000 7feaaebf1740 20 client.15498 trim_cache size 0 max 16384 2024-09-19T09:39:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.734+0000 7feaaebf1740 1 Processor -- start 2024-09-19T09:39:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.734+0000 7feaaebf1740 1 -- start start 2024-09-19T09:39:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.734+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de17320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.734+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de17292e0 0x561de173a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.734+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de172e370 0x561de17230b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.734+0000 7feaaebf1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41a8ed0 con 0x561de172e370 2024-09-19T09:39:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.734+0000 7feaaebf1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41aaa10 con 0x561de17289a0 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.734+0000 7feaaebf1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41a95a0 con 0x561de17292e0 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.734+0000 7feaaa315640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de172e370 0x561de17230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7feaaa315640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de172e370 0x561de17230b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39622/0 (socket says 172.21.15.42:39622) 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7feaaa315640 1 -- 172.21.15.42:0/1372522080 learned_addr learned my addr 172.21.15.42:0/1372522080 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7feaa9313640 1 --2- 172.21.15.42:0/1372522080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de17292e0 0x561de173a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7feaaa315640 1 --2- 172.21.15.42:0/1372522080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de17320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7feaaa315640 1 -- 172.21.15.42:0/1372522080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de17292e0 msgr2=0x561de173a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7feaaa315640 1 --2- 172.21.15.42:0/1372522080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de17292e0 0x561de173a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7feaaa315640 1 -- 172.21.15.42:0/1372522080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 msgr2=0x561de17320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7feaaa315640 1 --2- 172.21.15.42:0/1372522080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de17320c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7feaaa315640 1 -- 172.21.15.42:0/1372522080 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de17297c0 con 0x561de172e370 2024-09-19T09:39:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7feaaa315640 1 --2- 172.21.15.42:0/1372522080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de172e370 0x561de17230b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fea9c000f80 tx=0x7fea9c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511a6b2c767c1a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7fea8f7fe640 1 -- 172.21.15.42:0/1372522080 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c049040 con 0x561de172e370 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7fea8f7fe640 1 -- 172.21.15.42:0/1372522080 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea9c056030 con 0x561de172e370 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.735+0000 7fea8f7fe640 1 -- 172.21.15.42:0/1372522080 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0305a0 con 0x561de172e370 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 -- 172.21.15.42:0/1372522080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de172e370 msgr2=0x561de17230b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 --2- 172.21.15.42:0/1372522080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de172e370 0x561de17230b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fea9c000f80 tx=0x7fea9c005ef0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 -- 172.21.15.42:0/1372522080 shutdown_connections 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 --2- 172.21.15.42:0/1372522080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de172e370 0x561de17230b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 --2- 172.21.15.42:0/1372522080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de17292e0 0x561de173a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 --2- 172.21.15.42:0/1372522080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de17320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 -- 172.21.15.42:0/1372522080 >> 172.21.15.42:0/1372522080 conn(0x561de1724010 msgr2=0x561de17229a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 -- 172.21.15.42:0/1372522080 shutdown_connections 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 -- 172.21.15.42:0/1372522080 wait complete. 2024-09-19T09:39:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 -- start start 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.736+0000 7feaaebf1740 1 Processor -- start 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de1737570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de1737ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaaebf1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de1738ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaaebf1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41aa340 con 0x561de17292e0 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaaebf1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41a9c70 con 0x561de17289a0 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaaebf1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41a6eb0 con 0x561de172e370 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaaebf1740 10 client.0 _ll_register_callbacks cb 0x7fea9400a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaa9313640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de1737ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaa9313640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de1737ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39628/0 (socket says 172.21.15.42:39628) 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaa9313640 1 -- 172.21.15.42:0/1932139710 learned_addr learned my addr 172.21.15.42:0/1932139710 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaaa315640 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de1738ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaaa315640 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de1737570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaa9313640 1 -- 172.21.15.42:0/1932139710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 msgr2=0x561de1738ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaa9313640 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de1738ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaa9313640 1 -- 172.21.15.42:0/1932139710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 msgr2=0x561de1737570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaa9313640 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de1737570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaa9313640 1 -- 172.21.15.42:0/1932139710 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de17390d0 con 0x561de17292e0 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaaa315640 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de1737570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7feaa9313640 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de1737ab0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fea94019880 tx=0x7fea9400fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71004f80d2c7ba72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.737+0000 7fea8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7fea8d7fa640 1 -- 172.21.15.42:0/1932139710 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea94033060 con 0x561de17292e0 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7fea8d7fa640 1 -- 172.21.15.42:0/1932139710 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fea94019af0 con 0x561de17292e0 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7feaaebf1740 1 -- 172.21.15.42:0/1932139710 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea9c056030 con 0x561de17292e0 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7fea8d7fa640 1 -- 172.21.15.42:0/1932139710 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fea94028040 con 0x561de17292e0 2024-09-19T09:39:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7feaaebf1740 10 client.15504 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7feaaebf1740 1 -- 172.21.15.42:0/1932139710 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561de17a95b0 con 0x561de17292e0 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7fea8d7fa640 1 -- 172.21.15.42:0/1932139710 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea9c056030 con 0x561de17292e0 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7fea8d7fa640 1 -- 172.21.15.42:0/1932139710 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fea94004660 con 0x561de17292e0 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7feaaebf1740 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7feaaebf1740 10 client.15504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7feaaebf1740 20 client.15504 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7feaaebf1740 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561de17a9df0 0x561de17ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7feaaebf1740 4 client.15504 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.738+0000 7feaaebf1740 1 -- 172.21.15.42:0/1932139710 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561de1693d70 con 0x561de17a9df0 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.739+0000 7feaaa315640 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561de17a9df0 0x561de17ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.739+0000 7fea8d7fa640 10 client.15504 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.739+0000 7feaaa315640 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561de17a9df0 0x561de17ac210 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c2749e75e52717 server_cookie=4fd427eaa3c1e1c4 in_seq=0 out_seq=0 2024-09-19T09:39:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7fea8d7fa640 1 -- 172.21.15.42:0/1932139710 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561de1693d70 con 0x561de17a9df0 2024-09-19T09:39:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7fea8d7fa640 10 client.15504 handle_command_reply: tid=0 2024-09-19T09:39:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 client.15504 shutdown 2024-09-19T09:39:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 -- 172.21.15.42:0/1932139710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 msgr2=0x561de1737ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de1737ab0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fea94019880 tx=0x7fea9400fe40 comp rx=0 tx=0).stop 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 -- 172.21.15.42:0/1932139710 shutdown_connections 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561de17a9df0 0x561de17ac210 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561de172e370 0x561de1738ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561de17292e0 0x561de1737ab0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 --2- 172.21.15.42:0/1932139710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561de17289a0 0x561de1737570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7fea8d7fa640 0 client.15504 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 -- 172.21.15.42:0/1932139710 >> 172.21.15.42:0/1932139710 conn(0x561de1724010 msgr2=0x561de17231c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 -- 172.21.15.42:0/1932139710 shutdown_connections 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 1 -- 172.21.15.42:0/1932139710 wait complete. 2024-09-19T09:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.747+0000 7feaaebf1740 20 client.15504 trim_cache size 0 max 16384 2024-09-19T09:39:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:39:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:39:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:39:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 -- 172.21.15.42:0/3573322406 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fea900a3390 msgr2=0x7fea900a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fea900a3390 0x7fea900a5850 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x561de1729d10 tx=0x7feaa0086040 comp rx=0 tx=0).stop 2024-09-19T09:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 -- 172.21.15.42:0/3573322406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaa40ffba0 msgr2=0x7feaa4197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaa40ffba0 0x7feaa4197d60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7feaa000d950 tx=0x7feaa000dd50 comp rx=0 tx=0).stop 2024-09-19T09:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 -- 172.21.15.42:0/3573322406 shutdown_connections 2024-09-19T09:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fea900a3390 0x7fea900a5850 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feaa4103130 0x7feaa419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feaa4100560 0x7feaa41982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 --2- 172.21.15.42:0/3573322406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feaa40ffba0 0x7feaa4197d60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 -- 172.21.15.42:0/3573322406 >> 172.21.15.42:0/3573322406 conn(0x7feaa40fb930 msgr2=0x7feaa4106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 -- 172.21.15.42:0/3573322406 shutdown_connections 2024-09-19T09:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:32.748+0000 7feaabd78640 1 -- 172.21.15.42:0/3573322406 wait complete. 2024-09-19T09:39:32.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:32 smithi171 ceph-mon[35803]: pgmap v343: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-09-19T09:39:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:32 smithi136 ceph-mon[34840]: pgmap v343: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-09-19T09:39:34.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:34 smithi042 ceph-mon[31223]: pgmap v344: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-09-19T09:39:34.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:34 smithi171 ceph-mon[35803]: pgmap v344: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-09-19T09:39:34.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:34 smithi136 ceph-mon[34840]: pgmap v344: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-09-19T09:39:36.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:36 smithi042 ceph-mon[31223]: pgmap v345: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-19T09:39:36.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:36 smithi171 ceph-mon[35803]: pgmap v345: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-19T09:39:36.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:36 smithi136 ceph-mon[34840]: pgmap v345: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-19T09:39:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:38 smithi042 ceph-mon[31223]: pgmap v346: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:39:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:38 smithi171 ceph-mon[35803]: pgmap v346: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:39:38.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:38 smithi136 ceph-mon[34840]: pgmap v346: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:39:40.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:39:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:40 smithi042 ceph-mon[31223]: pgmap v347: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:39:40.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:40 smithi171 ceph-mon[35803]: pgmap v347: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:39:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:40 smithi136 ceph-mon[34840]: pgmap v347: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:39:40.911 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:41.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.405+0000 7fc7c978a640 1 -- 172.21.15.42:0/3087162479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7c41082a0 msgr2=0x7fc7c410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.405+0000 7fc7c978a640 1 --2- 172.21.15.42:0/3087162479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7c41082a0 0x7fc7c410ec40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009cd0 tx=0x7fc7bc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.405+0000 7fc7c978a640 1 -- 172.21.15.42:0/3087162479 shutdown_connections 2024-09-19T09:39:41.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.405+0000 7fc7c978a640 1 --2- 172.21.15.42:0/3087162479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7c41082a0 0x7fc7c410ec40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.405+0000 7fc7c978a640 1 --2- 172.21.15.42:0/3087162479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7c41036e0 0x7fc7c4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.405+0000 7fc7c978a640 1 --2- 172.21.15.42:0/3087162479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7c4102d30 0x7fc7c4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.405+0000 7fc7c978a640 1 -- 172.21.15.42:0/3087162479 >> 172.21.15.42:0/3087162479 conn(0x7fc7c40fc7d0 msgr2=0x7fc7c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.405+0000 7fc7c978a640 1 -- 172.21.15.42:0/3087162479 shutdown_connections 2024-09-19T09:39:41.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.405+0000 7fc7c978a640 1 -- 172.21.15.42:0/3087162479 wait complete. 2024-09-19T09:39:41.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.406+0000 7fc7c978a640 1 Processor -- start 2024-09-19T09:39:41.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.406+0000 7fc7c978a640 1 -- start start 2024-09-19T09:39:41.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c978a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7c4102d30 0x7fc7c41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c978a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7c41036e0 0x7fc7c4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c978a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7c41082a0 0x7fc7c419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c978a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41120d0 con 0x7fc7c41082a0 2024-09-19T09:39:41.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c978a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c4111f50 con 0x7fc7c4102d30 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c978a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c4112250 con 0x7fc7c41036e0 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7c41082a0 0x7fc7c419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7c41082a0 0x7fc7c419cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58156/0 (socket says 172.21.15.42:58156) 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c37fe640 1 -- 172.21.15.42:0/2891364542 learned_addr learned my addr 172.21.15.42:0/2891364542 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7c4102d30 0x7fc7c41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c27fc640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7c41036e0 0x7fc7c4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c37fe640 1 -- 172.21.15.42:0/2891364542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7c41036e0 msgr2=0x7fc7c4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7c41036e0 0x7fc7c4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c37fe640 1 -- 172.21.15.42:0/2891364542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7c4102d30 msgr2=0x7fc7c41984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7c4102d30 0x7fc7c41984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c37fe640 1 -- 172.21.15.42:0/2891364542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c419d470 con 0x7fc7c41082a0 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7c4102d30 0x7fc7c41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.407+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7c41082a0 0x7fc7c419cd90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009ca0 tx=0x7fc7bc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.408+0000 7fc7abfff640 1 -- 172.21.15.42:0/2891364542 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc004240 con 0x7fc7c41082a0 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.408+0000 7fc7abfff640 1 -- 172.21.15.42:0/2891364542 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7bc0305a0 con 0x7fc7c41082a0 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.408+0000 7fc7c978a640 1 -- 172.21.15.42:0/2891364542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c419d700 con 0x7fc7c41082a0 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.408+0000 7fc7abfff640 1 -- 172.21.15.42:0/2891364542 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc03a660 con 0x7fc7c41082a0 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.408+0000 7fc7c978a640 1 -- 172.21.15.42:0/2891364542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c41a5040 con 0x7fc7c41082a0 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.410+0000 7fc7abfff640 1 -- 172.21.15.42:0/2891364542 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fc7bc030750 con 0x7fc7c41082a0 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7abfff640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc7ac0a32d0 0x7fc7ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc7ac0a32d0 0x7fc7ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7abfff640 1 -- 172.21.15.42:0/2891364542 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc7bc02e030 con 0x7fc7c41082a0 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7cbb63740 1 Processor -- start 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7cbb63740 1 -- start start 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8dafe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafeca0 0x555c8db0d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8db0da90 0x555c8db0fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c8da642e0 con 0x555c8dafe380 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555c8da0bce0 con 0x555c8dafeca0 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.411+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x555c8da602a0 con 0x555c8db0da90 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc7ac0a32d0 0x7fc7ac0a5790 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400abe0 tx=0x7fc7b400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8dafe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8dafe760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58166/0 (socket says 172.21.15.42:58166) 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c2ffd640 1 -- 172.21.15.42:0/2637197537 learned_addr learned my addr 172.21.15.42:0/2637197537 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c27fc640 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafeca0 0x555c8db0d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8db0da90 0x555c8db0fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c2ffd640 1 -- 172.21.15.42:0/2637197537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8db0da90 msgr2=0x555c8db0fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8db0da90 0x555c8db0fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c2ffd640 1 -- 172.21.15.42:0/2637197537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafeca0 msgr2=0x555c8db0d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafeca0 0x555c8db0d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c2ffd640 1 -- 172.21.15.42:0/2637197537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8d9f0440 con 0x555c8dafe380 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8db0da90 0x555c8db0fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c27fc640 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafeca0 0x555c8db0d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8dafe760 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400ef40 tx=0x7fc7b4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65980c7aac57fb5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7a97fa640 1 -- 172.21.15.42:0/2637197537 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4021070 con 0x555c8dafe380 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7a97fa640 1 -- 172.21.15.42:0/2637197537 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b4010e40 con 0x555c8dafe380 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.412+0000 7fc7a97fa640 1 -- 172.21.15.42:0/2637197537 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b401cd10 con 0x555c8dafe380 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.413+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2637197537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 msgr2=0x555c8dafe760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.413+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8dafe760 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400ef40 tx=0x7fc7b4011000 comp rx=0 tx=0).stop 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.413+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2637197537 shutdown_connections 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.413+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8db0da90 0x555c8db0fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.413+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafeca0 0x555c8db0d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.413+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/2637197537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8dafe760 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.413+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2637197537 >> 172.21.15.42:0/2637197537 conn(0x555c8dafaa30 msgr2=0x555c8dafae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.413+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2637197537 shutdown_connections 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.413+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2637197537 wait complete. 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7cbb63740 1 -- start start 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7cbb63740 1 Processor -- start 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8db0d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db0a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8db0da90 0x555c8db0ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c8db10660 con 0x555c8dafe380 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555c8da1f050 con 0x555c8db0da90 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x555c8db107e0 con 0x555c8dafeca0 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7cbb63740 10 client.0 _ll_register_callbacks cb 0x555c8da5f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7c2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8db0d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7c2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8db0d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58174/0 (socket says 172.21.15.42:58174) 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7c2ffd640 1 -- 172.21.15.42:0/698306966 learned_addr learned my addr 172.21.15.42:0/698306966 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8db0da90 0x555c8db0ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7c2ffd640 1 -- 172.21.15.42:0/698306966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 msgr2=0x555c8db0a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db0a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7c2ffd640 1 -- 172.21.15.42:0/698306966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8db0da90 msgr2=0x555c8db0ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.414+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8db0da90 0x555c8db0ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.415+0000 7fc7c2ffd640 1 -- 172.21.15.42:0/698306966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8d7d53c0 con 0x555c8dafe380 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.415+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8db0d340 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400a9c0 tx=0x7fc7b401cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6698e726667d361d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.415+0000 7fc7a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.415+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/698306966 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4021050 con 0x555c8dafe380 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.415+0000 7fc7cbb63740 1 -- 172.21.15.42:0/698306966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c8da71850 con 0x555c8dafe380 2024-09-19T09:39:41.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.415+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/698306966 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc7b4004020 con 0x555c8dafe380 2024-09-19T09:39:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.415+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/698306966 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc7b401cea0 con 0x555c8dafe380 2024-09-19T09:39:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.415+0000 7fc7cbb63740 10 client.15516 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.415+0000 7fc7cbb63740 1 -- 172.21.15.42:0/698306966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c8db1bf30 con 0x555c8dafe380 2024-09-19T09:39:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.415+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/698306966 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555c8da71850 con 0x555c8dafe380 2024-09-19T09:39:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.416+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/698306966 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc7b4003970 con 0x555c8dafe380 2024-09-19T09:39:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.416+0000 7fc7cbb63740 10 client.15516 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.416+0000 7fc7cbb63740 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.416+0000 7fc7cbb63740 20 client.15516 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.416+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555c8db1d340 0x555c8db1f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.416+0000 7fc7cbb63740 4 client.15516 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.416+0000 7fc7cbb63740 1 -- 172.21.15.42:0/698306966 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c8da6bd60 con 0x555c8db1d340 2024-09-19T09:39:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.416+0000 7fc7c27fc640 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555c8db1d340 0x555c8db1f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.417+0000 7fc7a6ff5640 10 client.15516 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.417+0000 7fc7c27fc640 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555c8db1d340 0x555c8db1f730 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbcd7dc9f0c78838 server_cookie=ec09e880ccdabae5 in_seq=0 out_seq=0 2024-09-19T09:39:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/698306966 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c8da6bd60 con 0x555c8db1d340 2024-09-19T09:39:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7a6ff5640 10 client.15516 handle_command_reply: tid=0 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 client.15516 shutdown 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 -- 172.21.15.42:0/698306966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 msgr2=0x555c8db0d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8db0d340 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400a9c0 tx=0x7fc7b401cd30 comp rx=0 tx=0).stop 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 -- 172.21.15.42:0/698306966 shutdown_connections 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555c8db1d340 0x555c8db1f730 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8db0da90 0x555c8db0ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db0a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/698306966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8dafe380 0x555c8db0d340 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7a6ff5640 0 client.15516 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 -- 172.21.15.42:0/698306966 >> 172.21.15.42:0/698306966 conn(0x555c8dafaa30 msgr2=0x555c8db00790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 -- 172.21.15.42:0/698306966 shutdown_connections 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 1 -- 172.21.15.42:0/698306966 wait complete. 2024-09-19T09:39:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.418+0000 7fc7cbb63740 20 client.15516 trim_cache size 0 max 16384 2024-09-19T09:39:41.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.452+0000 7fc7cbb63740 1 Processor -- start 2024-09-19T09:39:41.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.452+0000 7fc7cbb63740 1 -- start start 2024-09-19T09:39:41.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.452+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 0x555c8db19900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.452+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db05d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.452+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41ab450 con 0x555c8db0da90 2024-09-19T09:39:41.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41acf90 con 0x555c8dafe380 2024-09-19T09:39:41.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41abb20 con 0x555c8dafeca0 2024-09-19T09:39:41.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58188/0 (socket says 172.21.15.42:58188) 2024-09-19T09:39:41.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c37fe640 1 -- 172.21.15.42:0/3177015002 learned_addr learned my addr 172.21.15.42:0/3177015002 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:41.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c27fc640 1 --2- 172.21.15.42:0/3177015002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db05d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/3177015002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 0x555c8db19900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c37fe640 1 -- 172.21.15.42:0/3177015002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 msgr2=0x555c8db05d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/3177015002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db05d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c37fe640 1 -- 172.21.15.42:0/3177015002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 msgr2=0x555c8db19900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/3177015002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 0x555c8db19900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c37fe640 1 -- 172.21.15.42:0/3177015002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8db08b40 con 0x555c8db0da90 2024-09-19T09:39:41.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/3177015002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 0x555c8db19900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:41.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/3177015002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db094a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0b9c30 tx=0x7fc7bc0bd0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f086e5120e3a360f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.453+0000 7fc7a8ff9640 1 -- 172.21.15.42:0/3177015002 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0d6220 con 0x555c8db0da90 2024-09-19T09:39:41.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7a8ff9640 1 -- 172.21.15.42:0/3177015002 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7bc0d6070 con 0x555c8db0da90 2024-09-19T09:39:41.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7a8ff9640 1 -- 172.21.15.42:0/3177015002 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0b9a40 con 0x555c8db0da90 2024-09-19T09:39:41.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7cbb63740 1 -- 172.21.15.42:0/3177015002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 msgr2=0x555c8db094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/3177015002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db094a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0b9c30 tx=0x7fc7bc0bd0e0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7cbb63740 1 -- 172.21.15.42:0/3177015002 shutdown_connections 2024-09-19T09:39:41.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/3177015002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db094a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/3177015002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db05d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/3177015002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 0x555c8db19900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7cbb63740 1 -- 172.21.15.42:0/3177015002 >> 172.21.15.42:0/3177015002 conn(0x555c8dafaa30 msgr2=0x555c8db08d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7cbb63740 1 -- 172.21.15.42:0/3177015002 shutdown_connections 2024-09-19T09:39:41.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.454+0000 7fc7cbb63740 1 -- 172.21.15.42:0/3177015002 wait complete. 2024-09-19T09:39:41.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7cbb63740 1 -- start start 2024-09-19T09:39:41.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7cbb63740 1 Processor -- start 2024-09-19T09:39:41.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 0x555c8db15c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db16180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7cbb63740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db11030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41ac8c0 con 0x555c8db0da90 2024-09-19T09:39:41.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41ac1f0 con 0x555c8dafe380 2024-09-19T09:39:41.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7cbb63740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41a9430 con 0x555c8dafeca0 2024-09-19T09:39:41.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7cbb63740 10 client.0 _ll_register_callbacks cb 0x7fc7b400ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:41.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db11030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db11030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58204/0 (socket says 172.21.15.42:58204) 2024-09-19T09:39:41.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7c37fe640 1 -- 172.21.15.42:0/2087606788 learned_addr learned my addr 172.21.15.42:0/2087606788 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:41.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.455+0000 7fc7c27fc640 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db16180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 0x555c8db15c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7c37fe640 1 -- 172.21.15.42:0/2087606788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 msgr2=0x555c8db16180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db16180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7c37fe640 1 -- 172.21.15.42:0/2087606788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 msgr2=0x555c8db15c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 0x555c8db15c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7c37fe640 1 -- 172.21.15.42:0/2087606788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8db11830 con 0x555c8db0da90 2024-09-19T09:39:41.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7c37fe640 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db11030 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0bcf60 tx=0x7fc7bc0ee6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb060e27693aeeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:41.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/2087606788 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc087060 con 0x555c8db0da90 2024-09-19T09:39:41.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/2087606788 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc7bc0c1370 con 0x555c8db0da90 2024-09-19T09:39:41.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2087606788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7bc0d6070 con 0x555c8db0da90 2024-09-19T09:39:41.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/2087606788 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc7bc0c5ed0 con 0x555c8db0da90 2024-09-19T09:39:41.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7cbb63740 10 client.15522 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:41.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.456+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2087606788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c8db87910 con 0x555c8db0da90 2024-09-19T09:39:41.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.457+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/2087606788 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7bc0d6070 con 0x555c8db0da90 2024-09-19T09:39:41.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.457+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/2087606788 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc7bc04d020 con 0x555c8db0da90 2024-09-19T09:39:41.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.457+0000 7fc7cbb63740 10 client.15522 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.457+0000 7fc7cbb63740 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.457+0000 7fc7cbb63740 20 client.15522 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.457+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555c8db87fc0 0x555c8db8a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.457+0000 7fc7cbb63740 4 client.15522 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:39:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.457+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2087606788 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c8d9e8210 con 0x555c8db87fc0 2024-09-19T09:39:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.457+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555c8db87fc0 0x555c8db8a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7c2ffd640 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555c8db87fc0 0x555c8db8a3e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19ba731fd8cf034b server_cookie=66c444e0a3fc7c0d in_seq=0 out_seq=0 2024-09-19T09:39:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7a6ff5640 10 client.15522 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7a6ff5640 1 -- 172.21.15.42:0/2087606788 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555c8d9e8210 con 0x555c8db87fc0 2024-09-19T09:39:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7a6ff5640 10 client.15522 handle_command_reply: tid=0 2024-09-19T09:39:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 client.15522 shutdown 2024-09-19T09:39:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2087606788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 msgr2=0x555c8db11030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db11030 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0bcf60 tx=0x7fc7bc0ee6f0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2087606788 shutdown_connections 2024-09-19T09:39:41.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555c8db87fc0 0x555c8db8a3e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c8db0da90 0x555c8db11030 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c8dafeca0 0x555c8db16180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7a6ff5640 0 client.15522 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:41.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 --2- 172.21.15.42:0/2087606788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c8dafe380 0x555c8db15c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2087606788 >> 172.21.15.42:0/2087606788 conn(0x555c8dafaa30 msgr2=0x555c8db05c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2087606788 shutdown_connections 2024-09-19T09:39:41.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 1 -- 172.21.15.42:0/2087606788 wait complete. 2024-09-19T09:39:41.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.458+0000 7fc7cbb63740 20 client.15522 trim_cache size 0 max 16384 2024-09-19T09:39:41.477 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:39:41.477 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-19T09:39:41.477 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-09-19T09:39:41.478 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:39:41.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 -- 172.21.15.42:0/2891364542 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc7ac0a32d0 msgr2=0x7fc7ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc7ac0a32d0 0x7fc7ac0a5790 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400abe0 tx=0x7fc7b400a5c0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 -- 172.21.15.42:0/2891364542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7c41082a0 msgr2=0x7fc7c419cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7c41082a0 0x7fc7c419cd90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009ca0 tx=0x7fc7bc003ba0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 -- 172.21.15.42:0/2891364542 shutdown_connections 2024-09-19T09:39:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc7ac0a32d0 0x7fc7ac0a5790 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7c41082a0 0x7fc7c419cd90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7c41036e0 0x7fc7c4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 --2- 172.21.15.42:0/2891364542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7c4102d30 0x7fc7c41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 -- 172.21.15.42:0/2891364542 >> 172.21.15.42:0/2891364542 conn(0x7fc7c40fc7d0 msgr2=0x7fc7c40fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 -- 172.21.15.42:0/2891364542 shutdown_connections 2024-09-19T09:39:41.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:41.459+0000 7fc7c978a640 1 -- 172.21.15.42:0/2891364542 wait complete. 2024-09-19T09:39:42.197 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:39:42.197 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:42.481 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:42.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:42 smithi042 ceph-mon[31223]: pgmap v348: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:39:42.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:42 smithi171 ceph-mon[35803]: pgmap v348: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:39:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:42 smithi136 ceph-mon[34840]: pgmap v348: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:39:42.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.982+0000 7f7f8ef45640 1 -- 172.21.15.42:0/1551343006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f88102ef0 msgr2=0x7f7f8810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:42.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.982+0000 7f7f8ef45640 1 --2- 172.21.15.42:0/1551343006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f88102ef0 0x7f7f8810da40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009ca0 tx=0x7f7f8002a950 comp rx=0 tx=0).stop 2024-09-19T09:39:42.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.982+0000 7f7f8ef45640 1 -- 172.21.15.42:0/1551343006 shutdown_connections 2024-09-19T09:39:42.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.982+0000 7f7f8ef45640 1 --2- 172.21.15.42:0/1551343006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f88102ef0 0x7f7f8810da40 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:42.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.982+0000 7f7f8ef45640 1 --2- 172.21.15.42:0/1551343006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f88102570 0x7f7f881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:42.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.982+0000 7f7f8ef45640 1 --2- 172.21.15.42:0/1551343006 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f88100e20 0x7f7f88101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:42.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.982+0000 7f7f8ef45640 1 -- 172.21.15.42:0/1551343006 >> 172.21.15.42:0/1551343006 conn(0x7f7f880fc7d0 msgr2=0x7f7f880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:42.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.982+0000 7f7f8ef45640 1 -- 172.21.15.42:0/1551343006 shutdown_connections 2024-09-19T09:39:42.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.982+0000 7f7f8ef45640 1 -- 172.21.15.42:0/1551343006 wait complete. 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8ef45640 1 Processor -- start 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8ef45640 1 -- start start 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8ef45640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f88100e20 0x7f7f881973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8ef45640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f88102570 0x7f7f88197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8ef45640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f88102ef0 0x7f7f8819bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8ef45640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7f88110fd0 con 0x7f7f88102ef0 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8ef45640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7f88110e50 con 0x7f7f88102570 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8ef45640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7f88111150 con 0x7f7f88100e20 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8d4e2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f88102ef0 0x7f7f8819bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8d4e2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f88102ef0 0x7f7f8819bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58212/0 (socket says 172.21.15.42:58212) 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.983+0000 7f7f8d4e2640 1 -- 172.21.15.42:0/703490182 learned_addr learned my addr 172.21.15.42:0/703490182 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f87fff640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f88102570 0x7f7f88197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:42.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f8cce1640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f88100e20 0x7f7f881973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f8d4e2640 1 -- 172.21.15.42:0/703490182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f88100e20 msgr2=0x7f7f881973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f8d4e2640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f88100e20 0x7f7f881973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f8d4e2640 1 -- 172.21.15.42:0/703490182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f88102570 msgr2=0x7f7f88197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f8d4e2640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f88102570 0x7f7f88197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f8d4e2640 1 -- 172.21.15.42:0/703490182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8819c380 con 0x7f7f88102ef0 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f8d4e2640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f88102ef0 0x7f7f8819bca0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009dc0 tx=0x7f7f80003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f85ffb640 1 -- 172.21.15.42:0/703490182 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80034040 con 0x7f7f88102ef0 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f8ef45640 1 -- 172.21.15.42:0/703490182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8819c610 con 0x7f7f88102ef0 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.984+0000 7f7f85ffb640 1 -- 172.21.15.42:0/703490182 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8002fe10 con 0x7f7f88102ef0 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.985+0000 7f7f8ef45640 1 -- 172.21.15.42:0/703490182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f881a3f50 con 0x7f7f88102ef0 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.985+0000 7f7f85ffb640 1 -- 172.21.15.42:0/703490182 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80004750 con 0x7f7f88102ef0 2024-09-19T09:39:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.986+0000 7f7f8ef45640 1 -- 172.21.15.42:0/703490182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f88101200 con 0x7f7f88102ef0 2024-09-19T09:39:42.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.987+0000 7f7f85ffb640 1 -- 172.21.15.42:0/703490182 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f7f80037020 con 0x7f7f88102ef0 2024-09-19T09:39:42.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.987+0000 7f7f85ffb640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7f780a32d0 0x7f7f780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:42.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.988+0000 7f7f8cce1640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7f780a32d0 0x7f7f780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:42.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.988+0000 7f7f85ffb640 1 -- 172.21.15.42:0/703490182 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7f800f0850 con 0x7f7f88102ef0 2024-09-19T09:39:42.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.988+0000 7f7f8cce1640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7f780a32d0 0x7f7f780a5790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c005fd0 tx=0x7f7f7c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:42.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:42.992+0000 7f7f85ffb640 1 -- 172.21.15.42:0/703490182 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f800bd500 con 0x7f7f88102ef0 2024-09-19T09:39:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.234+0000 7f7f8ef45640 1 -- 172.21.15.42:0/703490182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f881a4120 con 0x7f7f88102ef0 2024-09-19T09:39:43.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.235+0000 7f7f85ffb640 1 -- 172.21.15.42:0/703490182 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f7f800bce00 con 0x7f7f88102ef0 2024-09-19T09:39:43.237 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:43.237 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:39:43.237 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:39:43.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.237+0000 7f7f8ef45640 1 -- 172.21.15.42:0/703490182 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7f780a32d0 msgr2=0x7f7f780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.237+0000 7f7f8ef45640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7f780a32d0 0x7f7f780a5790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c005fd0 tx=0x7f7f7c00b390 comp rx=0 tx=0).stop 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.237+0000 7f7f8ef45640 1 -- 172.21.15.42:0/703490182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f88102ef0 msgr2=0x7f7f8819bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.237+0000 7f7f8ef45640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f88102ef0 0x7f7f8819bca0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009dc0 tx=0x7f7f80003d00 comp rx=0 tx=0).stop 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.237+0000 7f7f8ef45640 1 -- 172.21.15.42:0/703490182 shutdown_connections 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.237+0000 7f7f8ef45640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f7f780a32d0 0x7f7f780a5790 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.237+0000 7f7f8ef45640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f88102ef0 0x7f7f8819bca0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.237+0000 7f7f8ef45640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f88102570 0x7f7f88197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.237+0000 7f7f8ef45640 1 --2- 172.21.15.42:0/703490182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f88100e20 0x7f7f881973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.238+0000 7f7f8ef45640 1 -- 172.21.15.42:0/703490182 >> 172.21.15.42:0/703490182 conn(0x7f7f880fc7d0 msgr2=0x7f7f88106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.238+0000 7f7f8ef45640 1 -- 172.21.15.42:0/703490182 shutdown_connections 2024-09-19T09:39:43.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:43.238+0000 7f7f8ef45640 1 -- 172.21.15.42:0/703490182 wait complete. 2024-09-19T09:39:43.540 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:43 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/703490182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:43.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:43 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/703490182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:43 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/703490182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:43.911 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:39:44.195 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:44.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:44 smithi042 ceph-mon[31223]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:39:44.738 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T09:39:44.738 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:44.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.735+0000 7fbbfc31d640 1 -- 172.21.15.42:0/3887635856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbf41037a0 msgr2=0x7fbbf410bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:44.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.735+0000 7fbbfc31d640 1 --2- 172.21.15.42:0/3887635856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbf41037a0 0x7fbbf410bc00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009900 tx=0x7fbbe402a410 comp rx=0 tx=0).stop 2024-09-19T09:39:44.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.736+0000 7fbbfc31d640 1 -- 172.21.15.42:0/3887635856 shutdown_connections 2024-09-19T09:39:44.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.736+0000 7fbbfc31d640 1 --2- 172.21.15.42:0/3887635856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf410c2f0 0x7fbbf410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.736+0000 7fbbfc31d640 1 --2- 172.21.15.42:0/3887635856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbf41037a0 0x7fbbf410bc00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.736+0000 7fbbfc31d640 1 --2- 172.21.15.42:0/3887635856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf4102df0 0x7fbbf41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.736+0000 7fbbfc31d640 1 -- 172.21.15.42:0/3887635856 >> 172.21.15.42:0/3887635856 conn(0x7fbbf40fc7d0 msgr2=0x7fbbf40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:44.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.736+0000 7fbbfc31d640 1 -- 172.21.15.42:0/3887635856 shutdown_connections 2024-09-19T09:39:44.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.736+0000 7fbbfc31d640 1 -- 172.21.15.42:0/3887635856 wait complete. 2024-09-19T09:39:44.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.736+0000 7fbbfc31d640 1 Processor -- start 2024-09-19T09:39:44.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbfc31d640 1 -- start start 2024-09-19T09:39:44.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbfc31d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf4102df0 0x7fbbf4198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbfc31d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbf41037a0 0x7fbbf4198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbfc31d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf410c2f0 0x7fbbf419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbfc31d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf41120d0 con 0x7fbbf41037a0 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbfc31d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf4111f50 con 0x7fbbf410c2f0 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbfc31d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf4112250 con 0x7fbbf4102df0 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbf98b8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbf41037a0 0x7fbbf4198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbf98b8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbf41037a0 0x7fbbf4198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58236/0 (socket says 172.21.15.42:58236) 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbf98b8640 1 -- 172.21.15.42:0/1175826666 learned_addr learned my addr 172.21.15.42:0/1175826666 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf4102df0 0x7fbbf4198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbfa8ba640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf410c2f0 0x7fbbf419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbf98b8640 1 -- 172.21.15.42:0/1175826666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf4102df0 msgr2=0x7fbbf4198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf4102df0 0x7fbbf4198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbf98b8640 1 -- 172.21.15.42:0/1175826666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf410c2f0 msgr2=0x7fbbf419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf410c2f0 0x7fbbf419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.737+0000 7fbbf98b8640 1 -- 172.21.15.42:0/1175826666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf419d5c0 con 0x7fbbf41037a0 2024-09-19T09:39:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.738+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbf41037a0 0x7fbbf4198b50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4005940 tx=0x7fbbe40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.738+0000 7fbbeb7fe640 1 -- 172.21.15.42:0/1175826666 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe403f030 con 0x7fbbf41037a0 2024-09-19T09:39:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.738+0000 7fbbeb7fe640 1 -- 172.21.15.42:0/1175826666 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbe4003ce0 con 0x7fbbf41037a0 2024-09-19T09:39:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.738+0000 7fbbfc31d640 1 -- 172.21.15.42:0/1175826666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf419d850 con 0x7fbbf41037a0 2024-09-19T09:39:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.738+0000 7fbbeb7fe640 1 -- 172.21.15.42:0/1175826666 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4035070 con 0x7fbbf41037a0 2024-09-19T09:39:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.738+0000 7fbbfc31d640 1 -- 172.21.15.42:0/1175826666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf41a5190 con 0x7fbbf41037a0 2024-09-19T09:39:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.741+0000 7fbbeb7fe640 1 -- 172.21.15.42:0/1175826666 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fbbe4042030 con 0x7fbbf41037a0 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.741+0000 7fbbfe6f6740 1 Processor -- start 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.741+0000 7fbbfe6f6740 1 -- start start 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.741+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f24e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.741+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f24ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.741+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f25d780 0x55871f25fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.741+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55871f1b42f0 con 0x55871f24e5d0 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.741+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55871f15bcf0 con 0x55871f24fb40 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.741+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55871f1b02b0 con 0x55871f25d780 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa0b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f24ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa0b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f24ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58248/0 (socket says 172.21.15.42:58248) 2024-09-19T09:39:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/406057456 learned_addr learned my addr 172.21.15.42:0/406057456 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa8ba640 1 --2- 172.21.15.42:0/406057456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f24e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/406057456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f25d780 0x55871f25fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/406057456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f25d780 msgr2=0x55871f25fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/406057456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f25d780 0x55871f25fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/406057456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 msgr2=0x55871f24e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/406057456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f24e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/406057456 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55871f1403a0 con 0x55871f24e5d0 2024-09-19T09:39:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbeb7fe640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbbe00a3350 0x7fbbe00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/406057456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f24ea10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000bd10 tx=0x7fbbf00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683ace29b88087a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbfa8ba640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbbe00a3350 0x7fbbe00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.742+0000 7fbbeb7fe640 1 -- 172.21.15.42:0/1175826666 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fbbe40efc50 con 0x7fbbf41037a0 2024-09-19T09:39:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.743+0000 7fbbe8dea640 1 -- 172.21.15.42:0/406057456 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0004030 con 0x55871f24e5d0 2024-09-19T09:39:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.743+0000 7fbbe8dea640 1 -- 172.21.15.42:0/406057456 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbf00041d0 con 0x55871f24e5d0 2024-09-19T09:39:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.743+0000 7fbbe8dea640 1 -- 172.21.15.42:0/406057456 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0011840 con 0x55871f24e5d0 2024-09-19T09:39:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.743+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/406057456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 msgr2=0x55871f24ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.743+0000 7fbbfa8ba640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbbe00a3350 0x7fbbe00a5810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbbec005fd0 tx=0x7fbbec0096e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.743+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/406057456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f24ea10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000bd10 tx=0x7fbbf00107a0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.744+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/406057456 shutdown_connections 2024-09-19T09:39:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.744+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/406057456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f25d780 0x55871f25fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.744+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/406057456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f24ea10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.744+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/406057456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f24e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.744+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/406057456 >> 172.21.15.42:0/406057456 conn(0x55871f217310 msgr2=0x55871f24ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.744+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/406057456 shutdown_connections 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.744+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/406057456 wait complete. 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.744+0000 7fbbfe6f6740 1 -- start start 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.744+0000 7fbbfe6f6740 1 Processor -- start 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 0x55871f25d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f25a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f25aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55871f260480 con 0x55871f25d780 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55871f16f060 con 0x55871f24fb40 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55871f260600 con 0x55871f24e5d0 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfe6f6740 10 client.0 _ll_register_callbacks cb 0x55871eec28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfa0b9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 0x55871f25d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfa8ba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f25aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfa0b9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 0x55871f25d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:56940/0 (socket says 172.21.15.42:56940) 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/3728162802 learned_addr learned my addr 172.21.15.42:0/3728162802 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f25a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/3728162802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 msgr2=0x55871f25a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f25a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/3728162802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 msgr2=0x55871f25aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f25aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/3728162802 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55871ef253c0 con 0x55871f24e5d0 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.745+0000 7fbbfa8ba640 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f25aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.746+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 0x55871f25d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0005cd0 tx=0x7fbbf000b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d5cfc5ed207594c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.746+0000 7fbbddffb640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.746+0000 7fbbddffb640 1 -- 172.21.15.42:0/3728162802 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0029060 con 0x55871f24e5d0 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.746+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/3728162802 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbf00041d0 con 0x55871f24e5d0 2024-09-19T09:39:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.746+0000 7fbbddffb640 1 -- 172.21.15.42:0/3728162802 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fbbf0004380 con 0x55871f24e5d0 2024-09-19T09:39:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.746+0000 7fbbddffb640 1 -- 172.21.15.42:0/3728162802 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbbf00035f0 con 0x55871f24e5d0 2024-09-19T09:39:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.746+0000 7fbbfe6f6740 10 client.25057 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.746+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/3728162802 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55871f26bf90 con 0x55871f24e5d0 2024-09-19T09:39:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.746+0000 7fbbddffb640 1 -- 172.21.15.42:0/3728162802 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbf00041d0 con 0x55871f24e5d0 2024-09-19T09:39:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.747+0000 7fbbddffb640 1 -- 172.21.15.42:0/3728162802 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbbf00046c0 con 0x55871f24e5d0 2024-09-19T09:39:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.747+0000 7fbbfe6f6740 10 client.25057 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.747+0000 7fbbfe6f6740 10 client.25057 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:39:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.747+0000 7fbbfe6f6740 20 client.25057 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.747+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55871f26d2e0 0x55871f26f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.747+0000 7fbbfe6f6740 4 client.25057 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.747+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/3728162802 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55871f1c1860 con 0x55871f26d2e0 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.747+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55871f26d2e0 0x55871f26f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.748+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55871f26d2e0 0x55871f26f6d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7b4cd529754ba137 server_cookie=ddb42c35c8b7dd83 in_seq=0 out_seq=0 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.748+0000 7fbbddffb640 10 client.25057 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.748+0000 7fbbddffb640 1 -- 172.21.15.42:0/3728162802 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55871f1c1860 con 0x55871f26d2e0 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.748+0000 7fbbddffb640 10 client.25057 handle_command_reply: tid=0 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.748+0000 7fbbfe6f6740 1 client.25057 shutdown 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.748+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/3728162802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 msgr2=0x55871f25d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.748+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 0x55871f25d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0005cd0 tx=0x7fbbf000b950 comp rx=0 tx=0).stop 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.749+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/3728162802 shutdown_connections 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.749+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55871f26d2e0 0x55871f26f6d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.749+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f25aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.749+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f25a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.749+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/3728162802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 0x55871f25d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.749+0000 7fbbddffb640 0 client.25057 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:39:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.749+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/3728162802 >> 172.21.15.42:0/3728162802 conn(0x55871f217310 msgr2=0x55871f250930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.749+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/3728162802 shutdown_connections 2024-09-19T09:39:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.749+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/3728162802 wait complete. 2024-09-19T09:39:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.749+0000 7fbbfe6f6740 20 client.25057 trim_cache size 0 max 16384 2024-09-19T09:39:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfe6f6740 1 Processor -- start 2024-09-19T09:39:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfe6f6740 1 -- start start 2024-09-19T09:39:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 0x55871f2698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f259470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f2726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf41ab4b0 con 0x55871f25d780 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf41acff0 con 0x55871f24fb40 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf41abb80 con 0x55871f24e5d0 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfa8ba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f2726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfa8ba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f2726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58268/0 (socket says 172.21.15.42:58268) 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfa8ba640 1 -- 172.21.15.42:0/238505359 learned_addr learned my addr 172.21.15.42:0/238505359 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/238505359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 0x55871f2698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.776+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/238505359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f259470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.777+0000 7fbbfa8ba640 1 -- 172.21.15.42:0/238505359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 msgr2=0x55871f2698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.777+0000 7fbbfa8ba640 1 --2- 172.21.15.42:0/238505359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 0x55871f2698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.777+0000 7fbbfa8ba640 1 -- 172.21.15.42:0/238505359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 msgr2=0x55871f259470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.777+0000 7fbbfa8ba640 1 --2- 172.21.15.42:0/238505359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f259470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.777+0000 7fbbfa8ba640 1 -- 172.21.15.42:0/238505359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55871f25fee0 con 0x55871f25d780 2024-09-19T09:39:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.777+0000 7fbbfa8ba640 1 --2- 172.21.15.42:0/238505359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f2726f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbbec01d7e0 tx=0x7fbbec00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45941e6f6864e70d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:44.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.777+0000 7fbbdffff640 1 -- 172.21.15.42:0/238505359 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec02d070 con 0x55871f25d780 2024-09-19T09:39:44.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.777+0000 7fbbdffff640 1 -- 172.21.15.42:0/238505359 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbec01bb60 con 0x55871f25d780 2024-09-19T09:39:44.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.777+0000 7fbbdffff640 1 -- 172.21.15.42:0/238505359 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec010630 con 0x55871f25d780 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.778+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/238505359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 msgr2=0x55871f2726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.778+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/238505359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f2726f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbbec01d7e0 tx=0x7fbbec00e000 comp rx=0 tx=0).stop 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.778+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/238505359 shutdown_connections 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.778+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/238505359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f25d780 0x55871f2726f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.778+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/238505359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f24fb40 0x55871f259470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.778+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/238505359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24e5d0 0x55871f2698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.778+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/238505359 >> 172.21.15.42:0/238505359 conn(0x55871f217310 msgr2=0x55871f258d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.778+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/238505359 shutdown_connections 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.778+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/238505359 wait complete. 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.779+0000 7fbbfe6f6740 1 -- start start 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.779+0000 7fbbfe6f6740 1 Processor -- start 2024-09-19T09:39:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.779+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f272b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.779+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24fb40 0x55871f26fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.779+0000 7fbbfe6f6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f25d780 0x55871f270400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.779+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf41ac920 con 0x55871f24e5d0 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.779+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf41ac250 con 0x55871f25d780 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.779+0000 7fbbfe6f6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf41a9490 con 0x55871f24fb40 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.779+0000 7fbbfe6f6740 10 client.0 _ll_register_callbacks cb 0x7fbbec009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.779+0000 7fbbfa0b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f272b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbfa0b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f272b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58282/0 (socket says 172.21.15.42:58282) 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/2407815411 learned_addr learned my addr 172.21.15.42:0/2407815411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbfa8ba640 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f25d780 0x55871f270400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24fb40 0x55871f26fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/2407815411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24fb40 msgr2=0x55871f26fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24fb40 0x55871f26fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/2407815411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f25d780 msgr2=0x55871f270400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f25d780 0x55871f270400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbfa0b9640 1 -- 172.21.15.42:0/2407815411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55871f270940 con 0x55871f24e5d0 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbfa0b9640 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f272b70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0004c80 tx=0x7fbbf0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0477eae0aaaba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbddffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbddffb640 1 -- 172.21.15.42:0/2407815411 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0029070 con 0x55871f24e5d0 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbddffb640 1 -- 172.21.15.42:0/2407815411 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fbbf00044d0 con 0x55871f24e5d0 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.780+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/2407815411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbec01bb60 con 0x55871f24e5d0 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.781+0000 7fbbddffb640 1 -- 172.21.15.42:0/2407815411 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbbf003e070 con 0x55871f24e5d0 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.781+0000 7fbbfe6f6740 10 client.15546 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.781+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/2407815411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55871f2d7930 con 0x55871f24e5d0 2024-09-19T09:39:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.781+0000 7fbbddffb640 1 -- 172.21.15.42:0/2407815411 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbec01bb60 con 0x55871f24e5d0 2024-09-19T09:39:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.781+0000 7fbbddffb640 1 -- 172.21.15.42:0/2407815411 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbbf0005480 con 0x55871f24e5d0 2024-09-19T09:39:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.781+0000 7fbbfe6f6740 10 client.15546 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.781+0000 7fbbfe6f6740 10 client.15546 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:39:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.781+0000 7fbbfe6f6740 20 client.15546 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.781+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55871f2d7fb0 0x55871f2da3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.782+0000 7fbbfe6f6740 4 client.15546 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:39:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.782+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/2407815411 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55871f1bbd70 con 0x55871f2d7fb0 2024-09-19T09:39:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.782+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55871f2d7fb0 0x55871f2da3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.782+0000 7fbbddffb640 10 client.15546 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:39:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.782+0000 7fbbf98b8640 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55871f2d7fb0 0x55871f2da3d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=40e03afeff02d3db server_cookie=61236626b182e683 in_seq=0 out_seq=0 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.782+0000 7fbbddffb640 1 -- 172.21.15.42:0/2407815411 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55871f1bbd70 con 0x55871f2d7fb0 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.782+0000 7fbbddffb640 10 client.15546 handle_command_reply: tid=0 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.782+0000 7fbbfe6f6740 1 client.15546 shutdown 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/2407815411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 msgr2=0x55871f272b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f272b70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0004c80 tx=0x7fbbf0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/2407815411 shutdown_connections 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55871f2d7fb0 0x55871f2da3d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55871f25d780 0x55871f270400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55871f24fb40 0x55871f26fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 1 --2- 172.21.15.42:0/2407815411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55871f24e5d0 0x55871f272b70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/2407815411 >> 172.21.15.42:0/2407815411 conn(0x55871f217310 msgr2=0x55871f259580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbddffb640 0 client.15546 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:39:44.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/2407815411 shutdown_connections 2024-09-19T09:39:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 1 -- 172.21.15.42:0/2407815411 wait complete. 2024-09-19T09:39:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.783+0000 7fbbfe6f6740 20 client.15546 trim_cache size 0 max 16384 2024-09-19T09:39:44.789 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:39:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 -- 172.21.15.42:0/1175826666 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbbe00a3350 msgr2=0x7fbbe00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbbe00a3350 0x7fbbe00a5810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbbec005fd0 tx=0x7fbbec0096e0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 -- 172.21.15.42:0/1175826666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbf41037a0 msgr2=0x7fbbf4198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbf41037a0 0x7fbbf4198b50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4005940 tx=0x7fbbe40042f0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 -- 172.21.15.42:0/1175826666 shutdown_connections 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbbe00a3350 0x7fbbe00a5810 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf410c2f0 0x7fbbf419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbf41037a0 0x7fbbf4198b50 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 --2- 172.21.15.42:0/1175826666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf4102df0 0x7fbbf4198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 -- 172.21.15.42:0/1175826666 >> 172.21.15.42:0/1175826666 conn(0x7fbbf40fc7d0 msgr2=0x7fbbf40fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 -- 172.21.15.42:0/1175826666 shutdown_connections 2024-09-19T09:39:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:44.784+0000 7fbbfc31d640 1 -- 172.21.15.42:0/1175826666 wait complete. 2024-09-19T09:39:44.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:44 smithi171 ceph-mon[35803]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:39:44.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:44 smithi136 ceph-mon[34840]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:39:45.485 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:39:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.850+0000 7f003344d640 1 -- 172.21.15.42:0/1082470001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0024094550 msgr2=0x7f0024094950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.850+0000 7f003344d640 1 --2- 172.21.15.42:0/1082470001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0024094550 0x7f0024094950 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0028009900 tx=0x7f002802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.850+0000 7f003344d640 1 -- 172.21.15.42:0/1082470001 shutdown_connections 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.850+0000 7f003344d640 1 --2- 172.21.15.42:0/1082470001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0024096100 0x7f002409c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.850+0000 7f003344d640 1 --2- 172.21.15.42:0/1082470001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0024095740 0x7f0024095bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.850+0000 7f003344d640 1 --2- 172.21.15.42:0/1082470001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0024094550 0x7f0024094950 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.850+0000 7f003344d640 1 -- 172.21.15.42:0/1082470001 >> 172.21.15.42:0/1082470001 conn(0x7f002408fcb0 msgr2=0x7f00240920f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.850+0000 7f003344d640 1 -- 172.21.15.42:0/1082470001 shutdown_connections 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.850+0000 7f003344d640 1 -- 172.21.15.42:0/1082470001 wait complete. 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f003344d640 1 Processor -- start 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f003344d640 1 -- start start 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f003344d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0024094550 0x7f002412a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f003344d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0024095740 0x7f002412ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f003344d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0024096100 0x7f0024131de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f003344d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f00240a0210 con 0x7f0024095740 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f003344d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f00240a0090 con 0x7f0024094550 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f003344d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f00240a0390 con 0x7f0024096100 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f0031c4a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0024095740 0x7f002412ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f0031c4a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0024095740 0x7f002412ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58294/0 (socket says 172.21.15.42:58294) 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f0031c4a640 1 -- 172.21.15.42:0/2826109364 learned_addr learned my addr 172.21.15.42:0/2826109364 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f003244b640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0024094550 0x7f002412a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f0032c4c640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0024096100 0x7f0024131de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f0031c4a640 1 -- 172.21.15.42:0/2826109364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0024096100 msgr2=0x7f0024131de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f0031c4a640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0024096100 0x7f0024131de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f0031c4a640 1 -- 172.21.15.42:0/2826109364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0024094550 msgr2=0x7f002412a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f0031c4a640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0024094550 0x7f002412a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.851+0000 7f0031c4a640 1 -- 172.21.15.42:0/2826109364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0024132450 con 0x7f0024095740 2024-09-19T09:39:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.852+0000 7f0031c4a640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0024095740 0x7f002412ad70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f001c00c920 tx=0x7f001c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.852+0000 7f00237fe640 1 -- 172.21.15.42:0/2826109364 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c013d70 con 0x7f0024095740 2024-09-19T09:39:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.852+0000 7f003344d640 1 -- 172.21.15.42:0/2826109364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00240060f0 con 0x7f0024095740 2024-09-19T09:39:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.852+0000 7f00237fe640 1 -- 172.21.15.42:0/2826109364 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f001c007c80 con 0x7f0024095740 2024-09-19T09:39:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.852+0000 7f00237fe640 1 -- 172.21.15.42:0/2826109364 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c01ccc0 con 0x7f0024095740 2024-09-19T09:39:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.852+0000 7f003344d640 1 -- 172.21.15.42:0/2826109364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0024006640 con 0x7f0024095740 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.855+0000 7f00237fe640 1 -- 172.21.15.42:0/2826109364 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f001c0077a0 con 0x7f0024095740 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.855+0000 7f00237fe640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f00180a32e0 0x7f00180a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.855+0000 7f003743f740 1 Processor -- start 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.855+0000 7f00237fe640 1 -- 172.21.15.42:0/2826109364 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f001c0d4160 con 0x7f0024095740 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.855+0000 7f003244b640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f00180a32e0 0x7f00180a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003743f740 1 -- start start 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003743f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b563018f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003743f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b56301df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003743f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b563020a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003743f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b562f7c2f0 con 0x55b563018b70 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003743f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b562f24270 con 0x55b5630194b0 2024-09-19T09:39:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003743f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b562f782b0 con 0x55b56301e540 2024-09-19T09:39:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003244b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b563018f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003244b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b563018f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58296/0 (socket says 172.21.15.42:58296) 2024-09-19T09:39:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003244b640 1 -- 172.21.15.42:0/908348642 learned_addr learned my addr 172.21.15.42:0/908348642 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f0031c4a640 1 --2- 172.21.15.42:0/908348642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b56301df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003244b640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f00180a32e0 0x7f00180a57a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0028005ab0 tx=0x7f0028000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003244b640 1 -- 172.21.15.42:0/908348642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 msgr2=0x55b563020a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:39:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003244b640 1 --2- 172.21.15.42:0/908348642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b563020a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003244b640 1 -- 172.21.15.42:0/908348642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 msgr2=0x55b56301df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003244b640 1 --2- 172.21.15.42:0/908348642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b56301df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.856+0000 7f003244b640 1 -- 172.21.15.42:0/908348642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b562f23340 con 0x55b563018b70 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.857+0000 7f003244b640 1 --2- 172.21.15.42:0/908348642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b563018f70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0028009900 tx=0x7f002803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e21d986081a1b89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.857+0000 7f0020ff9640 1 -- 172.21.15.42:0/908348642 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002804d070 con 0x55b563018b70 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.857+0000 7f0020ff9640 1 -- 172.21.15.42:0/908348642 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0028049450 con 0x55b563018b70 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.857+0000 7f0020ff9640 1 -- 172.21.15.42:0/908348642 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028035040 con 0x55b563018b70 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 -- 172.21.15.42:0/908348642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 msgr2=0x55b563018f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 --2- 172.21.15.42:0/908348642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b563018f70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0028009900 tx=0x7f002803d000 comp rx=0 tx=0).stop 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 -- 172.21.15.42:0/908348642 shutdown_connections 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 --2- 172.21.15.42:0/908348642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b563020a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 --2- 172.21.15.42:0/908348642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b56301df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 --2- 172.21.15.42:0/908348642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b563018f70 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 -- 172.21.15.42:0/908348642 >> 172.21.15.42:0/908348642 conn(0x55b5630141e0 msgr2=0x55b5630145e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 -- 172.21.15.42:0/908348642 shutdown_connections 2024-09-19T09:39:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 -- 172.21.15.42:0/908348642 wait complete. 2024-09-19T09:39:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 -- start start 2024-09-19T09:39:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.858+0000 7f003743f740 1 Processor -- start 2024-09-19T09:39:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f003743f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b563018b70 0x55b56302b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f003743f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5630194b0 0x55b56302b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f003743f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b56301e540 0x55b563032a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f0031c4a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5630194b0 0x55b56302b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f003743f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b5630214b0 con 0x55b5630194b0 2024-09-19T09:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f0031c4a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5630194b0 0x55b56302b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58306/0 (socket says 172.21.15.42:58306) 2024-09-19T09:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f0031c4a640 1 -- 172.21.15.42:0/3522430773 learned_addr learned my addr 172.21.15.42:0/3522430773 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f003743f740 1 -- 172.21.15.42:0/3522430773 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b562f05290 con 0x55b56301e540 2024-09-19T09:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f003743f740 1 -- 172.21.15.42:0/3522430773 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b563021630 con 0x55b563018b70 2024-09-19T09:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f003743f740 10 client.0 _ll_register_callbacks cb 0x55b562f36140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f003244b640 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b563018b70 0x55b56302b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f0031c4a640 1 -- 172.21.15.42:0/3522430773 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b563018b70 msgr2=0x55b56302b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f0031c4a640 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b563018b70 0x55b56302b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f0031c4a640 1 -- 172.21.15.42:0/3522430773 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b56301e540 msgr2=0x55b563032a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f0031c4a640 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b56301e540 0x55b563032a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.859+0000 7f0031c4a640 1 -- 172.21.15.42:0/3522430773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b562c8f210 con 0x55b5630194b0 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f0031c4a640 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5630194b0 0x55b56302b9c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f001c007590 tx=0x7f001c0a0200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad841677bfb06437 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f0015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f0015ffb640 1 -- 172.21.15.42:0/3522430773 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c0b8070 con 0x55b5630194b0 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f0015ffb640 1 -- 172.21.15.42:0/3522430773 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f001c09fc50 con 0x55b5630194b0 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f003743f740 1 -- 172.21.15.42:0/3522430773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0028049450 con 0x55b5630194b0 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f0015ffb640 1 -- 172.21.15.42:0/3522430773 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f001c09c040 con 0x55b5630194b0 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f003743f740 10 client.15558 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f003743f740 1 -- 172.21.15.42:0/3522430773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b562d5b620 con 0x55b5630194b0 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f0015ffb640 1 -- 172.21.15.42:0/3522430773 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0028049450 con 0x55b5630194b0 2024-09-19T09:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f0015ffb640 1 -- 172.21.15.42:0/3522430773 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f001c09c350 con 0x55b5630194b0 2024-09-19T09:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f003743f740 10 client.15558 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f003743f740 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f003743f740 20 client.15558 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f003743f740 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b5630371a0 0x55b5630395f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f003743f740 4 client.15558 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.860+0000 7f003743f740 1 -- 172.21.15.42:0/3522430773 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b562f89a20 con 0x55b5630371a0 2024-09-19T09:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.861+0000 7f003244b640 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b5630371a0 0x55b5630395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.861+0000 7f003244b640 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b5630371a0 0x55b5630395f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f81644971eea4b server_cookie=2692937527d429af in_seq=0 out_seq=0 2024-09-19T09:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.861+0000 7f0015ffb640 10 client.15558 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f0015ffb640 1 -- 172.21.15.42:0/3522430773 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b562f89a20 con 0x55b5630371a0 2024-09-19T09:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f0015ffb640 10 client.15558 handle_command_reply: tid=0 2024-09-19T09:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 client.15558 shutdown 2024-09-19T09:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 -- 172.21.15.42:0/3522430773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5630194b0 msgr2=0x55b56302b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5630194b0 0x55b56302b9c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f001c007590 tx=0x7f001c0a0200 comp rx=0 tx=0).stop 2024-09-19T09:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 -- 172.21.15.42:0/3522430773 shutdown_connections 2024-09-19T09:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b5630371a0 0x55b5630395f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b56301e540 0x55b563032a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b5630194b0 0x55b56302b9c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 --2- 172.21.15.42:0/3522430773 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b563018b70 0x55b56302b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f0015ffb640 0 client.15558 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 -- 172.21.15.42:0/3522430773 >> 172.21.15.42:0/3522430773 conn(0x55b5630141e0 msgr2=0x55b5630159f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 -- 172.21.15.42:0/3522430773 shutdown_connections 2024-09-19T09:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 1 -- 172.21.15.42:0/3522430773 wait complete. 2024-09-19T09:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.862+0000 7f003743f740 20 client.15558 trim_cache size 0 max 16384 2024-09-19T09:39:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.876+0000 7f003743f740 1 Processor -- start 2024-09-19T09:39:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003743f740 1 -- start start 2024-09-19T09:39:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003743f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b5630131a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003743f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b5630329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003743f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b5630136e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003743f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f002413a980 con 0x55b563018b70 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003743f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f002413c4c0 con 0x55b5630194b0 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003743f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f002413b050 con 0x55b56301e540 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003244b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b5630131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003244b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b5630131a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58314/0 (socket says 172.21.15.42:58314) 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003244b640 1 -- 172.21.15.42:0/3358429150 learned_addr learned my addr 172.21.15.42:0/3358429150 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f0032c4c640 1 --2- 172.21.15.42:0/3358429150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b5630136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f0031c4a640 1 --2- 172.21.15.42:0/3358429150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b5630329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003244b640 1 -- 172.21.15.42:0/3358429150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 msgr2=0x55b5630136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003244b640 1 --2- 172.21.15.42:0/3358429150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b5630136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003244b640 1 -- 172.21.15.42:0/3358429150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 msgr2=0x55b5630329c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003244b640 1 --2- 172.21.15.42:0/3358429150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b5630329c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003244b640 1 -- 172.21.15.42:0/3358429150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b56302afc0 con 0x55b563018b70 2024-09-19T09:39:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.877+0000 7f003244b640 1 --2- 172.21.15.42:0/3358429150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b5630131a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f002802a910 tx=0x7f0028049f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59d8a001d2bb213 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.878+0000 7f0017fff640 1 -- 172.21.15.42:0/3358429150 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028040050 con 0x55b563018b70 2024-09-19T09:39:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.878+0000 7f0017fff640 1 -- 172.21.15.42:0/3358429150 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00280037f0 con 0x55b563018b70 2024-09-19T09:39:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.878+0000 7f0017fff640 1 -- 172.21.15.42:0/3358429150 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002804d040 con 0x55b563018b70 2024-09-19T09:39:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.878+0000 7f003743f740 1 -- 172.21.15.42:0/3358429150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 msgr2=0x55b5630131a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.878+0000 7f003743f740 1 --2- 172.21.15.42:0/3358429150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b5630131a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f002802a910 tx=0x7f0028049f90 comp rx=0 tx=0).stop 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.878+0000 7f003743f740 1 -- 172.21.15.42:0/3358429150 shutdown_connections 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.878+0000 7f003743f740 1 --2- 172.21.15.42:0/3358429150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b5630136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.878+0000 7f003743f740 1 --2- 172.21.15.42:0/3358429150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b5630329c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.878+0000 7f003743f740 1 --2- 172.21.15.42:0/3358429150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b5630131a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 -- 172.21.15.42:0/3358429150 >> 172.21.15.42:0/3358429150 conn(0x55b5630141e0 msgr2=0x55b563012a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 -- 172.21.15.42:0/3358429150 shutdown_connections 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 -- 172.21.15.42:0/3358429150 wait complete. 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 -- start start 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 Processor -- start 2024-09-19T09:39:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b56302ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b5630304f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b5630314b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f002413bdf0 con 0x55b563018b70 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f002413b720 con 0x55b5630194b0 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0024138960 con 0x55b56301e540 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003743f740 10 client.0 _ll_register_callbacks cb 0x7f001c00c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003244b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b56302ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003244b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b56302ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58328/0 (socket says 172.21.15.42:58328) 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f003244b640 1 -- 172.21.15.42:0/4053757018 learned_addr learned my addr 172.21.15.42:0/4053757018 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.879+0000 7f0031c4a640 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b5630304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f0032c4c640 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b5630314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f003244b640 1 -- 172.21.15.42:0/4053757018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 msgr2=0x55b5630314b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f003244b640 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b5630314b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f003244b640 1 -- 172.21.15.42:0/4053757018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 msgr2=0x55b5630304f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f003244b640 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b5630304f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f003244b640 1 -- 172.21.15.42:0/4053757018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b563031ac0 con 0x55b563018b70 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f0031c4a640 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b5630304f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f003244b640 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b56302ffb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0028031440 tx=0x7f002802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee5bd5a3e51e342 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f0015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f0015ffb640 1 -- 172.21.15.42:0/4053757018 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002806e060 con 0x55b563018b70 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f003743f740 1 -- 172.21.15.42:0/4053757018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00280037f0 con 0x55b563018b70 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f0015ffb640 1 -- 172.21.15.42:0/4053757018 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0028003db0 con 0x55b563018b70 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f0015ffb640 1 -- 172.21.15.42:0/4053757018 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0028040030 con 0x55b563018b70 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f003743f740 10 client.15564 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f003743f740 1 -- 172.21.15.42:0/4053757018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b563032dd0 con 0x55b563018b70 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.880+0000 7f0015ffb640 1 -- 172.21.15.42:0/4053757018 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00280037f0 con 0x55b563018b70 2024-09-19T09:39:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.881+0000 7f0015ffb640 1 -- 172.21.15.42:0/4053757018 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0028066070 con 0x55b563018b70 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.881+0000 7f003743f740 10 client.15564 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.881+0000 7f003743f740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.881+0000 7f003743f740 20 client.15564 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.881+0000 7f003743f740 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b5630a2020 0x55b5630a4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.881+0000 7f003743f740 4 client.15564 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.881+0000 7f003743f740 1 -- 172.21.15.42:0/4053757018 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b562f83d70 con 0x55b5630a2020 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.881+0000 7f0031c4a640 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b5630a2020 0x55b5630a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.881+0000 7f0031c4a640 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b5630a2020 0x55b5630a4410 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b97696af4b6628a9 server_cookie=f3d18f3c36e32939 in_seq=0 out_seq=0 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.881+0000 7f0015ffb640 10 client.15564 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f0015ffb640 1 -- 172.21.15.42:0/4053757018 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b562f83d70 con 0x55b5630a2020 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f0015ffb640 10 client.15564 handle_command_reply: tid=0 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 client.15564 shutdown 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 -- 172.21.15.42:0/4053757018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 msgr2=0x55b56302ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b56302ffb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0028031440 tx=0x7f002802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 -- 172.21.15.42:0/4053757018 shutdown_connections 2024-09-19T09:39:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b5630a2020 0x55b5630a4410 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b56301e540 0x55b5630314b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5630194b0 0x55b5630304f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 --2- 172.21.15.42:0/4053757018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b563018b70 0x55b56302ffb0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f0015ffb640 0 client.15564 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 -- 172.21.15.42:0/4053757018 >> 172.21.15.42:0/4053757018 conn(0x55b5630141e0 msgr2=0x55b5630132b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 -- 172.21.15.42:0/4053757018 shutdown_connections 2024-09-19T09:39:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 1 -- 172.21.15.42:0/4053757018 wait complete. 2024-09-19T09:39:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.885+0000 7f003743f740 20 client.15564 trim_cache size 0 max 16384 2024-09-19T09:39:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:39:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:39:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:39:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 -- 172.21.15.42:0/2826109364 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f00180a32e0 msgr2=0x7f00180a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f00180a32e0 0x7f00180a57a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0028005ab0 tx=0x7f0028000bc0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 -- 172.21.15.42:0/2826109364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0024095740 msgr2=0x7f002412ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0024095740 0x7f002412ad70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f001c00c920 tx=0x7f001c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 -- 172.21.15.42:0/2826109364 shutdown_connections 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f00180a32e0 0x7f00180a57a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0024096100 0x7f0024131de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0024095740 0x7f002412ad70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 --2- 172.21.15.42:0/2826109364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0024094550 0x7f002412a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 -- 172.21.15.42:0/2826109364 >> 172.21.15.42:0/2826109364 conn(0x7f002408fcb0 msgr2=0x7f0024098b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 -- 172.21.15.42:0/2826109364 shutdown_connections 2024-09-19T09:39:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:45.886+0000 7f003344d640 1 -- 172.21.15.42:0/2826109364 wait complete. 2024-09-19T09:39:46.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.076+0000 7fafaa937640 1 -- 172.21.15.42:0/760133168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafa4102d30 msgr2=0x7fafa4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.076+0000 7fafaa937640 1 --2- 172.21.15.42:0/760133168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafa4102d30 0x7fafa4103110 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faf94009930 tx=0x7faf9402a420 comp rx=0 tx=0).stop 2024-09-19T09:39:46.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.076+0000 7fafaa937640 1 -- 172.21.15.42:0/760133168 shutdown_connections 2024-09-19T09:39:46.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.076+0000 7fafaa937640 1 --2- 172.21.15.42:0/760133168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa41082a0 0x7fafa410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.076+0000 7fafaa937640 1 --2- 172.21.15.42:0/760133168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa41036e0 0x7fafa4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.076+0000 7fafaa937640 1 --2- 172.21.15.42:0/760133168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafa4102d30 0x7fafa4103110 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.076+0000 7fafaa937640 1 -- 172.21.15.42:0/760133168 >> 172.21.15.42:0/760133168 conn(0x7fafa40fc7d0 msgr2=0x7fafa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.076+0000 7fafaa937640 1 -- 172.21.15.42:0/760133168 shutdown_connections 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.076+0000 7fafaa937640 1 -- 172.21.15.42:0/760133168 wait complete. 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafaa937640 1 Processor -- start 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafaa937640 1 -- start start 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafaa937640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafa4102d30 0x7fafa41985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafaa937640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa41036e0 0x7fafa4198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafaa937640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa41082a0 0x7fafa419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafaa937640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fafa41120a0 con 0x7fafa4102d30 2024-09-19T09:39:46.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafaa937640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fafa4111f20 con 0x7fafa41082a0 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafaa937640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fafa4112220 con 0x7fafa41036e0 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafa3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafa4102d30 0x7fafa41985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafa3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafa4102d30 0x7fafa41985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58350/0 (socket says 172.21.15.42:58350) 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafa3fff640 1 -- 172.21.15.42:0/109425796 learned_addr learned my addr 172.21.15.42:0/109425796 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafa37fe640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa41036e0 0x7fafa4198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.077+0000 7fafa8ed4640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa41082a0 0x7fafa419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafa3fff640 1 -- 172.21.15.42:0/109425796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa41036e0 msgr2=0x7fafa4198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafa3fff640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa41036e0 0x7fafa4198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafa3fff640 1 -- 172.21.15.42:0/109425796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa41082a0 msgr2=0x7fafa419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafa3fff640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa41082a0 0x7fafa419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafa3fff640 1 -- 172.21.15.42:0/109425796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa419d590 con 0x7fafa4102d30 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafa8ed4640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa41082a0 0x7fafa419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafa3fff640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafa4102d30 0x7fafa41985e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faf94009230 tx=0x7faf94004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafa17fa640 1 -- 172.21.15.42:0/109425796 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9403f030 con 0x7fafa4102d30 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafa17fa640 1 -- 172.21.15.42:0/109425796 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf94004440 con 0x7fafa4102d30 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafa17fa640 1 -- 172.21.15.42:0/109425796 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94035070 con 0x7fafa4102d30 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafaa937640 1 -- 172.21.15.42:0/109425796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa419d820 con 0x7fafa4102d30 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.078+0000 7fafaa937640 1 -- 172.21.15.42:0/109425796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa419dcb0 con 0x7fafa4102d30 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.079+0000 7fafaa937640 1 -- 172.21.15.42:0/109425796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa4103110 con 0x7fafa4102d30 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.080+0000 7fafa17fa640 1 -- 172.21.15.42:0/109425796 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7faf94042030 con 0x7fafa4102d30 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.081+0000 7fafa17fa640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faf8c0a3350 0x7faf8c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.081+0000 7fafa37fe640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faf8c0a3350 0x7faf8c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.082+0000 7fafa17fa640 1 -- 172.21.15.42:0/109425796 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7faf940efa40 con 0x7fafa4102d30 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.082+0000 7fafa37fe640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faf8c0a3350 0x7faf8c0a5810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fafa40fee70 tx=0x7faf98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.086+0000 7fafa17fa640 1 -- 172.21.15.42:0/109425796 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf940bc5e0 con 0x7fafa4102d30 2024-09-19T09:39:46.141 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:46.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.325+0000 7fafaa937640 1 -- 172.21.15.42:0/109425796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafa410a2b0 con 0x7fafa4102d30 2024-09-19T09:39:46.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.326+0000 7fafa17fa640 1 -- 172.21.15.42:0/109425796 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7faf940bbee0 con 0x7fafa4102d30 2024-09-19T09:39:46.328 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:46.328 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:39:46.328 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:39:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.328+0000 7fafaa937640 1 -- 172.21.15.42:0/109425796 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faf8c0a3350 msgr2=0x7faf8c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.328+0000 7fafaa937640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faf8c0a3350 0x7faf8c0a5810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fafa40fee70 tx=0x7faf98005f90 comp rx=0 tx=0).stop 2024-09-19T09:39:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.328+0000 7fafaa937640 1 -- 172.21.15.42:0/109425796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafa4102d30 msgr2=0x7fafa41985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.328+0000 7fafaa937640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafa4102d30 0x7fafa41985e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faf94009230 tx=0x7faf94004040 comp rx=0 tx=0).stop 2024-09-19T09:39:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.329+0000 7fafaa937640 1 -- 172.21.15.42:0/109425796 shutdown_connections 2024-09-19T09:39:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.329+0000 7fafaa937640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7faf8c0a3350 0x7faf8c0a5810 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.329+0000 7fafaa937640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa41082a0 0x7fafa419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.329+0000 7fafaa937640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa41036e0 0x7fafa4198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.329+0000 7fafaa937640 1 --2- 172.21.15.42:0/109425796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafa4102d30 0x7fafa41985e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.329+0000 7fafaa937640 1 -- 172.21.15.42:0/109425796 >> 172.21.15.42:0/109425796 conn(0x7fafa40fc7d0 msgr2=0x7fafa4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.329+0000 7fafaa937640 1 -- 172.21.15.42:0/109425796 shutdown_connections 2024-09-19T09:39:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.329+0000 7fafaa937640 1 -- 172.21.15.42:0/109425796 wait complete. 2024-09-19T09:39:46.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:46 smithi042 ceph-mon[31223]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:39:46.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:46 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/109425796' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:46.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.811+0000 7f77cbc6b640 1 -- 172.21.15.42:0/1380340459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4102d30 msgr2=0x7f77c4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.811+0000 7f77cbc6b640 1 --2- 172.21.15.42:0/1380340459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4102d30 0x7f77c4103110 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009930 tx=0x7f77c002a440 comp rx=0 tx=0).stop 2024-09-19T09:39:46.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.811+0000 7f77cbc6b640 1 -- 172.21.15.42:0/1380340459 shutdown_connections 2024-09-19T09:39:46.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.811+0000 7f77cbc6b640 1 --2- 172.21.15.42:0/1380340459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77c41082a0 0x7f77c410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.811+0000 7f77cbc6b640 1 --2- 172.21.15.42:0/1380340459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77c41036e0 0x7f77c4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.811+0000 7f77cbc6b640 1 --2- 172.21.15.42:0/1380340459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4102d30 0x7f77c4103110 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.811+0000 7f77cbc6b640 1 -- 172.21.15.42:0/1380340459 >> 172.21.15.42:0/1380340459 conn(0x7f77c40fc7d0 msgr2=0x7f77c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.811+0000 7f77cbc6b640 1 -- 172.21.15.42:0/1380340459 shutdown_connections 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.811+0000 7f77cbc6b640 1 -- 172.21.15.42:0/1380340459 wait complete. 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.812+0000 7f77cbc6b640 1 Processor -- start 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.812+0000 7f77cbc6b640 1 -- start start 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.812+0000 7f77cbc6b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4102d30 0x7f77c41a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.812+0000 7f77cbc6b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77c41036e0 0x7f77c41a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.812+0000 7f77cbc6b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77c41082a0 0x7f77c419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.812+0000 7f77cbc6b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4112160 con 0x7f77c4102d30 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.812+0000 7f77cbc6b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4111fe0 con 0x7f77c41036e0 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.812+0000 7f77cbc6b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f77c41122e0 con 0x7f77c41082a0 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.812+0000 7f77c9a07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4102d30 0x7f77c41a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77c9a07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4102d30 0x7f77c41a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58370/0 (socket says 172.21.15.42:58370) 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77c9a07640 1 -- 172.21.15.42:0/3233959480 learned_addr learned my addr 172.21.15.42:0/3233959480 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77c9206640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77c41036e0 0x7f77c41a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77c9a07640 1 -- 172.21.15.42:0/3233959480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77c41082a0 msgr2=0x7f77c419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77c9a07640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77c41082a0 0x7f77c419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77c9a07640 1 -- 172.21.15.42:0/3233959480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77c41036e0 msgr2=0x7f77c41a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77c9a07640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77c41036e0 0x7f77c41a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77c9a07640 1 -- 172.21.15.42:0/3233959480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c419afc0 con 0x7f77c4102d30 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77c9206640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77c41036e0 0x7f77c41a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77c9a07640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4102d30 0x7f77c41a0680 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009a50 tx=0x7f77c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77baffd640 1 -- 172.21.15.42:0/3233959480 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c003f030 con 0x7f77c4102d30 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77baffd640 1 -- 172.21.15.42:0/3233959480 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77c0003ce0 con 0x7f77c4102d30 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77cbc6b640 1 -- 172.21.15.42:0/3233959480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c419b250 con 0x7f77c4102d30 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77baffd640 1 -- 172.21.15.42:0/3233959480 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c0035070 con 0x7f77c4102d30 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.813+0000 7f77cbc6b640 1 -- 172.21.15.42:0/3233959480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c41a7430 con 0x7f77c4102d30 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.816+0000 7f77baffd640 1 -- 172.21.15.42:0/3233959480 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f77c0042030 con 0x7f77c4102d30 2024-09-19T09:39:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.816+0000 7f77ce044740 1 Processor -- start 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.816+0000 7f77ce044740 1 -- start start 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.816+0000 7f77ce044740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71acb40 0x5645b71ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.816+0000 7f77ce044740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 0x5645b71aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.816+0000 7f77ce044740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71b6370 0x5645b71b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.816+0000 7f77ce044740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5645b71112f0 con 0x5645b71b6370 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.816+0000 7f77ce044740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5645b70b8cf0 con 0x5645b71acb40 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.816+0000 7f77ce044740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5645b710d2b0 con 0x5645b71ab5d0 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77c9206640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71b6370 0x5645b71b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77c9206640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71b6370 0x5645b71b8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58386/0 (socket says 172.21.15.42:58386) 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77c9206640 1 -- 172.21.15.42:0/151266716 learned_addr learned my addr 172.21.15.42:0/151266716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77ca208640 1 --2- 172.21.15.42:0/151266716 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71acb40 0x5645b71ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77c9a07640 1 --2- 172.21.15.42:0/151266716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 0x5645b71aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77c9206640 1 -- 172.21.15.42:0/151266716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 msgr2=0x5645b71aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77c9206640 1 --2- 172.21.15.42:0/151266716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 0x5645b71aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77c9206640 1 -- 172.21.15.42:0/151266716 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71acb40 msgr2=0x5645b71ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77c9206640 1 --2- 172.21.15.42:0/151266716 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71acb40 0x5645b71ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77c9206640 1 -- 172.21.15.42:0/151266716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b709d3a0 con 0x5645b71b6370 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77ca208640 1 --2- 172.21.15.42:0/151266716 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71acb40 0x5645b71ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77baffd640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77b00a3350 0x7f77b00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.817+0000 7f77ca208640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77b00a3350 0x7f77b00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.818+0000 7f77baffd640 1 -- 172.21.15.42:0/3233959480 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f77c00f0120 con 0x7f77c4102d30 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.818+0000 7f77c9206640 1 --2- 172.21.15.42:0/151266716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71b6370 0x5645b71b8760 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f77b400a970 tx=0x7f77b400ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd08d7282ac41d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.818+0000 7f77affff640 1 -- 172.21.15.42:0/151266716 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4015070 con 0x5645b71b6370 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.818+0000 7f77affff640 1 -- 172.21.15.42:0/151266716 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b400cc00 con 0x5645b71b6370 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.818+0000 7f77affff640 1 -- 172.21.15.42:0/151266716 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40105b0 con 0x5645b71b6370 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 -- 172.21.15.42:0/151266716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71b6370 msgr2=0x5645b71b8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 --2- 172.21.15.42:0/151266716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71b6370 0x5645b71b8760 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f77b400a970 tx=0x7f77b400ae30 comp rx=0 tx=0).stop 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ca208640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77b00a3350 0x7f77b00a5810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00a510 tx=0x7f77bc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 -- 172.21.15.42:0/151266716 shutdown_connections 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 --2- 172.21.15.42:0/151266716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71b6370 0x5645b71b8760 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 --2- 172.21.15.42:0/151266716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 0x5645b71aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 --2- 172.21.15.42:0/151266716 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71acb40 0x5645b71ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 -- 172.21.15.42:0/151266716 >> 172.21.15.42:0/151266716 conn(0x5645b7174310 msgr2=0x5645b71a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 -- 172.21.15.42:0/151266716 shutdown_connections 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 -- 172.21.15.42:0/151266716 wait complete. 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 -- start start 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.819+0000 7f77ce044740 1 Processor -- start 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77ce044740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 0x5645b71b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77ce044740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77ce044740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71b6370 0x5645b71b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77ce044740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5645b71b9070 con 0x5645b71acb40 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77ce044740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5645b70cc060 con 0x5645b71ab5d0 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77ce044740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5645b71b91f0 con 0x5645b71b6370 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77ce044740 10 client.0 _ll_register_callbacks cb 0x5645b6e1f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77c9206640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77c9206640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58392/0 (socket says 172.21.15.42:58392) 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77c9206640 1 -- 172.21.15.42:0/1430998317 learned_addr learned my addr 172.21.15.42:0/1430998317 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77c9a07640 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 0x5645b71b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77ca208640 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71b6370 0x5645b71b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77c9206640 1 -- 172.21.15.42:0/1430998317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71b6370 msgr2=0x5645b71b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77c9206640 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71b6370 0x5645b71b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77c9206640 1 -- 172.21.15.42:0/1430998317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 msgr2=0x5645b71b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77c9206640 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 0x5645b71b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.820+0000 7f77c9206640 1 -- 172.21.15.42:0/1430998317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b6e823c0 con 0x5645b71acb40 2024-09-19T09:39:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77c9206640 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b2f50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f77b400a940 tx=0x7f77b4011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3e65bcae1b385c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ad7fa640 1 -- 172.21.15.42:0/1430998317 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4020070 con 0x5645b71acb40 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ad7fa640 1 -- 172.21.15.42:0/1430998317 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f77b401a450 con 0x5645b71acb40 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ce044740 1 -- 172.21.15.42:0/1430998317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77b400cc00 con 0x5645b71acb40 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ad7fa640 1 -- 172.21.15.42:0/1430998317 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f77b4015040 con 0x5645b71acb40 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ce044740 10 client.15582 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ce044740 1 -- 172.21.15.42:0/1430998317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5645b71c4a90 con 0x5645b71acb40 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ad7fa640 1 -- 172.21.15.42:0/1430998317 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b400cc00 con 0x5645b71acb40 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ad7fa640 1 -- 172.21.15.42:0/1430998317 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f77b402e690 con 0x5645b71acb40 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ce044740 10 client.15582 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ce044740 10 client.15582 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ce044740 20 client.15582 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.821+0000 7f77ce044740 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5645b71c5de0 0x5645b71c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.822+0000 7f77ce044740 4 client.15582 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.822+0000 7f77ce044740 1 -- 172.21.15.42:0/1430998317 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645b711e860 con 0x5645b71c5de0 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.822+0000 7f77c9a07640 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5645b71c5de0 0x5645b71c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.822+0000 7f77ad7fa640 10 client.15582 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.822+0000 7f77c9a07640 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5645b71c5de0 0x5645b71c81d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fa85f9fff9ac171c server_cookie=566670b9e54d22fd in_seq=0 out_seq=0 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ad7fa640 1 -- 172.21.15.42:0/1430998317 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5645b711e860 con 0x5645b71c5de0 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ad7fa640 10 client.15582 handle_command_reply: tid=0 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 client.15582 shutdown 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 -- 172.21.15.42:0/1430998317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 msgr2=0x5645b71b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b2f50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f77b400a940 tx=0x7f77b4011b60 comp rx=0 tx=0).stop 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 -- 172.21.15.42:0/1430998317 shutdown_connections 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5645b71c5de0 0x5645b71c81d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71b6370 0x5645b71b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b2f50 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 --2- 172.21.15.42:0/1430998317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 0x5645b71b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ad7fa640 0 client.15582 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 -- 172.21.15.42:0/1430998317 >> 172.21.15.42:0/1430998317 conn(0x5645b7174310 msgr2=0x5645b71ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 -- 172.21.15.42:0/1430998317 shutdown_connections 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 1 -- 172.21.15.42:0/1430998317 wait complete. 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.823+0000 7f77ce044740 20 client.15582 trim_cache size 0 max 16384 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77ce044740 1 Processor -- start 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77ce044740 1 -- start start 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77ce044740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b7174310 0x5645b71c2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77ce044740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 0x5645b71b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77ce044740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71acb40 0x5645b71cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77ce044740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77c41af9b0 con 0x5645b7174310 2024-09-19T09:39:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77ce044740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f77c41b14f0 con 0x5645b71ab5d0 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77ce044740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f77c41b0080 con 0x5645b71acb40 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77c9a07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b7174310 0x5645b71c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77c9a07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b7174310 0x5645b71c2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58400/0 (socket says 172.21.15.42:58400) 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77c9a07640 1 -- 172.21.15.42:0/1238856254 learned_addr learned my addr 172.21.15.42:0/1238856254 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77ca208640 1 --2- 172.21.15.42:0/1238856254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71acb40 0x5645b71cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77c9206640 1 --2- 172.21.15.42:0/1238856254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 0x5645b71b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77c9a07640 1 -- 172.21.15.42:0/1238856254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71acb40 msgr2=0x5645b71cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77c9a07640 1 --2- 172.21.15.42:0/1238856254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71acb40 0x5645b71cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77c9a07640 1 -- 172.21.15.42:0/1238856254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 msgr2=0x5645b71b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77c9a07640 1 --2- 172.21.15.42:0/1238856254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 0x5645b71b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77c9a07640 1 -- 172.21.15.42:0/1238856254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b71ab3d0 con 0x5645b7174310 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.837+0000 7f77c9206640 1 --2- 172.21.15.42:0/1238856254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 0x5645b71b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77c9a07640 1 --2- 172.21.15.42:0/1238856254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b7174310 0x5645b71c2340 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f77c00edae0 tx=0x7f77c00f3d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8fbc750efe627b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77af7fe640 1 -- 172.21.15.42:0/1238856254 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c0049040 con 0x5645b7174310 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77af7fe640 1 -- 172.21.15.42:0/1238856254 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77c00bccc0 con 0x5645b7174310 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77af7fe640 1 -- 172.21.15.42:0/1238856254 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c00edd00 con 0x5645b7174310 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77ce044740 1 -- 172.21.15.42:0/1238856254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b7174310 msgr2=0x5645b71c2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77ce044740 1 --2- 172.21.15.42:0/1238856254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b7174310 0x5645b71c2340 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f77c00edae0 tx=0x7f77c00f3d50 comp rx=0 tx=0).stop 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77ce044740 1 -- 172.21.15.42:0/1238856254 shutdown_connections 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77ce044740 1 --2- 172.21.15.42:0/1238856254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71acb40 0x5645b71cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77ce044740 1 --2- 172.21.15.42:0/1238856254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b71ab5d0 0x5645b71b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77ce044740 1 --2- 172.21.15.42:0/1238856254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b7174310 0x5645b71c2340 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.838+0000 7f77ce044740 1 -- 172.21.15.42:0/1238856254 >> 172.21.15.42:0/1238856254 conn(0x5645b71b35f0 msgr2=0x5645b71b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 1 -- 172.21.15.42:0/1238856254 shutdown_connections 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 1 -- 172.21.15.42:0/1238856254 wait complete. 2024-09-19T09:39:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 1 -- start start 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 1 Processor -- start 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b7174310 0x5645b71b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 0x5645b71b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77c41b0e20 con 0x5645b71acb40 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f77c41b0750 con 0x5645b7174310 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f77c41ad990 con 0x5645b71ab5d0 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.839+0000 7f77ce044740 10 client.0 _ll_register_callbacks cb 0x7f77bc009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ca208640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ca208640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58402/0 (socket says 172.21.15.42:58402) 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ca208640 1 -- 172.21.15.42:0/2483680858 learned_addr learned my addr 172.21.15.42:0/2483680858 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77c9a07640 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b7174310 0x5645b71b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77c9206640 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 0x5645b71b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ca208640 1 -- 172.21.15.42:0/2483680858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 msgr2=0x5645b71b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ca208640 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 0x5645b71b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ca208640 1 -- 172.21.15.42:0/2483680858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b7174310 msgr2=0x5645b71b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ca208640 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b7174310 0x5645b71b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ca208640 1 -- 172.21.15.42:0/2483680858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b722f960 con 0x5645b71acb40 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77c9206640 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 0x5645b71b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ca208640 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b0ae0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f77bc016e60 tx=0x7f77bc004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299e89a7a8452ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ad7fa640 1 -- 172.21.15.42:0/2483680858 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc023450 con 0x5645b71acb40 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ad7fa640 1 -- 172.21.15.42:0/2483680858 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f77bc0235f0 con 0x5645b71acb40 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.840+0000 7f77ce044740 1 -- 172.21.15.42:0/2483680858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77c00bccc0 con 0x5645b71acb40 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ad7fa640 1 -- 172.21.15.42:0/2483680858 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f77bc0237f0 con 0x5645b71acb40 2024-09-19T09:39:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ce044740 10 client.15588 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ce044740 1 -- 172.21.15.42:0/2483680858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5645b7230c10 con 0x5645b71acb40 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ad7fa640 1 -- 172.21.15.42:0/2483680858 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77c00bccc0 con 0x5645b71acb40 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ad7fa640 1 -- 172.21.15.42:0/2483680858 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f77bc02c930 con 0x5645b71acb40 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ce044740 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ce044740 10 client.15588 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ce044740 20 client.15588 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ce044740 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5645b71b6370 0x5645b7233420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ce044740 4 client.15588 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77ce044740 1 -- 172.21.15.42:0/2483680858 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5645b7118d70 con 0x5645b71b6370 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.841+0000 7f77c9a07640 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5645b71b6370 0x5645b7233420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77c9a07640 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5645b71b6370 0x5645b7233420 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c05decc02b50054f server_cookie=6840af07bc4521d9 in_seq=0 out_seq=0 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ad7fa640 10 client.15588 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ad7fa640 1 -- 172.21.15.42:0/2483680858 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5645b7118d70 con 0x5645b71b6370 2024-09-19T09:39:46.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ad7fa640 10 client.15588 handle_command_reply: tid=0 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ce044740 1 client.15588 shutdown 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ce044740 1 -- 172.21.15.42:0/2483680858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 msgr2=0x5645b71b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ce044740 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b0ae0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f77bc016e60 tx=0x7f77bc004b50 comp rx=0 tx=0).stop 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ce044740 1 -- 172.21.15.42:0/2483680858 shutdown_connections 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ce044740 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x5645b71b6370 0x5645b7233420 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ce044740 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645b71acb40 0x5645b71b0ae0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ce044740 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5645b71ab5d0 0x5645b71b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ce044740 1 --2- 172.21.15.42:0/2483680858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5645b7174310 0x5645b71b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ad7fa640 0 client.15588 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.842+0000 7f77ce044740 1 -- 172.21.15.42:0/2483680858 >> 172.21.15.42:0/2483680858 conn(0x5645b71b35f0 msgr2=0x5645b71a6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77ce044740 1 -- 172.21.15.42:0/2483680858 shutdown_connections 2024-09-19T09:39:46.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77ce044740 1 -- 172.21.15.42:0/2483680858 wait complete. 2024-09-19T09:39:46.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77ce044740 20 client.15588 trim_cache size 0 max 16384 2024-09-19T09:39:46.861 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:39:46.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77cbc6b640 1 -- 172.21.15.42:0/3233959480 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77b00a3350 msgr2=0x7f77b00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77cbc6b640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77b00a3350 0x7f77b00a5810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00a510 tx=0x7f77bc00d040 comp rx=0 tx=0).stop 2024-09-19T09:39:46.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77cbc6b640 1 -- 172.21.15.42:0/3233959480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4102d30 msgr2=0x7f77c41a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:46.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77cbc6b640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4102d30 0x7f77c41a0680 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009a50 tx=0x7f77c0004270 comp rx=0 tx=0).stop 2024-09-19T09:39:46.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77cbc6b640 1 -- 172.21.15.42:0/3233959480 shutdown_connections 2024-09-19T09:39:46.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77cbc6b640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77b00a3350 0x7f77b00a5810 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77cbc6b640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77c41082a0 0x7f77c419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77cbc6b640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77c41036e0 0x7f77c41a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77cbc6b640 1 --2- 172.21.15.42:0/3233959480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77c4102d30 0x7f77c41a0680 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:46.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.843+0000 7f77cbc6b640 1 -- 172.21.15.42:0/3233959480 >> 172.21.15.42:0/3233959480 conn(0x7f77c40fc7d0 msgr2=0x7f77c4100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:46.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.844+0000 7f77cbc6b640 1 -- 172.21.15.42:0/3233959480 shutdown_connections 2024-09-19T09:39:46.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:46.844+0000 7f77cbc6b640 1 -- 172.21.15.42:0/3233959480 wait complete. 2024-09-19T09:39:46.863 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:46 smithi171 ceph-mon[35803]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:39:46.863 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:46 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/109425796' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:46.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:46 smithi136 ceph-mon[34840]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:39:46.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:46 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/109425796' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:48.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:48 smithi171 ceph-mon[35803]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T09:39:48.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:48 smithi136 ceph-mon[34840]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T09:39:48.895 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:48 smithi042 ceph-mon[31223]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T09:39:50.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:50 smithi171 ceph-mon[35803]: pgmap v352: 97 pgs: 97 active+clean; 663 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:39:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:50 smithi136 ceph-mon[34840]: pgmap v352: 97 pgs: 97 active+clean; 663 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:39:50.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:50 smithi042 ceph-mon[31223]: pgmap v352: 97 pgs: 97 active+clean; 663 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:39:51.939 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:39:52.375 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T09:39:52.376 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T09:39:52.422 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:52.582 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:52 smithi042 ceph-mon[31223]: pgmap v353: 97 pgs: 97 active+clean; 663 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:39:52.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:52 smithi171 ceph-mon[35803]: pgmap v353: 97 pgs: 97 active+clean; 663 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:39:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:52 smithi136 ceph-mon[34840]: pgmap v353: 97 pgs: 97 active+clean; 663 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:39:52.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.952+0000 7f1611267640 1 -- 172.21.15.42:0/2683253693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f160c100aa0 msgr2=0x7f160c10ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:52.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.952+0000 7f1611267640 1 --2- 172.21.15.42:0/2683253693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f160c100aa0 0x7f160c10ea20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1604009ca0 tx=0x7f160402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.952+0000 7f1611267640 1 -- 172.21.15.42:0/2683253693 shutdown_connections 2024-09-19T09:39:52.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.952+0000 7f1611267640 1 --2- 172.21.15.42:0/2683253693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f160c100aa0 0x7f160c10ea20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.952+0000 7f1611267640 1 --2- 172.21.15.42:0/2683253693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f160c100100 0x7f160c100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.952+0000 7f1611267640 1 --2- 172.21.15.42:0/2683253693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c106b80 0x7f160c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.952+0000 7f1611267640 1 -- 172.21.15.42:0/2683253693 >> 172.21.15.42:0/2683253693 conn(0x7f160c077230 msgr2=0x7f160c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:52.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.952+0000 7f1611267640 1 -- 172.21.15.42:0/2683253693 shutdown_connections 2024-09-19T09:39:52.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.952+0000 7f1611267640 1 -- 172.21.15.42:0/2683253693 wait complete. 2024-09-19T09:39:52.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.953+0000 7f1611267640 1 Processor -- start 2024-09-19T09:39:52.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.953+0000 7f1611267640 1 -- start start 2024-09-19T09:39:52.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f1611267640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f160c100100 0x7f160c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f1611267640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c100aa0 0x7f160c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f1611267640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f160c106b80 0x7f160c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f1611267640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f160c112050 con 0x7f160c100100 2024-09-19T09:39:52.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f1611267640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f160c111ed0 con 0x7f160c100aa0 2024-09-19T09:39:52.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f1611267640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1121d0 con 0x7f160c106b80 2024-09-19T09:39:52.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f160c106b80 0x7f160c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f160c106b80 0x7f160c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:36072/0 (socket says 172.21.15.42:36072) 2024-09-19T09:39:52.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f160b7fe640 1 -- 172.21.15.42:0/398219060 learned_addr learned my addr 172.21.15.42:0/398219060 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:52.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f160a7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c100aa0 0x7f160c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f160affd640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f160c100100 0x7f160c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f160a7fc640 1 -- 172.21.15.42:0/398219060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f160c106b80 msgr2=0x7f160c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.954+0000 7f160a7fc640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f160c106b80 0x7f160c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.955+0000 7f160a7fc640 1 -- 172.21.15.42:0/398219060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f160c100100 msgr2=0x7f160c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.955+0000 7f160a7fc640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f160c100100 0x7f160c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.955+0000 7f160a7fc640 1 -- 172.21.15.42:0/398219060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c19d410 con 0x7f160c100aa0 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.955+0000 7f160b7fe640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f160c106b80 0x7f160c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.955+0000 7f160a7fc640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c100aa0 0x7f160c1989a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f16000099c0 tx=0x7f1600009e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.955+0000 7f15f3fff640 1 -- 172.21.15.42:0/398219060 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16000078c0 con 0x7f160c100aa0 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.955+0000 7f15f3fff640 1 -- 172.21.15.42:0/398219060 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1600005020 con 0x7f160c100aa0 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.955+0000 7f1611267640 1 -- 172.21.15.42:0/398219060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c19d700 con 0x7f160c100aa0 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.955+0000 7f15f3fff640 1 -- 172.21.15.42:0/398219060 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600004d90 con 0x7f160c100aa0 2024-09-19T09:39:52.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.955+0000 7f1611267640 1 -- 172.21.15.42:0/398219060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c101210 con 0x7f160c100aa0 2024-09-19T09:39:52.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.959+0000 7f15f3fff640 1 -- 172.21.15.42:0/398219060 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f16000051d0 con 0x7f160c100aa0 2024-09-19T09:39:52.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.959+0000 7f1613640740 1 Processor -- start 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.959+0000 7f1613640740 1 -- start start 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.959+0000 7f1613640740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.959+0000 7f1613640740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.959+0000 7f1613640740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7e7370 0x56264c7e9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.959+0000 7f1613640740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56264c7422f0 con 0x56264c7ddb40 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.959+0000 7f1613640740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56264c6e9cf0 con 0x56264c7e7370 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.959+0000 7f1613640740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56264c73e2b0 con 0x56264c7dc5d0 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7dc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52258/0 (socket says 172.21.15.42:52258) 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160b7fe640 1 -- 172.21.15.42:0/2386111541 learned_addr learned my addr 172.21.15.42:0/2386111541 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160a7fc640 1 --2- 172.21.15.42:0/2386111541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7e7370 0x56264c7e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160affd640 1 --2- 172.21.15.42:0/2386111541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160a7fc640 1 -- 172.21.15.42:0/2386111541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 msgr2=0x56264c7dca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160a7fc640 1 --2- 172.21.15.42:0/2386111541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7dca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160a7fc640 1 -- 172.21.15.42:0/2386111541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 msgr2=0x56264c7dc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160a7fc640 1 --2- 172.21.15.42:0/2386111541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7dc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160a7fc640 1 -- 172.21.15.42:0/2386111541 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56264c6ce3a0 con 0x56264c7e7370 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.960+0000 7f160b7fe640 1 --2- 172.21.15.42:0/2386111541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7dc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.961+0000 7f160a7fc640 1 --2- 172.21.15.42:0/2386111541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7e7370 0x56264c7e9760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16000d0860 tx=0x7f16000db5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e720aee588f5be0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.961+0000 7f15f3fff640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f40a3350 0x7f15f40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.961+0000 7f15f17fa640 1 -- 172.21.15.42:0/2386111541 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16000e6070 con 0x56264c7e7370 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.961+0000 7f15f17fa640 1 -- 172.21.15.42:0/2386111541 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f160009f420 con 0x56264c7e7370 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.961+0000 7f15f17fa640 1 -- 172.21.15.42:0/2386111541 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160009ed80 con 0x56264c7e7370 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.961+0000 7f15f3fff640 1 -- 172.21.15.42:0/398219060 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f16000d2ed0 con 0x7f160c100aa0 2024-09-19T09:39:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.961+0000 7f160b7fe640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f40a3350 0x7f15f40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.962+0000 7f1613640740 1 -- 172.21.15.42:0/2386111541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7e7370 msgr2=0x56264c7e9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.962+0000 7f1613640740 1 --2- 172.21.15.42:0/2386111541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7e7370 0x56264c7e9760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16000d0860 tx=0x7f16000db5f0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.962+0000 7f160b7fe640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f40a3350 0x7f15f40a5810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1604009430 tx=0x7f1604004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.962+0000 7f1613640740 1 -- 172.21.15.42:0/2386111541 shutdown_connections 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.962+0000 7f1613640740 1 --2- 172.21.15.42:0/2386111541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7e7370 0x56264c7e9760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.962+0000 7f1613640740 1 --2- 172.21.15.42:0/2386111541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7dca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.962+0000 7f1613640740 1 --2- 172.21.15.42:0/2386111541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7dc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.962+0000 7f1613640740 1 -- 172.21.15.42:0/2386111541 >> 172.21.15.42:0/2386111541 conn(0x56264c7a5310 msgr2=0x56264c7d8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.962+0000 7f1613640740 1 -- 172.21.15.42:0/2386111541 shutdown_connections 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.963+0000 7f1613640740 1 -- 172.21.15.42:0/2386111541 wait complete. 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.963+0000 7f1613640740 1 -- start start 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.963+0000 7f1613640740 1 Processor -- start 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.963+0000 7f1613640740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7dc5d0 0x56264c7e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f1613640740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7e4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f1613640740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7e7370 0x56264c7e4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f1613640740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56264c7ea070 con 0x56264c7ddb40 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f1613640740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56264c6fd060 con 0x56264c7dc5d0 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f1613640740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56264c7ea1f0 con 0x56264c7e7370 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f1613640740 10 client.0 _ll_register_callbacks cb 0x56264c4508c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f160a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f160a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7e4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52272/0 (socket says 172.21.15.42:52272) 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f160a7fc640 1 -- 172.21.15.42:0/3095286267 learned_addr learned my addr 172.21.15.42:0/3095286267 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f160b7fe640 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7e7370 0x56264c7e4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f160affd640 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7dc5d0 0x56264c7e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f160a7fc640 1 -- 172.21.15.42:0/3095286267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7e7370 msgr2=0x56264c7e4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f160a7fc640 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7e7370 0x56264c7e4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f160a7fc640 1 -- 172.21.15.42:0/3095286267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7dc5d0 msgr2=0x56264c7e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f160a7fc640 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7dc5d0 0x56264c7e6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.964+0000 7f160a7fc640 1 -- 172.21.15.42:0/3095286267 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56264c4b33c0 con 0x56264c7ddb40 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.965+0000 7f160a7fc640 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7e4010 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f16000a7ab0 tx=0x7f1600007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69a4c6b9db7d1a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.965+0000 7f15eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.965+0000 7f15eeff5640 1 -- 172.21.15.42:0/3095286267 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160001b880 con 0x56264c7ddb40 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.965+0000 7f15eeff5640 1 -- 172.21.15.42:0/3095286267 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f160009d720 con 0x56264c7ddb40 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.965+0000 7f1613640740 1 -- 172.21.15.42:0/3095286267 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f160009f420 con 0x56264c7ddb40 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.965+0000 7f15eeff5640 1 -- 172.21.15.42:0/3095286267 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f160001ba60 con 0x56264c7ddb40 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.965+0000 7f1613640740 10 client.15600 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.965+0000 7f1613640740 1 -- 172.21.15.42:0/3095286267 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56264c7ea070 con 0x56264c7ddb40 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.966+0000 7f15eeff5640 1 -- 172.21.15.42:0/3095286267 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f160009f420 con 0x56264c7ddb40 2024-09-19T09:39:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.966+0000 7f15eeff5640 1 -- 172.21.15.42:0/3095286267 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f160009f680 con 0x56264c7ddb40 2024-09-19T09:39:52.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.966+0000 7f1613640740 10 client.15600 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:52.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.966+0000 7f1613640740 10 client.15600 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:39:52.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.966+0000 7f1613640740 20 client.15600 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.966+0000 7f1613640740 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56264c7ff4d0 0x56264c8018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.966+0000 7f1613640740 4 client.15600 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.966+0000 7f1613640740 1 -- 172.21.15.42:0/3095286267 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56264c74f860 con 0x56264c7ff4d0 2024-09-19T09:39:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.967+0000 7f160affd640 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56264c7ff4d0 0x56264c8018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.967+0000 7f160affd640 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56264c7ff4d0 0x56264c8018c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8320f825c6853d63 server_cookie=46ad14f0ffc0afc2 in_seq=0 out_seq=0 2024-09-19T09:39:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.967+0000 7f15eeff5640 10 client.15600 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:39:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.968+0000 7f15eeff5640 1 -- 172.21.15.42:0/3095286267 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56264c74f860 con 0x56264c7ff4d0 2024-09-19T09:39:52.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.968+0000 7f15eeff5640 10 client.15600 handle_command_reply: tid=0 2024-09-19T09:39:52.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.968+0000 7f1613640740 1 client.15600 shutdown 2024-09-19T09:39:52.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.968+0000 7f1613640740 1 -- 172.21.15.42:0/3095286267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 msgr2=0x56264c7e4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:52.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.968+0000 7f1613640740 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7e4010 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f16000a7ab0 tx=0x7f1600007740 comp rx=0 tx=0).stop 2024-09-19T09:39:52.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.969+0000 7f1613640740 1 -- 172.21.15.42:0/3095286267 shutdown_connections 2024-09-19T09:39:52.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.969+0000 7f1613640740 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56264c7ff4d0 0x56264c8018c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.969+0000 7f15eeff5640 0 client.15600 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:39:52.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.969+0000 7f1613640740 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7e7370 0x56264c7e4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.969+0000 7f1613640740 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7ddb40 0x56264c7e4010 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.969+0000 7f1613640740 1 --2- 172.21.15.42:0/3095286267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7dc5d0 0x56264c7e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.969+0000 7f1613640740 1 -- 172.21.15.42:0/3095286267 >> 172.21.15.42:0/3095286267 conn(0x56264c7a5310 msgr2=0x56264c7de930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:52.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.969+0000 7f1613640740 1 -- 172.21.15.42:0/3095286267 shutdown_connections 2024-09-19T09:39:52.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.969+0000 7f1613640740 1 -- 172.21.15.42:0/3095286267 wait complete. 2024-09-19T09:39:52.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.969+0000 7f1613640740 20 client.15600 trim_cache size 0 max 16384 2024-09-19T09:39:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.994+0000 7f1613640740 1 Processor -- start 2024-09-19T09:39:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.994+0000 7f1613640740 1 -- start start 2024-09-19T09:39:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.995+0000 7f1613640740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7fbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.995+0000 7f1613640740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 0x56264c7df120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.995+0000 7f1613640740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7df660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:52.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.995+0000 7f160affd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7fbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.995+0000 7f160affd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7fbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:36084/0 (socket says 172.21.15.42:36084) 2024-09-19T09:39:52.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f160a7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 0x56264c7df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f160a7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 0x56264c7df120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:53932/0 (socket says 172.21.15.42:53932) 2024-09-19T09:39:52.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7df660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f1613640740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1ab430 con 0x56264c7e7370 2024-09-19T09:39:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f1613640740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1acf70 con 0x56264c7ddb40 2024-09-19T09:39:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7df660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52282/0 (socket says 172.21.15.42:52282) 2024-09-19T09:39:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f1613640740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1abb00 con 0x56264c7dc5d0 2024-09-19T09:39:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f160b7fe640 1 -- 172.21.15.42:0/2088882017 learned_addr learned my addr 172.21.15.42:0/2088882017 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f160affd640 1 -- 172.21.15.42:0/2088882017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 msgr2=0x56264c7df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f160affd640 1 --2- 172.21.15.42:0/2088882017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 0x56264c7df120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f160affd640 1 -- 172.21.15.42:0/2088882017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 msgr2=0x56264c7df660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f160affd640 1 --2- 172.21.15.42:0/2088882017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7df660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.996+0000 7f160affd640 1 -- 172.21.15.42:0/2088882017 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56264c7e70d0 con 0x56264c7dc5d0 2024-09-19T09:39:53.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.997+0000 7f160b7fe640 1 --2- 172.21.15.42:0/2088882017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7df660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:53.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.997+0000 7f160affd640 1 --2- 172.21.15.42:0/2088882017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7fbbd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1600000c00 tx=0x7f15fc00bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f2173a19dd7b46a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:53.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.997+0000 7f15f0ff9640 1 -- 172.21.15.42:0/2088882017 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc003ea0 con 0x56264c7dc5d0 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.997+0000 7f15f0ff9640 1 -- 172.21.15.42:0/2088882017 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15fc01d950 con 0x56264c7dc5d0 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.997+0000 7f15f0ff9640 1 -- 172.21.15.42:0/2088882017 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc011b90 con 0x56264c7dc5d0 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.998+0000 7f1613640740 1 -- 172.21.15.42:0/2088882017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 msgr2=0x56264c7fbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.998+0000 7f1613640740 1 --2- 172.21.15.42:0/2088882017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7fbbd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1600000c00 tx=0x7f15fc00bf20 comp rx=0 tx=0).stop 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.998+0000 7f1613640740 1 -- 172.21.15.42:0/2088882017 shutdown_connections 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.998+0000 7f1613640740 1 --2- 172.21.15.42:0/2088882017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7df660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.998+0000 7f1613640740 1 --2- 172.21.15.42:0/2088882017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 0x56264c7df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.998+0000 7f1613640740 1 --2- 172.21.15.42:0/2088882017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7fbbd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.998+0000 7f1613640740 1 -- 172.21.15.42:0/2088882017 >> 172.21.15.42:0/2088882017 conn(0x56264c7a5310 msgr2=0x56264c7e3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.998+0000 7f1613640740 1 -- 172.21.15.42:0/2088882017 shutdown_connections 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.998+0000 7f1613640740 1 -- 172.21.15.42:0/2088882017 wait complete. 2024-09-19T09:39:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.999+0000 7f1613640740 1 -- start start 2024-09-19T09:39:53.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.999+0000 7f1613640740 1 Processor -- start 2024-09-19T09:39:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.999+0000 7f1613640740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.999+0000 7f1613640740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 0x56264c7f8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:52.999+0000 7f1613640740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7f3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f1613640740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1ac8a0 con 0x56264c7e7370 2024-09-19T09:39:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f1613640740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1ac1d0 con 0x56264c7ddb40 2024-09-19T09:39:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f1613640740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1a9430 con 0x56264c7dc5d0 2024-09-19T09:39:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f1613640740 10 client.0 _ll_register_callbacks cb 0x7f16000e4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:53.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7f3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52296/0 (socket says 172.21.15.42:52296) 2024-09-19T09:39:53.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160b7fe640 1 -- 172.21.15.42:0/4233732297 learned_addr learned my addr 172.21.15.42:0/4233732297 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:53.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160affd640 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160a7fc640 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 0x56264c7f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160b7fe640 1 -- 172.21.15.42:0/4233732297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 msgr2=0x56264c7f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160b7fe640 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160b7fe640 1 -- 172.21.15.42:0/4233732297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 msgr2=0x56264c7f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160b7fe640 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 0x56264c7f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160b7fe640 1 -- 172.21.15.42:0/4233732297 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56264c7f3e80 con 0x56264c7e7370 2024-09-19T09:39:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.000+0000 7f160b7fe640 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7f3650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1604031a00 tx=0x7f16040095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e009798f9fb3dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.001+0000 7f15eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.001+0000 7f15eeff5640 1 -- 172.21.15.42:0/4233732297 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1604058060 con 0x56264c7e7370 2024-09-19T09:39:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.001+0000 7f15eeff5640 1 -- 172.21.15.42:0/4233732297 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f160402fda0 con 0x56264c7e7370 2024-09-19T09:39:53.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.001+0000 7f1613640740 1 -- 172.21.15.42:0/4233732297 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15fc01d950 con 0x56264c7e7370 2024-09-19T09:39:53.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.001+0000 7f15eeff5640 1 -- 172.21.15.42:0/4233732297 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f16040305c0 con 0x56264c7e7370 2024-09-19T09:39:53.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.002+0000 7f1613640740 10 client.15606 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:53.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.002+0000 7f1613640740 1 -- 172.21.15.42:0/4233732297 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56264c7ea4f0 con 0x56264c7e7370 2024-09-19T09:39:53.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.002+0000 7f15eeff5640 1 -- 172.21.15.42:0/4233732297 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1604036040 con 0x56264c7e7370 2024-09-19T09:39:53.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.002+0000 7f15eeff5640 1 -- 172.21.15.42:0/4233732297 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1604053890 con 0x56264c7e7370 2024-09-19T09:39:53.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.002+0000 7f1613640740 10 client.15606 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:53.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.002+0000 7f1613640740 10 client.15606 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:39:53.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.002+0000 7f1613640740 20 client.15606 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:53.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.002+0000 7f1613640740 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56264c7ff4d0 0x56264c7eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:53.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.002+0000 7f1613640740 4 client.15606 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:39:53.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.002+0000 7f1613640740 1 -- 172.21.15.42:0/4233732297 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f15fc01d950 con 0x56264c7ff4d0 2024-09-19T09:39:53.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.003+0000 7f160affd640 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56264c7ff4d0 0x56264c7eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:53.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.003+0000 7f160affd640 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56264c7ff4d0 0x56264c7eccb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55563ee04d1c6c87 server_cookie=3ad0a95946fa8000 in_seq=0 out_seq=0 2024-09-19T09:39:53.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.003+0000 7f15eeff5640 10 client.15606 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:39:53.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f15eeff5640 1 -- 172.21.15.42:0/4233732297 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f15fc01d950 con 0x56264c7ff4d0 2024-09-19T09:39:53.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f15eeff5640 10 client.15606 handle_command_reply: tid=0 2024-09-19T09:39:53.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f1613640740 1 client.15606 shutdown 2024-09-19T09:39:53.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f1613640740 1 -- 172.21.15.42:0/4233732297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 msgr2=0x56264c7f3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:53.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f1613640740 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7f3650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1604031a00 tx=0x7f16040095c0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f1613640740 1 -- 172.21.15.42:0/4233732297 shutdown_connections 2024-09-19T09:39:53.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f1613640740 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56264c7ff4d0 0x56264c7eccb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f1613640740 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56264c7e7370 0x56264c7f3650 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f1613640740 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56264c7ddb40 0x56264c7f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f1613640740 1 --2- 172.21.15.42:0/4233732297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56264c7dc5d0 0x56264c7f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.004+0000 7f1613640740 1 -- 172.21.15.42:0/4233732297 >> 172.21.15.42:0/4233732297 conn(0x56264c7a5310 msgr2=0x56264c7d74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:53.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.005+0000 7f15eeff5640 0 client.15606 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:39:53.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.005+0000 7f1613640740 1 -- 172.21.15.42:0/4233732297 shutdown_connections 2024-09-19T09:39:53.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.005+0000 7f1613640740 1 -- 172.21.15.42:0/4233732297 wait complete. 2024-09-19T09:39:53.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.005+0000 7f1613640740 20 client.15606 trim_cache size 0 max 16384 2024-09-19T09:39:53.012 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:39:53.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.006+0000 7f1611267640 1 -- 172.21.15.42:0/398219060 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f40a3350 msgr2=0x7f15f40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:53.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.006+0000 7f1611267640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f40a3350 0x7f15f40a5810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1604009430 tx=0x7f1604004a80 comp rx=0 tx=0).stop 2024-09-19T09:39:53.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.006+0000 7f1611267640 1 -- 172.21.15.42:0/398219060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c100aa0 msgr2=0x7f160c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:53.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.006+0000 7f1611267640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c100aa0 0x7f160c1989a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f16000099c0 tx=0x7f1600009e80 comp rx=0 tx=0).stop 2024-09-19T09:39:53.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.006+0000 7f1611267640 1 -- 172.21.15.42:0/398219060 shutdown_connections 2024-09-19T09:39:53.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.006+0000 7f1611267640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f15f40a3350 0x7f15f40a5810 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.006+0000 7f1611267640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f160c106b80 0x7f160c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.006+0000 7f1611267640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f160c100aa0 0x7f160c1989a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.006+0000 7f1611267640 1 --2- 172.21.15.42:0/398219060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f160c100100 0x7f160c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:53.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.006+0000 7f1611267640 1 -- 172.21.15.42:0/398219060 >> 172.21.15.42:0/398219060 conn(0x7f160c077230 msgr2=0x7f160c104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:53.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.007+0000 7f1611267640 1 -- 172.21.15.42:0/398219060 shutdown_connections 2024-09-19T09:39:53.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:53.007+0000 7f1611267640 1 -- 172.21.15.42:0/398219060 wait complete. 2024-09-19T09:39:53.015 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:53.573 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:39:54.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.024+0000 7f042dede640 1 -- 172.21.15.42:0/3678248824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428102d90 msgr2=0x7f0428103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.024+0000 7f042dede640 1 --2- 172.21.15.42:0/3678248824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428102d90 0x7f0428103170 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0418009930 tx=0x7f041802a420 comp rx=0 tx=0).stop 2024-09-19T09:39:54.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.024+0000 7f042dede640 1 -- 172.21.15.42:0/3678248824 shutdown_connections 2024-09-19T09:39:54.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.024+0000 7f042dede640 1 --2- 172.21.15.42:0/3678248824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0428108290 0x7f042810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.024+0000 7f042dede640 1 --2- 172.21.15.42:0/3678248824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0428103740 0x7f0428107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.024+0000 7f042dede640 1 --2- 172.21.15.42:0/3678248824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428102d90 0x7f0428103170 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.024+0000 7f042dede640 1 -- 172.21.15.42:0/3678248824 >> 172.21.15.42:0/3678248824 conn(0x7f04280fc7d0 msgr2=0x7f04280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.025+0000 7f042dede640 1 -- 172.21.15.42:0/3678248824 shutdown_connections 2024-09-19T09:39:54.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.025+0000 7f042dede640 1 -- 172.21.15.42:0/3678248824 wait complete. 2024-09-19T09:39:54.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.025+0000 7f042dede640 1 Processor -- start 2024-09-19T09:39:54.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f042dede640 1 -- start start 2024-09-19T09:39:54.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f042dede640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428102d90 0x7f0428198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f042dede640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0428103740 0x7f0428198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f042dede640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0428108290 0x7f042819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f042dede640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0428112090 con 0x7f0428102d90 2024-09-19T09:39:54.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f042dede640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0428111f10 con 0x7f0428103740 2024-09-19T09:39:54.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f042dede640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0428112210 con 0x7f0428108290 2024-09-19T09:39:54.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f04277fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428102d90 0x7f0428198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f04277fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428102d90 0x7f0428198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52304/0 (socket says 172.21.15.42:52304) 2024-09-19T09:39:54.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f04277fe640 1 -- 172.21.15.42:0/1609755421 learned_addr learned my addr 172.21.15.42:0/1609755421 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:54.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f0427fff640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0428108290 0x7f042819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.026+0000 7f0426ffd640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0428103740 0x7f0428198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.027+0000 7f04277fe640 1 -- 172.21.15.42:0/1609755421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0428108290 msgr2=0x7f042819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.027+0000 7f04277fe640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0428108290 0x7f042819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.027+0000 7f04277fe640 1 -- 172.21.15.42:0/1609755421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0428103740 msgr2=0x7f0428198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.027+0000 7f04277fe640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0428103740 0x7f0428198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.027+0000 7f04277fe640 1 -- 172.21.15.42:0/1609755421 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042819d500 con 0x7f0428102d90 2024-09-19T09:39:54.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.027+0000 7f04277fe640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428102d90 0x7f0428198550 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0418009a50 tx=0x7f0418004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.027+0000 7f0424ff9640 1 -- 172.21.15.42:0/1609755421 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418035070 con 0x7f0428102d90 2024-09-19T09:39:54.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.027+0000 7f0424ff9640 1 -- 172.21.15.42:0/1609755421 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f041803de40 con 0x7f0428102d90 2024-09-19T09:39:54.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.027+0000 7f042dede640 1 -- 172.21.15.42:0/1609755421 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f042819d790 con 0x7f0428102d90 2024-09-19T09:39:54.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.027+0000 7f042dede640 1 -- 172.21.15.42:0/1609755421 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0428100920 con 0x7f0428102d90 2024-09-19T09:39:54.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.028+0000 7f0424ff9640 1 -- 172.21.15.42:0/1609755421 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04180453d0 con 0x7f0428102d90 2024-09-19T09:39:54.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.031+0000 7f04302b7740 1 Processor -- start 2024-09-19T09:39:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.031+0000 7f04302b7740 1 -- start start 2024-09-19T09:39:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.031+0000 7f04302b7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e762a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.031+0000 7f04302b7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762fa0 0x55a40e775c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.031+0000 7f04302b7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e776150 0x55a40e778540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.031+0000 7f04302b7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a40e6c82a0 con 0x55a40e762680 2024-09-19T09:39:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.031+0000 7f04302b7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a40e66fb10 con 0x55a40e776150 2024-09-19T09:39:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.031+0000 7f04302b7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a40e6c4260 con 0x55a40e762fa0 2024-09-19T09:39:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.032+0000 7f0427fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e762a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.032+0000 7f0426ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e776150 0x55a40e778540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.032+0000 7f0427fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e762a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52318/0 (socket says 172.21.15.42:52318) 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.032+0000 7f0427fff640 1 -- 172.21.15.42:0/1116772198 learned_addr learned my addr 172.21.15.42:0/1116772198 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.032+0000 7f0427fff640 1 -- 172.21.15.42:0/1116772198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762fa0 msgr2=0x55a40e775c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.032+0000 7f0427fff640 1 --2- 172.21.15.42:0/1116772198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762fa0 0x55a40e775c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.032+0000 7f0427fff640 1 -- 172.21.15.42:0/1116772198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e776150 msgr2=0x55a40e778540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.032+0000 7f0427fff640 1 --2- 172.21.15.42:0/1116772198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e776150 0x55a40e778540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.032+0000 7f0427fff640 1 -- 172.21.15.42:0/1116772198 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a40e439b90 con 0x55a40e762680 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.032+0000 7f0424ff9640 1 -- 172.21.15.42:0/1609755421 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f0418003710 con 0x7f0428102d90 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.033+0000 7f0427fff640 1 --2- 172.21.15.42:0/1116772198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e762a60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f042000f470 tx=0x7f042000f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bd9e9c78fa4acb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.033+0000 7f040dffb640 1 -- 172.21.15.42:0/1116772198 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420003b70 con 0x55a40e762680 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.033+0000 7f040dffb640 1 -- 172.21.15.42:0/1116772198 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0420003d10 con 0x55a40e762680 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f0424ff9640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04100a34a0 0x7f04100a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f040dffb640 1 -- 172.21.15.42:0/1116772198 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420010bb0 con 0x55a40e762680 2024-09-19T09:39:54.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f0424ff9640 1 -- 172.21.15.42:0/1609755421 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f04180f02b0 con 0x7f0428102d90 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f04277fe640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04100a34a0 0x7f04100a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f04302b7740 1 -- 172.21.15.42:0/1116772198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 msgr2=0x55a40e762a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f04302b7740 1 --2- 172.21.15.42:0/1116772198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e762a60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f042000f470 tx=0x7f042000f930 comp rx=0 tx=0).stop 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f04302b7740 1 -- 172.21.15.42:0/1116772198 shutdown_connections 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f04302b7740 1 --2- 172.21.15.42:0/1116772198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e776150 0x55a40e778540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f04302b7740 1 --2- 172.21.15.42:0/1116772198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762fa0 0x55a40e775c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f04302b7740 1 --2- 172.21.15.42:0/1116772198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e762a60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f04302b7740 1 -- 172.21.15.42:0/1116772198 >> 172.21.15.42:0/1116772198 conn(0x55a40e75ecf0 msgr2=0x55a40e75f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.034+0000 7f04302b7740 1 -- 172.21.15.42:0/1116772198 shutdown_connections 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.035+0000 7f04302b7740 1 -- 172.21.15.42:0/1116772198 wait complete. 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.035+0000 7f04302b7740 1 -- start start 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.035+0000 7f04277fe640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04100a34a0 0x7f04100a5960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f04180b91d0 tx=0x7f041802a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.035+0000 7f04302b7740 1 Processor -- start 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f04302b7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762680 0x55a40e7730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f04302b7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762fa0 0x55a40e7735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f04302b7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e776150 0x55a40e773b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f04302b7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a40e778d10 con 0x55a40e762fa0 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f04302b7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a40e6506e0 con 0x55a40e776150 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f04302b7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a40e778e90 con 0x55a40e762680 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f04302b7740 10 client.0 _ll_register_callbacks cb 0x55a40e674a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f0427fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762680 0x55a40e7730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f0426ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762fa0 0x55a40e7735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f0427fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762680 0x55a40e7730b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:36128/0 (socket says 172.21.15.42:36128) 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f0427fff640 1 -- 172.21.15.42:0/178971008 learned_addr learned my addr 172.21.15.42:0/178971008 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:54.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.036+0000 7f0427fff640 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e776150 0x55a40e773b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.037+0000 7f0426ffd640 1 -- 172.21.15.42:0/178971008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762680 msgr2=0x55a40e7730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.037+0000 7f0426ffd640 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762680 0x55a40e7730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.037+0000 7f0426ffd640 1 -- 172.21.15.42:0/178971008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e776150 msgr2=0x55a40e773b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.037+0000 7f0426ffd640 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e776150 0x55a40e773b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.037+0000 7f0426ffd640 1 -- 172.21.15.42:0/178971008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a40e782310 con 0x55a40e762fa0 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.037+0000 7f0426ffd640 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762fa0 0x55a40e7735f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f04280697d0 tx=0x7f041c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39ed1b8113c7c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.037+0000 7f0406ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.037+0000 7f0406ffd640 1 -- 172.21.15.42:0/178971008 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c010840 con 0x55a40e762fa0 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.038+0000 7f04302b7740 1 -- 172.21.15.42:0/178971008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0420003d10 con 0x55a40e762fa0 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.038+0000 7f0406ffd640 1 -- 172.21.15.42:0/178971008 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f041c0109e0 con 0x55a40e762fa0 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.038+0000 7f0406ffd640 1 -- 172.21.15.42:0/178971008 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f041c010be0 con 0x55a40e762fa0 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.038+0000 7f04302b7740 10 client.15618 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.038+0000 7f04302b7740 1 -- 172.21.15.42:0/178971008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a40e765400 con 0x55a40e762fa0 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.038+0000 7f0406ffd640 1 -- 172.21.15.42:0/178971008 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f041c010d80 con 0x55a40e762fa0 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.039+0000 7f0406ffd640 1 -- 172.21.15.42:0/178971008 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f041c018020 con 0x55a40e762fa0 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.039+0000 7f04302b7740 10 client.15618 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.039+0000 7f04302b7740 10 client.15618 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.039+0000 7f04302b7740 20 client.15618 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.039+0000 7f04302b7740 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a40e766d60 0x55a40e769180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.039+0000 7f04302b7740 4 client.15618 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.039+0000 7f04302b7740 1 -- 172.21.15.42:0/178971008 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0420003d10 con 0x55a40e766d60 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.039+0000 7f0427fff640 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a40e766d60 0x55a40e769180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.040+0000 7f0406ffd640 10 client.15618 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.040+0000 7f0427fff640 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a40e766d60 0x55a40e769180 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6a15a90bbffddf9 server_cookie=194bd13d9bfd9186 in_seq=0 out_seq=0 2024-09-19T09:39:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.040+0000 7f0406ffd640 1 -- 172.21.15.42:0/178971008 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0420003d10 con 0x55a40e766d60 2024-09-19T09:39:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f0406ffd640 10 client.15618 handle_command_reply: tid=0 2024-09-19T09:39:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 client.15618 shutdown 2024-09-19T09:39:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 -- 172.21.15.42:0/178971008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762fa0 msgr2=0x55a40e7735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762fa0 0x55a40e7735f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f04280697d0 tx=0x7f041c0039c0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 -- 172.21.15.42:0/178971008 shutdown_connections 2024-09-19T09:39:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a40e766d60 0x55a40e769180 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e776150 0x55a40e773b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762fa0 0x55a40e7735f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 --2- 172.21.15.42:0/178971008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762680 0x55a40e7730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f0406ffd640 0 client.15618 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 -- 172.21.15.42:0/178971008 >> 172.21.15.42:0/178971008 conn(0x55a40e75ecf0 msgr2=0x55a40e75de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 -- 172.21.15.42:0/178971008 shutdown_connections 2024-09-19T09:39:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 1 -- 172.21.15.42:0/178971008 wait complete. 2024-09-19T09:39:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.041+0000 7f04302b7740 20 client.15618 trim_cache size 0 max 16384 2024-09-19T09:39:54.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.074+0000 7f04302b7740 1 Processor -- start 2024-09-19T09:39:54.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.074+0000 7f04302b7740 1 -- start start 2024-09-19T09:39:54.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.074+0000 7f04302b7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762680 0x55a40e76e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.074+0000 7f04302b7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762fa0 0x55a40e775020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.074+0000 7f04302b7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e776150 0x55a40e773980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f04302b7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04281ab620 con 0x55a40e776150 2024-09-19T09:39:54.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f04302b7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04281ad160 con 0x55a40e762680 2024-09-19T09:39:54.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f04302b7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04281abcf0 con 0x55a40e762fa0 2024-09-19T09:39:54.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0427fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762680 0x55a40e76e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0426ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762fa0 0x55a40e775020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0427fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762680 0x55a40e76e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:53986/0 (socket says 172.21.15.42:53986) 2024-09-19T09:39:54.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0427fff640 1 -- 172.21.15.42:0/1304288482 learned_addr learned my addr 172.21.15.42:0/1304288482 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:54.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0427fff640 1 --2- 172.21.15.42:0/1304288482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e776150 0x55a40e773980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0427fff640 1 -- 172.21.15.42:0/1304288482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762fa0 msgr2=0x55a40e775020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0427fff640 1 --2- 172.21.15.42:0/1304288482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762fa0 0x55a40e775020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0427fff640 1 -- 172.21.15.42:0/1304288482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e776150 msgr2=0x55a40e773980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0427fff640 1 --2- 172.21.15.42:0/1304288482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e776150 0x55a40e773980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0427fff640 1 -- 172.21.15.42:0/1304288482 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a40e762dd0 con 0x55a40e762680 2024-09-19T09:39:54.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.075+0000 7f0427fff640 1 --2- 172.21.15.42:0/1304288482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762680 0x55a40e76e600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0420010800 tx=0x7f042000a4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38e8d3989794f141 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.076+0000 7f040d7fa640 1 -- 172.21.15.42:0/1304288482 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420003ca0 con 0x55a40e762680 2024-09-19T09:39:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.076+0000 7f040d7fa640 1 -- 172.21.15.42:0/1304288482 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04200108c0 con 0x55a40e762680 2024-09-19T09:39:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.076+0000 7f040d7fa640 1 -- 172.21.15.42:0/1304288482 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420004200 con 0x55a40e762680 2024-09-19T09:39:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.077+0000 7f04302b7740 1 -- 172.21.15.42:0/1304288482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762680 msgr2=0x55a40e76e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.077+0000 7f04302b7740 1 --2- 172.21.15.42:0/1304288482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762680 0x55a40e76e600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0420010800 tx=0x7f042000a4d0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.077+0000 7f04302b7740 1 -- 172.21.15.42:0/1304288482 shutdown_connections 2024-09-19T09:39:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.077+0000 7f04302b7740 1 --2- 172.21.15.42:0/1304288482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e776150 0x55a40e773980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.077+0000 7f04302b7740 1 --2- 172.21.15.42:0/1304288482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e762fa0 0x55a40e775020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.077+0000 7f04302b7740 1 --2- 172.21.15.42:0/1304288482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762680 0x55a40e76e600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.077+0000 7f04302b7740 1 -- 172.21.15.42:0/1304288482 >> 172.21.15.42:0/1304288482 conn(0x55a40e75ecf0 msgr2=0x55a40e774910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.077+0000 7f04302b7740 1 -- 172.21.15.42:0/1304288482 shutdown_connections 2024-09-19T09:39:54.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.077+0000 7f04302b7740 1 -- 172.21.15.42:0/1304288482 wait complete. 2024-09-19T09:39:54.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.077+0000 7f04302b7740 1 -- start start 2024-09-19T09:39:54.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.078+0000 7f04302b7740 1 Processor -- start 2024-09-19T09:39:54.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.078+0000 7f04302b7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e787d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.078+0000 7f0427fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e787d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.079+0000 7f0427fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e787d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52354/0 (socket says 172.21.15.42:52354) 2024-09-19T09:39:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.079+0000 7f0427fff640 1 -- 172.21.15.42:0/211325897 learned_addr learned my addr 172.21.15.42:0/211325897 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.079+0000 7f04302b7740 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762fa0 0x55a40e788290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.079+0000 7f04302b7740 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e776150 0x55a40e7e7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.079+0000 7f0426ffd640 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762fa0 0x55a40e788290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.079+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04281aca90 con 0x55a40e762680 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.079+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04281ac3c0 con 0x55a40e762fa0 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.079+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04281a9600 con 0x55a40e776150 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.080+0000 7f0426ffd640 1 -- 172.21.15.42:0/211325897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e776150 msgr2=0x55a40e7e7c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.080+0000 7f0426ffd640 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e776150 0x55a40e7e7c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.080+0000 7f0426ffd640 1 -- 172.21.15.42:0/211325897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 msgr2=0x55a40e787d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.080+0000 7f0426ffd640 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e787d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.080+0000 7f0426ffd640 1 -- 172.21.15.42:0/211325897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a40e788b20 con 0x55a40e762fa0 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.080+0000 7f0427fff640 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e787d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.080+0000 7f0426ffd640 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762fa0 0x55a40e788290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f041c024640 tx=0x7f041c011fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30e973dc19c5c710 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.080+0000 7f0406ffd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.080+0000 7f04302b7740 10 client.0 _ll_register_callbacks cb 0x7f041c00c970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.080+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04200108c0 con 0x55a40e762fa0 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f0406ffd640 1 -- 172.21.15.42:0/211325897 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c024a40 con 0x55a40e762fa0 2024-09-19T09:39:54.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f0406ffd640 1 -- 172.21.15.42:0/211325897 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f041c010640 con 0x55a40e762fa0 2024-09-19T09:39:54.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f0406ffd640 1 -- 172.21.15.42:0/211325897 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f041c035070 con 0x55a40e762fa0 2024-09-19T09:39:54.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f04302b7740 10 client.25178 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a40e7e9180 con 0x55a40e762fa0 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f0406ffd640 1 -- 172.21.15.42:0/211325897 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f041c018040 con 0x55a40e762fa0 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f04302b7740 10 client.25178 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f04302b7740 10 client.25178 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f04302b7740 20 client.25178 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f04302b7740 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a40e7e9850 0x55a40e7ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f04302b7740 4 client.25178 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.081+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x55a40e6d59d0 con 0x55a40e7e9850 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.082+0000 7f0427fff640 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a40e7e9850 0x55a40e7ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.082+0000 7f0427fff640 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a40e7e9850 0x55a40e7ebce0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6641aed52bacdf7 server_cookie=78a50573d17fb387 in_seq=0 out_seq=0 2024-09-19T09:39:54.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.082+0000 7f0406ffd640 10 client.25178 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:54.088 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:54.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.090+0000 7f0406ffd640 1 -- 172.21.15.42:0/211325897 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a40e6d59d0 con 0x55a40e7e9850 2024-09-19T09:39:54.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.090+0000 7f0406ffd640 10 client.25178 handle_command_reply: tid=0 2024-09-19T09:39:54.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.090+0000 7f04302b7740 1 client.25178 shutdown 2024-09-19T09:39:54.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.090+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762fa0 msgr2=0x55a40e788290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.090+0000 7f04302b7740 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762fa0 0x55a40e788290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f041c024640 tx=0x7f041c011fc0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.090+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 shutdown_connections 2024-09-19T09:39:54.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.090+0000 7f04302b7740 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a40e7e9850 0x55a40e7ebce0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.091+0000 7f04302b7740 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a40e776150 0x55a40e7e7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.091+0000 7f0406ffd640 0 client.25178 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:54.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.091+0000 7f04302b7740 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a40e762fa0 0x55a40e788290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.091+0000 7f04302b7740 1 --2- 172.21.15.42:0/211325897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a40e762680 0x55a40e787d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.091+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 >> 172.21.15.42:0/211325897 conn(0x55a40e75ecf0 msgr2=0x55a40e775130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.091+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 shutdown_connections 2024-09-19T09:39:54.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.091+0000 7f04302b7740 1 -- 172.21.15.42:0/211325897 wait complete. 2024-09-19T09:39:54.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.091+0000 7f04302b7740 20 client.25178 trim_cache size 0 max 16384 2024-09-19T09:39:54.096 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:39:54.096 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 28, 2024-09-19T09:39:54.096 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 24506, 2024-09-19T09:39:54.096 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 2, 2024-09-19T09:39:54.096 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-09-19T09:39:54.097 INFO:teuthology.orchestra.run.smithi042.stdout: "3e10ce17": { 2024-09-19T09:39:54.097 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 2, 2024-09-19T09:39:54.097 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-09-19T09:39:54.097 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:39:54.097 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-09-19T09:39:54.097 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:39:54.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:39:54.097 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-09-19T09:39:54.098 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 131.2, 2024-09-19T09:39:54.098 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-09-19T09:39:54.098 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-09-19T09:39:54.098 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-09-19T09:39:54.098 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:39:54.098 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-09-19T09:39:54.098 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:39:54.099 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:54.099 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:54.099 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:54.099 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:54.099 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:54.099 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.092+0000 7f042dede640 1 -- 172.21.15.42:0/1609755421 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04100a34a0 msgr2=0x7f04100a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.092+0000 7f042dede640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04100a34a0 0x7f04100a5960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f04180b91d0 tx=0x7f041802a420 comp rx=0 tx=0).stop 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.093+0000 7f042dede640 1 -- 172.21.15.42:0/1609755421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428102d90 msgr2=0x7f0428198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.093+0000 7f042dede640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428102d90 0x7f0428198550 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0418009a50 tx=0x7f0418004270 comp rx=0 tx=0).stop 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.093+0000 7f042dede640 1 -- 172.21.15.42:0/1609755421 shutdown_connections 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.093+0000 7f042dede640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04100a34a0 0x7f04100a5960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.093+0000 7f042dede640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0428108290 0x7f042819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.093+0000 7f042dede640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0428103740 0x7f0428198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.093+0000 7f042dede640 1 --2- 172.21.15.42:0/1609755421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0428102d90 0x7f0428198550 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.093+0000 7f042dede640 1 -- 172.21.15.42:0/1609755421 >> 172.21.15.42:0/1609755421 conn(0x7f04280fc7d0 msgr2=0x7f0428105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.094+0000 7f042dede640 1 -- 172.21.15.42:0/1609755421 shutdown_connections 2024-09-19T09:39:54.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:54.094+0000 7f042dede640 1 -- 172.21.15.42:0/1609755421 wait complete. 2024-09-19T09:39:54.693 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3e10ce17', quiesce took 10.0 seconds. Will release after: 1.1999999999999993 2024-09-19T09:39:54.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:54 smithi171 ceph-mon[35803]: pgmap v354: 97 pgs: 97 active+clean; 663 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:39:54.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:54 smithi042 ceph-mon[31223]: pgmap v354: 97 pgs: 97 active+clean; 663 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:39:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:54 smithi136 ceph-mon[34840]: pgmap v354: 97 pgs: 97 active+clean; 663 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:39:55.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.258+0000 7f26b0313640 1 -- 172.21.15.42:0/3428253052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a81082a0 msgr2=0x7f26a810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:55.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.258+0000 7f26b0313640 1 --2- 172.21.15.42:0/3428253052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a81082a0 0x7f26a810ec40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009cd0 tx=0x7f26a002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.259+0000 7f26b0313640 1 -- 172.21.15.42:0/3428253052 shutdown_connections 2024-09-19T09:39:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.259+0000 7f26b0313640 1 --2- 172.21.15.42:0/3428253052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a81082a0 0x7f26a810ec40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.259+0000 7f26b0313640 1 --2- 172.21.15.42:0/3428253052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26a81036e0 0x7f26a8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.259+0000 7f26b0313640 1 --2- 172.21.15.42:0/3428253052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26a8102d30 0x7f26a8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.259+0000 7f26b0313640 1 -- 172.21.15.42:0/3428253052 >> 172.21.15.42:0/3428253052 conn(0x7f26a80fc7d0 msgr2=0x7f26a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:55.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.260+0000 7f26b0313640 1 -- 172.21.15.42:0/3428253052 shutdown_connections 2024-09-19T09:39:55.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.260+0000 7f26b0313640 1 -- 172.21.15.42:0/3428253052 wait complete. 2024-09-19T09:39:55.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.260+0000 7f26b0313640 1 Processor -- start 2024-09-19T09:39:55.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.260+0000 7f26b0313640 1 -- start start 2024-09-19T09:39:55.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26b0313640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a8102d30 0x7f26a8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26b0313640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26a81036e0 0x7f26a8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26b0313640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26a81082a0 0x7f26a8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26b0313640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81120a0 con 0x7f26a8102d30 2024-09-19T09:39:55.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26b0313640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f26a8111f20 con 0x7f26a81036e0 2024-09-19T09:39:55.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26b0313640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f26a8112220 con 0x7f26a81082a0 2024-09-19T09:39:55.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26ad8ae640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26a81036e0 0x7f26a8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26ad8ae640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26a81036e0 0x7f26a8100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:54012/0 (socket says 172.21.15.42:54012) 2024-09-19T09:39:55.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26ad8ae640 1 -- 172.21.15.42:0/4143145111 learned_addr learned my addr 172.21.15.42:0/4143145111 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:55.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26ae0af640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a8102d30 0x7f26a8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26ad8ae640 1 -- 172.21.15.42:0/4143145111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26a81082a0 msgr2=0x7f26a8101410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:39:55.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26a81082a0 0x7f26a8101410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26ad8ae640 1 -- 172.21.15.42:0/4143145111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a8102d30 msgr2=0x7f26a8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:55.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a8102d30 0x7f26a8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.261+0000 7f26ad8ae640 1 -- 172.21.15.42:0/4143145111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a81a6a50 con 0x7f26a81036e0 2024-09-19T09:39:55.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.262+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26a81036e0 0x7f26a8100ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f269800e9c0 tx=0x7f269800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:55.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.262+0000 7f269f7fe640 1 -- 172.21.15.42:0/4143145111 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269800ccc0 con 0x7f26a81036e0 2024-09-19T09:39:55.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.262+0000 7f26b0313640 1 -- 172.21.15.42:0/4143145111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a81a6d40 con 0x7f26a81036e0 2024-09-19T09:39:55.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.262+0000 7f269f7fe640 1 -- 172.21.15.42:0/4143145111 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2698005500 con 0x7f26a81036e0 2024-09-19T09:39:55.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.262+0000 7f26b0313640 1 -- 172.21.15.42:0/4143145111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a81a7220 con 0x7f26a81036e0 2024-09-19T09:39:55.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.262+0000 7f269f7fe640 1 -- 172.21.15.42:0/4143145111 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698010690 con 0x7f26a81036e0 2024-09-19T09:39:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.265+0000 7f269f7fe640 1 -- 172.21.15.42:0/4143145111 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f2698004e80 con 0x7f26a81036e0 2024-09-19T09:39:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.265+0000 7f269f7fe640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26940a3350 0x7f26940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.266+0000 7f269f7fe640 1 -- 172.21.15.42:0/4143145111 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f26980cff80 con 0x7f26a81036e0 2024-09-19T09:39:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.266+0000 7f26ae0af640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26940a3350 0x7f26940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.266+0000 7f26b26ec740 1 Processor -- start 2024-09-19T09:39:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26ae0af640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26940a3350 0x7f26940a5810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009b60 tx=0x7f26a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26b26ec740 1 -- start start 2024-09-19T09:39:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf8b40 0x5643e0cf7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf75d0 0x5643e0cf7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0d02370 0x5643e0d04760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26b26ec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5643e0c5d2f0 con 0x5643e0cf8b40 2024-09-19T09:39:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26ae0af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf8b40 0x5643e0cf7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26b26ec740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5643e0c04cf0 con 0x5643e0d02370 2024-09-19T09:39:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26b26ec740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5643e0c592b0 con 0x5643e0cf75d0 2024-09-19T09:39:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26ae0af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf8b40 0x5643e0cf7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52384/0 (socket says 172.21.15.42:52384) 2024-09-19T09:39:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26ae0af640 1 -- 172.21.15.42:0/2297307475 learned_addr learned my addr 172.21.15.42:0/2297307475 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.267+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/2297307475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf75d0 0x5643e0cf7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.268+0000 7f26ad8ae640 1 -- 172.21.15.42:0/2297307475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0d02370 msgr2=0x5643e0d04760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.268+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/2297307475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0d02370 0x5643e0d04760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.268+0000 7f26ad8ae640 1 -- 172.21.15.42:0/2297307475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf8b40 msgr2=0x5643e0cf7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.268+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/2297307475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf8b40 0x5643e0cf7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.268+0000 7f26ad8ae640 1 -- 172.21.15.42:0/2297307475 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e0be93a0 con 0x5643e0cf75d0 2024-09-19T09:39:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.268+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/2297307475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf75d0 0x5643e0cf7a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26980cd8b0 tx=0x7f269809bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=632ea5da0a5c2cff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.268+0000 7f269cdea640 1 -- 172.21.15.42:0/2297307475 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26980b5070 con 0x5643e0cf75d0 2024-09-19T09:39:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.269+0000 7f269cdea640 1 -- 172.21.15.42:0/2297307475 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f269809c3c0 con 0x5643e0cf75d0 2024-09-19T09:39:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.269+0000 7f269cdea640 1 -- 172.21.15.42:0/2297307475 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26980b5210 con 0x5643e0cf75d0 2024-09-19T09:39:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.270+0000 7f26b26ec740 1 -- 172.21.15.42:0/2297307475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf75d0 msgr2=0x5643e0cf7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.270+0000 7f26b26ec740 1 --2- 172.21.15.42:0/2297307475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf75d0 0x5643e0cf7a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26980cd8b0 tx=0x7f269809bd20 comp rx=0 tx=0).stop 2024-09-19T09:39:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.270+0000 7f26b26ec740 1 -- 172.21.15.42:0/2297307475 shutdown_connections 2024-09-19T09:39:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.270+0000 7f26b26ec740 1 --2- 172.21.15.42:0/2297307475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0d02370 0x5643e0d04760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.270+0000 7f26b26ec740 1 --2- 172.21.15.42:0/2297307475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf75d0 0x5643e0cf7a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.270+0000 7f26b26ec740 1 --2- 172.21.15.42:0/2297307475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf8b40 0x5643e0cf7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.270+0000 7f26b26ec740 1 -- 172.21.15.42:0/2297307475 >> 172.21.15.42:0/2297307475 conn(0x5643e0cc0310 msgr2=0x5643e0cf3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.270+0000 7f26b26ec740 1 -- 172.21.15.42:0/2297307475 shutdown_connections 2024-09-19T09:39:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.270+0000 7f26b26ec740 1 -- 172.21.15.42:0/2297307475 wait complete. 2024-09-19T09:39:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.271+0000 7f26b26ec740 1 -- start start 2024-09-19T09:39:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.271+0000 7f26b26ec740 1 Processor -- start 2024-09-19T09:39:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.271+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0cff100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.271+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf8b40 0x5643e0cff640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0d02370 0x5643e0cffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26b26ec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5643e0d05070 con 0x5643e0cf75d0 2024-09-19T09:39:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26b26ec740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5643e0c18060 con 0x5643e0d02370 2024-09-19T09:39:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26b26ec740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5643e0d051f0 con 0x5643e0cf8b40 2024-09-19T09:39:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26b26ec740 10 client.0 _ll_register_callbacks cb 0x5643e096b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ae0af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0cff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ae0af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0cff100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52392/0 (socket says 172.21.15.42:52392) 2024-09-19T09:39:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ae0af640 1 -- 172.21.15.42:0/1600890185 learned_addr learned my addr 172.21.15.42:0/1600890185 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf8b40 0x5643e0cff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ae8b0640 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0d02370 0x5643e0cffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ad8ae640 1 -- 172.21.15.42:0/1600890185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0d02370 msgr2=0x5643e0cffb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0d02370 0x5643e0cffb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ad8ae640 1 -- 172.21.15.42:0/1600890185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 msgr2=0x5643e0cff100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0cff100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ad8ae640 1 -- 172.21.15.42:0/1600890185 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e09ce3c0 con 0x5643e0cf8b40 2024-09-19T09:39:55.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ae0af640 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0cff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:55.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf8b40 0x5643e0cff640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f26980a51f0 tx=0x7f269800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d15ca9eaefc5edc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:55.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.272+0000 7f2691ffb640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:39:55.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f2691ffb640 1 -- 172.21.15.42:0/1600890185 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26980b5040 con 0x5643e0cf8b40 2024-09-19T09:39:55.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f2691ffb640 1 -- 172.21.15.42:0/1600890185 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f26980b51e0 con 0x5643e0cf8b40 2024-09-19T09:39:55.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f26b26ec740 1 -- 172.21.15.42:0/1600890185 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f269809c3c0 con 0x5643e0cf8b40 2024-09-19T09:39:55.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f2691ffb640 1 -- 172.21.15.42:0/1600890185 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f26980a5030 con 0x5643e0cf8b40 2024-09-19T09:39:55.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f26b26ec740 10 client.25123 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:55.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f26b26ec740 1 -- 172.21.15.42:0/1600890185 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643e0d05070 con 0x5643e0cf8b40 2024-09-19T09:39:55.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f2691ffb640 1 -- 172.21.15.42:0/1600890185 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2698005170 con 0x5643e0cf8b40 2024-09-19T09:39:55.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f2691ffb640 1 -- 172.21.15.42:0/1600890185 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f269809b810 con 0x5643e0cf8b40 2024-09-19T09:39:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f26b26ec740 10 client.25123 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f26b26ec740 10 client.25123 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:39:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f26b26ec740 20 client.25123 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f26b26ec740 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5643e0d11d80 0x5643e0d14170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f26b26ec740 4 client.25123 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.273+0000 7f26b26ec740 1 -- 172.21.15.42:0/1600890185 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f269809c3c0 con 0x5643e0d11d80 2024-09-19T09:39:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.274+0000 7f26ae0af640 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5643e0d11d80 0x5643e0d14170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.274+0000 7f2691ffb640 10 client.25123 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:39:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.274+0000 7f26ae0af640 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5643e0d11d80 0x5643e0d14170 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98ae2aacc231452a server_cookie=24ff3a4ecc9daf70 in_seq=0 out_seq=0 2024-09-19T09:39:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f2691ffb640 1 -- 172.21.15.42:0/1600890185 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f269809c3c0 con 0x5643e0d11d80 2024-09-19T09:39:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f2691ffb640 10 client.25123 handle_command_reply: tid=0 2024-09-19T09:39:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 client.25123 shutdown 2024-09-19T09:39:55.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 -- 172.21.15.42:0/1600890185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf8b40 msgr2=0x5643e0cff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:55.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf8b40 0x5643e0cff640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f26980a51f0 tx=0x7f269800cf60 comp rx=0 tx=0).stop 2024-09-19T09:39:55.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 -- 172.21.15.42:0/1600890185 shutdown_connections 2024-09-19T09:39:55.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5643e0d11d80 0x5643e0d14170 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f2691ffb640 0 client.25123 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:39:55.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0d02370 0x5643e0cffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0cf8b40 0x5643e0cff640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 --2- 172.21.15.42:0/1600890185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0cff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 -- 172.21.15.42:0/1600890185 >> 172.21.15.42:0/1600890185 conn(0x5643e0cc0310 msgr2=0x5643e0cf9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:55.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 -- 172.21.15.42:0/1600890185 shutdown_connections 2024-09-19T09:39:55.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.275+0000 7f26b26ec740 1 -- 172.21.15.42:0/1600890185 wait complete. 2024-09-19T09:39:55.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.276+0000 7f26b26ec740 20 client.25123 trim_cache size 0 max 16384 2024-09-19T09:39:55.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.301+0000 7f26b26ec740 1 Processor -- start 2024-09-19T09:39:55.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26b26ec740 1 -- start start 2024-09-19T09:39:55.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0d00960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 0x5643e0cff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 0x5643e0d19770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26b26ec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81ab4a0 con 0x5643e0cf75d0 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26b26ec740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81acfe0 con 0x5643e0cf8b40 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26b26ec740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81abb70 con 0x5643e0d02370 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26ad8ae640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 0x5643e0cff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26ad8ae640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 0x5643e0cff9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:54050/0 (socket says 172.21.15.42:54050) 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26ad8ae640 1 -- 172.21.15.42:0/1078379143 learned_addr learned my addr 172.21.15.42:0/1078379143 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26ad8ae640 1 -- 172.21.15.42:0/1078379143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 msgr2=0x5643e0d19770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/1078379143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 0x5643e0d19770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.302+0000 7f26ad8ae640 1 -- 172.21.15.42:0/1078379143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 msgr2=0x5643e0d00960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.303+0000 7f26ae0af640 1 --2- 172.21.15.42:0/1078379143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0d00960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.303+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/1078379143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0d00960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.303+0000 7f26ad8ae640 1 -- 172.21.15.42:0/1078379143 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e0d01810 con 0x5643e0cf8b40 2024-09-19T09:39:55.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.303+0000 7f26ae0af640 1 --2- 172.21.15.42:0/1078379143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0d00960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:55.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.303+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/1078379143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 0x5643e0cff9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f26980a4b00 tx=0x7f269809a8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=740776625bbe5f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:55.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.304+0000 7f2693fff640 1 -- 172.21.15.42:0/1078379143 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26980b5070 con 0x5643e0cf8b40 2024-09-19T09:39:55.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.304+0000 7f2693fff640 1 -- 172.21.15.42:0/1078379143 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f269809c3c0 con 0x5643e0cf8b40 2024-09-19T09:39:55.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.304+0000 7f2693fff640 1 -- 172.21.15.42:0/1078379143 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26980b5210 con 0x5643e0cf8b40 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.304+0000 7f26b26ec740 1 -- 172.21.15.42:0/1078379143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 msgr2=0x5643e0cff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.304+0000 7f26b26ec740 1 --2- 172.21.15.42:0/1078379143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 0x5643e0cff9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f26980a4b00 tx=0x7f269809a8d0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.305+0000 7f26b26ec740 1 -- 172.21.15.42:0/1078379143 shutdown_connections 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.305+0000 7f26b26ec740 1 --2- 172.21.15.42:0/1078379143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 0x5643e0d19770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.305+0000 7f26b26ec740 1 --2- 172.21.15.42:0/1078379143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 0x5643e0cff9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.305+0000 7f26b26ec740 1 --2- 172.21.15.42:0/1078379143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0d00960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.305+0000 7f26b26ec740 1 -- 172.21.15.42:0/1078379143 >> 172.21.15.42:0/1078379143 conn(0x5643e0cc0310 msgr2=0x5643e0d0db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.305+0000 7f26b26ec740 1 -- 172.21.15.42:0/1078379143 shutdown_connections 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.305+0000 7f26b26ec740 1 -- 172.21.15.42:0/1078379143 wait complete. 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.305+0000 7f26b26ec740 1 -- start start 2024-09-19T09:39:55.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.305+0000 7f26b26ec740 1 Processor -- start 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0d0a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 0x5643e0d05d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26b26ec740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 0x5643e0d06260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26b26ec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81ac910 con 0x5643e0cf75d0 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26b26ec740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81ac240 con 0x5643e0cf8b40 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26b26ec740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81a9480 con 0x5643e0d02370 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26b26ec740 10 client.0 _ll_register_callbacks cb 0x7f26980b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26ae8b0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 0x5643e0d06260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26ae8b0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 0x5643e0d06260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:36180/0 (socket says 172.21.15.42:36180) 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26ae8b0640 1 -- 172.21.15.42:0/2135610033 learned_addr learned my addr 172.21.15.42:0/2135610033 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26ad8ae640 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 0x5643e0d05d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26ae8b0640 1 -- 172.21.15.42:0/2135610033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 msgr2=0x5643e0d05d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:55.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26ae8b0640 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 0x5643e0d05d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26ae8b0640 1 -- 172.21.15.42:0/2135610033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 msgr2=0x5643e0d0a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.306+0000 7f26ae0af640 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0d0a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.307+0000 7f26ae8b0640 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0d0a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.307+0000 7f26ae8b0640 1 -- 172.21.15.42:0/2135610033 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e0d067a0 con 0x5643e0d02370 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.307+0000 7f26ae0af640 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0d0a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.307+0000 7f26ae8b0640 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 0x5643e0d06260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009cd0 tx=0x7f26a0005f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e29bb3df2e3374a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.307+0000 7f2691ffb640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.307+0000 7f2691ffb640 1 -- 172.21.15.42:0/2135610033 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0003970 con 0x5643e0d02370 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.307+0000 7f2691ffb640 1 -- 172.21.15.42:0/2135610033 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f26a0003b10 con 0x5643e0d02370 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.307+0000 7f26b26ec740 1 -- 172.21.15.42:0/2135610033 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f269809c3c0 con 0x5643e0d02370 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f2691ffb640 1 -- 172.21.15.42:0/2135610033 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f26a0003d10 con 0x5643e0d02370 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f26b26ec740 10 client.25126 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:55.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f26b26ec740 1 -- 172.21.15.42:0/2135610033 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643e0d7c3a0 con 0x5643e0d02370 2024-09-19T09:39:55.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f2691ffb640 1 -- 172.21.15.42:0/2135610033 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f269809c3c0 con 0x5643e0d02370 2024-09-19T09:39:55.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f2691ffb640 1 -- 172.21.15.42:0/2135610033 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f26a0030070 con 0x5643e0d02370 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f26b26ec740 10 client.25126 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f26b26ec740 10 client.25126 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f26b26ec740 20 client.25126 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f26b26ec740 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5643e0d7cb20 0x5643e0d7ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f26b26ec740 4 client.25126 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.308+0000 7f26b26ec740 1 -- 172.21.15.42:0/2135610033 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643e0c6a860 con 0x5643e0d7cb20 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.309+0000 7f26ae0af640 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5643e0d7cb20 0x5643e0d7ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.309+0000 7f26ae0af640 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5643e0d7cb20 0x5643e0d7ef40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8162d586fa12548 server_cookie=b24ed9f4e45623e9 in_seq=0 out_seq=0 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.309+0000 7f2691ffb640 10 client.25126 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f2691ffb640 1 -- 172.21.15.42:0/2135610033 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643e0c6a860 con 0x5643e0d7cb20 2024-09-19T09:39:55.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f2691ffb640 10 client.25126 handle_command_reply: tid=0 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 client.25126 shutdown 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 -- 172.21.15.42:0/2135610033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 msgr2=0x5643e0d06260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 0x5643e0d06260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009cd0 tx=0x7f26a0005f60 comp rx=0 tx=0).stop 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 -- 172.21.15.42:0/2135610033 shutdown_connections 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5643e0d7cb20 0x5643e0d7ef40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5643e0d02370 0x5643e0d06260 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5643e0cf8b40 0x5643e0d05d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 --2- 172.21.15.42:0/2135610033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5643e0cf75d0 0x5643e0d0a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 -- 172.21.15.42:0/2135610033 >> 172.21.15.42:0/2135610033 conn(0x5643e0cc0310 msgr2=0x5643e0cfe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f2691ffb640 0 client.25126 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 -- 172.21.15.42:0/2135610033 shutdown_connections 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 1 -- 172.21.15.42:0/2135610033 wait complete. 2024-09-19T09:39:55.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.310+0000 7f26b26ec740 20 client.25126 trim_cache size 0 max 16384 2024-09-19T09:39:55.316 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:39:55.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 -- 172.21.15.42:0/4143145111 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26940a3350 msgr2=0x7f26940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26940a3350 0x7f26940a5810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009b60 tx=0x7f26a4005f90 comp rx=0 tx=0).stop 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 -- 172.21.15.42:0/4143145111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26a81036e0 msgr2=0x7f26a8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26a81036e0 0x7f26a8100ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f269800e9c0 tx=0x7f269800ee80 comp rx=0 tx=0).stop 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 -- 172.21.15.42:0/4143145111 shutdown_connections 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f26940a3350 0x7f26940a5810 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26a81082a0 0x7f26a8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26a81036e0 0x7f26a8100ed0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 --2- 172.21.15.42:0/4143145111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a8102d30 0x7f26a8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 -- 172.21.15.42:0/4143145111 >> 172.21.15.42:0/4143145111 conn(0x7f26a80fc7d0 msgr2=0x7f26a8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 -- 172.21.15.42:0/4143145111 shutdown_connections 2024-09-19T09:39:55.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:55.311+0000 7f26b0313640 1 -- 172.21.15.42:0/4143145111 wait complete. 2024-09-19T09:39:55.894 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:56.030 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:39:56.290 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:56.701 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:56 smithi042 ceph-mon[31223]: pgmap v355: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:39:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.817+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/2055622186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c08103660 msgr2=0x7f5c0810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.817+0000 7f5c0d3ab640 1 --2- 172.21.15.42:0/2055622186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c08103660 0x7f5c0810bb50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009900 tx=0x7f5bfc02a480 comp rx=0 tx=0).stop 2024-09-19T09:39:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.817+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/2055622186 shutdown_connections 2024-09-19T09:39:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.817+0000 7f5c0d3ab640 1 --2- 172.21.15.42:0/2055622186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c0810c170 0x7f5c0810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.817+0000 7f5c0d3ab640 1 --2- 172.21.15.42:0/2055622186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c08103660 0x7f5c0810bb50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.817+0000 7f5c0d3ab640 1 --2- 172.21.15.42:0/2055622186 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c08102d40 0x7f5c08103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.817+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/2055622186 >> 172.21.15.42:0/2055622186 conn(0x7f5c080fc7a0 msgr2=0x7f5c080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.817+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/2055622186 shutdown_connections 2024-09-19T09:39:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.817+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/2055622186 wait complete. 2024-09-19T09:39:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.818+0000 7f5c0d3ab640 1 Processor -- start 2024-09-19T09:39:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.819+0000 7f5c0d3ab640 1 -- start start 2024-09-19T09:39:56.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.819+0000 7f5c0d3ab640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c08102d40 0x7f5c08198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:56.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.819+0000 7f5c0d3ab640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c0810c170 0x7f5c08198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:56.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.819+0000 7f5c0d3ab640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c0819cf30 0x7f5c0819d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:56.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.819+0000 7f5c06ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c08102d40 0x7f5c08198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:56.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.819+0000 7f5c0d3ab640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08111f70 con 0x7f5c08102d40 2024-09-19T09:39:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.819+0000 7f5c0d3ab640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08111df0 con 0x7f5c0810c170 2024-09-19T09:39:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.819+0000 7f5c0d3ab640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5c081120f0 con 0x7f5c0819cf30 2024-09-19T09:39:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.819+0000 7f5c06ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c08102d40 0x7f5c08198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52418/0 (socket says 172.21.15.42:52418) 2024-09-19T09:39:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.819+0000 7f5c06ffd640 1 -- 172.21.15.42:0/1878084547 learned_addr learned my addr 172.21.15.42:0/1878084547 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.820+0000 7f5c067fc640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c0810c170 0x7f5c08198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.820+0000 7f5c077fe640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c0819cf30 0x7f5c0819d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.820+0000 7f5c06ffd640 1 -- 172.21.15.42:0/1878084547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c0819cf30 msgr2=0x7f5c0819d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.820+0000 7f5c06ffd640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c0819cf30 0x7f5c0819d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.820+0000 7f5c06ffd640 1 -- 172.21.15.42:0/1878084547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c0810c170 msgr2=0x7f5c08198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.820+0000 7f5c06ffd640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c0810c170 0x7f5c08198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.820+0000 7f5c06ffd640 1 -- 172.21.15.42:0/1878084547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0819d9f0 con 0x7f5c08102d40 2024-09-19T09:39:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.820+0000 7f5c077fe640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c0819cf30 0x7f5c0819d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.820+0000 7f5c06ffd640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c08102d40 0x7f5c08198660 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800e9f0 tx=0x7f5bf800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.821+0000 7f5beffff640 1 -- 172.21.15.42:0/1878084547 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf800cd80 con 0x7f5c08102d40 2024-09-19T09:39:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.821+0000 7f5beffff640 1 -- 172.21.15.42:0/1878084547 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf8010910 con 0x7f5c08102d40 2024-09-19T09:39:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.821+0000 7f5beffff640 1 -- 172.21.15.42:0/1878084547 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf80188f0 con 0x7f5c08102d40 2024-09-19T09:39:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.821+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/1878084547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0819dce0 con 0x7f5c08102d40 2024-09-19T09:39:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.822+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/1878084547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c08100b60 con 0x7f5c08102d40 2024-09-19T09:39:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.823+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/1878084547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c08103120 con 0x7f5c08102d40 2024-09-19T09:39:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.825+0000 7f5beffff640 1 -- 172.21.15.42:0/1878084547 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f5bf8010ac0 con 0x7f5c08102d40 2024-09-19T09:39:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.826+0000 7f5beffff640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5bf00a3350 0x7f5bf00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.826+0000 7f5c067fc640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5bf00a3350 0x7f5bf00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.826+0000 7f5beffff640 1 -- 172.21.15.42:0/1878084547 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f5bf80cfff0 con 0x7f5c08102d40 2024-09-19T09:39:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.827+0000 7f5c067fc640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5bf00a3350 0x7f5bf00a5810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc005940 tx=0x7f5bfc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:56.835+0000 7f5beffff640 1 -- 172.21.15.42:0/1878084547 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5bf809cc30 con 0x7f5c08102d40 2024-09-19T09:39:56.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:56 smithi171 ceph-mon[35803]: pgmap v355: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:39:56.867 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:56.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:56 smithi136 ceph-mon[34840]: pgmap v355: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:39:57.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.203+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/1878084547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c0802d7c0 con 0x7f5c08102d40 2024-09-19T09:39:57.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.204+0000 7f5beffff640 1 -- 172.21.15.42:0/1878084547 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f5bf809c530 con 0x7f5c08102d40 2024-09-19T09:39:57.206 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:39:57.206 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:39:57.207 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:39:57.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.207+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/1878084547 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5bf00a3350 msgr2=0x7f5bf00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.207+0000 7f5c0d3ab640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5bf00a3350 0x7f5bf00a5810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc005940 tx=0x7f5bfc0058d0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.207+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/1878084547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c08102d40 msgr2=0x7f5c08198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.207+0000 7f5c0d3ab640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c08102d40 0x7f5c08198660 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800e9f0 tx=0x7f5bf800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.208+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/1878084547 shutdown_connections 2024-09-19T09:39:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.208+0000 7f5c0d3ab640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f5bf00a3350 0x7f5bf00a5810 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.208+0000 7f5c0d3ab640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c0819cf30 0x7f5c0819d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.208+0000 7f5c0d3ab640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c0810c170 0x7f5c08198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.208+0000 7f5c0d3ab640 1 --2- 172.21.15.42:0/1878084547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c08102d40 0x7f5c08198660 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.208+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/1878084547 >> 172.21.15.42:0/1878084547 conn(0x7f5c080fc7a0 msgr2=0x7f5c080fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.208+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/1878084547 shutdown_connections 2024-09-19T09:39:57.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.208+0000 7f5c0d3ab640 1 -- 172.21.15.42:0/1878084547 wait complete. 2024-09-19T09:39:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.422+0000 7fb06bf7a640 1 -- 172.21.15.42:0/1877213668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06410c170 msgr2=0x7fb06410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.422+0000 7fb06bf7a640 1 --2- 172.21.15.42:0/1877213668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06410c170 0x7fb06410e610 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009ca0 tx=0x7fb05c02a950 comp rx=0 tx=0).stop 2024-09-19T09:39:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.423+0000 7fb06bf7a640 1 -- 172.21.15.42:0/1877213668 shutdown_connections 2024-09-19T09:39:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.423+0000 7fb06bf7a640 1 --2- 172.21.15.42:0/1877213668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06410c170 0x7fb06410e610 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.423+0000 7fb06bf7a640 1 --2- 172.21.15.42:0/1877213668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb064103660 0x7fb06410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.423+0000 7fb06bf7a640 1 --2- 172.21.15.42:0/1877213668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb064102d40 0x7fb064103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.423+0000 7fb06bf7a640 1 -- 172.21.15.42:0/1877213668 >> 172.21.15.42:0/1877213668 conn(0x7fb0640fc7a0 msgr2=0x7fb0640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.423+0000 7fb06bf7a640 1 -- 172.21.15.42:0/1877213668 shutdown_connections 2024-09-19T09:39:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.423+0000 7fb06bf7a640 1 -- 172.21.15.42:0/1877213668 wait complete. 2024-09-19T09:39:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb06bf7a640 1 Processor -- start 2024-09-19T09:39:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb06bf7a640 1 -- start start 2024-09-19T09:39:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb06bf7a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb064102d40 0x7fb064198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb06bf7a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb064103660 0x7fb064198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb06bf7a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb06410c170 0x7fb06419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb06bf7a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb064111f80 con 0x7fb064103660 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb06bf7a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb064111e00 con 0x7fb06410c170 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb06bf7a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb064112100 con 0x7fb064102d40 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb069515640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb064103660 0x7fb064198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb069d16640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb064102d40 0x7fb064198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb069d16640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb064102d40 0x7fb064198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:36210/0 (socket says 172.21.15.42:36210) 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.424+0000 7fb069d16640 1 -- 172.21.15.42:0/2467078351 learned_addr learned my addr 172.21.15.42:0/2467078351 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.425+0000 7fb06a517640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb06410c170 0x7fb06419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.425+0000 7fb069d16640 1 -- 172.21.15.42:0/2467078351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb06410c170 msgr2=0x7fb06419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.425+0000 7fb069d16640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb06410c170 0x7fb06419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.425+0000 7fb069d16640 1 -- 172.21.15.42:0/2467078351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb064103660 msgr2=0x7fb064198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.425+0000 7fb069d16640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb064103660 0x7fb064198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.425+0000 7fb069d16640 1 -- 172.21.15.42:0/2467078351 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06419d2f0 con 0x7fb064102d40 2024-09-19T09:39:57.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.425+0000 7fb06a517640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb06410c170 0x7fb06419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:57.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.425+0000 7fb069d16640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb064102d40 0x7fb064198340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb06000c920 tx=0x7fb06000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:57.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.425+0000 7fb05affd640 1 -- 172.21.15.42:0/2467078351 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060007c70 con 0x7fb064102d40 2024-09-19T09:39:57.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.426+0000 7fb06bf7a640 1 -- 172.21.15.42:0/2467078351 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06419d5e0 con 0x7fb064102d40 2024-09-19T09:39:57.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.426+0000 7fb06bf7a640 1 -- 172.21.15.42:0/2467078351 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0641008d0 con 0x7fb064102d40 2024-09-19T09:39:57.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.426+0000 7fb05affd640 1 -- 172.21.15.42:0/2467078351 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb060007e10 con 0x7fb064102d40 2024-09-19T09:39:57.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.426+0000 7fb05affd640 1 -- 172.21.15.42:0/2467078351 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060018890 con 0x7fb064102d40 2024-09-19T09:39:57.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.429+0000 7fb06e353740 1 Processor -- start 2024-09-19T09:39:57.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.429+0000 7fb06e353740 1 -- start start 2024-09-19T09:39:57.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.429+0000 7fb06e353740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c17090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.429+0000 7fb06e353740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 0x557ec6c17a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.429+0000 7fb06e353740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 0x557ec6c24760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.429+0000 7fb06e353740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557ec6b7d2f0 con 0x557ec6c175d0 2024-09-19T09:39:57.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.429+0000 7fb06e353740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557ec6b24cf0 con 0x557ec6c18b40 2024-09-19T09:39:57.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.429+0000 7fb06e353740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557ec6b792b0 con 0x557ec6c22370 2024-09-19T09:39:57.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.430+0000 7fb05affd640 1 -- 172.21.15.42:0/2467078351 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fb060018a50 con 0x7fb064102d40 2024-09-19T09:39:57.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.430+0000 7fb06a517640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c17090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.430+0000 7fb06a517640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c17090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:54108/0 (socket says 172.21.15.42:54108) 2024-09-19T09:39:57.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.430+0000 7fb06a517640 1 -- 172.21.15.42:0/803694200 learned_addr learned my addr 172.21.15.42:0/803694200 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:57.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.430+0000 7fb069515640 1 --2- 172.21.15.42:0/803694200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 0x557ec6c24760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.430+0000 7fb069d16640 1 --2- 172.21.15.42:0/803694200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 0x557ec6c17a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.431+0000 7fb069515640 1 -- 172.21.15.42:0/803694200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 msgr2=0x557ec6c17090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:57.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.431+0000 7fb069515640 1 --2- 172.21.15.42:0/803694200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c17090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.431+0000 7fb069515640 1 -- 172.21.15.42:0/803694200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 msgr2=0x557ec6c17a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:57.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.431+0000 7fb069515640 1 --2- 172.21.15.42:0/803694200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 0x557ec6c17a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.431+0000 7fb069515640 1 -- 172.21.15.42:0/803694200 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec6b093a0 con 0x557ec6c22370 2024-09-19T09:39:57.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.431+0000 7fb069515640 1 --2- 172.21.15.42:0/803694200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 0x557ec6c24760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb054009be0 tx=0x7fb054011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32e9fb00f314c8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:57.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.431+0000 7fb05affd640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb0500a32d0 0x7fb0500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.431+0000 7fb05affd640 1 -- 172.21.15.42:0/2467078351 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb0600cfc10 con 0x7fb064102d40 2024-09-19T09:39:57.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.431+0000 7fb04ffff640 1 -- 172.21.15.42:0/803694200 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054004050 con 0x557ec6c22370 2024-09-19T09:39:57.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.432+0000 7fb04ffff640 1 -- 172.21.15.42:0/803694200 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb054005500 con 0x557ec6c22370 2024-09-19T09:39:57.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.432+0000 7fb06a517640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb0500a32d0 0x7fb0500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.432+0000 7fb04ffff640 1 -- 172.21.15.42:0/803694200 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054004d00 con 0x557ec6c22370 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.432+0000 7fb06e353740 1 -- 172.21.15.42:0/803694200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 msgr2=0x557ec6c24760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.432+0000 7fb06a517640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb0500a32d0 0x7fb0500a5790 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009a60 tx=0x7fb05c009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.432+0000 7fb06e353740 1 --2- 172.21.15.42:0/803694200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 0x557ec6c24760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb054009be0 tx=0x7fb054011810 comp rx=0 tx=0).stop 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.433+0000 7fb06e353740 1 -- 172.21.15.42:0/803694200 shutdown_connections 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.433+0000 7fb06e353740 1 --2- 172.21.15.42:0/803694200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 0x557ec6c24760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.433+0000 7fb06e353740 1 --2- 172.21.15.42:0/803694200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 0x557ec6c17a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.433+0000 7fb06e353740 1 --2- 172.21.15.42:0/803694200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c17090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.433+0000 7fb06e353740 1 -- 172.21.15.42:0/803694200 >> 172.21.15.42:0/803694200 conn(0x557ec6be0310 msgr2=0x557ec6c13c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.433+0000 7fb06e353740 1 -- 172.21.15.42:0/803694200 shutdown_connections 2024-09-19T09:39:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.433+0000 7fb06e353740 1 -- 172.21.15.42:0/803694200 wait complete. 2024-09-19T09:39:57.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.433+0000 7fb06e353740 1 -- start start 2024-09-19T09:39:57.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.433+0000 7fb06e353740 1 Processor -- start 2024-09-19T09:39:57.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb06e353740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 0x557ec6c21c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb06e353740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c1ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb06e353740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 0x557ec6c1f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb06e353740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557ec6c250c0 con 0x557ec6c175d0 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb06e353740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557ec6b38060 con 0x557ec6c18b40 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb06e353740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557ec6c25240 con 0x557ec6c22370 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb06e353740 10 client.0 _ll_register_callbacks cb 0x557ec688b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb069d16640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 0x557ec6c21c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb069515640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c1ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb069d16640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 0x557ec6c21c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52468/0 (socket says 172.21.15.42:52468) 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb069d16640 1 -- 172.21.15.42:0/2918011443 learned_addr learned my addr 172.21.15.42:0/2918011443 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.434+0000 7fb06a517640 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 0x557ec6c1f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.435+0000 7fb069d16640 1 -- 172.21.15.42:0/2918011443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 msgr2=0x557ec6c1f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.435+0000 7fb069d16640 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 0x557ec6c1f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.435+0000 7fb069d16640 1 -- 172.21.15.42:0/2918011443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 msgr2=0x557ec6c1ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:57.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.435+0000 7fb069d16640 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c1ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.435+0000 7fb069d16640 1 -- 172.21.15.42:0/2918011443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ec68ee3c0 con 0x557ec6c175d0 2024-09-19T09:39:57.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.435+0000 7fb069d16640 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 0x557ec6c21c70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb060000c00 tx=0x7fb06009bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6418730bf1f21463 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:57.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.435+0000 7fb04d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:57.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.435+0000 7fb04d7fa640 1 -- 172.21.15.42:0/2918011443 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0600a0460 con 0x557ec6c175d0 2024-09-19T09:39:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.436+0000 7fb06e353740 1 -- 172.21.15.42:0/2918011443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb054005500 con 0x557ec6c175d0 2024-09-19T09:39:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.436+0000 7fb04d7fa640 1 -- 172.21.15.42:0/2918011443 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb060018d40 con 0x557ec6c175d0 2024-09-19T09:39:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.436+0000 7fb04d7fa640 1 -- 172.21.15.42:0/2918011443 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb0600a4d20 con 0x557ec6c175d0 2024-09-19T09:39:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.436+0000 7fb06e353740 10 client.15654 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.436+0000 7fb06e353740 1 -- 172.21.15.42:0/2918011443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557ec6c30b80 con 0x557ec6c175d0 2024-09-19T09:39:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.436+0000 7fb04d7fa640 1 -- 172.21.15.42:0/2918011443 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb054005500 con 0x557ec6c175d0 2024-09-19T09:39:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.437+0000 7fb04d7fa640 1 -- 172.21.15.42:0/2918011443 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb0600a00c0 con 0x557ec6c175d0 2024-09-19T09:39:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.437+0000 7fb06e353740 10 client.15654 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:57.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.437+0000 7fb06e353740 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:57.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.437+0000 7fb06e353740 20 client.15654 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:57.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.437+0000 7fb06e353740 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557ec6c32410 0x557ec6c348a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.437+0000 7fb06e353740 4 client.15654 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:57.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.437+0000 7fb06e353740 1 -- 172.21.15.42:0/2918011443 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ec6b8a860 con 0x557ec6c32410 2024-09-19T09:39:57.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.438+0000 7fb069515640 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557ec6c32410 0x557ec6c348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.438+0000 7fb069515640 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557ec6c32410 0x557ec6c348a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bbdb67539354cfc server_cookie=2fa0c5028949ee60 in_seq=0 out_seq=0 2024-09-19T09:39:57.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.438+0000 7fb04d7fa640 10 client.15654 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:57.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb04d7fa640 1 -- 172.21.15.42:0/2918011443 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ec6b8a860 con 0x557ec6c32410 2024-09-19T09:39:57.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb04d7fa640 10 client.15654 handle_command_reply: tid=0 2024-09-19T09:39:57.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 client.15654 shutdown 2024-09-19T09:39:57.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 -- 172.21.15.42:0/2918011443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 msgr2=0x557ec6c21c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 0x557ec6c21c70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb060000c00 tx=0x7fb06009bad0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 -- 172.21.15.42:0/2918011443 shutdown_connections 2024-09-19T09:39:57.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557ec6c32410 0x557ec6c348a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c22370 0x557ec6c1f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c1ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 --2- 172.21.15.42:0/2918011443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c175d0 0x557ec6c21c70 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 -- 172.21.15.42:0/2918011443 >> 172.21.15.42:0/2918011443 conn(0x557ec6be0310 msgr2=0x557ec6c19930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:57.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb04d7fa640 0 client.15654 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:57.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 -- 172.21.15.42:0/2918011443 shutdown_connections 2024-09-19T09:39:57.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.439+0000 7fb06e353740 1 -- 172.21.15.42:0/2918011443 wait complete. 2024-09-19T09:39:57.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.440+0000 7fb06e353740 20 client.15654 trim_cache size 0 max 16384 2024-09-19T09:39:57.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.453+0000 7fb06e353740 1 Processor -- start 2024-09-19T09:39:57.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.453+0000 7fb06e353740 1 -- start start 2024-09-19T09:39:57.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb06e353740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c13e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb06e353740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c2e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb06e353740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 0x557ec6c3a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb069d16640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c13e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb069d16640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c13e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:36240/0 (socket says 172.21.15.42:36240) 2024-09-19T09:39:57.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb06a517640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 0x557ec6c3a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb06a517640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 0x557ec6c3a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52474/0 (socket says 172.21.15.42:52474) 2024-09-19T09:39:57.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb069515640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c2e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb069515640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c2e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:54124/0 (socket says 172.21.15.42:54124) 2024-09-19T09:39:57.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb06e353740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0641af5c0 con 0x557ec6c22370 2024-09-19T09:39:57.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb069d16640 1 -- 172.21.15.42:0/2197255671 learned_addr learned my addr 172.21.15.42:0/2197255671 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:57.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb06e353740 1 -- 172.21.15.42:0/2197255671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb0641b1100 con 0x557ec6c18b40 2024-09-19T09:39:57.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb06e353740 1 -- 172.21.15.42:0/2197255671 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb0641afc90 con 0x557ec6c175d0 2024-09-19T09:39:57.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb069d16640 1 -- 172.21.15.42:0/2197255671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 msgr2=0x557ec6c2e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:57.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb069d16640 1 --2- 172.21.15.42:0/2197255671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c2e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb069d16640 1 -- 172.21.15.42:0/2197255671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 msgr2=0x557ec6c3a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:57.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb069d16640 1 --2- 172.21.15.42:0/2197255671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 0x557ec6c3a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.454+0000 7fb069d16640 1 -- 172.21.15.42:0/2197255671 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec6c1f800 con 0x557ec6c175d0 2024-09-19T09:39:57.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.455+0000 7fb069d16640 1 --2- 172.21.15.42:0/2197255671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c13e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb06000fee0 tx=0x7fb06009c230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a355f1b5b18a73b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:57.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.455+0000 7fb04f7fe640 1 -- 172.21.15.42:0/2197255671 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06000fb30 con 0x557ec6c175d0 2024-09-19T09:39:57.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.455+0000 7fb04f7fe640 1 -- 172.21.15.42:0/2197255671 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0600d3030 con 0x557ec6c175d0 2024-09-19T09:39:57.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.455+0000 7fb04f7fe640 1 -- 172.21.15.42:0/2197255671 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060098720 con 0x557ec6c175d0 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.456+0000 7fb06e353740 1 -- 172.21.15.42:0/2197255671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 msgr2=0x557ec6c13e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.456+0000 7fb06e353740 1 --2- 172.21.15.42:0/2197255671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c13e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb06000fee0 tx=0x7fb06009c230 comp rx=0 tx=0).stop 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.456+0000 7fb06e353740 1 -- 172.21.15.42:0/2197255671 shutdown_connections 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.456+0000 7fb06e353740 1 --2- 172.21.15.42:0/2197255671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 0x557ec6c3a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.456+0000 7fb06e353740 1 --2- 172.21.15.42:0/2197255671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c2e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.456+0000 7fb06e353740 1 --2- 172.21.15.42:0/2197255671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c13e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.456+0000 7fb06e353740 1 -- 172.21.15.42:0/2197255671 >> 172.21.15.42:0/2197255671 conn(0x557ec6be0310 msgr2=0x557ec6c13700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.456+0000 7fb06e353740 1 -- 172.21.15.42:0/2197255671 shutdown_connections 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.456+0000 7fb06e353740 1 -- 172.21.15.42:0/2197255671 wait complete. 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.457+0000 7fb06e353740 1 -- start start 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.457+0000 7fb06e353740 1 Processor -- start 2024-09-19T09:39:57.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.457+0000 7fb06e353740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c2ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.457+0000 7fb06e353740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c25fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.457+0000 7fb06e353740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 0x557ec6c26500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb06e353740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0641b0a30 con 0x557ec6c22370 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb06e353740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb0641b0360 con 0x557ec6c18b40 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb069d16640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c2ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb069d16640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c2ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:36250/0 (socket says 172.21.15.42:36250) 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb06a517640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 0x557ec6c26500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb069d16640 1 -- 172.21.15.42:0/4169514896 learned_addr learned my addr 172.21.15.42:0/4169514896 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb069515640 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c25fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb06e353740 1 -- 172.21.15.42:0/4169514896 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb0641ad650 con 0x557ec6c175d0 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb06e353740 10 client.0 _ll_register_callbacks cb 0x7fb06000fe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb069d16640 1 -- 172.21.15.42:0/4169514896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 msgr2=0x557ec6c25fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb069d16640 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c25fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb069d16640 1 -- 172.21.15.42:0/4169514896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 msgr2=0x557ec6c26500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:57.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb069d16640 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 0x557ec6c26500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb069d16640 1 -- 172.21.15.42:0/4169514896 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ec6c26d50 con 0x557ec6c175d0 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.458+0000 7fb06a517640 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 0x557ec6c26500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.459+0000 7fb069d16640 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c2ac90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb06009a360 tx=0x7fb0600a4b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f96de76b57449fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.459+0000 7fb04d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.459+0000 7fb04d7fa640 1 -- 172.21.15.42:0/4169514896 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06007f060 con 0x557ec6c175d0 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.459+0000 7fb04d7fa640 1 -- 172.21.15.42:0/4169514896 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb06009b500 con 0x557ec6c175d0 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.459+0000 7fb06e353740 1 -- 172.21.15.42:0/4169514896 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0600d3030 con 0x557ec6c175d0 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.459+0000 7fb04d7fa640 1 -- 172.21.15.42:0/4169514896 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb06009bbf0 con 0x557ec6c175d0 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.459+0000 7fb06e353740 10 client.25150 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.459+0000 7fb06e353740 1 -- 172.21.15.42:0/4169514896 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557ec6ca5960 con 0x557ec6c175d0 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.460+0000 7fb04d7fa640 1 -- 172.21.15.42:0/4169514896 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0600a0460 con 0x557ec6c175d0 2024-09-19T09:39:57.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.460+0000 7fb04d7fa640 1 -- 172.21.15.42:0/4169514896 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb06007ace0 con 0x557ec6c175d0 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.460+0000 7fb06e353740 10 client.25150 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.460+0000 7fb06e353740 10 client.25150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.460+0000 7fb06e353740 20 client.25150 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.460+0000 7fb06e353740 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557ec6ca5e40 0x557ec6ca8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.460+0000 7fb06e353740 4 client.25150 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.460+0000 7fb06e353740 1 -- 172.21.15.42:0/4169514896 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb0600d3030 con 0x557ec6ca5e40 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.460+0000 7fb069515640 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557ec6ca5e40 0x557ec6ca8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb04d7fa640 10 client.25150 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb069515640 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557ec6ca5e40 0x557ec6ca8230 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1eedfbaab8ce5b5 server_cookie=ed22c5dd57514fe8 in_seq=0 out_seq=0 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb04d7fa640 1 -- 172.21.15.42:0/4169514896 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb0600d3030 con 0x557ec6ca5e40 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb04d7fa640 10 client.25150 handle_command_reply: tid=0 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb06e353740 1 client.25150 shutdown 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb06e353740 1 -- 172.21.15.42:0/4169514896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 msgr2=0x557ec6c2ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb06e353740 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c2ac90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb06009a360 tx=0x7fb0600a4b80 comp rx=0 tx=0).stop 2024-09-19T09:39:57.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb06e353740 1 -- 172.21.15.42:0/4169514896 shutdown_connections 2024-09-19T09:39:57.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb06e353740 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557ec6ca5e40 0x557ec6ca8230 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb06e353740 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ec6c22370 0x557ec6c26500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb06e353740 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557ec6c18b40 0x557ec6c25fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb06e353740 1 --2- 172.21.15.42:0/4169514896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec6c175d0 0x557ec6c2ac90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb06e353740 1 -- 172.21.15.42:0/4169514896 >> 172.21.15.42:0/4169514896 conn(0x557ec6be0310 msgr2=0x557ec6c124e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:57.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.461+0000 7fb04d7fa640 0 client.25150 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:57.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06e353740 1 -- 172.21.15.42:0/4169514896 shutdown_connections 2024-09-19T09:39:57.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06e353740 1 -- 172.21.15.42:0/4169514896 wait complete. 2024-09-19T09:39:57.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06e353740 20 client.25150 trim_cache size 0 max 16384 2024-09-19T09:39:57.467 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:39:57.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06bf7a640 1 -- 172.21.15.42:0/2467078351 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb0500a32d0 msgr2=0x7fb0500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06bf7a640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb0500a32d0 0x7fb0500a5790 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009a60 tx=0x7fb05c009800 comp rx=0 tx=0).stop 2024-09-19T09:39:57.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06bf7a640 1 -- 172.21.15.42:0/2467078351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb064102d40 msgr2=0x7fb064198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:57.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06bf7a640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb064102d40 0x7fb064198340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb06000c920 tx=0x7fb06000cde0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06bf7a640 1 -- 172.21.15.42:0/2467078351 shutdown_connections 2024-09-19T09:39:57.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06bf7a640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb0500a32d0 0x7fb0500a5790 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06bf7a640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb06410c170 0x7fb06419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06bf7a640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb064103660 0x7fb064198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06bf7a640 1 --2- 172.21.15.42:0/2467078351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb064102d40 0x7fb064198340 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:57.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.462+0000 7fb06bf7a640 1 -- 172.21.15.42:0/2467078351 >> 172.21.15.42:0/2467078351 conn(0x7fb0640fc7a0 msgr2=0x7fb0640fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:57.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.463+0000 7fb06bf7a640 1 -- 172.21.15.42:0/2467078351 shutdown_connections 2024-09-19T09:39:57.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:57.463+0000 7fb06bf7a640 1 -- 172.21.15.42:0/2467078351 wait complete. 2024-09-19T09:39:57.667 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:57 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1878084547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:57.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:57 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1878084547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:57 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1878084547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:58.110 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id 3e10ce17 --release --await' 2024-09-19T09:39:58.110 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id 3e10ce17 --release --await 2024-09-19T09:39:58.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:39:58 smithi136 ceph-mon[34840]: pgmap v356: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T09:39:58.819 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:39:58 smithi171 ceph-mon[35803]: pgmap v356: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T09:39:58.948 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:39:58 smithi042 ceph-mon[31223]: pgmap v356: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T09:39:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.015+0000 7ff41f54b640 1 -- 172.21.15.42:0/2549235495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4181078c0 msgr2=0x7ff418109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.015+0000 7ff41f54b640 1 --2- 172.21.15.42:0/2549235495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4181078c0 0x7ff418109cb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff410009ca0 tx=0x7ff41002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.016+0000 7ff41f54b640 1 -- 172.21.15.42:0/2549235495 shutdown_connections 2024-09-19T09:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.016+0000 7ff41f54b640 1 --2- 172.21.15.42:0/2549235495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4181078c0 0x7ff418109cb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.016+0000 7ff41f54b640 1 --2- 172.21.15.42:0/2549235495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff418104f90 0x7ff418107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.016+0000 7ff41f54b640 1 --2- 172.21.15.42:0/2549235495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff418102660 0x7ff418104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.016+0000 7ff41f54b640 1 -- 172.21.15.42:0/2549235495 >> 172.21.15.42:0/2549235495 conn(0x7ff4180fc1e0 msgr2=0x7ff4180fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.016+0000 7ff41f54b640 1 -- 172.21.15.42:0/2549235495 shutdown_connections 2024-09-19T09:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.016+0000 7ff41f54b640 1 -- 172.21.15.42:0/2549235495 wait complete. 2024-09-19T09:39:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.016+0000 7ff41f54b640 1 Processor -- start 2024-09-19T09:39:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.016+0000 7ff41f54b640 1 -- start start 2024-09-19T09:39:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41f54b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff418102660 0x7ff418197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41f54b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff418104f90 0x7ff418198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41f54b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4181078c0 0x7ff41819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41f54b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff41810d800 con 0x7ff418102660 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41f54b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff41810d680 con 0x7ff418104f90 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41f54b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff41810d980 con 0x7ff4181078c0 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41d2e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff418102660 0x7ff418197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41d2e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff418102660 0x7ff418197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52494/0 (socket says 172.21.15.42:52494) 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41d2e7640 1 -- 172.21.15.42:0/3281502609 learned_addr learned my addr 172.21.15.42:0/3281502609 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41cae6640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff418104f90 0x7ff418198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41dae8640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4181078c0 0x7ff41819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41dae8640 1 -- 172.21.15.42:0/3281502609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff418104f90 msgr2=0x7ff418198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41dae8640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff418104f90 0x7ff418198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41dae8640 1 -- 172.21.15.42:0/3281502609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff418102660 msgr2=0x7ff418197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41dae8640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff418102660 0x7ff418197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.017+0000 7ff41dae8640 1 -- 172.21.15.42:0/3281502609 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41819fa50 con 0x7ff4181078c0 2024-09-19T09:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.018+0000 7ff41cae6640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff418104f90 0x7ff418198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.018+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff418102660 0x7ff418197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.018+0000 7ff41dae8640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4181078c0 0x7ff41819f3e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff41002ade0 tx=0x7ff410004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.018+0000 7ff40e7fc640 1 -- 172.21.15.42:0/3281502609 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410003b70 con 0x7ff4181078c0 2024-09-19T09:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.018+0000 7ff41f54b640 1 -- 172.21.15.42:0/3281502609 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff418100450 con 0x7ff4181078c0 2024-09-19T09:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.018+0000 7ff40e7fc640 1 -- 172.21.15.42:0/3281502609 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff410003d10 con 0x7ff4181078c0 2024-09-19T09:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.018+0000 7ff40e7fc640 1 -- 172.21.15.42:0/3281502609 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410004810 con 0x7ff4181078c0 2024-09-19T09:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.018+0000 7ff41f54b640 1 -- 172.21.15.42:0/3281502609 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff418100970 con 0x7ff4181078c0 2024-09-19T09:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.021+0000 7ff4223c1740 1 Processor -- start 2024-09-19T09:39:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.022+0000 7ff40e7fc640 1 -- 172.21.15.42:0/3281502609 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7ff41003f810 con 0x7ff4181078c0 2024-09-19T09:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.022+0000 7ff4223c1740 1 -- start start 2024-09-19T09:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.022+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da39a0 0x561711da3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da42e0 0x561711da8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff4223c1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561711d072f0 con 0x561711da9370 2024-09-19T09:39:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff4223c1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561711caf270 con 0x561711da39a0 2024-09-19T09:39:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff4223c1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561711d032b0 con 0x561711da42e0 2024-09-19T09:39:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff41d2e7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da42e0 0x561711da8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff41d2e7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da42e0 0x561711da8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:36276/0 (socket says 172.21.15.42:36276) 2024-09-19T09:39:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff41d2e7640 1 -- 172.21.15.42:0/3880445272 learned_addr learned my addr 172.21.15.42:0/3880445272 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff41cae6640 1 --2- 172.21.15.42:0/3880445272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff41d2e7640 1 -- 172.21.15.42:0/3880445272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da39a0 msgr2=0x561711da3da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/3880445272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da39a0 0x561711da3da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff41d2e7640 1 -- 172.21.15.42:0/3880445272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 msgr2=0x561711dab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff40e7fc640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff4040a3390 0x7ff4040a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/3880445272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff41d2e7640 1 -- 172.21.15.42:0/3880445272 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561711cae340 con 0x561711da42e0 2024-09-19T09:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.023+0000 7ff41cae6640 1 --2- 172.21.15.42:0/3880445272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.024+0000 7ff40e7fc640 1 -- 172.21.15.42:0/3281502609 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ff4100f4d60 con 0x7ff4181078c0 2024-09-19T09:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.024+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/3880445272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da42e0 0x561711da8da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff414009fd0 tx=0x7ff414011ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f392fb3ea2a87c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.024+0000 7ff41cae6640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff4040a3390 0x7ff4040a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.024+0000 7ff4037fe640 1 -- 172.21.15.42:0/3880445272 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41401e070 con 0x561711da42e0 2024-09-19T09:39:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.024+0000 7ff4037fe640 1 -- 172.21.15.42:0/3880445272 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff41400fbd0 con 0x561711da42e0 2024-09-19T09:39:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.024+0000 7ff4037fe640 1 -- 172.21.15.42:0/3880445272 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414019d10 con 0x561711da42e0 2024-09-19T09:39:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.024+0000 7ff41cae6640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff4040a3390 0x7ff4040a5850 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff418199340 tx=0x7ff408011440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.025+0000 7ff4223c1740 1 -- 172.21.15.42:0/3880445272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da42e0 msgr2=0x561711da8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.025+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3880445272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da42e0 0x561711da8da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff414009fd0 tx=0x7ff414011ae0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.025+0000 7ff4223c1740 1 -- 172.21.15.42:0/3880445272 shutdown_connections 2024-09-19T09:39:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.025+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3880445272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.025+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3880445272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da42e0 0x561711da8da0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.025+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3880445272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da39a0 0x561711da3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.025+0000 7ff4223c1740 1 -- 172.21.15.42:0/3880445272 >> 172.21.15.42:0/3880445272 conn(0x561711d9f010 msgr2=0x561711d9f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.025+0000 7ff4223c1740 1 -- 172.21.15.42:0/3880445272 shutdown_connections 2024-09-19T09:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.025+0000 7ff4223c1740 1 -- 172.21.15.42:0/3880445272 wait complete. 2024-09-19T09:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.026+0000 7ff4223c1740 1 -- start start 2024-09-19T09:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.026+0000 7ff4223c1740 1 Processor -- start 2024-09-19T09:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.026+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da39a0 0x561711dadc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711dae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da9370 0x561711db51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff4223c1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561711dac340 con 0x561711da42e0 2024-09-19T09:39:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff4223c1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561711c90290 con 0x561711da39a0 2024-09-19T09:39:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff4223c1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561711dac4c0 con 0x561711da9370 2024-09-19T09:39:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff4223c1740 10 client.0 _ll_register_callbacks cb 0x561711cc1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41cae6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711dae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41d2e7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da39a0 0x561711dadc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41dae8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da9370 0x561711db51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41cae6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711dae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52498/0 (socket says 172.21.15.42:52498) 2024-09-19T09:39:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41cae6640 1 -- 172.21.15.42:0/3742929536 learned_addr learned my addr 172.21.15.42:0/3742929536 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41dae8640 1 -- 172.21.15.42:0/3742929536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da39a0 msgr2=0x561711dadc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41dae8640 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da39a0 0x561711dadc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41dae8640 1 -- 172.21.15.42:0/3742929536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 msgr2=0x561711dae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41dae8640 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711dae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41dae8640 1 -- 172.21.15.42:0/3742929536 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561711a1a210 con 0x561711da9370 2024-09-19T09:39:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da39a0 0x561711dadc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.027+0000 7ff41cae6640 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711dae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff41dae8640 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da9370 0x561711db51a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4100f2800 tx=0x7ff4100c0f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e69ec393e7fd037a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff400ff9640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:39:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff400ff9640 1 -- 172.21.15.42:0/3742929536 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100c56c0 con 0x561711da9370 2024-09-19T09:39:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff4223c1740 1 -- 172.21.15.42:0/3742929536 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff41400fbd0 con 0x561711da9370 2024-09-19T09:39:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff400ff9640 1 -- 172.21.15.42:0/3742929536 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ff410003ec0 con 0x561711da9370 2024-09-19T09:39:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff400ff9640 1 -- 172.21.15.42:0/3742929536 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4100c9f80 con 0x561711da9370 2024-09-19T09:39:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff4223c1740 10 client.25162 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff4223c1740 1 -- 172.21.15.42:0/3742929536 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561711ae6620 con 0x561711da9370 2024-09-19T09:39:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff400ff9640 1 -- 172.21.15.42:0/3742929536 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff41400fbd0 con 0x561711da9370 2024-09-19T09:39:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff400ff9640 1 -- 172.21.15.42:0/3742929536 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4100c1570 con 0x561711da9370 2024-09-19T09:39:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.028+0000 7ff4223c1740 10 client.25162 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.029+0000 7ff4223c1740 10 client.25162 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.029+0000 7ff4223c1740 20 client.25162 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.029+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561711db98b0 0x561711dbbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.029+0000 7ff4223c1740 4 client.25162 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.029+0000 7ff4223c1740 1 -- 172.21.15.42:0/3742929536 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561711d14a20 con 0x561711db98b0 2024-09-19T09:39:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.029+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561711db98b0 0x561711dbbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.029+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561711db98b0 0x561711dbbca0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab2db4db5ec556ba server_cookie=67e19dc2faf4162b in_seq=0 out_seq=0 2024-09-19T09:39:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.029+0000 7ff400ff9640 10 client.25162 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff400ff9640 1 -- 172.21.15.42:0/3742929536 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561711d14a20 con 0x561711db98b0 2024-09-19T09:39:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff400ff9640 10 client.25162 handle_command_reply: tid=0 2024-09-19T09:39:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff4223c1740 1 client.25162 shutdown 2024-09-19T09:39:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff4223c1740 1 -- 172.21.15.42:0/3742929536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da9370 msgr2=0x561711db51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da9370 0x561711db51a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4100f2800 tx=0x7ff4100c0f10 comp rx=0 tx=0).stop 2024-09-19T09:39:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff4223c1740 1 -- 172.21.15.42:0/3742929536 shutdown_connections 2024-09-19T09:39:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561711db98b0 0x561711dbbca0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff400ff9640 0 client.25162 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da9370 0x561711db51a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711dae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3742929536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da39a0 0x561711dadc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.030+0000 7ff4223c1740 1 -- 172.21.15.42:0/3742929536 >> 172.21.15.42:0/3742929536 conn(0x561711d9f010 msgr2=0x561711da0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.031+0000 7ff4223c1740 1 -- 172.21.15.42:0/3742929536 shutdown_connections 2024-09-19T09:39:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.031+0000 7ff4223c1740 1 -- 172.21.15.42:0/3742929536 wait complete. 2024-09-19T09:39:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.031+0000 7ff4223c1740 20 client.25162 trim_cache size 0 max 16384 2024-09-19T09:39:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff4223c1740 1 Processor -- start 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff4223c1740 1 -- start start 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711d9e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da42e0 0x561711db5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dc0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff4223c1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181a6d60 con 0x561711da9370 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff4223c1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181a88a0 con 0x561711da42e0 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff4223c1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181a7430 con 0x561711da39a0 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff41dae8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dc0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff41d2e7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711d9e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff41dae8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dc0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52510/0 (socket says 172.21.15.42:52510) 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff41dae8640 1 -- 172.21.15.42:0/3631239541 learned_addr learned my addr 172.21.15.42:0/3631239541 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff41cae6640 1 --2- 172.21.15.42:0/3631239541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da42e0 0x561711db5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff41dae8640 1 -- 172.21.15.42:0/3631239541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 msgr2=0x561711d9e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff41dae8640 1 --2- 172.21.15.42:0/3631239541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711d9e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.046+0000 7ff41dae8640 1 -- 172.21.15.42:0/3631239541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da42e0 msgr2=0x561711db5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.047+0000 7ff41dae8640 1 --2- 172.21.15.42:0/3631239541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da42e0 0x561711db5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.047+0000 7ff41dae8640 1 -- 172.21.15.42:0/3631239541 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561711da47c0 con 0x561711da9370 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.047+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/3631239541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711d9e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.047+0000 7ff41cae6640 1 --2- 172.21.15.42:0/3631239541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da42e0 0x561711db5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.047+0000 7ff41dae8640 1 --2- 172.21.15.42:0/3631239541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dc0570 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff4100f2830 tx=0x7ff410005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b19b5475d3d92c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.047+0000 7ff402ffd640 1 -- 172.21.15.42:0/3631239541 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100bd5b0 con 0x561711da9370 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.047+0000 7ff402ffd640 1 -- 172.21.15.42:0/3631239541 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff410036040 con 0x561711da9370 2024-09-19T09:39:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.047+0000 7ff402ffd640 1 -- 172.21.15.42:0/3631239541 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100bdb10 con 0x561711da9370 2024-09-19T09:39:59.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 -- 172.21.15.42:0/3631239541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 msgr2=0x561711dc0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3631239541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dc0570 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff4100f2830 tx=0x7ff410005c30 comp rx=0 tx=0).stop 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 -- 172.21.15.42:0/3631239541 shutdown_connections 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3631239541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da9370 0x561711dc0570 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3631239541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da42e0 0x561711db5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 --2- 172.21.15.42:0/3631239541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711d9e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 -- 172.21.15.42:0/3631239541 >> 172.21.15.42:0/3631239541 conn(0x561711d9f010 msgr2=0x561711d9d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 -- 172.21.15.42:0/3631239541 shutdown_connections 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 -- 172.21.15.42:0/3631239541 wait complete. 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 -- start start 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.048+0000 7ff4223c1740 1 Processor -- start 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711db2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711db2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff4223c1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da9370 0x561711db3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff4223c1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181a81d0 con 0x561711da42e0 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff4223c1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181a7b00 con 0x561711da9370 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff4223c1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181a4d40 con 0x561711da39a0 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff4223c1740 10 client.0 _ll_register_callbacks cb 0x7ff410005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff41d2e7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711db2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff41cae6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711db2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff41d2e7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711db2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:36304/0 (socket says 172.21.15.42:36304) 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff41d2e7640 1 -- 172.21.15.42:0/595681260 learned_addr learned my addr 172.21.15.42:0/595681260 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff41dae8640 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da9370 0x561711db3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff41d2e7640 1 -- 172.21.15.42:0/595681260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da9370 msgr2=0x561711db3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da9370 0x561711db3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.049+0000 7ff41d2e7640 1 -- 172.21.15.42:0/595681260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 msgr2=0x561711db2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711db2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff41d2e7640 1 -- 172.21.15.42:0/595681260 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561711db42d0 con 0x561711da39a0 2024-09-19T09:39:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff41cae6640 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711db2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff41d2e7640 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711db2810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff41400f3c0 tx=0x7ff414009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a99cc7e041a456b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff400ff9640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:39:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff400ff9640 1 -- 172.21.15.42:0/595681260 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414030060 con 0x561711da39a0 2024-09-19T09:39:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff400ff9640 1 -- 172.21.15.42:0/595681260 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ff41400fd10 con 0x561711da39a0 2024-09-19T09:39:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff4223c1740 1 -- 172.21.15.42:0/595681260 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff410036040 con 0x561711da39a0 2024-09-19T09:39:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff400ff9640 1 -- 172.21.15.42:0/595681260 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff414028070 con 0x561711da39a0 2024-09-19T09:39:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff4223c1740 10 client.25168 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff4223c1740 1 -- 172.21.15.42:0/595681260 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561711e24550 con 0x561711da39a0 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.050+0000 7ff400ff9640 1 -- 172.21.15.42:0/595681260 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff414005bf0 con 0x561711da39a0 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.051+0000 7ff400ff9640 1 -- 172.21.15.42:0/595681260 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4140035f0 con 0x561711da39a0 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.051+0000 7ff4223c1740 10 client.25168 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.051+0000 7ff4223c1740 10 client.25168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.051+0000 7ff4223c1740 20 client.25168 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.051+0000 7ff4223c1740 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561711db98b0 0x561711e26d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.051+0000 7ff4223c1740 4 client.25168 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.051+0000 7ff4223c1740 1 -- 172.21.15.42:0/595681260 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7ff410036040 con 0x561711db98b0 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.051+0000 7ff41cae6640 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561711db98b0 0x561711e26d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.051+0000 7ff400ff9640 10 client.25168 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.052+0000 7ff41cae6640 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561711db98b0 0x561711e26d70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ced5924d13a1305 server_cookie=caec358e87b2c754 in_seq=0 out_seq=0 2024-09-19T09:39:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff400ff9640 1 -- 172.21.15.42:0/595681260 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7ff410036040 con 0x561711db98b0 2024-09-19T09:39:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff400ff9640 10 client.25168 handle_command_reply: tid=0 2024-09-19T09:39:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 client.25168 shutdown 2024-09-19T09:39:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 -- 172.21.15.42:0/595681260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 msgr2=0x561711db2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711db2810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff41400f3c0 tx=0x7ff414009310 comp rx=0 tx=0).stop 2024-09-19T09:39:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 -- 172.21.15.42:0/595681260 shutdown_connections 2024-09-19T09:39:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561711db98b0 0x561711e26d70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff400ff9640 0 client.25168 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561711da9370 0x561711db3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561711da42e0 0x561711db2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 --2- 172.21.15.42:0/595681260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561711da39a0 0x561711db2810 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 -- 172.21.15.42:0/595681260 >> 172.21.15.42:0/595681260 conn(0x561711d9f010 msgr2=0x561711d9e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 -- 172.21.15.42:0/595681260 shutdown_connections 2024-09-19T09:39:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 1 -- 172.21.15.42:0/595681260 wait complete. 2024-09-19T09:39:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.060+0000 7ff4223c1740 20 client.25168 trim_cache size 0 max 16384 2024-09-19T09:39:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:39:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:39:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:39:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:39:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 -- 172.21.15.42:0/3281502609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff4040a3390 msgr2=0x7ff4040a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff4040a3390 0x7ff4040a5850 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff418199340 tx=0x7ff408011440 comp rx=0 tx=0).stop 2024-09-19T09:39:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 -- 172.21.15.42:0/3281502609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4181078c0 msgr2=0x7ff41819f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4181078c0 0x7ff41819f3e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff41002ade0 tx=0x7ff410004ab0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 -- 172.21.15.42:0/3281502609 shutdown_connections 2024-09-19T09:39:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff4040a3390 0x7ff4040a5850 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4181078c0 0x7ff41819f3e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff418104f90 0x7ff418198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 --2- 172.21.15.42:0/3281502609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff418102660 0x7ff418197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 -- 172.21.15.42:0/3281502609 >> 172.21.15.42:0/3281502609 conn(0x7ff4180fc1e0 msgr2=0x7ff418102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 -- 172.21.15.42:0/3281502609 shutdown_connections 2024-09-19T09:39:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:39:59.061+0000 7ff41f54b640 1 -- 172.21.15.42:0/3281502609 wait complete. 2024-09-19T09:39:59.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.343+0000 7f1d4762a640 1 -- 172.21.15.42:0/84201261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d40100e20 msgr2=0x7f1d40101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.343+0000 7f1d4762a640 1 --2- 172.21.15.42:0/84201261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d40100e20 0x7f1d40101200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009890 tx=0x7f1d3c02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.343+0000 7f1d4762a640 1 -- 172.21.15.42:0/84201261 shutdown_connections 2024-09-19T09:39:59.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.343+0000 7f1d4762a640 1 --2- 172.21.15.42:0/84201261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d40102ef0 0x7f1d4010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.343+0000 7f1d4762a640 1 --2- 172.21.15.42:0/84201261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d40102570 0x7f1d401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.343+0000 7f1d4762a640 1 --2- 172.21.15.42:0/84201261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d40100e20 0x7f1d40101200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.343+0000 7f1d4762a640 1 -- 172.21.15.42:0/84201261 >> 172.21.15.42:0/84201261 conn(0x7f1d400fc7d0 msgr2=0x7f1d400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.344+0000 7f1d4762a640 1 -- 172.21.15.42:0/84201261 shutdown_connections 2024-09-19T09:39:59.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.344+0000 7f1d4762a640 1 -- 172.21.15.42:0/84201261 wait complete. 2024-09-19T09:39:59.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.345+0000 7f1d4762a640 1 Processor -- start 2024-09-19T09:39:59.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.345+0000 7f1d4762a640 1 -- start start 2024-09-19T09:39:59.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.345+0000 7f1d4762a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d40100e20 0x7f1d40199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.345+0000 7f1d4762a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d40102570 0x7f1d40199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d4762a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d40102ef0 0x7f1d401a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d453c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d40100e20 0x7f1d40199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d453c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d40100e20 0x7f1d40199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52540/0 (socket says 172.21.15.42:52540) 2024-09-19T09:39:59.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d453c6640 1 -- 172.21.15.42:0/2175374321 learned_addr learned my addr 172.21.15.42:0/2175374321 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:59.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1d40110f50 con 0x7f1d40100e20 2024-09-19T09:39:59.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1d40110dd0 con 0x7f1d40102ef0 2024-09-19T09:39:59.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401110d0 con 0x7f1d40102570 2024-09-19T09:39:59.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d45bc7640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d40102ef0 0x7f1d401a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d40102570 0x7f1d40199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d45bc7640 1 -- 172.21.15.42:0/2175374321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d40102570 msgr2=0x7f1d40199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d45bc7640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d40102570 0x7f1d40199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d45bc7640 1 -- 172.21.15.42:0/2175374321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d40100e20 msgr2=0x7f1d40199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d45bc7640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d40100e20 0x7f1d40199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d45bc7640 1 -- 172.21.15.42:0/2175374321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d401a4a00 con 0x7f1d40102ef0 2024-09-19T09:39:59.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d453c6640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d40100e20 0x7f1d40199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:59.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.346+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d40102570 0x7f1d40199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:59.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.347+0000 7f1d45bc7640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d40102ef0 0x7f1d401a44c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009fd0 tx=0x7f1d3800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.347+0000 7f1d367fc640 1 -- 172.21.15.42:0/2175374321 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800ce20 con 0x7f1d40102ef0 2024-09-19T09:39:59.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.347+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d40197230 con 0x7f1d40102ef0 2024-09-19T09:39:59.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.347+0000 7f1d367fc640 1 -- 172.21.15.42:0/2175374321 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d380137d0 con 0x7f1d40102ef0 2024-09-19T09:39:59.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.347+0000 7f1d367fc640 1 -- 172.21.15.42:0/2175374321 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380055e0 con 0x7f1d40102ef0 2024-09-19T09:39:59.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.347+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d40197720 con 0x7f1d40102ef0 2024-09-19T09:39:59.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.350+0000 7f1d49a03740 1 Processor -- start 2024-09-19T09:39:59.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.350+0000 7f1d367fc640 1 -- 172.21.15.42:0/2175374321 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f1d38013980 con 0x7f1d40102ef0 2024-09-19T09:39:59.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.351+0000 7f1d49a03740 1 -- start start 2024-09-19T09:39:59.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.351+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538060 0x561214538440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.351+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214542d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.351+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214545630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.351+0000 7f1d49a03740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56121449d620 con 0x561214543240 2024-09-19T09:39:59.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.351+0000 7f1d49a03740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561214444e50 con 0x561214538980 2024-09-19T09:39:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.351+0000 7f1d49a03740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5612144995e0 con 0x561214538060 2024-09-19T09:39:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.351+0000 7f1d44bc5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214545630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.351+0000 7f1d44bc5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214545630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52544/0 (socket says 172.21.15.42:52544) 2024-09-19T09:39:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.352+0000 7f1d44bc5640 1 -- 172.21.15.42:0/3453587192 learned_addr learned my addr 172.21.15.42:0/3453587192 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.352+0000 7f1d367fc640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1d2c0a3350 0x7f1d2c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.352+0000 7f1d453c6640 1 --2- 172.21.15.42:0/3453587192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214542d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.352+0000 7f1d367fc640 1 -- 172.21.15.42:0/2175374321 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f1d380d41a0 con 0x7f1d40102ef0 2024-09-19T09:39:59.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.352+0000 7f1d45bc7640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1d2c0a3350 0x7f1d2c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.352+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/3453587192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538060 0x561214538440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.353+0000 7f1d45bc7640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1d2c0a3350 0x7f1d2c0a5810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1d380a06e0 tx=0x7f1d38005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.353+0000 7f1d44bc5640 1 -- 172.21.15.42:0/3453587192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538060 msgr2=0x561214538440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.353+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/3453587192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538060 0x561214538440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.353+0000 7f1d44bc5640 1 -- 172.21.15.42:0/3453587192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 msgr2=0x561214542d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.353+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/3453587192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214542d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.353+0000 7f1d44bc5640 1 -- 172.21.15.42:0/3453587192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561214435d40 con 0x561214543240 2024-09-19T09:39:59.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.353+0000 7f1d453c6640 1 --2- 172.21.15.42:0/3453587192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214542d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:59.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.353+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/3453587192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214545630 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009fd0 tx=0x7f1d30009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97edcc4c9a80f88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.353+0000 7f1d2b7fe640 1 -- 172.21.15.42:0/3453587192 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3001b020 con 0x561214543240 2024-09-19T09:39:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.353+0000 7f1d2b7fe640 1 -- 172.21.15.42:0/3453587192 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d300035f0 con 0x561214543240 2024-09-19T09:39:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.354+0000 7f1d2b7fe640 1 -- 172.21.15.42:0/3453587192 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30011800 con 0x561214543240 2024-09-19T09:39:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.354+0000 7f1d49a03740 1 -- 172.21.15.42:0/3453587192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 msgr2=0x561214545630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.354+0000 7f1d49a03740 1 --2- 172.21.15.42:0/3453587192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214545630 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009fd0 tx=0x7f1d30009970 comp rx=0 tx=0).stop 2024-09-19T09:39:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.355+0000 7f1d49a03740 1 -- 172.21.15.42:0/3453587192 shutdown_connections 2024-09-19T09:39:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.355+0000 7f1d49a03740 1 --2- 172.21.15.42:0/3453587192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214545630 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.355+0000 7f1d49a03740 1 --2- 172.21.15.42:0/3453587192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214542d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.355+0000 7f1d49a03740 1 --2- 172.21.15.42:0/3453587192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538060 0x561214538440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.355+0000 7f1d49a03740 1 -- 172.21.15.42:0/3453587192 >> 172.21.15.42:0/3453587192 conn(0x5612145345f0 msgr2=0x5612145349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.355+0000 7f1d49a03740 1 -- 172.21.15.42:0/3453587192 shutdown_connections 2024-09-19T09:39:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.355+0000 7f1d49a03740 1 -- 172.21.15.42:0/3453587192 wait complete. 2024-09-19T09:39:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.355+0000 7f1d49a03740 1 -- start start 2024-09-19T09:39:59.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.355+0000 7f1d49a03740 1 Processor -- start 2024-09-19T09:39:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538060 0x561214540020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214540560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214540aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d49a03740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561214545eb0 con 0x561214543240 2024-09-19T09:39:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d49a03740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561214425f10 con 0x561214538980 2024-09-19T09:39:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d49a03740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561214546030 con 0x561214538060 2024-09-19T09:39:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d49a03740 10 client.0 _ll_register_callbacks cb 0x561214449db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d453c6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214540560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d453c6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214540560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:54256/0 (socket says 172.21.15.42:54256) 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d453c6640 1 -- 172.21.15.42:0/4021240899 learned_addr learned my addr 172.21.15.42:0/4021240899 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.356+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538060 0x561214540020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214540aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d453c6640 1 -- 172.21.15.42:0/4021240899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538060 msgr2=0x561214540020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d453c6640 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538060 0x561214540020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d453c6640 1 -- 172.21.15.42:0/4021240899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 msgr2=0x561214540aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d453c6640 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214540aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d453c6640 1 -- 172.21.15.42:0/4021240899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612141ac580 con 0x561214538980 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214540aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d453c6640 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214540560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c030550 tx=0x7f1d3c005d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dcfdab27afff5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d28ff9640 1 -- 172.21.15.42:0/4021240899 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c041020 con 0x561214538980 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d28ff9640 1 -- 172.21.15.42:0/4021240899 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f1d3c005450 con 0x561214538980 2024-09-19T09:39:59.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.357+0000 7f1d49a03740 1 -- 172.21.15.42:0/4021240899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d300035f0 con 0x561214538980 2024-09-19T09:39:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.358+0000 7f1d28ff9640 1 -- 172.21.15.42:0/4021240899 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1d3c04c050 con 0x561214538980 2024-09-19T09:39:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.358+0000 7f1d49a03740 10 client.25235 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.358+0000 7f1d49a03740 1 -- 172.21.15.42:0/4021240899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561214276960 con 0x561214538980 2024-09-19T09:39:59.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.358+0000 7f1d28ff9640 1 -- 172.21.15.42:0/4021240899 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d3c038040 con 0x561214538980 2024-09-19T09:39:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.359+0000 7f1d28ff9640 1 -- 172.21.15.42:0/4021240899 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1d3c0038f0 con 0x561214538980 2024-09-19T09:39:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.359+0000 7f1d49a03740 10 client.25235 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.359+0000 7f1d49a03740 10 client.25235 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:39:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.359+0000 7f1d49a03740 20 client.25235 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.359+0000 7f1d49a03740 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561214552e70 0x561214555290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.359+0000 7f1d49a03740 4 client.25235 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.359+0000 7f1d49a03740 1 -- 172.21.15.42:0/4021240899 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1d300035f0 con 0x561214552e70 2024-09-19T09:39:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.360+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561214552e70 0x561214555290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.360+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561214552e70 0x561214555290 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=119e1de5010126eb server_cookie=ebfd5be9dd4913d8 in_seq=0 out_seq=0 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.360+0000 7f1d28ff9640 10 client.25235 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d28ff9640 1 -- 172.21.15.42:0/4021240899 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1d300035f0 con 0x561214552e70 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d28ff9640 10 client.25235 handle_command_reply: tid=0 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d49a03740 1 client.25235 shutdown 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d49a03740 1 -- 172.21.15.42:0/4021240899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 msgr2=0x561214540560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d49a03740 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214540560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c030550 tx=0x7f1d3c005d20 comp rx=0 tx=0).stop 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d49a03740 1 -- 172.21.15.42:0/4021240899 shutdown_connections 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d49a03740 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x561214552e70 0x561214555290 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d49a03740 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214543240 0x561214540aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d49a03740 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214540560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d49a03740 1 --2- 172.21.15.42:0/4021240899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538060 0x561214540020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.361+0000 7f1d49a03740 1 -- 172.21.15.42:0/4021240899 >> 172.21.15.42:0/4021240899 conn(0x5612145345f0 msgr2=0x56121453a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.362+0000 7f1d28ff9640 0 client.25235 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:59.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.362+0000 7f1d49a03740 1 -- 172.21.15.42:0/4021240899 shutdown_connections 2024-09-19T09:39:59.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.362+0000 7f1d49a03740 1 -- 172.21.15.42:0/4021240899 wait complete. 2024-09-19T09:39:59.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.362+0000 7f1d49a03740 20 client.25235 trim_cache size 0 max 16384 2024-09-19T09:39:59.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.395+0000 7f1d49a03740 1 Processor -- start 2024-09-19T09:39:59.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.396+0000 7f1d49a03740 1 -- start start 2024-09-19T09:39:59.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.396+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x56121453eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.396+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538980 0x56121455ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.396+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214543240 0x56121455b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.396+0000 7f1d49a03740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401ab3e0 con 0x561214538060 2024-09-19T09:39:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.396+0000 7f1d44bc5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x56121453eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d49a03740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401acf20 con 0x561214543240 2024-09-19T09:39:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d44bc5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x56121453eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52558/0 (socket says 172.21.15.42:52558) 2024-09-19T09:39:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d44bc5640 1 -- 172.21.15.42:0/3964091828 learned_addr learned my addr 172.21.15.42:0/3964091828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d49a03740 1 -- 172.21.15.42:0/3964091828 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401abab0 con 0x561214538980 2024-09-19T09:39:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d453c6640 1 --2- 172.21.15.42:0/3964091828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538980 0x56121455ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d453c6640 1 -- 172.21.15.42:0/3964091828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214543240 msgr2=0x56121455b080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:39:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d453c6640 1 --2- 172.21.15.42:0/3964091828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214543240 0x56121455b080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d453c6640 1 -- 172.21.15.42:0/3964091828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 msgr2=0x56121453eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d453c6640 1 --2- 172.21.15.42:0/3964091828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x56121453eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d453c6640 1 -- 172.21.15.42:0/3964091828 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561214534420 con 0x561214538980 2024-09-19T09:39:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/3964091828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x56121453eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.397+0000 7f1d453c6640 1 --2- 172.21.15.42:0/3964091828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538980 0x56121455ab40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x5612145415d0 tx=0x7f1d3c02ab30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1c10d0f6b801ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.398+0000 7f1d2affd640 1 -- 172.21.15.42:0/3964091828 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c054070 con 0x561214538980 2024-09-19T09:39:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.398+0000 7f1d2affd640 1 -- 172.21.15.42:0/3964091828 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d3c0309b0 con 0x561214538980 2024-09-19T09:39:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.398+0000 7f1d2affd640 1 -- 172.21.15.42:0/3964091828 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c037040 con 0x561214538980 2024-09-19T09:39:59.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.399+0000 7f1d49a03740 1 -- 172.21.15.42:0/3964091828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538980 msgr2=0x56121455ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.399+0000 7f1d49a03740 1 --2- 172.21.15.42:0/3964091828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538980 0x56121455ab40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x5612145415d0 tx=0x7f1d3c02ab30 comp rx=0 tx=0).stop 2024-09-19T09:39:59.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.399+0000 7f1d49a03740 1 -- 172.21.15.42:0/3964091828 shutdown_connections 2024-09-19T09:39:59.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.399+0000 7f1d49a03740 1 --2- 172.21.15.42:0/3964091828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214543240 0x56121455b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.399+0000 7f1d49a03740 1 --2- 172.21.15.42:0/3964091828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214538980 0x56121455ab40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.399+0000 7f1d49a03740 1 --2- 172.21.15.42:0/3964091828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x56121453eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.399+0000 7f1d49a03740 1 -- 172.21.15.42:0/3964091828 >> 172.21.15.42:0/3964091828 conn(0x5612145345f0 msgr2=0x56121453e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.399+0000 7f1d49a03740 1 -- 172.21.15.42:0/3964091828 shutdown_connections 2024-09-19T09:39:59.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.399+0000 7f1d49a03740 1 -- 172.21.15.42:0/3964091828 wait complete. 2024-09-19T09:39:59.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.400+0000 7f1d49a03740 1 -- start start 2024-09-19T09:39:59.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.400+0000 7f1d49a03740 1 Processor -- start 2024-09-19T09:39:59.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x561214547780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214547cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d49a03740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214543240 0x5612145bcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d44bc5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x561214547780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d49a03740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401ac850 con 0x561214538060 2024-09-19T09:39:59.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d44bc5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x561214547780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52560/0 (socket says 172.21.15.42:52560) 2024-09-19T09:39:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d44bc5640 1 -- 172.21.15.42:0/1325858521 learned_addr learned my addr 172.21.15.42:0/1325858521 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:39:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d49a03740 1 -- 172.21.15.42:0/1325858521 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401ac180 con 0x561214538980 2024-09-19T09:39:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d49a03740 1 -- 172.21.15.42:0/1325858521 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401a9470 con 0x561214543240 2024-09-19T09:39:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d49a03740 10 client.0 _ll_register_callbacks cb 0x7f1d3c0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.401+0000 7f1d453c6640 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214547cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.402+0000 7f1d44bc5640 1 -- 172.21.15.42:0/1325858521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214543240 msgr2=0x5612145bcb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:39:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.402+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214543240 0x5612145bcb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.402+0000 7f1d44bc5640 1 -- 172.21.15.42:0/1325858521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 msgr2=0x561214547cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.402+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214547cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.402+0000 7f1d44bc5640 1 -- 172.21.15.42:0/1325858521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612145bd050 con 0x561214538060 2024-09-19T09:39:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.402+0000 7f1d453c6640 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214547cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.402+0000 7f1d44bc5640 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x561214547780 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1d30006010 tx=0x7f1d30009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9af2a4daf4ba4bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.402+0000 7f1d28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:39:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.402+0000 7f1d28ff9640 1 -- 172.21.15.42:0/1325858521 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3001b040 con 0x561214538060 2024-09-19T09:39:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.403+0000 7f1d28ff9640 1 -- 172.21.15.42:0/1325858521 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f1d300052c0 con 0x561214538060 2024-09-19T09:39:59.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.403+0000 7f1d49a03740 1 -- 172.21.15.42:0/1325858521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d3c0309b0 con 0x561214538060 2024-09-19T09:39:59.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.403+0000 7f1d28ff9640 1 -- 172.21.15.42:0/1325858521 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1d300054c0 con 0x561214538060 2024-09-19T09:39:59.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.403+0000 7f1d49a03740 10 client.15690 fetch_fsmap learned FSMap version 28 2024-09-19T09:39:59.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.403+0000 7f1d49a03740 1 -- 172.21.15.42:0/1325858521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5612145be340 con 0x561214538060 2024-09-19T09:39:59.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.403+0000 7f1d28ff9640 1 -- 172.21.15.42:0/1325858521 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d3c0309b0 con 0x561214538060 2024-09-19T09:39:59.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.404+0000 7f1d28ff9640 1 -- 172.21.15.42:0/1325858521 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1d30011620 con 0x561214538060 2024-09-19T09:39:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.404+0000 7f1d49a03740 10 client.15690 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:39:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.404+0000 7f1d49a03740 10 client.15690 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:39:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.404+0000 7f1d49a03740 20 client.15690 populate_metadata read hostname 'smithi042' 2024-09-19T09:39:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.404+0000 7f1d49a03740 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5612145be970 0x5612145c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.404+0000 7f1d49a03740 4 client.15690 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3e10ce17", "release": true, "await": true}] 2024-09-19T09:39:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.404+0000 7f1d49a03740 1 -- 172.21.15.42:0/1325858521 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3e10ce17", "release": true, "await": true}) -- 0x5612144aab90 con 0x5612145be970 2024-09-19T09:39:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.405+0000 7f1d453c6640 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5612145be970 0x5612145c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.405+0000 7f1d453c6640 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5612145be970 0x5612145c0d60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe5e236a33599357 server_cookie=3e0cffdc96b0cfd5 in_seq=0 out_seq=0 2024-09-19T09:39:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.405+0000 7f1d28ff9640 10 client.15690 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:59.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d28ff9640 1 -- 172.21.15.42:0/1325858521 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5612144aab90 con 0x5612145be970 2024-09-19T09:39:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d28ff9640 10 client.15690 handle_command_reply: tid=0 2024-09-19T09:39:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d49a03740 1 client.15690 shutdown 2024-09-19T09:39:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d49a03740 1 -- 172.21.15.42:0/1325858521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 msgr2=0x561214547780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d49a03740 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x561214547780 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1d30006010 tx=0x7f1d30009970 comp rx=0 tx=0).stop 2024-09-19T09:39:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d49a03740 1 -- 172.21.15.42:0/1325858521 shutdown_connections 2024-09-19T09:39:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d49a03740 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5612145be970 0x5612145c0d60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d49a03740 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561214543240 0x5612145bcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d49a03740 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561214538980 0x561214547cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d49a03740 1 --2- 172.21.15.42:0/1325858521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561214538060 0x561214547780 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d49a03740 1 -- 172.21.15.42:0/1325858521 >> 172.21.15.42:0/1325858521 conn(0x5612145345f0 msgr2=0x56121453a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d28ff9640 0 client.15690 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:39:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.407+0000 7f1d49a03740 1 -- 172.21.15.42:0/1325858521 shutdown_connections 2024-09-19T09:39:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.408+0000 7f1d49a03740 1 -- 172.21.15.42:0/1325858521 wait complete. 2024-09-19T09:39:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.408+0000 7f1d49a03740 20 client.15690 trim_cache size 0 max 16384 2024-09-19T09:39:59.412 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:39:59.412 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 28, 2024-09-19T09:39:59.412 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 24506, 2024-09-19T09:39:59.412 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 4, 2024-09-19T09:39:59.412 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-09-19T09:39:59.412 INFO:teuthology.orchestra.run.smithi042.stdout: "3e10ce17": { 2024-09-19T09:39:59.412 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 4, 2024-09-19T09:39:59.412 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-09-19T09:39:59.412 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:39:59.412 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 131.2, 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:59.413 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:59.414 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:39:59.414 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1d2c0a3350 msgr2=0x7f1d2c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1d2c0a3350 0x7f1d2c0a5810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1d380a06e0 tx=0x7f1d38005f70 comp rx=0 tx=0).stop 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d40102ef0 msgr2=0x7f1d401a44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d40102ef0 0x7f1d401a44c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009fd0 tx=0x7f1d3800ef10 comp rx=0 tx=0).stop 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 shutdown_connections 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f1d2c0a3350 0x7f1d2c0a5810 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d40102ef0 0x7f1d401a44c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d40102570 0x7f1d40199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 --2- 172.21.15.42:0/2175374321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d40100e20 0x7f1d40199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 >> 172.21.15.42:0/2175374321 conn(0x7f1d400fc7d0 msgr2=0x7f1d401048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 shutdown_connections 2024-09-19T09:39:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:39:59.409+0000 7f1d4762a640 1 -- 172.21.15.42:0/2175374321 wait complete. 2024-09-19T09:39:59.706 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:39:59.706 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:40:00.163 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3e10ce17', total seconds elapsed: 15.4 2024-09-19T09:40:00.188 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:00.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.726+0000 7efec4c61640 1 -- 172.21.15.42:0/1306921872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efec010c160 msgr2=0x7efec010e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:00.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.726+0000 7efec4c61640 1 --2- 172.21.15.42:0/1306921872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efec010c160 0x7efec010e5e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009ca0 tx=0x7efeb802a950 comp rx=0 tx=0).stop 2024-09-19T09:40:00.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.726+0000 7efec4c61640 1 -- 172.21.15.42:0/1306921872 shutdown_connections 2024-09-19T09:40:00.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.726+0000 7efec4c61640 1 --2- 172.21.15.42:0/1306921872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efec010c160 0x7efec010e5e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.726+0000 7efec4c61640 1 --2- 172.21.15.42:0/1306921872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec01036a0 0x7efec010bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.726+0000 7efec4c61640 1 --2- 172.21.15.42:0/1306921872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec0102d80 0x7efec0103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.726+0000 7efec4c61640 1 -- 172.21.15.42:0/1306921872 >> 172.21.15.42:0/1306921872 conn(0x7efec00fc780 msgr2=0x7efec00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:00.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.726+0000 7efec4c61640 1 -- 172.21.15.42:0/1306921872 shutdown_connections 2024-09-19T09:40:00.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.726+0000 7efec4c61640 1 -- 172.21.15.42:0/1306921872 wait complete. 2024-09-19T09:40:00.729 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:00 smithi042 ceph-mon[31223]: pgmap v357: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:40:00.729 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:00 smithi042 ceph-mon[31223]: overall HEALTH_OK 2024-09-19T09:40:00.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.727+0000 7efec4c61640 1 Processor -- start 2024-09-19T09:40:00.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.727+0000 7efec4c61640 1 -- start start 2024-09-19T09:40:00.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.727+0000 7efec4c61640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec0102d80 0x7efec010ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.727+0000 7efec4c61640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efec01036a0 0x7efec010b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.727+0000 7efec4c61640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec010c160 0x7efec01a32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efec4c61640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efec0111f70 con 0x7efec01036a0 2024-09-19T09:40:00.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efec4c61640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efec0111df0 con 0x7efec0102d80 2024-09-19T09:40:00.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efec4c61640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efec01120f0 con 0x7efec010c160 2024-09-19T09:40:00.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efebe59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec0102d80 0x7efec010ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efebe59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec0102d80 0x7efec010ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:41294/0 (socket says 172.21.15.42:41294) 2024-09-19T09:40:00.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efebe59c640 1 -- 172.21.15.42:0/1953093458 learned_addr learned my addr 172.21.15.42:0/1953093458 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:00.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efebdd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efec01036a0 0x7efec010b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efebdd9b640 1 -- 172.21.15.42:0/1953093458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec010c160 msgr2=0x7efec01a32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:00.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efebdd9b640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec010c160 0x7efec01a32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efebdd9b640 1 -- 172.21.15.42:0/1953093458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec0102d80 msgr2=0x7efec010ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:00.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efebdd9b640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec0102d80 0x7efec010ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.728+0000 7efebdd9b640 1 -- 172.21.15.42:0/1953093458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec01a39f0 con 0x7efec01036a0 2024-09-19T09:40:00.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.729+0000 7efebdd9b640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efec01036a0 0x7efec010b3a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efeb400e9f0 tx=0x7efeb400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:00.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.729+0000 7efeaf7fe640 1 -- 172.21.15.42:0/1953093458 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb400ccc0 con 0x7efec01036a0 2024-09-19T09:40:00.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.729+0000 7efeaf7fe640 1 -- 172.21.15.42:0/1953093458 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeb4005020 con 0x7efec01036a0 2024-09-19T09:40:00.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.729+0000 7efec4c61640 1 -- 172.21.15.42:0/1953093458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec01a3ce0 con 0x7efec01036a0 2024-09-19T09:40:00.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.730+0000 7efeaf7fe640 1 -- 172.21.15.42:0/1953093458 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb40049e0 con 0x7efec01036a0 2024-09-19T09:40:00.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.730+0000 7efec4c61640 1 -- 172.21.15.42:0/1953093458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec01ab5a0 con 0x7efec01036a0 2024-09-19T09:40:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.733+0000 7efeaf7fe640 1 -- 172.21.15.42:0/1953093458 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7efeb4005560 con 0x7efec01036a0 2024-09-19T09:40:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.733+0000 7efec703a740 1 Processor -- start 2024-09-19T09:40:00.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.733+0000 7efec703a740 1 -- start start 2024-09-19T09:40:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.733+0000 7efec703a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 0x55d7470a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.733+0000 7efec703a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a4480 0x55d7470ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.733+0000 7efec703a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470aed40 0x55d7470b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.733+0000 7efec703a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d747009280 con 0x55d7470aed40 2024-09-19T09:40:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.733+0000 7efec703a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d746fb0b10 con 0x55d7470a4480 2024-09-19T09:40:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.733+0000 7efec703a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d747005240 con 0x55d7470a3b60 2024-09-19T09:40:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebe59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a4480 0x55d7470ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebdd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470aed40 0x55d7470b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebe59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a4480 0x55d7470ae800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:41304/0 (socket says 172.21.15.42:41304) 2024-09-19T09:40:00.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebe59c640 1 -- 172.21.15.42:0/3441616897 learned_addr learned my addr 172.21.15.42:0/3441616897 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebed9d640 1 --2- 172.21.15.42:0/3441616897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 0x55d7470a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebe59c640 1 -- 172.21.15.42:0/3441616897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 msgr2=0x55d7470a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebe59c640 1 --2- 172.21.15.42:0/3441616897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 0x55d7470a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebe59c640 1 -- 172.21.15.42:0/3441616897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470aed40 msgr2=0x55d7470b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebe59c640 1 --2- 172.21.15.42:0/3441616897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470aed40 0x55d7470b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebe59c640 1 -- 172.21.15.42:0/3441616897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d746fbd1f0 con 0x55d7470a4480 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebdd9b640 1 --2- 172.21.15.42:0/3441616897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470aed40 0x55d7470b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.734+0000 7efebe59c640 1 --2- 172.21.15.42:0/3441616897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a4480 0x55d7470ae800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009dc0 tx=0x7efeb0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab3336ba31d1bc90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.735+0000 7efeacff9640 1 -- 172.21.15.42:0/3441616897 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0005220 con 0x55d7470a4480 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.735+0000 7efeacff9640 1 -- 172.21.15.42:0/3441616897 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeb0004c80 con 0x55d7470a4480 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.735+0000 7efeacff9640 1 -- 172.21.15.42:0/3441616897 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb00199e0 con 0x55d7470a4480 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.735+0000 7efec703a740 1 -- 172.21.15.42:0/3441616897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a4480 msgr2=0x55d7470ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:00.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.735+0000 7efec703a740 1 --2- 172.21.15.42:0/3441616897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a4480 0x55d7470ae800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009dc0 tx=0x7efeb0011810 comp rx=0 tx=0).stop 2024-09-19T09:40:00.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.735+0000 7efec703a740 1 -- 172.21.15.42:0/3441616897 shutdown_connections 2024-09-19T09:40:00.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.735+0000 7efec703a740 1 --2- 172.21.15.42:0/3441616897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470aed40 0x55d7470b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.735+0000 7efec703a740 1 --2- 172.21.15.42:0/3441616897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a4480 0x55d7470ae800 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.735+0000 7efec703a740 1 --2- 172.21.15.42:0/3441616897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 0x55d7470a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.735+0000 7efec703a740 1 -- 172.21.15.42:0/3441616897 >> 172.21.15.42:0/3441616897 conn(0x55d7470a00f0 msgr2=0x55d7470a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:00.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.736+0000 7efeaf7fe640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efea80a3420 0x7efea80a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.736+0000 7efec703a740 1 -- 172.21.15.42:0/3441616897 shutdown_connections 2024-09-19T09:40:00.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.736+0000 7efebe59c640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efea80a3420 0x7efea80a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.736+0000 7efec703a740 1 -- 172.21.15.42:0/3441616897 wait complete. 2024-09-19T09:40:00.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efec703a740 1 -- start start 2024-09-19T09:40:00.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efec703a740 1 Processor -- start 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efebe59c640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efea80a3420 0x7efea80a58e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efeb001b040 tx=0x7efeb0019540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efeaf7fe640 1 -- 172.21.15.42:0/1953093458 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7efeb40cf990 con 0x7efec01036a0 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efec703a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a3b60 0x55d7470ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efec703a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efec703a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470aed40 0x55d7470ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efec703a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d7470b1910 con 0x55d7470a4480 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efec703a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d746fc3f10 con 0x55d7470a3b60 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efec703a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d7470b1a90 con 0x55d7470aed40 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.737+0000 7efec703a740 10 client.0 _ll_register_callbacks cb 0x55d746f8ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebdd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebdd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44304/0 (socket says 172.21.15.42:44304) 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebdd9b640 1 -- 172.21.15.42:0/134732098 learned_addr learned my addr 172.21.15.42:0/134732098 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebed9d640 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470aed40 0x55d7470ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebe59c640 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a3b60 0x55d7470ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebdd9b640 1 -- 172.21.15.42:0/134732098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470aed40 msgr2=0x55d7470ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebdd9b640 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470aed40 0x55d7470ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebdd9b640 1 -- 172.21.15.42:0/134732098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a3b60 msgr2=0x55d7470ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebdd9b640 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a3b60 0x55d7470ae7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebdd9b640 1 -- 172.21.15.42:0/134732098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d746d7a6a0 con 0x55d7470a4480 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efebdd9b640 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470abb10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efeb400c6a0 tx=0x7efeb40d3050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9a225542238589 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.738+0000 7efea5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efea5ffb640 1 -- 172.21.15.42:0/134732098 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb401c040 con 0x55d7470a4480 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efea5ffb640 1 -- 172.21.15.42:0/134732098 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7efeb4004c40 con 0x55d7470a4480 2024-09-19T09:40:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efec703a740 1 -- 172.21.15.42:0/134732098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb0004c80 con 0x55d7470a4480 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efea5ffb640 1 -- 172.21.15.42:0/134732098 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efeb409b970 con 0x55d7470a4480 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efec703a740 10 client.15702 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efec703a740 1 -- 172.21.15.42:0/134732098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d7470bd4b0 con 0x55d7470a4480 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efea5ffb640 1 -- 172.21.15.42:0/134732098 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeb0004c80 con 0x55d7470a4480 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efea5ffb640 1 -- 172.21.15.42:0/134732098 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efeb409b280 con 0x55d7470a4480 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efec703a740 10 client.15702 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efec703a740 10 client.15702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efec703a740 20 client.15702 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efec703a740 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d7470bedd0 0x55d7470c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efec703a740 4 client.15702 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.739+0000 7efec703a740 1 -- 172.21.15.42:0/134732098 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7470167f0 con 0x55d7470bedd0 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.740+0000 7efebe59c640 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d7470bedd0 0x55d7470c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.740+0000 7efea5ffb640 10 client.15702 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.740+0000 7efebe59c640 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d7470bedd0 0x55d7470c1270 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b7529cbe44946a server_cookie=eb82d56e070cbf82 in_seq=0 out_seq=0 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.741+0000 7efea5ffb640 1 -- 172.21.15.42:0/134732098 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7470167f0 con 0x55d7470bedd0 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.741+0000 7efea5ffb640 10 client.15702 handle_command_reply: tid=0 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.741+0000 7efec703a740 1 client.15702 shutdown 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.741+0000 7efec703a740 1 -- 172.21.15.42:0/134732098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 msgr2=0x55d7470abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.741+0000 7efec703a740 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470abb10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efeb400c6a0 tx=0x7efeb40d3050 comp rx=0 tx=0).stop 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.742+0000 7efec703a740 1 -- 172.21.15.42:0/134732098 shutdown_connections 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.742+0000 7efec703a740 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d7470bedd0 0x55d7470c1270 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.742+0000 7efec703a740 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470aed40 0x55d7470ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.742+0000 7efec703a740 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470abb10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.742+0000 7efea5ffb640 0 client.15702 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:00.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.742+0000 7efec703a740 1 --2- 172.21.15.42:0/134732098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470a3b60 0x55d7470ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.742+0000 7efec703a740 1 -- 172.21.15.42:0/134732098 >> 172.21.15.42:0/134732098 conn(0x55d7470a00f0 msgr2=0x55d74709f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:00.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.742+0000 7efec703a740 1 -- 172.21.15.42:0/134732098 shutdown_connections 2024-09-19T09:40:00.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.742+0000 7efec703a740 1 -- 172.21.15.42:0/134732098 wait complete. 2024-09-19T09:40:00.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.742+0000 7efec703a740 20 client.15702 trim_cache size 0 max 16384 2024-09-19T09:40:00.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.776+0000 7efec703a740 1 Processor -- start 2024-09-19T09:40:00.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efec703a740 1 -- start start 2024-09-19T09:40:00.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efec703a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a3b60 0x55d7470a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efec703a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a4480 0x55d7470bab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efec703a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470aed40 0x55d7470c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efec703a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efec01b3ba0 con 0x55d7470a3b60 2024-09-19T09:40:00.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efec703a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efec01b56e0 con 0x55d7470aed40 2024-09-19T09:40:00.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efec703a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efec01b4270 con 0x55d7470a4480 2024-09-19T09:40:00.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efebe59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a3b60 0x55d7470a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efebe59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a3b60 0x55d7470a65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44310/0 (socket says 172.21.15.42:44310) 2024-09-19T09:40:00.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efebe59c640 1 -- 172.21.15.42:0/675455076 learned_addr learned my addr 172.21.15.42:0/675455076 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:00.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efebdd9b640 1 --2- 172.21.15.42:0/675455076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a4480 0x55d7470bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.777+0000 7efebed9d640 1 --2- 172.21.15.42:0/675455076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470aed40 0x55d7470c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.778+0000 7efebdd9b640 1 -- 172.21.15.42:0/675455076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470aed40 msgr2=0x55d7470c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.778+0000 7efebdd9b640 1 --2- 172.21.15.42:0/675455076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470aed40 0x55d7470c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.778+0000 7efebdd9b640 1 -- 172.21.15.42:0/675455076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a3b60 msgr2=0x55d7470a65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.778+0000 7efebdd9b640 1 --2- 172.21.15.42:0/675455076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a3b60 0x55d7470a65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.778+0000 7efebdd9b640 1 -- 172.21.15.42:0/675455076 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d74709ff20 con 0x55d7470a4480 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.778+0000 7efebe59c640 1 --2- 172.21.15.42:0/675455076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a3b60 0x55d7470a65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.778+0000 7efebdd9b640 1 --2- 172.21.15.42:0/675455076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a4480 0x55d7470bab70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55d7470ad150 tx=0x7efeb409b6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bc5bcb656baa074 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.778+0000 7efea7fff640 1 -- 172.21.15.42:0/675455076 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb401c070 con 0x55d7470a4480 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.778+0000 7efea7fff640 1 -- 172.21.15.42:0/675455076 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeb40051d0 con 0x55d7470a4480 2024-09-19T09:40:00.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.778+0000 7efea7fff640 1 -- 172.21.15.42:0/675455076 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb409b790 con 0x55d7470a4480 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.779+0000 7efec703a740 1 -- 172.21.15.42:0/675455076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a4480 msgr2=0x55d7470bab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.779+0000 7efec703a740 1 --2- 172.21.15.42:0/675455076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a4480 0x55d7470bab70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55d7470ad150 tx=0x7efeb409b6e0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.779+0000 7efec703a740 1 -- 172.21.15.42:0/675455076 shutdown_connections 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.779+0000 7efec703a740 1 --2- 172.21.15.42:0/675455076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470aed40 0x55d7470c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.779+0000 7efec703a740 1 --2- 172.21.15.42:0/675455076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a4480 0x55d7470bab70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.779+0000 7efec703a740 1 --2- 172.21.15.42:0/675455076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a3b60 0x55d7470a65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.779+0000 7efec703a740 1 -- 172.21.15.42:0/675455076 >> 172.21.15.42:0/675455076 conn(0x55d7470a00f0 msgr2=0x55d7470aac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.780+0000 7efec703a740 1 -- 172.21.15.42:0/675455076 shutdown_connections 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.780+0000 7efec703a740 1 -- 172.21.15.42:0/675455076 wait complete. 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.780+0000 7efec703a740 1 -- start start 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.780+0000 7efec703a740 1 Processor -- start 2024-09-19T09:40:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efec703a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 0x55d7470b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efec703a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470a8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efec703a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470aed40 0x55d7470a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efec703a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efec01b5010 con 0x55d7470a4480 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efec703a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efec01b4940 con 0x55d7470aed40 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efec703a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efec01b1b80 con 0x55d7470a3b60 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efec703a740 10 client.0 _ll_register_callbacks cb 0x7efeb400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebe59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 0x55d7470b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebe59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 0x55d7470b7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:54616/0 (socket says 172.21.15.42:54616) 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebe59c640 1 -- 172.21.15.42:0/3807912497 learned_addr learned my addr 172.21.15.42:0/3807912497 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebdd9b640 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebed9d640 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470aed40 0x55d7470a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebe59c640 1 -- 172.21.15.42:0/3807912497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470aed40 msgr2=0x55d7470a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebe59c640 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470aed40 0x55d7470a8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebe59c640 1 -- 172.21.15.42:0/3807912497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 msgr2=0x55d7470a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebe59c640 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebe59c640 1 -- 172.21.15.42:0/3807912497 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7470a9730 con 0x55d7470a3b60 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebdd9b640 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.781+0000 7efebe59c640 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 0x55d7470b7510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55d7470a0f50 tx=0x7efeb0005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491e10bd854320e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efea5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efea5ffb640 1 -- 172.21.15.42:0/3807912497 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb003d070 con 0x55d7470a3b60 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efea5ffb640 1 -- 172.21.15.42:0/3807912497 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7efeb0005440 con 0x55d7470a3b60 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efec703a740 1 -- 172.21.15.42:0/3807912497 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb40051d0 con 0x55d7470a3b60 2024-09-19T09:40:00.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efea5ffb640 1 -- 172.21.15.42:0/3807912497 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efeb0019830 con 0x55d7470a3b60 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efec703a740 10 client.25198 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efec703a740 1 -- 172.21.15.42:0/3807912497 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d747129cd0 con 0x55d7470a3b60 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efea5ffb640 1 -- 172.21.15.42:0/3807912497 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeb0043450 con 0x55d7470a3b60 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efea5ffb640 1 -- 172.21.15.42:0/3807912497 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efeb0040030 con 0x55d7470a3b60 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efec703a740 10 client.25198 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efec703a740 10 client.25198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.782+0000 7efec703a740 20 client.25198 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.783+0000 7efec703a740 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d7470bedd0 0x55d74712c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.783+0000 7efec703a740 4 client.25198 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.783+0000 7efec703a740 1 -- 172.21.15.42:0/3807912497 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7efeb40051d0 con 0x55d7470bedd0 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.783+0000 7efebdd9b640 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d7470bedd0 0x55d74712c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.783+0000 7efea5ffb640 10 client.25198 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:00.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.784+0000 7efebdd9b640 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d7470bedd0 0x55d74712c350 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7dee45995ab36 server_cookie=a0d51c0e8af839db in_seq=0 out_seq=0 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efea5ffb640 1 -- 172.21.15.42:0/3807912497 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7efeb40051d0 con 0x55d7470bedd0 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efea5ffb640 10 client.25198 handle_command_reply: tid=0 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efec703a740 1 client.25198 shutdown 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efec703a740 1 -- 172.21.15.42:0/3807912497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 msgr2=0x55d7470b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efec703a740 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 0x55d7470b7510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55d7470a0f50 tx=0x7efeb0005f90 comp rx=0 tx=0).stop 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efec703a740 1 -- 172.21.15.42:0/3807912497 shutdown_connections 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efec703a740 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d7470bedd0 0x55d74712c350 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efec703a740 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d7470aed40 0x55d7470a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efec703a740 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7470a4480 0x55d7470a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efea5ffb640 0 client.25198 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efec703a740 1 --2- 172.21.15.42:0/3807912497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d7470a3b60 0x55d7470b7510 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.785+0000 7efec703a740 1 -- 172.21.15.42:0/3807912497 >> 172.21.15.42:0/3807912497 conn(0x55d7470a00f0 msgr2=0x55d74709ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.786+0000 7efec703a740 1 -- 172.21.15.42:0/3807912497 shutdown_connections 2024-09-19T09:40:00.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.786+0000 7efec703a740 1 -- 172.21.15.42:0/3807912497 wait complete. 2024-09-19T09:40:00.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.786+0000 7efec703a740 20 client.25198 trim_cache size 0 max 16384 2024-09-19T09:40:00.790 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:40:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-19T09:40:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "53133db6-1a92-45d3-b40b-f3ca6e917039", 2024-09-19T09:40:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-19T09:40:00.790 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:40:00.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 -- 172.21.15.42:0/1953093458 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efea80a3420 msgr2=0x7efea80a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:00.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efea80a3420 0x7efea80a58e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efeb001b040 tx=0x7efeb0019540 comp rx=0 tx=0).stop 2024-09-19T09:40:00.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 -- 172.21.15.42:0/1953093458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efec01036a0 msgr2=0x7efec010b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:00.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efec01036a0 0x7efec010b3a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efeb400e9f0 tx=0x7efeb400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 -- 172.21.15.42:0/1953093458 shutdown_connections 2024-09-19T09:40:00.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efea80a3420 0x7efea80a58e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec010c160 0x7efec01a32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efec01036a0 0x7efec010b3a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 --2- 172.21.15.42:0/1953093458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec0102d80 0x7efec010ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:00.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 -- 172.21.15.42:0/1953093458 >> 172.21.15.42:0/1953093458 conn(0x7efec00fc780 msgr2=0x7efec0100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:00.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 -- 172.21.15.42:0/1953093458 shutdown_connections 2024-09-19T09:40:00.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:00.787+0000 7efec4c61640 1 -- 172.21.15.42:0/1953093458 wait complete. 2024-09-19T09:40:00.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:00 smithi171 ceph-mon[35803]: pgmap v357: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:40:00.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:00 smithi171 ceph-mon[35803]: overall HEALTH_OK 2024-09-19T09:40:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:00 smithi136 ceph-mon[34840]: pgmap v357: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:40:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:00 smithi136 ceph-mon[34840]: overall HEALTH_OK 2024-09-19T09:40:01.458 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:40:01.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:01 smithi042 ceph-mon[31223]: scrub queued for path: / 2024-09-19T09:40:01.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:01 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:01.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:01 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:40:01.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:01 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:01.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:01 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:40:01.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:01 smithi171 ceph-mon[35803]: scrub queued for path: / 2024-09-19T09:40:01.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:01 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:01.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:01 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:40:01.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:01 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:01.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:01 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:40:01.858 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:01 smithi136 ceph-mon[34840]: scrub queued for path: / 2024-09-19T09:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:01 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:01 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:01 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:01 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:40:02.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.339+0000 7eff08609640 1 -- 172.21.15.42:0/1345099285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff001036e0 msgr2=0x7eff00107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:02.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.339+0000 7eff08609640 1 --2- 172.21.15.42:0/1345099285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff001036e0 0x7eff00107b90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efef4009930 tx=0x7efef402a420 comp rx=0 tx=0).stop 2024-09-19T09:40:02.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.339+0000 7eff08609640 1 -- 172.21.15.42:0/1345099285 shutdown_connections 2024-09-19T09:40:02.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.339+0000 7eff08609640 1 --2- 172.21.15.42:0/1345099285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff001082a0 0x7eff0010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.339+0000 7eff08609640 1 --2- 172.21.15.42:0/1345099285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff001036e0 0x7eff00107b90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.339+0000 7eff08609640 1 --2- 172.21.15.42:0/1345099285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff00102d30 0x7eff00103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.339+0000 7eff08609640 1 -- 172.21.15.42:0/1345099285 >> 172.21.15.42:0/1345099285 conn(0x7eff000fc7d0 msgr2=0x7eff000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.339+0000 7eff08609640 1 -- 172.21.15.42:0/1345099285 shutdown_connections 2024-09-19T09:40:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.340+0000 7eff08609640 1 -- 172.21.15.42:0/1345099285 wait complete. 2024-09-19T09:40:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.340+0000 7eff08609640 1 Processor -- start 2024-09-19T09:40:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.340+0000 7eff08609640 1 -- start start 2024-09-19T09:40:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff08609640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff00102d30 0x7eff001985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff08609640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff001036e0 0x7eff00198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff08609640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff001082a0 0x7eff0019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff08609640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff00112060 con 0x7eff001036e0 2024-09-19T09:40:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff08609640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7eff00111ee0 con 0x7eff001082a0 2024-09-19T09:40:02.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff08609640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff001121e0 con 0x7eff00102d30 2024-09-19T09:40:02.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff063a5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff00102d30 0x7eff001985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff063a5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff00102d30 0x7eff001985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:54626/0 (socket says 172.21.15.42:54626) 2024-09-19T09:40:02.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff063a5640 1 -- 172.21.15.42:0/724768376 learned_addr learned my addr 172.21.15.42:0/724768376 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:02.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff06ba6640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff001082a0 0x7eff0019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff063a5640 1 -- 172.21.15.42:0/724768376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff001082a0 msgr2=0x7eff0019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:02.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff063a5640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff001082a0 0x7eff0019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff05ba4640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff001036e0 0x7eff00198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff063a5640 1 -- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff001036e0 msgr2=0x7eff00198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.341+0000 7eff063a5640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff001036e0 0x7eff00198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.342+0000 7eff063a5640 1 -- 172.21.15.42:0/724768376 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0019d550 con 0x7eff00102d30 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.342+0000 7eff05ba4640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff001036e0 0x7eff00198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.342+0000 7eff063a5640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff00102d30 0x7eff001985a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efefc00d950 tx=0x7efefc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.342+0000 7efef37fe640 1 -- 172.21.15.42:0/724768376 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc017030 con 0x7eff00102d30 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.342+0000 7eff08609640 1 -- 172.21.15.42:0/724768376 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0019d840 con 0x7eff00102d30 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.342+0000 7efef37fe640 1 -- 172.21.15.42:0/724768376 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efefc004020 con 0x7eff00102d30 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.342+0000 7efef37fe640 1 -- 172.21.15.42:0/724768376 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc0047a0 con 0x7eff00102d30 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.342+0000 7eff08609640 1 -- 172.21.15.42:0/724768376 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff001008c0 con 0x7eff00102d30 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.345+0000 7eff0a9e2740 1 Processor -- start 2024-09-19T09:40:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.345+0000 7eff0a9e2740 1 -- start start 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cb24a0 0x557436cb2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb2dc0 0x557436cbd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cbd680 0x557436cbfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff0a9e2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557436c182e0 con 0x557436cbd680 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff0a9e2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557436bbfce0 con 0x557436cb24a0 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff0a9e2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557436c142a0 con 0x557436cb2dc0 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7efef37fe640 1 -- 172.21.15.42:0/724768376 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7efefc004940 con 0x7eff00102d30 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff05ba4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cbd680 0x557436cbfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff05ba4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cbd680 0x557436cbfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44350/0 (socket says 172.21.15.42:44350) 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff05ba4640 1 -- 172.21.15.42:0/2405866895 learned_addr learned my addr 172.21.15.42:0/2405866895 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff06ba6640 1 --2- 172.21.15.42:0/2405866895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cb24a0 0x557436cb2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.346+0000 7eff063a5640 1 --2- 172.21.15.42:0/2405866895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb2dc0 0x557436cbd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.347+0000 7eff05ba4640 1 -- 172.21.15.42:0/2405866895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb2dc0 msgr2=0x557436cbd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.347+0000 7eff05ba4640 1 --2- 172.21.15.42:0/2405866895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb2dc0 0x557436cbd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.347+0000 7eff05ba4640 1 -- 172.21.15.42:0/2405866895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cb24a0 msgr2=0x557436cb2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.347+0000 7eff05ba4640 1 --2- 172.21.15.42:0/2405866895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cb24a0 0x557436cb2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.347+0000 7eff05ba4640 1 -- 172.21.15.42:0/2405866895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557436ba4440 con 0x557436cbd680 2024-09-19T09:40:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.347+0000 7eff05ba4640 1 --2- 172.21.15.42:0/2405866895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cbd680 0x557436cbfa70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efef4006010 tx=0x7efef4009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c23db017bab733 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.348+0000 7efef0ff9640 1 -- 172.21.15.42:0/2405866895 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef403f070 con 0x557436cbd680 2024-09-19T09:40:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.348+0000 7efef37fe640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efeec0a33d0 0x7efeec0a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.348+0000 7efef0ff9640 1 -- 172.21.15.42:0/2405866895 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efef4004030 con 0x557436cbd680 2024-09-19T09:40:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.348+0000 7efef37fe640 1 -- 172.21.15.42:0/724768376 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7efefc0cf4e0 con 0x7eff00102d30 2024-09-19T09:40:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.348+0000 7eff06ba6640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efeec0a33d0 0x7efeec0a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.348+0000 7efef0ff9640 1 -- 172.21.15.42:0/2405866895 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4035070 con 0x557436cbd680 2024-09-19T09:40:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.349+0000 7eff0a9e2740 1 -- 172.21.15.42:0/2405866895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cbd680 msgr2=0x557436cbfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.349+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/2405866895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cbd680 0x557436cbfa70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efef4006010 tx=0x7efef4009680 comp rx=0 tx=0).stop 2024-09-19T09:40:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.349+0000 7eff0a9e2740 1 -- 172.21.15.42:0/2405866895 shutdown_connections 2024-09-19T09:40:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.349+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/2405866895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cbd680 0x557436cbfa70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.349+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/2405866895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb2dc0 0x557436cbd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.349+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/2405866895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cb24a0 0x557436cb2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.349+0000 7eff0a9e2740 1 -- 172.21.15.42:0/2405866895 >> 172.21.15.42:0/2405866895 conn(0x557436caea30 msgr2=0x557436caee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.349+0000 7eff0a9e2740 1 -- 172.21.15.42:0/2405866895 shutdown_connections 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.350+0000 7eff0a9e2740 1 -- 172.21.15.42:0/2405866895 wait complete. 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.350+0000 7eff06ba6640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efeec0a33d0 0x7efeec0a5890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efef8005fd0 tx=0x7efef8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.350+0000 7eff0a9e2740 1 -- start start 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.350+0000 7eff0a9e2740 1 Processor -- start 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.350+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cbced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.350+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.350+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cbd680 0x557436cba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.350+0000 7eff0a9e2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557436cc02f0 con 0x557436cb2dc0 2024-09-19T09:40:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff0a9e2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557436bd3050 con 0x557436cbd680 2024-09-19T09:40:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff0a9e2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557436cc0470 con 0x557436cb24a0 2024-09-19T09:40:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff0a9e2740 10 client.0 _ll_register_callbacks cb 0x557436c13160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff05ba4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff05ba4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cba180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44366/0 (socket says 172.21.15.42:44366) 2024-09-19T09:40:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff05ba4640 1 -- 172.21.15.42:0/513323413 learned_addr learned my addr 172.21.15.42:0/513323413 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff06ba6640 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cbd680 0x557436cba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff063a5640 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cbced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff06ba6640 1 -- 172.21.15.42:0/513323413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 msgr2=0x557436cbced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff06ba6640 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cbced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff06ba6640 1 -- 172.21.15.42:0/513323413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 msgr2=0x557436cba180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff06ba6640 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cba180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff06ba6640 1 -- 172.21.15.42:0/513323413 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574369893c0 con 0x557436cbd680 2024-09-19T09:40:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff063a5640 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cbced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.351+0000 7eff05ba4640 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.352+0000 7eff06ba6640 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cbd680 0x557436cba6c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efef8011dd0 tx=0x7efef8004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d3c2f197fa517c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:02.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.352+0000 7efee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:40:02.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.352+0000 7efee9ffb640 1 -- 172.21.15.42:0/513323413 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef800f810 con 0x557436cbd680 2024-09-19T09:40:02.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.352+0000 7efee9ffb640 1 -- 172.21.15.42:0/513323413 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7efef800f9b0 con 0x557436cbd680 2024-09-19T09:40:02.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.352+0000 7eff0a9e2740 1 -- 172.21.15.42:0/513323413 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efef4004030 con 0x557436cbd680 2024-09-19T09:40:02.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.352+0000 7efee9ffb640 1 -- 172.21.15.42:0/513323413 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efef800fbb0 con 0x557436cbd680 2024-09-19T09:40:02.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.352+0000 7eff0a9e2740 10 client.25265 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:02.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.352+0000 7eff0a9e2740 1 -- 172.21.15.42:0/513323413 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557436ccbc70 con 0x557436cbd680 2024-09-19T09:40:02.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.352+0000 7efee9ffb640 1 -- 172.21.15.42:0/513323413 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efef4004030 con 0x557436cbd680 2024-09-19T09:40:02.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.352+0000 7efee9ffb640 1 -- 172.21.15.42:0/513323413 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efef8026070 con 0x557436cbd680 2024-09-19T09:40:02.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.353+0000 7eff0a9e2740 10 client.25265 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:02.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.353+0000 7eff0a9e2740 10 client.25265 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:02.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.353+0000 7eff0a9e2740 20 client.25265 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:02.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.353+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557436ccd120 0x557436ccf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.353+0000 7eff0a9e2740 4 client.25265 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:02.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.353+0000 7eff0a9e2740 1 -- 172.21.15.42:0/513323413 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557436c25850 con 0x557436ccd120 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.353+0000 7eff063a5640 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557436ccd120 0x557436ccf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.353+0000 7efee9ffb640 10 client.25265 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.353+0000 7eff063a5640 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557436ccd120 0x557436ccf5a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff55c49eb26c0b02 server_cookie=be415894ef3aaa6a in_seq=0 out_seq=0 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.354+0000 7efee9ffb640 1 -- 172.21.15.42:0/513323413 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557436c25850 con 0x557436ccd120 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.354+0000 7efee9ffb640 10 client.25265 handle_command_reply: tid=0 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.354+0000 7eff0a9e2740 1 client.25265 shutdown 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.354+0000 7eff0a9e2740 1 -- 172.21.15.42:0/513323413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cbd680 msgr2=0x557436cba6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.354+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cbd680 0x557436cba6c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efef8011dd0 tx=0x7efef8004ab0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.354+0000 7eff0a9e2740 1 -- 172.21.15.42:0/513323413 shutdown_connections 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.354+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557436ccd120 0x557436ccf5a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.354+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436cbd680 0x557436cba6c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.355+0000 7efee9ffb640 0 client.25265 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.355+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.355+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/513323413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cbced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.355+0000 7eff0a9e2740 1 -- 172.21.15.42:0/513323413 >> 172.21.15.42:0/513323413 conn(0x557436caea30 msgr2=0x557436cb4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.355+0000 7eff0a9e2740 1 -- 172.21.15.42:0/513323413 shutdown_connections 2024-09-19T09:40:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.355+0000 7eff0a9e2740 1 -- 172.21.15.42:0/513323413 wait complete. 2024-09-19T09:40:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.355+0000 7eff0a9e2740 20 client.25265 trim_cache size 0 max 16384 2024-09-19T09:40:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.372+0000 7eff0a9e2740 1 Processor -- start 2024-09-19T09:40:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff0a9e2740 1 -- start start 2024-09-19T09:40:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 0x557436cc9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cd4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cd53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff0a9e2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff001af800 con 0x557436cb2dc0 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff0a9e2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7eff001b1340 con 0x557436caea30 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff0a9e2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff001afed0 con 0x557436cb24a0 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff05ba4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cd4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff06ba6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cd53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff05ba4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cd4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:54650/0 (socket says 172.21.15.42:54650) 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff05ba4640 1 -- 172.21.15.42:0/674451360 learned_addr learned my addr 172.21.15.42:0/674451360 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.373+0000 7eff063a5640 1 --2- 172.21.15.42:0/674451360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 0x557436cc9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.374+0000 7eff05ba4640 1 -- 172.21.15.42:0/674451360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 msgr2=0x557436cc9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.374+0000 7eff05ba4640 1 --2- 172.21.15.42:0/674451360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 0x557436cc9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.374+0000 7eff05ba4640 1 -- 172.21.15.42:0/674451360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 msgr2=0x557436cd53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.374+0000 7eff05ba4640 1 --2- 172.21.15.42:0/674451360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cd53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.374+0000 7eff05ba4640 1 -- 172.21.15.42:0/674451360 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557436cbd240 con 0x557436cb24a0 2024-09-19T09:40:02.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.374+0000 7eff05ba4640 1 --2- 172.21.15.42:0/674451360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cd4e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efef4009930 tx=0x7efef402a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb43214dfb8a1d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:02.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.374+0000 7efeebfff640 1 -- 172.21.15.42:0/674451360 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4035050 con 0x557436cb24a0 2024-09-19T09:40:02.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.374+0000 7efeebfff640 1 -- 172.21.15.42:0/674451360 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efef4005460 con 0x557436cb24a0 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.374+0000 7efeebfff640 1 -- 172.21.15.42:0/674451360 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef403f040 con 0x557436cb24a0 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.375+0000 7eff0a9e2740 1 -- 172.21.15.42:0/674451360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 msgr2=0x557436cd4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.375+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/674451360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cd4e70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efef4009930 tx=0x7efef402a420 comp rx=0 tx=0).stop 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.375+0000 7eff0a9e2740 1 -- 172.21.15.42:0/674451360 shutdown_connections 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.375+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/674451360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cd53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.375+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/674451360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cd4e70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.375+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/674451360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 0x557436cc9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.375+0000 7eff0a9e2740 1 -- 172.21.15.42:0/674451360 >> 172.21.15.42:0/674451360 conn(0x557436cba820 msgr2=0x557436cb8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.375+0000 7eff0a9e2740 1 -- 172.21.15.42:0/674451360 shutdown_connections 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.375+0000 7eff0a9e2740 1 -- 172.21.15.42:0/674451360 wait complete. 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.376+0000 7eff0a9e2740 1 -- start start 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.376+0000 7eff0a9e2740 1 Processor -- start 2024-09-19T09:40:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.376+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 0x557436cc5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.376+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cc0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.376+0000 7eff0a9e2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cc14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff06ba6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cc14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff06ba6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cc14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44390/0 (socket says 172.21.15.42:44390) 2024-09-19T09:40:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff06ba6640 1 -- 172.21.15.42:0/1383079145 learned_addr learned my addr 172.21.15.42:0/1383079145 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff001b0c70 con 0x557436cb2dc0 2024-09-19T09:40:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7eff001b05a0 con 0x557436caea30 2024-09-19T09:40:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff001ad7e0 con 0x557436cb24a0 2024-09-19T09:40:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff063a5640 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 0x557436cc5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff0a9e2740 10 client.0 _ll_register_callbacks cb 0x7efef8009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff05ba4640 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cc0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff063a5640 1 -- 172.21.15.42:0/1383079145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 msgr2=0x557436cc0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff063a5640 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cc0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff063a5640 1 -- 172.21.15.42:0/1383079145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 msgr2=0x557436cc14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff063a5640 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cc14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff063a5640 1 -- 172.21.15.42:0/1383079145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557436cc1af0 con 0x557436caea30 2024-09-19T09:40:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7eff063a5640 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 0x557436cc5c40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efefc0ccde0 tx=0x7efefc0cf820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb24e5c05a3fae7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.377+0000 7efee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:40:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.378+0000 7efee9ffb640 1 -- 172.21.15.42:0/1383079145 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc09b920 con 0x557436caea30 2024-09-19T09:40:02.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.378+0000 7efee9ffb640 1 -- 172.21.15.42:0/1383079145 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7efefc0d2d70 con 0x557436caea30 2024-09-19T09:40:02.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.378+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efef4005460 con 0x557436caea30 2024-09-19T09:40:02.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.378+0000 7efee9ffb640 1 -- 172.21.15.42:0/1383079145 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efefc09fcd0 con 0x557436caea30 2024-09-19T09:40:02.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.378+0000 7eff0a9e2740 10 client.25271 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:02.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.378+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557436d37cc0 con 0x557436caea30 2024-09-19T09:40:02.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.378+0000 7efee9ffb640 1 -- 172.21.15.42:0/1383079145 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efef4005460 con 0x557436caea30 2024-09-19T09:40:02.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.379+0000 7efee9ffb640 1 -- 172.21.15.42:0/1383079145 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efefc0041d0 con 0x557436caea30 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.379+0000 7eff0a9e2740 10 client.25271 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.379+0000 7eff0a9e2740 10 client.25271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.379+0000 7eff0a9e2740 20 client.25271 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.379+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557436cbd680 0x557436d3a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.379+0000 7eff0a9e2740 4 client.25271 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.379+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557436c1fd60 con 0x557436cbd680 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.379+0000 7eff05ba4640 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557436cbd680 0x557436d3a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff05ba4640 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557436cbd680 0x557436d3a3a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ced42f085d83368 server_cookie=b20bea76906f2d93 in_seq=0 out_seq=0 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7efee9ffb640 10 client.25271 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7efee9ffb640 1 -- 172.21.15.42:0/1383079145 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557436c1fd60 con 0x557436cbd680 2024-09-19T09:40:02.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7efee9ffb640 10 client.25271 handle_command_reply: tid=0 2024-09-19T09:40:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 client.25271 shutdown 2024-09-19T09:40:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 msgr2=0x557436cc5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 0x557436cc5c40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efefc0ccde0 tx=0x7efefc0cf820 comp rx=0 tx=0).stop 2024-09-19T09:40:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 shutdown_connections 2024-09-19T09:40:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x557436cbd680 0x557436d3a3a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7efee9ffb640 0 client.25271 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557436cb2dc0 0x557436cc14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557436cb24a0 0x557436cc0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 --2- 172.21.15.42:0/1383079145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557436caea30 0x557436cc5c40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 >> 172.21.15.42:0/1383079145 conn(0x557436cba820 msgr2=0x557436cbb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 shutdown_connections 2024-09-19T09:40:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 1 -- 172.21.15.42:0/1383079145 wait complete. 2024-09-19T09:40:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.380+0000 7eff0a9e2740 20 client.25271 trim_cache size 0 max 16384 2024-09-19T09:40:02.388 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:40:02.388 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-19T09:40:02.389 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-09-19T09:40:02.389 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:40:02.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 -- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efeec0a33d0 msgr2=0x7efeec0a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:02.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efeec0a33d0 0x7efeec0a5890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efef8005fd0 tx=0x7efef8009500 comp rx=0 tx=0).stop 2024-09-19T09:40:02.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 -- 172.21.15.42:0/724768376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff00102d30 msgr2=0x7eff001985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:02.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff00102d30 0x7eff001985a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efefc00d950 tx=0x7efefc00de10 comp rx=0 tx=0).stop 2024-09-19T09:40:02.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 -- 172.21.15.42:0/724768376 shutdown_connections 2024-09-19T09:40:02.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7efeec0a33d0 0x7efeec0a5890 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff001082a0 0x7eff0019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff001036e0 0x7eff00198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 --2- 172.21.15.42:0/724768376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff00102d30 0x7eff001985a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:02.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 -- 172.21.15.42:0/724768376 >> 172.21.15.42:0/724768376 conn(0x7eff000fc7d0 msgr2=0x7eff00105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:02.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 -- 172.21.15.42:0/724768376 shutdown_connections 2024-09-19T09:40:02.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:02.381+0000 7eff08609640 1 -- 172.21.15.42:0/724768376 wait complete. 2024-09-19T09:40:02.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:02 smithi042 ceph-mon[31223]: pgmap v358: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:40:02.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:02 smithi171 ceph-mon[35803]: pgmap v358: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:40:02.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:02 smithi136 ceph-mon[34840]: pgmap v358: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:40:03.124 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:40:03.124 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:40:03.523 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.054+0000 7fde35956640 1 -- 172.21.15.42:0/3283228142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde30106f10 msgr2=0x7fde3010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.054+0000 7fde35956640 1 --2- 172.21.15.42:0/3283228142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde30106f10 0x7fde3010ea90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fde28009cc0 tx=0x7fde2802ecf0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.054+0000 7fde35956640 1 -- 172.21.15.42:0/3283228142 shutdown_connections 2024-09-19T09:40:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.054+0000 7fde35956640 1 --2- 172.21.15.42:0/3283228142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde30106f10 0x7fde3010ea90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.054+0000 7fde35956640 1 --2- 172.21.15.42:0/3283228142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde30102790 0x7fde301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.054+0000 7fde35956640 1 --2- 172.21.15.42:0/3283228142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde30101de0 0x7fde301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.054+0000 7fde35956640 1 -- 172.21.15.42:0/3283228142 >> 172.21.15.42:0/3283228142 conn(0x7fde300fd8c0 msgr2=0x7fde300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.054+0000 7fde35956640 1 -- 172.21.15.42:0/3283228142 shutdown_connections 2024-09-19T09:40:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.055+0000 7fde35956640 1 -- 172.21.15.42:0/3283228142 wait complete. 2024-09-19T09:40:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.055+0000 7fde35956640 1 Processor -- start 2024-09-19T09:40:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.056+0000 7fde35956640 1 -- start start 2024-09-19T09:40:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.056+0000 7fde35956640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde30101de0 0x7fde301961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.056+0000 7fde2effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde30101de0 0x7fde301961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.056+0000 7fde2effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde30101de0 0x7fde301961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44416/0 (socket says 172.21.15.42:44416) 2024-09-19T09:40:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.056+0000 7fde2effd640 1 -- 172.21.15.42:0/1640788667 learned_addr learned my addr 172.21.15.42:0/1640788667 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.056+0000 7fde35956640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde30102790 0x7fde301966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.056+0000 7fde35956640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde30106f10 0x7fde3019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.056+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde3010fd60 con 0x7fde30101de0 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.056+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fde3010fbe0 con 0x7fde30106f10 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.056+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde3010fee0 con 0x7fde30102790 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.057+0000 7fde2f7fe640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde30106f10 0x7fde3019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.057+0000 7fde2e7fc640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde30102790 0x7fde301966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.057+0000 7fde2effd640 1 -- 172.21.15.42:0/1640788667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde30102790 msgr2=0x7fde301966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.057+0000 7fde2effd640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde30102790 0x7fde301966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.057+0000 7fde2effd640 1 -- 172.21.15.42:0/1640788667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde30106f10 msgr2=0x7fde3019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.057+0000 7fde2effd640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde30106f10 0x7fde3019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.057+0000 7fde2effd640 1 -- 172.21.15.42:0/1640788667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3019b150 con 0x7fde30101de0 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.057+0000 7fde2effd640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde30101de0 0x7fde301961a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fde2000bf40 tx=0x7fde2000dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.057+0000 7fde34954640 1 -- 172.21.15.42:0/1640788667 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2001c070 con 0x7fde30101de0 2024-09-19T09:40:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.058+0000 7fde34954640 1 -- 172.21.15.42:0/1640788667 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde2001a070 con 0x7fde30101de0 2024-09-19T09:40:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.058+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3019b440 con 0x7fde30101de0 2024-09-19T09:40:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.059+0000 7fde34954640 1 -- 172.21.15.42:0/1640788667 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20009b10 con 0x7fde30101de0 2024-09-19T09:40:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.059+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde301a2d20 con 0x7fde30101de0 2024-09-19T09:40:04.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.061+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde301021c0 con 0x7fde30101de0 2024-09-19T09:40:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.061+0000 7fde34954640 1 -- 172.21.15.42:0/1640788667 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fde200047a0 con 0x7fde30101de0 2024-09-19T09:40:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.062+0000 7fde34954640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fde180a3350 0x7fde180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.063+0000 7fde2e7fc640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fde180a3350 0x7fde180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.063+0000 7fde34954640 1 -- 172.21.15.42:0/1640788667 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fde2009f5f0 con 0x7fde30101de0 2024-09-19T09:40:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.063+0000 7fde2e7fc640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fde180a3350 0x7fde180a5810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde24005fd0 tx=0x7fde24005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:04.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.071+0000 7fde34954640 1 -- 172.21.15.42:0/1640788667 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde200a3680 con 0x7fde30101de0 2024-09-19T09:40:04.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.490+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde3010a1b0 con 0x7fde30101de0 2024-09-19T09:40:04.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.494+0000 7fde34954640 1 -- 172.21.15.42:0/1640788667 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7fde200a2f80 con 0x7fde30101de0 2024-09-19T09:40:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:40:04.496 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:40:04.496 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.496+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fde180a3350 msgr2=0x7fde180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.496+0000 7fde35956640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fde180a3350 0x7fde180a5810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde24005fd0 tx=0x7fde24005850 comp rx=0 tx=0).stop 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.497+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde30101de0 msgr2=0x7fde301961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.497+0000 7fde35956640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde30101de0 0x7fde301961a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fde2000bf40 tx=0x7fde2000dd60 comp rx=0 tx=0).stop 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.497+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 shutdown_connections 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.497+0000 7fde35956640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fde180a3350 0x7fde180a5810 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.497+0000 7fde35956640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde30106f10 0x7fde3019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.497+0000 7fde35956640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde30102790 0x7fde301966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.497+0000 7fde35956640 1 --2- 172.21.15.42:0/1640788667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde30101de0 0x7fde301961a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.497+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 >> 172.21.15.42:0/1640788667 conn(0x7fde300fd8c0 msgr2=0x7fde300feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.497+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 shutdown_connections 2024-09-19T09:40:04.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:04.497+0000 7fde35956640 1 -- 172.21.15.42:0/1640788667 wait complete. 2024-09-19T09:40:04.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:04 smithi042 ceph-mon[31223]: pgmap v359: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T09:40:04.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:04 smithi171 ceph-mon[35803]: pgmap v359: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T09:40:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:04 smithi136 ceph-mon[34840]: pgmap v359: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T09:40:05.198 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:40:05.585 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:05.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:05 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1640788667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:05.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:05 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1640788667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:05.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:05 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1640788667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.152+0000 7f6895ee7640 1 -- 172.21.15.42:0/2346732732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6890102ef0 msgr2=0x7f689010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.152+0000 7f6895ee7640 1 --2- 172.21.15.42:0/2346732732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6890102ef0 0x7f689010da40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6888009ca0 tx=0x7f688802a950 comp rx=0 tx=0).stop 2024-09-19T09:40:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.152+0000 7f6895ee7640 1 -- 172.21.15.42:0/2346732732 shutdown_connections 2024-09-19T09:40:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.152+0000 7f6895ee7640 1 --2- 172.21.15.42:0/2346732732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6890102ef0 0x7f689010da40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.152+0000 7f6895ee7640 1 --2- 172.21.15.42:0/2346732732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6890102570 0x7f68901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.152+0000 7f6895ee7640 1 --2- 172.21.15.42:0/2346732732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6890100e20 0x7f6890101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.152+0000 7f6895ee7640 1 -- 172.21.15.42:0/2346732732 >> 172.21.15.42:0/2346732732 conn(0x7f68900fc7d0 msgr2=0x7f68900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.153+0000 7f6895ee7640 1 -- 172.21.15.42:0/2346732732 shutdown_connections 2024-09-19T09:40:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.153+0000 7f6895ee7640 1 -- 172.21.15.42:0/2346732732 wait complete. 2024-09-19T09:40:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.154+0000 7f6895ee7640 1 Processor -- start 2024-09-19T09:40:06.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.154+0000 7f6895ee7640 1 -- start start 2024-09-19T09:40:06.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.154+0000 7f6895ee7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6890100e20 0x7f689019d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.154+0000 7f6895ee7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6890102570 0x7f689019d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f688effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6890102570 0x7f689019d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f688effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6890102570 0x7f689019d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44438/0 (socket says 172.21.15.42:44438) 2024-09-19T09:40:06.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f688effd640 1 -- 172.21.15.42:0/50783670 learned_addr learned my addr 172.21.15.42:0/50783670 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:06.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f6895ee7640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6890102ef0 0x7f6890198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6890110fd0 con 0x7f6890102570 2024-09-19T09:40:06.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6890110e50 con 0x7f6890102ef0 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6890111150 con 0x7f6890100e20 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f688f7fe640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6890100e20 0x7f689019d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f688ffff640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6890102ef0 0x7f6890198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f688effd640 1 -- 172.21.15.42:0/50783670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6890100e20 msgr2=0x7f689019d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f688effd640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6890100e20 0x7f689019d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f688effd640 1 -- 172.21.15.42:0/50783670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6890102ef0 msgr2=0x7f6890198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f688effd640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6890102ef0 0x7f6890198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.155+0000 7f688effd640 1 -- 172.21.15.42:0/50783670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6890198dd0 con 0x7f6890102570 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.156+0000 7f688effd640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6890102570 0x7f689019d5b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f688400d950 tx=0x7f688400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.156+0000 7f688cff9640 1 -- 172.21.15.42:0/50783670 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884017070 con 0x7f6890102570 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.156+0000 7f688cff9640 1 -- 172.21.15.42:0/50783670 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6884009c30 con 0x7f6890102570 2024-09-19T09:40:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.156+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68901990c0 con 0x7f6890102570 2024-09-19T09:40:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.157+0000 7f688cff9640 1 -- 172.21.15.42:0/50783670 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884020060 con 0x7f6890102570 2024-09-19T09:40:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.157+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6890111730 con 0x7f6890102570 2024-09-19T09:40:06.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.160+0000 7f688cff9640 1 -- 172.21.15.42:0/50783670 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f68840109d0 con 0x7f6890102570 2024-09-19T09:40:06.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f68982c0740 1 Processor -- start 2024-09-19T09:40:06.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f68982c0740 1 -- start start 2024-09-19T09:40:06.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f688cff9640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f68780a32d0 0x7f68780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f68982c0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b10396090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f68982c0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103965d0 0x563b10396a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f68982c0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 0x563b103a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f68982c0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b102fc2f0 con 0x563b103a1370 2024-09-19T09:40:06.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f68982c0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563b102a3cf0 con 0x563b10397b40 2024-09-19T09:40:06.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f68982c0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563b102f82b0 con 0x563b103965d0 2024-09-19T09:40:06.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f688cff9640 1 -- 172.21.15.42:0/50783670 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f68840cf330 con 0x7f6890102570 2024-09-19T09:40:06.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.161+0000 7f688ffff640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f68780a32d0 0x7f68780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b10396090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b10396090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:41436/0 (socket says 172.21.15.42:41436) 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688f7fe640 1 -- 172.21.15.42:0/2449117599 learned_addr learned my addr 172.21.15.42:0/2449117599 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688effd640 1 --2- 172.21.15.42:0/2449117599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103965d0 0x563b10396a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688ffff640 1 --2- 172.21.15.42:0/2449117599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 0x563b103a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688f7fe640 1 -- 172.21.15.42:0/2449117599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103965d0 msgr2=0x563b10396a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688f7fe640 1 --2- 172.21.15.42:0/2449117599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103965d0 0x563b10396a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688f7fe640 1 -- 172.21.15.42:0/2449117599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 msgr2=0x563b103a3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688f7fe640 1 --2- 172.21.15.42:0/2449117599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 0x563b103a3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688f7fe640 1 -- 172.21.15.42:0/2449117599 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b102883a0 con 0x563b10397b40 2024-09-19T09:40:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688ffff640 1 --2- 172.21.15.42:0/2449117599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 0x563b103a3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688f7fe640 1 --2- 172.21.15.42:0/2449117599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b10396090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f688000efd0 tx=0x7f68800096d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac0cdea151a7bcdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f688ffff640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f68780a32d0 0x7f68780a5790 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x563b10397070 tx=0x7f6888005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.162+0000 7f6875ffb640 1 -- 172.21.15.42:0/2449117599 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688001a430 con 0x563b10397b40 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.163+0000 7f6875ffb640 1 -- 172.21.15.42:0/2449117599 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f688000d8a0 con 0x563b10397b40 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.163+0000 7f6875ffb640 1 -- 172.21.15.42:0/2449117599 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688000c830 con 0x563b10397b40 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.163+0000 7f68982c0740 1 -- 172.21.15.42:0/2449117599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 msgr2=0x563b10396090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.163+0000 7f68982c0740 1 --2- 172.21.15.42:0/2449117599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b10396090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f688000efd0 tx=0x7f68800096d0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.164+0000 7f68982c0740 1 -- 172.21.15.42:0/2449117599 shutdown_connections 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.164+0000 7f68982c0740 1 --2- 172.21.15.42:0/2449117599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 0x563b103a3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.164+0000 7f68982c0740 1 --2- 172.21.15.42:0/2449117599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103965d0 0x563b10396a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.164+0000 7f68982c0740 1 --2- 172.21.15.42:0/2449117599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b10396090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.164+0000 7f68982c0740 1 -- 172.21.15.42:0/2449117599 >> 172.21.15.42:0/2449117599 conn(0x563b1035f310 msgr2=0x563b10392c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.164+0000 7f68982c0740 1 -- 172.21.15.42:0/2449117599 shutdown_connections 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.164+0000 7f68982c0740 1 -- 172.21.15.42:0/2449117599 wait complete. 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.164+0000 7f68982c0740 1 -- start start 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.164+0000 7f68982c0740 1 Processor -- start 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f68982c0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f68982c0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b1039e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f68982c0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103a1370 0x563b1039e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44452/0 (socket says 172.21.15.42:44452) 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f688effd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b1039e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f688effd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b1039e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:41440/0 (socket says 172.21.15.42:41440) 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f688f7fe640 1 -- 172.21.15.42:0/979929534 learned_addr learned my addr 172.21.15.42:0/979929534 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b103b5020 con 0x563b103965d0 2024-09-19T09:40:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563b102b7060 con 0x563b10397b40 2024-09-19T09:40:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563b103b51a0 con 0x563b103a1370 2024-09-19T09:40:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f68982c0740 10 client.0 _ll_register_callbacks cb 0x563b1000a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f688ffff640 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103a1370 0x563b1039e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.165+0000 7f688effd640 1 -- 172.21.15.42:0/979929534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103a1370 msgr2=0x563b1039e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f688effd640 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103a1370 0x563b1039e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f688effd640 1 -- 172.21.15.42:0/979929534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 msgr2=0x563b103a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f688effd640 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f688effd640 1 -- 172.21.15.42:0/979929534 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1006d3c0 con 0x563b10397b40 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f688000d8a0 con 0x563b10397b40 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f688f7fe640 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f688effd640 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b1039e0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68840cccc0 tx=0x7f6884009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d937ca1cd690b2af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f686effd640 10 client.25289 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f686effd640 1 -- 172.21.15.42:0/979929534 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68840a4440 con 0x563b10397b40 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f686effd640 1 -- 172.21.15.42:0/979929534 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f6884097e40 con 0x563b10397b40 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f686effd640 1 -- 172.21.15.42:0/979929534 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f688405a950 con 0x563b10397b40 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f68982c0740 10 client.25289 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.166+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563b103a3ef0 con 0x563b10397b40 2024-09-19T09:40:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.167+0000 7f686effd640 1 -- 172.21.15.42:0/979929534 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f688409ac20 con 0x563b10397b40 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.167+0000 7f68982c0740 10 client.25289 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.167+0000 7f68982c0740 10 client.25289 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.167+0000 7f68982c0740 20 client.25289 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.167+0000 7f68982c0740 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563b103a5240 0x563b103a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.167+0000 7f68982c0740 4 client.25289 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.167+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b10309860 con 0x563b103a5240 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.167+0000 7f688f7fe640 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563b103a5240 0x563b103a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.168+0000 7f688f7fe640 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563b103a5240 0x563b103a76d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1733e7acc48ed876 server_cookie=79ab8e85f587483 in_seq=0 out_seq=0 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.168+0000 7f686effd640 10 client.25289 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f686effd640 1 -- 172.21.15.42:0/979929534 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b10309860 con 0x563b103a5240 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f686effd640 10 client.25289 handle_command_reply: tid=0 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 client.25289 shutdown 2024-09-19T09:40:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 msgr2=0x563b1039e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b1039e0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68840cccc0 tx=0x7f6884009f20 comp rx=0 tx=0).stop 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 shutdown_connections 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563b103a5240 0x563b103a76d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f686effd640 0 client.25289 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103a1370 0x563b1039e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b1039e0e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 --2- 172.21.15.42:0/979929534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 >> 172.21.15.42:0/979929534 conn(0x563b1035f310 msgr2=0x563b10398960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 shutdown_connections 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 1 -- 172.21.15.42:0/979929534 wait complete. 2024-09-19T09:40:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.169+0000 7f68982c0740 20 client.25289 trim_cache size 0 max 16384 2024-09-19T09:40:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.196+0000 7f68982c0740 1 Processor -- start 2024-09-19T09:40:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.196+0000 7f68982c0740 1 -- start start 2024-09-19T09:40:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.196+0000 7f68982c0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b103965d0 0x563b1039e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.196+0000 7f68982c0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b10397b40 0x563b103acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.196+0000 7f68982c0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 0x563b103ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.196+0000 7f68982c0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6890072000 con 0x563b103a1370 2024-09-19T09:40:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.196+0000 7f68982c0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6890073b40 con 0x563b103965d0 2024-09-19T09:40:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.196+0000 7f68982c0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f68900726d0 con 0x563b10397b40 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.196+0000 7f688ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 0x563b103ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.196+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b103965d0 0x563b1039e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b103965d0 0x563b1039e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:41442/0 (socket says 172.21.15.42:41442) 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688f7fe640 1 -- 172.21.15.42:0/2050503772 learned_addr learned my addr 172.21.15.42:0/2050503772 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688effd640 1 --2- 172.21.15.42:0/2050503772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b10397b40 0x563b103acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688f7fe640 1 -- 172.21.15.42:0/2050503772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b10397b40 msgr2=0x563b103acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688f7fe640 1 --2- 172.21.15.42:0/2050503772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b10397b40 0x563b103acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688f7fe640 1 -- 172.21.15.42:0/2050503772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 msgr2=0x563b103ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688f7fe640 1 --2- 172.21.15.42:0/2050503772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 0x563b103ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688f7fe640 1 -- 172.21.15.42:0/2050503772 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b103a11a0 con 0x563b103965d0 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688effd640 1 --2- 172.21.15.42:0/2050503772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b10397b40 0x563b103acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688ffff640 1 --2- 172.21.15.42:0/2050503772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 0x563b103ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f688f7fe640 1 --2- 172.21.15.42:0/2050503772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b103965d0 0x563b1039e0b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f688000eef0 tx=0x7f6880009d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80fc574d699ff31b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.197+0000 7f68757fa640 1 -- 172.21.15.42:0/2050503772 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688000d660 con 0x563b103965d0 2024-09-19T09:40:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.198+0000 7f68757fa640 1 -- 172.21.15.42:0/2050503772 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f688000e480 con 0x563b103965d0 2024-09-19T09:40:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.198+0000 7f68757fa640 1 -- 172.21.15.42:0/2050503772 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880005500 con 0x563b103965d0 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.199+0000 7f68982c0740 1 -- 172.21.15.42:0/2050503772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b103965d0 msgr2=0x563b1039e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.199+0000 7f68982c0740 1 --2- 172.21.15.42:0/2050503772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b103965d0 0x563b1039e0b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f688000eef0 tx=0x7f6880009d00 comp rx=0 tx=0).stop 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.199+0000 7f68982c0740 1 -- 172.21.15.42:0/2050503772 shutdown_connections 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.199+0000 7f68982c0740 1 --2- 172.21.15.42:0/2050503772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103a1370 0x563b103ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.199+0000 7f68982c0740 1 --2- 172.21.15.42:0/2050503772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b10397b40 0x563b103acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.199+0000 7f68982c0740 1 --2- 172.21.15.42:0/2050503772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b103965d0 0x563b1039e0b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.199+0000 7f68982c0740 1 -- 172.21.15.42:0/2050503772 >> 172.21.15.42:0/2050503772 conn(0x563b1035f310 msgr2=0x563b1039d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.199+0000 7f68982c0740 1 -- 172.21.15.42:0/2050503772 shutdown_connections 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.199+0000 7f68982c0740 1 -- 172.21.15.42:0/2050503772 wait complete. 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.199+0000 7f68982c0740 1 -- start start 2024-09-19T09:40:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.200+0000 7f68982c0740 1 Processor -- start 2024-09-19T09:40:06.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.200+0000 7f68982c0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103ba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.200+0000 7f68982c0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b103ba930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.200+0000 7f68982c0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103a1370 0x563b1039a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f68982c0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6890073470 con 0x563b103965d0 2024-09-19T09:40:06.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f68982c0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6890072da0 con 0x563b10397b40 2024-09-19T09:40:06.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f68982c0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f689006ffe0 con 0x563b103a1370 2024-09-19T09:40:06.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103ba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f68982c0740 10 client.0 _ll_register_callbacks cb 0x7f688409b5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103ba3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44474/0 (socket says 172.21.15.42:44474) 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f688f7fe640 1 -- 172.21.15.42:0/32112824 learned_addr learned my addr 172.21.15.42:0/32112824 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f688effd640 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b103ba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f688f7fe640 1 -- 172.21.15.42:0/32112824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103a1370 msgr2=0x563b1039a350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f688f7fe640 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103a1370 0x563b1039a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f688f7fe640 1 -- 172.21.15.42:0/32112824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 msgr2=0x563b103ba930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f688f7fe640 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b103ba930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.201+0000 7f688f7fe640 1 -- 172.21.15.42:0/32112824 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1039bfa0 con 0x563b103965d0 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.202+0000 7f688f7fe640 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103ba3f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6880005e90 tx=0x7f6880005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7034e88d8283ba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.202+0000 7f686effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.202+0000 7f686effd640 1 -- 172.21.15.42:0/32112824 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880033070 con 0x563b103965d0 2024-09-19T09:40:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.202+0000 7f686effd640 1 -- 172.21.15.42:0/32112824 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f6880005280 con 0x563b103965d0 2024-09-19T09:40:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.202+0000 7f68982c0740 1 -- 172.21.15.42:0/32112824 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f688000e480 con 0x563b103965d0 2024-09-19T09:40:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.202+0000 7f686effd640 1 -- 172.21.15.42:0/32112824 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f688003f050 con 0x563b103965d0 2024-09-19T09:40:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.202+0000 7f68982c0740 10 client.15744 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.202+0000 7f68982c0740 1 -- 172.21.15.42:0/32112824 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563b1041c080 con 0x563b103965d0 2024-09-19T09:40:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.203+0000 7f686effd640 1 -- 172.21.15.42:0/32112824 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f688000e480 con 0x563b103965d0 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.203+0000 7f686effd640 1 -- 172.21.15.42:0/32112824 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6880024070 con 0x563b103965d0 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.203+0000 7f68982c0740 10 client.15744 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.203+0000 7f68982c0740 10 client.15744 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.203+0000 7f68982c0740 20 client.15744 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.203+0000 7f68982c0740 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563b103a5240 0x563b1041e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.203+0000 7f68982c0740 4 client.15744 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.203+0000 7f68982c0740 1 -- 172.21.15.42:0/32112824 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b10303d70 con 0x563b103a5240 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.203+0000 7f688effd640 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563b103a5240 0x563b1041e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.204+0000 7f686effd640 10 client.15744 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.204+0000 7f688effd640 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563b103a5240 0x563b1041e510 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9a12b4a69bdc16dc server_cookie=4a556739b08395f7 in_seq=0 out_seq=0 2024-09-19T09:40:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.204+0000 7f686effd640 1 -- 172.21.15.42:0/32112824 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b10303d70 con 0x563b103a5240 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.204+0000 7f686effd640 10 client.15744 handle_command_reply: tid=0 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.204+0000 7f68982c0740 1 client.15744 shutdown 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 1 -- 172.21.15.42:0/32112824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 msgr2=0x563b103ba3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103ba3f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6880005e90 tx=0x7f6880005ec0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 1 -- 172.21.15.42:0/32112824 shutdown_connections 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x563b103a5240 0x563b1041e510 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563b103a1370 0x563b1039a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b10397b40 0x563b103ba930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f686effd640 0 client.15744 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 1 --2- 172.21.15.42:0/32112824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b103965d0 0x563b103ba3f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 1 -- 172.21.15.42:0/32112824 >> 172.21.15.42:0/32112824 conn(0x563b1035f310 msgr2=0x563b103914e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 1 -- 172.21.15.42:0/32112824 shutdown_connections 2024-09-19T09:40:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 1 -- 172.21.15.42:0/32112824 wait complete. 2024-09-19T09:40:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.205+0000 7f68982c0740 20 client.15744 trim_cache size 0 max 16384 2024-09-19T09:40:06.210 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:40:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.206+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f68780a32d0 msgr2=0x7f68780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.206+0000 7f6895ee7640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f68780a32d0 0x7f68780a5790 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x563b10397070 tx=0x7f6888005d80 comp rx=0 tx=0).stop 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.206+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6890102570 msgr2=0x7f689019d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.206+0000 7f6895ee7640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6890102570 0x7f689019d5b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f688400d950 tx=0x7f688400de10 comp rx=0 tx=0).stop 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.206+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 shutdown_connections 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.206+0000 7f6895ee7640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f68780a32d0 0x7f68780a5790 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.207+0000 7f6895ee7640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6890102ef0 0x7f6890198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.207+0000 7f6895ee7640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6890102570 0x7f689019d5b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.207+0000 7f6895ee7640 1 --2- 172.21.15.42:0/50783670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6890100e20 0x7f689019d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.207+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 >> 172.21.15.42:0/50783670 conn(0x7f68900fc7d0 msgr2=0x7f6890103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.207+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 shutdown_connections 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:06.207+0000 7f6895ee7640 1 -- 172.21.15.42:0/50783670 wait complete. 2024-09-19T09:40:06.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:06 smithi171 ceph-mon[35803]: pgmap v360: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:40:06.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:06 smithi042 ceph-mon[31223]: pgmap v360: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:40:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:06 smithi136 ceph-mon[34840]: pgmap v360: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:40:07.031 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:40:07.364 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.915+0000 7f4955165640 1 -- 172.21.15.42:0/704316210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4950100a60 msgr2=0x7f4950100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.916+0000 7f4955165640 1 --2- 172.21.15.42:0/704316210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4950100a60 0x7f4950100ec0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4944009930 tx=0x7f494402a420 comp rx=0 tx=0).stop 2024-09-19T09:40:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.916+0000 7f4955165640 1 -- 172.21.15.42:0/704316210 shutdown_connections 2024-09-19T09:40:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.916+0000 7f4955165640 1 --2- 172.21.15.42:0/704316210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4950101400 0x7f495010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.916+0000 7f4955165640 1 --2- 172.21.15.42:0/704316210 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4950100a60 0x7f4950100ec0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.916+0000 7f4955165640 1 --2- 172.21.15.42:0/704316210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4950106a60 0x7f4950106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.916+0000 7f4955165640 1 -- 172.21.15.42:0/704316210 >> 172.21.15.42:0/704316210 conn(0x7f49500fc780 msgr2=0x7f49500feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.916+0000 7f4955165640 1 -- 172.21.15.42:0/704316210 shutdown_connections 2024-09-19T09:40:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.916+0000 7f4955165640 1 -- 172.21.15.42:0/704316210 wait complete. 2024-09-19T09:40:07.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.917+0000 7f4955165640 1 Processor -- start 2024-09-19T09:40:07.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.917+0000 7f4955165640 1 -- start start 2024-09-19T09:40:07.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.917+0000 7f4955165640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4950100a60 0x7f4950197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.917+0000 7f4955165640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4950101400 0x7f49501978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f4955165640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4950106a60 0x7f495019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f4955165640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4950110eb0 con 0x7f4950101400 2024-09-19T09:40:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f4955165640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4950110d30 con 0x7f4950100a60 2024-09-19T09:40:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f4955165640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4950111030 con 0x7f4950106a60 2024-09-19T09:40:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f494e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4950101400 0x7f49501978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f494e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4950101400 0x7f49501978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44490/0 (socket says 172.21.15.42:44490) 2024-09-19T09:40:07.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f494e59c640 1 -- 172.21.15.42:0/2733798321 learned_addr learned my addr 172.21.15.42:0/2733798321 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f494f59e640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4950106a60 0x7f495019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f494ed9d640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4950100a60 0x7f4950197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f494e59c640 1 -- 172.21.15.42:0/2733798321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4950106a60 msgr2=0x7f495019bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f494e59c640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4950106a60 0x7f495019bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f494e59c640 1 -- 172.21.15.42:0/2733798321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4950100a60 msgr2=0x7f4950197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f494e59c640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4950100a60 0x7f4950197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.918+0000 7f494e59c640 1 -- 172.21.15.42:0/2733798321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495019c330 con 0x7f4950101400 2024-09-19T09:40:07.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.919+0000 7f494e59c640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4950101400 0x7f49501978c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f494402a990 tx=0x7f4944003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.919+0000 7f4937fff640 1 -- 172.21.15.42:0/2733798321 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494403f070 con 0x7f4950101400 2024-09-19T09:40:07.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.919+0000 7f4937fff640 1 -- 172.21.15.42:0/2733798321 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4944031c90 con 0x7f4950101400 2024-09-19T09:40:07.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.919+0000 7f4937fff640 1 -- 172.21.15.42:0/2733798321 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944035030 con 0x7f4950101400 2024-09-19T09:40:07.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.919+0000 7f4955165640 1 -- 172.21.15.42:0/2733798321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495019c5c0 con 0x7f4950101400 2024-09-19T09:40:07.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.919+0000 7f4955165640 1 -- 172.21.15.42:0/2733798321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495019ca50 con 0x7f4950101400 2024-09-19T09:40:07.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.922+0000 7f4937fff640 1 -- 172.21.15.42:0/2733798321 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f4944042070 con 0x7f4950101400 2024-09-19T09:40:07.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.922+0000 7f4937fff640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49380a55b0 0x7f49380a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.922+0000 7f4937fff640 1 -- 172.21.15.42:0/2733798321 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f49440f0280 con 0x7f4950101400 2024-09-19T09:40:07.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.923+0000 7f494ed9d640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49380a55b0 0x7f49380a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.923+0000 7f495753e740 1 Processor -- start 2024-09-19T09:40:07.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.923+0000 7f495753e740 1 -- start start 2024-09-19T09:40:07.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.923+0000 7f494ed9d640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49380a55b0 0x7f49380a7a70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4940009b30 tx=0x7f4940005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f495753e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38cb40 0x55d3ca38b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f495753e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 0x55d3ca38ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f495753e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca398760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f495753e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca2f12f0 con 0x55d3ca396370 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f495753e740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca298cf0 con 0x55d3ca38cb40 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f495753e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca2ed2b0 con 0x55d3ca38b5d0 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f494f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca398760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f494f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca398760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44506/0 (socket says 172.21.15.42:44506) 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f494f59e640 1 -- 172.21.15.42:0/2996007112 learned_addr learned my addr 172.21.15.42:0/2996007112 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f494ed9d640 1 --2- 172.21.15.42:0/2996007112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38cb40 0x55d3ca38b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f494e59c640 1 --2- 172.21.15.42:0/2996007112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 0x55d3ca38ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f494f59e640 1 -- 172.21.15.42:0/2996007112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 msgr2=0x55d3ca38ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f494f59e640 1 --2- 172.21.15.42:0/2996007112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 0x55d3ca38ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f494f59e640 1 -- 172.21.15.42:0/2996007112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38cb40 msgr2=0x55d3ca38b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f494f59e640 1 --2- 172.21.15.42:0/2996007112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38cb40 0x55d3ca38b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.924+0000 7f494f59e640 1 -- 172.21.15.42:0/2996007112 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3ca27d3a0 con 0x55d3ca396370 2024-09-19T09:40:07.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.925+0000 7f494f59e640 1 --2- 172.21.15.42:0/2996007112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca398760 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4948009fc0 tx=0x7f4948010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de6f2cf930362ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.925+0000 7f49357fa640 1 -- 172.21.15.42:0/2996007112 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948003b70 con 0x55d3ca396370 2024-09-19T09:40:07.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.925+0000 7f49357fa640 1 -- 172.21.15.42:0/2996007112 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4948003d10 con 0x55d3ca396370 2024-09-19T09:40:07.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.925+0000 7f49357fa640 1 -- 172.21.15.42:0/2996007112 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948011ae0 con 0x55d3ca396370 2024-09-19T09:40:07.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.926+0000 7f495753e740 1 -- 172.21.15.42:0/2996007112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 msgr2=0x55d3ca398760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.926+0000 7f495753e740 1 --2- 172.21.15.42:0/2996007112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca398760 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4948009fc0 tx=0x7f4948010860 comp rx=0 tx=0).stop 2024-09-19T09:40:07.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.926+0000 7f495753e740 1 -- 172.21.15.42:0/2996007112 shutdown_connections 2024-09-19T09:40:07.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.926+0000 7f495753e740 1 --2- 172.21.15.42:0/2996007112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca398760 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.926+0000 7f495753e740 1 --2- 172.21.15.42:0/2996007112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 0x55d3ca38ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.926+0000 7f495753e740 1 --2- 172.21.15.42:0/2996007112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38cb40 0x55d3ca38b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.926+0000 7f495753e740 1 -- 172.21.15.42:0/2996007112 >> 172.21.15.42:0/2996007112 conn(0x55d3ca354310 msgr2=0x55d3ca387c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.927+0000 7f495753e740 1 -- 172.21.15.42:0/2996007112 shutdown_connections 2024-09-19T09:40:07.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.927+0000 7f495753e740 1 -- 172.21.15.42:0/2996007112 wait complete. 2024-09-19T09:40:07.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.927+0000 7f495753e740 1 -- start start 2024-09-19T09:40:07.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.927+0000 7f495753e740 1 Processor -- start 2024-09-19T09:40:07.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.928+0000 7f495753e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 0x55d3ca395d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.928+0000 7f495753e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca393020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.928+0000 7f495753e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca396370 0x55d3ca393610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.928+0000 7f494e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca393020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.928+0000 7f494e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca393020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44508/0 (socket says 172.21.15.42:44508) 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.928+0000 7f494e59c640 1 -- 172.21.15.42:0/1776594255 learned_addr learned my addr 172.21.15.42:0/1776594255 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.928+0000 7f494ed9d640 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 0x55d3ca395d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.928+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca399070 con 0x55d3ca38cb40 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.928+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca2ac060 con 0x55d3ca38b5d0 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.928+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d3ca3991f0 con 0x55d3ca396370 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.929+0000 7f494f59e640 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca396370 0x55d3ca393610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.929+0000 7f495753e740 10 client.0 _ll_register_callbacks cb 0x55d3c9fff8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:07.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.929+0000 7f494e59c640 1 -- 172.21.15.42:0/1776594255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca396370 msgr2=0x55d3ca393610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.929+0000 7f494e59c640 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca396370 0x55d3ca393610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.929+0000 7f494e59c640 1 -- 172.21.15.42:0/1776594255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 msgr2=0x55d3ca395d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.929+0000 7f494e59c640 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 0x55d3ca395d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.929+0000 7f494e59c640 1 -- 172.21.15.42:0/1776594255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3ca0623c0 con 0x55d3ca38cb40 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.929+0000 7f494f59e640 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca396370 0x55d3ca393610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.929+0000 7f494e59c640 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca393020 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f49440bc3c0 tx=0x7f4944009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f92d9ed2604699 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.929+0000 7f4932ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f4932ff5640 1 -- 172.21.15.42:0/1776594255 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49440d9020 con 0x55d3ca38cb40 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f4932ff5640 1 -- 172.21.15.42:0/1776594255 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f49440b8d30 con 0x55d3ca38cb40 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4948003d10 con 0x55d3ca38cb40 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f4932ff5640 1 -- 172.21.15.42:0/1776594255 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f49440a4050 con 0x55d3ca38cb40 2024-09-19T09:40:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f495753e740 10 client.15756 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:07.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3ca3a4af0 con 0x55d3ca38cb40 2024-09-19T09:40:07.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f4932ff5640 1 -- 172.21.15.42:0/1776594255 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49440bc6c0 con 0x55d3ca38cb40 2024-09-19T09:40:07.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f4932ff5640 1 -- 172.21.15.42:0/1776594255 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f494409c070 con 0x55d3ca38cb40 2024-09-19T09:40:07.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f495753e740 10 client.15756 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:07.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f495753e740 10 client.15756 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:40:07.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.930+0000 7f495753e740 20 client.15756 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:07.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.931+0000 7f495753e740 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55d3ca3a5fa0 0x55d3ca3a83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.931+0000 7f495753e740 4 client.15756 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:07.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.931+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4948003d10 con 0x55d3ca3a5fa0 2024-09-19T09:40:07.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.931+0000 7f494ed9d640 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55d3ca3a5fa0 0x55d3ca3a83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.932+0000 7f4932ff5640 10 client.15756 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.932+0000 7f494ed9d640 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55d3ca3a5fa0 0x55d3ca3a83d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e893a21c46a4f0cb server_cookie=35b3403a3fb189b in_seq=0 out_seq=0 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.932+0000 7f4932ff5640 1 -- 172.21.15.42:0/1776594255 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f4948003d10 con 0x55d3ca3a5fa0 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.932+0000 7f4932ff5640 10 client.15756 handle_command_reply: tid=0 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.933+0000 7f495753e740 1 client.15756 shutdown 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.933+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 msgr2=0x55d3ca393020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.933+0000 7f495753e740 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca393020 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f49440bc3c0 tx=0x7f4944009260 comp rx=0 tx=0).stop 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.933+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 shutdown_connections 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.933+0000 7f495753e740 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55d3ca3a5fa0 0x55d3ca3a83d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.933+0000 7f4932ff5640 0 client.15756 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:40:07.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.933+0000 7f495753e740 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca396370 0x55d3ca393610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.933+0000 7f495753e740 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca393020 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.933+0000 7f495753e740 1 --2- 172.21.15.42:0/1776594255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 0x55d3ca395d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.933+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 >> 172.21.15.42:0/1776594255 conn(0x55d3ca354310 msgr2=0x55d3ca38d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.934+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 shutdown_connections 2024-09-19T09:40:07.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.934+0000 7f495753e740 1 -- 172.21.15.42:0/1776594255 wait complete. 2024-09-19T09:40:07.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.934+0000 7f495753e740 20 client.15756 trim_cache size 0 max 16384 2024-09-19T09:40:07.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.959+0000 7f495753e740 1 Processor -- start 2024-09-19T09:40:07.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.959+0000 7f495753e740 1 -- start start 2024-09-19T09:40:07.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f495753e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 0x55d3ca3928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f495753e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38cb40 0x55d3ca394f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f495753e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca38e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f494f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca38e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f494f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca38e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44524/0 (socket says 172.21.15.42:44524) 2024-09-19T09:40:07.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f494f59e640 1 -- 172.21.15.42:0/412969817 learned_addr learned my addr 172.21.15.42:0/412969817 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:07.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f495753e740 1 -- 172.21.15.42:0/412969817 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f49501ab4d0 con 0x55d3ca396370 2024-09-19T09:40:07.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f495753e740 1 -- 172.21.15.42:0/412969817 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f49501ad010 con 0x55d3ca38b5d0 2024-09-19T09:40:07.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f494e59c640 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38cb40 0x55d3ca394f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f495753e740 1 -- 172.21.15.42:0/412969817 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f49501abba0 con 0x55d3ca38cb40 2024-09-19T09:40:07.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.960+0000 7f494ed9d640 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 0x55d3ca3928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.961+0000 7f494e59c640 1 -- 172.21.15.42:0/412969817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 msgr2=0x55d3ca3928e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.961+0000 7f494e59c640 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 0x55d3ca3928e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.961+0000 7f494e59c640 1 -- 172.21.15.42:0/412969817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 msgr2=0x55d3ca38e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.961+0000 7f494e59c640 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca38e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.961+0000 7f494e59c640 1 -- 172.21.15.42:0/412969817 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3ca387510 con 0x55d3ca38cb40 2024-09-19T09:40:07.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.961+0000 7f494ed9d640 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 0x55d3ca3928e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:07.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.961+0000 7f494f59e640 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca38e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.961+0000 7f494e59c640 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38cb40 0x55d3ca394f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f49440b9090 tx=0x7f4944031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5facc2920f829e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.961+0000 7f4934ff9640 1 -- 172.21.15.42:0/412969817 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49440d9070 con 0x55d3ca38cb40 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.962+0000 7f4934ff9640 1 -- 172.21.15.42:0/412969817 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49440bc6c0 con 0x55d3ca38cb40 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.962+0000 7f4934ff9640 1 -- 172.21.15.42:0/412969817 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49440b8d30 con 0x55d3ca38cb40 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.962+0000 7f495753e740 1 -- 172.21.15.42:0/412969817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38cb40 msgr2=0x55d3ca394f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.962+0000 7f495753e740 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38cb40 0x55d3ca394f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f49440b9090 tx=0x7f4944031400 comp rx=0 tx=0).stop 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.962+0000 7f495753e740 1 -- 172.21.15.42:0/412969817 shutdown_connections 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.962+0000 7f495753e740 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca396370 0x55d3ca38e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.962+0000 7f495753e740 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38cb40 0x55d3ca394f90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.962+0000 7f495753e740 1 --2- 172.21.15.42:0/412969817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca38b5d0 0x55d3ca3928e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.962+0000 7f495753e740 1 -- 172.21.15.42:0/412969817 >> 172.21.15.42:0/412969817 conn(0x55d3ca354310 msgr2=0x55d3ca394880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.963+0000 7f495753e740 1 -- 172.21.15.42:0/412969817 shutdown_connections 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.963+0000 7f495753e740 1 -- 172.21.15.42:0/412969817 wait complete. 2024-09-19T09:40:07.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.963+0000 7f495753e740 1 -- start start 2024-09-19T09:40:07.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.963+0000 7f495753e740 1 Processor -- start 2024-09-19T09:40:07.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.964+0000 7f495753e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 0x55d3ca39a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.964+0000 7f495753e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca39a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.964+0000 7f494e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca39a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.964+0000 7f494ed9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 0x55d3ca39a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.964+0000 7f494ed9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 0x55d3ca39a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:54790/0 (socket says 172.21.15.42:54790) 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.964+0000 7f494e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca39a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44532/0 (socket says 172.21.15.42:44532) 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.964+0000 7f494ed9d640 1 -- 172.21.15.42:0/2821167495 learned_addr learned my addr 172.21.15.42:0/2821167495 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f495753e740 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca396370 0x55d3ca39ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f49501ac940 con 0x55d3ca38cb40 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f49501ac270 con 0x55d3ca396370 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f49501a94b0 con 0x55d3ca38b5d0 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f494f59e640 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca396370 0x55d3ca39ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f495753e740 10 client.0 _ll_register_callbacks cb 0x7f4944031e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f494ed9d640 1 -- 172.21.15.42:0/2821167495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca396370 msgr2=0x55d3ca39ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f494ed9d640 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca396370 0x55d3ca39ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f494ed9d640 1 -- 172.21.15.42:0/2821167495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 msgr2=0x55d3ca39a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f494ed9d640 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca39a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f494ed9d640 1 -- 172.21.15.42:0/2821167495 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3ca40fce0 con 0x55d3ca38b5d0 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.965+0000 7f494e59c640 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca39a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.966+0000 7f494ed9d640 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 0x55d3ca39a1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4940011eb0 tx=0x7f4940004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=551cf11369bc080a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.966+0000 7f4932ff5640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.966+0000 7f4932ff5640 1 -- 172.21.15.42:0/2821167495 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940003ba0 con 0x55d3ca38b5d0 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.966+0000 7f4932ff5640 1 -- 172.21.15.42:0/2821167495 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4940003d40 con 0x55d3ca38b5d0 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.966+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49440bc6c0 con 0x55d3ca38b5d0 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.966+0000 7f4932ff5640 1 -- 172.21.15.42:0/2821167495 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f494003a050 con 0x55d3ca38b5d0 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.966+0000 7f495753e740 10 client.25252 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.966+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3ca410f70 con 0x55d3ca38b5d0 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.966+0000 7f4932ff5640 1 -- 172.21.15.42:0/2821167495 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49440bc6c0 con 0x55d3ca38b5d0 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.967+0000 7f4932ff5640 1 -- 172.21.15.42:0/2821167495 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f49400128a0 con 0x55d3ca38b5d0 2024-09-19T09:40:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.967+0000 7f495753e740 10 client.25252 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.967+0000 7f495753e740 10 client.25252 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.967+0000 7f495753e740 20 client.25252 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.967+0000 7f495753e740 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55d3ca3a5fa0 0x55d3ca4136b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.967+0000 7f495753e740 4 client.25252 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.967+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d3ca2fe860 con 0x55d3ca3a5fa0 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.967+0000 7f494e59c640 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55d3ca3a5fa0 0x55d3ca4136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f494e59c640 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55d3ca3a5fa0 0x55d3ca4136b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b30a0d19e59edc5b server_cookie=50a6ff50c4ed99be in_seq=0 out_seq=0 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f4932ff5640 10 client.25252 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f4932ff5640 1 -- 172.21.15.42:0/2821167495 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d3ca2fe860 con 0x55d3ca3a5fa0 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f4932ff5640 10 client.25252 handle_command_reply: tid=0 2024-09-19T09:40:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f495753e740 1 client.25252 shutdown 2024-09-19T09:40:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 msgr2=0x55d3ca39a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f495753e740 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 0x55d3ca39a1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4940011eb0 tx=0x7f4940004730 comp rx=0 tx=0).stop 2024-09-19T09:40:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 shutdown_connections 2024-09-19T09:40:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f495753e740 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55d3ca3a5fa0 0x55d3ca4136b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f4932ff5640 0 client.25252 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:40:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f495753e740 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3ca396370 0x55d3ca39ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f495753e740 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3ca38cb40 0x55d3ca39a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f495753e740 1 --2- 172.21.15.42:0/2821167495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3ca38b5d0 0x55d3ca39a1f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.968+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 >> 172.21.15.42:0/2821167495 conn(0x55d3ca354310 msgr2=0x55d3ca386d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.969+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 shutdown_connections 2024-09-19T09:40:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.969+0000 7f495753e740 1 -- 172.21.15.42:0/2821167495 wait complete. 2024-09-19T09:40:07.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.969+0000 7f495753e740 20 client.25252 trim_cache size 0 max 16384 2024-09-19T09:40:07.974 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:40:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.969+0000 7f4955165640 1 -- 172.21.15.42:0/2733798321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49380a55b0 msgr2=0x7f49380a7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.969+0000 7f4955165640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49380a55b0 0x7f49380a7a70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4940009b30 tx=0x7f4940005f90 comp rx=0 tx=0).stop 2024-09-19T09:40:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.969+0000 7f4955165640 1 -- 172.21.15.42:0/2733798321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4950101400 msgr2=0x7f49501978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.969+0000 7f4955165640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4950101400 0x7f49501978c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f494402a990 tx=0x7f4944003b90 comp rx=0 tx=0).stop 2024-09-19T09:40:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.970+0000 7f4955165640 1 -- 172.21.15.42:0/2733798321 shutdown_connections 2024-09-19T09:40:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.970+0000 7f4955165640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49380a55b0 0x7f49380a7a70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.970+0000 7f4955165640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4950106a60 0x7f495019bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.970+0000 7f4955165640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4950101400 0x7f49501978c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.970+0000 7f4955165640 1 --2- 172.21.15.42:0/2733798321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4950100a60 0x7f4950197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.970+0000 7f4955165640 1 -- 172.21.15.42:0/2733798321 >> 172.21.15.42:0/2733798321 conn(0x7f49500fc780 msgr2=0x7f49500fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.970+0000 7f4955165640 1 -- 172.21.15.42:0/2733798321 shutdown_connections 2024-09-19T09:40:07.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:07.970+0000 7f4955165640 1 -- 172.21.15.42:0/2733798321 wait complete. 2024-09-19T09:40:08.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:08 smithi042 ceph-mon[31223]: pgmap v361: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:40:08.827 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:40:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:08 smithi171 ceph-mon[35803]: pgmap v361: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:40:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:08 smithi136 ceph-mon[34840]: pgmap v361: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:40:09.116 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:09.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.645+0000 7f8ece664640 1 -- 172.21.15.42:0/1515534348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ec81036e0 msgr2=0x7f8ec8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:09.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.645+0000 7f8ece664640 1 --2- 172.21.15.42:0/1515534348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ec81036e0 0x7f8ec8107b90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009930 tx=0x7f8ebc02a420 comp rx=0 tx=0).stop 2024-09-19T09:40:09.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.645+0000 7f8ece664640 1 -- 172.21.15.42:0/1515534348 shutdown_connections 2024-09-19T09:40:09.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.645+0000 7f8ece664640 1 --2- 172.21.15.42:0/1515534348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ec81082a0 0x7f8ec810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.645+0000 7f8ece664640 1 --2- 172.21.15.42:0/1515534348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ec81036e0 0x7f8ec8107b90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.645+0000 7f8ece664640 1 --2- 172.21.15.42:0/1515534348 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ec8102d30 0x7f8ec8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.645+0000 7f8ece664640 1 -- 172.21.15.42:0/1515534348 >> 172.21.15.42:0/1515534348 conn(0x7f8ec80fc7d0 msgr2=0x7f8ec80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:09.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.645+0000 7f8ece664640 1 -- 172.21.15.42:0/1515534348 shutdown_connections 2024-09-19T09:40:09.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.645+0000 7f8ece664640 1 -- 172.21.15.42:0/1515534348 wait complete. 2024-09-19T09:40:09.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.646+0000 7f8ece664640 1 Processor -- start 2024-09-19T09:40:09.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.646+0000 7f8ece664640 1 -- start start 2024-09-19T09:40:09.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.646+0000 7f8ece664640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ec8102d30 0x7f8ec8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.646+0000 7f8ece664640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ec81036e0 0x7f8ec8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.646+0000 7f8ece664640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ec81082a0 0x7f8ec8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ec77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ec81036e0 0x7f8ec8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ec77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ec81036e0 0x7f8ec8100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44560/0 (socket says 172.21.15.42:44560) 2024-09-19T09:40:09.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ec77fe640 1 -- 172.21.15.42:0/3259304032 learned_addr learned my addr 172.21.15.42:0/3259304032 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:09.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec81120b0 con 0x7f8ec81036e0 2024-09-19T09:40:09.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec8111f30 con 0x7f8ec8102d30 2024-09-19T09:40:09.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ec8102d30 0x7f8ec8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec8112230 con 0x7f8ec81082a0 2024-09-19T09:40:09.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8eccc01640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ec81082a0 0x7f8ec8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ec7fff640 1 -- 172.21.15.42:0/3259304032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ec81082a0 msgr2=0x7f8ec8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:09.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ec81082a0 0x7f8ec8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ec7fff640 1 -- 172.21.15.42:0/3259304032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ec81036e0 msgr2=0x7f8ec8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:09.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ec81036e0 0x7f8ec8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8ec7fff640 1 -- 172.21.15.42:0/3259304032 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec81a6a80 con 0x7f8ec8102d30 2024-09-19T09:40:09.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.647+0000 7f8eccc01640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ec81082a0 0x7f8ec8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:09.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.648+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ec8102d30 0x7f8ec8100990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800e9f0 tx=0x7f8eb800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:09.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.648+0000 7f8ec57fa640 1 -- 172.21.15.42:0/3259304032 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800ccc0 con 0x7f8ec8102d30 2024-09-19T09:40:09.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.648+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec81a6d70 con 0x7f8ec8102d30 2024-09-19T09:40:09.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.648+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec81a7270 con 0x7f8ec8102d30 2024-09-19T09:40:09.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.648+0000 7f8ec57fa640 1 -- 172.21.15.42:0/3259304032 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eb8010910 con 0x7f8ec8102d30 2024-09-19T09:40:09.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.648+0000 7f8ec57fa640 1 -- 172.21.15.42:0/3259304032 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8018960 con 0x7f8ec8102d30 2024-09-19T09:40:09.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.651+0000 7f8ec57fa640 1 -- 172.21.15.42:0/3259304032 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f8eb8010430 con 0x7f8ec8102d30 2024-09-19T09:40:09.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.651+0000 7f8ed0a3d740 1 Processor -- start 2024-09-19T09:40:09.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.651+0000 7f8ed0a3d740 1 -- start start 2024-09-19T09:40:09.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b4b40 0x55f2c53b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 0x55f2c53b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8ec57fa640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8eb00a3350 0x7f8eb00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8eccc01640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b4b40 0x55f2c53b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8eccc01640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b4b40 0x55f2c53b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44574/0 (socket says 172.21.15.42:44574) 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53be370 0x55f2c53c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8eccc01640 1 -- 172.21.15.42:0/2766221314 learned_addr learned my addr 172.21.15.42:0/2766221314 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8eb00a3350 0x7f8eb00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8ec57fa640 1 -- 172.21.15.42:0/3259304032 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8eb80cfe90 con 0x7f8ec8102d30 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/2766221314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f2c53192f0 con 0x55f2c53b4b40 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/2766221314 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f2c52c0cf0 con 0x55f2c53be370 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/2766221314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 0x55f2c53b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.652+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/2766221314 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f2c53152b0 con 0x55f2c53b35d0 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.653+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8eb00a3350 0x7f8eb00a5810 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8102420 tx=0x7f8ebc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.653+0000 7f8eccc01640 1 --2- 172.21.15.42:0/2766221314 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53be370 0x55f2c53c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.653+0000 7f8eccc01640 1 -- 172.21.15.42:0/2766221314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 msgr2=0x55f2c53b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.653+0000 7f8eccc01640 1 --2- 172.21.15.42:0/2766221314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 0x55f2c53b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.653+0000 7f8eccc01640 1 -- 172.21.15.42:0/2766221314 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53be370 msgr2=0x55f2c53c0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:09.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.653+0000 7f8eccc01640 1 --2- 172.21.15.42:0/2766221314 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53be370 0x55f2c53c0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.653+0000 7f8eccc01640 1 -- 172.21.15.42:0/2766221314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c52a53a0 con 0x55f2c53b4b40 2024-09-19T09:40:09.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.653+0000 7f8eccc01640 1 --2- 172.21.15.42:0/2766221314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b4b40 0x55f2c53b3090 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00092f0 tx=0x7f8ec0009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d2fd697cab9a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:09.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.653+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/2766221314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 0x55f2c53b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:09.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.654+0000 7f8eae7fc640 1 -- 172.21.15.42:0/2766221314 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0004b20 con 0x55f2c53b4b40 2024-09-19T09:40:09.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.654+0000 7f8eae7fc640 1 -- 172.21.15.42:0/2766221314 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ec0004cc0 con 0x55f2c53b4b40 2024-09-19T09:40:09.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.654+0000 7f8eae7fc640 1 -- 172.21.15.42:0/2766221314 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00052f0 con 0x55f2c53b4b40 2024-09-19T09:40:09.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.654+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/2766221314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b4b40 msgr2=0x55f2c53b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:09.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.654+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/2766221314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b4b40 0x55f2c53b3090 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00092f0 tx=0x7f8ec0009af0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.655+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/2766221314 shutdown_connections 2024-09-19T09:40:09.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.655+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/2766221314 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53be370 0x55f2c53c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.655+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/2766221314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 0x55f2c53b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.655+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/2766221314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b4b40 0x55f2c53b3090 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.655+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/2766221314 >> 172.21.15.42:0/2766221314 conn(0x55f2c537c310 msgr2=0x55f2c53afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:09.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.655+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/2766221314 shutdown_connections 2024-09-19T09:40:09.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.655+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/2766221314 wait complete. 2024-09-19T09:40:09.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.655+0000 7f8ed0a3d740 1 -- start start 2024-09-19T09:40:09.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ed0a3d740 1 Processor -- start 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b35d0 0x55f2c53bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 0x55f2c53bb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53be370 0x55f2c53bb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ed0a3d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f2c53c1070 con 0x55f2c53b35d0 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ec7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b35d0 0x55f2c53bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ec7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b35d0 0x55f2c53bdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44582/0 (socket says 172.21.15.42:44582) 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ec7fff640 1 -- 172.21.15.42:0/1438816386 learned_addr learned my addr 172.21.15.42:0/1438816386 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1438816386 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f2c52d4060 con 0x55f2c53be370 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 0x55f2c53bb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.656+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1438816386 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f2c53c11f0 con 0x55f2c53b4b40 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.657+0000 7f8ed0a3d740 10 client.0 _ll_register_callbacks cb 0x55f2c50278c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.657+0000 7f8eccc01640 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53be370 0x55f2c53bb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.657+0000 7f8ec77fe640 1 -- 172.21.15.42:0/1438816386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53be370 msgr2=0x55f2c53bb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.657+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53be370 0x55f2c53bb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.657+0000 7f8ec77fe640 1 -- 172.21.15.42:0/1438816386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b35d0 msgr2=0x55f2c53bdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.657+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b35d0 0x55f2c53bdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.657+0000 7f8ec77fe640 1 -- 172.21.15.42:0/1438816386 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c508a3c0 con 0x55f2c53b4b40 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.657+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 0x55f2c53bb000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc006010 tx=0x7f8ebc009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=527ab32b212826a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.657+0000 7f8ea77fe640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.657+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1438816386 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc04d020 con 0x55f2c53b4b40 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.658+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1438816386 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8ebc0048c0 con 0x55f2c53b4b40 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.658+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1438816386 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ec0004cc0 con 0x55f2c53b4b40 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.658+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1438816386 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ebc058050 con 0x55f2c53b4b40 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.658+0000 7f8ed0a3d740 10 client.25261 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.658+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1438816386 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f2c53ccb50 con 0x55f2c53b4b40 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.658+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1438816386 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ec0004cc0 con 0x55f2c53b4b40 2024-09-19T09:40:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.659+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1438816386 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8ebc0035f0 con 0x55f2c53b4b40 2024-09-19T09:40:09.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.659+0000 7f8ed0a3d740 10 client.25261 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:09.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.659+0000 7f8ed0a3d740 10 client.25261 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:40:09.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.659+0000 7f8ed0a3d740 20 client.25261 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:09.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.659+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f2c53ce0d0 0x55f2c53d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.659+0000 7f8ed0a3d740 4 client.25261 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:09.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.659+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1438816386 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2c5326860 con 0x55f2c53ce0d0 2024-09-19T09:40:09.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.659+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f2c53ce0d0 0x55f2c53d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.659+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f2c53ce0d0 0x55f2c53d0510 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d005bff092e4f2e3 server_cookie=b8cac0732b1986a1 in_seq=0 out_seq=0 2024-09-19T09:40:09.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.659+0000 7f8ea77fe640 10 client.25261 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:40:09.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.660+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1438816386 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2c5326860 con 0x55f2c53ce0d0 2024-09-19T09:40:09.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.660+0000 7f8ea77fe640 10 client.25261 handle_command_reply: tid=0 2024-09-19T09:40:09.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.660+0000 7f8ed0a3d740 1 client.25261 shutdown 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1438816386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 msgr2=0x55f2c53bb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 0x55f2c53bb000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc006010 tx=0x7f8ebc009260 comp rx=0 tx=0).stop 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1438816386 shutdown_connections 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f2c53ce0d0 0x55f2c53d0510 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53be370 0x55f2c53bb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 0x55f2c53bb000 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ea77fe640 0 client.25261 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1438816386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c53b35d0 0x55f2c53bdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1438816386 >> 172.21.15.42:0/1438816386 conn(0x55f2c537c310 msgr2=0x55f2c53b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1438816386 shutdown_connections 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1438816386 wait complete. 2024-09-19T09:40:09.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.661+0000 7f8ed0a3d740 20 client.25261 trim_cache size 0 max 16384 2024-09-19T09:40:09.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.687+0000 7f8ed0a3d740 1 Processor -- start 2024-09-19T09:40:09.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.687+0000 7f8ed0a3d740 1 -- start start 2024-09-19T09:40:09.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.687+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53b35d0 0x55f2c53b9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 0x55f2c53d5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ed0a3d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb400e500 con 0x55f2c537c310 2024-09-19T09:40:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ed0a3d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb4010040 con 0x55f2c53b35d0 2024-09-19T09:40:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ed0a3d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb400ebd0 con 0x55f2c53b4b40 2024-09-19T09:40:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ec7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ec7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44596/0 (socket says 172.21.15.42:44596) 2024-09-19T09:40:09.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ec7fff640 1 -- 172.21.15.42:0/1409194510 learned_addr learned my addr 172.21.15.42:0/1409194510 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:09.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/1409194510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53b35d0 0x55f2c53b9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8eccc01640 1 --2- 172.21.15.42:0/1409194510 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 0x55f2c53d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ec7fff640 1 -- 172.21.15.42:0/1409194510 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 msgr2=0x55f2c53d5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:09.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/1409194510 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 0x55f2c53d5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ec7fff640 1 -- 172.21.15.42:0/1409194510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53b35d0 msgr2=0x55f2c53b9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:09.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/1409194510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53b35d0 0x55f2c53b9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ec7fff640 1 -- 172.21.15.42:0/1409194510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c53d0b90 con 0x55f2c537c310 2024-09-19T09:40:09.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.688+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/1409194510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53ca370 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800cf30 tx=0x7f8eb80d0110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1426c98bac83098 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:09.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.689+0000 7f8eadffb640 1 -- 172.21.15.42:0/1409194510 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8010720 con 0x55f2c537c310 2024-09-19T09:40:09.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.689+0000 7f8eadffb640 1 -- 172.21.15.42:0/1409194510 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eb809a5d0 con 0x55f2c537c310 2024-09-19T09:40:09.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.689+0000 7f8eadffb640 1 -- 172.21.15.42:0/1409194510 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80bc0b0 con 0x55f2c537c310 2024-09-19T09:40:09.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.689+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1409194510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 msgr2=0x55f2c53ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:09.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.689+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1409194510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53ca370 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800cf30 tx=0x7f8eb80d0110 comp rx=0 tx=0).stop 2024-09-19T09:40:09.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.690+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1409194510 shutdown_connections 2024-09-19T09:40:09.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.690+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1409194510 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b4b40 0x55f2c53d5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.690+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1409194510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53b35d0 0x55f2c53b9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.690+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1409194510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53ca370 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.690+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1409194510 >> 172.21.15.42:0/1409194510 conn(0x55f2c53b69f0 msgr2=0x55f2c53b98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:09.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.690+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1409194510 shutdown_connections 2024-09-19T09:40:09.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.690+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1409194510 wait complete. 2024-09-19T09:40:09.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.690+0000 7f8ed0a3d740 1 -- start start 2024-09-19T09:40:09.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ed0a3d740 1 Processor -- start 2024-09-19T09:40:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ed0a3d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 0x55f2c53c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ec7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ec7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44602/0 (socket says 172.21.15.42:44602) 2024-09-19T09:40:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ec7fff640 1 -- 172.21.15.42:0/1067741771 learned_addr learned my addr 172.21.15.42:0/1067741771 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53b4b40 0x55f2c53c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb400f970 con 0x55f2c537c310 2024-09-19T09:40:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb400f2a0 con 0x55f2c53b4b40 2024-09-19T09:40:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb400c4e0 con 0x55f2c53b35d0 2024-09-19T09:40:09.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.691+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 0x55f2c53c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ec7fff640 1 -- 172.21.15.42:0/1067741771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 msgr2=0x55f2c53c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 0x55f2c53c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ec7fff640 1 -- 172.21.15.42:0/1067741771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53b4b40 msgr2=0x55f2c53c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53b4b40 0x55f2c53c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ec7fff640 1 -- 172.21.15.42:0/1067741771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c5440720 con 0x55f2c537c310 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 0x55f2c53c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ec7fff640 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53c2390 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80a4a10 tx=0x7f8eb809cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b4979357c7baf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ed0a3d740 10 client.0 _ll_register_callbacks cb 0x7f8ebc040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8eb809a5d0 con 0x55f2c537c310 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ea77fe640 10 client.15780 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1067741771 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80b4020 con 0x55f2c537c310 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1067741771 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8eb80b5220 con 0x55f2c537c310 2024-09-19T09:40:09.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1067741771 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8eb8010720 con 0x55f2c537c310 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ed0a3d740 10 client.15780 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.692+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f2c54417b0 con 0x55f2c537c310 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.693+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1067741771 <== mon.0 v2:172.21.15.42:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8eb80bc0d0 con 0x55f2c537c310 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.693+0000 7f8ed0a3d740 10 client.15780 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.693+0000 7f8ed0a3d740 10 client.15780 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.693+0000 7f8ed0a3d740 20 client.15780 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.693+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f2c53be370 0x55f2c5443f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.693+0000 7f8ed0a3d740 4 client.15780 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.693+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2c5320d70 con 0x55f2c53be370 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.693+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f2c53be370 0x55f2c5443f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ea77fe640 10 client.15780 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ec77fe640 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f2c53be370 0x55f2c5443f20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4de17e5166d38e8b server_cookie=8e3b2b0a64232df9 in_seq=0 out_seq=0 2024-09-19T09:40:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ea77fe640 1 -- 172.21.15.42:0/1067741771 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2c5320d70 con 0x55f2c53be370 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ea77fe640 10 client.15780 handle_command_reply: tid=0 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ed0a3d740 1 client.15780 shutdown 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 msgr2=0x55f2c53c2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53c2390 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80a4a10 tx=0x7f8eb809cad0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 shutdown_connections 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f2c53be370 0x55f2c5443f20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2c53b4b40 0x55f2c53c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2c53b35d0 0x55f2c53c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ed0a3d740 1 --2- 172.21.15.42:0/1067741771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2c537c310 0x55f2c53c2390 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 >> 172.21.15.42:0/1067741771 conn(0x55f2c53b69f0 msgr2=0x55f2c53ba0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ea77fe640 0 client.15780 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.694+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 shutdown_connections 2024-09-19T09:40:09.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.695+0000 7f8ed0a3d740 1 -- 172.21.15.42:0/1067741771 wait complete. 2024-09-19T09:40:09.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.695+0000 7f8ed0a3d740 20 client.15780 trim_cache size 0 max 16384 2024-09-19T09:40:09.701 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.695+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8eb00a3350 msgr2=0x7f8eb00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.695+0000 7f8ece664640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8eb00a3350 0x7f8eb00a5810 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8102420 tx=0x7f8ebc005b50 comp rx=0 tx=0).stop 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.695+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ec8102d30 msgr2=0x7f8ec8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.695+0000 7f8ece664640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ec8102d30 0x7f8ec8100990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800e9f0 tx=0x7f8eb800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.696+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 shutdown_connections 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.696+0000 7f8ece664640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8eb00a3350 0x7f8eb00a5810 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.696+0000 7f8ece664640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ec81082a0 0x7f8ec8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.696+0000 7f8ece664640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ec81036e0 0x7f8ec8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.696+0000 7f8ece664640 1 --2- 172.21.15.42:0/3259304032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ec8102d30 0x7f8ec8100990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.696+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 >> 172.21.15.42:0/3259304032 conn(0x7f8ec80fc7d0 msgr2=0x7f8ec8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.696+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 shutdown_connections 2024-09-19T09:40:09.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:09.696+0000 7f8ece664640 1 -- 172.21.15.42:0/3259304032 wait complete. 2024-09-19T09:40:10.490 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:40:10.517 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:10 smithi042 ceph-mon[31223]: pgmap v362: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T09:40:10.777 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:10 smithi171 ceph-mon[35803]: pgmap v362: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T09:40:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:10 smithi136 ceph-mon[34840]: pgmap v362: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T09:40:11.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.331+0000 7f04a5ade640 1 -- 172.21.15.42:0/1575113062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a01012d0 msgr2=0x7f04a0107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:11.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.331+0000 7f04a5ade640 1 --2- 172.21.15.42:0/1575113062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a01012d0 0x7f04a0107a20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0494009900 tx=0x7f049402a410 comp rx=0 tx=0).stop 2024-09-19T09:40:11.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.331+0000 7f04a5ade640 1 -- 172.21.15.42:0/1575113062 shutdown_connections 2024-09-19T09:40:11.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.331+0000 7f04a5ade640 1 --2- 172.21.15.42:0/1575113062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04a0108150 0x7f04a010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.331+0000 7f04a5ade640 1 --2- 172.21.15.42:0/1575113062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a01012d0 0x7f04a0107a20 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.331+0000 7f04a5ade640 1 --2- 172.21.15.42:0/1575113062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04a0100920 0x7f04a0100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.331+0000 7f04a5ade640 1 -- 172.21.15.42:0/1575113062 >> 172.21.15.42:0/1575113062 conn(0x7f04a0075f70 msgr2=0x7f04a0076380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:11.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.331+0000 7f04a5ade640 1 -- 172.21.15.42:0/1575113062 shutdown_connections 2024-09-19T09:40:11.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.331+0000 7f04a5ade640 1 -- 172.21.15.42:0/1575113062 wait complete. 2024-09-19T09:40:11.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.333+0000 7f04a5ade640 1 Processor -- start 2024-09-19T09:40:11.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.333+0000 7f04a5ade640 1 -- start start 2024-09-19T09:40:11.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.333+0000 7f04a5ade640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04a0100920 0x7f04a0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.333+0000 7f04a5ade640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04a01012d0 0x7f04a01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f04a5ade640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0108150 0x7f04a019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0108150 0x7f04a019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0108150 0x7f04a019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45526/0 (socket says 172.21.15.42:45526) 2024-09-19T09:40:11.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049ffff640 1 -- 172.21.15.42:0/2517888975 learned_addr learned my addr 172.21.15.42:0/2517888975 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:11.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049f7fe640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04a0100920 0x7f04a0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049effd640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04a01012d0 0x7f04a01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0111f60 con 0x7f04a0108150 2024-09-19T09:40:11.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0111de0 con 0x7f04a01012d0 2024-09-19T09:40:11.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01120e0 con 0x7f04a0100920 2024-09-19T09:40:11.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049ffff640 1 -- 172.21.15.42:0/2517888975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04a0100920 msgr2=0x7f04a0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:11.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049ffff640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04a0100920 0x7f04a0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049ffff640 1 -- 172.21.15.42:0/2517888975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04a01012d0 msgr2=0x7f04a01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:11.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049ffff640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04a01012d0 0x7f04a01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049ffff640 1 -- 172.21.15.42:0/2517888975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a019d420 con 0x7f04a0108150 2024-09-19T09:40:11.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.334+0000 7f049effd640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04a01012d0 0x7f04a01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:11.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.335+0000 7f049ffff640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0108150 0x7f04a019cd40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f049800eaa0 tx=0x7f049800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:11.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.335+0000 7f049cff9640 1 -- 172.21.15.42:0/2517888975 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049800cdb0 con 0x7f04a0108150 2024-09-19T09:40:11.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.335+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a019d710 con 0x7f04a0108150 2024-09-19T09:40:11.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.335+0000 7f049cff9640 1 -- 172.21.15.42:0/2517888975 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0498005020 con 0x7f04a0108150 2024-09-19T09:40:11.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.335+0000 7f049cff9640 1 -- 172.21.15.42:0/2517888975 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980116d0 con 0x7f04a0108150 2024-09-19T09:40:11.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.336+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a01017d0 con 0x7f04a0108150 2024-09-19T09:40:11.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.339+0000 7f049cff9640 1 -- 172.21.15.42:0/2517888975 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f0498005540 con 0x7f04a0108150 2024-09-19T09:40:11.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.340+0000 7f04a7eb7740 1 Processor -- start 2024-09-19T09:40:11.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.340+0000 7f04a7eb7740 1 -- start start 2024-09-19T09:40:11.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.340+0000 7f049cff9640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04880a32e0 0x7f04880a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.340+0000 7f049cff9640 1 -- 172.21.15.42:0/2517888975 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f04980d2380 con 0x7f04a0108150 2024-09-19T09:40:11.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f049effd640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04880a32e0 0x7f04880a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e70b40 0x562ec5e6f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e6fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e84f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f04a7eb7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562ec5dd52f0 con 0x562ec5e6f5d0 2024-09-19T09:40:11.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f04a7eb7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562ec5d7ccf0 con 0x562ec5e70b40 2024-09-19T09:40:11.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f04a7eb7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562ec5dd12b0 con 0x562ec5e82b80 2024-09-19T09:40:11.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f049ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e84f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f049ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e84f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:45970/0 (socket says 172.21.15.42:45970) 2024-09-19T09:40:11.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f049ffff640 1 -- 172.21.15.42:0/3455712315 learned_addr learned my addr 172.21.15.42:0/3455712315 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:11.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f049f7fe640 1 --2- 172.21.15.42:0/3455712315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e70b40 0x562ec5e6f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f049effd640 1 --2- 172.21.15.42:0/3455712315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e6fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f049ffff640 1 -- 172.21.15.42:0/3455712315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e70b40 msgr2=0x562ec5e6f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:11.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f049ffff640 1 --2- 172.21.15.42:0/3455712315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e70b40 0x562ec5e6f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.341+0000 7f049ffff640 1 -- 172.21.15.42:0/3455712315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 msgr2=0x562ec5e6fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.342+0000 7f049ffff640 1 --2- 172.21.15.42:0/3455712315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e6fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.342+0000 7f049ffff640 1 -- 172.21.15.42:0/3455712315 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec5d613a0 con 0x562ec5e82b80 2024-09-19T09:40:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.342+0000 7f049effd640 1 --2- 172.21.15.42:0/3455712315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e6fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.342+0000 7f049ffff640 1 --2- 172.21.15.42:0/3455712315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e84f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0498097a80 tx=0x7f04980979f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84dec01fe4b5fb70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.342+0000 7f049effd640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04880a32e0 0x7f04880a57a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04a0100280 tx=0x7f0494031710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.342+0000 7f0485ffb640 1 -- 172.21.15.42:0/3455712315 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980b4070 con 0x562ec5e82b80 2024-09-19T09:40:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.342+0000 7f0485ffb640 1 -- 172.21.15.42:0/3455712315 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f049809f9d0 con 0x562ec5e82b80 2024-09-19T09:40:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.342+0000 7f0485ffb640 1 -- 172.21.15.42:0/3455712315 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980052f0 con 0x562ec5e82b80 2024-09-19T09:40:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.343+0000 7f04a7eb7740 1 -- 172.21.15.42:0/3455712315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 msgr2=0x562ec5e84f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.343+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/3455712315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e84f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0498097a80 tx=0x7f04980979f0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.343+0000 7f04a7eb7740 1 -- 172.21.15.42:0/3455712315 shutdown_connections 2024-09-19T09:40:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.343+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/3455712315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e84f70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.343+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/3455712315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e6fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.343+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/3455712315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e70b40 0x562ec5e6f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.343+0000 7f04a7eb7740 1 -- 172.21.15.42:0/3455712315 >> 172.21.15.42:0/3455712315 conn(0x562ec5e38310 msgr2=0x562ec5e6bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.343+0000 7f04a7eb7740 1 -- 172.21.15.42:0/3455712315 shutdown_connections 2024-09-19T09:40:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.343+0000 7f04a7eb7740 1 -- 172.21.15.42:0/3455712315 wait complete. 2024-09-19T09:40:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.344+0000 7f04a7eb7740 1 -- start start 2024-09-19T09:40:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.344+0000 7f04a7eb7740 1 Processor -- start 2024-09-19T09:40:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.344+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e6f5d0 0x562ec5e7f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.344+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.344+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e82b80 0x562ec5e80380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.344+0000 7f04a7eb7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562ec5e85880 con 0x562ec5e70b40 2024-09-19T09:40:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.344+0000 7f04a7eb7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562ec5d90060 con 0x562ec5e82b80 2024-09-19T09:40:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.344+0000 7f04a7eb7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562ec5e85a00 con 0x562ec5e6f5d0 2024-09-19T09:40:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f04a7eb7740 10 client.0 _ll_register_callbacks cb 0x562ec5ae38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45546/0 (socket says 172.21.15.42:45546) 2024-09-19T09:40:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049effd640 1 -- 172.21.15.42:0/1980201521 learned_addr learned my addr 172.21.15.42:0/1980201521 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049ffff640 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e82b80 0x562ec5e80380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049f7fe640 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e6f5d0 0x562ec5e7f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049effd640 1 -- 172.21.15.42:0/1980201521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e6f5d0 msgr2=0x562ec5e7f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:11.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049effd640 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e6f5d0 0x562ec5e7f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049effd640 1 -- 172.21.15.42:0/1980201521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e82b80 msgr2=0x562ec5e80380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:11.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049effd640 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e82b80 0x562ec5e80380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049effd640 1 -- 172.21.15.42:0/1980201521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec5b463c0 con 0x562ec5e70b40 2024-09-19T09:40:11.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.345+0000 7f049ffff640 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e82b80 0x562ec5e80380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:11.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.346+0000 7f049effd640 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7fe40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f049402a930 tx=0x7f049402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6628889248f215 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:11.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.346+0000 7f047effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:11.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.346+0000 7f047effd640 1 -- 172.21.15.42:0/1980201521 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049404e060 con 0x562ec5e70b40 2024-09-19T09:40:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.346+0000 7f047effd640 1 -- 172.21.15.42:0/1980201521 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0494005240 con 0x562ec5e70b40 2024-09-19T09:40:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.346+0000 7f04a7eb7740 1 -- 172.21.15.42:0/1980201521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f049809f9d0 con 0x562ec5e70b40 2024-09-19T09:40:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.346+0000 7f047effd640 1 -- 172.21.15.42:0/1980201521 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0494035050 con 0x562ec5e70b40 2024-09-19T09:40:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.346+0000 7f04a7eb7740 10 client.15792 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.346+0000 7f04a7eb7740 1 -- 172.21.15.42:0/1980201521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ec5e91410 con 0x562ec5e70b40 2024-09-19T09:40:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.347+0000 7f047effd640 1 -- 172.21.15.42:0/1980201521 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0494005440 con 0x562ec5e70b40 2024-09-19T09:40:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.347+0000 7f047effd640 1 -- 172.21.15.42:0/1980201521 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f04940038c0 con 0x562ec5e70b40 2024-09-19T09:40:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.347+0000 7f04a7eb7740 10 client.15792 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.347+0000 7f04a7eb7740 10 client.15792 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:40:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.347+0000 7f04a7eb7740 20 client.15792 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.347+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x562ec5e928d0 0x562ec5e94cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.347+0000 7f04a7eb7740 4 client.15792 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.347+0000 7f04a7eb7740 1 -- 172.21.15.42:0/1980201521 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f049809f9d0 con 0x562ec5e928d0 2024-09-19T09:40:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.348+0000 7f049f7fe640 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x562ec5e928d0 0x562ec5e94cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.348+0000 7f049f7fe640 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x562ec5e928d0 0x562ec5e94cc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aab5861b3c1b5119 server_cookie=5704110dbbe877e7 in_seq=0 out_seq=0 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.348+0000 7f047effd640 10 client.15792 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f047effd640 1 -- 172.21.15.42:0/1980201521 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f049809f9d0 con 0x562ec5e928d0 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f047effd640 10 client.15792 handle_command_reply: tid=0 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f04a7eb7740 1 client.15792 shutdown 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f04a7eb7740 1 -- 172.21.15.42:0/1980201521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 msgr2=0x562ec5e7fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7fe40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f049402a930 tx=0x7f049402a410 comp rx=0 tx=0).stop 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f04a7eb7740 1 -- 172.21.15.42:0/1980201521 shutdown_connections 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x562ec5e928d0 0x562ec5e94cc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f047effd640 0 client.15792 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e82b80 0x562ec5e80380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7fe40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/1980201521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e6f5d0 0x562ec5e7f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.349+0000 7f04a7eb7740 1 -- 172.21.15.42:0/1980201521 >> 172.21.15.42:0/1980201521 conn(0x562ec5e38310 msgr2=0x562ec5e71930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:11.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.350+0000 7f04a7eb7740 1 -- 172.21.15.42:0/1980201521 shutdown_connections 2024-09-19T09:40:11.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.350+0000 7f04a7eb7740 1 -- 172.21.15.42:0/1980201521 wait complete. 2024-09-19T09:40:11.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.350+0000 7f04a7eb7740 20 client.15792 trim_cache size 0 max 16384 2024-09-19T09:40:11.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f04a7eb7740 1 Processor -- start 2024-09-19T09:40:11.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f04a7eb7740 1 -- start start 2024-09-19T09:40:11.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e9a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e70b40 0x562ec5e9aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e7f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f04a7eb7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01ab5d0 con 0x562ec5e6f5d0 2024-09-19T09:40:11.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f04a7eb7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01ad110 con 0x562ec5e70b40 2024-09-19T09:40:11.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f04a7eb7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01abca0 con 0x562ec5e82b80 2024-09-19T09:40:11.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e9a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e9a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45552/0 (socket says 172.21.15.42:45552) 2024-09-19T09:40:11.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.376+0000 7f049f7fe640 1 -- 172.21.15.42:0/41841342 learned_addr learned my addr 172.21.15.42:0/41841342 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:11.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.377+0000 7f049effd640 1 --2- 172.21.15.42:0/41841342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e70b40 0x562ec5e9aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.377+0000 7f049f7fe640 1 -- 172.21.15.42:0/41841342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 msgr2=0x562ec5e7f8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:40:11.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.377+0000 7f049f7fe640 1 --2- 172.21.15.42:0/41841342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e7f8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.377+0000 7f049f7fe640 1 -- 172.21.15.42:0/41841342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e70b40 msgr2=0x562ec5e9aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:11.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.377+0000 7f049f7fe640 1 --2- 172.21.15.42:0/41841342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e70b40 0x562ec5e9aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.377+0000 7f049f7fe640 1 -- 172.21.15.42:0/41841342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec5e72120 con 0x562ec5e6f5d0 2024-09-19T09:40:11.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.377+0000 7f049f7fe640 1 --2- 172.21.15.42:0/41841342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e9a550 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0490009fd0 tx=0x7f0490005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997095f07747d1f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:11.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.377+0000 7f04857fa640 1 -- 172.21.15.42:0/41841342 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490022070 con 0x562ec5e6f5d0 2024-09-19T09:40:11.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.377+0000 7f04857fa640 1 -- 172.21.15.42:0/41841342 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0490005500 con 0x562ec5e6f5d0 2024-09-19T09:40:11.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.377+0000 7f04857fa640 1 -- 172.21.15.42:0/41841342 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490004a00 con 0x562ec5e6f5d0 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.378+0000 7f04a7eb7740 1 -- 172.21.15.42:0/41841342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 msgr2=0x562ec5e9a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.378+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/41841342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e9a550 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0490009fd0 tx=0x7f0490005f90 comp rx=0 tx=0).stop 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.379+0000 7f04a7eb7740 1 -- 172.21.15.42:0/41841342 shutdown_connections 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.379+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/41841342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e7f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.379+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/41841342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e70b40 0x562ec5e9aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.379+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/41841342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e6f5d0 0x562ec5e9a550 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.379+0000 7f04a7eb7740 1 -- 172.21.15.42:0/41841342 >> 172.21.15.42:0/41841342 conn(0x562ec5e38310 msgr2=0x562ec5e7e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.379+0000 7f04a7eb7740 1 -- 172.21.15.42:0/41841342 shutdown_connections 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.379+0000 7f04a7eb7740 1 -- 172.21.15.42:0/41841342 wait complete. 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.379+0000 7f04a7eb7740 1 -- start start 2024-09-19T09:40:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.379+0000 7f04a7eb7740 1 Processor -- start 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e6f5d0 0x562ec5e8b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f04a7eb7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e7cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f049effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f049effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45560/0 (socket says 172.21.15.42:45560) 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f049effd640 1 -- 172.21.15.42:0/315528387 learned_addr learned my addr 172.21.15.42:0/315528387 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01aca40 con 0x562ec5e70b40 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01ac370 con 0x562ec5e6f5d0 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01a95b0 con 0x562ec5e82b80 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f04a7eb7740 10 client.0 _ll_register_callbacks cb 0x7f0490005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f049f7fe640 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e6f5d0 0x562ec5e8b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.380+0000 7f049ffff640 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e7cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.381+0000 7f049effd640 1 -- 172.21.15.42:0/315528387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 msgr2=0x562ec5e7cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.381+0000 7f049effd640 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e7cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.381+0000 7f049effd640 1 -- 172.21.15.42:0/315528387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e6f5d0 msgr2=0x562ec5e8b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.381+0000 7f049effd640 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e6f5d0 0x562ec5e8b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.381+0000 7f049effd640 1 -- 172.21.15.42:0/315528387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec5efc520 con 0x562ec5e70b40 2024-09-19T09:40:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.381+0000 7f049effd640 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7c7b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0494003cc0 tx=0x7f0494005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0714dc41b8f1c8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.381+0000 7f047effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.381+0000 7f047effd640 1 -- 172.21.15.42:0/315528387 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049404e070 con 0x562ec5e70b40 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.381+0000 7f047effd640 1 -- 172.21.15.42:0/315528387 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f04940048c0 con 0x562ec5e70b40 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.381+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0490005500 con 0x562ec5e70b40 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.382+0000 7f047effd640 1 -- 172.21.15.42:0/315528387 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0494062070 con 0x562ec5e70b40 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.382+0000 7f04a7eb7740 10 client.15798 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.382+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ec5efd640 con 0x562ec5e70b40 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.382+0000 7f047effd640 1 -- 172.21.15.42:0/315528387 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04940496a0 con 0x562ec5e70b40 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.382+0000 7f047effd640 1 -- 172.21.15.42:0/315528387 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0494054430 con 0x562ec5e70b40 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.382+0000 7f04a7eb7740 10 client.15798 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.382+0000 7f04a7eb7740 10 client.15798 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.382+0000 7f04a7eb7740 20 client.15798 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.383+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x562ec5e928d0 0x562ec5effcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.383+0000 7f04a7eb7740 4 client.15798 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.383+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0490005500 con 0x562ec5e928d0 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.383+0000 7f049f7fe640 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x562ec5e928d0 0x562ec5effcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.383+0000 7f049f7fe640 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x562ec5e928d0 0x562ec5effcb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7668903bbc0a270c server_cookie=b21920a856fc6e15 in_seq=0 out_seq=0 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.383+0000 7f047effd640 10 client.15798 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.384+0000 7f047effd640 1 -- 172.21.15.42:0/315528387 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0490005500 con 0x562ec5e928d0 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.384+0000 7f047effd640 10 client.15798 handle_command_reply: tid=0 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.384+0000 7f04a7eb7740 1 client.15798 shutdown 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.384+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 msgr2=0x562ec5e7c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.384+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7c7b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0494003cc0 tx=0x7f0494005370 comp rx=0 tx=0).stop 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.385+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 shutdown_connections 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.385+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x562ec5e928d0 0x562ec5effcb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.385+0000 7f047effd640 0 client.15798 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:40:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.385+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec5e82b80 0x562ec5e7cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.385+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562ec5e70b40 0x562ec5e7c7b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.385+0000 7f04a7eb7740 1 --2- 172.21.15.42:0/315528387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562ec5e6f5d0 0x562ec5e8b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.385+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 >> 172.21.15.42:0/315528387 conn(0x562ec5e38310 msgr2=0x562ec5e6a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:11.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.387+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 shutdown_connections 2024-09-19T09:40:11.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.387+0000 7f04a7eb7740 1 -- 172.21.15.42:0/315528387 wait complete. 2024-09-19T09:40:11.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.387+0000 7f04a7eb7740 20 client.15798 trim_cache size 0 max 16384 2024-09-19T09:40:11.390 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:40:11.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04880a32e0 msgr2=0x7f04880a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:11.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04880a32e0 0x7f04880a57a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04a0100280 tx=0x7f0494031710 comp rx=0 tx=0).stop 2024-09-19T09:40:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0108150 msgr2=0x7f04a019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0108150 0x7f04a019cd40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f049800eaa0 tx=0x7f049800ef60 comp rx=0 tx=0).stop 2024-09-19T09:40:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 shutdown_connections 2024-09-19T09:40:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f04880a32e0 0x7f04880a57a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a0108150 0x7f04a019cd40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04a01012d0 0x7f04a01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 --2- 172.21.15.42:0/2517888975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04a0100920 0x7f04a0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 >> 172.21.15.42:0/2517888975 conn(0x7f04a0075f70 msgr2=0x7f04a0105c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 shutdown_connections 2024-09-19T09:40:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:11.388+0000 7f04a5ade640 1 -- 172.21.15.42:0/2517888975 wait complete. 2024-09-19T09:40:12.143 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:40:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.200+0000 7f249359e640 1 -- 172.21.15.42:0/1646218770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24940fffe0 msgr2=0x7f24941003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.200+0000 7f249359e640 1 --2- 172.21.15.42:0/1646218770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24940fffe0 0x7f24941003e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f248400aa10 tx=0x7f248402b720 comp rx=0 tx=0).stop 2024-09-19T09:40:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.201+0000 7f249359e640 1 -- 172.21.15.42:0/1646218770 shutdown_connections 2024-09-19T09:40:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.201+0000 7f249359e640 1 --2- 172.21.15.42:0/1646218770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2494101b90 0x7f2494108420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.201+0000 7f249359e640 1 --2- 172.21.15.42:0/1646218770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24941011d0 0x7f2494101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.201+0000 7f249359e640 1 --2- 172.21.15.42:0/1646218770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24940fffe0 0x7f24941003e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.201+0000 7f249359e640 1 -- 172.21.15.42:0/1646218770 >> 172.21.15.42:0/1646218770 conn(0x7f24940fb740 msgr2=0x7f24940fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.201+0000 7f249359e640 1 -- 172.21.15.42:0/1646218770 shutdown_connections 2024-09-19T09:40:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.201+0000 7f249359e640 1 -- 172.21.15.42:0/1646218770 wait complete. 2024-09-19T09:40:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f249359e640 1 Processor -- start 2024-09-19T09:40:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f249359e640 1 -- start start 2024-09-19T09:40:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f249359e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24940fffe0 0x7f2494197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f249359e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24941011d0 0x7f2494198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f249359e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2494101b90 0x7f249419f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f249359e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f249410d670 con 0x7f24941011d0 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f249359e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f249410d4f0 con 0x7f2494101b90 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f249359e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f249410d7f0 con 0x7f24940fffe0 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f2491d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24941011d0 0x7f2494198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f2491d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24941011d0 0x7f2494198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45572/0 (socket says 172.21.15.42:45572) 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f2491d9b640 1 -- 172.21.15.42:0/663386487 learned_addr learned my addr 172.21.15.42:0/663386487 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f249259c640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24940fffe0 0x7f2494197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.202+0000 7f2492d9d640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2494101b90 0x7f249419f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f2492d9d640 1 -- 172.21.15.42:0/663386487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24940fffe0 msgr2=0x7f2494197bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f2492d9d640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24940fffe0 0x7f2494197bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f2492d9d640 1 -- 172.21.15.42:0/663386487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24941011d0 msgr2=0x7f2494198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f2492d9d640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24941011d0 0x7f2494198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f2492d9d640 1 -- 172.21.15.42:0/663386487 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249419f7f0 con 0x7f2494101b90 2024-09-19T09:40:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f2491d9b640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24941011d0 0x7f2494198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f249259c640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24940fffe0 0x7f2494197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f2492d9d640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2494101b90 0x7f249419f180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f248c00cab0 tx=0x7f248c00cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f24837fe640 1 -- 172.21.15.42:0/663386487 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c00ae20 con 0x7f2494101b90 2024-09-19T09:40:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f24837fe640 1 -- 172.21.15.42:0/663386487 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f248c00f930 con 0x7f2494101b90 2024-09-19T09:40:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.203+0000 7f24837fe640 1 -- 172.21.15.42:0/663386487 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c018b30 con 0x7f2494101b90 2024-09-19T09:40:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.204+0000 7f249359e640 1 -- 172.21.15.42:0/663386487 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249419fae0 con 0x7f2494101b90 2024-09-19T09:40:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.204+0000 7f249359e640 1 -- 172.21.15.42:0/663386487 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249419ff50 con 0x7f2494101b90 2024-09-19T09:40:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.208+0000 7f249ba72740 1 Processor -- start 2024-09-19T09:40:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.208+0000 7f24837fe640 1 -- 172.21.15.42:0/663386487 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f248c018cd0 con 0x7f2494101b90 2024-09-19T09:40:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f249ba72740 1 -- start start 2024-09-19T09:40:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f249ba72740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 0x55c036e78380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f249ba72740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e7d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f249ba72740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e7d950 0x55c036e7fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f249ba72740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c036dd72f0 con 0x55c036e788c0 2024-09-19T09:40:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f249ba72740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c036d7f270 con 0x55c036e77f80 2024-09-19T09:40:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f249ba72740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c036dd32b0 con 0x55c036e7d950 2024-09-19T09:40:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f249259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e7d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f2491d9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e7d950 0x55c036e7fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f249259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e7d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45580/0 (socket says 172.21.15.42:45580) 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f249259c640 1 -- 172.21.15.42:0/4024085532 learned_addr learned my addr 172.21.15.42:0/4024085532 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.209+0000 7f2491d9b640 1 --2- 172.21.15.42:0/4024085532 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 0x55c036e78380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f24837fe640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f247c0a3350 0x7f247c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f249259c640 1 -- 172.21.15.42:0/4024085532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e7d950 msgr2=0x55c036e7fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f249259c640 1 --2- 172.21.15.42:0/4024085532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e7d950 0x55c036e7fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f249259c640 1 -- 172.21.15.42:0/4024085532 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 msgr2=0x55c036e78380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f249259c640 1 --2- 172.21.15.42:0/4024085532 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 0x55c036e78380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f249259c640 1 -- 172.21.15.42:0/4024085532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c036d7e340 con 0x55c036e788c0 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f24837fe640 1 -- 172.21.15.42:0/663386487 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f248c0cff60 con 0x7f2494101b90 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f249259c640 1 --2- 172.21.15.42:0/4024085532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e7d380 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2484030550 tx=0x7f24840043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef2bb1007e6a764 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f2492d9d640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f247c0a3350 0x7f247c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f2480ff9640 1 -- 172.21.15.42:0/4024085532 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248403f070 con 0x55c036e788c0 2024-09-19T09:40:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f2480ff9640 1 -- 172.21.15.42:0/4024085532 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24840307c0 con 0x55c036e788c0 2024-09-19T09:40:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.210+0000 7f2480ff9640 1 -- 172.21.15.42:0/4024085532 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484036040 con 0x55c036e788c0 2024-09-19T09:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.211+0000 7f249ba72740 1 -- 172.21.15.42:0/4024085532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 msgr2=0x55c036e7d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.211+0000 7f249ba72740 1 --2- 172.21.15.42:0/4024085532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e7d380 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2484030550 tx=0x7f24840043b0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.211+0000 7f2492d9d640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f247c0a3350 0x7f247c0a5810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f248c00ca80 tx=0x7f248c098040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.211+0000 7f249ba72740 1 -- 172.21.15.42:0/4024085532 shutdown_connections 2024-09-19T09:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.211+0000 7f249ba72740 1 --2- 172.21.15.42:0/4024085532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e7d950 0x55c036e7fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.211+0000 7f249ba72740 1 --2- 172.21.15.42:0/4024085532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e7d380 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.211+0000 7f249ba72740 1 --2- 172.21.15.42:0/4024085532 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 0x55c036e78380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.211+0000 7f249ba72740 1 -- 172.21.15.42:0/4024085532 >> 172.21.15.42:0/4024085532 conn(0x55c036e6f1e0 msgr2=0x55c036e6f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.212+0000 7f249ba72740 1 -- 172.21.15.42:0/4024085532 shutdown_connections 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.212+0000 7f249ba72740 1 -- 172.21.15.42:0/4024085532 wait complete. 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.212+0000 7f249ba72740 1 -- start start 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.212+0000 7f249ba72740 1 Processor -- start 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.213+0000 7f249ba72740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 0x55c036e82170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.213+0000 7f249ba72740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e826b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.213+0000 7f2491d9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 0x55c036e82170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.213+0000 7f2491d9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 0x55c036e82170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:46050/0 (socket says 172.21.15.42:46050) 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.213+0000 7f249259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e826b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.213+0000 7f249259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e826b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45590/0 (socket says 172.21.15.42:45590) 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.213+0000 7f2491d9b640 1 -- 172.21.15.42:0/3464217247 learned_addr learned my addr 172.21.15.42:0/3464217247 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.213+0000 7f249ba72740 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e7d950 0x55c036e896f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.214+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c036e808c0 con 0x55c036e788c0 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.214+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c036d60290 con 0x55c036e7d950 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.214+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c036e80a40 con 0x55c036e77f80 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.214+0000 7f2491d9b640 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e7d950 0x55c036e896f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.214+0000 7f249259c640 1 -- 172.21.15.42:0/3464217247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 msgr2=0x55c036e82170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.214+0000 7f249259c640 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 0x55c036e82170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.214+0000 7f249259c640 1 -- 172.21.15.42:0/3464217247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e7d950 msgr2=0x55c036e896f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.214+0000 7f249259c640 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e7d950 0x55c036e896f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.214+0000 7f249259c640 1 -- 172.21.15.42:0/3464217247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c036aea210 con 0x55c036e788c0 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.214+0000 7f2491d9b640 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 0x55c036e82170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.215+0000 7f249259c640 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e826b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f248402bc40 tx=0x7f2484030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc03866ec70d82b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.215+0000 7f2479ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.215+0000 7f249ba72740 10 client.0 _ll_register_callbacks cb 0x55c036d91140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.215+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24840307c0 con 0x55c036e788c0 2024-09-19T09:40:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.215+0000 7f2479ffb640 1 -- 172.21.15.42:0/3464217247 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484055050 con 0x55c036e788c0 2024-09-19T09:40:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.215+0000 7f2479ffb640 1 -- 172.21.15.42:0/3464217247 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2484044750 con 0x55c036e788c0 2024-09-19T09:40:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.215+0000 7f2479ffb640 1 -- 172.21.15.42:0/3464217247 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f248404b070 con 0x55c036e788c0 2024-09-19T09:40:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.215+0000 7f249ba72740 10 client.15807 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.215+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c036bb6620 con 0x55c036e788c0 2024-09-19T09:40:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.216+0000 7f2479ffb640 1 -- 172.21.15.42:0/3464217247 <== mon.0 v2:172.21.15.42:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f248400b040 con 0x55c036e788c0 2024-09-19T09:40:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.216+0000 7f249ba72740 10 client.15807 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.216+0000 7f249ba72740 10 client.15807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.216+0000 7f249ba72740 20 client.15807 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.216+0000 7f249ba72740 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c036e8d710 0x55c036e8fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.216+0000 7f249ba72740 4 client.15807 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.216+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c036de4a20 con 0x55c036e8d710 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.216+0000 7f2491d9b640 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c036e8d710 0x55c036e8fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.217+0000 7f2479ffb640 10 client.15807 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.217+0000 7f2491d9b640 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c036e8d710 0x55c036e8fb60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84b589d942063765 server_cookie=41bdfd283977ef98 in_seq=0 out_seq=0 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.217+0000 7f2479ffb640 1 -- 172.21.15.42:0/3464217247 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c036de4a20 con 0x55c036e8d710 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.217+0000 7f2479ffb640 10 client.15807 handle_command_reply: tid=0 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 client.15807 shutdown 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 msgr2=0x55c036e826b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e826b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f248402bc40 tx=0x7f2484030f90 comp rx=0 tx=0).stop 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 shutdown_connections 2024-09-19T09:40:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c036e8d710 0x55c036e8fb60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f2479ffb640 0 client.15807 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e7d950 0x55c036e896f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e788c0 0x55c036e826b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 --2- 172.21.15.42:0/3464217247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 0x55c036e82170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 >> 172.21.15.42:0/3464217247 conn(0x55c036e6f1e0 msgr2=0x55c036e709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 shutdown_connections 2024-09-19T09:40:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 1 -- 172.21.15.42:0/3464217247 wait complete. 2024-09-19T09:40:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.218+0000 7f249ba72740 20 client.15807 trim_cache size 0 max 16384 2024-09-19T09:40:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.232+0000 7f249ba72740 1 Processor -- start 2024-09-19T09:40:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.232+0000 7f249ba72740 1 -- start start 2024-09-19T09:40:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f249ba72740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e6f1e0 0x55c036e6da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f249ba72740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 0x55c036e896b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f249ba72740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e7d950 0x55c036e6dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f249ba72740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f24941a6bc0 con 0x55c036e7d950 2024-09-19T09:40:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f249ba72740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f24941a8700 con 0x55c036e77f80 2024-09-19T09:40:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f249ba72740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f24941a7290 con 0x55c036e6f1e0 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f2491d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e7d950 0x55c036e6dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f2491d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e7d950 0x55c036e6dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45606/0 (socket says 172.21.15.42:45606) 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f2491d9b640 1 -- 172.21.15.42:0/1110190603 learned_addr learned my addr 172.21.15.42:0/1110190603 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f2491d9b640 1 --2- 172.21.15.42:0/1110190603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e6f1e0 0x55c036e6da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f249259c640 1 --2- 172.21.15.42:0/1110190603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 0x55c036e896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f2491d9b640 1 -- 172.21.15.42:0/1110190603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e6f1e0 msgr2=0x55c036e6da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f2491d9b640 1 --2- 172.21.15.42:0/1110190603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e6f1e0 0x55c036e6da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f2491d9b640 1 -- 172.21.15.42:0/1110190603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 msgr2=0x55c036e896b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.233+0000 7f2491d9b640 1 --2- 172.21.15.42:0/1110190603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 0x55c036e896b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.234+0000 7f2491d9b640 1 -- 172.21.15.42:0/1110190603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c036e78da0 con 0x55c036e7d950 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.234+0000 7f249259c640 1 --2- 172.21.15.42:0/1110190603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 0x55c036e896b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.234+0000 7f2491d9b640 1 --2- 172.21.15.42:0/1110190603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e7d950 0x55c036e6dfd0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f248800dfd0 tx=0x7f2488004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59462a773604cf37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.234+0000 7f247bfff640 1 -- 172.21.15.42:0/1110190603 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488025040 con 0x55c036e7d950 2024-09-19T09:40:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.234+0000 7f247bfff640 1 -- 172.21.15.42:0/1110190603 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2488012ce0 con 0x55c036e7d950 2024-09-19T09:40:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.234+0000 7f247bfff640 1 -- 172.21.15.42:0/1110190603 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248802b6c0 con 0x55c036e7d950 2024-09-19T09:40:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.235+0000 7f249ba72740 1 -- 172.21.15.42:0/1110190603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e7d950 msgr2=0x55c036e6dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.235+0000 7f249ba72740 1 --2- 172.21.15.42:0/1110190603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e7d950 0x55c036e6dfd0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f248800dfd0 tx=0x7f2488004730 comp rx=0 tx=0).stop 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.235+0000 7f249ba72740 1 -- 172.21.15.42:0/1110190603 shutdown_connections 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.235+0000 7f249ba72740 1 --2- 172.21.15.42:0/1110190603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e7d950 0x55c036e6dfd0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.235+0000 7f249ba72740 1 --2- 172.21.15.42:0/1110190603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e77f80 0x55c036e896b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.235+0000 7f249ba72740 1 --2- 172.21.15.42:0/1110190603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e6f1e0 0x55c036e6da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.235+0000 7f249ba72740 1 -- 172.21.15.42:0/1110190603 >> 172.21.15.42:0/1110190603 conn(0x55c036e7d470 msgr2=0x55c036e82130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.235+0000 7f249ba72740 1 -- 172.21.15.42:0/1110190603 shutdown_connections 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.235+0000 7f249ba72740 1 -- 172.21.15.42:0/1110190603 wait complete. 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f249ba72740 1 -- start start 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f249ba72740 1 Processor -- start 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f249ba72740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e6f1e0 0x55c036e87090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f249ba72740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 0x55c036e875d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f249ba72740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e7d950 0x55c036e884f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f249ba72740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f24941a8030 con 0x55c036e6f1e0 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f249ba72740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f24941a7960 con 0x55c036e7d950 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f249ba72740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f24941a4ba0 con 0x55c036e77f80 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f249ba72740 10 client.0 _ll_register_callbacks cb 0x7f248800d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f2491d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e6f1e0 0x55c036e87090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f2491d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e6f1e0 0x55c036e87090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45612/0 (socket says 172.21.15.42:45612) 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.236+0000 7f2491d9b640 1 -- 172.21.15.42:0/1024919476 learned_addr learned my addr 172.21.15.42:0/1024919476 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f249259c640 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 0x55c036e875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2491d9b640 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e7d950 0x55c036e884f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2491d9b640 1 -- 172.21.15.42:0/1024919476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 msgr2=0x55c036e875d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2491d9b640 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 0x55c036e875d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2491d9b640 1 -- 172.21.15.42:0/1024919476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e7d950 msgr2=0x55c036e884f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2491d9b640 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e7d950 0x55c036e884f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2491d9b640 1 -- 172.21.15.42:0/1024919476 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c036e88b00 con 0x55c036e6f1e0 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2491d9b640 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e6f1e0 0x55c036e87090 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2488006000 tx=0x7f248800de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b61c714f324af67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2479ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2479ffb640 1 -- 172.21.15.42:0/1024919476 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488005020 con 0x55c036e6f1e0 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2479ffb640 1 -- 172.21.15.42:0/1024919476 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f24880051c0 con 0x55c036e6f1e0 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f249ba72740 1 -- 172.21.15.42:0/1024919476 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2488012ce0 con 0x55c036e6f1e0 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f2479ffb640 1 -- 172.21.15.42:0/1024919476 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f248803d070 con 0x55c036e6f1e0 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f249ba72740 10 client.15813 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.237+0000 7f249ba72740 1 -- 172.21.15.42:0/1024919476 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c036ef8650 con 0x55c036e6f1e0 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.238+0000 7f2479ffb640 1 -- 172.21.15.42:0/1024919476 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2488012ce0 con 0x55c036e6f1e0 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.238+0000 7f2479ffb640 1 -- 172.21.15.42:0/1024919476 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f248801f340 con 0x55c036e6f1e0 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.238+0000 7f249ba72740 10 client.15813 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.238+0000 7f249ba72740 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.238+0000 7f249ba72740 20 client.15813 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.238+0000 7f249ba72740 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c036e8d710 0x55c036efaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.238+0000 7f249ba72740 4 client.15813 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:40:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.238+0000 7f249ba72740 1 -- 172.21.15.42:0/1024919476 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c036dded70 con 0x55c036e8d710 2024-09-19T09:40:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.238+0000 7f249259c640 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c036e8d710 0x55c036efaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.239+0000 7f2479ffb640 10 client.15813 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.239+0000 7f249259c640 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c036e8d710 0x55c036efaf20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e59880896805b93 server_cookie=72840ccaacb90fbe in_seq=0 out_seq=0 2024-09-19T09:40:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f2479ffb640 1 -- 172.21.15.42:0/1024919476 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c036dded70 con 0x55c036e8d710 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f2479ffb640 10 client.15813 handle_command_reply: tid=0 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 client.15813 shutdown 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 -- 172.21.15.42:0/1024919476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e6f1e0 msgr2=0x55c036e87090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e6f1e0 0x55c036e87090 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2488006000 tx=0x7f248800de30 comp rx=0 tx=0).stop 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 -- 172.21.15.42:0/1024919476 shutdown_connections 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55c036e8d710 0x55c036efaf20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c036e7d950 0x55c036e884f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c036e77f80 0x55c036e875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 --2- 172.21.15.42:0/1024919476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c036e6f1e0 0x55c036e87090 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 -- 172.21.15.42:0/1024919476 >> 172.21.15.42:0/1024919476 conn(0x55c036e7d470 msgr2=0x55c036e70060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f2479ffb640 0 client.15813 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 -- 172.21.15.42:0/1024919476 shutdown_connections 2024-09-19T09:40:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 1 -- 172.21.15.42:0/1024919476 wait complete. 2024-09-19T09:40:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.243+0000 7f249ba72740 20 client.15813 trim_cache size 0 max 16384 2024-09-19T09:40:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:40:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:40:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:40:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:40:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 -- 172.21.15.42:0/663386487 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f247c0a3350 msgr2=0x7f247c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f247c0a3350 0x7f247c0a5810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f248c00ca80 tx=0x7f248c098040 comp rx=0 tx=0).stop 2024-09-19T09:40:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 -- 172.21.15.42:0/663386487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2494101b90 msgr2=0x7f249419f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2494101b90 0x7f249419f180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f248c00cab0 tx=0x7f248c00cf70 comp rx=0 tx=0).stop 2024-09-19T09:40:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 -- 172.21.15.42:0/663386487 shutdown_connections 2024-09-19T09:40:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f247c0a3350 0x7f247c0a5810 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2494101b90 0x7f249419f180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24941011d0 0x7f2494198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 --2- 172.21.15.42:0/663386487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24940fffe0 0x7f2494197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 -- 172.21.15.42:0/663386487 >> 172.21.15.42:0/663386487 conn(0x7f24940fb740 msgr2=0x7f24941044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 -- 172.21.15.42:0/663386487 shutdown_connections 2024-09-19T09:40:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:12.244+0000 7f249359e640 1 -- 172.21.15.42:0/663386487 wait complete. 2024-09-19T09:40:12.578 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:12.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:12 smithi042 ceph-mon[31223]: pgmap v363: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:40:12.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:12 smithi171 ceph-mon[35803]: pgmap v363: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:40:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:12 smithi136 ceph-mon[34840]: pgmap v363: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:40:13.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.101+0000 7f9788836640 1 -- 172.21.15.42:0/544447880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9784100e20 msgr2=0x7f9784101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.101+0000 7f9788836640 1 --2- 172.21.15.42:0/544447880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9784100e20 0x7f9784101200 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9774009900 tx=0x7f977402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.101+0000 7f9788836640 1 -- 172.21.15.42:0/544447880 shutdown_connections 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.101+0000 7f9788836640 1 --2- 172.21.15.42:0/544447880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9784102ef0 0x7f978410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.101+0000 7f9788836640 1 --2- 172.21.15.42:0/544447880 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784102570 0x7f97841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.101+0000 7f9788836640 1 --2- 172.21.15.42:0/544447880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9784100e20 0x7f9784101200 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.101+0000 7f9788836640 1 -- 172.21.15.42:0/544447880 >> 172.21.15.42:0/544447880 conn(0x7f97840fc7d0 msgr2=0x7f97840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.101+0000 7f9788836640 1 -- 172.21.15.42:0/544447880 shutdown_connections 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.101+0000 7f9788836640 1 -- 172.21.15.42:0/544447880 wait complete. 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.103+0000 7f9788836640 1 Processor -- start 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.103+0000 7f9788836640 1 -- start start 2024-09-19T09:40:13.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.103+0000 7f9788836640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9784100e20 0x7f9784197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.104+0000 7f9788836640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9784102570 0x7f9784197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.104+0000 7f9788836640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784102ef0 0x7f978419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.104+0000 7f9788836640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9784110fa0 con 0x7f9784102570 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.104+0000 7f9788836640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9784110e20 con 0x7f9784102ef0 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.104+0000 7f9788836640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9784111120 con 0x7f9784100e20 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.104+0000 7f9782d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784102ef0 0x7f978419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.104+0000 7f9782d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784102ef0 0x7f978419baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:35170/0 (socket says 172.21.15.42:35170) 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.104+0000 7f9782d9d640 1 -- 172.21.15.42:0/589682149 learned_addr learned my addr 172.21.15.42:0/589682149 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.104+0000 7f9781d9b640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9784102570 0x7f9784197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.104+0000 7f9782d9d640 1 -- 172.21.15.42:0/589682149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9784100e20 msgr2=0x7f9784197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f978259c640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9784100e20 0x7f9784197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f9782d9d640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9784100e20 0x7f9784197220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f9782d9d640 1 -- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9784102570 msgr2=0x7f9784197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f9782d9d640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9784102570 0x7f9784197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f9782d9d640 1 -- 172.21.15.42:0/589682149 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978419c1d0 con 0x7f9784102ef0 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f9781d9b640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9784102570 0x7f9784197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f9782d9d640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784102ef0 0x7f978419baf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f977c00eb10 tx=0x7f977c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f97737fe640 1 -- 172.21.15.42:0/589682149 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c004b20 con 0x7f9784102ef0 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f97737fe640 1 -- 172.21.15.42:0/589682149 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f977c004cc0 con 0x7f9784102ef0 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f9788836640 1 -- 172.21.15.42:0/589682149 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978419c4c0 con 0x7f9784102ef0 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f97737fe640 1 -- 172.21.15.42:0/589682149 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c010790 con 0x7f9784102ef0 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.105+0000 7f9788836640 1 -- 172.21.15.42:0/589682149 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9784069f70 con 0x7f9784102ef0 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.109+0000 7f978ac0f740 1 Processor -- start 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.109+0000 7f97737fe640 1 -- 172.21.15.42:0/589682149 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f977c005020 con 0x7f9784102ef0 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.110+0000 7f978ac0f740 1 -- start start 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.110+0000 7f978ac0f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf0780b40 0x55edf077f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.110+0000 7f978ac0f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf077f5d0 0x55edf077fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.110+0000 7f978ac0f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf078c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.110+0000 7f978ac0f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55edf06e52f0 con 0x55edf078a370 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.110+0000 7f978ac0f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55edf068ccf0 con 0x55edf0780b40 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.110+0000 7f978ac0f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55edf06e12b0 con 0x55edf077f5d0 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f978259c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf077f5d0 0x55edf077fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f978259c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf077f5d0 0x55edf077fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:46098/0 (socket says 172.21.15.42:46098) 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f978259c640 1 -- 172.21.15.42:0/827057917 learned_addr learned my addr 172.21.15.42:0/827057917 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f9781d9b640 1 --2- 172.21.15.42:0/827057917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf078c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f97737fe640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f976c0a32e0 0x7f976c0a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f97737fe640 1 -- 172.21.15.42:0/589682149 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f977c0d0170 con 0x7f9784102ef0 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f978259c640 1 -- 172.21.15.42:0/827057917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf0780b40 msgr2=0x55edf077f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f978259c640 1 --2- 172.21.15.42:0/827057917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf0780b40 0x55edf077f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f9782d9d640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f976c0a32e0 0x7f976c0a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f978259c640 1 -- 172.21.15.42:0/827057917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 msgr2=0x55edf078c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f978259c640 1 --2- 172.21.15.42:0/827057917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf078c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f978259c640 1 -- 172.21.15.42:0/827057917 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf06713a0 con 0x55edf077f5d0 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.111+0000 7f9781d9b640 1 --2- 172.21.15.42:0/827057917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf078c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.112+0000 7f978259c640 1 --2- 172.21.15.42:0/827057917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf077f5d0 0x55edf077fa10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9774005bf0 tx=0x7f9774000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c534e74993a8d285 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.112+0000 7f9782d9d640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f976c0a32e0 0x7f976c0a57a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f977c009270 tx=0x7f977c009200 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.112+0000 7f9770ff9640 1 -- 172.21.15.42:0/827057917 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977403f070 con 0x55edf077f5d0 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.112+0000 7f9770ff9640 1 -- 172.21.15.42:0/827057917 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9774031c20 con 0x55edf077f5d0 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.112+0000 7f9770ff9640 1 -- 172.21.15.42:0/827057917 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9774035030 con 0x55edf077f5d0 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.113+0000 7f978ac0f740 1 -- 172.21.15.42:0/827057917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf077f5d0 msgr2=0x55edf077fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.113+0000 7f978ac0f740 1 --2- 172.21.15.42:0/827057917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf077f5d0 0x55edf077fa10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9774005bf0 tx=0x7f9774000bc0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.113+0000 7f978ac0f740 1 -- 172.21.15.42:0/827057917 shutdown_connections 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.113+0000 7f978ac0f740 1 --2- 172.21.15.42:0/827057917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf078c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.113+0000 7f978ac0f740 1 --2- 172.21.15.42:0/827057917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf077f5d0 0x55edf077fa10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.113+0000 7f978ac0f740 1 --2- 172.21.15.42:0/827057917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf0780b40 0x55edf077f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.113+0000 7f978ac0f740 1 -- 172.21.15.42:0/827057917 >> 172.21.15.42:0/827057917 conn(0x55edf0748310 msgr2=0x55edf077bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.113+0000 7f978ac0f740 1 -- 172.21.15.42:0/827057917 shutdown_connections 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.113+0000 7f978ac0f740 1 -- 172.21.15.42:0/827057917 wait complete. 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.114+0000 7f978ac0f740 1 -- start start 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.114+0000 7f978ac0f740 1 Processor -- start 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.114+0000 7f978ac0f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf077f5d0 0x55edf0789d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.114+0000 7f9781d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf077f5d0 0x55edf0789d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.114+0000 7f9781d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf077f5d0 0x55edf0789d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45662/0 (socket says 172.21.15.42:45662) 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.114+0000 7f9781d9b640 1 -- 172.21.15.42:0/2776019540 learned_addr learned my addr 172.21.15.42:0/2776019540 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f978ac0f740 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf0780b40 0x55edf0787030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f978ac0f740 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf078a370 0x55edf0787640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55edf078d010 con 0x55edf077f5d0 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55edf06a0060 con 0x55edf0780b40 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55edf078d190 con 0x55edf078a370 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f9781d9b640 1 -- 172.21.15.42:0/2776019540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf078a370 msgr2=0x55edf0787640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f9781d9b640 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf078a370 0x55edf0787640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f9781d9b640 1 -- 172.21.15.42:0/2776019540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf0780b40 msgr2=0x55edf0787030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f9781d9b640 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf0780b40 0x55edf0787030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f9781d9b640 1 -- 172.21.15.42:0/2776019540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf04563c0 con 0x55edf077f5d0 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f978ac0f740 10 client.0 _ll_register_callbacks cb 0x55edf03f38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f9781d9b640 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf077f5d0 0x55edf0789d80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f97780127c0 tx=0x7f9778012c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaee0fa31b0bc34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f9769ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.115+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9774031c20 con 0x55edf077f5d0 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.116+0000 7f9769ffb640 1 -- 172.21.15.42:0/2776019540 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778011db0 con 0x55edf077f5d0 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.116+0000 7f9769ffb640 1 -- 172.21.15.42:0/2776019540 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f977800f450 con 0x55edf077f5d0 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.116+0000 7f9769ffb640 1 -- 172.21.15.42:0/2776019540 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f977800f670 con 0x55edf077f5d0 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.116+0000 7f978ac0f740 10 client.15825 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.116+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55edf07a1260 con 0x55edf077f5d0 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.116+0000 7f9769ffb640 1 -- 172.21.15.42:0/2776019540 <== mon.0 v2:172.21.15.42:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9778019020 con 0x55edf077f5d0 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.117+0000 7f978ac0f740 10 client.15825 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.117+0000 7f978ac0f740 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.117+0000 7f978ac0f740 20 client.15825 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.117+0000 7f978ac0f740 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55edf07a2ba0 0x55edf07a5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.117+0000 7f978ac0f740 4 client.15825 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.117+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edf06f2860 con 0x55edf07a2ba0 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.117+0000 7f978259c640 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55edf07a2ba0 0x55edf07a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.117+0000 7f9769ffb640 10 client.15825 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.117+0000 7f978259c640 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55edf07a2ba0 0x55edf07a5030 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1360f8f5b96e2ea4 server_cookie=279af2cc3d093ee4 in_seq=0 out_seq=0 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f9769ffb640 1 -- 172.21.15.42:0/2776019540 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55edf06f2860 con 0x55edf07a2ba0 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f9769ffb640 10 client.15825 handle_command_reply: tid=0 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f978ac0f740 1 client.15825 shutdown 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf077f5d0 msgr2=0x55edf0789d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f978ac0f740 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf077f5d0 0x55edf0789d80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f97780127c0 tx=0x7f9778012c80 comp rx=0 tx=0).stop 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 shutdown_connections 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f978ac0f740 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55edf07a2ba0 0x55edf07a5030 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f978ac0f740 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf078a370 0x55edf0787640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f978ac0f740 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf0780b40 0x55edf0787030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f9769ffb640 0 client.15825 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.118+0000 7f978ac0f740 1 --2- 172.21.15.42:0/2776019540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf077f5d0 0x55edf0789d80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.119+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 >> 172.21.15.42:0/2776019540 conn(0x55edf0748310 msgr2=0x55edf0781960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.119+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 shutdown_connections 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.119+0000 7f978ac0f740 1 -- 172.21.15.42:0/2776019540 wait complete. 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.119+0000 7f978ac0f740 20 client.15825 trim_cache size 0 max 16384 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.145+0000 7f978ac0f740 1 Processor -- start 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.145+0000 7f978ac0f740 1 -- start start 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.145+0000 7f978ac0f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 0x55edf0787000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.145+0000 7f978ac0f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf0780b40 0x55edf079eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.145+0000 7f978ac0f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf0782120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.145+0000 7f978ac0f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f97841ab3c0 con 0x55edf078a370 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.145+0000 7f978ac0f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97841acf00 con 0x55edf077f5d0 2024-09-19T09:40:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.145+0000 7f978ac0f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f97841aba90 con 0x55edf0780b40 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f9781d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf0782120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f9781d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf0782120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45664/0 (socket says 172.21.15.42:45664) 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f9781d9b640 1 -- 172.21.15.42:0/779393584 learned_addr learned my addr 172.21.15.42:0/779393584 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f9781d9b640 1 --2- 172.21.15.42:0/779393584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 0x55edf0787000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f9781d9b640 1 -- 172.21.15.42:0/779393584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf0780b40 msgr2=0x55edf079eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f9781d9b640 1 --2- 172.21.15.42:0/779393584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf0780b40 0x55edf079eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f9781d9b640 1 -- 172.21.15.42:0/779393584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 msgr2=0x55edf0787000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f9781d9b640 1 --2- 172.21.15.42:0/779393584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 0x55edf0787000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f9781d9b640 1 -- 172.21.15.42:0/779393584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf077b4f0 con 0x55edf078a370 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f9781d9b640 1 --2- 172.21.15.42:0/779393584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf0782120 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f977800fac0 tx=0x7f9778015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88415643d209d151 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f976bfff640 1 -- 172.21.15.42:0/779393584 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977800fbe0 con 0x55edf078a370 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.146+0000 7f976bfff640 1 -- 172.21.15.42:0/779393584 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f977802e070 con 0x55edf078a370 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.147+0000 7f976bfff640 1 -- 172.21.15.42:0/779393584 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977801bd80 con 0x55edf078a370 2024-09-19T09:40:13.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.147+0000 7f978ac0f740 1 -- 172.21.15.42:0/779393584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 msgr2=0x55edf0782120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.147+0000 7f978ac0f740 1 --2- 172.21.15.42:0/779393584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf0782120 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f977800fac0 tx=0x7f9778015000 comp rx=0 tx=0).stop 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.148+0000 7f978ac0f740 1 -- 172.21.15.42:0/779393584 shutdown_connections 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.148+0000 7f978ac0f740 1 --2- 172.21.15.42:0/779393584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf078a370 0x55edf0782120 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.148+0000 7f978ac0f740 1 --2- 172.21.15.42:0/779393584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf0780b40 0x55edf079eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.148+0000 7f978ac0f740 1 --2- 172.21.15.42:0/779393584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 0x55edf0787000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.148+0000 7f978ac0f740 1 -- 172.21.15.42:0/779393584 >> 172.21.15.42:0/779393584 conn(0x55edf0748310 msgr2=0x55edf07868f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.148+0000 7f978ac0f740 1 -- 172.21.15.42:0/779393584 shutdown_connections 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.148+0000 7f978ac0f740 1 -- 172.21.15.42:0/779393584 wait complete. 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.148+0000 7f978ac0f740 1 -- start start 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.148+0000 7f978ac0f740 1 Processor -- start 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f978ac0f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 0x55edf079ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f978ac0f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf0780b40 0x55edf079b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f978ac0f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf079b760 0x55edf07832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f978ac0f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f97841ac830 con 0x55edf0780b40 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f978ac0f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97841ac160 con 0x55edf077f5d0 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f978ac0f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f97841a93a0 con 0x55edf079b760 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f978ac0f740 10 client.0 _ll_register_callbacks cb 0x7f977800c910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f978259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf0780b40 0x55edf079b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f978259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf0780b40 0x55edf079b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45672/0 (socket says 172.21.15.42:45672) 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f978259c640 1 -- 172.21.15.42:0/1382659602 learned_addr learned my addr 172.21.15.42:0/1382659602 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.149+0000 7f9781d9b640 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 0x55edf079ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.150+0000 7f978259c640 1 -- 172.21.15.42:0/1382659602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf079b760 msgr2=0x55edf07832c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.150+0000 7f978259c640 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf079b760 0x55edf07832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.150+0000 7f978259c640 1 -- 172.21.15.42:0/1382659602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 msgr2=0x55edf079ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.150+0000 7f978259c640 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 0x55edf079ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.150+0000 7f978259c640 1 -- 172.21.15.42:0/1382659602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf0783900 con 0x55edf0780b40 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.150+0000 7f9781d9b640 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 0x55edf079ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.150+0000 7f978259c640 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf0780b40 0x55edf079b220 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f977402a9c0 tx=0x7f977403b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a00357cdf7b7b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.150+0000 7f9769ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.150+0000 7f9769ffb640 1 -- 172.21.15.42:0/1382659602 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977403f040 con 0x55edf0780b40 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.150+0000 7f9769ffb640 1 -- 172.21.15.42:0/1382659602 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f977403bc30 con 0x55edf0780b40 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.151+0000 7f978ac0f740 1 -- 172.21.15.42:0/1382659602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f977802e070 con 0x55edf0780b40 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.151+0000 7f9769ffb640 1 -- 172.21.15.42:0/1382659602 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9774035040 con 0x55edf0780b40 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.151+0000 7f978ac0f740 10 client.15831 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.151+0000 7f978ac0f740 1 -- 172.21.15.42:0/1382659602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55edf080d2b0 con 0x55edf0780b40 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.151+0000 7f9769ffb640 1 -- 172.21.15.42:0/1382659602 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f977802e070 con 0x55edf0780b40 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.151+0000 7f9769ffb640 1 -- 172.21.15.42:0/1382659602 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f977404d630 con 0x55edf0780b40 2024-09-19T09:40:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.152+0000 7f978ac0f740 10 client.15831 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.152+0000 7f978ac0f740 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.152+0000 7f978ac0f740 20 client.15831 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.152+0000 7f978ac0f740 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55edf080d5f0 0x55edf080f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.152+0000 7f978ac0f740 4 client.15831 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.152+0000 7f978ac0f740 1 -- 172.21.15.42:0/1382659602 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55edf06ecd70 con 0x55edf080d5f0 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.152+0000 7f9781d9b640 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55edf080d5f0 0x55edf080f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.153+0000 7f9781d9b640 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55edf080d5f0 0x55edf080f9e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e461e1fe1d4429 server_cookie=fbf196d9f40afd95 in_seq=0 out_seq=0 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.153+0000 7f9769ffb640 10 client.15831 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f9769ffb640 1 -- 172.21.15.42:0/1382659602 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55edf06ecd70 con 0x55edf080d5f0 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f9769ffb640 10 client.15831 handle_command_reply: tid=0 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 client.15831 shutdown 2024-09-19T09:40:13.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 -- 172.21.15.42:0/1382659602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf0780b40 msgr2=0x55edf079b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf0780b40 0x55edf079b220 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f977402a9c0 tx=0x7f977403b670 comp rx=0 tx=0).stop 2024-09-19T09:40:13.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 -- 172.21.15.42:0/1382659602 shutdown_connections 2024-09-19T09:40:13.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55edf080d5f0 0x55edf080f9e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55edf079b760 0x55edf07832c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55edf0780b40 0x55edf079b220 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 --2- 172.21.15.42:0/1382659602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edf077f5d0 0x55edf079ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 -- 172.21.15.42:0/1382659602 >> 172.21.15.42:0/1382659602 conn(0x55edf0748310 msgr2=0x55edf077a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f9769ffb640 0 client.15831 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:13.259 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:40:13.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 -- 172.21.15.42:0/1382659602 shutdown_connections 2024-09-19T09:40:13.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 1 -- 172.21.15.42:0/1382659602 wait complete. 2024-09-19T09:40:13.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.154+0000 7f978ac0f740 20 client.15831 trim_cache size 0 max 16384 2024-09-19T09:40:13.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.155+0000 7f9788836640 1 -- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f976c0a32e0 msgr2=0x7f976c0a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.155+0000 7f9788836640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f976c0a32e0 0x7f976c0a57a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f977c009270 tx=0x7f977c009200 comp rx=0 tx=0).stop 2024-09-19T09:40:13.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.155+0000 7f9788836640 1 -- 172.21.15.42:0/589682149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784102ef0 msgr2=0x7f978419baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.155+0000 7f9788836640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784102ef0 0x7f978419baf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f977c00eb10 tx=0x7f977c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.155+0000 7f9788836640 1 -- 172.21.15.42:0/589682149 shutdown_connections 2024-09-19T09:40:13.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.155+0000 7f9788836640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f976c0a32e0 0x7f976c0a57a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.156+0000 7f9788836640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784102ef0 0x7f978419baf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.156+0000 7f9788836640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9784102570 0x7f9784197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.156+0000 7f9788836640 1 --2- 172.21.15.42:0/589682149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9784100e20 0x7f9784197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.156+0000 7f9788836640 1 -- 172.21.15.42:0/589682149 >> 172.21.15.42:0/589682149 conn(0x7f97840fc7d0 msgr2=0x7f97841056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.156+0000 7f9788836640 1 -- 172.21.15.42:0/589682149 shutdown_connections 2024-09-19T09:40:13.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:13.156+0000 7f9788836640 1 -- 172.21.15.42:0/589682149 wait complete. 2024-09-19T09:40:14.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:14 smithi171 ceph-mon[35803]: pgmap v364: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:40:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:14 smithi136 ceph-mon[34840]: pgmap v364: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:40:14.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:14 smithi042 ceph-mon[31223]: pgmap v364: 97 pgs: 97 active+clean; 673 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:40:14.997 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:40:14.997 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:40:15.278 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.825+0000 7f140d542640 1 -- 172.21.15.42:0/1509625381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1408102ef0 msgr2=0x7f140810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.825+0000 7f140d542640 1 --2- 172.21.15.42:0/1509625381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1408102ef0 0x7f140810da40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1400009ca0 tx=0x7f140002a950 comp rx=0 tx=0).stop 2024-09-19T09:40:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.825+0000 7f140d542640 1 -- 172.21.15.42:0/1509625381 shutdown_connections 2024-09-19T09:40:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.825+0000 7f140d542640 1 --2- 172.21.15.42:0/1509625381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1408102ef0 0x7f140810da40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.825+0000 7f140d542640 1 --2- 172.21.15.42:0/1509625381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1408102570 0x7f14081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.825+0000 7f140d542640 1 --2- 172.21.15.42:0/1509625381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1408100e20 0x7f1408101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.825+0000 7f140d542640 1 -- 172.21.15.42:0/1509625381 >> 172.21.15.42:0/1509625381 conn(0x7f14080fc7d0 msgr2=0x7f14080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.825+0000 7f140d542640 1 -- 172.21.15.42:0/1509625381 shutdown_connections 2024-09-19T09:40:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.825+0000 7f140d542640 1 -- 172.21.15.42:0/1509625381 wait complete. 2024-09-19T09:40:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.826+0000 7f140d542640 1 Processor -- start 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.826+0000 7f140d542640 1 -- start start 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.826+0000 7f140d542640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1408100e20 0x7f140819e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.826+0000 7f140d542640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1408102570 0x7f140819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.826+0000 7f140d542640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1408102ef0 0x7f1408196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.826+0000 7f140d542640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1408110f80 con 0x7f1408102570 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.826+0000 7f140d542640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1408110e00 con 0x7f1408100e20 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.826+0000 7f140d542640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1408111100 con 0x7f1408102ef0 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f14067fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1408102570 0x7f140819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f14067fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1408102570 0x7f140819e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45684/0 (socket says 172.21.15.42:45684) 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f14067fc640 1 -- 172.21.15.42:0/1773457039 learned_addr learned my addr 172.21.15.42:0/1773457039 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f14077fe640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1408102ef0 0x7f1408196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f1406ffd640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1408100e20 0x7f140819e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f14067fc640 1 -- 172.21.15.42:0/1773457039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1408102ef0 msgr2=0x7f1408196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f14067fc640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1408102ef0 0x7f1408196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f14067fc640 1 -- 172.21.15.42:0/1773457039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1408100e20 msgr2=0x7f140819e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f14067fc640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1408100e20 0x7f140819e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f14067fc640 1 -- 172.21.15.42:0/1773457039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1408196d40 con 0x7f1408102570 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f14067fc640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1408102570 0x7f140819e6b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00d950 tx=0x7f13fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.827+0000 7f13effff640 1 -- 172.21.15.42:0/1773457039 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc017030 con 0x7f1408102570 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.828+0000 7f13effff640 1 -- 172.21.15.42:0/1773457039 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13fc004020 con 0x7f1408102570 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.828+0000 7f140d542640 1 -- 172.21.15.42:0/1773457039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1408197030 con 0x7f1408102570 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.828+0000 7f13effff640 1 -- 172.21.15.42:0/1773457039 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0047a0 con 0x7f1408102570 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.828+0000 7f140d542640 1 -- 172.21.15.42:0/1773457039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140806bde0 con 0x7f1408102570 2024-09-19T09:40:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.830+0000 7f13effff640 1 -- 172.21.15.42:0/1773457039 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f13fc0041d0 con 0x7f1408102570 2024-09-19T09:40:15.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.831+0000 7f13effff640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f13f00a3350 0x7f13f00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.831+0000 7f13effff640 1 -- 172.21.15.42:0/1773457039 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f13fc0cf440 con 0x7f1408102570 2024-09-19T09:40:15.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.831+0000 7f1406ffd640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f13f00a3350 0x7f13f00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.831+0000 7f140f91b740 1 Processor -- start 2024-09-19T09:40:15.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.831+0000 7f140f91b740 1 -- start start 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.831+0000 7f140f91b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7adb60 0x55e8bd7adf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.831+0000 7f140f91b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f140f91b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b8d40 0x55e8bd7bb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f140f91b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8bd713280 con 0x55e8bd7adb60 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f140f91b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e8bd6bab10 con 0x55e8bd7ae480 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f140f91b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e8bd70f240 con 0x55e8bd7b8d40 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f1406ffd640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f13f00a3350 0x7f13f00a5810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009bd0 tx=0x7f13f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f1406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7adb60 0x55e8bd7adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f1406ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7adb60 0x55e8bd7adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45694/0 (socket says 172.21.15.42:45694) 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f14067fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f1406ffd640 1 -- 172.21.15.42:0/87226307 learned_addr learned my addr 172.21.15.42:0/87226307 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f14077fe640 1 --2- 172.21.15.42:0/87226307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b8d40 0x55e8bd7bb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f1406ffd640 1 -- 172.21.15.42:0/87226307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b8d40 msgr2=0x55e8bd7bb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f1406ffd640 1 --2- 172.21.15.42:0/87226307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b8d40 0x55e8bd7bb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f1406ffd640 1 -- 172.21.15.42:0/87226307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 msgr2=0x55e8bd7b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f1406ffd640 1 --2- 172.21.15.42:0/87226307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f1406ffd640 1 -- 172.21.15.42:0/87226307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8bd6c71f0 con 0x55e8bd7adb60 2024-09-19T09:40:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.832+0000 7f1406ffd640 1 --2- 172.21.15.42:0/87226307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7adb60 0x55e8bd7adf40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005bc0 tx=0x7f13f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6096c44692067b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.833+0000 7f13ed7fa640 1 -- 172.21.15.42:0/87226307 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8005020 con 0x55e8bd7adb60 2024-09-19T09:40:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.833+0000 7f13ed7fa640 1 -- 172.21.15.42:0/87226307 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13f80047a0 con 0x55e8bd7adb60 2024-09-19T09:40:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.833+0000 7f13ed7fa640 1 -- 172.21.15.42:0/87226307 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8026820 con 0x55e8bd7adb60 2024-09-19T09:40:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.834+0000 7f140f91b740 1 -- 172.21.15.42:0/87226307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7adb60 msgr2=0x55e8bd7adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.834+0000 7f140f91b740 1 --2- 172.21.15.42:0/87226307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7adb60 0x55e8bd7adf40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005bc0 tx=0x7f13f8014000 comp rx=0 tx=0).stop 2024-09-19T09:40:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.834+0000 7f140f91b740 1 -- 172.21.15.42:0/87226307 shutdown_connections 2024-09-19T09:40:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.834+0000 7f140f91b740 1 --2- 172.21.15.42:0/87226307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b8d40 0x55e8bd7bb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.834+0000 7f140f91b740 1 --2- 172.21.15.42:0/87226307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.834+0000 7f140f91b740 1 --2- 172.21.15.42:0/87226307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7adb60 0x55e8bd7adf40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.834+0000 7f140f91b740 1 -- 172.21.15.42:0/87226307 >> 172.21.15.42:0/87226307 conn(0x55e8bd7aa0f0 msgr2=0x55e8bd7aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.834+0000 7f140f91b740 1 -- 172.21.15.42:0/87226307 shutdown_connections 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.834+0000 7f140f91b740 1 -- 172.21.15.42:0/87226307 wait complete. 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.834+0000 7f140f91b740 1 -- start start 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f140f91b740 1 Processor -- start 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f140f91b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f140f91b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b8d40 0x55e8bd7b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f140f91b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f14067fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b8d40 0x55e8bd7b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f140f91b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8bd7bb910 con 0x55e8bd7b8d40 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f140f91b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e8bd6cdf10 con 0x55e8bd7ae480 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f140f91b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e8bd7bba90 con 0x55e8bd7b68b0 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f14067fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b8d40 0x55e8bd7b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45696/0 (socket says 172.21.15.42:45696) 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f14067fc640 1 -- 172.21.15.42:0/2204587978 learned_addr learned my addr 172.21.15.42:0/2204587978 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f140f91b740 10 client.0 _ll_register_callbacks cb 0x55e8bd696a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.835+0000 7f1406ffd640 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f14077fe640 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f14067fc640 1 -- 172.21.15.42:0/2204587978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b68b0 msgr2=0x55e8bd7c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f14067fc640 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f14067fc640 1 -- 172.21.15.42:0/2204587978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 msgr2=0x55e8bd7b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f14067fc640 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f14067fc640 1 -- 172.21.15.42:0/2204587978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8bd4846a0 con 0x55e8bd7b8d40 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f14067fc640 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b8d40 0x55e8bd7b6370 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f13fc09b580 tx=0x7f13fc09b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9287516e19cb35a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f13eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f13eaff5640 1 -- 172.21.15.42:0/2204587978 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0b4060 con 0x55e8bd7b8d40 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f13eaff5640 1 -- 172.21.15.42:0/2204587978 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f13fc0a4060 con 0x55e8bd7b8d40 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f140f91b740 1 -- 172.21.15.42:0/2204587978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13f80047a0 con 0x55e8bd7b8d40 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.836+0000 7f13eaff5640 1 -- 172.21.15.42:0/2204587978 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f13fc09b880 con 0x55e8bd7b8d40 2024-09-19T09:40:15.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f140f91b740 10 client.15843 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:15.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f140f91b740 1 -- 172.21.15.42:0/2204587978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8bd7c7b90 con 0x55e8bd7b8d40 2024-09-19T09:40:15.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f13eaff5640 1 -- 172.21.15.42:0/2204587978 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13fc09fc30 con 0x55e8bd7b8d40 2024-09-19T09:40:15.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f13eaff5640 1 -- 172.21.15.42:0/2204587978 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f13fc09cc40 con 0x55e8bd7b8d40 2024-09-19T09:40:15.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f140f91b740 10 client.15843 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:15.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f140f91b740 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:15.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f140f91b740 20 client.15843 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:15.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f140f91b740 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e8bd7c8fa0 0x55e8bd7cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f140f91b740 4 client.15843 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:15.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f140f91b740 1 -- 172.21.15.42:0/2204587978 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f13f80047a0 con 0x55e8bd7c8fa0 2024-09-19T09:40:15.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.837+0000 7f1406ffd640 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e8bd7c8fa0 0x55e8bd7cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.838+0000 7f1406ffd640 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e8bd7c8fa0 0x55e8bd7cb390 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff5c728d1f5b5d7a server_cookie=894a4635b1680455 in_seq=0 out_seq=0 2024-09-19T09:40:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.838+0000 7f13eaff5640 10 client.15843 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f13eaff5640 1 -- 172.21.15.42:0/2204587978 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f13f80047a0 con 0x55e8bd7c8fa0 2024-09-19T09:40:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f13eaff5640 10 client.15843 handle_command_reply: tid=0 2024-09-19T09:40:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 client.15843 shutdown 2024-09-19T09:40:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 -- 172.21.15.42:0/2204587978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b8d40 msgr2=0x55e8bd7b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b8d40 0x55e8bd7b6370 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f13fc09b580 tx=0x7f13fc09b4f0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 -- 172.21.15.42:0/2204587978 shutdown_connections 2024-09-19T09:40:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e8bd7c8fa0 0x55e8bd7cb390 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b8d40 0x55e8bd7b6370 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 --2- 172.21.15.42:0/2204587978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 -- 172.21.15.42:0/2204587978 >> 172.21.15.42:0/2204587978 conn(0x55e8bd7aa0f0 msgr2=0x55e8bd7a9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f13eaff5640 0 client.15843 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 -- 172.21.15.42:0/2204587978 shutdown_connections 2024-09-19T09:40:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 1 -- 172.21.15.42:0/2204587978 wait complete. 2024-09-19T09:40:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.839+0000 7f140f91b740 20 client.15843 trim_cache size 0 max 16384 2024-09-19T09:40:15.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f140f91b740 1 Processor -- start 2024-09-19T09:40:15.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f140f91b740 1 -- start start 2024-09-19T09:40:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f140f91b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7ae480 0x55e8bd7c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f140f91b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7b0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f140f91b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f14077fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f14077fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45702/0 (socket says 172.21.15.42:45702) 2024-09-19T09:40:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f14077fe640 1 -- 172.21.15.42:0/2388706806 learned_addr learned my addr 172.21.15.42:0/2388706806 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f140f91b740 1 -- 172.21.15.42:0/2388706806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f14081c4db0 con 0x55e8bd7b6460 2024-09-19T09:40:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f140f91b740 1 -- 172.21.15.42:0/2388706806 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f14081c68f0 con 0x55e8bd7b68b0 2024-09-19T09:40:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.874+0000 7f140f91b740 1 -- 172.21.15.42:0/2388706806 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f14081c5480 con 0x55e8bd7ae480 2024-09-19T09:40:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.875+0000 7f1406ffd640 1 --2- 172.21.15.42:0/2388706806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7ae480 0x55e8bd7c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.875+0000 7f14067fc640 1 --2- 172.21.15.42:0/2388706806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.875+0000 7f14077fe640 1 -- 172.21.15.42:0/2388706806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7ae480 msgr2=0x55e8bd7c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.875+0000 7f14077fe640 1 --2- 172.21.15.42:0/2388706806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7ae480 0x55e8bd7c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.875+0000 7f14077fe640 1 -- 172.21.15.42:0/2388706806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7b68b0 msgr2=0x55e8bd7b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.875+0000 7f14077fe640 1 --2- 172.21.15.42:0/2388706806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.875+0000 7f14077fe640 1 -- 172.21.15.42:0/2388706806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8bd7a5830 con 0x55e8bd7b6460 2024-09-19T09:40:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.875+0000 7f14077fe640 1 --2- 172.21.15.42:0/2388706806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b4e50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1400035000 tx=0x7f1400009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c394a31d98963d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.876+0000 7f13ecff9640 1 -- 172.21.15.42:0/2388706806 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140004a070 con 0x55e8bd7b6460 2024-09-19T09:40:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.876+0000 7f13ecff9640 1 -- 172.21.15.42:0/2388706806 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140002fbb0 con 0x55e8bd7b6460 2024-09-19T09:40:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.876+0000 7f13ecff9640 1 -- 172.21.15.42:0/2388706806 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1400034040 con 0x55e8bd7b6460 2024-09-19T09:40:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 -- 172.21.15.42:0/2388706806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 msgr2=0x55e8bd7b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 --2- 172.21.15.42:0/2388706806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b4e50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1400035000 tx=0x7f1400009940 comp rx=0 tx=0).stop 2024-09-19T09:40:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 -- 172.21.15.42:0/2388706806 shutdown_connections 2024-09-19T09:40:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 --2- 172.21.15.42:0/2388706806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b4e50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 --2- 172.21.15.42:0/2388706806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 --2- 172.21.15.42:0/2388706806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7ae480 0x55e8bd7c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 -- 172.21.15.42:0/2388706806 >> 172.21.15.42:0/2388706806 conn(0x55e8bd7aa0f0 msgr2=0x55e8bd7b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 -- 172.21.15.42:0/2388706806 shutdown_connections 2024-09-19T09:40:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 -- 172.21.15.42:0/2388706806 wait complete. 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 -- start start 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.877+0000 7f140f91b740 1 Processor -- start 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f140f91b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f140f91b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f140f91b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f140f91b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f14081c6220 con 0x55e8bd7b6460 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f140f91b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f14081c5b50 con 0x55e8bd7ae480 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f140f91b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1408101200 con 0x55e8bd7b68b0 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f140f91b740 10 client.0 _ll_register_callbacks cb 0x7f13fc09b720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f14067fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f14067fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45706/0 (socket says 172.21.15.42:45706) 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f14067fc640 1 -- 172.21.15.42:0/497210600 learned_addr learned my addr 172.21.15.42:0/497210600 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.878+0000 7f14077fe640 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f1406ffd640 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f14067fc640 1 -- 172.21.15.42:0/497210600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b68b0 msgr2=0x55e8bd7b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f14067fc640 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f14067fc640 1 -- 172.21.15.42:0/497210600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 msgr2=0x55e8bd7b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f14067fc640 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f14067fc640 1 -- 172.21.15.42:0/497210600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8bd7bb4a0 con 0x55e8bd7b6460 2024-09-19T09:40:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f1406ffd640 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f14067fc640 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b3290 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f13fc09ba40 tx=0x7f13fc0ba3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3f4ec3db9d6a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f13eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f13eaff5640 1 -- 172.21.15.42:0/497210600 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0b4040 con 0x55e8bd7b6460 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f13eaff5640 1 -- 172.21.15.42:0/497210600 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f13fc0a4270 con 0x55e8bd7b6460 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f140f91b740 1 -- 172.21.15.42:0/497210600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f140002fbb0 con 0x55e8bd7b6460 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f13eaff5640 1 -- 172.21.15.42:0/497210600 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f13fc09fc30 con 0x55e8bd7b6460 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f140f91b740 10 client.15849 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.879+0000 7f140f91b740 1 -- 172.21.15.42:0/497210600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8bd833c60 con 0x55e8bd7b6460 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.880+0000 7f13eaff5640 1 -- 172.21.15.42:0/497210600 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13fc09cbb0 con 0x55e8bd7b6460 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.880+0000 7f13eaff5640 1 -- 172.21.15.42:0/497210600 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f13fc081020 con 0x55e8bd7b6460 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.880+0000 7f140f91b740 10 client.15849 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.880+0000 7f140f91b740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.880+0000 7f140f91b740 20 client.15849 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.880+0000 7f140f91b740 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e8bd8341c0 0x55e8bd8365e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.880+0000 7f140f91b740 4 client.15849 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:40:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.880+0000 7f140f91b740 1 -- 172.21.15.42:0/497210600 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f140002fbb0 con 0x55e8bd8341c0 2024-09-19T09:40:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.880+0000 7f1406ffd640 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e8bd8341c0 0x55e8bd8365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.881+0000 7f13eaff5640 10 client.15849 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.881+0000 7f1406ffd640 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e8bd8341c0 0x55e8bd8365e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=352696b51c46e923 server_cookie=c19f888b1afff047 in_seq=0 out_seq=0 2024-09-19T09:40:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f13eaff5640 1 -- 172.21.15.42:0/497210600 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f140002fbb0 con 0x55e8bd8341c0 2024-09-19T09:40:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f13eaff5640 10 client.15849 handle_command_reply: tid=0 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f140f91b740 1 client.15849 shutdown 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f140f91b740 1 -- 172.21.15.42:0/497210600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 msgr2=0x55e8bd7b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f140f91b740 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b3290 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f13fc09ba40 tx=0x7f13fc0ba3a0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f140f91b740 1 -- 172.21.15.42:0/497210600 shutdown_connections 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f140f91b740 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e8bd8341c0 0x55e8bd8365e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f140f91b740 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e8bd7b68b0 0x55e8bd7b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f140f91b740 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8bd7b6460 0x55e8bd7b3290 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f140f91b740 1 --2- 172.21.15.42:0/497210600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e8bd7ae480 0x55e8bd7b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f140f91b740 1 -- 172.21.15.42:0/497210600 >> 172.21.15.42:0/497210600 conn(0x55e8bd7aa0f0 msgr2=0x55e8bd7b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.882+0000 7f13eaff5640 0 client.15849 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.883+0000 7f140f91b740 1 -- 172.21.15.42:0/497210600 shutdown_connections 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.883+0000 7f140f91b740 1 -- 172.21.15.42:0/497210600 wait complete. 2024-09-19T09:40:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.883+0000 7f140f91b740 20 client.15849 trim_cache size 0 max 16384 2024-09-19T09:40:15.890 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:40:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-19T09:40:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "4fef688a-920a-4d65-a3bd-2fcf652bc8ef", 2024-09-19T09:40:15.890 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-19T09:40:15.890 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:40:15.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.883+0000 7f140d542640 1 -- 172.21.15.42:0/1773457039 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f13f00a3350 msgr2=0x7f13f00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:15.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.883+0000 7f140d542640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f13f00a3350 0x7f13f00a5810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009bd0 tx=0x7f13f8005f90 comp rx=0 tx=0).stop 2024-09-19T09:40:15.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.884+0000 7f140d542640 1 -- 172.21.15.42:0/1773457039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1408102570 msgr2=0x7f140819e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:15.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.884+0000 7f140d542640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1408102570 0x7f140819e6b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00d950 tx=0x7f13fc00de10 comp rx=0 tx=0).stop 2024-09-19T09:40:15.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.884+0000 7f140d542640 1 -- 172.21.15.42:0/1773457039 shutdown_connections 2024-09-19T09:40:15.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.884+0000 7f140d542640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f13f00a3350 0x7f13f00a5810 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.884+0000 7f140d542640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1408102ef0 0x7f1408196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.884+0000 7f140d542640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1408102570 0x7f140819e6b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.884+0000 7f140d542640 1 --2- 172.21.15.42:0/1773457039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1408100e20 0x7f140819e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:15.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.884+0000 7f140d542640 1 -- 172.21.15.42:0/1773457039 >> 172.21.15.42:0/1773457039 conn(0x7f14080fc7d0 msgr2=0x7f14080ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:15.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.884+0000 7f140d542640 1 -- 172.21.15.42:0/1773457039 shutdown_connections 2024-09-19T09:40:15.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:15.884+0000 7f140d542640 1 -- 172.21.15.42:0/1773457039 wait complete. 2024-09-19T09:40:16.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:16 smithi042 ceph-mon[31223]: pgmap v365: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 13 op/s 2024-09-19T09:40:16.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:16 smithi042 ceph-mon[31223]: scrub queued for path: / 2024-09-19T09:40:16.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:16 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:16.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:16 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:40:16.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:16 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:16.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:16 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:40:16.729 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:40:16.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:16 smithi171 ceph-mon[35803]: pgmap v365: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 13 op/s 2024-09-19T09:40:16.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:16 smithi171 ceph-mon[35803]: scrub queued for path: / 2024-09-19T09:40:16.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:16 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:16.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:16 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:40:16.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:16 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:16.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:16 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:40:16.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:16 smithi136 ceph-mon[34840]: pgmap v365: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 13 op/s 2024-09-19T09:40:16.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:16 smithi136 ceph-mon[34840]: scrub queued for path: / 2024-09-19T09:40:16.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:16 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:16.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:16 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:40:16.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:16 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:16.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:16 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:40:17.022 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:17.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.504+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/3893896497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a38100e20 msgr2=0x7f4a38101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:17.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.504+0000 7f4a3d6cb640 1 --2- 172.21.15.42:0/3893896497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a38100e20 0x7f4a38101200 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009900 tx=0x7f4a2802a480 comp rx=0 tx=0).stop 2024-09-19T09:40:17.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.505+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/3893896497 shutdown_connections 2024-09-19T09:40:17.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.505+0000 7f4a3d6cb640 1 --2- 172.21.15.42:0/3893896497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a38102ef0 0x7f4a3810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.505+0000 7f4a3d6cb640 1 --2- 172.21.15.42:0/3893896497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a38102570 0x7f4a381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.505+0000 7f4a3d6cb640 1 --2- 172.21.15.42:0/3893896497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a38100e20 0x7f4a38101200 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.505+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/3893896497 >> 172.21.15.42:0/3893896497 conn(0x7f4a380fc7d0 msgr2=0x7f4a380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:17.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.505+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/3893896497 shutdown_connections 2024-09-19T09:40:17.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.505+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/3893896497 wait complete. 2024-09-19T09:40:17.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.505+0000 7f4a3d6cb640 1 Processor -- start 2024-09-19T09:40:17.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a3d6cb640 1 -- start start 2024-09-19T09:40:17.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a3d6cb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a38100e20 0x7f4a3810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a3d6cb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a38102570 0x7f4a3810ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a3d6cb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a38102ef0 0x7f4a3810ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a3d6cb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a38112060 con 0x7f4a38102ef0 2024-09-19T09:40:17.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a3d6cb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4a38111ee0 con 0x7f4a38100e20 2024-09-19T09:40:17.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a3d6cb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381121e0 con 0x7f4a38102570 2024-09-19T09:40:17.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a377fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a38102ef0 0x7f4a3810ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a377fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a38102ef0 0x7f4a3810ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45722/0 (socket says 172.21.15.42:45722) 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a377fe640 1 -- 172.21.15.42:0/2405420235 learned_addr learned my addr 172.21.15.42:0/2405420235 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.506+0000 7f4a367fc640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a38102570 0x7f4a3810ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.507+0000 7f4a377fe640 1 -- 172.21.15.42:0/2405420235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a38102570 msgr2=0x7f4a3810ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.507+0000 7f4a377fe640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a38102570 0x7f4a3810ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.507+0000 7f4a377fe640 1 -- 172.21.15.42:0/2405420235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a38100e20 msgr2=0x7f4a3810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.507+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a38100e20 0x7f4a3810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.507+0000 7f4a377fe640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a38100e20 0x7f4a3810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.507+0000 7f4a377fe640 1 -- 172.21.15.42:0/2405420235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a381a6a50 con 0x7f4a38102ef0 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.507+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a38100e20 0x7f4a3810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.507+0000 7f4a377fe640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a38102ef0 0x7f4a3810ef50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000eaa0 tx=0x7f4a3000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:17.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.507+0000 7f4a1ffff640 1 -- 172.21.15.42:0/2405420235 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3000cdb0 con 0x7f4a38102ef0 2024-09-19T09:40:17.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.508+0000 7f4a1ffff640 1 -- 172.21.15.42:0/2405420235 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a30005020 con 0x7f4a38102ef0 2024-09-19T09:40:17.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.508+0000 7f4a1ffff640 1 -- 172.21.15.42:0/2405420235 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a300116b0 con 0x7f4a38102ef0 2024-09-19T09:40:17.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.508+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/2405420235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a381a6d40 con 0x7f4a38102ef0 2024-09-19T09:40:17.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.509+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/2405420235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a381a7230 con 0x7f4a38102ef0 2024-09-19T09:40:17.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.511+0000 7f4a1ffff640 1 -- 172.21.15.42:0/2405420235 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f4a30011850 con 0x7f4a38102ef0 2024-09-19T09:40:17.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.512+0000 7f4a1ffff640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4a200a33d0 0x7f4a200a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.513+0000 7f4a1ffff640 1 -- 172.21.15.42:0/2405420235 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4a300d0c20 con 0x7f4a38102ef0 2024-09-19T09:40:17.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.513+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4a200a33d0 0x7f4a200a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.514+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4a200a33d0 0x7f4a200a5890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4a28000c00 tx=0x7f4a28004100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:17.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.514+0000 7f4a3faa4740 1 Processor -- start 2024-09-19T09:40:17.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.514+0000 7f4a3faa4740 1 -- start start 2024-09-19T09:40:17.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.515+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55755615e4a0 0x55755615e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.515+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615edc0 0x557556169140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.515+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x55755616ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.515+0000 7f4a3faa4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5575560c42e0 con 0x557556169680 2024-09-19T09:40:17.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.515+0000 7f4a3faa4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55755606bce0 con 0x55755615edc0 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.515+0000 7f4a3faa4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5575560c02a0 con 0x55755615e4a0 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.515+0000 7f4a367fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615edc0 0x557556169140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.515+0000 7f4a377fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x55755616ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.515+0000 7f4a377fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x55755616ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45724/0 (socket says 172.21.15.42:45724) 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.515+0000 7f4a377fe640 1 -- 172.21.15.42:0/1785326503 learned_addr learned my addr 172.21.15.42:0/1785326503 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.516+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/1785326503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55755615e4a0 0x55755615e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.516+0000 7f4a377fe640 1 -- 172.21.15.42:0/1785326503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55755615e4a0 msgr2=0x55755615e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.516+0000 7f4a377fe640 1 --2- 172.21.15.42:0/1785326503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55755615e4a0 0x55755615e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.516+0000 7f4a377fe640 1 -- 172.21.15.42:0/1785326503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615edc0 msgr2=0x557556169140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.516+0000 7f4a377fe640 1 --2- 172.21.15.42:0/1785326503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615edc0 0x557556169140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.516+0000 7f4a377fe640 1 -- 172.21.15.42:0/1785326503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557556050440 con 0x557556169680 2024-09-19T09:40:17.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.516+0000 7f4a377fe640 1 --2- 172.21.15.42:0/1785326503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x55755616ba70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4a30099a30 tx=0x7f4a3009d170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c606236c6401d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:17.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.516+0000 7f4a1d7fa640 1 -- 172.21.15.42:0/1785326503 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3001f030 con 0x557556169680 2024-09-19T09:40:17.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.516+0000 7f4a1d7fa640 1 -- 172.21.15.42:0/1785326503 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a3009b420 con 0x557556169680 2024-09-19T09:40:17.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.516+0000 7f4a1d7fa640 1 -- 172.21.15.42:0/1785326503 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30005360 con 0x557556169680 2024-09-19T09:40:17.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.517+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1785326503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 msgr2=0x55755616ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:17.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.517+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1785326503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x55755616ba70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4a30099a30 tx=0x7f4a3009d170 comp rx=0 tx=0).stop 2024-09-19T09:40:17.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.517+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1785326503 shutdown_connections 2024-09-19T09:40:17.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.517+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1785326503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x55755616ba70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.517+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1785326503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615edc0 0x557556169140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.517+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1785326503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55755615e4a0 0x55755615e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.517+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1785326503 >> 172.21.15.42:0/1785326503 conn(0x55755615aa30 msgr2=0x55755615ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:17.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.518+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1785326503 shutdown_connections 2024-09-19T09:40:17.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.518+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1785326503 wait complete. 2024-09-19T09:40:17.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.518+0000 7f4a3faa4740 1 -- start start 2024-09-19T09:40:17.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.518+0000 7f4a3faa4740 1 Processor -- start 2024-09-19T09:40:17.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.518+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 0x557556169090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.518+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615edc0 0x557556166340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.518+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556169680 0x557556166950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.518+0000 7f4a3faa4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55755616c250 con 0x55755615edc0 2024-09-19T09:40:17.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.518+0000 7f4a3faa4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55755607f050 con 0x55755615e4a0 2024-09-19T09:40:17.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.518+0000 7f4a3faa4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55755616c3d0 con 0x557556169680 2024-09-19T09:40:17.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a3faa4740 10 client.0 _ll_register_callbacks cb 0x5575560bf160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:17.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a367fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615edc0 0x557556166340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a367fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615edc0 0x557556166340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45730/0 (socket says 172.21.15.42:45730) 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a367fc640 1 -- 172.21.15.42:0/1502761317 learned_addr learned my addr 172.21.15.42:0/1502761317 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a377fe640 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556169680 0x557556166950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a367fc640 1 -- 172.21.15.42:0/1502761317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556169680 msgr2=0x557556166950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a367fc640 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556169680 0x557556166950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a367fc640 1 -- 172.21.15.42:0/1502761317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 msgr2=0x557556169090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 0x557556169090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a367fc640 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 0x557556169090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.519+0000 7f4a367fc640 1 -- 172.21.15.42:0/1502761317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557555e353c0 con 0x55755615edc0 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.520+0000 7f4a367fc640 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615edc0 0x557556166340 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0116f0 tx=0x7f4a2c011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c8bd099ac4d4fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.520+0000 7f4a1aff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.520+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1502761317 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c004020 con 0x55755615edc0 2024-09-19T09:40:17.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.520+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1502761317 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4a2c0041c0 con 0x55755615edc0 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.520+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1502761317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5575560d1850 con 0x55755615edc0 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.520+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1502761317 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4a2c0043c0 con 0x55755615edc0 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.520+0000 7f4a3faa4740 10 client.15861 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.520+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1502761317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557556180540 con 0x55755615edc0 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.521+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1502761317 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5575560d1850 con 0x55755615edc0 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.521+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1502761317 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4a2c003c90 con 0x55755615edc0 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.521+0000 7f4a3faa4740 10 client.15861 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.521+0000 7f4a3faa4740 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.521+0000 7f4a3faa4740 20 client.15861 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.521+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5575561819a0 0x557556183e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.521+0000 7f4a3faa4740 4 client.15861 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:17.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.521+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1502761317 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575560cbd60 con 0x5575561819a0 2024-09-19T09:40:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.521+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5575561819a0 0x557556183e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.522+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5575561819a0 0x557556183e20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b0786daaa6a233 server_cookie=c1390002857e9ee9 in_seq=0 out_seq=0 2024-09-19T09:40:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.522+0000 7f4a1aff5640 10 client.15861 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1502761317 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575560cbd60 con 0x5575561819a0 2024-09-19T09:40:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a1aff5640 10 client.15861 handle_command_reply: tid=0 2024-09-19T09:40:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 client.15861 shutdown 2024-09-19T09:40:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1502761317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615edc0 msgr2=0x557556166340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615edc0 0x557556166340 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0116f0 tx=0x7f4a2c011bb0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1502761317 shutdown_connections 2024-09-19T09:40:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5575561819a0 0x557556183e20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556169680 0x557556166950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615edc0 0x557556166340 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1502761317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 0x557556169090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1502761317 >> 172.21.15.42:0/1502761317 conn(0x55755615aa30 msgr2=0x557556160710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a1aff5640 0 client.15861 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1502761317 shutdown_connections 2024-09-19T09:40:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1502761317 wait complete. 2024-09-19T09:40:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.523+0000 7f4a3faa4740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T09:40:17.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.558+0000 7f4a3faa4740 1 Processor -- start 2024-09-19T09:40:17.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.558+0000 7f4a3faa4740 1 -- start start 2024-09-19T09:40:17.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.558+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615e4a0 0x55755617dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.558+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556169680 0x5575561682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.558+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557556165430 0x5575561896f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.558+0000 7f4a3faa4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381ab550 con 0x55755615e4a0 2024-09-19T09:40:17.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.558+0000 7f4a3faa4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381ad090 con 0x557556165430 2024-09-19T09:40:17.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.558+0000 7f4a3faa4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381abc20 con 0x557556169680 2024-09-19T09:40:17.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.558+0000 7f4a36ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615e4a0 0x55755617dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.558+0000 7f4a36ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615e4a0 0x55755617dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45746/0 (socket says 172.21.15.42:45746) 2024-09-19T09:40:17.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.559+0000 7f4a36ffd640 1 -- 172.21.15.42:0/3393852097 learned_addr learned my addr 172.21.15.42:0/3393852097 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:17.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.559+0000 7f4a377fe640 1 --2- 172.21.15.42:0/3393852097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557556165430 0x5575561896f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.559+0000 7f4a36ffd640 1 -- 172.21.15.42:0/3393852097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556169680 msgr2=0x5575561682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.559+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/3393852097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556169680 0x5575561682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.559+0000 7f4a36ffd640 1 -- 172.21.15.42:0/3393852097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557556165430 msgr2=0x5575561896f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.559+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/3393852097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557556165430 0x5575561896f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.559+0000 7f4a36ffd640 1 -- 172.21.15.42:0/3393852097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55755615ebf0 con 0x55755615e4a0 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.559+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/3393852097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615e4a0 0x55755617dd40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009900 tx=0x7f4a2803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64596976c306a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.559+0000 7f4a1cff9640 1 -- 172.21.15.42:0/3393852097 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28056070 con 0x55755615e4a0 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.559+0000 7f4a1cff9640 1 -- 172.21.15.42:0/3393852097 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a28041040 con 0x55755615e4a0 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.560+0000 7f4a1cff9640 1 -- 172.21.15.42:0/3393852097 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28035050 con 0x55755615e4a0 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.560+0000 7f4a3faa4740 1 -- 172.21.15.42:0/3393852097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615e4a0 msgr2=0x55755617dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.560+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/3393852097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615e4a0 0x55755617dd40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009900 tx=0x7f4a2803b000 comp rx=0 tx=0).stop 2024-09-19T09:40:17.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.561+0000 7f4a3faa4740 1 -- 172.21.15.42:0/3393852097 shutdown_connections 2024-09-19T09:40:17.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.561+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/3393852097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557556165430 0x5575561896f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.561+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/3393852097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556169680 0x5575561682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.561+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/3393852097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55755615e4a0 0x55755617dd40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.561+0000 7f4a3faa4740 1 -- 172.21.15.42:0/3393852097 >> 172.21.15.42:0/3393852097 conn(0x55755615aa30 msgr2=0x557556167ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:17.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.561+0000 7f4a3faa4740 1 -- 172.21.15.42:0/3393852097 shutdown_connections 2024-09-19T09:40:17.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.561+0000 7f4a3faa4740 1 -- 172.21.15.42:0/3393852097 wait complete. 2024-09-19T09:40:17.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.561+0000 7f4a3faa4740 1 -- start start 2024-09-19T09:40:17.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.561+0000 7f4a3faa4740 1 Processor -- start 2024-09-19T09:40:17.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 0x55755617a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556165430 0x557556175ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a3faa4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x557556176240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a36ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 0x55755617a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a367fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556165430 0x557556175ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a36ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 0x55755617a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:35314/0 (socket says 172.21.15.42:35314) 2024-09-19T09:40:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a377fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x557556176240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a367fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556165430 0x557556175ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:46224/0 (socket says 172.21.15.42:46224) 2024-09-19T09:40:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a377fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x557556176240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45750/0 (socket says 172.21.15.42:45750) 2024-09-19T09:40:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a36ffd640 1 -- 172.21.15.42:0/1959962815 learned_addr learned my addr 172.21.15.42:0/1959962815 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381ac9c0 con 0x557556169680 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381ac2f0 con 0x55755615e4a0 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381a9530 con 0x557556165430 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.562+0000 7f4a3faa4740 10 client.0 _ll_register_callbacks cb 0x7f4a2c00bdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.563+0000 7f4a377fe640 1 -- 172.21.15.42:0/1959962815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556165430 msgr2=0x557556175ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.563+0000 7f4a377fe640 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556165430 0x557556175ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.563+0000 7f4a377fe640 1 -- 172.21.15.42:0/1959962815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 msgr2=0x55755617a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.563+0000 7f4a377fe640 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 0x55755617a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.563+0000 7f4a377fe640 1 -- 172.21.15.42:0/1959962815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557556169400 con 0x557556169680 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.563+0000 7f4a367fc640 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556165430 0x557556175ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.563+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 0x55755617a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.563+0000 7f4a377fe640 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x557556176240 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4a30099a30 tx=0x7f4a3009cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e09f1da65bd51b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.563+0000 7f4a1aff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.566+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1959962815 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3001f040 con 0x557556169680 2024-09-19T09:40:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.566+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1959962815 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4a300996d0 con 0x557556169680 2024-09-19T09:40:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.566+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a28041040 con 0x557556169680 2024-09-19T09:40:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.566+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1959962815 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4a300ce7a0 con 0x557556169680 2024-09-19T09:40:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.566+0000 7f4a3faa4740 10 client.15867 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.566+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5575561ec670 con 0x557556169680 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.567+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1959962815 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a28041040 con 0x557556169680 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.567+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1959962815 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4a3000f040 con 0x557556169680 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.567+0000 7f4a3faa4740 10 client.15867 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.567+0000 7f4a3faa4740 10 client.15867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.567+0000 7f4a3faa4740 20 client.15867 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.567+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5575561ec8f0 0x5575561eece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.567+0000 7f4a3faa4740 4 client.15867 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.567+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557556048210 con 0x5575561ec8f0 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.567+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5575561ec8f0 0x5575561eece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.568+0000 7f4a1aff5640 10 client.15867 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.568+0000 7f4a36ffd640 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5575561ec8f0 0x5575561eece0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eeef8f17a784e29 server_cookie=fcb294c4edc3a549 in_seq=0 out_seq=0 2024-09-19T09:40:17.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a1aff5640 1 -- 172.21.15.42:0/1959962815 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557556048210 con 0x5575561ec8f0 2024-09-19T09:40:17.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a1aff5640 10 client.15867 handle_command_reply: tid=0 2024-09-19T09:40:17.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a3faa4740 1 client.15867 shutdown 2024-09-19T09:40:17.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 msgr2=0x557556176240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:17.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x557556176240 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4a30099a30 tx=0x7f4a3009cba0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 shutdown_connections 2024-09-19T09:40:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5575561ec8f0 0x5575561eece0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557556169680 0x557556176240 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a1aff5640 0 client.15867 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557556165430 0x557556175ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a3faa4740 1 --2- 172.21.15.42:0/1959962815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55755615e4a0 0x55755617a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 >> 172.21.15.42:0/1959962815 conn(0x55755615aa30 msgr2=0x557556160710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.569+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 shutdown_connections 2024-09-19T09:40:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.570+0000 7f4a3faa4740 1 -- 172.21.15.42:0/1959962815 wait complete. 2024-09-19T09:40:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.570+0000 7f4a3faa4740 20 client.15867 trim_cache size 0 max 16384 2024-09-19T09:40:17.574 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:40:17.574 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-19T09:40:17.574 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-09-19T09:40:17.574 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:40:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.570+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/2405420235 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4a200a33d0 msgr2=0x7f4a200a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.570+0000 7f4a3d6cb640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4a200a33d0 0x7f4a200a5890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4a28000c00 tx=0x7f4a28004100 comp rx=0 tx=0).stop 2024-09-19T09:40:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.570+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/2405420235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a38102ef0 msgr2=0x7f4a3810ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.570+0000 7f4a3d6cb640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a38102ef0 0x7f4a3810ef50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000eaa0 tx=0x7f4a3000ef60 comp rx=0 tx=0).stop 2024-09-19T09:40:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.571+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/2405420235 shutdown_connections 2024-09-19T09:40:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.571+0000 7f4a3d6cb640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4a200a33d0 0x7f4a200a5890 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.571+0000 7f4a3d6cb640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a38102ef0 0x7f4a3810ef50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.571+0000 7f4a3d6cb640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a38102570 0x7f4a3810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.571+0000 7f4a3d6cb640 1 --2- 172.21.15.42:0/2405420235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a38100e20 0x7f4a3810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.571+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/2405420235 >> 172.21.15.42:0/2405420235 conn(0x7f4a380fc7d0 msgr2=0x7f4a380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:17.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.571+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/2405420235 shutdown_connections 2024-09-19T09:40:17.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:17.571+0000 7f4a3d6cb640 1 -- 172.21.15.42:0/2405420235 wait complete. 2024-09-19T09:40:17.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:17 smithi171 ceph-mon[35803]: pgmap v366: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-19T09:40:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:17 smithi136 ceph-mon[34840]: pgmap v366: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-19T09:40:17.932 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:17 smithi042 ceph-mon[31223]: pgmap v366: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-19T09:40:18.386 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:40:18.387 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:40:18.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:18 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:18.735 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:18 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:18.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:18 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:19.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.201+0000 7f51bd26a640 1 -- 172.21.15.42:0/1540315838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51b8102ef0 msgr2=0x7f51b810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.201+0000 7f51bd26a640 1 --2- 172.21.15.42:0/1540315838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51b8102ef0 0x7f51b810da40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009ca0 tx=0x7f51b002a950 comp rx=0 tx=0).stop 2024-09-19T09:40:19.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.201+0000 7f51bd26a640 1 -- 172.21.15.42:0/1540315838 shutdown_connections 2024-09-19T09:40:19.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.201+0000 7f51bd26a640 1 --2- 172.21.15.42:0/1540315838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51b8102ef0 0x7f51b810da40 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.201+0000 7f51bd26a640 1 --2- 172.21.15.42:0/1540315838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b8102570 0x7f51b81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.201+0000 7f51bd26a640 1 --2- 172.21.15.42:0/1540315838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51b8100e20 0x7f51b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.201+0000 7f51bd26a640 1 -- 172.21.15.42:0/1540315838 >> 172.21.15.42:0/1540315838 conn(0x7f51b80fc7d0 msgr2=0x7f51b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.201+0000 7f51bd26a640 1 -- 172.21.15.42:0/1540315838 shutdown_connections 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.201+0000 7f51bd26a640 1 -- 172.21.15.42:0/1540315838 wait complete. 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.202+0000 7f51bd26a640 1 Processor -- start 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.202+0000 7f51bd26a640 1 -- start start 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.202+0000 7f51bd26a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51b8100e20 0x7f51b819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.202+0000 7f51bd26a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b8102570 0x7f51b819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.202+0000 7f51bd26a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51b8102ef0 0x7f51b819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51bd26a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f51b810fec0 con 0x7f51b8102ef0 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51bd26a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f51b810fd40 con 0x7f51b8102570 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51bd26a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f51b8110040 con 0x7f51b8100e20 2024-09-19T09:40:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b6ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51b8100e20 0x7f51b819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b6ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51b8100e20 0x7f51b819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:46242/0 (socket says 172.21.15.42:46242) 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b6ffd640 1 -- 172.21.15.42:0/1069552919 learned_addr learned my addr 172.21.15.42:0/1069552919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b67fc640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b8102570 0x7f51b819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b77fe640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51b8102ef0 0x7f51b819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b6ffd640 1 -- 172.21.15.42:0/1069552919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b8102570 msgr2=0x7f51b819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b6ffd640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b8102570 0x7f51b819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b6ffd640 1 -- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51b8102ef0 msgr2=0x7f51b819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b6ffd640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51b8102ef0 0x7f51b819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b6ffd640 1 -- 172.21.15.42:0/1069552919 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b819f5f0 con 0x7f51b8100e20 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.203+0000 7f51b77fe640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51b8102ef0 0x7f51b819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.204+0000 7f51b6ffd640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51b8100e20 0x7f51b819a640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f51a800d950 tx=0x7f51a800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.204+0000 7f519ffff640 1 -- 172.21.15.42:0/1069552919 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8017070 con 0x7f51b8100e20 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.204+0000 7f519ffff640 1 -- 172.21.15.42:0/1069552919 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51a8009c30 con 0x7f51b8100e20 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.204+0000 7f519ffff640 1 -- 172.21.15.42:0/1069552919 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a800f6b0 con 0x7f51b8100e20 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.204+0000 7f51bd26a640 1 -- 172.21.15.42:0/1069552919 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b819f8e0 con 0x7f51b8100e20 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.204+0000 7f51bd26a640 1 -- 172.21.15.42:0/1069552919 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b819fd10 con 0x7f51b8100e20 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.206+0000 7f51bd26a640 1 -- 172.21.15.42:0/1069552919 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b8101200 con 0x7f51b8100e20 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.208+0000 7f519ffff640 1 -- 172.21.15.42:0/1069552919 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f51a8010460 con 0x7f51b8100e20 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.209+0000 7f519ffff640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51a00a3350 0x7f51a00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.209+0000 7f519ffff640 1 -- 172.21.15.42:0/1069552919 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f51a80cf790 con 0x7f51b8100e20 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.209+0000 7f51b67fc640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51a00a3350 0x7f51a00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.209+0000 7f51b67fc640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51a00a3350 0x7f51a00a5810 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00b3c0 tx=0x7f51ac00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.213+0000 7f519ffff640 1 -- 172.21.15.42:0/1069552919 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51a809c2d0 con 0x7f51b8100e20 2024-09-19T09:40:19.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.546+0000 7f51bd26a640 1 -- 172.21.15.42:0/1069552919 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51b819b9a0 con 0x7f51b8100e20 2024-09-19T09:40:19.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.547+0000 7f519ffff640 1 -- 172.21.15.42:0/1069552919 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f51a8009de0 con 0x7f51b8100e20 2024-09-19T09:40:19.550 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:40:19.550 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:40:19.550 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:40:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.551+0000 7f51bd26a640 1 -- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51a00a3350 msgr2=0x7f51a00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.551+0000 7f51bd26a640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51a00a3350 0x7f51a00a5810 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00b3c0 tx=0x7f51ac00d040 comp rx=0 tx=0).stop 2024-09-19T09:40:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.551+0000 7f51bd26a640 1 -- 172.21.15.42:0/1069552919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51b8100e20 msgr2=0x7f51b819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.551+0000 7f51bd26a640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51b8100e20 0x7f51b819a640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f51a800d950 tx=0x7f51a800de10 comp rx=0 tx=0).stop 2024-09-19T09:40:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.551+0000 7f51bd26a640 1 -- 172.21.15.42:0/1069552919 shutdown_connections 2024-09-19T09:40:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.551+0000 7f51bd26a640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f51a00a3350 0x7f51a00a5810 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.551+0000 7f51bd26a640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51b8102ef0 0x7f51b819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.551+0000 7f51bd26a640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b8102570 0x7f51b819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.551+0000 7f51bd26a640 1 --2- 172.21.15.42:0/1069552919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51b8100e20 0x7f51b819a640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:19.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.551+0000 7f51bd26a640 1 -- 172.21.15.42:0/1069552919 >> 172.21.15.42:0/1069552919 conn(0x7f51b80fc7d0 msgr2=0x7f51b8106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:19.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.552+0000 7f51bd26a640 1 -- 172.21.15.42:0/1069552919 shutdown_connections 2024-09-19T09:40:19.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:19.552+0000 7f51bd26a640 1 -- 172.21.15.42:0/1069552919 wait complete. 2024-09-19T09:40:20.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:20 smithi042 ceph-mon[31223]: pgmap v367: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:40:20.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:40:20.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:40:20.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:20 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1069552919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:20.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:20.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:40:20.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:40:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:20 smithi171 ceph-mon[35803]: pgmap v367: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:40:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:40:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:40:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:20 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1069552919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:40:20.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:40:20.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:40:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:20 smithi136 ceph-mon[34840]: pgmap v367: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:40:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:40:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:40:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:20 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1069552919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:40:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:40:20.649 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:20.965 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:40:20.965 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:40:20.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:40:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.134+0000 7f3192b35640 1 -- 172.21.15.42:0/246680915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f318c103780 msgr2=0x7f318c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.134+0000 7f3192b35640 1 --2- 172.21.15.42:0/246680915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f318c103780 0x7f318c107bc0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3178009930 tx=0x7f317802a420 comp rx=0 tx=0).stop 2024-09-19T09:40:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.134+0000 7f3192b35640 1 -- 172.21.15.42:0/246680915 shutdown_connections 2024-09-19T09:40:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.134+0000 7f3192b35640 1 --2- 172.21.15.42:0/246680915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318c108300 0x7f318c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.134+0000 7f3192b35640 1 --2- 172.21.15.42:0/246680915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f318c103780 0x7f318c107bc0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.135+0000 7f3192b35640 1 --2- 172.21.15.42:0/246680915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f318c102dd0 0x7f318c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.135+0000 7f3192b35640 1 -- 172.21.15.42:0/246680915 >> 172.21.15.42:0/246680915 conn(0x7f318c0fc7d0 msgr2=0x7f318c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.135+0000 7f3192b35640 1 -- 172.21.15.42:0/246680915 shutdown_connections 2024-09-19T09:40:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.136+0000 7f3192b35640 1 -- 172.21.15.42:0/246680915 wait complete. 2024-09-19T09:40:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.136+0000 7f3192b35640 1 Processor -- start 2024-09-19T09:40:21.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.136+0000 7f3192b35640 1 -- start start 2024-09-19T09:40:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.136+0000 7f3192b35640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318c102dd0 0x7f318c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.136+0000 7f3192b35640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f318c103780 0x7f318c198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.136+0000 7f3192b35640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f318c108300 0x7f318c19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.136+0000 7f3192b35640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f318c112070 con 0x7f318c108300 2024-09-19T09:40:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.136+0000 7f3192b35640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f318c111ef0 con 0x7f318c102dd0 2024-09-19T09:40:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.136+0000 7f3192b35640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f318c1121f0 con 0x7f318c103780 2024-09-19T09:40:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f31910d2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f318c108300 0x7f318c19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f31910d2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f318c108300 0x7f318c19cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34466/0 (socket says 172.21.15.42:34466) 2024-09-19T09:40:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f31910d2640 1 -- 172.21.15.42:0/1507291687 learned_addr learned my addr 172.21.15.42:0/1507291687 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:21.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f31908d1640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318c102dd0 0x7f318c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f318bfff640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f318c103780 0x7f318c198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f31910d2640 1 -- 172.21.15.42:0/1507291687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f318c103780 msgr2=0x7f318c198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f31910d2640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f318c103780 0x7f318c198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f31910d2640 1 -- 172.21.15.42:0/1507291687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318c102dd0 msgr2=0x7f318c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f31910d2640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318c102dd0 0x7f318c198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f31910d2640 1 -- 172.21.15.42:0/1507291687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c19d620 con 0x7f318c108300 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f31910d2640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f318c108300 0x7f318c19cf40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3184009fd0 tx=0x7f318400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f3189ffb640 1 -- 172.21.15.42:0/1507291687 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184017070 con 0x7f318c108300 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f3189ffb640 1 -- 172.21.15.42:0/1507291687 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3184003e50 con 0x7f318c108300 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.137+0000 7f3192b35640 1 -- 172.21.15.42:0/1507291687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318c19d910 con 0x7f318c108300 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.138+0000 7f3189ffb640 1 -- 172.21.15.42:0/1507291687 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31840106c0 con 0x7f318c108300 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.138+0000 7f3192b35640 1 -- 172.21.15.42:0/1507291687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318c1a51f0 con 0x7f318c108300 2024-09-19T09:40:21.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.140+0000 7f3194f0e740 1 Processor -- start 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.140+0000 7f3189ffb640 1 -- 172.21.15.42:0/1507291687 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f3184003970 con 0x7f318c108300 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f3194f0e740 1 -- start start 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132db40 0x55b30132c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132c5d0 0x55b30132ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b301339760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f3194f0e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b3012922f0 con 0x55b30132db40 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f3194f0e740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b301239cf0 con 0x55b301337370 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f3194f0e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b30128e2b0 con 0x55b30132c5d0 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f318bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132db40 0x55b30132c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f318bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132db40 0x55b30132c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34482/0 (socket says 172.21.15.42:34482) 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f318bfff640 1 -- 172.21.15.42:0/3476733719 learned_addr learned my addr 172.21.15.42:0/3476733719 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f31908d1640 1 --2- 172.21.15.42:0/3476733719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132c5d0 0x55b30132ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f318bfff640 1 --2- 172.21.15.42:0/3476733719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b301339760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f318bfff640 1 -- 172.21.15.42:0/3476733719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132c5d0 msgr2=0x55b30132ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f318bfff640 1 --2- 172.21.15.42:0/3476733719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132c5d0 0x55b30132ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f318bfff640 1 -- 172.21.15.42:0/3476733719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 msgr2=0x55b301339760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f318bfff640 1 --2- 172.21.15.42:0/3476733719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b301339760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.141+0000 7f318bfff640 1 -- 172.21.15.42:0/3476733719 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b30121e3a0 con 0x55b30132db40 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.142+0000 7f3189ffb640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f317c0a3350 0x7f317c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.142+0000 7f318bfff640 1 --2- 172.21.15.42:0/3476733719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132db40 0x55b30132c090 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3178006010 tx=0x7f31780058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae66a852f1f8586 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.142+0000 7f3189ffb640 1 -- 172.21.15.42:0/1507291687 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f31840cf6b0 con 0x7f318c108300 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.142+0000 7f31908d1640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f317c0a3350 0x7f317c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.142+0000 7f3176ffd640 1 -- 172.21.15.42:0/3476733719 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178044020 con 0x55b30132db40 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.142+0000 7f3176ffd640 1 -- 172.21.15.42:0/3476733719 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31780317b0 con 0x55b30132db40 2024-09-19T09:40:21.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.142+0000 7f3176ffd640 1 -- 172.21.15.42:0/3476733719 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178035040 con 0x55b30132db40 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.143+0000 7f3194f0e740 1 -- 172.21.15.42:0/3476733719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132db40 msgr2=0x55b30132c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.143+0000 7f31908d1640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f317c0a3350 0x7f317c0a5810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55b301329ac0 tx=0x7f3180005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.143+0000 7f3194f0e740 1 --2- 172.21.15.42:0/3476733719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132db40 0x55b30132c090 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3178006010 tx=0x7f31780058d0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.143+0000 7f3194f0e740 1 -- 172.21.15.42:0/3476733719 shutdown_connections 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.143+0000 7f3194f0e740 1 --2- 172.21.15.42:0/3476733719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b301339760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.143+0000 7f3194f0e740 1 --2- 172.21.15.42:0/3476733719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132c5d0 0x55b30132ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.143+0000 7f3194f0e740 1 --2- 172.21.15.42:0/3476733719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132db40 0x55b30132c090 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.143+0000 7f3194f0e740 1 -- 172.21.15.42:0/3476733719 >> 172.21.15.42:0/3476733719 conn(0x55b3012f5310 msgr2=0x55b301328c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.143+0000 7f3194f0e740 1 -- 172.21.15.42:0/3476733719 shutdown_connections 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.143+0000 7f3194f0e740 1 -- 172.21.15.42:0/3476733719 wait complete. 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.144+0000 7f3194f0e740 1 -- start start 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.144+0000 7f3194f0e740 1 Processor -- start 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.144+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b301336de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b301334090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b3013347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f3194f0e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b30133a010 con 0x55b30132c5d0 2024-09-19T09:40:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f3194f0e740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b30124d060 con 0x55b301337370 2024-09-19T09:40:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f3194f0e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b30133a190 con 0x55b30132db40 2024-09-19T09:40:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31908d1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b301336de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f3194f0e740 10 client.0 _ll_register_callbacks cb 0x55b300fa08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31908d1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b301336de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34488/0 (socket says 172.21.15.42:34488) 2024-09-19T09:40:21.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31908d1640 1 -- 172.21.15.42:0/1807420951 learned_addr learned my addr 172.21.15.42:0/1807420951 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31910d2640 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b3013347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f318bfff640 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b301334090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31910d2640 1 -- 172.21.15.42:0/1807420951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 msgr2=0x55b301334090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31910d2640 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b301334090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31910d2640 1 -- 172.21.15.42:0/1807420951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 msgr2=0x55b301336de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31910d2640 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b301336de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31910d2640 1 -- 172.21.15.42:0/1807420951 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3010033c0 con 0x55b301337370 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31908d1640 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b301336de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f31910d2640 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b3013347d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31840cd040 tx=0x7f318409b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4225065b90f5f365 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.145+0000 7f316bfff640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.146+0000 7f316bfff640 1 -- 172.21.15.42:0/1807420951 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184020070 con 0x55b301337370 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.146+0000 7f3194f0e740 1 -- 172.21.15.42:0/1807420951 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31780317b0 con 0x55b301337370 2024-09-19T09:40:21.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.146+0000 7f316bfff640 1 -- 172.21.15.42:0/1807420951 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3184098270 con 0x55b301337370 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.146+0000 7f316bfff640 1 -- 172.21.15.42:0/1807420951 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f31840b3020 con 0x55b301337370 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.146+0000 7f3194f0e740 10 client.25403 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.146+0000 7f3194f0e740 1 -- 172.21.15.42:0/1807420951 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b301345b40 con 0x55b301337370 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.146+0000 7f316bfff640 1 -- 172.21.15.42:0/1807420951 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31780317b0 con 0x55b301337370 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.147+0000 7f316bfff640 1 -- 172.21.15.42:0/1807420951 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3184097950 con 0x55b301337370 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.147+0000 7f3194f0e740 10 client.25403 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.147+0000 7f3194f0e740 10 client.25403 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.147+0000 7f3194f0e740 20 client.25403 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.147+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b301346f50 0x55b3013493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.147+0000 7f3194f0e740 4 client.25403 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.147+0000 7f3194f0e740 1 -- 172.21.15.42:0/1807420951 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b30129f860 con 0x55b301346f50 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.147+0000 7f31908d1640 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b301346f50 0x55b3013493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.147+0000 7f31908d1640 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b301346f50 0x55b3013493b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c7458bdf30b0e85a server_cookie=b773b3513c37536d in_seq=0 out_seq=0 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.147+0000 7f316bfff640 10 client.25403 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f316bfff640 1 -- 172.21.15.42:0/1807420951 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b30129f860 con 0x55b301346f50 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f316bfff640 10 client.25403 handle_command_reply: tid=0 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f3194f0e740 1 client.25403 shutdown 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f3194f0e740 1 -- 172.21.15.42:0/1807420951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 msgr2=0x55b3013347d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b3013347d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31840cd040 tx=0x7f318409b830 comp rx=0 tx=0).stop 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f3194f0e740 1 -- 172.21.15.42:0/1807420951 shutdown_connections 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b301346f50 0x55b3013493b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b3013347d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b301334090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1807420951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b301336de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f316bfff640 0 client.25403 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:40:21.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.148+0000 7f3194f0e740 1 -- 172.21.15.42:0/1807420951 >> 172.21.15.42:0/1807420951 conn(0x55b3012f5310 msgr2=0x55b30132e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:21.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.149+0000 7f3194f0e740 1 -- 172.21.15.42:0/1807420951 shutdown_connections 2024-09-19T09:40:21.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.149+0000 7f3194f0e740 1 -- 172.21.15.42:0/1807420951 wait complete. 2024-09-19T09:40:21.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.149+0000 7f3194f0e740 20 client.25403 trim_cache size 0 max 16384 2024-09-19T09:40:21.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.170+0000 7f3194f0e740 1 Processor -- start 2024-09-19T09:40:21.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.170+0000 7f3194f0e740 1 -- start start 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b30132c5d0 0x55b3013432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b30132f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b301337370 0x55b30132f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f3194f0e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f318c1ad5b0 con 0x55b301337370 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f31910d2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b301337370 0x55b30132f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f31910d2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b301337370 0x55b30132f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34496/0 (socket says 172.21.15.42:34496) 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f31910d2640 1 -- 172.21.15.42:0/3625657917 learned_addr learned my addr 172.21.15.42:0/3625657917 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f31908d1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b30132c5d0 0x55b3013432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f3194f0e740 1 -- 172.21.15.42:0/3625657917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f318c1af0f0 con 0x55b30132c5d0 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f3194f0e740 1 -- 172.21.15.42:0/3625657917 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f318c1adc80 con 0x55b30132db40 2024-09-19T09:40:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f318bfff640 1 --2- 172.21.15.42:0/3625657917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b30132f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f31910d2640 1 -- 172.21.15.42:0/3625657917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 msgr2=0x55b30132f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f31910d2640 1 --2- 172.21.15.42:0/3625657917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b30132f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f31910d2640 1 -- 172.21.15.42:0/3625657917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b30132c5d0 msgr2=0x55b3013432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f31910d2640 1 --2- 172.21.15.42:0/3625657917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b30132c5d0 0x55b3013432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.171+0000 7f31910d2640 1 -- 172.21.15.42:0/3625657917 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3013437f0 con 0x55b301337370 2024-09-19T09:40:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.172+0000 7f31910d2640 1 --2- 172.21.15.42:0/3625657917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b301337370 0x55b30132f660 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f318400dfd0 tx=0x7f3184097fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58055ec2314682d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.172+0000 7f31767fc640 1 -- 172.21.15.42:0/3625657917 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184020070 con 0x55b301337370 2024-09-19T09:40:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.172+0000 7f31767fc640 1 -- 172.21.15.42:0/3625657917 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31840a47c0 con 0x55b301337370 2024-09-19T09:40:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.172+0000 7f31767fc640 1 -- 172.21.15.42:0/3625657917 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31840b9080 con 0x55b301337370 2024-09-19T09:40:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 -- 172.21.15.42:0/3625657917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b301337370 msgr2=0x55b30132f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 --2- 172.21.15.42:0/3625657917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b301337370 0x55b30132f660 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f318400dfd0 tx=0x7f3184097fd0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 -- 172.21.15.42:0/3625657917 shutdown_connections 2024-09-19T09:40:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 --2- 172.21.15.42:0/3625657917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b301337370 0x55b30132f660 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 --2- 172.21.15.42:0/3625657917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b30132f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 --2- 172.21.15.42:0/3625657917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b30132c5d0 0x55b3013432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 -- 172.21.15.42:0/3625657917 >> 172.21.15.42:0/3625657917 conn(0x55b3012f5310 msgr2=0x55b301333180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 -- 172.21.15.42:0/3625657917 shutdown_connections 2024-09-19T09:40:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 -- 172.21.15.42:0/3625657917 wait complete. 2024-09-19T09:40:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 -- start start 2024-09-19T09:40:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.173+0000 7f3194f0e740 1 Processor -- start 2024-09-19T09:40:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b30133b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b30133b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f3194f0e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b30133bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f3194f0e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f318c1aea20 con 0x55b30132c5d0 2024-09-19T09:40:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f3194f0e740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f318c1ae350 con 0x55b301337370 2024-09-19T09:40:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f31908d1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b30133b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f3194f0e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f318c1ab590 con 0x55b30132db40 2024-09-19T09:40:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f31908d1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b30133b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34502/0 (socket says 172.21.15.42:34502) 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f31908d1640 1 -- 172.21.15.42:0/1833781958 learned_addr learned my addr 172.21.15.42:0/1833781958 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f3194f0e740 10 client.0 _ll_register_callbacks cb 0x7f3184009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f318bfff640 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b30133b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.174+0000 7f31910d2640 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b30133bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f31908d1640 1 -- 172.21.15.42:0/1833781958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 msgr2=0x55b30133b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f31908d1640 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b30133b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f31908d1640 1 -- 172.21.15.42:0/1833781958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 msgr2=0x55b30133bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f31908d1640 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b30133bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f31908d1640 1 -- 172.21.15.42:0/1833781958 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3013b0c50 con 0x55b30132c5d0 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f31908d1640 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b30133b120 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3180012cb0 tx=0x7f31800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4abca3ee22a1dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f316bfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:21.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f316bfff640 1 -- 172.21.15.42:0/1833781958 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180005020 con 0x55b30132c5d0 2024-09-19T09:40:21.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f316bfff640 1 -- 172.21.15.42:0/1833781958 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f31800051c0 con 0x55b30132c5d0 2024-09-19T09:40:21.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f3194f0e740 1 -- 172.21.15.42:0/1833781958 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31840a47c0 con 0x55b30132c5d0 2024-09-19T09:40:21.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f316bfff640 1 -- 172.21.15.42:0/1833781958 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f31800053c0 con 0x55b30132c5d0 2024-09-19T09:40:21.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f3194f0e740 10 client.15891 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:21.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.175+0000 7f3194f0e740 1 -- 172.21.15.42:0/1833781958 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3013b1f10 con 0x55b30132c5d0 2024-09-19T09:40:21.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.176+0000 7f316bfff640 1 -- 172.21.15.42:0/1833781958 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3180005560 con 0x55b30132c5d0 2024-09-19T09:40:21.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.176+0000 7f316bfff640 1 -- 172.21.15.42:0/1833781958 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f318002ba20 con 0x55b30132c5d0 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.176+0000 7f3194f0e740 10 client.15891 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.176+0000 7f3194f0e740 10 client.15891 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.176+0000 7f3194f0e740 20 client.15891 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.176+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b3013b25e0 0x55b3013b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.176+0000 7f3194f0e740 4 client.15891 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.176+0000 7f3194f0e740 1 -- 172.21.15.42:0/1833781958 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f31840a47c0 con 0x55b3013b25e0 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.177+0000 7f318bfff640 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b3013b25e0 0x55b3013b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.177+0000 7f318bfff640 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b3013b25e0 0x55b3013b49d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e43e265dc79cabc8 server_cookie=a4cfb1edec1c02e in_seq=0 out_seq=0 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.177+0000 7f316bfff640 10 client.15891 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.177+0000 7f316bfff640 1 -- 172.21.15.42:0/1833781958 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f31840a47c0 con 0x55b3013b25e0 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.177+0000 7f316bfff640 10 client.15891 handle_command_reply: tid=0 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.177+0000 7f3194f0e740 1 client.15891 shutdown 2024-09-19T09:40:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 1 -- 172.21.15.42:0/1833781958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 msgr2=0x55b30133b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b30133b120 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3180012cb0 tx=0x7f31800046c0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 1 -- 172.21.15.42:0/1833781958 shutdown_connections 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b3013b25e0 0x55b3013b49d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b301337370 0x55b30133bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b30132db40 0x55b30133b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 1 --2- 172.21.15.42:0/1833781958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b30132c5d0 0x55b30133b120 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 1 -- 172.21.15.42:0/1833781958 >> 172.21.15.42:0/1833781958 conn(0x55b3012f5310 msgr2=0x55b3013358f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f316bfff640 0 client.15891 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 1 -- 172.21.15.42:0/1833781958 shutdown_connections 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 1 -- 172.21.15.42:0/1833781958 wait complete. 2024-09-19T09:40:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.178+0000 7f3194f0e740 20 client.15891 trim_cache size 0 max 16384 2024-09-19T09:40:21.187 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:40:21.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 -- 172.21.15.42:0/1507291687 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f317c0a3350 msgr2=0x7f317c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:21.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f317c0a3350 0x7f317c0a5810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55b301329ac0 tx=0x7f3180005f90 comp rx=0 tx=0).stop 2024-09-19T09:40:21.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 -- 172.21.15.42:0/1507291687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f318c108300 msgr2=0x7f318c19cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:21.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f318c108300 0x7f318c19cf40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3184009fd0 tx=0x7f318400b260 comp rx=0 tx=0).stop 2024-09-19T09:40:21.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 -- 172.21.15.42:0/1507291687 shutdown_connections 2024-09-19T09:40:21.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f317c0a3350 0x7f317c0a5810 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f318c108300 0x7f318c19cf40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f318c103780 0x7f318c198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 --2- 172.21.15.42:0/1507291687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f318c102dd0 0x7f318c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:21.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 -- 172.21.15.42:0/1507291687 >> 172.21.15.42:0/1507291687 conn(0x7f318c0fc7d0 msgr2=0x7f318c105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:21.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 -- 172.21.15.42:0/1507291687 shutdown_connections 2024-09-19T09:40:21.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:21.179+0000 7f3192b35640 1 -- 172.21.15.42:0/1507291687 wait complete. 2024-09-19T09:40:22.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:22 smithi042 ceph-mon[31223]: pgmap v368: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:40:22.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:22 smithi171 ceph-mon[35803]: pgmap v368: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:40:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:22 smithi136 ceph-mon[34840]: pgmap v368: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:40:22.457 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:40:22.510 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.047+0000 7f226714a640 1 -- 172.21.15.42:0/4288770739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260100e20 msgr2=0x7f2260101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.047+0000 7f226714a640 1 --2- 172.21.15.42:0/4288770739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260100e20 0x7f2260101200 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2248009900 tx=0x7f224802a480 comp rx=0 tx=0).stop 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.047+0000 7f226714a640 1 -- 172.21.15.42:0/4288770739 shutdown_connections 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.047+0000 7f226714a640 1 --2- 172.21.15.42:0/4288770739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2260102ef0 0x7f226010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.047+0000 7f226714a640 1 --2- 172.21.15.42:0/4288770739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2260102570 0x7f22601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.047+0000 7f226714a640 1 --2- 172.21.15.42:0/4288770739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260100e20 0x7f2260101200 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.047+0000 7f226714a640 1 -- 172.21.15.42:0/4288770739 >> 172.21.15.42:0/4288770739 conn(0x7f22600fc7d0 msgr2=0x7f22600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.047+0000 7f226714a640 1 -- 172.21.15.42:0/4288770739 shutdown_connections 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.047+0000 7f226714a640 1 -- 172.21.15.42:0/4288770739 wait complete. 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f226714a640 1 Processor -- start 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f226714a640 1 -- start start 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f226714a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260100e20 0x7f2260197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f226714a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2260102570 0x7f22601976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f226714a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2260102ef0 0x7f2260197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f226714a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2260110f80 con 0x7f2260100e20 2024-09-19T09:40:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f226714a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2260110e00 con 0x7f2260102570 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f226714a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2260111100 con 0x7f2260102ef0 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f2264ee6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260100e20 0x7f2260197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f2264ee6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260100e20 0x7f2260197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34528/0 (socket says 172.21.15.42:34528) 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f2264ee6640 1 -- 172.21.15.42:0/4285221787 learned_addr learned my addr 172.21.15.42:0/4285221787 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f22656e7640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2260102ef0 0x7f2260197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.048+0000 7f225ffff640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2260102570 0x7f22601976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f2264ee6640 1 -- 172.21.15.42:0/4285221787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2260102ef0 msgr2=0x7f2260197bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f2264ee6640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2260102ef0 0x7f2260197bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f2264ee6640 1 -- 172.21.15.42:0/4285221787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2260102570 msgr2=0x7f22601976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f2264ee6640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2260102570 0x7f22601976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f2264ee6640 1 -- 172.21.15.42:0/4285221787 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22601a69e0 con 0x7f2260100e20 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f225ffff640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2260102570 0x7f22601976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f2264ee6640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260100e20 0x7f2260197170 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2248006010 tx=0x7f2248003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f225dffb640 1 -- 172.21.15.42:0/4285221787 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224803f070 con 0x7f2260100e20 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f225dffb640 1 -- 172.21.15.42:0/4285221787 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2248031c30 con 0x7f2260100e20 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f226714a640 1 -- 172.21.15.42:0/4285221787 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22601a6c70 con 0x7f2260100e20 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f225dffb640 1 -- 172.21.15.42:0/4285221787 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248035030 con 0x7f2260100e20 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.049+0000 7f226714a640 1 -- 172.21.15.42:0/4285221787 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22601a7150 con 0x7f2260100e20 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.051+0000 7f226714a640 1 -- 172.21.15.42:0/4285221787 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2260101200 con 0x7f2260100e20 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.052+0000 7f225dffb640 1 -- 172.21.15.42:0/4285221787 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f2248042070 con 0x7f2260100e20 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.052+0000 7f225dffb640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f224c0a32d0 0x7f224c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.052+0000 7f225dffb640 1 -- 172.21.15.42:0/4285221787 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f22480f0320 con 0x7f2260100e20 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.052+0000 7f225ffff640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f224c0a32d0 0x7f224c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.053+0000 7f225ffff640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f224c0a32d0 0x7f224c0a5790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f22601992d0 tx=0x7f2250009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.057+0000 7f225dffb640 1 -- 172.21.15.42:0/4285221787 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2248031de0 con 0x7f2260100e20 2024-09-19T09:40:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:23.235 INFO:tasks.workunit.client.0.smithi042.stderr:Updating files: 90% (11650/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T09:40:23.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.287+0000 7f226714a640 1 -- 172.21.15.42:0/4285221787 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2260109090 con 0x7f2260100e20 2024-09-19T09:40:23.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.288+0000 7f225dffb640 1 -- 172.21.15.42:0/4285221787 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f22480bcec0 con 0x7f2260100e20 2024-09-19T09:40:23.290 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:40:23.290 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:40:23.291 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:40:23.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 -- 172.21.15.42:0/4285221787 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f224c0a32d0 msgr2=0x7f224c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f224c0a32d0 0x7f224c0a5790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f22601992d0 tx=0x7f2250009520 comp rx=0 tx=0).stop 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 -- 172.21.15.42:0/4285221787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260100e20 msgr2=0x7f2260197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260100e20 0x7f2260197170 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2248006010 tx=0x7f2248003c10 comp rx=0 tx=0).stop 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 -- 172.21.15.42:0/4285221787 shutdown_connections 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f224c0a32d0 0x7f224c0a5790 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2260102ef0 0x7f2260197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2260102570 0x7f22601976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 --2- 172.21.15.42:0/4285221787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260100e20 0x7f2260197170 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 -- 172.21.15.42:0/4285221787 >> 172.21.15.42:0/4285221787 conn(0x7f22600fc7d0 msgr2=0x7f22600fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 -- 172.21.15.42:0/4285221787 shutdown_connections 2024-09-19T09:40:23.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:23.292+0000 7f226714a640 1 -- 172.21.15.42:0/4285221787 wait complete. 2024-09-19T09:40:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:40:23.761 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-19T09:40:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:40:23.761 INFO:tasks.workunit.client.0.smithi042.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr: git switch -c 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:Or undo this operation with: 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr: git switch - 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-19T09:40:23.762 INFO:tasks.workunit.client.0.smithi042.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:40:23.768 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T09:40:23.831 INFO:tasks.workunit.client.0.smithi042.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:40:23.834 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:40:23.834 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:40:24.253 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:40:24.253 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:40:24.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:24 smithi171 ceph-mon[35803]: pgmap v369: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:40:24.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:24 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/4285221787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:24.376 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:24 smithi042 ceph-mon[31223]: pgmap v369: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:40:24.376 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:24 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/4285221787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:24.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:24 smithi136 ceph-mon[34840]: pgmap v369: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:40:24.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:24 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/4285221787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:24.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.463+0000 7f3268cbf640 1 -- 172.21.15.42:0/3592234132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3264100b20 msgr2=0x7f3264100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:24.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.463+0000 7f3268cbf640 1 --2- 172.21.15.42:0/3592234132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3264100b20 0x7f3264100f00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3254009900 tx=0x7f325402a410 comp rx=0 tx=0).stop 2024-09-19T09:40:24.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.463+0000 7f3268cbf640 1 -- 172.21.15.42:0/3592234132 shutdown_connections 2024-09-19T09:40:24.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.463+0000 7f3268cbf640 1 --2- 172.21.15.42:0/3592234132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f326410e500 0x7f3264110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.463+0000 7f3268cbf640 1 --2- 172.21.15.42:0/3592234132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3264101440 0x7f326410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.463+0000 7f3268cbf640 1 --2- 172.21.15.42:0/3592234132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3264100b20 0x7f3264100f00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.463+0000 7f3268cbf640 1 -- 172.21.15.42:0/3592234132 >> 172.21.15.42:0/3592234132 conn(0x7f32640fc7d0 msgr2=0x7f32640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:24.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.464+0000 7f3268cbf640 1 -- 172.21.15.42:0/3592234132 shutdown_connections 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.464+0000 7f3268cbf640 1 -- 172.21.15.42:0/3592234132 wait complete. 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.464+0000 7f3268cbf640 1 Processor -- start 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.464+0000 7f3268cbf640 1 -- start start 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.464+0000 7f3268cbf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3264100b20 0x7f32641a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.464+0000 7f3268cbf640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3264101440 0x7f32641a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3268cbf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f326410e500 0x7f326419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3268cbf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3264114320 con 0x7f326410e500 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3268cbf640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f32641141a0 con 0x7f3264101440 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3268cbf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32641144a0 con 0x7f3264100b20 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3262d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f326410e500 0x7f326419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3262d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f326410e500 0x7f326419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34540/0 (socket says 172.21.15.42:34540) 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3262d9d640 1 -- 172.21.15.42:0/903270846 learned_addr learned my addr 172.21.15.42:0/903270846 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:24.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f326259c640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3264100b20 0x7f32641a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3261d9b640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3264101440 0x7f32641a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3262d9d640 1 -- 172.21.15.42:0/903270846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3264100b20 msgr2=0x7f32641a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3262d9d640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3264100b20 0x7f32641a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3262d9d640 1 -- 172.21.15.42:0/903270846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3264101440 msgr2=0x7f32641a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3262d9d640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3264101440 0x7f32641a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3262d9d640 1 -- 172.21.15.42:0/903270846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326419ad00 con 0x7f326410e500 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3261d9b640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3264101440 0x7f32641a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f3262d9d640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f326410e500 0x7f326419a5d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f325c00b9e0 tx=0x7f325c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.465+0000 7f32537fe640 1 -- 172.21.15.42:0/903270846 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c019070 con 0x7f326410e500 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.466+0000 7f32537fe640 1 -- 172.21.15.42:0/903270846 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f325c014440 con 0x7f326410e500 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.466+0000 7f3268cbf640 1 -- 172.21.15.42:0/903270846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f326419aff0 con 0x7f326410e500 2024-09-19T09:40:24.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.466+0000 7f32537fe640 1 -- 172.21.15.42:0/903270846 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c0125e0 con 0x7f326410e500 2024-09-19T09:40:24.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.466+0000 7f3268cbf640 1 -- 172.21.15.42:0/903270846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32641a72e0 con 0x7f326410e500 2024-09-19T09:40:24.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.468+0000 7f32537fe640 1 -- 172.21.15.42:0/903270846 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f325c01c070 con 0x7f326410e500 2024-09-19T09:40:24.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.468+0000 7f326b098740 1 Processor -- start 2024-09-19T09:40:24.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f326b098740 1 -- start start 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f326b098740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f51090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f326b098740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f51a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f326b098740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f5c370 0x556cc6f5e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f326b098740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556cc6eb72f0 con 0x556cc6f52b40 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f326b098740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556cc6e5ecf0 con 0x556cc6f5c370 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f326b098740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556cc6eb32b0 con 0x556cc6f515d0 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f3261d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f51090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f3261d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f51090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34548/0 (socket says 172.21.15.42:34548) 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f3261d9b640 1 -- 172.21.15.42:0/1850043411 learned_addr learned my addr 172.21.15.42:0/1850043411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f32537fe640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f324c0a32d0 0x7f324c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f326259c640 1 --2- 172.21.15.42:0/1850043411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f51a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f3261d9b640 1 -- 172.21.15.42:0/1850043411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 msgr2=0x556cc6f51a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f32537fe640 1 -- 172.21.15.42:0/903270846 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f325c0cefd0 con 0x7f326410e500 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f3262d9d640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f324c0a32d0 0x7f324c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f3261d9b640 1 --2- 172.21.15.42:0/1850043411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f51a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f3261d9b640 1 -- 172.21.15.42:0/1850043411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f5c370 msgr2=0x556cc6f5e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f3261d9b640 1 --2- 172.21.15.42:0/1850043411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f5c370 0x556cc6f5e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f3261d9b640 1 -- 172.21.15.42:0/1850043411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cc6e433a0 con 0x556cc6f52b40 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.469+0000 7f326259c640 1 --2- 172.21.15.42:0/1850043411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f51a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.470+0000 7f3261d9b640 1 --2- 172.21.15.42:0/1850043411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f51090 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3258005bc0 tx=0x7f3258011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce3961eef9cf9e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.470+0000 7f3250ff9640 1 -- 172.21.15.42:0/1850043411 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325801a400 con 0x556cc6f52b40 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.470+0000 7f3262d9d640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f324c0a32d0 0x7f324c0a5790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f325c00b9b0 tx=0x7f325c004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.470+0000 7f3250ff9640 1 -- 172.21.15.42:0/1850043411 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f325801aa80 con 0x556cc6f52b40 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.470+0000 7f3250ff9640 1 -- 172.21.15.42:0/1850043411 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258012c10 con 0x556cc6f52b40 2024-09-19T09:40:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 -- 172.21.15.42:0/1850043411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 msgr2=0x556cc6f51090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 --2- 172.21.15.42:0/1850043411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f51090 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3258005bc0 tx=0x7f3258011750 comp rx=0 tx=0).stop 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 -- 172.21.15.42:0/1850043411 shutdown_connections 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 --2- 172.21.15.42:0/1850043411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f5c370 0x556cc6f5e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 --2- 172.21.15.42:0/1850043411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f51a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 --2- 172.21.15.42:0/1850043411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f51090 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 -- 172.21.15.42:0/1850043411 >> 172.21.15.42:0/1850043411 conn(0x556cc6f1a310 msgr2=0x556cc6f4dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 -- 172.21.15.42:0/1850043411 shutdown_connections 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 -- 172.21.15.42:0/1850043411 wait complete. 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 -- start start 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.471+0000 7f326b098740 1 Processor -- start 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326b098740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f5bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326b098740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 0x556cc6f590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326b098740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f597e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326b098740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556cc6f5f070 con 0x556cc6f5c370 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326b098740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556cc6e72060 con 0x556cc6f52b40 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326b098740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556cc6f5f1f0 con 0x556cc6f515d0 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326b098740 10 client.0 _ll_register_callbacks cb 0x556cc6bc58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f3261d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f3261d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34564/0 (socket says 172.21.15.42:34564) 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f3261d9b640 1 -- 172.21.15.42:0/1089247031 learned_addr learned my addr 172.21.15.42:0/1089247031 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326259c640 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 0x556cc6f590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326259c640 1 -- 172.21.15.42:0/1089247031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 msgr2=0x556cc6f5bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326259c640 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f5bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326259c640 1 -- 172.21.15.42:0/1089247031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 msgr2=0x556cc6f597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326259c640 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f326259c640 1 -- 172.21.15.42:0/1089247031 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cc6c283c0 con 0x556cc6f52b40 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.472+0000 7f3261d9b640 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.473+0000 7f326259c640 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 0x556cc6f590a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f325402aa00 tx=0x7f3254004510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a2feb155726b3b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.473+0000 7f3249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.473+0000 7f3249ffb640 1 -- 172.21.15.42:0/1089247031 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3254035040 con 0x556cc6f52b40 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.473+0000 7f326b098740 1 -- 172.21.15.42:0/1089247031 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f325801aa80 con 0x556cc6f52b40 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.473+0000 7f3249ffb640 1 -- 172.21.15.42:0/1089247031 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3254005510 con 0x556cc6f52b40 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.473+0000 7f3249ffb640 1 -- 172.21.15.42:0/1089247031 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f32540046c0 con 0x556cc6f52b40 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.473+0000 7f326b098740 10 client.25418 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.473+0000 7f326b098740 1 -- 172.21.15.42:0/1089247031 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556cc6f73370 con 0x556cc6f52b40 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.473+0000 7f3249ffb640 1 -- 172.21.15.42:0/1089247031 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f325801aa80 con 0x556cc6f52b40 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.474+0000 7f3249ffb640 1 -- 172.21.15.42:0/1089247031 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3254003af0 con 0x556cc6f52b40 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.474+0000 7f326b098740 10 client.25418 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.474+0000 7f326b098740 10 client.25418 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.474+0000 7f326b098740 20 client.25418 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.474+0000 7f326b098740 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556cc6f74720 0x556cc6f76b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.474+0000 7f326b098740 4 client.25418 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.474+0000 7f326b098740 1 -- 172.21.15.42:0/1089247031 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cc6ec4860 con 0x556cc6f74720 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.474+0000 7f3261d9b640 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556cc6f74720 0x556cc6f76b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.474+0000 7f3249ffb640 10 client.25418 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.474+0000 7f3261d9b640 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556cc6f74720 0x556cc6f76b50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7489cae4b2a994fb server_cookie=f2602c7c46945c3e in_seq=0 out_seq=0 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f3249ffb640 1 -- 172.21.15.42:0/1089247031 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556cc6ec4860 con 0x556cc6f74720 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f3249ffb640 10 client.25418 handle_command_reply: tid=0 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 client.25418 shutdown 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 -- 172.21.15.42:0/1089247031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 msgr2=0x556cc6f590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 0x556cc6f590a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f325402aa00 tx=0x7f3254004510 comp rx=0 tx=0).stop 2024-09-19T09:40:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 -- 172.21.15.42:0/1089247031 shutdown_connections 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556cc6f74720 0x556cc6f76b50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 0x556cc6f590a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f3249ffb640 0 client.25418 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 --2- 172.21.15.42:0/1089247031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f5bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 -- 172.21.15.42:0/1089247031 >> 172.21.15.42:0/1089247031 conn(0x556cc6f1a310 msgr2=0x556cc6f53960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 -- 172.21.15.42:0/1089247031 shutdown_connections 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.475+0000 7f326b098740 1 -- 172.21.15.42:0/1089247031 wait complete. 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.476+0000 7f326b098740 20 client.25418 trim_cache size 0 max 16384 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.488+0000 7f326b098740 1 Processor -- start 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.488+0000 7f326b098740 1 -- start start 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326b098740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f70ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326b098740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f58960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326b098740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f5c370 0x556cc6f54120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326b098740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f32641ab450 con 0x556cc6f52b40 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326b098740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f32641acf90 con 0x556cc6f5c370 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326b098740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32641abb20 con 0x556cc6f515d0 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f58960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f58960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34578/0 (socket says 172.21.15.42:34578) 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326259c640 1 -- 172.21.15.42:0/17803607 learned_addr learned my addr 172.21.15.42:0/17803607 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f3261d9b640 1 --2- 172.21.15.42:0/17803607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f5c370 0x556cc6f54120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326259c640 1 -- 172.21.15.42:0/17803607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 msgr2=0x556cc6f70ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f3261d9b640 1 --2- 172.21.15.42:0/17803607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f70ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326259c640 1 --2- 172.21.15.42:0/17803607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f70ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326259c640 1 -- 172.21.15.42:0/17803607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f5c370 msgr2=0x556cc6f54120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326259c640 1 --2- 172.21.15.42:0/17803607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f5c370 0x556cc6f54120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326259c640 1 -- 172.21.15.42:0/17803607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cc6f575f0 con 0x556cc6f52b40 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f326259c640 1 --2- 172.21.15.42:0/17803607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f58960 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3254006010 tx=0x7f3254009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e56baff86e88d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f324bfff640 1 -- 172.21.15.42:0/17803607 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3254035070 con 0x556cc6f52b40 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f324bfff640 1 -- 172.21.15.42:0/17803607 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3254031a00 con 0x556cc6f52b40 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.489+0000 7f324bfff640 1 -- 172.21.15.42:0/17803607 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3254004b50 con 0x556cc6f52b40 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.490+0000 7f326b098740 1 -- 172.21.15.42:0/17803607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 msgr2=0x556cc6f58960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.490+0000 7f326b098740 1 --2- 172.21.15.42:0/17803607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f58960 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3254006010 tx=0x7f3254009230 comp rx=0 tx=0).stop 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.490+0000 7f326b098740 1 -- 172.21.15.42:0/17803607 shutdown_connections 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.490+0000 7f326b098740 1 --2- 172.21.15.42:0/17803607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f5c370 0x556cc6f54120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.490+0000 7f326b098740 1 --2- 172.21.15.42:0/17803607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f52b40 0x556cc6f58960 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.490+0000 7f326b098740 1 --2- 172.21.15.42:0/17803607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f70ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.490+0000 7f326b098740 1 -- 172.21.15.42:0/17803607 >> 172.21.15.42:0/17803607 conn(0x556cc6f1a310 msgr2=0x556cc6f58190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.490+0000 7f326b098740 1 -- 172.21.15.42:0/17803607 shutdown_connections 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.490+0000 7f326b098740 1 -- 172.21.15.42:0/17803607 wait complete. 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.490+0000 7f326b098740 1 -- start start 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f326b098740 1 Processor -- start 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f326b098740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f6cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f326b098740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 0x556cc6f6d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f326b098740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f326b098740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f32641ac8c0 con 0x556cc6f5c370 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f326b098740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f32641ac1f0 con 0x556cc6f52b40 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f326b098740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32641a9430 con 0x556cc6f515d0 2024-09-19T09:40:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f326b098740 10 client.0 _ll_register_callbacks cb 0x7f3254009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3261d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3261d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34582/0 (socket says 172.21.15.42:34582) 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3261d9b640 1 -- 172.21.15.42:0/3537797911 learned_addr learned my addr 172.21.15.42:0/3537797911 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f326259c640 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 0x556cc6f6d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3261d9b640 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f6cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3261d9b640 1 -- 172.21.15.42:0/3537797911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 msgr2=0x556cc6f6cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3261d9b640 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f6cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3261d9b640 1 -- 172.21.15.42:0/3537797911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 msgr2=0x556cc6f6d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3261d9b640 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 0x556cc6f6d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3261d9b640 1 -- 172.21.15.42:0/3537797911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cc6f55c30 con 0x556cc6f5c370 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f326259c640 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 0x556cc6f6d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3261d9b640 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f556f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f325800b7f0 tx=0x7f3258011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6109e49a1d1afa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.491+0000 7f3249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f3249ffb640 1 -- 172.21.15.42:0/3537797911 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258004020 con 0x556cc6f5c370 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f3249ffb640 1 -- 172.21.15.42:0/3537797911 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f32580041c0 con 0x556cc6f5c370 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f326b098740 1 -- 172.21.15.42:0/3537797911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3254031a00 con 0x556cc6f5c370 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f3249ffb640 1 -- 172.21.15.42:0/3537797911 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f325803a070 con 0x556cc6f5c370 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f326b098740 10 client.15915 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f326b098740 1 -- 172.21.15.42:0/3537797911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556cc6fdeb50 con 0x556cc6f5c370 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f3249ffb640 1 -- 172.21.15.42:0/3537797911 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3254031a00 con 0x556cc6f5c370 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f3249ffb640 1 -- 172.21.15.42:0/3537797911 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3258003680 con 0x556cc6f5c370 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f326b098740 10 client.15915 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f326b098740 10 client.15915 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f326b098740 20 client.15915 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f326b098740 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556cc6fdef50 0x556cc6fe1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f326b098740 4 client.15915 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.492+0000 7f326b098740 1 -- 172.21.15.42:0/3537797911 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556cc6ebed70 con 0x556cc6fdef50 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326259c640 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556cc6fdef50 0x556cc6fe1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326259c640 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556cc6fdef50 0x556cc6fe1340 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e395e6c3fe6ebc3d server_cookie=d97f0059dbe7979a in_seq=0 out_seq=0 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f3249ffb640 10 client.15915 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f3249ffb640 1 -- 172.21.15.42:0/3537797911 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556cc6ebed70 con 0x556cc6fdef50 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f3249ffb640 10 client.15915 handle_command_reply: tid=0 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326b098740 1 client.15915 shutdown 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326b098740 1 -- 172.21.15.42:0/3537797911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 msgr2=0x556cc6f556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326b098740 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f556f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f325800b7f0 tx=0x7f3258011750 comp rx=0 tx=0).stop 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326b098740 1 -- 172.21.15.42:0/3537797911 shutdown_connections 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326b098740 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x556cc6fdef50 0x556cc6fe1340 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326b098740 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556cc6f5c370 0x556cc6f556f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326b098740 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cc6f52b40 0x556cc6f6d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326b098740 1 --2- 172.21.15.42:0/3537797911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cc6f515d0 0x556cc6f6cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326b098740 1 -- 172.21.15.42:0/3537797911 >> 172.21.15.42:0/3537797911 conn(0x556cc6f1a310 msgr2=0x556cc6f58190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f3249ffb640 0 client.15915 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:40:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.493+0000 7f326b098740 1 -- 172.21.15.42:0/3537797911 shutdown_connections 2024-09-19T09:40:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f326b098740 1 -- 172.21.15.42:0/3537797911 wait complete. 2024-09-19T09:40:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f326b098740 20 client.15915 trim_cache size 0 max 16384 2024-09-19T09:40:24.528 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:40:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 -- 172.21.15.42:0/903270846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f324c0a32d0 msgr2=0x7f324c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f324c0a32d0 0x7f324c0a5790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f325c00b9b0 tx=0x7f325c004b50 comp rx=0 tx=0).stop 2024-09-19T09:40:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 -- 172.21.15.42:0/903270846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f326410e500 msgr2=0x7f326419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f326410e500 0x7f326419a5d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f325c00b9e0 tx=0x7f325c00bea0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 -- 172.21.15.42:0/903270846 shutdown_connections 2024-09-19T09:40:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f324c0a32d0 0x7f324c0a5790 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f326410e500 0x7f326419a5d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3264101440 0x7f32641a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 --2- 172.21.15.42:0/903270846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3264100b20 0x7f32641a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 -- 172.21.15.42:0/903270846 >> 172.21.15.42:0/903270846 conn(0x7f32640fc7d0 msgr2=0x7f32640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 -- 172.21.15.42:0/903270846 shutdown_connections 2024-09-19T09:40:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:24.494+0000 7f3268cbf640 1 -- 172.21.15.42:0/903270846 wait complete. 2024-09-19T09:40:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.345+0000 7f083a942640 1 -- 172.21.15.42:0/4058608849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0834103710 msgr2=0x7f0834109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.345+0000 7f083a942640 1 --2- 172.21.15.42:0/4058608849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0834103710 0x7f0834109fa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f082c009ca0 tx=0x7f082c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.345+0000 7f083a942640 1 -- 172.21.15.42:0/4058608849 shutdown_connections 2024-09-19T09:40:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.345+0000 7f083a942640 1 --2- 172.21.15.42:0/4058608849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0834103710 0x7f0834109fa0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.345+0000 7f083a942640 1 --2- 172.21.15.42:0/4058608849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0834102d50 0x7f08341031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.345+0000 7f083a942640 1 --2- 172.21.15.42:0/4058608849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0834101b60 0x7f0834101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.345+0000 7f083a942640 1 -- 172.21.15.42:0/4058608849 >> 172.21.15.42:0/4058608849 conn(0x7f08340fd2c0 msgr2=0x7f08340ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.345+0000 7f083a942640 1 -- 172.21.15.42:0/4058608849 shutdown_connections 2024-09-19T09:40:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.345+0000 7f083a942640 1 -- 172.21.15.42:0/4058608849 wait complete. 2024-09-19T09:40:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.346+0000 7f083a942640 1 Processor -- start 2024-09-19T09:40:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.346+0000 7f083a942640 1 -- start start 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.346+0000 7f083a942640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0834101b60 0x7f0834197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.346+0000 7f083a942640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0834102d50 0x7f08341982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.346+0000 7f083a942640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0834103710 0x7f083419f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.346+0000 7f083a942640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f083410d7c0 con 0x7f0834102d50 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.346+0000 7f083a942640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f083410d640 con 0x7f0834101b60 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.346+0000 7f083a942640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f083410d940 con 0x7f0834103710 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08337fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0834102d50 0x7f08341982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08337fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0834102d50 0x7f08341982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34606/0 (socket says 172.21.15.42:34606) 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08337fe640 1 -- 172.21.15.42:0/1981210017 learned_addr learned my addr 172.21.15.42:0/1981210017 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f0833fff640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0834101b60 0x7f0834197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f0838edf640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0834103710 0x7f083419f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08337fe640 1 -- 172.21.15.42:0/1981210017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0834103710 msgr2=0x7f083419f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08337fe640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0834103710 0x7f083419f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08337fe640 1 -- 172.21.15.42:0/1981210017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0834101b60 msgr2=0x7f0834197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08337fe640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0834101b60 0x7f0834197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08337fe640 1 -- 172.21.15.42:0/1981210017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083419f9d0 con 0x7f0834102d50 2024-09-19T09:40:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08337fe640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0834102d50 0x7f08341982f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f082800d950 tx=0x7f082800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08317fa640 1 -- 172.21.15.42:0/1981210017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828017070 con 0x7f0834102d50 2024-09-19T09:40:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08317fa640 1 -- 172.21.15.42:0/1981210017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0828009c30 con 0x7f0834102d50 2024-09-19T09:40:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f083a942640 1 -- 172.21.15.42:0/1981210017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083419fcc0 con 0x7f0834102d50 2024-09-19T09:40:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.347+0000 7f08317fa640 1 -- 172.21.15.42:0/1981210017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082800f6b0 con 0x7f0834102d50 2024-09-19T09:40:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.348+0000 7f083a942640 1 -- 172.21.15.42:0/1981210017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08341a01c0 con 0x7f0834102d50 2024-09-19T09:40:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f08317fa640 1 -- 172.21.15.42:0/1981210017 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f08280109d0 con 0x7f0834102d50 2024-09-19T09:40:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f083d6d8740 1 Processor -- start 2024-09-19T09:40:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f083d6d8740 1 -- start start 2024-09-19T09:40:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69d51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69d7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f083d6d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5556d692f2f0 con 0x5556d69d5780 2024-09-19T09:40:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f083d6d8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5556d68d7270 con 0x5556d69d06f0 2024-09-19T09:40:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f083d6d8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5556d692b2b0 con 0x5556d69cfdb0 2024-09-19T09:40:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f08337fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69d7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f08337fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69d7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34614/0 (socket says 172.21.15.42:34614) 2024-09-19T09:40:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.350+0000 7f08337fe640 1 -- 172.21.15.42:0/4271960141 learned_addr learned my addr 172.21.15.42:0/4271960141 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f0833fff640 1 --2- 172.21.15.42:0/4271960141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69d51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f0838edf640 1 --2- 172.21.15.42:0/4271960141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f08337fe640 1 -- 172.21.15.42:0/4271960141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 msgr2=0x5556d69d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f08337fe640 1 --2- 172.21.15.42:0/4271960141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f08317fa640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f081c0a3390 0x7f081c0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f08337fe640 1 -- 172.21.15.42:0/4271960141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 msgr2=0x5556d69d51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f08337fe640 1 --2- 172.21.15.42:0/4271960141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69d51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f08337fe640 1 -- 172.21.15.42:0/4271960141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556d68d6340 con 0x5556d69d5780 2024-09-19T09:40:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f0838edf640 1 --2- 172.21.15.42:0/4271960141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f0838edf640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f081c0a3390 0x7f081c0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f08317fa640 1 -- 172.21.15.42:0/1981210017 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f08280cf660 con 0x7f0834102d50 2024-09-19T09:40:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f08337fe640 1 --2- 172.21.15.42:0/4271960141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69d7c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f08280ccf30 tx=0x7f08280d5f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f915cbd3279df746 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.351+0000 7f081a7fc640 1 -- 172.21.15.42:0/4271960141 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828020030 con 0x5556d69d5780 2024-09-19T09:40:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f081a7fc640 1 -- 172.21.15.42:0/4271960141 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08280801a0 con 0x5556d69d5780 2024-09-19T09:40:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f081a7fc640 1 -- 172.21.15.42:0/4271960141 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828009de0 con 0x5556d69d5780 2024-09-19T09:40:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f083d6d8740 1 -- 172.21.15.42:0/4271960141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 msgr2=0x5556d69d7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f0838edf640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f081c0a3390 0x7f081c0a5850 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f082c005e30 tx=0x7f082c03d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f083d6d8740 1 --2- 172.21.15.42:0/4271960141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69d7c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f08280ccf30 tx=0x7f08280d5f40 comp rx=0 tx=0).stop 2024-09-19T09:40:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f083d6d8740 1 -- 172.21.15.42:0/4271960141 shutdown_connections 2024-09-19T09:40:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f083d6d8740 1 --2- 172.21.15.42:0/4271960141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69d7c40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f083d6d8740 1 --2- 172.21.15.42:0/4271960141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69d51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f083d6d8740 1 --2- 172.21.15.42:0/4271960141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f083d6d8740 1 -- 172.21.15.42:0/4271960141 >> 172.21.15.42:0/4271960141 conn(0x5556d69c7010 msgr2=0x5556d69c7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f083d6d8740 1 -- 172.21.15.42:0/4271960141 shutdown_connections 2024-09-19T09:40:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.352+0000 7f083d6d8740 1 -- 172.21.15.42:0/4271960141 wait complete. 2024-09-19T09:40:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f083d6d8740 1 -- start start 2024-09-19T09:40:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f083d6d8740 1 Processor -- start 2024-09-19T09:40:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69cfdb0 0x5556d69d9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69da460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69d5780 0x5556d69e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f083d6d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5556d69d8690 con 0x5556d69cfdb0 2024-09-19T09:40:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f083d6d8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5556d68b8290 con 0x5556d69d06f0 2024-09-19T09:40:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f083d6d8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5556d69d8810 con 0x5556d69d5780 2024-09-19T09:40:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f083d6d8740 10 client.0 _ll_register_callbacks cb 0x5556d68e9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f0833fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69cfdb0 0x5556d69d9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f0833fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69cfdb0 0x5556d69d9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34624/0 (socket says 172.21.15.42:34624) 2024-09-19T09:40:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.353+0000 7f0833fff640 1 -- 172.21.15.42:0/3650297007 learned_addr learned my addr 172.21.15.42:0/3650297007 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f08337fe640 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f0838edf640 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69d5780 0x5556d69e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f0833fff640 1 -- 172.21.15.42:0/3650297007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69d5780 msgr2=0x5556d69e14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f0833fff640 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69d5780 0x5556d69e14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f0833fff640 1 -- 172.21.15.42:0/3650297007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 msgr2=0x5556d69da460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f0833fff640 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69da460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f0833fff640 1 -- 172.21.15.42:0/3650297007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556d6642210 con 0x5556d69cfdb0 2024-09-19T09:40:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f0833fff640 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69cfdb0 0x5556d69d9f20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f082400bad0 tx=0x7f082400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11e32a926aae950 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f08137fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f08137fe640 1 -- 172.21.15.42:0/3650297007 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824003e00 con 0x5556d69cfdb0 2024-09-19T09:40:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f08137fe640 1 -- 172.21.15.42:0/3650297007 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0824005020 con 0x5556d69cfdb0 2024-09-19T09:40:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f083d6d8740 1 -- 172.21.15.42:0/3650297007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5556d693ca20 con 0x5556d69cfdb0 2024-09-19T09:40:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f08137fe640 1 -- 172.21.15.42:0/3650297007 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0824005220 con 0x5556d69cfdb0 2024-09-19T09:40:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f083d6d8740 10 client.15927 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f083d6d8740 1 -- 172.21.15.42:0/3650297007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5556d670e620 con 0x5556d69cfdb0 2024-09-19T09:40:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.354+0000 7f08137fe640 1 -- 172.21.15.42:0/3650297007 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5556d693ca20 con 0x5556d69cfdb0 2024-09-19T09:40:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.355+0000 7f08137fe640 1 -- 172.21.15.42:0/3650297007 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f082401b630 con 0x5556d69cfdb0 2024-09-19T09:40:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.355+0000 7f083d6d8740 10 client.15927 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.355+0000 7f083d6d8740 10 client.15927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.355+0000 7f083d6d8740 20 client.15927 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.355+0000 7f083d6d8740 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5556d69e5c40 0x5556d69e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.355+0000 7f083d6d8740 4 client.15927 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.355+0000 7f083d6d8740 1 -- 172.21.15.42:0/3650297007 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556d6936d70 con 0x5556d69e5c40 2024-09-19T09:40:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.355+0000 7f08337fe640 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5556d69e5c40 0x5556d69e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.355+0000 7f08137fe640 10 client.15927 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.355+0000 7f08337fe640 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5556d69e5c40 0x5556d69e8090 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90003bb13e9f336a server_cookie=3b0a39cb4c88972f in_seq=0 out_seq=0 2024-09-19T09:40:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.356+0000 7f08137fe640 1 -- 172.21.15.42:0/3650297007 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556d6936d70 con 0x5556d69e5c40 2024-09-19T09:40:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.356+0000 7f08137fe640 10 client.15927 handle_command_reply: tid=0 2024-09-19T09:40:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.356+0000 7f083d6d8740 1 client.15927 shutdown 2024-09-19T09:40:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 1 -- 172.21.15.42:0/3650297007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69cfdb0 msgr2=0x5556d69d9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69cfdb0 0x5556d69d9f20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f082400bad0 tx=0x7f082400bf90 comp rx=0 tx=0).stop 2024-09-19T09:40:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 1 -- 172.21.15.42:0/3650297007 shutdown_connections 2024-09-19T09:40:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5556d69e5c40 0x5556d69e8090 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69d5780 0x5556d69e14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69da460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f08137fe640 0 client.15927 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 1 --2- 172.21.15.42:0/3650297007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69cfdb0 0x5556d69d9f20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 1 -- 172.21.15.42:0/3650297007 >> 172.21.15.42:0/3650297007 conn(0x5556d69c7010 msgr2=0x5556d69c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 1 -- 172.21.15.42:0/3650297007 shutdown_connections 2024-09-19T09:40:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 1 -- 172.21.15.42:0/3650297007 wait complete. 2024-09-19T09:40:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.357+0000 7f083d6d8740 20 client.15927 trim_cache size 0 max 16384 2024-09-19T09:40:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.371+0000 7f083d6d8740 1 Processor -- start 2024-09-19T09:40:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f083d6d8740 1 -- start start 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69e13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f083d6d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f08341a6e30 con 0x5556d69d5780 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f083d6d8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f08341a8970 con 0x5556d69d06f0 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f083d6d8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f08341a7500 con 0x5556d69cfdb0 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f0838edf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f0838edf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34636/0 (socket says 172.21.15.42:34636) 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f0838edf640 1 -- 172.21.15.42:0/347443893 learned_addr learned my addr 172.21.15.42:0/347443893 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f0833fff640 1 --2- 172.21.15.42:0/347443893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f08337fe640 1 --2- 172.21.15.42:0/347443893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69e13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f0838edf640 1 -- 172.21.15.42:0/347443893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 msgr2=0x5556d69c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f0838edf640 1 --2- 172.21.15.42:0/347443893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f0838edf640 1 -- 172.21.15.42:0/347443893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 msgr2=0x5556d69e13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f0838edf640 1 --2- 172.21.15.42:0/347443893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69e13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f0838edf640 1 -- 172.21.15.42:0/347443893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556d69d88d0 con 0x5556d69d5780 2024-09-19T09:40:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.372+0000 7f08337fe640 1 --2- 172.21.15.42:0/347443893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69e13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.373+0000 7f0838edf640 1 --2- 172.21.15.42:0/347443893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69c7930 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f082c031f50 tx=0x7f082c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d638bb30f5c4ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.373+0000 7f0819ffb640 1 -- 172.21.15.42:0/347443893 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c056070 con 0x5556d69d5780 2024-09-19T09:40:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.373+0000 7f0819ffb640 1 -- 172.21.15.42:0/347443893 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f082c036040 con 0x5556d69d5780 2024-09-19T09:40:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.373+0000 7f0819ffb640 1 -- 172.21.15.42:0/347443893 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c046660 con 0x5556d69d5780 2024-09-19T09:40:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.373+0000 7f083d6d8740 1 -- 172.21.15.42:0/347443893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 msgr2=0x5556d69c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.373+0000 7f083d6d8740 1 --2- 172.21.15.42:0/347443893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69c7930 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f082c031f50 tx=0x7f082c041000 comp rx=0 tx=0).stop 2024-09-19T09:40:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.373+0000 7f083d6d8740 1 -- 172.21.15.42:0/347443893 shutdown_connections 2024-09-19T09:40:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.373+0000 7f083d6d8740 1 --2- 172.21.15.42:0/347443893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69c7930 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.373+0000 7f083d6d8740 1 --2- 172.21.15.42:0/347443893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69e13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 --2- 172.21.15.42:0/347443893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 -- 172.21.15.42:0/347443893 >> 172.21.15.42:0/347443893 conn(0x5556d69c7010 msgr2=0x5556d69d9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 -- 172.21.15.42:0/347443893 shutdown_connections 2024-09-19T09:40:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 -- 172.21.15.42:0/347443893 wait complete. 2024-09-19T09:40:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 -- start start 2024-09-19T09:40:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 Processor -- start 2024-09-19T09:40:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69de6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69debe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f08341a82a0 con 0x5556d69d5780 2024-09-19T09:40:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f08341a7bd0 con 0x5556d69d06f0 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f08341a4e10 con 0x5556d69cfdb0 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f083d6d8740 10 client.0 _ll_register_callbacks cb 0x7f0824004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f0838edf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f0838edf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69dfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34644/0 (socket says 172.21.15.42:34644) 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.374+0000 7f0838edf640 1 -- 172.21.15.42:0/2060202039 learned_addr learned my addr 172.21.15.42:0/2060202039 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f0833fff640 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69de6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f08337fe640 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69debe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f0838edf640 1 -- 172.21.15.42:0/2060202039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 msgr2=0x5556d69de6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f0838edf640 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69de6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f0838edf640 1 -- 172.21.15.42:0/2060202039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 msgr2=0x5556d69debe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f0838edf640 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69debe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f0838edf640 1 -- 172.21.15.42:0/2060202039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556d69e0190 con 0x5556d69d5780 2024-09-19T09:40:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f0833fff640 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69de6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f0838edf640 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69dfb80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f082c054040 tx=0x7f082c030870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6273e9d5c62b858 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f08137fe640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f08137fe640 1 -- 172.21.15.42:0/2060202039 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c061060 con 0x5556d69d5780 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f08137fe640 1 -- 172.21.15.42:0/2060202039 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f082c03b810 con 0x5556d69d5780 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f083d6d8740 1 -- 172.21.15.42:0/2060202039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f082c036040 con 0x5556d69d5780 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f08137fe640 1 -- 172.21.15.42:0/2060202039 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f082c056070 con 0x5556d69d5780 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f083d6d8740 10 client.15933 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.375+0000 7f083d6d8740 1 -- 172.21.15.42:0/2060202039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5556d69e14a0 con 0x5556d69d5780 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f08137fe640 1 -- 172.21.15.42:0/2060202039 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f082c036040 con 0x5556d69d5780 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f08137fe640 1 -- 172.21.15.42:0/2060202039 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f082c050070 con 0x5556d69d5780 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f083d6d8740 10 client.15933 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f083d6d8740 10 client.15933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f083d6d8740 20 client.15933 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f083d6d8740 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5556d6a50ea0 0x5556d6a532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f083d6d8740 4 client.15933 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:40:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f083d6d8740 1 -- 172.21.15.42:0/2060202039 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5556d68b3900 con 0x5556d6a50ea0 2024-09-19T09:40:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f0833fff640 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5556d6a50ea0 0x5556d6a532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f0833fff640 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5556d6a50ea0 0x5556d6a532c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6486a887772bbd07 server_cookie=184c480a0eea4b77 in_seq=0 out_seq=0 2024-09-19T09:40:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.376+0000 7f08137fe640 10 client.15933 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f08137fe640 1 -- 172.21.15.42:0/2060202039 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5556d68b3900 con 0x5556d6a50ea0 2024-09-19T09:40:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f08137fe640 10 client.15933 handle_command_reply: tid=0 2024-09-19T09:40:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 client.15933 shutdown 2024-09-19T09:40:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 -- 172.21.15.42:0/2060202039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 msgr2=0x5556d69dfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69dfb80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f082c054040 tx=0x7f082c030870 comp rx=0 tx=0).stop 2024-09-19T09:40:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 -- 172.21.15.42:0/2060202039 shutdown_connections 2024-09-19T09:40:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5556d6a50ea0 0x5556d6a532c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556d69d5780 0x5556d69dfb80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5556d69d06f0 0x5556d69debe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f08137fe640 0 client.15933 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 --2- 172.21.15.42:0/2060202039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556d69cfdb0 0x5556d69de6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 -- 172.21.15.42:0/2060202039 >> 172.21.15.42:0/2060202039 conn(0x5556d69c7010 msgr2=0x5556d69c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 -- 172.21.15.42:0/2060202039 shutdown_connections 2024-09-19T09:40:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 1 -- 172.21.15.42:0/2060202039 wait complete. 2024-09-19T09:40:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.380+0000 7f083d6d8740 20 client.15933 trim_cache size 0 max 16384 2024-09-19T09:40:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:40:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:40:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:40:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:40:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 -- 172.21.15.42:0/1981210017 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f081c0a3390 msgr2=0x7f081c0a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f081c0a3390 0x7f081c0a5850 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f082c005e30 tx=0x7f082c03d040 comp rx=0 tx=0).stop 2024-09-19T09:40:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 -- 172.21.15.42:0/1981210017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0834102d50 msgr2=0x7f08341982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0834102d50 0x7f08341982f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f082800d950 tx=0x7f082800de10 comp rx=0 tx=0).stop 2024-09-19T09:40:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 -- 172.21.15.42:0/1981210017 shutdown_connections 2024-09-19T09:40:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f081c0a3390 0x7f081c0a5850 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0834103710 0x7f083419f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0834102d50 0x7f08341982f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 --2- 172.21.15.42:0/1981210017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0834101b60 0x7f0834197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 -- 172.21.15.42:0/1981210017 >> 172.21.15.42:0/1981210017 conn(0x7f08340fd2c0 msgr2=0x7f08341060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 -- 172.21.15.42:0/1981210017 shutdown_connections 2024-09-19T09:40:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:25.381+0000 7f083a942640 1 -- 172.21.15.42:0/1981210017 wait complete. 2024-09-19T09:40:25.588 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:40:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:25.963 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:40:26.079 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:40:26.121 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:40:26.123 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:40:26.123 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:40:26.165 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:40:26.168 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:40:26.168 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T09:40:26.185 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-19T09:40:26.186 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-19T09:40:26.187 DEBUG:teuthology.orchestra.run.smithi042:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 -- 172.21.15.42:0/1961502828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f540c1082a0 msgr2=0x7f540c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 --2- 172.21.15.42:0/1961502828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f540c1082a0 0x7f540c10ec40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5404009930 tx=0x7f540402a420 comp rx=0 tx=0).stop 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 -- 172.21.15.42:0/1961502828 shutdown_connections 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 --2- 172.21.15.42:0/1961502828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f540c1082a0 0x7f540c10ec40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 --2- 172.21.15.42:0/1961502828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c1036e0 0x7f540c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 --2- 172.21.15.42:0/1961502828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f540c102d30 0x7f540c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 -- 172.21.15.42:0/1961502828 >> 172.21.15.42:0/1961502828 conn(0x7f540c0fc7d0 msgr2=0x7f540c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 -- 172.21.15.42:0/1961502828 shutdown_connections 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 -- 172.21.15.42:0/1961502828 wait complete. 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 Processor -- start 2024-09-19T09:40:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.216+0000 7f5412b1a640 1 -- start start 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f5412b1a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c102d30 0x7f540c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f5412b1a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f540c1036e0 0x7f540c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f5412b1a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f540c1082a0 0x7f540c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f5412b1a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1120a0 con 0x7f540c1082a0 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f5412b1a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f540c111f20 con 0x7f540c1036e0 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f5412b1a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f540c112220 con 0x7f540c102d30 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54110b7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f540c1082a0 0x7f540c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54110b7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f540c1082a0 0x7f540c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34658/0 (socket says 172.21.15.42:34658) 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54110b7640 1 -- 172.21.15.42:0/1153114851 learned_addr learned my addr 172.21.15.42:0/1153114851 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f540bfff640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f540c1036e0 0x7f540c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54108b6640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c102d30 0x7f540c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54110b7640 1 -- 172.21.15.42:0/1153114851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c102d30 msgr2=0x7f540c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54110b7640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c102d30 0x7f540c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54110b7640 1 -- 172.21.15.42:0/1153114851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f540c1036e0 msgr2=0x7f540c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54110b7640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f540c1036e0 0x7f540c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54110b7640 1 -- 172.21.15.42:0/1153114851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540c1a6a00 con 0x7f540c1082a0 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54108b6640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c102d30 0x7f540c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f54110b7640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f540c1082a0 0x7f540c101410 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5404005ab0 tx=0x7f54040040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f5409ffb640 1 -- 172.21.15.42:0/1153114851 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540403f030 con 0x7f540c1082a0 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f5409ffb640 1 -- 172.21.15.42:0/1153114851 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54040044c0 con 0x7f540c1082a0 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f5412b1a640 1 -- 172.21.15.42:0/1153114851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540c1a6c90 con 0x7f540c1082a0 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.217+0000 7f5409ffb640 1 -- 172.21.15.42:0/1153114851 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404035070 con 0x7f540c1082a0 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.218+0000 7f5412b1a640 1 -- 172.21.15.42:0/1153114851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f540c1a7170 con 0x7f540c1082a0 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5409ffb640 1 -- 172.21.15.42:0/1153114851 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f5404042030 con 0x7f540c1082a0 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5414ef3740 1 Processor -- start 2024-09-19T09:40:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5414ef3740 1 -- start start 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf437850 0x559acf437c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf438170 0x559acf4424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf444e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5414ef3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559acf39c160 con 0x559acf442a30 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5414ef3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559acf343720 con 0x559acf437850 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5414ef3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x559acf398120 con 0x559acf438170 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f540bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf444e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f540bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf444e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34670/0 (socket says 172.21.15.42:34670) 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f540bfff640 1 -- 172.21.15.42:0/3405273461 learned_addr learned my addr 172.21.15.42:0/3405273461 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5409ffb640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f53f80a32d0 0x7f53f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f540bfff640 1 --2- 172.21.15.42:0/3405273461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf437850 0x559acf437c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f54108b6640 1 --2- 172.21.15.42:0/3405273461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf438170 0x559acf4424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f54110b7640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f53f80a32d0 0x7f53f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f540bfff640 1 -- 172.21.15.42:0/3405273461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf438170 msgr2=0x559acf4424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f540bfff640 1 --2- 172.21.15.42:0/3405273461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf438170 0x559acf4424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f540bfff640 1 -- 172.21.15.42:0/3405273461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf437850 msgr2=0x559acf437c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f540bfff640 1 --2- 172.21.15.42:0/3405273461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf437850 0x559acf437c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f540bfff640 1 -- 172.21.15.42:0/3405273461 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559acf10dba0 con 0x559acf442a30 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5409ffb640 1 -- 172.21.15.42:0/1153114851 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f54040efbb0 con 0x7f540c1082a0 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f540bfff640 1 --2- 172.21.15.42:0/3405273461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf444e20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f53f400b6c0 tx=0x7f53f400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535125c41bc992b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5402ffd640 1 -- 172.21.15.42:0/3405273461 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4012c40 con 0x559acf442a30 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5402ffd640 1 -- 172.21.15.42:0/3405273461 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f4012de0 con 0x559acf442a30 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.221+0000 7f5402ffd640 1 -- 172.21.15.42:0/3405273461 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4004a00 con 0x559acf442a30 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f5414ef3740 1 -- 172.21.15.42:0/3405273461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 msgr2=0x559acf444e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f5414ef3740 1 --2- 172.21.15.42:0/3405273461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf444e20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f53f400b6c0 tx=0x7f53f400b650 comp rx=0 tx=0).stop 2024-09-19T09:40:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f54110b7640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f53f80a32d0 0x7f53f80a5790 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f54040bbcf0 tx=0x7f54040dc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f5414ef3740 1 -- 172.21.15.42:0/3405273461 shutdown_connections 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f5414ef3740 1 --2- 172.21.15.42:0/3405273461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf444e20 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f5414ef3740 1 --2- 172.21.15.42:0/3405273461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf438170 0x559acf4424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f5414ef3740 1 --2- 172.21.15.42:0/3405273461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf437850 0x559acf437c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f5414ef3740 1 -- 172.21.15.42:0/3405273461 >> 172.21.15.42:0/3405273461 conn(0x559acf433de0 msgr2=0x559acf4341c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f5414ef3740 1 -- 172.21.15.42:0/3405273461 shutdown_connections 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f5414ef3740 1 -- 172.21.15.42:0/3405273461 wait complete. 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.222+0000 7f5414ef3740 1 -- start start 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f5414ef3740 1 Processor -- start 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf437850 0x559acf43f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf438170 0x559acf43fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 0x559acf4403e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f5414ef3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559acf445600 con 0x559acf438170 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f5414ef3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559acf324900 con 0x559acf437850 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f5414ef3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x559acf445780 con 0x559acf442a30 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f5414ef3740 10 client.0 _ll_register_callbacks cb 0x559acf322780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f54108b6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf438170 0x559acf43fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f54108b6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf438170 0x559acf43fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34678/0 (socket says 172.21.15.42:34678) 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f54108b6640 1 -- 172.21.15.42:0/2897905429 learned_addr learned my addr 172.21.15.42:0/2897905429 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f540bfff640 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 0x559acf4403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f540bfff640 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf437850 0x559acf43f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f54108b6640 1 -- 172.21.15.42:0/2897905429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 msgr2=0x559acf4403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f54108b6640 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 0x559acf4403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f54108b6640 1 -- 172.21.15.42:0/2897905429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf437850 msgr2=0x559acf43f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f54108b6640 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf437850 0x559acf43f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f54108b6640 1 -- 172.21.15.42:0/2897905429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559acf364c50 con 0x559acf438170 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.223+0000 7f540bfff640 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 0x559acf4403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f54108b6640 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf438170 0x559acf43fea0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009be0 tx=0x7f53fc004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ec851ce67eaa67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f53ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f53ebfff640 1 -- 172.21.15.42:0/2897905429 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc012860 con 0x559acf438170 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f5414ef3740 1 -- 172.21.15.42:0/2897905429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f4012de0 con 0x559acf438170 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f53ebfff640 1 -- 172.21.15.42:0/2897905429 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f53fc012a00 con 0x559acf438170 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f53ebfff640 1 -- 172.21.15.42:0/2897905429 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53fc012c00 con 0x559acf438170 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f5414ef3740 10 client.15945 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f5414ef3740 1 -- 172.21.15.42:0/2897905429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559acf451390 con 0x559acf438170 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f53ebfff640 1 -- 172.21.15.42:0/2897905429 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f4012de0 con 0x559acf438170 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f53ebfff640 1 -- 172.21.15.42:0/2897905429 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53fc026420 con 0x559acf438170 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f5414ef3740 10 client.15945 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f5414ef3740 10 client.15945 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f5414ef3740 20 client.15945 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f5414ef3740 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559acf452850 0x559acf454ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.224+0000 7f5414ef3740 4 client.15945 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.225+0000 7f5414ef3740 1 -- 172.21.15.42:0/2897905429 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559acf3a9890 con 0x559acf452850 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.225+0000 7f540bfff640 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559acf452850 0x559acf454ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.225+0000 7f53ebfff640 10 client.15945 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.225+0000 7f540bfff640 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559acf452850 0x559acf454ca0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64a877ae4df251ca server_cookie=1aedb2cc6b34b1e3 in_seq=0 out_seq=0 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f53ebfff640 1 -- 172.21.15.42:0/2897905429 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559acf3a9890 con 0x559acf452850 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f53ebfff640 10 client.15945 handle_command_reply: tid=0 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 client.15945 shutdown 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 -- 172.21.15.42:0/2897905429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf438170 msgr2=0x559acf43fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf438170 0x559acf43fea0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009be0 tx=0x7f53fc004410 comp rx=0 tx=0).stop 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 -- 172.21.15.42:0/2897905429 shutdown_connections 2024-09-19T09:40:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559acf452850 0x559acf454ca0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 0x559acf4403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf438170 0x559acf43fea0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 --2- 172.21.15.42:0/2897905429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf437850 0x559acf43f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f53ebfff640 0 client.15945 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 -- 172.21.15.42:0/2897905429 >> 172.21.15.42:0/2897905429 conn(0x559acf433de0 msgr2=0x559acf439ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 -- 172.21.15.42:0/2897905429 shutdown_connections 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 1 -- 172.21.15.42:0/2897905429 wait complete. 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.226+0000 7f5414ef3740 20 client.15945 trim_cache size 0 max 16384 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f5414ef3740 1 Processor -- start 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f5414ef3740 1 -- start start 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf437850 0x559acf45a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 0x559acf45aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf43cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f5414ef3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1af820 con 0x559acf442a30 2024-09-19T09:40:26.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f5414ef3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1b1360 con 0x559acf438170 2024-09-19T09:40:26.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f5414ef3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1afef0 con 0x559acf437850 2024-09-19T09:40:26.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f540bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf43cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f540bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf43cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34686/0 (socket says 172.21.15.42:34686) 2024-09-19T09:40:26.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f540bfff640 1 -- 172.21.15.42:0/1059683693 learned_addr learned my addr 172.21.15.42:0/1059683693 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f54108b6640 1 --2- 172.21.15.42:0/1059683693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 0x559acf45aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f540bfff640 1 --2- 172.21.15.42:0/1059683693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf437850 0x559acf45a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f540bfff640 1 -- 172.21.15.42:0/1059683693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf437850 msgr2=0x559acf45a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f540bfff640 1 --2- 172.21.15.42:0/1059683693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf437850 0x559acf45a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f540bfff640 1 -- 172.21.15.42:0/1059683693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 msgr2=0x559acf45aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f540bfff640 1 --2- 172.21.15.42:0/1059683693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 0x559acf45aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f540bfff640 1 -- 172.21.15.42:0/1059683693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559acf43e910 con 0x559acf442a30 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f54108b6640 1 --2- 172.21.15.42:0/1059683693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 0x559acf45aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f540bfff640 1 --2- 172.21.15.42:0/1059683693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf43cbc0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f53f400b6c0 tx=0x7f53f4005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb70d040e931cd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f54027fc640 1 -- 172.21.15.42:0/1059683693 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4004220 con 0x559acf442a30 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f54027fc640 1 -- 172.21.15.42:0/1059683693 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f4016070 con 0x559acf442a30 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.245+0000 7f54027fc640 1 -- 172.21.15.42:0/1059683693 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f40038e0 con 0x559acf442a30 2024-09-19T09:40:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.246+0000 7f5414ef3740 1 -- 172.21.15.42:0/1059683693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 msgr2=0x559acf43cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.246+0000 7f5414ef3740 1 --2- 172.21.15.42:0/1059683693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf43cbc0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f53f400b6c0 tx=0x7f53f4005620 comp rx=0 tx=0).stop 2024-09-19T09:40:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.246+0000 7f5414ef3740 1 -- 172.21.15.42:0/1059683693 shutdown_connections 2024-09-19T09:40:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.246+0000 7f5414ef3740 1 --2- 172.21.15.42:0/1059683693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf442a30 0x559acf43cbc0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.246+0000 7f5414ef3740 1 --2- 172.21.15.42:0/1059683693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 0x559acf45aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.246+0000 7f5414ef3740 1 --2- 172.21.15.42:0/1059683693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf437850 0x559acf45a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.246+0000 7f5414ef3740 1 -- 172.21.15.42:0/1059683693 >> 172.21.15.42:0/1059683693 conn(0x559acf433de0 msgr2=0x559acf4419e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.246+0000 7f5414ef3740 1 -- 172.21.15.42:0/1059683693 shutdown_connections 2024-09-19T09:40:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.246+0000 7f5414ef3740 1 -- 172.21.15.42:0/1059683693 wait complete. 2024-09-19T09:40:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f5414ef3740 1 -- start start 2024-09-19T09:40:26.261 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir -p fsstress 2024-09-19T09:40:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f5414ef3740 1 Processor -- start 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf437850 0x559acf446fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 0x559acf447510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f5414ef3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 0x559acf4b6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f5414ef3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1b0c90 con 0x559acf437850 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f5414ef3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1b05c0 con 0x559acf438170 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f5414ef3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1ad800 con 0x559acf442a30 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f5414ef3740 10 client.0 _ll_register_callbacks cb 0x7f53fc003a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f540bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf437850 0x559acf446fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f540bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf437850 0x559acf446fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34696/0 (socket says 172.21.15.42:34696) 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f540bfff640 1 -- 172.21.15.42:0/4265974253 learned_addr learned my addr 172.21.15.42:0/4265974253 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.247+0000 7f54108b6640 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 0x559acf447510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f540bfff640 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 0x559acf4b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f54108b6640 1 -- 172.21.15.42:0/4265974253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 msgr2=0x559acf4b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f54108b6640 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 0x559acf4b6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f54108b6640 1 -- 172.21.15.42:0/4265974253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf437850 msgr2=0x559acf446fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f54108b6640 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf437850 0x559acf446fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f54108b6640 1 -- 172.21.15.42:0/4265974253 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559acf4b6b50 con 0x559acf438170 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f540bfff640 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf437850 0x559acf446fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f54108b6640 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 0x559acf447510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x559acf440f10 tx=0x7f53fc009320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be2426477614edd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f53ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f53ebfff640 1 -- 172.21.15.42:0/4265974253 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc02b040 con 0x559acf438170 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f5414ef3740 1 -- 172.21.15.42:0/4265974253 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f4016070 con 0x559acf438170 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f53ebfff640 1 -- 172.21.15.42:0/4265974253 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f53fc005b50 con 0x559acf438170 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f53ebfff640 1 -- 172.21.15.42:0/4265974253 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53fc026e40 con 0x559acf438170 2024-09-19T09:40:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.248+0000 7f5414ef3740 10 client.25457 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:26.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.249+0000 7f5414ef3740 1 -- 172.21.15.42:0/4265974253 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559acf4bdea0 con 0x559acf438170 2024-09-19T09:40:26.266 INFO:tasks.workunit.client.0.smithi042.stderr:+ pushd fsstress 2024-09-19T09:40:26.266 INFO:tasks.workunit.client.0.smithi042.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:40:26.266 INFO:tasks.workunit.client.0.smithi042.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-19T09:40:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.249+0000 7f53ebfff640 1 -- 172.21.15.42:0/4265974253 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f4016070 con 0x559acf438170 2024-09-19T09:40:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.249+0000 7f53ebfff640 1 -- 172.21.15.42:0/4265974253 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53fc01b920 con 0x559acf438170 2024-09-19T09:40:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.249+0000 7f5414ef3740 10 client.25457 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.249+0000 7f5414ef3740 10 client.25457 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:40:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.249+0000 7f5414ef3740 20 client.25457 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.249+0000 7f5414ef3740 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559acf4be590 0x559acf4c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.249+0000 7f5414ef3740 4 client.25457 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:40:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.249+0000 7f5414ef3740 1 -- 172.21.15.42:0/4265974253 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x559acf42f410 con 0x559acf4be590 2024-09-19T09:40:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.249+0000 7f540bfff640 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559acf4be590 0x559acf4c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.250+0000 7f540bfff640 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559acf4be590 0x559acf4c09b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16c3abf6b58f7367 server_cookie=5f01e2aced8b750f in_seq=0 out_seq=0 2024-09-19T09:40:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.250+0000 7f53ebfff640 10 client.25457 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:26.298 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:26.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:26 smithi171 ceph-mon[35803]: pgmap v370: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T09:40:26.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:26 smithi136 ceph-mon[34840]: pgmap v370: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T09:40:26.419 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:26 smithi042 ceph-mon[31223]: pgmap v370: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f53ebfff640 1 -- 172.21.15.42:0/4265974253 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559acf42f410 con 0x559acf4be590 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f53ebfff640 10 client.25457 handle_command_reply: tid=0 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 client.25457 shutdown 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 -- 172.21.15.42:0/4265974253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 msgr2=0x559acf447510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 0x559acf447510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x559acf440f10 tx=0x7f53fc009320 comp rx=0 tx=0).stop 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 -- 172.21.15.42:0/4265974253 shutdown_connections 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559acf4be590 0x559acf4c09b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559acf442a30 0x559acf4b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559acf438170 0x559acf447510 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f53ebfff640 0 client.25457 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 --2- 172.21.15.42:0/4265974253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559acf437850 0x559acf446fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 -- 172.21.15.42:0/4265974253 >> 172.21.15.42:0/4265974253 conn(0x559acf433de0 msgr2=0x559acf43f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:26.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 -- 172.21.15.42:0/4265974253 shutdown_connections 2024-09-19T09:40:26.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 1 -- 172.21.15.42:0/4265974253 wait complete. 2024-09-19T09:40:26.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5414ef3740 20 client.25457 trim_cache size 0 max 16384 2024-09-19T09:40:26.439 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:40:26.439 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 28, 2024-09-19T09:40:26.439 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 24506, 2024-09-19T09:40:26.439 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 6, 2024-09-19T09:40:26.439 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "9edb0b2e": { 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 6, 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 140.3, 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-09-19T09:40:26.440 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:40:26.441 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-09-19T09:40:26.441 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:40:26.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:26.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:26.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:26.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:26.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:26.441 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 -- 172.21.15.42:0/1153114851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f53f80a32d0 msgr2=0x7f53f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f53f80a32d0 0x7f53f80a5790 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f54040bbcf0 tx=0x7f54040dc040 comp rx=0 tx=0).stop 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 -- 172.21.15.42:0/1153114851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f540c1082a0 msgr2=0x7f540c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f540c1082a0 0x7f540c101410 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5404005ab0 tx=0x7f54040040c0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 -- 172.21.15.42:0/1153114851 shutdown_connections 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f53f80a32d0 0x7f53f80a5790 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f540c1082a0 0x7f540c101410 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f540c1036e0 0x7f540c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 --2- 172.21.15.42:0/1153114851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c102d30 0x7f540c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 -- 172.21.15.42:0/1153114851 >> 172.21.15.42:0/1153114851 conn(0x7f540c0fc7d0 msgr2=0x7f540c105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 -- 172.21.15.42:0/1153114851 shutdown_connections 2024-09-19T09:40:26.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:26.436+0000 7f5412b1a640 1 -- 172.21.15.42:0/1153114851 wait complete. 2024-09-19T09:40:27.304 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9edb0b2e', quiesce took 6.3 seconds. Will release after: 14.05 2024-09-19T09:40:27.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.562+0000 7ff010f22640 1 -- 172.21.15.42:0/3706886765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00c106a80 msgr2=0x7ff00c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:27.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.562+0000 7ff010f22640 1 --2- 172.21.15.42:0/3706886765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00c106a80 0x7ff00c106e60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7feffc009930 tx=0x7feffc02a420 comp rx=0 tx=0).stop 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.562+0000 7ff010f22640 1 -- 172.21.15.42:0/3706886765 shutdown_connections 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.562+0000 7ff010f22640 1 --2- 172.21.15.42:0/3706886765 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff00c101420 0x7ff00c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.562+0000 7ff010f22640 1 --2- 172.21.15.42:0/3706886765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c100a80 0x7ff00c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.562+0000 7ff010f22640 1 --2- 172.21.15.42:0/3706886765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00c106a80 0x7ff00c106e60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.562+0000 7ff010f22640 1 -- 172.21.15.42:0/3706886765 >> 172.21.15.42:0/3706886765 conn(0x7ff00c0fc7a0 msgr2=0x7ff00c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.562+0000 7ff010f22640 1 -- 172.21.15.42:0/3706886765 shutdown_connections 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.562+0000 7ff010f22640 1 -- 172.21.15.42:0/3706886765 wait complete. 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.563+0000 7ff010f22640 1 Processor -- start 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.563+0000 7ff010f22640 1 -- start start 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff010f22640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c100a80 0x7ff00c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff010f22640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff00c101420 0x7ff00c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff010f22640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00c106a80 0x7ff00c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff010f22640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c110e40 con 0x7ff00c106a80 2024-09-19T09:40:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff010f22640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c110cc0 con 0x7ff00c100a80 2024-09-19T09:40:27.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff010f22640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c110fc0 con 0x7ff00c101420 2024-09-19T09:40:27.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff00ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00c106a80 0x7ff00c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff00ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00c106a80 0x7ff00c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34712/0 (socket says 172.21.15.42:34712) 2024-09-19T09:40:27.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff00a59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c100a80 0x7ff00c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff00ad9d640 1 -- 172.21.15.42:0/303897834 learned_addr learned my addr 172.21.15.42:0/303897834 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:27.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff009d9b640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff00c101420 0x7ff00c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff00ad9d640 1 -- 172.21.15.42:0/303897834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff00c101420 msgr2=0x7ff00c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:27.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff00ad9d640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff00c101420 0x7ff00c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff00ad9d640 1 -- 172.21.15.42:0/303897834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c100a80 msgr2=0x7ff00c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:27.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff00ad9d640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c100a80 0x7ff00c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff00ad9d640 1 -- 172.21.15.42:0/303897834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00c19d430 con 0x7ff00c106a80 2024-09-19T09:40:27.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.564+0000 7ff00ad9d640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00c106a80 0x7ff00c19cd50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff00400eaa0 tx=0x7ff00400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:27.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.565+0000 7feffb7fe640 1 -- 172.21.15.42:0/303897834 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00400cdb0 con 0x7ff00c106a80 2024-09-19T09:40:27.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.565+0000 7feffb7fe640 1 -- 172.21.15.42:0/303897834 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff004005020 con 0x7ff00c106a80 2024-09-19T09:40:27.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.565+0000 7ff010f22640 1 -- 172.21.15.42:0/303897834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00c19d720 con 0x7ff00c106a80 2024-09-19T09:40:27.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.565+0000 7feffb7fe640 1 -- 172.21.15.42:0/303897834 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0040116b0 con 0x7ff00c106a80 2024-09-19T09:40:27.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.565+0000 7ff010f22640 1 -- 172.21.15.42:0/303897834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00c1a5000 con 0x7ff00c106a80 2024-09-19T09:40:27.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.567+0000 7feffb7fe640 1 -- 172.21.15.42:0/303897834 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff004005560 con 0x7ff00c106a80 2024-09-19T09:40:27.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.567+0000 7ff0132fb740 1 Processor -- start 2024-09-19T09:40:27.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff0132fb740 1 -- start start 2024-09-19T09:40:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f6af50 0x55e2b1f694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f699e0 0x55e2b1f69e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f74780 0x55e2b1f76b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff0132fb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e2b1ecb2f0 con 0x55e2b1f74780 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff0132fb740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e2b1e72cf0 con 0x55e2b1f699e0 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff0132fb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e2b1ec72b0 con 0x55e2b1f6af50 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7feffb7fe640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feff40a3240 0x7feff40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff00ad9d640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feff40a3240 0x7feff40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff009d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f74780 0x55e2b1f76b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff009d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f74780 0x55e2b1f76b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34726/0 (socket says 172.21.15.42:34726) 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff009d9b640 1 -- 172.21.15.42:0/1568753331 learned_addr learned my addr 172.21.15.42:0/1568753331 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff009d9b640 1 --2- 172.21.15.42:0/1568753331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f6af50 0x55e2b1f694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff00a59c640 1 --2- 172.21.15.42:0/1568753331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f699e0 0x55e2b1f69e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7feffb7fe640 1 -- 172.21.15.42:0/303897834 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ff0040cfa70 con 0x7ff00c106a80 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff009d9b640 1 -- 172.21.15.42:0/1568753331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f6af50 msgr2=0x55e2b1f694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.568+0000 7ff009d9b640 1 --2- 172.21.15.42:0/1568753331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f6af50 0x55e2b1f694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.569+0000 7ff009d9b640 1 -- 172.21.15.42:0/1568753331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f699e0 msgr2=0x55e2b1f69e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.569+0000 7ff009d9b640 1 --2- 172.21.15.42:0/1568753331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f699e0 0x55e2b1f69e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.569+0000 7ff009d9b640 1 -- 172.21.15.42:0/1568753331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b1e573a0 con 0x55e2b1f74780 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.569+0000 7ff00ad9d640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feff40a3240 0x7feff40a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff004098580 tx=0x7ff00406efa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.569+0000 7ff009d9b640 1 --2- 172.21.15.42:0/1568753331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f74780 0x55e2b1f76b70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff0000127c0 tx=0x7ff00000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52747915efa29d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.569+0000 7feff8ff9640 1 -- 172.21.15.42:0/1568753331 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000012d40 con 0x55e2b1f74780 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.569+0000 7feff8ff9640 1 -- 172.21.15.42:0/1568753331 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff000010c50 con 0x55e2b1f74780 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.569+0000 7feff8ff9640 1 -- 172.21.15.42:0/1568753331 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00001eab0 con 0x55e2b1f74780 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.570+0000 7ff0132fb740 1 -- 172.21.15.42:0/1568753331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f74780 msgr2=0x55e2b1f76b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.570+0000 7ff0132fb740 1 --2- 172.21.15.42:0/1568753331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f74780 0x55e2b1f76b70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff0000127c0 tx=0x7ff00000b7c0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.570+0000 7ff0132fb740 1 -- 172.21.15.42:0/1568753331 shutdown_connections 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.570+0000 7ff0132fb740 1 --2- 172.21.15.42:0/1568753331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f74780 0x55e2b1f76b70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.570+0000 7ff0132fb740 1 --2- 172.21.15.42:0/1568753331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f699e0 0x55e2b1f69e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.570+0000 7ff0132fb740 1 --2- 172.21.15.42:0/1568753331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f6af50 0x55e2b1f694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.570+0000 7ff0132fb740 1 -- 172.21.15.42:0/1568753331 >> 172.21.15.42:0/1568753331 conn(0x55e2b1f2e310 msgr2=0x55e2b1f66070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.570+0000 7ff0132fb740 1 -- 172.21.15.42:0/1568753331 shutdown_connections 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.570+0000 7ff0132fb740 1 -- 172.21.15.42:0/1568753331 wait complete. 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.570+0000 7ff0132fb740 1 -- start start 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff0132fb740 1 Processor -- start 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f74180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f6af50 0x55e2b1f71430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f74780 0x55e2b1f71a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff0132fb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e2b1f77480 con 0x55e2b1f699e0 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff0132fb740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e2b1e86060 con 0x55e2b1f6af50 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff0132fb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e2b1f77600 con 0x55e2b1f74780 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff0132fb740 10 client.0 _ll_register_callbacks cb 0x55e2b1bd98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff009d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f74180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff009d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f74180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34738/0 (socket says 172.21.15.42:34738) 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff009d9b640 1 -- 172.21.15.42:0/3443653168 learned_addr learned my addr 172.21.15.42:0/3443653168 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff00a59c640 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f6af50 0x55e2b1f71430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff009d9b640 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f74780 0x55e2b1f71a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff009d9b640 1 -- 172.21.15.42:0/3443653168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f74780 msgr2=0x55e2b1f71a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff009d9b640 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f74780 0x55e2b1f71a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff009d9b640 1 -- 172.21.15.42:0/3443653168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f6af50 msgr2=0x55e2b1f71430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff009d9b640 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f6af50 0x55e2b1f71430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.571+0000 7ff009d9b640 1 -- 172.21.15.42:0/3443653168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2b1c3c3c0 con 0x55e2b1f699e0 2024-09-19T09:40:27.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7ff009d9b640 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f74180 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff00001e5a0 tx=0x7ff00001e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2baef9d32a94e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:27.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7feff1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:27.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7feff1ffb640 1 -- 172.21.15.42:0/3443653168 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000024040 con 0x55e2b1f699e0 2024-09-19T09:40:27.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7feff1ffb640 1 -- 172.21.15.42:0/3443653168 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ff00001ea90 con 0x55e2b1f699e0 2024-09-19T09:40:27.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7ff0132fb740 1 -- 172.21.15.42:0/3443653168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff000010c50 con 0x55e2b1f699e0 2024-09-19T09:40:27.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7feff1ffb640 1 -- 172.21.15.42:0/3443653168 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff000031070 con 0x55e2b1f699e0 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7ff0132fb740 10 client.15963 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7ff0132fb740 1 -- 172.21.15.42:0/3443653168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e2b1f82f20 con 0x55e2b1f699e0 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7feff1ffb640 1 -- 172.21.15.42:0/3443653168 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff000010c50 con 0x55e2b1f699e0 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7feff1ffb640 1 -- 172.21.15.42:0/3443653168 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff0000035f0 con 0x55e2b1f699e0 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7ff0132fb740 10 client.15963 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7ff0132fb740 10 client.15963 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7ff0132fb740 20 client.15963 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7ff0132fb740 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55e2b1f842d0 0x55e2b1f866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7ff0132fb740 4 client.15963 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.572+0000 7ff0132fb740 1 -- 172.21.15.42:0/3443653168 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2b1ed8860 con 0x55e2b1f842d0 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.573+0000 7ff00a59c640 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55e2b1f842d0 0x55e2b1f866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.573+0000 7ff00a59c640 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55e2b1f842d0 0x55e2b1f866c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a79831b2d36f6e32 server_cookie=16a357cba124dc32 in_seq=0 out_seq=0 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.573+0000 7feff1ffb640 10 client.15963 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7feff1ffb640 1 -- 172.21.15.42:0/3443653168 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e2b1ed8860 con 0x55e2b1f842d0 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7feff1ffb640 10 client.15963 handle_command_reply: tid=0 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 client.15963 shutdown 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 -- 172.21.15.42:0/3443653168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 msgr2=0x55e2b1f74180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f74180 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff00001e5a0 tx=0x7ff00001e790 comp rx=0 tx=0).stop 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 -- 172.21.15.42:0/3443653168 shutdown_connections 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55e2b1f842d0 0x55e2b1f866c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f74780 0x55e2b1f71a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f6af50 0x55e2b1f71430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 --2- 172.21.15.42:0/3443653168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f74180 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 -- 172.21.15.42:0/3443653168 >> 172.21.15.42:0/3443653168 conn(0x55e2b1f2e310 msgr2=0x55e2b1f6bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7feff1ffb640 0 client.15963 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:40:27.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 -- 172.21.15.42:0/3443653168 shutdown_connections 2024-09-19T09:40:27.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 1 -- 172.21.15.42:0/3443653168 wait complete. 2024-09-19T09:40:27.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.574+0000 7ff0132fb740 20 client.15963 trim_cache size 0 max 16384 2024-09-19T09:40:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.587+0000 7ff0132fb740 1 Processor -- start 2024-09-19T09:40:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.587+0000 7ff0132fb740 1 -- start start 2024-09-19T09:40:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f699e0 0x55e2b1f80720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f6af50 0x55e2b1f72c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f74780 0x55e2b1f6c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff0132fb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c1ab450 con 0x55e2b1f6af50 2024-09-19T09:40:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff0132fb740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c1acf90 con 0x55e2b1f74780 2024-09-19T09:40:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff0132fb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c1abb20 con 0x55e2b1f699e0 2024-09-19T09:40:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff00a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f6af50 0x55e2b1f72c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff00a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f6af50 0x55e2b1f72c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34742/0 (socket says 172.21.15.42:34742) 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff00a59c640 1 -- 172.21.15.42:0/3151052194 learned_addr learned my addr 172.21.15.42:0/3151052194 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff009d9b640 1 --2- 172.21.15.42:0/3151052194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f699e0 0x55e2b1f80720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff009d9b640 1 --2- 172.21.15.42:0/3151052194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f74780 0x55e2b1f6c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff00a59c640 1 -- 172.21.15.42:0/3151052194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f699e0 msgr2=0x55e2b1f80720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff00a59c640 1 --2- 172.21.15.42:0/3151052194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f699e0 0x55e2b1f80720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff00a59c640 1 -- 172.21.15.42:0/3151052194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f74780 msgr2=0x55e2b1f6c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff00a59c640 1 --2- 172.21.15.42:0/3151052194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f74780 0x55e2b1f6c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff00a59c640 1 -- 172.21.15.42:0/3151052194 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b1f744f0 con 0x55e2b1f6af50 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff009d9b640 1 --2- 172.21.15.42:0/3151052194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f74780 0x55e2b1f6c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7ff00a59c640 1 --2- 172.21.15.42:0/3151052194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f6af50 0x55e2b1f72c90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7feffc009930 tx=0x7feffc031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc762540ef5d39d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7feff3fff640 1 -- 172.21.15.42:0/3151052194 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc035040 con 0x55e2b1f6af50 2024-09-19T09:40:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7feff3fff640 1 -- 172.21.15.42:0/3151052194 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feffc005500 con 0x55e2b1f6af50 2024-09-19T09:40:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.588+0000 7feff3fff640 1 -- 172.21.15.42:0/3151052194 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc004bc0 con 0x55e2b1f6af50 2024-09-19T09:40:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 -- 172.21.15.42:0/3151052194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f6af50 msgr2=0x55e2b1f72c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 --2- 172.21.15.42:0/3151052194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f6af50 0x55e2b1f72c90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7feffc009930 tx=0x7feffc031b10 comp rx=0 tx=0).stop 2024-09-19T09:40:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 -- 172.21.15.42:0/3151052194 shutdown_connections 2024-09-19T09:40:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 --2- 172.21.15.42:0/3151052194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f74780 0x55e2b1f6c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 --2- 172.21.15.42:0/3151052194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f6af50 0x55e2b1f72c90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 --2- 172.21.15.42:0/3151052194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f699e0 0x55e2b1f80720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 -- 172.21.15.42:0/3151052194 >> 172.21.15.42:0/3151052194 conn(0x55e2b1f2e310 msgr2=0x55e2b1f60d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 -- 172.21.15.42:0/3151052194 shutdown_connections 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 -- 172.21.15.42:0/3151052194 wait complete. 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 -- start start 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.589+0000 7ff0132fb740 1 Processor -- start 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f7c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f6af50 0x55e2b1f7ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff0132fb740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f74780 0x55e2b1f77dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff0132fb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c1ac8c0 con 0x55e2b1f699e0 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff0132fb740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c1ac1f0 con 0x55e2b1f74780 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff0132fb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c1a9430 con 0x55e2b1f6af50 2024-09-19T09:40:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff0132fb740 10 client.0 _ll_register_callbacks cb 0x7ff00000be90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff009d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f7c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff009d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f7c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34754/0 (socket says 172.21.15.42:34754) 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff009d9b640 1 -- 172.21.15.42:0/72843466 learned_addr learned my addr 172.21.15.42:0/72843466 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff00a59c640 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f6af50 0x55e2b1f7ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff009d9b640 1 -- 172.21.15.42:0/72843466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f6af50 msgr2=0x55e2b1f7ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff009d9b640 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f6af50 0x55e2b1f7ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff009d9b640 1 -- 172.21.15.42:0/72843466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f74780 msgr2=0x55e2b1f77dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff009d9b640 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f74780 0x55e2b1f77dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff009d9b640 1 -- 172.21.15.42:0/72843466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2b1f71d90 con 0x55e2b1f699e0 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7ff009d9b640 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f7c950 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff000003bb0 tx=0x7ff000012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9036e72bc82cb631 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:27.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.590+0000 7feff1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7feff1ffb640 1 -- 172.21.15.42:0/72843466 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00001e3e0 con 0x55e2b1f699e0 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7feff1ffb640 1 -- 172.21.15.42:0/72843466 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ff000010a90 con 0x55e2b1f699e0 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7ff0132fb740 1 -- 172.21.15.42:0/72843466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feffc005500 con 0x55e2b1f699e0 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7feff1ffb640 1 -- 172.21.15.42:0/72843466 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff00000b480 con 0x55e2b1f699e0 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7ff0132fb740 10 client.15969 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7ff0132fb740 1 -- 172.21.15.42:0/72843466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e2b1fee5c0 con 0x55e2b1f699e0 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7feff1ffb640 1 -- 172.21.15.42:0/72843466 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feffc005500 con 0x55e2b1f699e0 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7feff1ffb640 1 -- 172.21.15.42:0/72843466 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff00001eb00 con 0x55e2b1f699e0 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7ff0132fb740 10 client.15969 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7ff0132fb740 10 client.15969 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7ff0132fb740 20 client.15969 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7ff0132fb740 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55e2b1feecb0 0x55e2b1ff10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:27.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7ff0132fb740 4 client.15969 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:27.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.591+0000 7ff0132fb740 1 -- 172.21.15.42:0/72843466 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2b1ed2d70 con 0x55e2b1feecb0 2024-09-19T09:40:27.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff00a59c640 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55e2b1feecb0 0x55e2b1ff10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:27.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff00a59c640 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55e2b1feecb0 0x55e2b1ff10d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5456b955c1e9f1f8 server_cookie=f491dfdad7bb934f in_seq=0 out_seq=0 2024-09-19T09:40:27.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7feff1ffb640 10 client.15969 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:40:27.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7feff1ffb640 1 -- 172.21.15.42:0/72843466 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e2b1ed2d70 con 0x55e2b1feecb0 2024-09-19T09:40:27.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7feff1ffb640 10 client.15969 handle_command_reply: tid=0 2024-09-19T09:40:27.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff0132fb740 1 client.15969 shutdown 2024-09-19T09:40:27.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff0132fb740 1 -- 172.21.15.42:0/72843466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 msgr2=0x55e2b1f7c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:27.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff0132fb740 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f7c950 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff000003bb0 tx=0x7ff000012690 comp rx=0 tx=0).stop 2024-09-19T09:40:27.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff0132fb740 1 -- 172.21.15.42:0/72843466 shutdown_connections 2024-09-19T09:40:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff0132fb740 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55e2b1feecb0 0x55e2b1ff10d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff0132fb740 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e2b1f74780 0x55e2b1f77dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff0132fb740 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e2b1f6af50 0x55e2b1f7ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff0132fb740 1 --2- 172.21.15.42:0/72843466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e2b1f699e0 0x55e2b1f7c950 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7feff1ffb640 0 client.15969 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:40:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.592+0000 7ff0132fb740 1 -- 172.21.15.42:0/72843466 >> 172.21.15.42:0/72843466 conn(0x55e2b1f2e310 msgr2=0x55e2b1f7f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff0132fb740 1 -- 172.21.15.42:0/72843466 shutdown_connections 2024-09-19T09:40:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff0132fb740 1 -- 172.21.15.42:0/72843466 wait complete. 2024-09-19T09:40:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff0132fb740 20 client.15969 trim_cache size 0 max 16384 2024-09-19T09:40:27.603 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:40:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 -- 172.21.15.42:0/303897834 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feff40a3240 msgr2=0x7feff40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feff40a3240 0x7feff40a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff004098580 tx=0x7ff00406efa0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 -- 172.21.15.42:0/303897834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00c106a80 msgr2=0x7ff00c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00c106a80 0x7ff00c19cd50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff00400eaa0 tx=0x7ff00400ef60 comp rx=0 tx=0).stop 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 -- 172.21.15.42:0/303897834 shutdown_connections 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feff40a3240 0x7feff40a5700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff00c106a80 0x7ff00c19cd50 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff00c101420 0x7ff00c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 --2- 172.21.15.42:0/303897834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c100a80 0x7ff00c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 -- 172.21.15.42:0/303897834 >> 172.21.15.42:0/303897834 conn(0x7ff00c0fc7a0 msgr2=0x7ff00c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.593+0000 7ff010f22640 1 -- 172.21.15.42:0/303897834 shutdown_connections 2024-09-19T09:40:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:27.594+0000 7ff010f22640 1 -- 172.21.15.42:0/303897834 wait complete. 2024-09-19T09:40:28.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:28 smithi042 ceph-mon[31223]: pgmap v371: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T09:40:28.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:28 smithi042 ceph-mon[31223]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T09:40:28.250 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:40:28.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:28 smithi171 ceph-mon[35803]: pgmap v371: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T09:40:28.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:28 smithi171 ceph-mon[35803]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T09:40:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:28 smithi136 ceph-mon[34840]: pgmap v371: 97 pgs: 97 active+clean; 674 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T09:40:28.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:28 smithi136 ceph-mon[34840]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T09:40:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.963+0000 7fa802f4e640 1 -- 172.21.15.42:0/712078552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc102570 msgr2=0x7fa7fc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.963+0000 7fa802f4e640 1 --2- 172.21.15.42:0/712078552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc102570 0x7fa7fc1029b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009ca0 tx=0x7fa7ec02a950 comp rx=0 tx=0).stop 2024-09-19T09:40:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.963+0000 7fa802f4e640 1 -- 172.21.15.42:0/712078552 shutdown_connections 2024-09-19T09:40:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.963+0000 7fa802f4e640 1 --2- 172.21.15.42:0/712078552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc102ef0 0x7fa7fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.963+0000 7fa802f4e640 1 --2- 172.21.15.42:0/712078552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc102570 0x7fa7fc1029b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.963+0000 7fa802f4e640 1 --2- 172.21.15.42:0/712078552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc100e20 0x7fa7fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.963+0000 7fa802f4e640 1 -- 172.21.15.42:0/712078552 >> 172.21.15.42:0/712078552 conn(0x7fa7fc0fc7d0 msgr2=0x7fa7fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.963+0000 7fa802f4e640 1 -- 172.21.15.42:0/712078552 shutdown_connections 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.963+0000 7fa802f4e640 1 -- 172.21.15.42:0/712078552 wait complete. 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa802f4e640 1 Processor -- start 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa802f4e640 1 -- start start 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa802f4e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc100e20 0x7fa7fc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa802f4e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc102570 0x7fa7fc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa802f4e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc102ef0 0x7fa7fc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa802f4e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc110fd0 con 0x7fa7fc100e20 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa802f4e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc110e50 con 0x7fa7fc102570 2024-09-19T09:40:28.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa802f4e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc111150 con 0x7fa7fc102ef0 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa800cea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc100e20 0x7fa7fc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa800cea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc100e20 0x7fa7fc198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34766/0 (socket says 172.21.15.42:34766) 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa800cea640 1 -- 172.21.15.42:0/383327526 learned_addr learned my addr 172.21.15.42:0/383327526 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc102570 0x7fa7fc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa8014eb640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc102ef0 0x7fa7fc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa800cea640 1 -- 172.21.15.42:0/383327526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc102ef0 msgr2=0x7fa7fc19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa800cea640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc102ef0 0x7fa7fc19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa800cea640 1 -- 172.21.15.42:0/383327526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc102570 msgr2=0x7fa7fc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa800cea640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc102570 0x7fa7fc198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa800cea640 1 -- 172.21.15.42:0/383327526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc19d4e0 con 0x7fa7fc100e20 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.964+0000 7fa8014eb640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc102ef0 0x7fa7fc19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.965+0000 7fa800cea640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc100e20 0x7fa7fc198530 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400e9f0 tx=0x7fa7f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:28.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.965+0000 7fa7f9ffb640 1 -- 172.21.15.42:0/383327526 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400cd80 con 0x7fa7fc100e20 2024-09-19T09:40:28.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.965+0000 7fa7f9ffb640 1 -- 172.21.15.42:0/383327526 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7f4010910 con 0x7fa7fc100e20 2024-09-19T09:40:28.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.965+0000 7fa802f4e640 1 -- 172.21.15.42:0/383327526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7fc19d7d0 con 0x7fa7fc100e20 2024-09-19T09:40:28.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.965+0000 7fa7f9ffb640 1 -- 172.21.15.42:0/383327526 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4018990 con 0x7fa7fc100e20 2024-09-19T09:40:28.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.965+0000 7fa802f4e640 1 -- 172.21.15.42:0/383327526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7fc1a50b0 con 0x7fa7fc100e20 2024-09-19T09:40:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.967+0000 7fa7f9ffb640 1 -- 172.21.15.42:0/383327526 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa7f4010ac0 con 0x7fa7fc100e20 2024-09-19T09:40:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa805327740 1 Processor -- start 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa805327740 1 -- start start 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa805327740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b9b40 0x55cd536b8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa805327740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536b85d0 0x55cd536b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa805327740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536c3370 0x55cd536c5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa805327740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cd5361e2f0 con 0x55cd536b9b40 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa805327740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55cd535c5cf0 con 0x55cd536c3370 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa805327740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55cd5361a2b0 con 0x55cd536b85d0 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa7f9ffb640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a3240 0x7fa7e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa8014eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b9b40 0x55cd536b8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa8014eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b9b40 0x55cd536b8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34778/0 (socket says 172.21.15.42:34778) 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa8014eb640 1 -- 172.21.15.42:0/2226715155 learned_addr learned my addr 172.21.15.42:0/2226715155 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/2226715155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536c3370 0x55cd536c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa8014eb640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a3240 0x7fa7e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa7f9ffb640 1 -- 172.21.15.42:0/383327526 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa7f40cfd50 con 0x7fa7fc100e20 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.968+0000 7fa800cea640 1 --2- 172.21.15.42:0/2226715155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536b85d0 0x55cd536b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.969+0000 7fa8014eb640 1 -- 172.21.15.42:0/2226715155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536b85d0 msgr2=0x55cd536b8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.969+0000 7fa8014eb640 1 --2- 172.21.15.42:0/2226715155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536b85d0 0x55cd536b8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.969+0000 7fa8014eb640 1 -- 172.21.15.42:0/2226715155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536c3370 msgr2=0x55cd536c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.969+0000 7fa8014eb640 1 --2- 172.21.15.42:0/2226715155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536c3370 0x55cd536c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.969+0000 7fa8014eb640 1 -- 172.21.15.42:0/2226715155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd535aa3a0 con 0x55cd536b9b40 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.969+0000 7fa8014eb640 1 --2- 172.21.15.42:0/2226715155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b9b40 0x55cd536b8090 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4012a30 tx=0x7fa7e4012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36cd128ac7f8827 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.969+0000 7fa8014eb640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a3240 0x7fa7e80a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4010860 tx=0x7fa7e401d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.969+0000 7fa7f2ffd640 1 -- 172.21.15.42:0/2226715155 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4023070 con 0x55cd536b9b40 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.969+0000 7fa7f2ffd640 1 -- 172.21.15.42:0/2226715155 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e4009990 con 0x55cd536b9b40 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.969+0000 7fa7f2ffd640 1 -- 172.21.15.42:0/2226715155 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400da60 con 0x55cd536b9b40 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 -- 172.21.15.42:0/2226715155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b9b40 msgr2=0x55cd536b8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 --2- 172.21.15.42:0/2226715155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b9b40 0x55cd536b8090 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4012a30 tx=0x7fa7e4012ef0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 -- 172.21.15.42:0/2226715155 shutdown_connections 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 --2- 172.21.15.42:0/2226715155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536c3370 0x55cd536c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 --2- 172.21.15.42:0/2226715155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536b85d0 0x55cd536b8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 --2- 172.21.15.42:0/2226715155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b9b40 0x55cd536b8090 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 -- 172.21.15.42:0/2226715155 >> 172.21.15.42:0/2226715155 conn(0x55cd53681310 msgr2=0x55cd536b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 -- 172.21.15.42:0/2226715155 shutdown_connections 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 -- 172.21.15.42:0/2226715155 wait complete. 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 -- start start 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.970+0000 7fa805327740 1 Processor -- start 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa805327740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa805327740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536b9b40 0x55cd536c0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa805327740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536c3370 0x55cd536c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa805327740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cd536ca420 con 0x55cd536b85d0 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa805327740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55cd535d9060 con 0x55cd536b9b40 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa805327740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55cd536ca5a0 con 0x55cd536c3370 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa805327740 10 client.0 _ll_register_callbacks cb 0x55cd5332c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa800cea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa800cea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34782/0 (socket says 172.21.15.42:34782) 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa800cea640 1 -- 172.21.15.42:0/4001883865 learned_addr learned my addr 172.21.15.42:0/4001883865 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536b9b40 0x55cd536c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa8014eb640 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536c3370 0x55cd536c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa800cea640 1 -- 172.21.15.42:0/4001883865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536c3370 msgr2=0x55cd536c07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa800cea640 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536c3370 0x55cd536c07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa800cea640 1 -- 172.21.15.42:0/4001883865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536b9b40 msgr2=0x55cd536c0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa800cea640 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536b9b40 0x55cd536c0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.971+0000 7fa800cea640 1 -- 172.21.15.42:0/4001883865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd5338f3c0 con 0x55cd536b85d0 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa800cea640 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536c2de0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa7f409bff0 tx=0x7fa7f409bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c598ab9e3f41a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa7dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa7dbfff640 1 -- 172.21.15.42:0/4001883865 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40b5060 con 0x55cd536b85d0 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa7dbfff640 1 -- 172.21.15.42:0/4001883865 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa7f4018b30 con 0x55cd536b85d0 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa805327740 1 -- 172.21.15.42:0/4001883865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7e4009990 con 0x55cd536b85d0 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa7dbfff640 1 -- 172.21.15.42:0/4001883865 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa7f40a06a0 con 0x55cd536b85d0 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa805327740 10 client.15981 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa805327740 1 -- 172.21.15.42:0/4001883865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd536d5fb0 con 0x55cd536b85d0 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa7dbfff640 1 -- 172.21.15.42:0/4001883865 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e4009990 con 0x55cd536b85d0 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa7dbfff640 1 -- 172.21.15.42:0/4001883865 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa7f409b740 con 0x55cd536b85d0 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa805327740 10 client.15981 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa805327740 10 client.15981 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:40:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa805327740 20 client.15981 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa805327740 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55cd536d73c0 0x55cd536d97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa805327740 4 client.15981 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.972+0000 7fa805327740 1 -- 172.21.15.42:0/4001883865 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd5362b860 con 0x55cd536d73c0 2024-09-19T09:40:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.973+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55cd536d73c0 0x55cd536d97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.973+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55cd536d73c0 0x55cd536d97b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1f300a96194e74a6 server_cookie=2b22812620107687 in_seq=0 out_seq=0 2024-09-19T09:40:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.973+0000 7fa7dbfff640 10 client.15981 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:40:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa7dbfff640 1 -- 172.21.15.42:0/4001883865 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd5362b860 con 0x55cd536d73c0 2024-09-19T09:40:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa7dbfff640 10 client.15981 handle_command_reply: tid=0 2024-09-19T09:40:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa805327740 1 client.15981 shutdown 2024-09-19T09:40:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa805327740 1 -- 172.21.15.42:0/4001883865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 msgr2=0x55cd536c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa805327740 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536c2de0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa7f409bff0 tx=0x7fa7f409bc50 comp rx=0 tx=0).stop 2024-09-19T09:40:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa805327740 1 -- 172.21.15.42:0/4001883865 shutdown_connections 2024-09-19T09:40:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa805327740 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55cd536d73c0 0x55cd536d97b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa805327740 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536c3370 0x55cd536c07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa805327740 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536b9b40 0x55cd536c0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa805327740 1 --2- 172.21.15.42:0/4001883865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536c2de0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa805327740 1 -- 172.21.15.42:0/4001883865 >> 172.21.15.42:0/4001883865 conn(0x55cd53681310 msgr2=0x55cd536ba960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.974+0000 7fa7dbfff640 0 client.15981 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:40:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.975+0000 7fa805327740 1 -- 172.21.15.42:0/4001883865 shutdown_connections 2024-09-19T09:40:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.975+0000 7fa805327740 1 -- 172.21.15.42:0/4001883865 wait complete. 2024-09-19T09:40:28.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.975+0000 7fa805327740 20 client.15981 trim_cache size 0 max 16384 2024-09-19T09:40:28.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.988+0000 7fa805327740 1 Processor -- start 2024-09-19T09:40:28.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.988+0000 7fa805327740 1 -- start start 2024-09-19T09:40:28.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.988+0000 7fa805327740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd53681310 0x55cd536d36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.988+0000 7fa805327740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.988+0000 7fa805327740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536b9b40 0x55cd536df080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:28.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.988+0000 7fa805327740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1ab450 con 0x55cd536b85d0 2024-09-19T09:40:28.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.988+0000 7fa805327740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1acf90 con 0x55cd536b9b40 2024-09-19T09:40:28.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.988+0000 7fa805327740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1abb20 con 0x55cd53681310 2024-09-19T09:40:28.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34792/0 (socket says 172.21.15.42:34792) 2024-09-19T09:40:28.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7fbfff640 1 -- 172.21.15.42:0/1860472507 learned_addr learned my addr 172.21.15.42:0/1860472507 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa800cea640 1 --2- 172.21.15.42:0/1860472507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd53681310 0x55cd536d36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa8014eb640 1 --2- 172.21.15.42:0/1860472507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536b9b40 0x55cd536df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7fbfff640 1 -- 172.21.15.42:0/1860472507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd53681310 msgr2=0x55cd536d36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/1860472507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd53681310 0x55cd536d36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7fbfff640 1 -- 172.21.15.42:0/1860472507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536b9b40 msgr2=0x55cd536df080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/1860472507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536b9b40 0x55cd536df080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7fbfff640 1 -- 172.21.15.42:0/1860472507 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd536d3c00 con 0x55cd536b85d0 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa800cea640 1 --2- 172.21.15.42:0/1860472507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd53681310 0x55cd536d36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/1860472507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bef80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009ca0 tx=0x7fa7ec02f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90eb09d3a9fa71d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7f27fc640 1 -- 172.21.15.42:0/1860472507 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec034040 con 0x55cd536b85d0 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7f27fc640 1 -- 172.21.15.42:0/1860472507 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ec02fe10 con 0x55cd536b85d0 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.989+0000 7fa7f27fc640 1 -- 172.21.15.42:0/1860472507 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec004670 con 0x55cd536b85d0 2024-09-19T09:40:28.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.990+0000 7fa805327740 1 -- 172.21.15.42:0/1860472507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 msgr2=0x55cd536bef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:29.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.990+0000 7fa805327740 1 --2- 172.21.15.42:0/1860472507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bef80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009ca0 tx=0x7fa7ec02f7b0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.990+0000 7fa805327740 1 -- 172.21.15.42:0/1860472507 shutdown_connections 2024-09-19T09:40:29.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.990+0000 7fa805327740 1 --2- 172.21.15.42:0/1860472507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd536b9b40 0x55cd536df080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.990+0000 7fa805327740 1 --2- 172.21.15.42:0/1860472507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bef80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.990+0000 7fa805327740 1 --2- 172.21.15.42:0/1860472507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd53681310 0x55cd536d36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.990+0000 7fa805327740 1 -- 172.21.15.42:0/1860472507 >> 172.21.15.42:0/1860472507 conn(0x55cd536bbae0 msgr2=0x55cd536be870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:29.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.990+0000 7fa805327740 1 -- 172.21.15.42:0/1860472507 shutdown_connections 2024-09-19T09:40:29.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.990+0000 7fa805327740 1 -- 172.21.15.42:0/1860472507 wait complete. 2024-09-19T09:40:29.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.990+0000 7fa805327740 1 -- start start 2024-09-19T09:40:29.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa805327740 1 Processor -- start 2024-09-19T09:40:29.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa805327740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd53681310 0x55cd536bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:29.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa805327740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:29.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa805327740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536b9b40 0x55cd536bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:29.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa805327740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1ac8c0 con 0x55cd536b85d0 2024-09-19T09:40:29.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa805327740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1ac1f0 con 0x55cd53681310 2024-09-19T09:40:29.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa805327740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1a9430 con 0x55cd536b9b40 2024-09-19T09:40:29.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa805327740 10 client.0 _ll_register_callbacks cb 0x7fa7f4098590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:29.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34798/0 (socket says 172.21.15.42:34798) 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa7fbfff640 1 -- 172.21.15.42:0/1653880640 learned_addr learned my addr 172.21.15.42:0/1653880640 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa800cea640 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd53681310 0x55cd536bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa8014eb640 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536b9b40 0x55cd536bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa7fbfff640 1 -- 172.21.15.42:0/1653880640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536b9b40 msgr2=0x55cd536bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536b9b40 0x55cd536bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa7fbfff640 1 -- 172.21.15.42:0/1653880640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd53681310 msgr2=0x55cd536bd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd53681310 0x55cd536bd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.991+0000 7fa7fbfff640 1 -- 172.21.15.42:0/1653880640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd53741050 con 0x55cd536b85d0 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa7fbfff640 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bd5c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec02ae70 tx=0x7fa7ec005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc5f2cedc7bf241 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa7dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa7dbfff640 1 -- 172.21.15.42:0/1653880640 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec034030 con 0x55cd536b85d0 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa7dbfff640 1 -- 172.21.15.42:0/1653880640 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa7ec02fb30 con 0x55cd536b85d0 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa805327740 1 -- 172.21.15.42:0/1653880640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7ec02fe10 con 0x55cd536b85d0 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa7dbfff640 1 -- 172.21.15.42:0/1653880640 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa7ec061050 con 0x55cd536b85d0 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa805327740 10 client.15987 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa805327740 1 -- 172.21.15.42:0/1653880640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd537422e0 con 0x55cd536b85d0 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa7dbfff640 1 -- 172.21.15.42:0/1653880640 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ec02fe10 con 0x55cd536b85d0 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa7dbfff640 1 -- 172.21.15.42:0/1653880640 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa7ec047430 con 0x55cd536b85d0 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa805327740 10 client.15987 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa805327740 10 client.15987 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa805327740 20 client.15987 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.992+0000 7fa805327740 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55cd536c3370 0x55cd53744a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.993+0000 7fa805327740 4 client.15987 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:29.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.993+0000 7fa805327740 1 -- 172.21.15.42:0/1653880640 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd53625d70 con 0x55cd536c3370 2024-09-19T09:40:29.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.993+0000 7fa800cea640 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55cd536c3370 0x55cd53744a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:29.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.993+0000 7fa7dbfff640 10 client.15987 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:40:29.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.993+0000 7fa800cea640 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55cd536c3370 0x55cd53744a70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a60520e51d5368ae server_cookie=527e747e0e2b81a3 in_seq=0 out_seq=0 2024-09-19T09:40:29.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.993+0000 7fa7dbfff640 1 -- 172.21.15.42:0/1653880640 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd53625d70 con 0x55cd536c3370 2024-09-19T09:40:29.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.993+0000 7fa7dbfff640 10 client.15987 handle_command_reply: tid=0 2024-09-19T09:40:29.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.993+0000 7fa805327740 1 client.15987 shutdown 2024-09-19T09:40:29.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 1 -- 172.21.15.42:0/1653880640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 msgr2=0x55cd536bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:29.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bd5c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec02ae70 tx=0x7fa7ec005c50 comp rx=0 tx=0).stop 2024-09-19T09:40:29.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 1 -- 172.21.15.42:0/1653880640 shutdown_connections 2024-09-19T09:40:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55cd536c3370 0x55cd53744a70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cd536b9b40 0x55cd536bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd536b85d0 0x55cd536bd5c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 1 --2- 172.21.15.42:0/1653880640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd53681310 0x55cd536bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 1 -- 172.21.15.42:0/1653880640 >> 172.21.15.42:0/1653880640 conn(0x55cd536bbae0 msgr2=0x55cd536b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa7dbfff640 0 client.15987 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:40:29.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 1 -- 172.21.15.42:0/1653880640 shutdown_connections 2024-09-19T09:40:29.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 1 -- 172.21.15.42:0/1653880640 wait complete. 2024-09-19T09:40:29.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa805327740 20 client.15987 trim_cache size 0 max 16384 2024-09-19T09:40:29.007 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:40:29.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa802f4e640 1 -- 172.21.15.42:0/383327526 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a3240 msgr2=0x7fa7e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa802f4e640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a3240 0x7fa7e80a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4010860 tx=0x7fa7e401d000 comp rx=0 tx=0).stop 2024-09-19T09:40:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa802f4e640 1 -- 172.21.15.42:0/383327526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc100e20 msgr2=0x7fa7fc198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa802f4e640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc100e20 0x7fa7fc198530 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400e9f0 tx=0x7fa7f400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa802f4e640 1 -- 172.21.15.42:0/383327526 shutdown_connections 2024-09-19T09:40:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa802f4e640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a3240 0x7fa7e80a5700 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.994+0000 7fa802f4e640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc102ef0 0x7fa7fc19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.995+0000 7fa802f4e640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc102570 0x7fa7fc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.995+0000 7fa802f4e640 1 --2- 172.21.15.42:0/383327526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc100e20 0x7fa7fc198530 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.995+0000 7fa802f4e640 1 -- 172.21.15.42:0/383327526 >> 172.21.15.42:0/383327526 conn(0x7fa7fc0fc7d0 msgr2=0x7fa7fc06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.995+0000 7fa802f4e640 1 -- 172.21.15.42:0/383327526 shutdown_connections 2024-09-19T09:40:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:28.995+0000 7fa802f4e640 1 -- 172.21.15.42:0/383327526 wait complete. 2024-09-19T09:40:29.727 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:40:29.985 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:30.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:30 smithi171 ceph-mon[35803]: pgmap v372: 97 pgs: 97 active+clean; 693 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T09:40:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:30 smithi136 ceph-mon[34840]: pgmap v372: 97 pgs: 97 active+clean; 693 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T09:40:30.391 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:30 smithi042 ceph-mon[31223]: pgmap v372: 97 pgs: 97 active+clean; 693 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T09:40:30.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.474+0000 7f20533bb640 1 -- 172.21.15.42:0/1087419719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f204c106f10 msgr2=0x7f204c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:30.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.474+0000 7f20533bb640 1 --2- 172.21.15.42:0/1087419719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f204c106f10 0x7f204c10ea90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2044009ca0 tx=0x7f204402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.474+0000 7f20533bb640 1 -- 172.21.15.42:0/1087419719 shutdown_connections 2024-09-19T09:40:30.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.474+0000 7f20533bb640 1 --2- 172.21.15.42:0/1087419719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f204c106f10 0x7f204c10ea90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.474+0000 7f20533bb640 1 --2- 172.21.15.42:0/1087419719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f204c102790 0x7f204c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.474+0000 7f20533bb640 1 --2- 172.21.15.42:0/1087419719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f204c101de0 0x7f204c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.474+0000 7f20533bb640 1 -- 172.21.15.42:0/1087419719 >> 172.21.15.42:0/1087419719 conn(0x7f204c0fd8c0 msgr2=0x7f204c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:30.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.474+0000 7f20533bb640 1 -- 172.21.15.42:0/1087419719 shutdown_connections 2024-09-19T09:40:30.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.474+0000 7f20533bb640 1 -- 172.21.15.42:0/1087419719 wait complete. 2024-09-19T09:40:30.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f20533bb640 1 Processor -- start 2024-09-19T09:40:30.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f20533bb640 1 -- start start 2024-09-19T09:40:30.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f20533bb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f204c101de0 0x7f204c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f20533bb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f204c102790 0x7f204c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f20533bb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f204c106f10 0x7f204c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f20533bb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f204c112000 con 0x7f204c101de0 2024-09-19T09:40:30.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f20533bb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f204c111e80 con 0x7f204c102790 2024-09-19T09:40:30.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f20533bb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f204c112180 con 0x7f204c106f10 2024-09-19T09:40:30.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f2051157640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f204c101de0 0x7f204c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f2051157640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f204c101de0 0x7f204c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37212/0 (socket says 172.21.15.42:37212) 2024-09-19T09:40:30.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.475+0000 7f2051157640 1 -- 172.21.15.42:0/1770748352 learned_addr learned my addr 172.21.15.42:0/1770748352 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:30.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f2050956640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f204c102790 0x7f204c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f2051958640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f204c106f10 0x7f204c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f2051157640 1 -- 172.21.15.42:0/1770748352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f204c106f10 msgr2=0x7f204c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:30.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f2051157640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f204c106f10 0x7f204c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f2051157640 1 -- 172.21.15.42:0/1770748352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f204c102790 msgr2=0x7f204c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:30.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f2051157640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f204c102790 0x7f204c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f2051157640 1 -- 172.21.15.42:0/1770748352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204c1a6980 con 0x7f204c101de0 2024-09-19T09:40:30.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f2051157640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f204c101de0 0x7f204c0744f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f204800c970 tx=0x7f204800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:30.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f20427fc640 1 -- 172.21.15.42:0/1770748352 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048007bb0 con 0x7f204c101de0 2024-09-19T09:40:30.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f20427fc640 1 -- 172.21.15.42:0/1770748352 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2048007d50 con 0x7f204c101de0 2024-09-19T09:40:30.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f20533bb640 1 -- 172.21.15.42:0/1770748352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204c1a6c70 con 0x7f204c101de0 2024-09-19T09:40:30.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f20427fc640 1 -- 172.21.15.42:0/1770748352 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204800f450 con 0x7f204c101de0 2024-09-19T09:40:30.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.476+0000 7f20533bb640 1 -- 172.21.15.42:0/1770748352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204c1a7160 con 0x7f204c101de0 2024-09-19T09:40:30.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.478+0000 7f20427fc640 1 -- 172.21.15.42:0/1770748352 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2048004f40 con 0x7f204c101de0 2024-09-19T09:40:30.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2055794740 1 Processor -- start 2024-09-19T09:40:30.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2055794740 1 -- start start 2024-09-19T09:40:30.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2055794740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da61b40 0x55e73da60090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2055794740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da60a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2055794740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 0x55e73da6d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2055794740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e73d9c62f0 con 0x55e73da605d0 2024-09-19T09:40:30.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2055794740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e73d96dcf0 con 0x55e73da61b40 2024-09-19T09:40:30.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2055794740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e73d9c22b0 con 0x55e73da6b370 2024-09-19T09:40:30.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2051157640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da60a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f20427fc640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20380a3240 0x7f20380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2051157640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da60a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37214/0 (socket says 172.21.15.42:37214) 2024-09-19T09:40:30.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.479+0000 7f2051157640 1 -- 172.21.15.42:0/949831103 learned_addr learned my addr 172.21.15.42:0/949831103 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:30.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f2050956640 1 --2- 172.21.15.42:0/949831103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 0x55e73da6d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f2051958640 1 --2- 172.21.15.42:0/949831103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da61b40 0x55e73da60090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f2051958640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20380a3240 0x7f20380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f20427fc640 1 -- 172.21.15.42:0/1770748352 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f20480cf660 con 0x7f204c101de0 2024-09-19T09:40:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f2051157640 1 -- 172.21.15.42:0/949831103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 msgr2=0x55e73da6d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f2051157640 1 --2- 172.21.15.42:0/949831103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 0x55e73da6d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f2051157640 1 -- 172.21.15.42:0/949831103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da61b40 msgr2=0x55e73da60090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f2051157640 1 --2- 172.21.15.42:0/949831103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da61b40 0x55e73da60090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f2051157640 1 -- 172.21.15.42:0/949831103 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73d9523a0 con 0x55e73da605d0 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f2051157640 1 --2- 172.21.15.42:0/949831103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da60a10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2048007590 tx=0x7f204809bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad58c71d09902462 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f20377fe640 1 -- 172.21.15.42:0/949831103 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204801d070 con 0x55e73da605d0 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f20377fe640 1 -- 172.21.15.42:0/949831103 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f204809bc60 con 0x55e73da605d0 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.480+0000 7f20377fe640 1 -- 172.21.15.42:0/949831103 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20480982d0 con 0x55e73da605d0 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2055794740 1 -- 172.21.15.42:0/949831103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 msgr2=0x55e73da60a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2055794740 1 --2- 172.21.15.42:0/949831103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da60a10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2048007590 tx=0x7f204809bb60 comp rx=0 tx=0).stop 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2051958640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20380a3240 0x7f20380a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2044005fe0 tx=0x7f20440095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2055794740 1 -- 172.21.15.42:0/949831103 shutdown_connections 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2055794740 1 --2- 172.21.15.42:0/949831103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 0x55e73da6d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2055794740 1 --2- 172.21.15.42:0/949831103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da60a10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2055794740 1 --2- 172.21.15.42:0/949831103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da61b40 0x55e73da60090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2055794740 1 -- 172.21.15.42:0/949831103 >> 172.21.15.42:0/949831103 conn(0x55e73da29310 msgr2=0x55e73da5cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2055794740 1 -- 172.21.15.42:0/949831103 shutdown_connections 2024-09-19T09:40:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2055794740 1 -- 172.21.15.42:0/949831103 wait complete. 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.481+0000 7f2055794740 1 -- start start 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2055794740 1 Processor -- start 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2055794740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da605d0 0x55e73da6add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2055794740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da61b40 0x55e73da68080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2055794740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 0x55e73da68810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2055794740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e73da6dfb0 con 0x55e73da61b40 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2055794740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e73d981060 con 0x55e73da6b370 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2055794740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e73da6e130 con 0x55e73da605d0 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2055794740 10 client.0 _ll_register_callbacks cb 0x55e73d6d48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2050956640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da61b40 0x55e73da68080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2050956640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da61b40 0x55e73da68080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37222/0 (socket says 172.21.15.42:37222) 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2050956640 1 -- 172.21.15.42:0/51739111 learned_addr learned my addr 172.21.15.42:0/51739111 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:30.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2051157640 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da605d0 0x55e73da6add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2051958640 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 0x55e73da68810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.482+0000 7f2050956640 1 -- 172.21.15.42:0/51739111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da605d0 msgr2=0x55e73da6add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2050956640 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da605d0 0x55e73da6add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2050956640 1 -- 172.21.15.42:0/51739111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 msgr2=0x55e73da68810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2050956640 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 0x55e73da68810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2050956640 1 -- 172.21.15.42:0/51739111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e73d7373c0 con 0x55e73da61b40 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2051958640 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 0x55e73da68810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2050956640 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da61b40 0x55e73da68080 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f203c011570 tx=0x7f203c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c121e153aa1c333b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2034ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2034ff9640 1 -- 172.21.15.42:0/51739111 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c013670 con 0x55e73da61b40 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2055794740 1 -- 172.21.15.42:0/51739111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f204809bc60 con 0x55e73da61b40 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2034ff9640 1 -- 172.21.15.42:0/51739111 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f203c013810 con 0x55e73da61b40 2024-09-19T09:40:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2034ff9640 1 -- 172.21.15.42:0/51739111 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f203c013a10 con 0x55e73da61b40 2024-09-19T09:40:30.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2055794740 10 client.15999 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:30.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2055794740 1 -- 172.21.15.42:0/51739111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e73da79bb0 con 0x55e73da61b40 2024-09-19T09:40:30.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.483+0000 7f2034ff9640 1 -- 172.21.15.42:0/51739111 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f204809bc60 con 0x55e73da61b40 2024-09-19T09:40:30.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.484+0000 7f2034ff9640 1 -- 172.21.15.42:0/51739111 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f203c014440 con 0x55e73da61b40 2024-09-19T09:40:30.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.484+0000 7f2055794740 10 client.15999 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:30.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.484+0000 7f2055794740 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:30.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.484+0000 7f2055794740 20 client.15999 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.484+0000 7f2055794740 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e73da7b010 0x55e73da7d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.484+0000 7f2055794740 4 client.15999 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.484+0000 7f2055794740 1 -- 172.21.15.42:0/51739111 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e73d9d3860 con 0x55e73da7b010 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.484+0000 7f2051157640 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e73da7b010 0x55e73da7d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.484+0000 7f2051157640 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e73da7b010 0x55e73da7d430 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9488fdf509c126a server_cookie=56594370a354416 in_seq=0 out_seq=0 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.484+0000 7f2034ff9640 10 client.15999 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2034ff9640 1 -- 172.21.15.42:0/51739111 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e73d9d3860 con 0x55e73da7b010 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2034ff9640 10 client.15999 handle_command_reply: tid=0 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2055794740 1 client.15999 shutdown 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2055794740 1 -- 172.21.15.42:0/51739111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da61b40 msgr2=0x55e73da68080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2055794740 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da61b40 0x55e73da68080 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f203c011570 tx=0x7f203c009f90 comp rx=0 tx=0).stop 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2055794740 1 -- 172.21.15.42:0/51739111 shutdown_connections 2024-09-19T09:40:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2055794740 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e73da7b010 0x55e73da7d430 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2055794740 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 0x55e73da68810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2055794740 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da61b40 0x55e73da68080 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2055794740 1 --2- 172.21.15.42:0/51739111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da605d0 0x55e73da6add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2034ff9640 0 client.15999 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:30.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.485+0000 7f2055794740 1 -- 172.21.15.42:0/51739111 >> 172.21.15.42:0/51739111 conn(0x55e73da29310 msgr2=0x55e73da62990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:30.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.486+0000 7f2055794740 1 -- 172.21.15.42:0/51739111 shutdown_connections 2024-09-19T09:40:30.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.486+0000 7f2055794740 1 -- 172.21.15.42:0/51739111 wait complete. 2024-09-19T09:40:30.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.486+0000 7f2055794740 20 client.15999 trim_cache size 0 max 16384 2024-09-19T09:40:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2055794740 1 Processor -- start 2024-09-19T09:40:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2055794740 1 -- start start 2024-09-19T09:40:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2055794740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da5cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2055794740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da61b40 0x55e73da67060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2055794740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 0x55e73da82ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2055794740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f204c1af890 con 0x55e73da605d0 2024-09-19T09:40:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2055794740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f204c1b13d0 con 0x55e73da61b40 2024-09-19T09:40:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2055794740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f204c1aff60 con 0x55e73da6b370 2024-09-19T09:40:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2051157640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da5cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2051157640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da5cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37224/0 (socket says 172.21.15.42:37224) 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2051157640 1 -- 172.21.15.42:0/1664064158 learned_addr learned my addr 172.21.15.42:0/1664064158 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2051958640 1 --2- 172.21.15.42:0/1664064158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 0x55e73da82ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2051157640 1 -- 172.21.15.42:0/1664064158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 msgr2=0x55e73da82ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2051157640 1 --2- 172.21.15.42:0/1664064158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 0x55e73da82ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2051157640 1 -- 172.21.15.42:0/1664064158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da61b40 msgr2=0x55e73da67060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2050956640 1 --2- 172.21.15.42:0/1664064158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da61b40 0x55e73da67060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2051157640 1 --2- 172.21.15.42:0/1664064158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da61b40 0x55e73da67060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2051157640 1 -- 172.21.15.42:0/1664064158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73da63bc0 con 0x55e73da605d0 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.499+0000 7f2051958640 1 --2- 172.21.15.42:0/1664064158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 0x55e73da82ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2051157640 1 --2- 172.21.15.42:0/1664064158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da5cd70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f204809b960 tx=0x7f204809cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a33906715f2507 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2036ffd640 1 -- 172.21.15.42:0/1664064158 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204801d040 con 0x55e73da605d0 2024-09-19T09:40:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2036ffd640 1 -- 172.21.15.42:0/1664064158 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20480b1030 con 0x55e73da605d0 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2036ffd640 1 -- 172.21.15.42:0/1664064158 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20480982d0 con 0x55e73da605d0 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2055794740 1 -- 172.21.15.42:0/1664064158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 msgr2=0x55e73da5cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2055794740 1 --2- 172.21.15.42:0/1664064158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da5cd70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f204809b960 tx=0x7f204809cf90 comp rx=0 tx=0).stop 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2055794740 1 -- 172.21.15.42:0/1664064158 shutdown_connections 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2055794740 1 --2- 172.21.15.42:0/1664064158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da6b370 0x55e73da82ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2055794740 1 --2- 172.21.15.42:0/1664064158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da61b40 0x55e73da67060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2055794740 1 --2- 172.21.15.42:0/1664064158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da5cd70 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2055794740 1 -- 172.21.15.42:0/1664064158 >> 172.21.15.42:0/1664064158 conn(0x55e73da29310 msgr2=0x55e73da66950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.500+0000 7f2055794740 1 -- 172.21.15.42:0/1664064158 shutdown_connections 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2055794740 1 -- 172.21.15.42:0/1664064158 wait complete. 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2055794740 1 -- start start 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2055794740 1 Processor -- start 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2055794740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da73890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2055794740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da61b40 0x55e73da6ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2055794740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 0x55e73da6f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2055794740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f204c1b0d00 con 0x55e73da605d0 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2055794740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f204c1b0630 con 0x55e73da6b370 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2055794740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f204c1ad870 con 0x55e73da61b40 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2055794740 10 client.0 _ll_register_callbacks cb 0x7f203c009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2051157640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da73890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.501+0000 7f2051157640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da73890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37226/0 (socket says 172.21.15.42:37226) 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2051157640 1 -- 172.21.15.42:0/936147163 learned_addr learned my addr 172.21.15.42:0/936147163 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2050956640 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da61b40 0x55e73da6ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2051958640 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 0x55e73da6f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2051157640 1 -- 172.21.15.42:0/936147163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da61b40 msgr2=0x55e73da6ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2051157640 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da61b40 0x55e73da6ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2051157640 1 -- 172.21.15.42:0/936147163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 msgr2=0x55e73da6f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2051157640 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 0x55e73da6f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2051157640 1 -- 172.21.15.42:0/936147163 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e73da6f640 con 0x55e73da605d0 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2051958640 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 0x55e73da6f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2051157640 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da73890 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f20480980c0 tx=0x7f204809a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cdfe099e8e5f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2034ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2034ff9640 1 -- 172.21.15.42:0/936147163 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20480b4e60 con 0x55e73da605d0 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2034ff9640 1 -- 172.21.15.42:0/936147163 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2048005590 con 0x55e73da605d0 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2055794740 1 -- 172.21.15.42:0/936147163 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20480b1030 con 0x55e73da605d0 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2034ff9640 1 -- 172.21.15.42:0/936147163 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f204801d030 con 0x55e73da605d0 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2055794740 10 client.16005 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2055794740 1 -- 172.21.15.42:0/936147163 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e73dae5a00 con 0x55e73da605d0 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.502+0000 7f2034ff9640 1 -- 172.21.15.42:0/936147163 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20480b1030 con 0x55e73da605d0 2024-09-19T09:40:30.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.503+0000 7f2034ff9640 1 -- 172.21.15.42:0/936147163 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f204809b140 con 0x55e73da605d0 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.503+0000 7f2055794740 10 client.16005 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.503+0000 7f2055794740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.503+0000 7f2055794740 20 client.16005 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.503+0000 7f2055794740 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e73dae5c80 0x55e73dae8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.503+0000 7f2055794740 4 client.16005 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.503+0000 7f2055794740 1 -- 172.21.15.42:0/936147163 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e73d9cdd70 con 0x55e73dae5c80 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.503+0000 7f2050956640 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e73dae5c80 0x55e73dae8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.503+0000 7f2034ff9640 10 client.16005 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.503+0000 7f2050956640 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e73dae5c80 0x55e73dae8070 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d36d22ff767845b7 server_cookie=3a08800a1ffb215d in_seq=0 out_seq=0 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2034ff9640 1 -- 172.21.15.42:0/936147163 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e73d9cdd70 con 0x55e73dae5c80 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2034ff9640 10 client.16005 handle_command_reply: tid=0 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 client.16005 shutdown 2024-09-19T09:40:30.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 -- 172.21.15.42:0/936147163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 msgr2=0x55e73da73890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da73890 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f20480980c0 tx=0x7f204809a030 comp rx=0 tx=0).stop 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 -- 172.21.15.42:0/936147163 shutdown_connections 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55e73dae5c80 0x55e73dae8070 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e73da6b370 0x55e73da6f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e73da61b40 0x55e73da6ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 --2- 172.21.15.42:0/936147163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e73da605d0 0x55e73da73890 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 -- 172.21.15.42:0/936147163 >> 172.21.15.42:0/936147163 conn(0x55e73da29310 msgr2=0x55e73da67170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2034ff9640 0 client.16005 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 -- 172.21.15.42:0/936147163 shutdown_connections 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 1 -- 172.21.15.42:0/936147163 wait complete. 2024-09-19T09:40:30.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.504+0000 7f2055794740 20 client.16005 trim_cache size 0 max 16384 2024-09-19T09:40:30.518 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:40:30.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 -- 172.21.15.42:0/1770748352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20380a3240 msgr2=0x7f20380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:30.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20380a3240 0x7f20380a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2044005fe0 tx=0x7f20440095c0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 -- 172.21.15.42:0/1770748352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f204c101de0 msgr2=0x7f204c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:30.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f204c101de0 0x7f204c0744f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f204800c970 tx=0x7f204800cd70 comp rx=0 tx=0).stop 2024-09-19T09:40:30.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 -- 172.21.15.42:0/1770748352 shutdown_connections 2024-09-19T09:40:30.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20380a3240 0x7f20380a5700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f204c106f10 0x7f204c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f204c102790 0x7f204c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 --2- 172.21.15.42:0/1770748352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f204c101de0 0x7f204c0744f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:30.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 -- 172.21.15.42:0/1770748352 >> 172.21.15.42:0/1770748352 conn(0x7f204c0fd8c0 msgr2=0x7f204c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:30.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 -- 172.21.15.42:0/1770748352 shutdown_connections 2024-09-19T09:40:30.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:30.505+0000 7f20533bb640 1 -- 172.21.15.42:0/1770748352 wait complete. 2024-09-19T09:40:32.242 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:40:32.242 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:40:32.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:32 smithi171 ceph-mon[35803]: pgmap v373: 97 pgs: 97 active+clean; 693 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T09:40:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:32 smithi136 ceph-mon[34840]: pgmap v373: 97 pgs: 97 active+clean; 693 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T09:40:32.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:32 smithi042 ceph-mon[31223]: pgmap v373: 97 pgs: 97 active+clean; 693 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T09:40:32.514 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:32.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.977+0000 7f03d5107640 1 -- 172.21.15.42:0/1416181701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03d0102d40 msgr2=0x7f03d0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:32.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.977+0000 7f03d5107640 1 --2- 172.21.15.42:0/1416181701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03d0102d40 0x7f03d0103120 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009900 tx=0x7f03c002a480 comp rx=0 tx=0).stop 2024-09-19T09:40:32.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.977+0000 7f03d5107640 1 -- 172.21.15.42:0/1416181701 shutdown_connections 2024-09-19T09:40:32.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.977+0000 7f03d5107640 1 --2- 172.21.15.42:0/1416181701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03d010c170 0x7f03d010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.977+0000 7f03d5107640 1 --2- 172.21.15.42:0/1416181701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d0103660 0x7f03d010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.977+0000 7f03d5107640 1 --2- 172.21.15.42:0/1416181701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03d0102d40 0x7f03d0103120 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.977+0000 7f03d5107640 1 -- 172.21.15.42:0/1416181701 >> 172.21.15.42:0/1416181701 conn(0x7f03d00fc7a0 msgr2=0x7f03d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:32.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.977+0000 7f03d5107640 1 -- 172.21.15.42:0/1416181701 shutdown_connections 2024-09-19T09:40:32.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.977+0000 7f03d5107640 1 -- 172.21.15.42:0/1416181701 wait complete. 2024-09-19T09:40:32.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.978+0000 7f03d5107640 1 Processor -- start 2024-09-19T09:40:32.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.978+0000 7f03d5107640 1 -- start start 2024-09-19T09:40:32.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03d5107640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03d0102d40 0x7f03d01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03d5107640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d0103660 0x7f03d0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03d5107640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03d010c170 0x7f03d0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03d5107640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f03d0111f70 con 0x7f03d0102d40 2024-09-19T09:40:32.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03d5107640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f03d0111df0 con 0x7f03d010c170 2024-09-19T09:40:32.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03d5107640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f03d01120f0 con 0x7f03d0103660 2024-09-19T09:40:32.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03ced9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03d0102d40 0x7f03d01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03ced9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03d0102d40 0x7f03d01009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37248/0 (socket says 172.21.15.42:37248) 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03ced9d640 1 -- 172.21.15.42:0/2012585771 learned_addr learned my addr 172.21.15.42:0/2012585771 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03cf59e640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03d010c170 0x7f03d0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03ce59c640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d0103660 0x7f03d0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03ced9d640 1 -- 172.21.15.42:0/2012585771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d0103660 msgr2=0x7f03d0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d0103660 0x7f03d0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03ced9d640 1 -- 172.21.15.42:0/2012585771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03d010c170 msgr2=0x7f03d0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03d010c170 0x7f03d0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03ced9d640 1 -- 172.21.15.42:0/2012585771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d01a6840 con 0x7f03d0102d40 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03d0102d40 0x7f03d01009a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f03c0005ab0 tx=0x7f03c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.979+0000 7f03b7fff640 1 -- 172.21.15.42:0/2012585771 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c003f030 con 0x7f03d0102d40 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.980+0000 7f03b7fff640 1 -- 172.21.15.42:0/2012585771 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03c0003ce0 con 0x7f03d0102d40 2024-09-19T09:40:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.980+0000 7f03d5107640 1 -- 172.21.15.42:0/2012585771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d01a6ad0 con 0x7f03d0102d40 2024-09-19T09:40:32.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.980+0000 7f03b7fff640 1 -- 172.21.15.42:0/2012585771 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0035070 con 0x7f03d0102d40 2024-09-19T09:40:32.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.980+0000 7f03d5107640 1 -- 172.21.15.42:0/2012585771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d01a6fb0 con 0x7f03d0102d40 2024-09-19T09:40:32.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.982+0000 7f03b7fff640 1 -- 172.21.15.42:0/2012585771 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f03c0042030 con 0x7f03d0102d40 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.982+0000 7f03d74e0740 1 Processor -- start 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.982+0000 7f03d74e0740 1 -- start start 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.982+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x560877507f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.982+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877508480 0x560877512800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.982+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x560877515130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.982+0000 7f03d74e0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56087746d280 con 0x560877507b60 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.982+0000 7f03d74e0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560877414b10 con 0x560877508480 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.982+0000 7f03d74e0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560877469240 con 0x560877512d40 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.982+0000 7f03cf59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x560877507f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03cf59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x560877507f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37256/0 (socket says 172.21.15.42:37256) 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03cf59e640 1 -- 172.21.15.42:0/79842403 learned_addr learned my addr 172.21.15.42:0/79842403 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03ced9d640 1 --2- 172.21.15.42:0/79842403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877508480 0x560877512800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03b7fff640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03b80a3240 0x7f03b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03ce59c640 1 --2- 172.21.15.42:0/79842403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x560877515130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03cf59e640 1 -- 172.21.15.42:0/79842403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 msgr2=0x560877515130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03cf59e640 1 --2- 172.21.15.42:0/79842403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x560877515130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03cf59e640 1 -- 172.21.15.42:0/79842403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877508480 msgr2=0x560877512800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03cf59e640 1 --2- 172.21.15.42:0/79842403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877508480 0x560877512800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03cf59e640 1 -- 172.21.15.42:0/79842403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608774211f0 con 0x560877507b60 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03b7fff640 1 -- 172.21.15.42:0/2012585771 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f03c00f0130 con 0x7f03d0102d40 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03cf59e640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03b80a3240 0x7f03b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03cf59e640 1 --2- 172.21.15.42:0/79842403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x560877507f40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f03c80072e0 tx=0x7f03c800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1288e8f96c22fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03b57fa640 1 -- 172.21.15.42:0/79842403 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8019870 con 0x560877507b60 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03b57fa640 1 -- 172.21.15.42:0/79842403 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03c8010430 con 0x560877507b60 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03b57fa640 1 -- 172.21.15.42:0/79842403 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c801a670 con 0x560877507b60 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.983+0000 7f03cf59e640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03b80a3240 0x7f03b80a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f03c8020000 tx=0x7f03c801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.984+0000 7f03d74e0740 1 -- 172.21.15.42:0/79842403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 msgr2=0x560877507f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.984+0000 7f03d74e0740 1 --2- 172.21.15.42:0/79842403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x560877507f40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f03c80072e0 tx=0x7f03c800f850 comp rx=0 tx=0).stop 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.984+0000 7f03d74e0740 1 -- 172.21.15.42:0/79842403 shutdown_connections 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.984+0000 7f03d74e0740 1 --2- 172.21.15.42:0/79842403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x560877515130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.984+0000 7f03d74e0740 1 --2- 172.21.15.42:0/79842403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877508480 0x560877512800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.984+0000 7f03d74e0740 1 --2- 172.21.15.42:0/79842403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x560877507f40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.984+0000 7f03d74e0740 1 -- 172.21.15.42:0/79842403 >> 172.21.15.42:0/79842403 conn(0x5608775040f0 msgr2=0x5608775044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.984+0000 7f03d74e0740 1 -- 172.21.15.42:0/79842403 shutdown_connections 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.984+0000 7f03d74e0740 1 -- 172.21.15.42:0/79842403 wait complete. 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.984+0000 7f03d74e0740 1 -- start start 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03d74e0740 1 Processor -- start 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 0x56087750fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x5608775100f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x560877510630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03d74e0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560877515910 con 0x560877508480 2024-09-19T09:40:32.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03d74e0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560877427f10 con 0x560877507b60 2024-09-19T09:40:32.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03d74e0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560877515a90 con 0x560877512d40 2024-09-19T09:40:32.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03d74e0740 10 client.0 _ll_register_callbacks cb 0x5608773f0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:32.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03ce59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x5608775100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03ce59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x5608775100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37264/0 (socket says 172.21.15.42:37264) 2024-09-19T09:40:32.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03ce59c640 1 -- 172.21.15.42:0/2431875001 learned_addr learned my addr 172.21.15.42:0/2431875001 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:32.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 0x56087750fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03cf59e640 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x560877510630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03ce59c640 1 -- 172.21.15.42:0/2431875001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 msgr2=0x560877510630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03ce59c640 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x560877510630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03ce59c640 1 -- 172.21.15.42:0/2431875001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 msgr2=0x56087750fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03ce59c640 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 0x56087750fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.985+0000 7f03ce59c640 1 -- 172.21.15.42:0/2431875001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608771de6a0 con 0x560877508480 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03ce59c640 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x5608775100f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f03c4012770 tx=0x7f03c4012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3fab335f048eab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03b2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2431875001 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c401f060 con 0x560877508480 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03d74e0740 1 -- 172.21.15.42:0/2431875001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03c8010430 con 0x560877508480 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2431875001 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f03c401a430 con 0x560877508480 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2431875001 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f03c4010e80 con 0x560877508480 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03d74e0740 10 client.16017 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03d74e0740 1 -- 172.21.15.42:0/2431875001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560877521530 con 0x560877508480 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2431875001 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03c8010430 con 0x560877508480 2024-09-19T09:40:32.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2431875001 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f03c4024540 con 0x560877508480 2024-09-19T09:40:32.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03d74e0740 10 client.16017 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:32.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03d74e0740 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:32.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03d74e0740 20 client.16017 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:32.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560877522a40 0x560877524e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:32.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03d74e0740 4 client.16017 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:32.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.986+0000 7f03d74e0740 1 -- 172.21.15.42:0/2431875001 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56087747a7f0 con 0x560877522a40 2024-09-19T09:40:32.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.987+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560877522a40 0x560877524e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:32.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.987+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560877522a40 0x560877524e60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c037144bbf51946 server_cookie=6b4e6a4a25104db4 in_seq=0 out_seq=0 2024-09-19T09:40:32.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.987+0000 7f03b2ff5640 10 client.16017 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:32.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2431875001 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56087747a7f0 con 0x560877522a40 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03b2ff5640 10 client.16017 handle_command_reply: tid=0 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 client.16017 shutdown 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 -- 172.21.15.42:0/2431875001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 msgr2=0x5608775100f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x5608775100f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f03c4012770 tx=0x7f03c4012c30 comp rx=0 tx=0).stop 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 -- 172.21.15.42:0/2431875001 shutdown_connections 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560877522a40 0x560877524e60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x560877510630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x5608775100f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03b2ff5640 0 client.16017 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2431875001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 0x56087750fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 -- 172.21.15.42:0/2431875001 >> 172.21.15.42:0/2431875001 conn(0x5608775040f0 msgr2=0x560877503270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:32.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 -- 172.21.15.42:0/2431875001 shutdown_connections 2024-09-19T09:40:32.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 1 -- 172.21.15.42:0/2431875001 wait complete. 2024-09-19T09:40:32.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:32.988+0000 7f03d74e0740 20 client.16017 trim_cache size 0 max 16384 2024-09-19T09:40:33.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03d74e0740 1 Processor -- start 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03d74e0740 1 -- start start 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 0x56087750ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x560877510480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x56087752a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03d74e0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f03d01af7a0 con 0x560877508480 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03d74e0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f03d01b12e0 con 0x560877507b60 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03d74e0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f03d01afe70 con 0x560877512d40 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03ce59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x560877510480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03ce59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x560877510480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37266/0 (socket says 172.21.15.42:37266) 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03ce59c640 1 -- 172.21.15.42:0/2485585853 learned_addr learned my addr 172.21.15.42:0/2485585853 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2485585853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 0x56087750ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:33.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.006+0000 7f03cf59e640 1 --2- 172.21.15.42:0/2485585853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x56087752a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:33.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03ce59c640 1 -- 172.21.15.42:0/2485585853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 msgr2=0x56087752a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:33.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03ce59c640 1 --2- 172.21.15.42:0/2485585853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x56087752a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03ce59c640 1 -- 172.21.15.42:0/2485585853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 msgr2=0x56087750ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:33.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03ce59c640 1 --2- 172.21.15.42:0/2485585853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 0x56087750ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03ce59c640 1 -- 172.21.15.42:0/2485585853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560877503f20 con 0x560877508480 2024-09-19T09:40:33.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2485585853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 0x56087750ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:33.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03ce59c640 1 --2- 172.21.15.42:0/2485585853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x560877510480 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f03c4024930 tx=0x7f03c400ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8177a2dda65331 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:33.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03b4ff9640 1 -- 172.21.15.42:0/2485585853 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4024da0 con 0x560877508480 2024-09-19T09:40:33.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03b4ff9640 1 -- 172.21.15.42:0/2485585853 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03c4012020 con 0x560877508480 2024-09-19T09:40:33.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03b4ff9640 1 -- 172.21.15.42:0/2485585853 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4004660 con 0x560877508480 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03d74e0740 1 -- 172.21.15.42:0/2485585853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 msgr2=0x560877510480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.007+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2485585853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x560877510480 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f03c4024930 tx=0x7f03c400ac20 comp rx=0 tx=0).stop 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 -- 172.21.15.42:0/2485585853 shutdown_connections 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2485585853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877512d40 0x56087752a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2485585853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877508480 0x560877510480 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2485585853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877507b60 0x56087750ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 -- 172.21.15.42:0/2485585853 >> 172.21.15.42:0/2485585853 conn(0x5608775040f0 msgr2=0x56087750e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 -- 172.21.15.42:0/2485585853 shutdown_connections 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 -- 172.21.15.42:0/2485585853 wait complete. 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 -- start start 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 Processor -- start 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x56087751b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:33.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877508480 0x5608775168a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877512d40 0x560877516e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f03d01b0c10 con 0x560877507b60 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f03d01b0540 con 0x560877512d40 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f03d01ad780 con 0x560877508480 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03d74e0740 10 client.0 _ll_register_callbacks cb 0x7f03c400a6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03ced9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x56087751b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03ced9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x56087751b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37270/0 (socket says 172.21.15.42:37270) 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.008+0000 7f03ced9d640 1 -- 172.21.15.42:0/2217632352 learned_addr learned my addr 172.21.15.42:0/2217632352 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03ce59c640 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877508480 0x5608775168a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03ced9d640 1 -- 172.21.15.42:0/2217632352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877508480 msgr2=0x5608775168a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877508480 0x5608775168a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03cf59e640 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877512d40 0x560877516e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:33.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03ced9d640 1 -- 172.21.15.42:0/2217632352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877512d40 msgr2=0x560877516e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877512d40 0x560877516e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03ced9d640 1 -- 172.21.15.42:0/2217632352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608775176c0 con 0x560877507b60 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03ced9d640 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x56087751b570 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f03c0006010 tx=0x7f03c00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4764a55ea3b878a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03b2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2217632352 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0049040 con 0x560877507b60 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2217632352 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f03c003bd70 con 0x560877507b60 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03d74e0740 1 -- 172.21.15.42:0/2217632352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03c4012020 con 0x560877507b60 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2217632352 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f03c00bc140 con 0x560877507b60 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03d74e0740 10 client.16023 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03d74e0740 1 -- 172.21.15.42:0/2217632352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56087758d850 con 0x560877507b60 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.009+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2217632352 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03c4012020 con 0x560877507b60 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.010+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2217632352 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f03c003b460 con 0x560877507b60 2024-09-19T09:40:33.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.010+0000 7f03d74e0740 10 client.16023 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.010+0000 7f03d74e0740 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.010+0000 7f03d74e0740 20 client.16023 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.010+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56087758dfa0 0x560877590400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.010+0000 7f03d74e0740 4 client.16023 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.010+0000 7f03d74e0740 1 -- 172.21.15.42:0/2217632352 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560877474d00 con 0x56087758dfa0 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.010+0000 7f03ce59c640 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56087758dfa0 0x560877590400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.010+0000 7f03ce59c640 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56087758dfa0 0x560877590400 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d56cdd3c66b15466 server_cookie=6caaf55464f6dfa3 in_seq=0 out_seq=0 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.010+0000 7f03b2ff5640 10 client.16023 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.011+0000 7f03b2ff5640 1 -- 172.21.15.42:0/2217632352 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560877474d00 con 0x56087758dfa0 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.011+0000 7f03b2ff5640 10 client.16023 handle_command_reply: tid=0 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.011+0000 7f03d74e0740 1 client.16023 shutdown 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 1 -- 172.21.15.42:0/2217632352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 msgr2=0x56087751b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:33.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x56087751b570 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f03c0006010 tx=0x7f03c00045e0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 1 -- 172.21.15.42:0/2217632352 shutdown_connections 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56087758dfa0 0x560877590400 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560877512d40 0x560877516e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560877508480 0x5608775168a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 1 --2- 172.21.15.42:0/2217632352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560877507b60 0x56087751b570 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 1 -- 172.21.15.42:0/2217632352 >> 172.21.15.42:0/2217632352 conn(0x5608775040f0 msgr2=0x56087750eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03b2ff5640 0 client.16023 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 1 -- 172.21.15.42:0/2217632352 shutdown_connections 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 1 -- 172.21.15.42:0/2217632352 wait complete. 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d74e0740 20 client.16023 trim_cache size 0 max 16384 2024-09-19T09:40:33.018 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:40:33.019 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-19T09:40:33.019 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "95395292-9cdd-4a84-a8b6-7a2bebc482a0", 2024-09-19T09:40:33.019 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-19T09:40:33.019 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:40:33.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d5107640 1 -- 172.21.15.42:0/2012585771 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03b80a3240 msgr2=0x7f03b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d5107640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03b80a3240 0x7f03b80a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f03c8020000 tx=0x7f03c801d000 comp rx=0 tx=0).stop 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d5107640 1 -- 172.21.15.42:0/2012585771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03d0102d40 msgr2=0x7f03d01009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d5107640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03d0102d40 0x7f03d01009a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f03c0005ab0 tx=0x7f03c00042f0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d5107640 1 -- 172.21.15.42:0/2012585771 shutdown_connections 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d5107640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f03b80a3240 0x7f03b80a5700 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d5107640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03d010c170 0x7f03d0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d5107640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d0103660 0x7f03d0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d5107640 1 --2- 172.21.15.42:0/2012585771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03d0102d40 0x7f03d01009a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.012+0000 7f03d5107640 1 -- 172.21.15.42:0/2012585771 >> 172.21.15.42:0/2012585771 conn(0x7f03d00fc7a0 msgr2=0x7f03d00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.013+0000 7f03d5107640 1 -- 172.21.15.42:0/2012585771 shutdown_connections 2024-09-19T09:40:33.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:33.013+0000 7f03d5107640 1 -- 172.21.15.42:0/2012585771 wait complete. 2024-09-19T09:40:33.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:40:33.979 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:34 smithi171 ceph-mon[35803]: pgmap v374: 97 pgs: 97 active+clean; 693 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-19T09:40:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:34 smithi171 ceph-mon[35803]: scrub queued for path: / 2024-09-19T09:40:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:34 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:34 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:40:34.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:34 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:34 smithi136 ceph-mon[34840]: pgmap v374: 97 pgs: 97 active+clean; 693 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-19T09:40:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:34 smithi136 ceph-mon[34840]: scrub queued for path: / 2024-09-19T09:40:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:34 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:34 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:40:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:34 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:34.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:34 smithi042 ceph-mon[31223]: pgmap v374: 97 pgs: 97 active+clean; 693 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-19T09:40:34.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:34 smithi042 ceph-mon[31223]: scrub queued for path: / 2024-09-19T09:40:34.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:34 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:34.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:34 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:40:34.400 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:34 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.407+0000 7f4889140640 1 -- 172.21.15.42:0/2048953263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4884101de0 msgr2=0x7f48841021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.407+0000 7f4889140640 1 --2- 172.21.15.42:0/2048953263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4884101de0 0x7f48841021c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4874009900 tx=0x7f487402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.407+0000 7f4889140640 1 -- 172.21.15.42:0/2048953263 shutdown_connections 2024-09-19T09:40:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.407+0000 7f4889140640 1 --2- 172.21.15.42:0/2048953263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4884106f10 0x7f488410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.407+0000 7f4889140640 1 --2- 172.21.15.42:0/2048953263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4884102790 0x7f48841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.407+0000 7f4889140640 1 --2- 172.21.15.42:0/2048953263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4884101de0 0x7f48841021c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.407+0000 7f4889140640 1 -- 172.21.15.42:0/2048953263 >> 172.21.15.42:0/2048953263 conn(0x7f48840fd8c0 msgr2=0x7f48840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.407+0000 7f4889140640 1 -- 172.21.15.42:0/2048953263 shutdown_connections 2024-09-19T09:40:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.407+0000 7f4889140640 1 -- 172.21.15.42:0/2048953263 wait complete. 2024-09-19T09:40:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.408+0000 7f4889140640 1 Processor -- start 2024-09-19T09:40:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.408+0000 7f4889140640 1 -- start start 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f4889140640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4884101de0 0x7f48841983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f4889140640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4884102790 0x7f4884198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f4889140640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4884106f10 0x7f488419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f4889140640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4884111f70 con 0x7f4884106f10 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f4889140640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4884111df0 con 0x7f4884102790 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f4889140640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48841120f0 con 0x7f4884101de0 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f488359e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4884106f10 0x7f488419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f488359e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4884106f10 0x7f488419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37288/0 (socket says 172.21.15.42:37288) 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f488359e640 1 -- 172.21.15.42:0/4070826774 learned_addr learned my addr 172.21.15.42:0/4070826774 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f4882d9d640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4884101de0 0x7f48841983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f488259c640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4884102790 0x7f4884198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f488359e640 1 -- 172.21.15.42:0/4070826774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4884101de0 msgr2=0x7f48841983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f488359e640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4884101de0 0x7f48841983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f488359e640 1 -- 172.21.15.42:0/4070826774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4884102790 msgr2=0x7f4884198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f488359e640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4884102790 0x7f4884198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f488359e640 1 -- 172.21.15.42:0/4070826774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488419d380 con 0x7f4884106f10 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.409+0000 7f488259c640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4884102790 0x7f4884198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.410+0000 7f488359e640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4884106f10 0x7f488419cca0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f487c00cce0 tx=0x7f487c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.410+0000 7f487bfff640 1 -- 172.21.15.42:0/4070826774 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c00f450 con 0x7f4884106f10 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.410+0000 7f487bfff640 1 -- 172.21.15.42:0/4070826774 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f487c00fad0 con 0x7f4884106f10 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.410+0000 7f4889140640 1 -- 172.21.15.42:0/4070826774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488419d670 con 0x7f4884106f10 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.410+0000 7f487bfff640 1 -- 172.21.15.42:0/4070826774 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c018c10 con 0x7f4884106f10 2024-09-19T09:40:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.410+0000 7f4889140640 1 -- 172.21.15.42:0/4070826774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48841a4f50 con 0x7f4884106f10 2024-09-19T09:40:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.412+0000 7f487bfff640 1 -- 172.21.15.42:0/4070826774 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f487c00f5f0 con 0x7f4884106f10 2024-09-19T09:40:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.412+0000 7f488b519740 1 Processor -- start 2024-09-19T09:40:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f488b519740 1 -- start start 2024-09-19T09:40:34.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f488b519740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 0x5640527d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f488b519740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527df550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f488b519740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x5640527e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f488b519740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5640527362e0 con 0x5640527d0ca0 2024-09-19T09:40:34.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f488b519740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5640526ddce0 con 0x5640527dfa90 2024-09-19T09:40:34.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f488b519740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5640527322a0 con 0x5640527d0380 2024-09-19T09:40:34.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f4882d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527df550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f487bfff640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48680a3240 0x7f48680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f4882d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527df550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37300/0 (socket says 172.21.15.42:37300) 2024-09-19T09:40:34.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f4882d9d640 1 -- 172.21.15.42:0/3193679476 learned_addr learned my addr 172.21.15.42:0/3193679476 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f488259c640 1 --2- 172.21.15.42:0/3193679476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 0x5640527d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f488259c640 1 --2- 172.21.15.42:0/3193679476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x5640527e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f487bfff640 1 -- 172.21.15.42:0/4070826774 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f487c0cff60 con 0x7f4884106f10 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.413+0000 7f488359e640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48680a3240 0x7f48680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f488259c640 1 -- 172.21.15.42:0/3193679476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 msgr2=0x5640527e1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f488259c640 1 --2- 172.21.15.42:0/3193679476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x5640527e1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f488259c640 1 -- 172.21.15.42:0/3193679476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 msgr2=0x5640527df550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f488259c640 1 --2- 172.21.15.42:0/3193679476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527df550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f488259c640 1 -- 172.21.15.42:0/3193679476 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640526c2440 con 0x5640527d0380 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f4882d9d640 1 --2- 172.21.15.42:0/3193679476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527df550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f488259c640 1 --2- 172.21.15.42:0/3193679476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 0x5640527d0760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48840fdce0 tx=0x7f487000d360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ebe949269205839 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f488359e640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48680a3240 0x7f48680a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f487c0cda40 tx=0x7f487c091a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f48797fa640 1 -- 172.21.15.42:0/3193679476 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487000a820 con 0x5640527d0380 2024-09-19T09:40:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f48797fa640 1 -- 172.21.15.42:0/3193679476 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48700103d0 con 0x5640527d0380 2024-09-19T09:40:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.414+0000 7f48797fa640 1 -- 172.21.15.42:0/3193679476 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487000f5c0 con 0x5640527d0380 2024-09-19T09:40:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 -- 172.21.15.42:0/3193679476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 msgr2=0x5640527d0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 --2- 172.21.15.42:0/3193679476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 0x5640527d0760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48840fdce0 tx=0x7f487000d360 comp rx=0 tx=0).stop 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 -- 172.21.15.42:0/3193679476 shutdown_connections 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 --2- 172.21.15.42:0/3193679476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x5640527e1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 --2- 172.21.15.42:0/3193679476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527df550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 --2- 172.21.15.42:0/3193679476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 0x5640527d0760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 -- 172.21.15.42:0/3193679476 >> 172.21.15.42:0/3193679476 conn(0x5640527cca30 msgr2=0x5640527cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 -- 172.21.15.42:0/3193679476 shutdown_connections 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 -- 172.21.15.42:0/3193679476 wait complete. 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 -- start start 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.415+0000 7f488b519740 1 Processor -- start 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488b519740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527df3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488b519740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0ca0 0x5640527dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488b519740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x5640527dcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488b519740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5640527e2660 con 0x5640527d0380 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488b519740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5640526f1050 con 0x5640527dfa90 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488b519740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5640527e27e0 con 0x5640527d0ca0 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488b519740 10 client.0 _ll_register_callbacks cb 0x564052731160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527df3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527df3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37304/0 (socket says 172.21.15.42:37304) 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488259c640 1 -- 172.21.15.42:0/775155123 learned_addr learned my addr 172.21.15.42:0/775155123 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f4882d9d640 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0ca0 0x5640527dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488259c640 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x5640527dcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488259c640 1 -- 172.21.15.42:0/775155123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0ca0 msgr2=0x5640527dc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488259c640 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0ca0 0x5640527dc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488259c640 1 -- 172.21.15.42:0/775155123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 msgr2=0x5640527dcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488259c640 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x5640527dcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.416+0000 7f488259c640 1 -- 172.21.15.42:0/775155123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640524a73c0 con 0x5640527d0380 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f488259c640 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527df3b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4870010d90 tx=0x7f48700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae42cbfe8db4f301 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f48667fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f48667fc640 1 -- 172.21.15.42:0/775155123 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870010780 con 0x5640527d0380 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f48667fc640 1 -- 172.21.15.42:0/775155123 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4870010920 con 0x5640527d0380 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f488b519740 1 -- 172.21.15.42:0/775155123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48700103d0 con 0x5640527d0380 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f48667fc640 1 -- 172.21.15.42:0/775155123 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4870030070 con 0x5640527d0380 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f488b519740 10 client.16035 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f488b519740 1 -- 172.21.15.42:0/775155123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640527ee070 con 0x5640527d0380 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f48667fc640 1 -- 172.21.15.42:0/775155123 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48700103d0 con 0x5640527d0380 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f48667fc640 1 -- 172.21.15.42:0/775155123 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f487002c4f0 con 0x5640527d0380 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f488b519740 10 client.16035 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f488b519740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f488b519740 20 client.16035 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f488b519740 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5640527ef3c0 0x5640527f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f488b519740 4 client.16035 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.417+0000 7f488b519740 1 -- 172.21.15.42:0/775155123 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564052743850 con 0x5640527ef3c0 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.418+0000 7f4882d9d640 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5640527ef3c0 0x5640527f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.418+0000 7f48667fc640 10 client.16035 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.418+0000 7f4882d9d640 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5640527ef3c0 0x5640527f17b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5dea20e3f4baf8f server_cookie=8d0d91e53796b76c in_seq=0 out_seq=0 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f48667fc640 1 -- 172.21.15.42:0/775155123 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564052743850 con 0x5640527ef3c0 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f48667fc640 10 client.16035 handle_command_reply: tid=0 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 client.16035 shutdown 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 -- 172.21.15.42:0/775155123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 msgr2=0x5640527df3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527df3b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4870010d90 tx=0x7f48700046c0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 -- 172.21.15.42:0/775155123 shutdown_connections 2024-09-19T09:40:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5640527ef3c0 0x5640527f17b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x5640527dcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0ca0 0x5640527dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 --2- 172.21.15.42:0/775155123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527df3b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 -- 172.21.15.42:0/775155123 >> 172.21.15.42:0/775155123 conn(0x5640527cca30 msgr2=0x5640527d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f48667fc640 0 client.16035 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 -- 172.21.15.42:0/775155123 shutdown_connections 2024-09-19T09:40:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 1 -- 172.21.15.42:0/775155123 wait complete. 2024-09-19T09:40:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.419+0000 7f488b519740 20 client.16035 trim_cache size 0 max 16384 2024-09-19T09:40:34.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.437+0000 7f488b519740 1 Processor -- start 2024-09-19T09:40:34.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.437+0000 7f488b519740 1 -- start start 2024-09-19T09:40:34.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.437+0000 7f488b519740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527eb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.437+0000 7f488b519740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527d0ca0 0x5640527dbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.437+0000 7f488b519740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527dfa90 0x5640527cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.437+0000 7f488b519740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f48841ab3e0 con 0x5640527d0380 2024-09-19T09:40:34.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.437+0000 7f488b519740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f48841acf20 con 0x5640527d0ca0 2024-09-19T09:40:34.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.437+0000 7f488b519740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48841abab0 con 0x5640527dfa90 2024-09-19T09:40:34.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.437+0000 7f488259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f488259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527eb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37312/0 (socket says 172.21.15.42:37312) 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f488259c640 1 -- 172.21.15.42:0/2965816144 learned_addr learned my addr 172.21.15.42:0/2965816144 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f4882d9d640 1 --2- 172.21.15.42:0/2965816144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527d0ca0 0x5640527dbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f488259c640 1 -- 172.21.15.42:0/2965816144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527dfa90 msgr2=0x5640527cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f488259c640 1 --2- 172.21.15.42:0/2965816144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527dfa90 0x5640527cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f488259c640 1 -- 172.21.15.42:0/2965816144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527d0ca0 msgr2=0x5640527dbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f488259c640 1 --2- 172.21.15.42:0/2965816144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527d0ca0 0x5640527dbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f488259c640 1 -- 172.21.15.42:0/2965816144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640527cc4d0 con 0x5640527d0380 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f488259c640 1 --2- 172.21.15.42:0/2965816144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527eb900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f487000dbd0 tx=0x7f4870012710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafbb322796fd02c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f4878ff9640 1 -- 172.21.15.42:0/2965816144 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487000d800 con 0x5640527d0380 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f4878ff9640 1 -- 172.21.15.42:0/2965816144 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f487002c590 con 0x5640527d0380 2024-09-19T09:40:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.438+0000 7f4878ff9640 1 -- 172.21.15.42:0/2965816144 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700053a0 con 0x5640527d0380 2024-09-19T09:40:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 -- 172.21.15.42:0/2965816144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 msgr2=0x5640527eb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 --2- 172.21.15.42:0/2965816144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527eb900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f487000dbd0 tx=0x7f4870012710 comp rx=0 tx=0).stop 2024-09-19T09:40:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 -- 172.21.15.42:0/2965816144 shutdown_connections 2024-09-19T09:40:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 --2- 172.21.15.42:0/2965816144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527dfa90 0x5640527cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 --2- 172.21.15.42:0/2965816144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527d0ca0 0x5640527dbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 --2- 172.21.15.42:0/2965816144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0380 0x5640527eb900 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 -- 172.21.15.42:0/2965816144 >> 172.21.15.42:0/2965816144 conn(0x5640527cca30 msgr2=0x5640527cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 -- 172.21.15.42:0/2965816144 shutdown_connections 2024-09-19T09:40:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 -- 172.21.15.42:0/2965816144 wait complete. 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 -- start start 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.439+0000 7f488b519740 1 Processor -- start 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488b519740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 0x5640527e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488b519740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527e30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488b519740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x564052857e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488b519740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f48841ac850 con 0x5640527d0ca0 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488b519740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f48841ac180 con 0x5640527dfa90 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488b519740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48841a93c0 con 0x5640527d0380 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488b519740 10 client.0 _ll_register_callbacks cb 0x7f48740314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f4882d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527e30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f4882d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527e30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37320/0 (socket says 172.21.15.42:37320) 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f4882d9d640 1 -- 172.21.15.42:0/3750993621 learned_addr learned my addr 172.21.15.42:0/3750993621 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488259c640 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x564052857e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488259c640 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 0x5640527e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f4882d9d640 1 -- 172.21.15.42:0/3750993621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 msgr2=0x5640527e2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f4882d9d640 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 0x5640527e2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f4882d9d640 1 -- 172.21.15.42:0/3750993621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 msgr2=0x564052857e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f4882d9d640 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x564052857e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f4882d9d640 1 -- 172.21.15.42:0/3750993621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640527d2ec0 con 0x5640527d0ca0 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488259c640 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 0x5640527e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f4882d9d640 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527e30f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4874009900 tx=0x7f4874031b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93c61a711700e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f48667fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f48667fc640 1 -- 172.21.15.42:0/3750993621 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874035040 con 0x5640527d0ca0 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f48667fc640 1 -- 172.21.15.42:0/3750993621 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f48740035f0 con 0x5640527d0ca0 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.440+0000 7f488b519740 1 -- 172.21.15.42:0/3750993621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f487002c590 con 0x5640527d0ca0 2024-09-19T09:40:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f48667fc640 1 -- 172.21.15.42:0/3750993621 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4874056070 con 0x5640527d0ca0 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f488b519740 10 client.16041 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f488b519740 1 -- 172.21.15.42:0/3750993621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564052859390 con 0x5640527d0ca0 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f48667fc640 1 -- 172.21.15.42:0/3750993621 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f487002c590 con 0x5640527d0ca0 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f48667fc640 1 -- 172.21.15.42:0/3750993621 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f487404f030 con 0x5640527d0ca0 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f488b519740 10 client.16041 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f488b519740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f488b519740 20 client.16041 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f488b519740 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x564052859af0 0x56405285bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f488b519740 4 client.16041 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.441+0000 7f488b519740 1 -- 172.21.15.42:0/3750993621 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56405273dd60 con 0x564052859af0 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488259c640 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x564052859af0 0x56405285bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f48667fc640 10 client.16041 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488259c640 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x564052859af0 0x56405285bf10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75964515e2cbfb38 server_cookie=d650f95ce3061835 in_seq=0 out_seq=0 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f48667fc640 1 -- 172.21.15.42:0/3750993621 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56405273dd60 con 0x564052859af0 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f48667fc640 10 client.16041 handle_command_reply: tid=0 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488b519740 1 client.16041 shutdown 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488b519740 1 -- 172.21.15.42:0/3750993621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 msgr2=0x5640527e30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488b519740 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527e30f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4874009900 tx=0x7f4874031b40 comp rx=0 tx=0).stop 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488b519740 1 -- 172.21.15.42:0/3750993621 shutdown_connections 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488b519740 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x564052859af0 0x56405285bf10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488b519740 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640527dfa90 0x564052857e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488b519740 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5640527d0ca0 0x5640527e30f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488b519740 1 --2- 172.21.15.42:0/3750993621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5640527d0380 0x5640527e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f488b519740 1 -- 172.21.15.42:0/3750993621 >> 172.21.15.42:0/3750993621 conn(0x5640527cca30 msgr2=0x5640527d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.442+0000 7f48667fc640 0 client.16041 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f488b519740 1 -- 172.21.15.42:0/3750993621 shutdown_connections 2024-09-19T09:40:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f488b519740 1 -- 172.21.15.42:0/3750993621 wait complete. 2024-09-19T09:40:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f488b519740 20 client.16041 trim_cache size 0 max 16384 2024-09-19T09:40:34.450 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:40:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:40:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-19T09:40:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: "95395292-9cdd-4a84-a8b6-7a2bebc482a0": { 2024-09-19T09:40:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-19T09:40:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "95395292-9cdd-4a84-a8b6-7a2bebc482a0", 2024-09-19T09:40:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-09-19T09:40:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:34.451 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:40:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 -- 172.21.15.42:0/4070826774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48680a3240 msgr2=0x7f48680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48680a3240 0x7f48680a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f487c0cda40 tx=0x7f487c091a40 comp rx=0 tx=0).stop 2024-09-19T09:40:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 -- 172.21.15.42:0/4070826774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4884106f10 msgr2=0x7f488419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4884106f10 0x7f488419cca0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f487c00cce0 tx=0x7f487c00a620 comp rx=0 tx=0).stop 2024-09-19T09:40:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 -- 172.21.15.42:0/4070826774 shutdown_connections 2024-09-19T09:40:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48680a3240 0x7f48680a5700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4884106f10 0x7f488419cca0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4884102790 0x7f4884198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 --2- 172.21.15.42:0/4070826774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4884101de0 0x7f48841983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 -- 172.21.15.42:0/4070826774 >> 172.21.15.42:0/4070826774 conn(0x7f48840fd8c0 msgr2=0x7f48840febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 -- 172.21.15.42:0/4070826774 shutdown_connections 2024-09-19T09:40:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:34.443+0000 7f4889140640 1 -- 172.21.15.42:0/4070826774 wait complete. 2024-09-19T09:40:35.207 INFO:tasks.cephfs.filesystem:scrub status for tag:95395292-9cdd-4a84-a8b6-7a2bebc482a0 - {'path': '/', 'tag': '95395292-9cdd-4a84-a8b6-7a2bebc482a0', 'options': 'recursive,force'} 2024-09-19T09:40:36.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:36 smithi136 ceph-mon[34840]: pgmap v375: 97 pgs: 97 active+clean; 703 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-09-19T09:40:36.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:36 smithi042 ceph-mon[31223]: pgmap v375: 97 pgs: 97 active+clean; 703 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-09-19T09:40:36.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:36 smithi171 ceph-mon[35803]: pgmap v375: 97 pgs: 97 active+clean; 703 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-09-19T09:40:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:37 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:40:37.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:37 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:40:37.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:37 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:40:38.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:38 smithi136 ceph-mon[34840]: pgmap v376: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-19T09:40:38.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:38 smithi042 ceph-mon[31223]: pgmap v376: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-19T09:40:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.482+0000 7f8d00152640 1 -- 172.21.15.42:0/4013940182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf8100a40 msgr2=0x7f8cf8100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.482+0000 7f8d00152640 1 --2- 172.21.15.42:0/4013940182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf8100a40 0x7f8cf8100e40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009900 tx=0x7f8cf402a410 comp rx=0 tx=0).stop 2024-09-19T09:40:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.482+0000 7f8d00152640 1 -- 172.21.15.42:0/4013940182 shutdown_connections 2024-09-19T09:40:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.482+0000 7f8d00152640 1 --2- 172.21.15.42:0/4013940182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cf81025f0 0x7f8cf8108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.482+0000 7f8d00152640 1 --2- 172.21.15.42:0/4013940182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101c30 0x7f8cf81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.482+0000 7f8d00152640 1 --2- 172.21.15.42:0/4013940182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf8100a40 0x7f8cf8100e40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.482+0000 7f8d00152640 1 -- 172.21.15.42:0/4013940182 >> 172.21.15.42:0/4013940182 conn(0x7f8cf80fc1e0 msgr2=0x7f8cf80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.482+0000 7f8d00152640 1 -- 172.21.15.42:0/4013940182 shutdown_connections 2024-09-19T09:40:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.482+0000 7f8d00152640 1 -- 172.21.15.42:0/4013940182 wait complete. 2024-09-19T09:40:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8d00152640 1 Processor -- start 2024-09-19T09:40:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8d00152640 1 -- start start 2024-09-19T09:40:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8d00152640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf8100a40 0x7f8cf8197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8d00152640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101c30 0x7f8cf8198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8d00152640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cf81025f0 0x7f8cf819f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8d00152640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf810c6c0 con 0x7f8cf8100a40 2024-09-19T09:40:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8d00152640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf810c540 con 0x7f8cf8101c30 2024-09-19T09:40:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8d00152640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf810c840 con 0x7f8cf81025f0 2024-09-19T09:40:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8cfdeee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf8100a40 0x7f8cf8197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8cfdeee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf8100a40 0x7f8cf8197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37342/0 (socket says 172.21.15.42:37342) 2024-09-19T09:40:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8cfdeee640 1 -- 172.21.15.42:0/3107103331 learned_addr learned my addr 172.21.15.42:0/3107103331 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8cfe6ef640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cf81025f0 0x7f8cf819f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8cfd6ed640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101c30 0x7f8cf8198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8cfdeee640 1 -- 172.21.15.42:0/3107103331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cf81025f0 msgr2=0x7f8cf819f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cf81025f0 0x7f8cf819f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8cfdeee640 1 -- 172.21.15.42:0/3107103331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101c30 msgr2=0x7f8cf8198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101c30 0x7f8cf8198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.483+0000 7f8cfdeee640 1 -- 172.21.15.42:0/3107103331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf819fa30 con 0x7f8cf8100a40 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.484+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf8100a40 0x7f8cf8197e10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4031610 tx=0x7f8cf40043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.484+0000 7f8ceeffd640 1 -- 172.21.15.42:0/3107103331 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf403f030 con 0x7f8cf8100a40 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.484+0000 7f8ceeffd640 1 -- 172.21.15.42:0/3107103331 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cf4003ce0 con 0x7f8cf8100a40 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.484+0000 7f8d00152640 1 -- 172.21.15.42:0/3107103331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf819fcc0 con 0x7f8cf8100a40 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.484+0000 7f8ceeffd640 1 -- 172.21.15.42:0/3107103331 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4035070 con 0x7f8cf8100a40 2024-09-19T09:40:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.484+0000 7f8d00152640 1 -- 172.21.15.42:0/3107103331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf81a01b0 con 0x7f8cf8100a40 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.486+0000 7f8ceeffd640 1 -- 172.21.15.42:0/3107103331 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8cf4042030 con 0x7f8cf8100a40 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.486+0000 7f8d02fbf740 1 Processor -- start 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8d02fbf740 1 -- start start 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da69a0 0x5560c1da6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1dabda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 0x5560c1dae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5560c1d0a2f0 con 0x5560c1da72e0 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5560c1cb2270 con 0x5560c1dac370 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5560c1d062b0 con 0x5560c1da69a0 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfdeee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1dabda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfdeee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1dabda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37358/0 (socket says 172.21.15.42:37358) 2024-09-19T09:40:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfdeee640 1 -- 172.21.15.42:0/1064670010 learned_addr learned my addr 172.21.15.42:0/1064670010 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfe6ef640 1 --2- 172.21.15.42:0/1064670010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da69a0 0x5560c1da6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfd6ed640 1 --2- 172.21.15.42:0/1064670010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 0x5560c1dae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8ceeffd640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8ce40a32f0 0x7f8ce40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfdeee640 1 -- 172.21.15.42:0/1064670010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da69a0 msgr2=0x5560c1da6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/1064670010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da69a0 0x5560c1da6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfdeee640 1 -- 172.21.15.42:0/1064670010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 msgr2=0x5560c1dae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/1064670010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 0x5560c1dae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfdeee640 1 -- 172.21.15.42:0/1064670010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c1cb1340 con 0x5560c1da72e0 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.487+0000 7f8cfd6ed640 1 --2- 172.21.15.42:0/1064670010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 0x5560c1dae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.488+0000 7f8cfe6ef640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8ce40a32f0 0x7f8ce40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.488+0000 7f8ceeffd640 1 -- 172.21.15.42:0/3107103331 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8cf40efed0 con 0x7f8cf8100a40 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.488+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/1064670010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1dabda0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40acb70 tx=0x7f8cf4086f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16066cf3a79c7121 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.488+0000 7f8ce3fff640 1 -- 172.21.15.42:0/1064670010 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40bbe30 con 0x5560c1da72e0 2024-09-19T09:40:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.488+0000 7f8ce3fff640 1 -- 172.21.15.42:0/1064670010 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cf40bcbd0 con 0x5560c1da72e0 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.488+0000 7f8ce3fff640 1 -- 172.21.15.42:0/1064670010 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40bc4d0 con 0x5560c1da72e0 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1064670010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 msgr2=0x5560c1dabda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1064670010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1dabda0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40acb70 tx=0x7f8cf4086f10 comp rx=0 tx=0).stop 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8cfe6ef640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8ce40a32f0 0x7f8ce40a57b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00098b0 tx=0x7f8cf0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1064670010 shutdown_connections 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1064670010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 0x5560c1dae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1064670010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1dabda0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1064670010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da69a0 0x5560c1da6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1064670010 >> 172.21.15.42:0/1064670010 conn(0x5560c1da2010 msgr2=0x5560c1da2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1064670010 shutdown_connections 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1064670010 wait complete. 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 -- start start 2024-09-19T09:40:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.489+0000 7f8d02fbf740 1 Processor -- start 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1da69a0 0x5560c1db08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da72e0 0x5560c1db0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1dac370 0x5560c1db7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5560c1daf100 con 0x5560c1dac370 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5560c1c93290 con 0x5560c1da69a0 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5560c1daf280 con 0x5560c1da72e0 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8d02fbf740 10 client.0 _ll_register_callbacks cb 0x5560c1cc4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8cfe6ef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1dac370 0x5560c1db7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8cfe6ef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1dac370 0x5560c1db7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37374/0 (socket says 172.21.15.42:37374) 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8cfe6ef640 1 -- 172.21.15.42:0/1170543834 learned_addr learned my addr 172.21.15.42:0/1170543834 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8cfd6ed640 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da72e0 0x5560c1db0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1da69a0 0x5560c1db08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8cfe6ef640 1 -- 172.21.15.42:0/1170543834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da72e0 msgr2=0x5560c1db0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8cfe6ef640 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da72e0 0x5560c1db0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8cfe6ef640 1 -- 172.21.15.42:0/1170543834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1da69a0 msgr2=0x5560c1db08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8cfe6ef640 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1da69a0 0x5560c1db08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.490+0000 7f8cfe6ef640 1 -- 172.21.15.42:0/1170543834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c1a1d210 con 0x5560c1dac370 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8cfe6ef640 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1dac370 0x5560c1db7db0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009a70 tx=0x7f8cf0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2a7001bb978040 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8ce17fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8ce17fa640 1 -- 172.21.15.42:0/1170543834 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf001ed70 con 0x5560c1dac370 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8ce17fa640 1 -- 172.21.15.42:0/1170543834 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8cf0028470 con 0x5560c1dac370 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1170543834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cf40bcbd0 con 0x5560c1dac370 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8ce17fa640 1 -- 172.21.15.42:0/1170543834 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8cf0028670 con 0x5560c1dac370 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8d02fbf740 10 client.16053 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1170543834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560c1ae9620 con 0x5560c1dac370 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8ce17fa640 1 -- 172.21.15.42:0/1170543834 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cf40bcbd0 con 0x5560c1dac370 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8ce17fa640 1 -- 172.21.15.42:0/1170543834 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8cf000f040 con 0x5560c1dac370 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8d02fbf740 10 client.16053 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8d02fbf740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8d02fbf740 20 client.16053 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5560c1dbc550 0x5560c1dbe9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8d02fbf740 4 client.16053 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.491+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1170543834 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560c1d17a20 con 0x5560c1dbc550 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.492+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5560c1dbc550 0x5560c1dbe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.492+0000 7f8ce17fa640 10 client.16053 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.492+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5560c1dbc550 0x5560c1dbe9a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fb6b7774ab3e349 server_cookie=792f8045d660aac9 in_seq=0 out_seq=0 2024-09-19T09:40:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8ce17fa640 1 -- 172.21.15.42:0/1170543834 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560c1d17a20 con 0x5560c1dbc550 2024-09-19T09:40:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8ce17fa640 10 client.16053 handle_command_reply: tid=0 2024-09-19T09:40:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 client.16053 shutdown 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1170543834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1dac370 msgr2=0x5560c1db7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1dac370 0x5560c1db7db0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009a70 tx=0x7f8cf0004ab0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1170543834 shutdown_connections 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5560c1dbc550 0x5560c1dbe9a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1dac370 0x5560c1db7db0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da72e0 0x5560c1db0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1170543834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1da69a0 0x5560c1db08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8ce17fa640 0 client.16053 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1170543834 >> 172.21.15.42:0/1170543834 conn(0x5560c1da2010 msgr2=0x5560c1da3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1170543834 shutdown_connections 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1170543834 wait complete. 2024-09-19T09:40:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.493+0000 7f8d02fbf740 20 client.16053 trim_cache size 0 max 16384 2024-09-19T09:40:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8d02fbf740 1 Processor -- start 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8d02fbf740 1 -- start start 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da69a0 0x5560c1da2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1da72e0 0x5560c1da3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1dac370 0x5560c1da3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81a90a0 con 0x5560c1da69a0 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81aabe0 con 0x5560c1da72e0 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81a9770 con 0x5560c1dac370 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8cfdeee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da69a0 0x5560c1da2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8cfdeee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da69a0 0x5560c1da2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37388/0 (socket says 172.21.15.42:37388) 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.508+0000 7f8cfdeee640 1 -- 172.21.15.42:0/1119528207 learned_addr learned my addr 172.21.15.42:0/1119528207 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8cfdeee640 1 -- 172.21.15.42:0/1119528207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1dac370 msgr2=0x5560c1da3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/1119528207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1dac370 0x5560c1da3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8cfdeee640 1 -- 172.21.15.42:0/1119528207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1da72e0 msgr2=0x5560c1da3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8cfd6ed640 1 --2- 172.21.15.42:0/1119528207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1da72e0 0x5560c1da3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/1119528207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1da72e0 0x5560c1da3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8cfdeee640 1 -- 172.21.15.42:0/1119528207 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c1db8160 con 0x5560c1da69a0 2024-09-19T09:40:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/1119528207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da69a0 0x5560c1da2ec0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40bc1d0 tx=0x7f8cf40b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1e138538af660c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8ce37fe640 1 -- 172.21.15.42:0/1119528207 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4049040 con 0x5560c1da69a0 2024-09-19T09:40:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8ce37fe640 1 -- 172.21.15.42:0/1119528207 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cf40bcbd0 con 0x5560c1da69a0 2024-09-19T09:40:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8ce37fe640 1 -- 172.21.15.42:0/1119528207 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40c5140 con 0x5560c1da69a0 2024-09-19T09:40:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1119528207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da69a0 msgr2=0x5560c1da2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.509+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1119528207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da69a0 0x5560c1da2ec0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40bc1d0 tx=0x7f8cf40b8040 comp rx=0 tx=0).stop 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1119528207 shutdown_connections 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1119528207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1dac370 0x5560c1da3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1119528207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1da72e0 0x5560c1da3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/1119528207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da69a0 0x5560c1da2ec0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1119528207 >> 172.21.15.42:0/1119528207 conn(0x5560c1da2010 msgr2=0x5560c1db08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1119528207 shutdown_connections 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 -- 172.21.15.42:0/1119528207 wait complete. 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 -- start start 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 Processor -- start 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da69a0 0x5560c1e22b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1e23060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 0x5560c1e2a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81aa510 con 0x5560c1da72e0 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81a9e40 con 0x5560c1dac370 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81a7080 con 0x5560c1da69a0 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.510+0000 7f8d02fbf740 10 client.0 _ll_register_callbacks cb 0x7f8cf0009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfd6ed640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1e23060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfd6ed640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1e23060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37402/0 (socket says 172.21.15.42:37402) 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfd6ed640 1 -- 172.21.15.42:0/2245091533 learned_addr learned my addr 172.21.15.42:0/2245091533 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfe6ef640 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 0x5560c1e2a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da69a0 0x5560c1e22b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfd6ed640 1 -- 172.21.15.42:0/2245091533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da69a0 msgr2=0x5560c1e22b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfd6ed640 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da69a0 0x5560c1e22b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfd6ed640 1 -- 172.21.15.42:0/2245091533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 msgr2=0x5560c1e2a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfd6ed640 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 0x5560c1e2a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfd6ed640 1 -- 172.21.15.42:0/2245091533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c1e2a6b0 con 0x5560c1da72e0 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfe6ef640 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 0x5560c1e2a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8cfd6ed640 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1e23060 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8199320 tx=0x7f8ce800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cdaf81564401c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8ce17fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8ce17fa640 1 -- 172.21.15.42:0/2245091533 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8004240 con 0x5560c1da72e0 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8ce17fa640 1 -- 172.21.15.42:0/2245091533 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8ce80043e0 con 0x5560c1da72e0 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8d02fbf740 1 -- 172.21.15.42:0/2245091533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cf40bcbd0 con 0x5560c1da72e0 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8ce17fa640 1 -- 172.21.15.42:0/2245091533 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ce80035f0 con 0x5560c1da72e0 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8d02fbf740 10 client.16059 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.511+0000 7f8d02fbf740 1 -- 172.21.15.42:0/2245091533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560c1e2bac0 con 0x5560c1da72e0 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.512+0000 7f8ce17fa640 1 -- 172.21.15.42:0/2245091533 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cf40bcbd0 con 0x5560c1da72e0 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.512+0000 7f8ce17fa640 1 -- 172.21.15.42:0/2245091533 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8ce8027aa0 con 0x5560c1da72e0 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.512+0000 7f8d02fbf740 10 client.16059 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.512+0000 7f8d02fbf740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.512+0000 7f8d02fbf740 20 client.16059 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.512+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5560c1e2c4d0 0x5560c1e2e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.512+0000 7f8d02fbf740 4 client.16059 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:40:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.512+0000 7f8d02fbf740 1 -- 172.21.15.42:0/2245091533 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5560c1d11d70 con 0x5560c1e2c4d0 2024-09-19T09:40:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.512+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5560c1e2c4d0 0x5560c1e2e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.513+0000 7f8ce17fa640 10 client.16059 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.513+0000 7f8cfdeee640 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5560c1e2c4d0 0x5560c1e2e8f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e43f507a607f6d86 server_cookie=e2d979335be5dc91 in_seq=0 out_seq=0 2024-09-19T09:40:38.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8ce17fa640 1 -- 172.21.15.42:0/2245091533 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5560c1d11d70 con 0x5560c1e2c4d0 2024-09-19T09:40:38.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8ce17fa640 10 client.16059 handle_command_reply: tid=0 2024-09-19T09:40:38.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 client.16059 shutdown 2024-09-19T09:40:38.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 -- 172.21.15.42:0/2245091533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 msgr2=0x5560c1e23060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:38.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1e23060 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8199320 tx=0x7f8ce800bf90 comp rx=0 tx=0).stop 2024-09-19T09:40:38.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 -- 172.21.15.42:0/2245091533 shutdown_connections 2024-09-19T09:40:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5560c1e2c4d0 0x5560c1e2e8f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560c1dac370 0x5560c1e2a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5560c1da72e0 0x5560c1e23060 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 --2- 172.21.15.42:0/2245091533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c1da69a0 0x5560c1e22b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8ce17fa640 0 client.16059 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 -- 172.21.15.42:0/2245091533 >> 172.21.15.42:0/2245091533 conn(0x5560c1da2010 msgr2=0x5560c1da09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 -- 172.21.15.42:0/2245091533 shutdown_connections 2024-09-19T09:40:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.524+0000 7f8d02fbf740 1 -- 172.21.15.42:0/2245091533 wait complete. 2024-09-19T09:40:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d02fbf740 20 client.16059 trim_cache size 0 max 16384 2024-09-19T09:40:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:40:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:40:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:40:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:40:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 -- 172.21.15.42:0/3107103331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8ce40a32f0 msgr2=0x7f8ce40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8ce40a32f0 0x7f8ce40a57b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00098b0 tx=0x7f8cf0004a40 comp rx=0 tx=0).stop 2024-09-19T09:40:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 -- 172.21.15.42:0/3107103331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf8100a40 msgr2=0x7f8cf8197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf8100a40 0x7f8cf8197e10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4031610 tx=0x7f8cf40043b0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 -- 172.21.15.42:0/3107103331 shutdown_connections 2024-09-19T09:40:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8ce40a32f0 0x7f8ce40a57b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cf81025f0 0x7f8cf819f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf8101c30 0x7f8cf8198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 --2- 172.21.15.42:0/3107103331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf8100a40 0x7f8cf8197e10 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 -- 172.21.15.42:0/3107103331 >> 172.21.15.42:0/3107103331 conn(0x7f8cf80fc1e0 msgr2=0x7f8cf80fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 -- 172.21.15.42:0/3107103331 shutdown_connections 2024-09-19T09:40:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:38.525+0000 7f8d00152640 1 -- 172.21.15.42:0/3107103331 wait complete. 2024-09-19T09:40:38.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:38 smithi171 ceph-mon[35803]: pgmap v376: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-19T09:40:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:40 smithi136 ceph-mon[34840]: pgmap v377: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-19T09:40:40.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:40 smithi042 ceph-mon[31223]: pgmap v377: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-19T09:40:40.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:40 smithi171 ceph-mon[35803]: pgmap v377: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-19T09:40:41.355 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:40:41.628 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:42.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.063+0000 7fc61182b640 1 -- 172.21.15.42:0/3758848857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc60c1055b0 msgr2=0x7fc60c10d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:42.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.063+0000 7fc61182b640 1 --2- 172.21.15.42:0/3758848857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc60c1055b0 0x7fc60c10d130 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc60400aa10 tx=0x7fc60402b720 comp rx=0 tx=0).stop 2024-09-19T09:40:42.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.064+0000 7fc61182b640 1 -- 172.21.15.42:0/3758848857 shutdown_connections 2024-09-19T09:40:42.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.064+0000 7fc61182b640 1 --2- 172.21.15.42:0/3758848857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc60c1055b0 0x7fc60c10d130 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:42.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.064+0000 7fc61182b640 1 --2- 172.21.15.42:0/3758848857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c100e30 0x7fc60c104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.064+0000 7fc61182b640 1 --2- 172.21.15.42:0/3758848857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc60c100480 0x7fc60c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.064+0000 7fc61182b640 1 -- 172.21.15.42:0/3758848857 >> 172.21.15.42:0/3758848857 conn(0x7fc60c077210 msgr2=0x7fc60c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.064+0000 7fc61182b640 1 -- 172.21.15.42:0/3758848857 shutdown_connections 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.064+0000 7fc61182b640 1 -- 172.21.15.42:0/3758848857 wait complete. 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.064+0000 7fc61182b640 1 Processor -- start 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc61182b640 1 -- start start 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc61182b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c100480 0x7fc60c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc61182b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc60c100e30 0x7fc60c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc61182b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc60c1055b0 0x7fc60c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc61182b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c10fd90 con 0x7fc60c100e30 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc61182b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c10fc10 con 0x7fc60c100480 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc61182b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c10ff10 con 0x7fc60c1055b0 2024-09-19T09:40:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc60a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc60c100e30 0x7fc60c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc60a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc60c100e30 0x7fc60c198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37536/0 (socket says 172.21.15.42:37536) 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc60a7fc640 1 -- 172.21.15.42:0/1145339586 learned_addr learned my addr 172.21.15.42:0/1145339586 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc60affd640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c100480 0x7fc60c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc60b7fe640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc60c1055b0 0x7fc60c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc60a7fc640 1 -- 172.21.15.42:0/1145339586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc60c1055b0 msgr2=0x7fc60c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc60a7fc640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc60c1055b0 0x7fc60c19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc60a7fc640 1 -- 172.21.15.42:0/1145339586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c100480 msgr2=0x7fc60c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc60a7fc640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c100480 0x7fc60c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.065+0000 7fc60a7fc640 1 -- 172.21.15.42:0/1145339586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c19d400 con 0x7fc60c100e30 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.066+0000 7fc60a7fc640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc60c100e30 0x7fc60c198990 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc60000d950 tx=0x7fc60000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.066+0000 7fc610829640 1 -- 172.21.15.42:0/1145339586 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600017070 con 0x7fc60c100e30 2024-09-19T09:40:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.066+0000 7fc61182b640 1 -- 172.21.15.42:0/1145339586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60c19d6f0 con 0x7fc60c100e30 2024-09-19T09:40:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.066+0000 7fc610829640 1 -- 172.21.15.42:0/1145339586 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc600009c30 con 0x7fc60c100e30 2024-09-19T09:40:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.066+0000 7fc610829640 1 -- 172.21.15.42:0/1145339586 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60000f6b0 con 0x7fc60c100e30 2024-09-19T09:40:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.066+0000 7fc61182b640 1 -- 172.21.15.42:0/1145339586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60c1a4fd0 con 0x7fc60c100e30 2024-09-19T09:40:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.067+0000 7fc61182b640 1 -- 172.21.15.42:0/1145339586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60c100860 con 0x7fc60c100e30 2024-09-19T09:40:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.068+0000 7fc610829640 1 -- 172.21.15.42:0/1145339586 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fc6000109d0 con 0x7fc60c100e30 2024-09-19T09:40:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.069+0000 7fc610829640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f40a3240 0x7fc5f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.069+0000 7fc60affd640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f40a3240 0x7fc5f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.069+0000 7fc610829640 1 -- 172.21.15.42:0/1145339586 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc6000cf450 con 0x7fc60c100e30 2024-09-19T09:40:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.069+0000 7fc60affd640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f40a3240 0x7fc5f40a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc005c40 tx=0x7fc5fc00a570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:42.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.073+0000 7fc610829640 1 -- 172.21.15.42:0/1145339586 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc600009de0 con 0x7fc60c100e30 2024-09-19T09:40:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.286+0000 7fc61182b640 1 -- 172.21.15.42:0/1145339586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc60c10a270 con 0x7fc60c100e30 2024-09-19T09:40:42.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.286+0000 7fc610829640 1 -- 172.21.15.42:0/1145339586 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7fc60009bb00 con 0x7fc60c100e30 2024-09-19T09:40:42.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:40:42.289 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:40:42.289 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:40:42.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.288+0000 7fc61182b640 1 -- 172.21.15.42:0/1145339586 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f40a3240 msgr2=0x7fc5f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.288+0000 7fc61182b640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f40a3240 0x7fc5f40a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc005c40 tx=0x7fc5fc00a570 comp rx=0 tx=0).stop 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.288+0000 7fc61182b640 1 -- 172.21.15.42:0/1145339586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc60c100e30 msgr2=0x7fc60c198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.288+0000 7fc61182b640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc60c100e30 0x7fc60c198990 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc60000d950 tx=0x7fc60000de10 comp rx=0 tx=0).stop 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.289+0000 7fc61182b640 1 -- 172.21.15.42:0/1145339586 shutdown_connections 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.289+0000 7fc61182b640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc5f40a3240 0x7fc5f40a5700 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.289+0000 7fc61182b640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc60c1055b0 0x7fc60c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.289+0000 7fc61182b640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc60c100e30 0x7fc60c198990 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.289+0000 7fc61182b640 1 --2- 172.21.15.42:0/1145339586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc60c100480 0x7fc60c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.289+0000 7fc61182b640 1 -- 172.21.15.42:0/1145339586 >> 172.21.15.42:0/1145339586 conn(0x7fc60c077210 msgr2=0x7fc60c103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.289+0000 7fc61182b640 1 -- 172.21.15.42:0/1145339586 shutdown_connections 2024-09-19T09:40:42.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:42.289+0000 7fc61182b640 1 -- 172.21.15.42:0/1145339586 wait complete. 2024-09-19T09:40:42.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:42 smithi136 ceph-mon[34840]: pgmap v378: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-09-19T09:40:42.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:42 smithi042 ceph-mon[31223]: pgmap v378: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-09-19T09:40:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:42 smithi171 ceph-mon[35803]: pgmap v378: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-09-19T09:40:42.995 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id 9edb0b2e --release --await' 2024-09-19T09:40:42.995 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id 9edb0b2e --release --await 2024-09-19T09:40:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:43.379 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:43 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1145339586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:43.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:43 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1145339586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:43.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:43 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1145339586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.746+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/3243892492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8cc100a80 msgr2=0x7fd8cc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.746+0000 7fd8d0d9e640 1 --2- 172.21.15.42:0/3243892492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8cc100a80 0x7fd8cc100ee0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009930 tx=0x7fd8b402a420 comp rx=0 tx=0).stop 2024-09-19T09:40:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.746+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/3243892492 shutdown_connections 2024-09-19T09:40:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.746+0000 7fd8d0d9e640 1 --2- 172.21.15.42:0/3243892492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8cc101420 0x7fd8cc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.746+0000 7fd8d0d9e640 1 --2- 172.21.15.42:0/3243892492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8cc100a80 0x7fd8cc100ee0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.746+0000 7fd8d0d9e640 1 --2- 172.21.15.42:0/3243892492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8cc106a80 0x7fd8cc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.746+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/3243892492 >> 172.21.15.42:0/3243892492 conn(0x7fd8cc0fc7a0 msgr2=0x7fd8cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.746+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/3243892492 shutdown_connections 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.746+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/3243892492 wait complete. 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8d0d9e640 1 Processor -- start 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8d0d9e640 1 -- start start 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8d0d9e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8cc100a80 0x7fd8cc199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8d0d9e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8cc101420 0x7fd8cc199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8d0d9e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8cc106a80 0x7fd8cc1a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8d0d9e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc110e80 con 0x7fd8cc101420 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8d0d9e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc110d00 con 0x7fd8cc100a80 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8d0d9e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc111000 con 0x7fd8cc106a80 2024-09-19T09:40:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8c1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8cc101420 0x7fd8cc199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8c1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8cc101420 0x7fd8cc199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37560/0 (socket says 172.21.15.42:37560) 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8c1d9b640 1 -- 172.21.15.42:0/536075086 learned_addr learned my addr 172.21.15.42:0/536075086 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8cc106a80 0x7fd8cc1a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.747+0000 7fd8ca59c640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8cc100a80 0x7fd8cc199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8c1d9b640 1 -- 172.21.15.42:0/536075086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8cc106a80 msgr2=0x7fd8cc1a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8cc106a80 0x7fd8cc1a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8c1d9b640 1 -- 172.21.15.42:0/536075086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8cc100a80 msgr2=0x7fd8cc199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8cc100a80 0x7fd8cc199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8c1d9b640 1 -- 172.21.15.42:0/536075086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc1a48c0 con 0x7fd8cc101420 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8cc101420 0x7fd8cc199840 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009230 tx=0x7fd8b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8c3fff640 1 -- 172.21.15.42:0/536075086 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b403f030 con 0x7fd8cc101420 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/536075086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8cc1a4a90 con 0x7fd8cc101420 2024-09-19T09:40:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8c3fff640 1 -- 172.21.15.42:0/536075086 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8b4003ad0 con 0x7fd8cc101420 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8c3fff640 1 -- 172.21.15.42:0/536075086 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4035070 con 0x7fd8cc101420 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.748+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/536075086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8cc1a4f40 con 0x7fd8cc101420 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.751+0000 7fd8c3fff640 1 -- 172.21.15.42:0/536075086 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd8b4042030 con 0x7fd8cc101420 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.751+0000 7fd8d3177740 1 Processor -- start 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.751+0000 7fd8d3177740 1 -- start start 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.751+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ea9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.751+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08eb8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.751+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ebaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.751+0000 7fd8d3177740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55de08e0e620 con 0x55de08eb8650 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.751+0000 7fd8d3177740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55de08db5e50 con 0x55de08ea8f40 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.751+0000 7fd8d3177740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55de08e0a5e0 con 0x55de08ea9860 2024-09-19T09:40:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.751+0000 7fd8c1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ebaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c3fff640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8b80a3240 0x7fd8b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ebaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37564/0 (socket says 172.21.15.42:37564) 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c1d9b640 1 -- 172.21.15.42:0/3300333754 learned_addr learned my addr 172.21.15.42:0/3300333754 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8ca59c640 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08eb8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ea9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8b80a3240 0x7fd8b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c3fff640 1 -- 172.21.15.42:0/536075086 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd8b40efe40 con 0x7fd8cc101420 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c1d9b640 1 -- 172.21.15.42:0/3300333754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 msgr2=0x55de08eb8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08eb8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c1d9b640 1 -- 172.21.15.42:0/3300333754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 msgr2=0x55de08ea9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ea9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c1d9b640 1 -- 172.21.15.42:0/3300333754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de08da6d40 con 0x55de08eb8650 2024-09-19T09:40:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ea9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8ca59c640 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08eb8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ebaa40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40b8e10 tx=0x7fd8b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e869ab114118e672 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8b80a3240 0x7fd8b80a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009fd0 tx=0x7fd8c4009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c0d99640 1 -- 172.21.15.42:0/3300333754 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4049070 con 0x55de08eb8650 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c0d99640 1 -- 172.21.15.42:0/3300333754 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8b40bcb40 con 0x55de08eb8650 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.752+0000 7fd8c0d99640 1 -- 172.21.15.42:0/3300333754 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40b8ab0 con 0x55de08eb8650 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.753+0000 7fd8d3177740 1 -- 172.21.15.42:0/3300333754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 msgr2=0x55de08ebaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.753+0000 7fd8d3177740 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ebaa40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40b8e10 tx=0x7fd8b4009260 comp rx=0 tx=0).stop 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.753+0000 7fd8d3177740 1 -- 172.21.15.42:0/3300333754 shutdown_connections 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.753+0000 7fd8d3177740 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ebaa40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.753+0000 7fd8d3177740 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08eb8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.753+0000 7fd8d3177740 1 --2- 172.21.15.42:0/3300333754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ea9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.753+0000 7fd8d3177740 1 -- 172.21.15.42:0/3300333754 >> 172.21.15.42:0/3300333754 conn(0x55de08ea55f0 msgr2=0x55de08ea59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.753+0000 7fd8d3177740 1 -- 172.21.15.42:0/3300333754 shutdown_connections 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.753+0000 7fd8d3177740 1 -- 172.21.15.42:0/3300333754 wait complete. 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8d3177740 1 -- start start 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8d3177740 1 Processor -- start 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08ea8f40 0x55de08eb55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea9860 0x55de08eb5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08eb8650 0x55de08eb6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8d3177740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55de08ebafe0 con 0x55de08ea8f40 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8d3177740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55de08d96f10 con 0x55de08ea9860 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8d3177740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55de08ebb160 con 0x55de08eb8650 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8d3177740 10 client.0 _ll_register_callbacks cb 0x55de08dbadb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:44.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8ca59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08ea8f40 0x55de08eb55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8ca59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08ea8f40 0x55de08eb55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37576/0 (socket says 172.21.15.42:37576) 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8ca59c640 1 -- 172.21.15.42:0/2594662115 learned_addr learned my addr 172.21.15.42:0/2594662115 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08eb8650 0x55de08eb6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea9860 0x55de08eb5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8ca59c640 1 -- 172.21.15.42:0/2594662115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08eb8650 msgr2=0x55de08eb6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8ca59c640 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08eb8650 0x55de08eb6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8ca59c640 1 -- 172.21.15.42:0/2594662115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea9860 msgr2=0x55de08eb5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8ca59c640 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea9860 0x55de08eb5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8ca59c640 1 -- 172.21.15.42:0/2594662115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de08b1d580 con 0x55de08ea8f40 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.754+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08eb8650 0x55de08eb6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8ca59c640 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08ea8f40 0x55de08eb55d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00be80 tx=0x7fd8bc012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ef8abec13f4658 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:44.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/2594662115 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0035f0 con 0x55de08ea8f40 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/2594662115 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd8bc003790 con 0x55de08ea8f40 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8d3177740 1 -- 172.21.15.42:0/2594662115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8b40bcb40 con 0x55de08ea8f40 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/2594662115 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd8bc0039b0 con 0x55de08ea8f40 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8d3177740 10 client.16077 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8d3177740 1 -- 172.21.15.42:0/2594662115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55de08be7960 con 0x55de08ea8f40 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/2594662115 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8b40bcb40 con 0x55de08ea8f40 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/2594662115 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd8bc019070 con 0x55de08ea8f40 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8d3177740 10 client.16077 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8d3177740 10 client.16077 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8d3177740 20 client.16077 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8d3177740 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55de08ec7ee0 0x55de08eca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8d3177740 4 client.16077 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:44.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.755+0000 7fd8d3177740 1 -- 172.21.15.42:0/2594662115 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de08e1bb90 con 0x55de08ec7ee0 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.756+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55de08ec7ee0 0x55de08eca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.756+0000 7fd8b1ffb640 10 client.16077 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.756+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55de08ec7ee0 0x55de08eca350 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d37654deadae43a server_cookie=6a95d70cfc5d8655 in_seq=0 out_seq=0 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/2594662115 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de08e1bb90 con 0x55de08ec7ee0 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8b1ffb640 10 client.16077 handle_command_reply: tid=0 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 client.16077 shutdown 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 -- 172.21.15.42:0/2594662115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08ea8f40 msgr2=0x55de08eb55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08ea8f40 0x55de08eb55d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00be80 tx=0x7fd8bc012820 comp rx=0 tx=0).stop 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 -- 172.21.15.42:0/2594662115 shutdown_connections 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55de08ec7ee0 0x55de08eca350 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08eb8650 0x55de08eb6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea9860 0x55de08eb5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8b1ffb640 0 client.16077 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 --2- 172.21.15.42:0/2594662115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08ea8f40 0x55de08eb55d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 -- 172.21.15.42:0/2594662115 >> 172.21.15.42:0/2594662115 conn(0x55de08ea55f0 msgr2=0x55de08eab350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 -- 172.21.15.42:0/2594662115 shutdown_connections 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.757+0000 7fd8d3177740 1 -- 172.21.15.42:0/2594662115 wait complete. 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.758+0000 7fd8d3177740 20 client.16077 trim_cache size 0 max 16384 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.774+0000 7fd8d3177740 1 Processor -- start 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.774+0000 7fd8d3177740 1 -- start start 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ea4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08ecfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ed0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8d3177740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1ab520 con 0x55de08eb8650 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8d3177740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1ad060 con 0x55de08ea8f40 2024-09-19T09:40:44.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8d3177740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1abbf0 con 0x55de08ea9860 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8cad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ed0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8cad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ed0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37590/0 (socket says 172.21.15.42:37590) 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8cad9d640 1 -- 172.21.15.42:0/165634454 learned_addr learned my addr 172.21.15.42:0/165634454 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8ca59c640 1 --2- 172.21.15.42:0/165634454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ea4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/165634454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08ecfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8cad9d640 1 -- 172.21.15.42:0/165634454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 msgr2=0x55de08ecfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/165634454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08ecfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8cad9d640 1 -- 172.21.15.42:0/165634454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 msgr2=0x55de08ea4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/165634454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ea4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8cad9d640 1 -- 172.21.15.42:0/165634454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de08eb65a0 con 0x55de08eb8650 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/165634454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08ecfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/165634454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ed0160 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4012ec0 tx=0x7fd8c4009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b513fcc192284b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.775+0000 7fd8b3fff640 1 -- 172.21.15.42:0/165634454 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4004b20 con 0x55de08eb8650 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8b3fff640 1 -- 172.21.15.42:0/165634454 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c4025070 con 0x55de08eb8650 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8b3fff640 1 -- 172.21.15.42:0/165634454 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4005770 con 0x55de08eb8650 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8d3177740 1 -- 172.21.15.42:0/165634454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 msgr2=0x55de08ed0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8d3177740 1 --2- 172.21.15.42:0/165634454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ed0160 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4012ec0 tx=0x7fd8c4009a00 comp rx=0 tx=0).stop 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8d3177740 1 -- 172.21.15.42:0/165634454 shutdown_connections 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8d3177740 1 --2- 172.21.15.42:0/165634454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08ed0160 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8d3177740 1 --2- 172.21.15.42:0/165634454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08ecfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8d3177740 1 --2- 172.21.15.42:0/165634454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ea4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8d3177740 1 -- 172.21.15.42:0/165634454 >> 172.21.15.42:0/165634454 conn(0x55de08ea55f0 msgr2=0x55de08ea3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8d3177740 1 -- 172.21.15.42:0/165634454 shutdown_connections 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8d3177740 1 -- 172.21.15.42:0/165634454 wait complete. 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.776+0000 7fd8d3177740 1 -- start start 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8d3177740 1 Processor -- start 2024-09-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ebc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08ebceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8d3177740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08f2bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8d3177740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1ac990 con 0x55de08eb8650 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8d3177740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1ac2c0 con 0x55de08ea8f40 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8d3177740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1a9500 con 0x55de08ea9860 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8d3177740 10 client.0 _ll_register_callbacks cb 0x7fd8bc00ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8cad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08f2bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8cad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08f2bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37604/0 (socket says 172.21.15.42:37604) 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8cad9d640 1 -- 172.21.15.42:0/1534274944 learned_addr learned my addr 172.21.15.42:0/1534274944 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8ca59c640 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ebc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08ebceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8cad9d640 1 -- 172.21.15.42:0/1534274944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 msgr2=0x55de08ebceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08ebceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8cad9d640 1 -- 172.21.15.42:0/1534274944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 msgr2=0x55de08ebc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ebc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8cad9d640 1 -- 172.21.15.42:0/1534274944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de08f2c270 con 0x55de08eb8650 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8c1d9b640 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08ebceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.777+0000 7fd8cad9d640 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08f2bc30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4005c10 tx=0x7fd8c4009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1881f269966f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/1534274944 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4011a20 con 0x55de08eb8650 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/1534274944 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd8c4011bc0 con 0x55de08eb8650 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8d3177740 1 -- 172.21.15.42:0/1534274944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8c4025070 con 0x55de08eb8650 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/1534274944 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd8c4011dc0 con 0x55de08eb8650 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8d3177740 10 client.16083 fetch_fsmap learned FSMap version 28 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8d3177740 1 -- 172.21.15.42:0/1534274944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55de08f33570 con 0x55de08eb8650 2024-09-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/1534274944 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c4025070 con 0x55de08eb8650 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/1534274944 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd8c401e070 con 0x55de08eb8650 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8d3177740 10 client.16083 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8d3177740 10 client.16083 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8d3177740 20 client.16083 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8d3177740 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55de08f33be0 0x55de08f35fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8d3177740 4 client.16083 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9edb0b2e", "release": true, "await": true}] 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.778+0000 7fd8d3177740 1 -- 172.21.15.42:0/1534274944 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9edb0b2e", "release": true, "await": true}) -- 0x55de08e160a0 con 0x55de08f33be0 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.779+0000 7fd8ca59c640 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55de08f33be0 0x55de08f35fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.779+0000 7fd8ca59c640 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55de08f33be0 0x55de08f35fd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c81c86aa7151c03 server_cookie=621f899400862dad in_seq=0 out_seq=0 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.779+0000 7fd8b1ffb640 10 client.16083 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8b1ffb640 1 -- 172.21.15.42:0/1534274944 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55de08e160a0 con 0x55de08f33be0 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8b1ffb640 10 client.16083 handle_command_reply: tid=0 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 client.16083 shutdown 2024-09-19T09:40:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 -- 172.21.15.42:0/1534274944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 msgr2=0x55de08f2bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08f2bc30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4005c10 tx=0x7fd8c4009dd0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 -- 172.21.15.42:0/1534274944 shutdown_connections 2024-09-19T09:40:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55de08f33be0 0x55de08f35fd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de08eb8650 0x55de08f2bc30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8b1ffb640 0 client.16083 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de08ea9860 0x55de08ebceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 --2- 172.21.15.42:0/1534274944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de08ea8f40 0x55de08ebc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 -- 172.21.15.42:0/1534274944 >> 172.21.15.42:0/1534274944 conn(0x55de08ea55f0 msgr2=0x55de08eb5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 -- 172.21.15.42:0/1534274944 shutdown_connections 2024-09-19T09:40:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 1 -- 172.21.15.42:0/1534274944 wait complete. 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 28, 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 24506, 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 8, 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "9edb0b2e": { 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 8, 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:40:44.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 140.3, 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:44.021 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.781+0000 7fd8d3177740 20 client.16083 trim_cache size 0 max 16384 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/536075086 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8b80a3240 msgr2=0x7fd8b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8b80a3240 0x7fd8b80a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009fd0 tx=0x7fd8c4009600 comp rx=0 tx=0).stop 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/536075086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8cc101420 msgr2=0x7fd8cc199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8cc101420 0x7fd8cc199840 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009230 tx=0x7fd8b4004270 comp rx=0 tx=0).stop 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/536075086 shutdown_connections 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8b80a3240 0x7fd8b80a5700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8cc106a80 0x7fd8cc1a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8cc101420 0x7fd8cc199840 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 --2- 172.21.15.42:0/536075086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8cc100a80 0x7fd8cc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/536075086 >> 172.21.15.42:0/536075086 conn(0x7fd8cc0fc7a0 msgr2=0x7fd8cc0fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/536075086 shutdown_connections 2024-09-19T09:40:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:43.782+0000 7fd8d0d9e640 1 -- 172.21.15.42:0/536075086 wait complete. 2024-09-19T09:40:44.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:44 smithi136 ceph-mon[34840]: pgmap v379: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-19T09:40:44.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:44 smithi042 ceph-mon[31223]: pgmap v379: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-19T09:40:44.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:44 smithi171 ceph-mon[35803]: pgmap v379: 97 pgs: 97 active+clean; 716 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-19T09:40:44.866 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9edb0b2e', total seconds elapsed: 23.9 2024-09-19T09:40:44.866 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:40:44.866 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:40:45.130 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.598+0000 7fab22a3e640 1 -- 172.21.15.42:0/237307009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab1c100e20 msgr2=0x7fab1c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.598+0000 7fab22a3e640 1 --2- 172.21.15.42:0/237307009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab1c100e20 0x7fab1c101200 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009900 tx=0x7fab0c02a480 comp rx=0 tx=0).stop 2024-09-19T09:40:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.598+0000 7fab22a3e640 1 -- 172.21.15.42:0/237307009 shutdown_connections 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.598+0000 7fab22a3e640 1 --2- 172.21.15.42:0/237307009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab1c102ef0 0x7fab1c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.598+0000 7fab22a3e640 1 --2- 172.21.15.42:0/237307009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab1c102570 0x7fab1c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.598+0000 7fab22a3e640 1 --2- 172.21.15.42:0/237307009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab1c100e20 0x7fab1c101200 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.598+0000 7fab22a3e640 1 -- 172.21.15.42:0/237307009 >> 172.21.15.42:0/237307009 conn(0x7fab1c0fc7d0 msgr2=0x7fab1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.598+0000 7fab22a3e640 1 -- 172.21.15.42:0/237307009 shutdown_connections 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.598+0000 7fab22a3e640 1 -- 172.21.15.42:0/237307009 wait complete. 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab22a3e640 1 Processor -- start 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab22a3e640 1 -- start start 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab22a3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab1c100e20 0x7fab1c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab22a3e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab1c102570 0x7fab1c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab22a3e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab1c102ef0 0x7fab1c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab22a3e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c110f80 con 0x7fab1c100e20 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab22a3e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c110e00 con 0x7fab1c102570 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab22a3e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c111100 con 0x7fab1c102ef0 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab1bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab1c100e20 0x7fab1c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab1bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab1c100e20 0x7fab1c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37624/0 (socket says 172.21.15.42:37624) 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab1bfff640 1 -- 172.21.15.42:0/2458296384 learned_addr learned my addr 172.21.15.42:0/2458296384 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab20fdb640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab1c102ef0 0x7fab1c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab13fff640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab1c102570 0x7fab1c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab1bfff640 1 -- 172.21.15.42:0/2458296384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab1c102ef0 msgr2=0x7fab1c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab1bfff640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab1c102ef0 0x7fab1c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab1bfff640 1 -- 172.21.15.42:0/2458296384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab1c102570 msgr2=0x7fab1c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.599+0000 7fab1bfff640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab1c102570 0x7fab1c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.600+0000 7fab1bfff640 1 -- 172.21.15.42:0/2458296384 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c19d3b0 con 0x7fab1c100e20 2024-09-19T09:40:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.600+0000 7fab20fdb640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab1c102ef0 0x7fab1c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.600+0000 7fab1bfff640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab1c100e20 0x7fab1c198400 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fab0c006010 tx=0x7fab0c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.600+0000 7fab19ffb640 1 -- 172.21.15.42:0/2458296384 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c03f070 con 0x7fab1c100e20 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.600+0000 7fab19ffb640 1 -- 172.21.15.42:0/2458296384 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab0c031e30 con 0x7fab1c100e20 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.600+0000 7fab22a3e640 1 -- 172.21.15.42:0/2458296384 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab1c19d640 con 0x7fab1c100e20 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.600+0000 7fab19ffb640 1 -- 172.21.15.42:0/2458296384 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c035030 con 0x7fab1c100e20 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.600+0000 7fab22a3e640 1 -- 172.21.15.42:0/2458296384 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab1c1a4f80 con 0x7fab1c100e20 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.601+0000 7fab22a3e640 1 -- 172.21.15.42:0/2458296384 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab1c1021b0 con 0x7fab1c100e20 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.602+0000 7fab19ffb640 1 -- 172.21.15.42:0/2458296384 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fab0c042070 con 0x7fab1c100e20 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.603+0000 7fab19ffb640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab080a3240 0x7fab080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.603+0000 7fab13fff640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab080a3240 0x7fab080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.603+0000 7fab19ffb640 1 -- 172.21.15.42:0/2458296384 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fab0c0f0330 con 0x7fab1c100e20 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.604+0000 7fab13fff640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab080a3240 0x7fab080a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fab04005e10 tx=0x7fab04005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.608+0000 7fab19ffb640 1 -- 172.21.15.42:0/2458296384 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab0c0bd030 con 0x7fab1c100e20 2024-09-19T09:40:45.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.819+0000 7fab22a3e640 1 -- 172.21.15.42:0/2458296384 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab1c199790 con 0x7fab1c100e20 2024-09-19T09:40:45.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.820+0000 7fab19ffb640 1 -- 172.21.15.42:0/2458296384 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7fab1c199790 con 0x7fab1c100e20 2024-09-19T09:40:45.822 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:40:45.822 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-19T09:38:58:569320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:38:58.362185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:40:45.822 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-19T09:40:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 -- 172.21.15.42:0/2458296384 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab080a3240 msgr2=0x7fab080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab080a3240 0x7fab080a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fab04005e10 tx=0x7fab04005da0 comp rx=0 tx=0).stop 2024-09-19T09:40:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 -- 172.21.15.42:0/2458296384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab1c100e20 msgr2=0x7fab1c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab1c100e20 0x7fab1c198400 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fab0c006010 tx=0x7fab0c003c80 comp rx=0 tx=0).stop 2024-09-19T09:40:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 -- 172.21.15.42:0/2458296384 shutdown_connections 2024-09-19T09:40:45.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab080a3240 0x7fab080a5700 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:45.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab1c102ef0 0x7fab1c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:45.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab1c102570 0x7fab1c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:45.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 --2- 172.21.15.42:0/2458296384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab1c100e20 0x7fab1c198400 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:45.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 -- 172.21.15.42:0/2458296384 >> 172.21.15.42:0/2458296384 conn(0x7fab1c0fc7d0 msgr2=0x7fab1c06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:45.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 -- 172.21.15.42:0/2458296384 shutdown_connections 2024-09-19T09:40:45.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:45.822+0000 7fab22a3e640 1 -- 172.21.15.42:0/2458296384 wait complete. 2024-09-19T09:40:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:46 smithi136 ceph-mon[34840]: pgmap v380: 97 pgs: 97 active+clean; 724 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-09-19T09:40:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:46 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2458296384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:46.398 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:46 smithi042 ceph-mon[31223]: pgmap v380: 97 pgs: 97 active+clean; 724 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-09-19T09:40:46.398 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:46 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2458296384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:46.427 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:40:46.428 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:40:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:46 smithi171 ceph-mon[35803]: pgmap v380: 97 pgs: 97 active+clean; 724 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-09-19T09:40:46.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:46 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2458296384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:46.688 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.160+0000 7fa30855f640 1 -- 172.21.15.42:0/3044393472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa300103660 msgr2=0x7fa30010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.160+0000 7fa30855f640 1 --2- 172.21.15.42:0/3044393472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa300103660 0x7fa30010bb50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009900 tx=0x7fa2f002a480 comp rx=0 tx=0).stop 2024-09-19T09:40:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.160+0000 7fa30855f640 1 -- 172.21.15.42:0/3044393472 shutdown_connections 2024-09-19T09:40:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.160+0000 7fa30855f640 1 --2- 172.21.15.42:0/3044393472 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa30010c170 0x7fa30010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.160+0000 7fa30855f640 1 --2- 172.21.15.42:0/3044393472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa300103660 0x7fa30010bb50 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.160+0000 7fa30855f640 1 --2- 172.21.15.42:0/3044393472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa300102d40 0x7fa300103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.160+0000 7fa30855f640 1 -- 172.21.15.42:0/3044393472 >> 172.21.15.42:0/3044393472 conn(0x7fa3000fc7a0 msgr2=0x7fa3000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.160+0000 7fa30855f640 1 -- 172.21.15.42:0/3044393472 shutdown_connections 2024-09-19T09:40:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.160+0000 7fa30855f640 1 -- 172.21.15.42:0/3044393472 wait complete. 2024-09-19T09:40:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.161+0000 7fa30855f640 1 Processor -- start 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.161+0000 7fa30855f640 1 -- start start 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.161+0000 7fa30855f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa300102d40 0x7fa300198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.161+0000 7fa30855f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa300103660 0x7fa300198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa30855f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa30010c170 0x7fa30019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa30855f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa300111f70 con 0x7fa300103660 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa30855f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa300111df0 con 0x7fa300102d40 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa30855f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001120f0 con 0x7fa30010c170 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa305afa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa300103660 0x7fa300198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa305afa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa300103660 0x7fa300198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37632/0 (socket says 172.21.15.42:37632) 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa305afa640 1 -- 172.21.15.42:0/2072184369 learned_addr learned my addr 172.21.15.42:0/2072184369 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa3062fb640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa300102d40 0x7fa300198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa306afc640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa30010c170 0x7fa30019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa305afa640 1 -- 172.21.15.42:0/2072184369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa30010c170 msgr2=0x7fa30019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa305afa640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa30010c170 0x7fa30019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa305afa640 1 -- 172.21.15.42:0/2072184369 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa300102d40 msgr2=0x7fa300198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa305afa640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa300102d40 0x7fa300198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa305afa640 1 -- 172.21.15.42:0/2072184369 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30019d3c0 con 0x7fa300103660 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa305afa640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa300103660 0x7fa300198950 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0005ab0 tx=0x7fa2f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.162+0000 7fa2f77fe640 1 -- 172.21.15.42:0/2072184369 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f003f030 con 0x7fa300103660 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.163+0000 7fa2f77fe640 1 -- 172.21.15.42:0/2072184369 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2f0003ce0 con 0x7fa300103660 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.163+0000 7fa30855f640 1 -- 172.21.15.42:0/2072184369 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30019d650 con 0x7fa300103660 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.163+0000 7fa2f77fe640 1 -- 172.21.15.42:0/2072184369 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0035070 con 0x7fa300103660 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.163+0000 7fa30855f640 1 -- 172.21.15.42:0/2072184369 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3001a4f90 con 0x7fa300103660 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.165+0000 7fa2f77fe640 1 -- 172.21.15.42:0/2072184369 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa2f0042030 con 0x7fa300103660 2024-09-19T09:40:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.165+0000 7fa30a938740 1 Processor -- start 2024-09-19T09:40:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.165+0000 7fa30a938740 1 -- start start 2024-09-19T09:40:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.165+0000 7fa30a938740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472dff9730 0x56472dff9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.165+0000 7fa30a938740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e008900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.165+0000 7fa30a938740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472e008e40 0x56472e00b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.165+0000 7fa30a938740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56472df5e160 con 0x56472e008e40 2024-09-19T09:40:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.165+0000 7fa30a938740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56472df05720 con 0x56472dffa050 2024-09-19T09:40:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.165+0000 7fa30a938740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56472df5a120 con 0x56472dff9730 2024-09-19T09:40:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa305afa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472e008e40 0x56472e00b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa305afa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472e008e40 0x56472e00b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37646/0 (socket says 172.21.15.42:37646) 2024-09-19T09:40:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa305afa640 1 -- 172.21.15.42:0/3381579084 learned_addr learned my addr 172.21.15.42:0/3381579084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa306afc640 1 --2- 172.21.15.42:0/3381579084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472dff9730 0x56472dff9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa3062fb640 1 --2- 172.21.15.42:0/3381579084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa2f77fe640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa2ec0a3240 0x7fa2ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa305afa640 1 -- 172.21.15.42:0/3381579084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472dff9730 msgr2=0x56472dff9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa305afa640 1 --2- 172.21.15.42:0/3381579084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472dff9730 0x56472dff9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa305afa640 1 -- 172.21.15.42:0/3381579084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 msgr2=0x56472e008900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa305afa640 1 --2- 172.21.15.42:0/3381579084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e008900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa305afa640 1 -- 172.21.15.42:0/3381579084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56472dccfba0 con 0x56472e008e40 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa3062fb640 1 --2- 172.21.15.42:0/3381579084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e008900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa306afc640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa2ec0a3240 0x7fa2ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa2f77fe640 1 -- 172.21.15.42:0/2072184369 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa2f00f0000 con 0x7fa300103660 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa305afa640 1 --2- 172.21.15.42:0/3381579084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472e008e40 0x56472e00b230 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00e19c0 tx=0x7fa2f00b8210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2eeb2087e1d2866 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:47.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa2f4ff9640 1 -- 172.21.15.42:0/3381579084 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00bc1e0 con 0x56472e008e40 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa2f4ff9640 1 -- 172.21.15.42:0/3381579084 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2f00bcda0 con 0x56472e008e40 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.166+0000 7fa2f4ff9640 1 -- 172.21.15.42:0/3381579084 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00c0a50 con 0x56472e008e40 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.167+0000 7fa30a938740 1 -- 172.21.15.42:0/3381579084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472e008e40 msgr2=0x56472e00b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.167+0000 7fa30a938740 1 --2- 172.21.15.42:0/3381579084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472e008e40 0x56472e00b230 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00e19c0 tx=0x7fa2f00b8210 comp rx=0 tx=0).stop 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.167+0000 7fa306afc640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa2ec0a3240 0x7fa2ec0a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800aed0 tx=0x7fa2f8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.167+0000 7fa30a938740 1 -- 172.21.15.42:0/3381579084 shutdown_connections 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.167+0000 7fa30a938740 1 --2- 172.21.15.42:0/3381579084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472e008e40 0x56472e00b230 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.167+0000 7fa30a938740 1 --2- 172.21.15.42:0/3381579084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e008900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.167+0000 7fa30a938740 1 --2- 172.21.15.42:0/3381579084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472dff9730 0x56472dff9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.167+0000 7fa30a938740 1 -- 172.21.15.42:0/3381579084 >> 172.21.15.42:0/3381579084 conn(0x56472dff5de0 msgr2=0x56472dff61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.167+0000 7fa30a938740 1 -- 172.21.15.42:0/3381579084 shutdown_connections 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.167+0000 7fa30a938740 1 -- 172.21.15.42:0/3381579084 wait complete. 2024-09-19T09:40:47.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa30a938740 1 -- start start 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa30a938740 1 Processor -- start 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa30a938740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472dff9730 0x56472e005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa30a938740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dffa050 0x56472e006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa30a938740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472e008e40 0x56472e0067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa30a938740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56472e00b7d0 con 0x56472dffa050 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa30a938740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56472dee6900 con 0x56472e008e40 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa30a938740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56472e00b950 con 0x56472dff9730 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa30a938740 10 client.0 _ll_register_callbacks cb 0x56472dee4780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa305afa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dffa050 0x56472e006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa305afa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dffa050 0x56472e006290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37658/0 (socket says 172.21.15.42:37658) 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa305afa640 1 -- 172.21.15.42:0/161387718 learned_addr learned my addr 172.21.15.42:0/161387718 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa3062fb640 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472dff9730 0x56472e005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa306afc640 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472e008e40 0x56472e0067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa305afa640 1 -- 172.21.15.42:0/161387718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472dff9730 msgr2=0x56472e005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa305afa640 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472dff9730 0x56472e005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa305afa640 1 -- 172.21.15.42:0/161387718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472e008e40 msgr2=0x56472e0067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa305afa640 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472e008e40 0x56472e0067d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.168+0000 7fa305afa640 1 -- 172.21.15.42:0/161387718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56472df26c50 con 0x56472dffa050 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa305afa640 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dffa050 0x56472e006290 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0031550 tx=0x7fa2f002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1a40d7ecc8bbc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa2e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/161387718 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0049030 con 0x56472dffa050 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/161387718 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa2f00bd6f0 con 0x56472dffa050 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa30a938740 1 -- 172.21.15.42:0/161387718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2f00bcda0 con 0x56472dffa050 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/161387718 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2f00c1be0 con 0x56472dffa050 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa30a938740 10 client.16101 fetch_fsmap learned FSMap version 29 2024-09-19T09:40:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa30a938740 1 -- 172.21.15.42:0/161387718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56472e00b7d0 con 0x56472dffa050 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/161387718 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2f00bcda0 con 0x56472dffa050 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/161387718 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fa2f00ecc50 con 0x56472dffa050 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa30a938740 10 client.16101 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa30a938740 10 client.16101 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa30a938740 20 client.16101 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa30a938740 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56472e018670 0x56472e01aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa30a938740 4 client.16101 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.169+0000 7fa30a938740 1 -- 172.21.15.42:0/161387718 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56472df6b890 con 0x56472e018670 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.170+0000 7fa3062fb640 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56472e018670 0x56472e01aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.170+0000 7fa2e9ffb640 10 client.16101 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.170+0000 7fa3062fb640 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56472e018670 0x56472e01aa90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62800c42ff4b81a6 server_cookie=a373d1bf83d254b5 in_seq=0 out_seq=0 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/161387718 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56472df6b890 con 0x56472e018670 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa2e9ffb640 10 client.16101 handle_command_reply: tid=0 2024-09-19T09:40:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 client.16101 shutdown 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 -- 172.21.15.42:0/161387718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dffa050 msgr2=0x56472e006290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dffa050 0x56472e006290 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0031550 tx=0x7fa2f002a480 comp rx=0 tx=0).stop 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 -- 172.21.15.42:0/161387718 shutdown_connections 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56472e018670 0x56472e01aa90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa2e9ffb640 0 client.16101 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472e008e40 0x56472e0067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dffa050 0x56472e006290 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 --2- 172.21.15.42:0/161387718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472dff9730 0x56472e005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 -- 172.21.15.42:0/161387718 >> 172.21.15.42:0/161387718 conn(0x56472dff5de0 msgr2=0x56472dffbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 -- 172.21.15.42:0/161387718 shutdown_connections 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 1 -- 172.21.15.42:0/161387718 wait complete. 2024-09-19T09:40:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.171+0000 7fa30a938740 20 client.16101 trim_cache size 0 max 16384 2024-09-19T09:40:47.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.188+0000 7fa30a938740 1 Processor -- start 2024-09-19T09:40:47.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.188+0000 7fa30a938740 1 -- start start 2024-09-19T09:40:47.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa30a938740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa30a938740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e020360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa30a938740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472e008e40 0x56472e0208a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa30a938740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001ab450 con 0x56472dff9730 2024-09-19T09:40:47.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa30a938740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001acfc0 con 0x56472dffa050 2024-09-19T09:40:47.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa30a938740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001abb20 con 0x56472e008e40 2024-09-19T09:40:47.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa3062fb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e006620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa3062fb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e006620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37662/0 (socket says 172.21.15.42:37662) 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa3062fb640 1 -- 172.21.15.42:0/2986924692 learned_addr learned my addr 172.21.15.42:0/2986924692 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa305afa640 1 --2- 172.21.15.42:0/2986924692 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e020360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa306afc640 1 --2- 172.21.15.42:0/2986924692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472e008e40 0x56472e0208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa3062fb640 1 -- 172.21.15.42:0/2986924692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472e008e40 msgr2=0x56472e0208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa3062fb640 1 --2- 172.21.15.42:0/2986924692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472e008e40 0x56472e0208a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa3062fb640 1 -- 172.21.15.42:0/2986924692 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 msgr2=0x56472e020360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa3062fb640 1 --2- 172.21.15.42:0/2986924692 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e020360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa3062fb640 1 -- 172.21.15.42:0/2986924692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56472e0086c0 con 0x56472dff9730 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa3062fb640 1 --2- 172.21.15.42:0/2986924692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e006620 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc005e10 tx=0x7fa2fc005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77af0e542cf124f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa2ebfff640 1 -- 172.21.15.42:0/2986924692 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc013110 con 0x56472dff9730 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa2ebfff640 1 -- 172.21.15.42:0/2986924692 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2fc0132b0 con 0x56472dff9730 2024-09-19T09:40:47.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.189+0000 7fa2ebfff640 1 -- 172.21.15.42:0/2986924692 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0119a0 con 0x56472dff9730 2024-09-19T09:40:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.190+0000 7fa30a938740 1 -- 172.21.15.42:0/2986924692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 msgr2=0x56472e006620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.190+0000 7fa30a938740 1 --2- 172.21.15.42:0/2986924692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e006620 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc005e10 tx=0x7fa2fc005900 comp rx=0 tx=0).stop 2024-09-19T09:40:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.190+0000 7fa30a938740 1 -- 172.21.15.42:0/2986924692 shutdown_connections 2024-09-19T09:40:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.190+0000 7fa30a938740 1 --2- 172.21.15.42:0/2986924692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472e008e40 0x56472e0208a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.190+0000 7fa30a938740 1 --2- 172.21.15.42:0/2986924692 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e020360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.190+0000 7fa30a938740 1 --2- 172.21.15.42:0/2986924692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e006620 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.190+0000 7fa30a938740 1 -- 172.21.15.42:0/2986924692 >> 172.21.15.42:0/2986924692 conn(0x56472dff5de0 msgr2=0x56472e0075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.190+0000 7fa30a938740 1 -- 172.21.15.42:0/2986924692 shutdown_connections 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.190+0000 7fa30a938740 1 -- 172.21.15.42:0/2986924692 wait complete. 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa30a938740 1 -- start start 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa30a938740 1 Processor -- start 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa30a938740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e00cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa30a938740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e00d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa30a938740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472e008e40 0x56472e00d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa30a938740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001ac8c0 con 0x56472dff9730 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa30a938740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001ac1f0 con 0x56472dffa050 2024-09-19T09:40:47.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa30a938740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001a9430 con 0x56472e008e40 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa3062fb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e00cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa30a938740 10 client.0 _ll_register_callbacks cb 0x7fa2f800a7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa3062fb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e00cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37676/0 (socket says 172.21.15.42:37676) 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa3062fb640 1 -- 172.21.15.42:0/1631550156 learned_addr learned my addr 172.21.15.42:0/1631550156 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa305afa640 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e00d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.191+0000 7fa306afc640 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472e008e40 0x56472e00d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa3062fb640 1 -- 172.21.15.42:0/1631550156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472e008e40 msgr2=0x56472e00d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa3062fb640 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472e008e40 0x56472e00d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa3062fb640 1 -- 172.21.15.42:0/1631550156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 msgr2=0x56472e00d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa3062fb640 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e00d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa3062fb640 1 -- 172.21.15.42:0/1631550156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56472e0825d0 con 0x56472dff9730 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa3062fb640 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e00cbe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc011480 tx=0x7fa2fc00afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737fde0bd198d73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa2e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:47.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/1631550156 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc034060 con 0x56472dff9730 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/1631550156 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa2fc005250 con 0x56472dff9730 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa30a938740 1 -- 172.21.15.42:0/1631550156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2fc0132b0 con 0x56472dff9730 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/1631550156 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2fc005450 con 0x56472dff9730 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa30a938740 10 client.16107 fetch_fsmap learned FSMap version 29 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa30a938740 1 -- 172.21.15.42:0/1631550156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56472e083890 con 0x56472dff9730 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/1631550156 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2fc0132b0 con 0x56472dff9730 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.192+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/1631550156 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fa2fc0118f0 con 0x56472dff9730 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.193+0000 7fa30a938740 10 client.16107 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.193+0000 7fa30a938740 10 client.16107 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.193+0000 7fa30a938740 20 client.16107 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.193+0000 7fa30a938740 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56472e018670 0x56472e085f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.193+0000 7fa30a938740 4 client.16107 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:40:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.193+0000 7fa30a938740 1 -- 172.21.15.42:0/1631550156 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x56472df65be0 con 0x56472e018670 2024-09-19T09:40:47.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.193+0000 7fa305afa640 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56472e018670 0x56472e085f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:47.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.193+0000 7fa2e9ffb640 10 client.16107 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:47.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.193+0000 7fa305afa640 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56472e018670 0x56472e085f70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d1c0e9f459a454e server_cookie=1c5e1258d695377a in_seq=0 out_seq=0 2024-09-19T09:40:47.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa2e9ffb640 1 -- 172.21.15.42:0/1631550156 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56472df65be0 con 0x56472e018670 2024-09-19T09:40:47.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa2e9ffb640 10 client.16107 handle_command_reply: tid=0 2024-09-19T09:40:47.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 client.16107 shutdown 2024-09-19T09:40:47.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 -- 172.21.15.42:0/1631550156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 msgr2=0x56472e00cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:47.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e00cbe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc011480 tx=0x7fa2fc00afa0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 -- 172.21.15.42:0/1631550156 shutdown_connections 2024-09-19T09:40:47.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56472e018670 0x56472e085f70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56472e008e40 0x56472e00d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56472dffa050 0x56472e00d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 --2- 172.21.15.42:0/1631550156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56472dff9730 0x56472e00cbe0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 -- 172.21.15.42:0/1631550156 >> 172.21.15.42:0/1631550156 conn(0x56472dff5de0 msgr2=0x56472dff46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa2e9ffb640 0 client.16107 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 -- 172.21.15.42:0/1631550156 shutdown_connections 2024-09-19T09:40:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 1 -- 172.21.15.42:0/1631550156 wait complete. 2024-09-19T09:40:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.202+0000 7fa30a938740 20 client.16107 trim_cache size 0 max 16384 2024-09-19T09:40:47.205 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:40:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 29, 2024-09-19T09:40:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 24506, 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 10, 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "94257ecd": { 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 10, 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 140.3, 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-09-19T09:40:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-09-19T09:40:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-09-19T09:40:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:40:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-09-19T09:40:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:40:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:40:47.207 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:40:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 -- 172.21.15.42:0/2072184369 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa2ec0a3240 msgr2=0x7fa2ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa2ec0a3240 0x7fa2ec0a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800aed0 tx=0x7fa2f8004a40 comp rx=0 tx=0).stop 2024-09-19T09:40:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 -- 172.21.15.42:0/2072184369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa300103660 msgr2=0x7fa300198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa300103660 0x7fa300198950 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0005ab0 tx=0x7fa2f00042f0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 -- 172.21.15.42:0/2072184369 shutdown_connections 2024-09-19T09:40:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa2ec0a3240 0x7fa2ec0a5700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa30010c170 0x7fa30019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa300103660 0x7fa300198950 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 --2- 172.21.15.42:0/2072184369 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa300102d40 0x7fa300198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 -- 172.21.15.42:0/2072184369 >> 172.21.15.42:0/2072184369 conn(0x7fa3000fc7a0 msgr2=0x7fa3000fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 -- 172.21.15.42:0/2072184369 shutdown_connections 2024-09-19T09:40:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:40:47.203+0000 7fa30855f640 1 -- 172.21.15.42:0/2072184369 wait complete. 2024-09-19T09:40:47.895 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '94257ecd', quiesce took 3.0 seconds. Will release after: 17.35 2024-09-19T09:40:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:48 smithi136 ceph-mon[34840]: pgmap v381: 97 pgs: 97 active+clean; 724 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-19T09:40:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:48 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:40:48.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:48 smithi042 ceph-mon[31223]: pgmap v381: 97 pgs: 97 active+clean; 724 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-19T09:40:48.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:48 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:40:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:48 smithi171 ceph-mon[35803]: pgmap v381: 97 pgs: 97 active+clean; 724 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-19T09:40:48.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:48 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:40:50.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:50 smithi136 ceph-mon[34840]: pgmap v382: 97 pgs: 97 active+clean; 746 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-09-19T09:40:50.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:50 smithi042 ceph-mon[31223]: pgmap v382: 97 pgs: 97 active+clean; 746 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-09-19T09:40:50.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:50 smithi171 ceph-mon[35803]: pgmap v382: 97 pgs: 97 active+clean; 746 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-09-19T09:40:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.626+0000 7f87fbae6640 1 -- 172.21.15.42:0/2084168650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87f410e130 msgr2=0x7f87f4110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.626+0000 7f87fbae6640 1 --2- 172.21.15.42:0/2084168650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87f410e130 0x7f87f4110520 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009ca0 tx=0x7f87ec02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.626+0000 7f87fbae6640 1 -- 172.21.15.42:0/2084168650 shutdown_connections 2024-09-19T09:40:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.626+0000 7f87fbae6640 1 --2- 172.21.15.42:0/2084168650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87f410e130 0x7f87f4110520 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.626+0000 7f87fbae6640 1 --2- 172.21.15.42:0/2084168650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f4074c50 0x7f87f40750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.626+0000 7f87fbae6640 1 --2- 172.21.15.42:0/2084168650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87f4076230 0x7f87f4074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.626+0000 7f87fbae6640 1 -- 172.21.15.42:0/2084168650 >> 172.21.15.42:0/2084168650 conn(0x7f87f40fd2e0 msgr2=0x7f87f40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.626+0000 7f87fbae6640 1 -- 172.21.15.42:0/2084168650 shutdown_connections 2024-09-19T09:40:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.626+0000 7f87fbae6640 1 -- 172.21.15.42:0/2084168650 wait complete. 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fbae6640 1 Processor -- start 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fbae6640 1 -- start start 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fbae6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87f4074c50 0x7f87f419e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fbae6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f4076230 0x7f87f419e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fbae6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87f410e130 0x7f87f41a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fbae6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f87f4113df0 con 0x7f87f410e130 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fbae6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f87f4113c70 con 0x7f87f4076230 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fbae6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f87f4113f70 con 0x7f87f4074c50 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fa083640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87f410e130 0x7f87f41a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87f9882640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87f4074c50 0x7f87f419e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fa083640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87f410e130 0x7f87f41a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47996/0 (socket says 172.21.15.42:47996) 2024-09-19T09:40:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fa083640 1 -- 172.21.15.42:0/2057198294 learned_addr learned my addr 172.21.15.42:0/2057198294 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87f9081640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f4076230 0x7f87f419e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fa083640 1 -- 172.21.15.42:0/2057198294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87f4074c50 msgr2=0x7f87f419e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fa083640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87f4074c50 0x7f87f419e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fa083640 1 -- 172.21.15.42:0/2057198294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f4076230 msgr2=0x7f87f419e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fa083640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f4076230 0x7f87f419e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87fa083640 1 -- 172.21.15.42:0/2057198294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f41a5ee0 con 0x7f87f410e130 2024-09-19T09:40:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.627+0000 7f87f9081640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f4076230 0x7f87f419e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.628+0000 7f87fa083640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87f410e130 0x7f87f41a5870 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f87ec031ae0 tx=0x7f87ec031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.628+0000 7f87e6ffd640 1 -- 172.21.15.42:0/2057198294 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec003c30 con 0x7f87f410e130 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.628+0000 7f87e6ffd640 1 -- 172.21.15.42:0/2057198294 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87ec003dd0 con 0x7f87f410e130 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.628+0000 7f87fbae6640 1 -- 172.21.15.42:0/2057198294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f41a6170 con 0x7f87f410e130 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.628+0000 7f87e6ffd640 1 -- 172.21.15.42:0/2057198294 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec02fcb0 con 0x7f87f410e130 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.628+0000 7f87fbae6640 1 -- 172.21.15.42:0/2057198294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f41a6710 con 0x7f87f410e130 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.630+0000 7f87e6ffd640 1 -- 172.21.15.42:0/2057198294 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f87ec004050 con 0x7f87f410e130 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.631+0000 7f87fe87d740 1 Processor -- start 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.631+0000 7f87fe87d740 1 -- start start 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.631+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146769a0 0x55b014676da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.631+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146772e0 0x55b01467bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.631+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b01467c370 0x55b01467e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.631+0000 7f87e6ffd640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f87e00a3370 0x7f87e00a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.631+0000 7f87fe87d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b0145da2f0 con 0x55b0146772e0 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.631+0000 7f87fe87d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b014582270 con 0x55b01467c370 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.631+0000 7f87fe87d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b0145d62b0 con 0x55b0146769a0 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9882640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146772e0 0x55b01467bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87fa083640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f87e00a3370 0x7f87e00a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9882640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146772e0 0x55b01467bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47998/0 (socket says 172.21.15.42:47998) 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9882640 1 -- 172.21.15.42:0/1888317421 learned_addr learned my addr 172.21.15.42:0/1888317421 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87e6ffd640 1 -- 172.21.15.42:0/2057198294 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f87ec0f0b80 con 0x7f87f410e130 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9081640 1 --2- 172.21.15.42:0/1888317421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146769a0 0x55b014676da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9081640 1 --2- 172.21.15.42:0/1888317421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b01467c370 0x55b01467e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9882640 1 -- 172.21.15.42:0/1888317421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146769a0 msgr2=0x55b014676da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9882640 1 --2- 172.21.15.42:0/1888317421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146769a0 0x55b014676da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9882640 1 -- 172.21.15.42:0/1888317421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b01467c370 msgr2=0x55b01467e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9882640 1 --2- 172.21.15.42:0/1888317421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b01467c370 0x55b01467e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9882640 1 -- 172.21.15.42:0/1888317421 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b014581340 con 0x55b0146772e0 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87fa083640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f87e00a3370 0x7f87e00a5830 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0bd230 tx=0x7f87ec03d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87f9882640 1 --2- 172.21.15.42:0/1888317421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146772e0 0x55b01467bda0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009d20 tx=0x7f87e8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f071c397bb57ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87dffff640 1 -- 172.21.15.42:0/1888317421 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e801e070 con 0x55b0146772e0 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87dffff640 1 -- 172.21.15.42:0/1888317421 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87e8009e10 con 0x55b0146772e0 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.632+0000 7f87dffff640 1 -- 172.21.15.42:0/1888317421 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8018910 con 0x55b0146772e0 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.633+0000 7f87fe87d740 1 -- 172.21.15.42:0/1888317421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146772e0 msgr2=0x55b01467bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.633+0000 7f87fe87d740 1 --2- 172.21.15.42:0/1888317421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146772e0 0x55b01467bda0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009d20 tx=0x7f87e8011810 comp rx=0 tx=0).stop 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.633+0000 7f87fe87d740 1 -- 172.21.15.42:0/1888317421 shutdown_connections 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.633+0000 7f87fe87d740 1 --2- 172.21.15.42:0/1888317421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b01467c370 0x55b01467e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.633+0000 7f87fe87d740 1 --2- 172.21.15.42:0/1888317421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146772e0 0x55b01467bda0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.633+0000 7f87fe87d740 1 --2- 172.21.15.42:0/1888317421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146769a0 0x55b014676da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.633+0000 7f87fe87d740 1 -- 172.21.15.42:0/1888317421 >> 172.21.15.42:0/1888317421 conn(0x55b014672010 msgr2=0x55b014672410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.633+0000 7f87fe87d740 1 -- 172.21.15.42:0/1888317421 shutdown_connections 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.633+0000 7f87fe87d740 1 -- 172.21.15.42:0/1888317421 wait complete. 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87fe87d740 1 -- start start 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87fe87d740 1 Processor -- start 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146769a0 0x55b014680bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146772e0 0x55b014681100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014688140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87fe87d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b01467f340 con 0x55b01467c370 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87fe87d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b014563290 con 0x55b0146769a0 2024-09-19T09:40:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87fe87d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b01467f4c0 con 0x55b0146772e0 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87fe87d740 10 client.0 _ll_register_callbacks cb 0x55b014594140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87f9081640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014688140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87f9081640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014688140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48006/0 (socket says 172.21.15.42:48006) 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.634+0000 7f87f9081640 1 -- 172.21.15.42:0/2221321099 learned_addr learned my addr 172.21.15.42:0/2221321099 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87f9882640 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146772e0 0x55b014681100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87f9081640 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146769a0 0x55b014680bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87f9081640 1 -- 172.21.15.42:0/2221321099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146772e0 msgr2=0x55b014681100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87f9081640 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146772e0 0x55b014681100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87f9081640 1 -- 172.21.15.42:0/2221321099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146769a0 msgr2=0x55b014680bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87f9081640 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146769a0 0x55b014680bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87f9081640 1 -- 172.21.15.42:0/2221321099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0142ed210 con 0x55b01467c370 2024-09-19T09:40:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87f9081640 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014688140 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f87f000e770 tx=0x7f87f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57cacb6226dc58c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87dd7fa640 1 -- 172.21.15.42:0/2221321099 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0004030 con 0x55b01467c370 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87dd7fa640 1 -- 172.21.15.42:0/2221321099 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f87f00041d0 con 0x55b01467c370 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87fe87d740 1 -- 172.21.15.42:0/2221321099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87e8009e10 con 0x55b01467c370 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87dd7fa640 1 -- 172.21.15.42:0/2221321099 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f87f0027050 con 0x55b01467c370 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87fe87d740 10 client.16119 fetch_fsmap learned FSMap version 29 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.635+0000 7f87fe87d740 1 -- 172.21.15.42:0/2221321099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b0143b9620 con 0x55b01467c370 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.636+0000 7f87dd7fa640 1 -- 172.21.15.42:0/2221321099 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87e8009e10 con 0x55b01467c370 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.636+0000 7f87dd7fa640 1 -- 172.21.15.42:0/2221321099 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f87f00035f0 con 0x55b01467c370 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.636+0000 7f87fe87d740 10 client.16119 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.636+0000 7f87fe87d740 10 client.16119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.636+0000 7f87fe87d740 20 client.16119 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.636+0000 7f87fe87d740 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b01468c840 0x55b01468ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.636+0000 7f87fe87d740 4 client.16119 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.636+0000 7f87fe87d740 1 -- 172.21.15.42:0/2221321099 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0145e7a20 con 0x55b01468c840 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.636+0000 7f87f9882640 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b01468c840 0x55b01468ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.637+0000 7f87f9882640 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b01468c840 0x55b01468ece0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d13c050a31f7a4e server_cookie=bf21ca5b0a542232 in_seq=0 out_seq=0 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.637+0000 7f87dd7fa640 10 client.16119 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.637+0000 7f87dd7fa640 1 -- 172.21.15.42:0/2221321099 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0145e7a20 con 0x55b01468c840 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.637+0000 7f87dd7fa640 10 client.16119 handle_command_reply: tid=0 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 client.16119 shutdown 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 -- 172.21.15.42:0/2221321099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 msgr2=0x55b014688140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014688140 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f87f000e770 tx=0x7f87f00046c0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 -- 172.21.15.42:0/2221321099 shutdown_connections 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b01468c840 0x55b01468ece0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014688140 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146772e0 0x55b014681100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 --2- 172.21.15.42:0/2221321099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146769a0 0x55b014680bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 -- 172.21.15.42:0/2221321099 >> 172.21.15.42:0/2221321099 conn(0x55b014672010 msgr2=0x55b014673820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87dd7fa640 0 client.16119 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 -- 172.21.15.42:0/2221321099 shutdown_connections 2024-09-19T09:40:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 1 -- 172.21.15.42:0/2221321099 wait complete. 2024-09-19T09:40:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.638+0000 7f87fe87d740 20 client.16119 trim_cache size 0 max 16384 2024-09-19T09:40:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87fe87d740 1 Processor -- start 2024-09-19T09:40:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87fe87d740 1 -- start start 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146769a0 0x55b01467ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146772e0 0x55b014688100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014672ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87fe87d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41af500 con 0x55b01467c370 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87fe87d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41b1070 con 0x55b0146772e0 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87fe87d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41afbd0 con 0x55b0146769a0 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87f9081640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014672ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87f9081640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014672ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48012/0 (socket says 172.21.15.42:48012) 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87f9081640 1 -- 172.21.15.42:0/2951588443 learned_addr learned my addr 172.21.15.42:0/2951588443 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87f9081640 1 -- 172.21.15.42:0/2951588443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146769a0 msgr2=0x55b01467ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87f9081640 1 --2- 172.21.15.42:0/2951588443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146769a0 0x55b01467ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87f9081640 1 -- 172.21.15.42:0/2951588443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146772e0 msgr2=0x55b014688100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87f9882640 1 --2- 172.21.15.42:0/2951588443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146772e0 0x55b014688100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87f9081640 1 --2- 172.21.15.42:0/2951588443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146772e0 0x55b014688100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.653+0000 7f87f9081640 1 -- 172.21.15.42:0/2951588443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01468f360 con 0x55b01467c370 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87f9081640 1 --2- 172.21.15.42:0/2951588443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014672ec0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f87f000e010 tx=0x7f87f000bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fcc919e9fdac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87df7fe640 1 -- 172.21.15.42:0/2951588443 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f00037f0 con 0x55b01467c370 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87df7fe640 1 -- 172.21.15.42:0/2951588443 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87f000b460 con 0x55b01467c370 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87df7fe640 1 -- 172.21.15.42:0/2951588443 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f000db70 con 0x55b01467c370 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87fe87d740 1 -- 172.21.15.42:0/2951588443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 msgr2=0x55b014672ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87fe87d740 1 --2- 172.21.15.42:0/2951588443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014672ec0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f87f000e010 tx=0x7f87f000bbd0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87fe87d740 1 -- 172.21.15.42:0/2951588443 shutdown_connections 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87fe87d740 1 --2- 172.21.15.42:0/2951588443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b01467c370 0x55b014672ec0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87fe87d740 1 --2- 172.21.15.42:0/2951588443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146772e0 0x55b014688100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87fe87d740 1 --2- 172.21.15.42:0/2951588443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0146769a0 0x55b01467ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87fe87d740 1 -- 172.21.15.42:0/2951588443 >> 172.21.15.42:0/2951588443 conn(0x55b014672010 msgr2=0x55b01467f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87fe87d740 1 -- 172.21.15.42:0/2951588443 shutdown_connections 2024-09-19T09:40:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.654+0000 7f87fe87d740 1 -- 172.21.15.42:0/2951588443 wait complete. 2024-09-19T09:40:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87fe87d740 1 -- start start 2024-09-19T09:40:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87fe87d740 1 Processor -- start 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146769a0 0x55b014685790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146772e0 0x55b014685cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87fe87d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b01467c370 0x55b014686ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87fe87d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41b0970 con 0x55b0146769a0 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87fe87d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41b02a0 con 0x55b0146772e0 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87fe87d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41ad4e0 con 0x55b01467c370 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87fe87d740 10 client.0 _ll_register_callbacks cb 0x7f87f0011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87f9081640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146769a0 0x55b014685790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87f9081640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146769a0 0x55b014685790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48022/0 (socket says 172.21.15.42:48022) 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.655+0000 7f87f9081640 1 -- 172.21.15.42:0/270736783 learned_addr learned my addr 172.21.15.42:0/270736783 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87f9081640 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b01467c370 0x55b014686ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87f9882640 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146772e0 0x55b014685cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87f9081640 1 -- 172.21.15.42:0/270736783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b01467c370 msgr2=0x55b014686ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87f9081640 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b01467c370 0x55b014686ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87f9081640 1 -- 172.21.15.42:0/270736783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146772e0 msgr2=0x55b014685cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87f9081640 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146772e0 0x55b014685cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87f9081640 1 -- 172.21.15.42:0/270736783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0146872f0 con 0x55b0146769a0 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87f9081640 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146769a0 0x55b014685790 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f87f0000c00 tx=0x7f87f0005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c043d10a47a6cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87dd7fa640 1 -- 172.21.15.42:0/270736783 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0003de0 con 0x55b0146769a0 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87dd7fa640 1 -- 172.21.15.42:0/270736783 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f87f000db00 con 0x55b0146769a0 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87fe87d740 1 -- 172.21.15.42:0/270736783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87f000b460 con 0x55b0146769a0 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87dd7fa640 1 -- 172.21.15.42:0/270736783 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f87f000b820 con 0x55b0146769a0 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87fe87d740 10 client.16125 fetch_fsmap learned FSMap version 29 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87fe87d740 1 -- 172.21.15.42:0/270736783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b0146f7580 con 0x55b0146769a0 2024-09-19T09:40:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.656+0000 7f87dd7fa640 1 -- 172.21.15.42:0/270736783 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87f000b460 con 0x55b0146769a0 2024-09-19T09:40:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.657+0000 7f87dd7fa640 1 -- 172.21.15.42:0/270736783 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f87f0032030 con 0x55b0146769a0 2024-09-19T09:40:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.657+0000 7f87fe87d740 10 client.16125 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:40:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.657+0000 7f87fe87d740 10 client.16125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.657+0000 7f87fe87d740 20 client.16125 populate_metadata read hostname 'smithi042' 2024-09-19T09:40:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.657+0000 7f87fe87d740 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b0146f7df0 0x55b0146fa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.657+0000 7f87fe87d740 4 client.16125 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:40:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.657+0000 7f87fe87d740 1 -- 172.21.15.42:0/270736783 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b0145e1d70 con 0x55b0146f7df0 2024-09-19T09:40:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.657+0000 7f87f9882640 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b0146f7df0 0x55b0146fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.657+0000 7f87dd7fa640 10 client.16125 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.657+0000 7f87f9882640 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b0146f7df0 0x55b0146fa210 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2746c66d92000fbd server_cookie=424cd122793a6614 in_seq=0 out_seq=0 2024-09-19T09:40:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87dd7fa640 1 -- 172.21.15.42:0/270736783 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b0145e1d70 con 0x55b0146f7df0 2024-09-19T09:40:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87dd7fa640 10 client.16125 handle_command_reply: tid=0 2024-09-19T09:40:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 client.16125 shutdown 2024-09-19T09:40:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 -- 172.21.15.42:0/270736783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146769a0 msgr2=0x55b014685790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146769a0 0x55b014685790 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f87f0000c00 tx=0x7f87f0005da0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 -- 172.21.15.42:0/270736783 shutdown_connections 2024-09-19T09:40:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b0146f7df0 0x55b0146fa210 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b01467c370 0x55b014686ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0146772e0 0x55b014685cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 --2- 172.21.15.42:0/270736783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0146769a0 0x55b014685790 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87dd7fa640 0 client.16125 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:40:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 -- 172.21.15.42:0/270736783 >> 172.21.15.42:0/270736783 conn(0x55b014672010 msgr2=0x55b0146709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 -- 172.21.15.42:0/270736783 shutdown_connections 2024-09-19T09:40:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 1 -- 172.21.15.42:0/270736783 wait complete. 2024-09-19T09:40:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.666+0000 7f87fe87d740 20 client.16125 trim_cache size 0 max 16384 2024-09-19T09:40:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:40:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:40:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:40:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:40:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 -- 172.21.15.42:0/2057198294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f87e00a3370 msgr2=0x7f87e00a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f87e00a3370 0x7f87e00a5830 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0bd230 tx=0x7f87ec03d040 comp rx=0 tx=0).stop 2024-09-19T09:40:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 -- 172.21.15.42:0/2057198294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87f410e130 msgr2=0x7f87f41a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87f410e130 0x7f87f41a5870 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f87ec031ae0 tx=0x7f87ec031ee0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 -- 172.21.15.42:0/2057198294 shutdown_connections 2024-09-19T09:40:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f87e00a3370 0x7f87e00a5830 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87f410e130 0x7f87f41a5870 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f4076230 0x7f87f419e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 --2- 172.21.15.42:0/2057198294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87f4074c50 0x7f87f419e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 -- 172.21.15.42:0/2057198294 >> 172.21.15.42:0/2057198294 conn(0x7f87f40fd2e0 msgr2=0x7f87f41013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 -- 172.21.15.42:0/2057198294 shutdown_connections 2024-09-19T09:40:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:40:51.667+0000 7f87fbae6640 1 -- 172.21.15.42:0/2057198294 wait complete. 2024-09-19T09:40:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:52 smithi136 ceph-mon[34840]: pgmap v383: 97 pgs: 97 active+clean; 1.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 108 KiB/s wr, 14 op/s 2024-09-19T09:40:52.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:52 smithi042 ceph-mon[31223]: pgmap v383: 97 pgs: 97 active+clean; 1.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 108 KiB/s wr, 14 op/s 2024-09-19T09:40:52.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:52 smithi171 ceph-mon[35803]: pgmap v383: 97 pgs: 97 active+clean; 1.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 108 KiB/s wr, 14 op/s 2024-09-19T09:40:54.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:54 smithi042 ceph-mon[31223]: pgmap v384: 97 pgs: 97 active+clean; 5.9 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 448 KiB/s wr, 11 op/s 2024-09-19T09:40:54.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:54 smithi171 ceph-mon[35803]: pgmap v384: 97 pgs: 97 active+clean; 5.9 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 448 KiB/s wr, 11 op/s 2024-09-19T09:40:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:54 smithi136 ceph-mon[34840]: pgmap v384: 97 pgs: 97 active+clean; 5.9 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 448 KiB/s wr, 11 op/s 2024-09-19T09:40:56.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:56 smithi042 ceph-mon[31223]: pgmap v385: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 449 KiB/s wr, 14 op/s 2024-09-19T09:40:56.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:56 smithi171 ceph-mon[35803]: pgmap v385: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 449 KiB/s wr, 14 op/s 2024-09-19T09:40:56.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:56 smithi136 ceph-mon[34840]: pgmap v385: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 449 KiB/s wr, 14 op/s 2024-09-19T09:40:58.437 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:40:58 smithi136 ceph-mon[34840]: pgmap v386: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 448 KiB/s wr, 12 op/s 2024-09-19T09:40:58.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:40:58 smithi042 ceph-mon[31223]: pgmap v386: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 448 KiB/s wr, 12 op/s 2024-09-19T09:40:58.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:40:58 smithi171 ceph-mon[35803]: pgmap v386: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 448 KiB/s wr, 12 op/s 2024-09-19T09:41:00.399 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:00 smithi171 ceph-mon[35803]: pgmap v387: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 448 KiB/s wr, 14 op/s 2024-09-19T09:41:00.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:00 smithi042 ceph-mon[31223]: pgmap v387: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 448 KiB/s wr, 14 op/s 2024-09-19T09:41:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:00 smithi136 ceph-mon[34840]: pgmap v387: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 448 KiB/s wr, 14 op/s 2024-09-19T09:41:02.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:02 smithi042 ceph-mon[31223]: pgmap v388: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 446 KiB/s wr, 12 op/s 2024-09-19T09:41:02.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:02 smithi171 ceph-mon[35803]: pgmap v388: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 446 KiB/s wr, 12 op/s 2024-09-19T09:41:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:02 smithi136 ceph-mon[34840]: pgmap v388: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 446 KiB/s wr, 12 op/s 2024-09-19T09:41:04.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:04 smithi042 ceph-mon[31223]: pgmap v389: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 342 KiB/s wr, 11 op/s 2024-09-19T09:41:04.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:04 smithi171 ceph-mon[35803]: pgmap v389: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 342 KiB/s wr, 11 op/s 2024-09-19T09:41:04.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:04 smithi136 ceph-mon[34840]: pgmap v389: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 342 KiB/s wr, 11 op/s 2024-09-19T09:41:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.767+0000 7ff54509b640 1 -- 172.21.15.42:0/4253592309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff540107840 msgr2=0x7ff540109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.767+0000 7ff54509b640 1 --2- 172.21.15.42:0/4253592309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff540107840 0x7ff540109cb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff538009900 tx=0x7ff53802a410 comp rx=0 tx=0).stop 2024-09-19T09:41:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.767+0000 7ff54509b640 1 -- 172.21.15.42:0/4253592309 shutdown_connections 2024-09-19T09:41:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.767+0000 7ff54509b640 1 --2- 172.21.15.42:0/4253592309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff540107840 0x7ff540109cb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.768+0000 7ff54509b640 1 --2- 172.21.15.42:0/4253592309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff540104f10 0x7ff540107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.768+0000 7ff54509b640 1 --2- 172.21.15.42:0/4253592309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5401025e0 0x7ff5401049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.768+0000 7ff54509b640 1 -- 172.21.15.42:0/4253592309 >> 172.21.15.42:0/4253592309 conn(0x7ff5400fc1e0 msgr2=0x7ff5400fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.768+0000 7ff54509b640 1 -- 172.21.15.42:0/4253592309 shutdown_connections 2024-09-19T09:41:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.768+0000 7ff54509b640 1 -- 172.21.15.42:0/4253592309 wait complete. 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.768+0000 7ff54509b640 1 Processor -- start 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff54509b640 1 -- start start 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff54509b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5401025e0 0x7ff540101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff54509b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff540104f10 0x7ff540100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff54509b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff540107840 0x7ff540100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff54509b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff54010d800 con 0x7ff540104f10 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff54509b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff54010d680 con 0x7ff5401025e0 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff54509b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff54010d980 con 0x7ff540107840 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff53e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff540104f10 0x7ff540100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff53e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff540104f10 0x7ff540100590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40274/0 (socket says 172.21.15.42:40274) 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff53e59c640 1 -- 172.21.15.42:0/227287619 learned_addr learned my addr 172.21.15.42:0/227287619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5401025e0 0x7ff540101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff53f59e640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff540107840 0x7ff540100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.769+0000 7ff53e59c640 1 -- 172.21.15.42:0/227287619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff540107840 msgr2=0x7ff540100ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff53e59c640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff540107840 0x7ff540100ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff53e59c640 1 -- 172.21.15.42:0/227287619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5401025e0 msgr2=0x7ff540101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff53e59c640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5401025e0 0x7ff540101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff53e59c640 1 -- 172.21.15.42:0/227287619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff540101360 con 0x7ff540104f10 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5401025e0 0x7ff540101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff53e59c640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff540104f10 0x7ff540100590 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff53400d770 tx=0x7ff53400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff527fff640 1 -- 172.21.15.42:0/227287619 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534017070 con 0x7ff540104f10 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff527fff640 1 -- 172.21.15.42:0/227287619 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff534009c30 con 0x7ff540104f10 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff54509b640 1 -- 172.21.15.42:0/227287619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5401a1f20 con 0x7ff540104f10 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff527fff640 1 -- 172.21.15.42:0/227287619 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53400f620 con 0x7ff540104f10 2024-09-19T09:41:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.770+0000 7ff54509b640 1 -- 172.21.15.42:0/227287619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5401a2390 con 0x7ff540104f10 2024-09-19T09:41:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff547e32740 1 Processor -- start 2024-09-19T09:41:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff527fff640 1 -- 172.21.15.42:0/227287619 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff53401a070 con 0x7ff540104f10 2024-09-19T09:41:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff547e32740 1 -- start start 2024-09-19T09:41:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff547e32740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a59a0 0x563c9d7a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff547e32740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a62e0 0x563c9d7aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff547e32740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7ab370 0x563c9d7ad830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff547e32740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563c9d7092f0 con 0x563c9d7a62e0 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff547e32740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563c9d6b1270 con 0x563c9d7ab370 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff547e32740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563c9d7052b0 con 0x563c9d7a59a0 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a62e0 0x563c9d7aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a62e0 0x563c9d7aada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40290/0 (socket says 172.21.15.42:40290) 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53ed9d640 1 -- 172.21.15.42:0/2690188605 learned_addr learned my addr 172.21.15.42:0/2690188605 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53f59e640 1 --2- 172.21.15.42:0/2690188605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a59a0 0x563c9d7a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53e59c640 1 --2- 172.21.15.42:0/2690188605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7ab370 0x563c9d7ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53ed9d640 1 -- 172.21.15.42:0/2690188605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a59a0 msgr2=0x563c9d7a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/2690188605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a59a0 0x563c9d7a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53ed9d640 1 -- 172.21.15.42:0/2690188605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7ab370 msgr2=0x563c9d7ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/2690188605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7ab370 0x563c9d7ad830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53ed9d640 1 -- 172.21.15.42:0/2690188605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c9d6b0340 con 0x563c9d7a62e0 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.773+0000 7ff53e59c640 1 --2- 172.21.15.42:0/2690188605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7ab370 0x563c9d7ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.774+0000 7ff527fff640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff5280a3370 0x7ff5280a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.774+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/2690188605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a62e0 0x563c9d7aada0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff5300107e0 tx=0x7ff530010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b248b0b6bb760e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.774+0000 7ff53f59e640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff5280a3370 0x7ff5280a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.774+0000 7ff527fff640 1 -- 172.21.15.42:0/227287619 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ff5340cf2b0 con 0x7ff540104f10 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.774+0000 7ff5257fa640 1 -- 172.21.15.42:0/2690188605 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530016070 con 0x563c9d7a62e0 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.774+0000 7ff5257fa640 1 -- 172.21.15.42:0/2690188605 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff53001b460 con 0x563c9d7a62e0 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.774+0000 7ff5257fa640 1 -- 172.21.15.42:0/2690188605 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5300126b0 con 0x563c9d7a62e0 2024-09-19T09:41:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff53f59e640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff5280a3370 0x7ff5280a5830 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff538005ab0 tx=0x7ff5380315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 -- 172.21.15.42:0/2690188605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a62e0 msgr2=0x563c9d7aada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 --2- 172.21.15.42:0/2690188605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a62e0 0x563c9d7aada0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff5300107e0 tx=0x7ff530010ca0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 -- 172.21.15.42:0/2690188605 shutdown_connections 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 --2- 172.21.15.42:0/2690188605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7ab370 0x563c9d7ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 --2- 172.21.15.42:0/2690188605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a62e0 0x563c9d7aada0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 --2- 172.21.15.42:0/2690188605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a59a0 0x563c9d7a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 -- 172.21.15.42:0/2690188605 >> 172.21.15.42:0/2690188605 conn(0x563c9d7a1010 msgr2=0x563c9d7a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 -- 172.21.15.42:0/2690188605 shutdown_connections 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 -- 172.21.15.42:0/2690188605 wait complete. 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 -- start start 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.775+0000 7ff547e32740 1 Processor -- start 2024-09-19T09:41:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff547e32740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a59a0 0x563c9d7afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff547e32740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a62e0 0x563c9d7b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff547e32740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff547e32740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563c9d7ae340 con 0x563c9d7ab370 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff547e32740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563c9d692290 con 0x563c9d7a62e0 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff547e32740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563c9d7ae4c0 con 0x563c9d7a59a0 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff547e32740 10 client.0 _ll_register_callbacks cb 0x563c9d6c3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40292/0 (socket says 172.21.15.42:40292) 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53f59e640 1 -- 172.21.15.42:0/2437869247 learned_addr learned my addr 172.21.15.42:0/2437869247 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a59a0 0x563c9d7afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53e59c640 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a62e0 0x563c9d7b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53f59e640 1 -- 172.21.15.42:0/2437869247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a59a0 msgr2=0x563c9d7afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53f59e640 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a59a0 0x563c9d7afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53f59e640 1 -- 172.21.15.42:0/2437869247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a62e0 msgr2=0x563c9d7b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53f59e640 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a62e0 0x563c9d7b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53f59e640 1 -- 172.21.15.42:0/2437869247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c9d41c210 con 0x563c9d7ab370 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff53f59e640 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7b7140 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff538009900 tx=0x7ff538009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3911689c6a919d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff522ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.776+0000 7ff522ff5640 1 -- 172.21.15.42:0/2437869247 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53804d070 con 0x563c9d7ab370 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff522ff5640 1 -- 172.21.15.42:0/2437869247 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ff538003a00 con 0x563c9d7ab370 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff547e32740 1 -- 172.21.15.42:0/2437869247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff53001b460 con 0x563c9d7ab370 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff522ff5640 1 -- 172.21.15.42:0/2437869247 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff538059050 con 0x563c9d7ab370 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff547e32740 10 client.16137 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff547e32740 1 -- 172.21.15.42:0/2437869247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c9d4e8620 con 0x563c9d7ab370 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff522ff5640 1 -- 172.21.15.42:0/2437869247 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff53001b460 con 0x563c9d7ab370 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff522ff5640 1 -- 172.21.15.42:0/2437869247 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7ff53803c440 con 0x563c9d7ab370 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff547e32740 10 client.16137 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff547e32740 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff547e32740 20 client.16137 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff547e32740 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563c9d7bb7c0 0x563c9d7bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff547e32740 4 client.16137 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff547e32740 1 -- 172.21.15.42:0/2437869247 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c9d716a20 con 0x563c9d7bb7c0 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.777+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563c9d7bb7c0 0x563c9d7bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.778+0000 7ff522ff5640 10 client.16137 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.778+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563c9d7bb7c0 0x563c9d7bdc00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7ad7087b8ba96da server_cookie=c0a7b0907fd65160 in_seq=0 out_seq=0 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff522ff5640 1 -- 172.21.15.42:0/2437869247 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c9d716a20 con 0x563c9d7bb7c0 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff522ff5640 10 client.16137 handle_command_reply: tid=0 2024-09-19T09:41:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 client.16137 shutdown 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 -- 172.21.15.42:0/2437869247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 msgr2=0x563c9d7b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7b7140 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff538009900 tx=0x7ff538009260 comp rx=0 tx=0).stop 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 -- 172.21.15.42:0/2437869247 shutdown_connections 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563c9d7bb7c0 0x563c9d7bdc00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7b7140 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a62e0 0x563c9d7b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff522ff5640 0 client.16137 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 --2- 172.21.15.42:0/2437869247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a59a0 0x563c9d7afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 -- 172.21.15.42:0/2437869247 >> 172.21.15.42:0/2437869247 conn(0x563c9d7a1010 msgr2=0x563c9d7a2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 -- 172.21.15.42:0/2437869247 shutdown_connections 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 1 -- 172.21.15.42:0/2437869247 wait complete. 2024-09-19T09:41:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.779+0000 7ff547e32740 20 client.16137 trim_cache size 0 max 16384 2024-09-19T09:41:04.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff547e32740 1 Processor -- start 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff547e32740 1 -- start start 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff547e32740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a59a0 0x563c9d7a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff547e32740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a62e0 0x563c9d7b7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff547e32740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7a2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff547e32740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5401ab330 con 0x563c9d7ab370 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff547e32740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff5401acea0 con 0x563c9d7a59a0 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff547e32740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff5401aba00 con 0x563c9d7a62e0 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff53f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff53f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7a2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40306/0 (socket says 172.21.15.42:40306) 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff53f59e640 1 -- 172.21.15.42:0/3397280649 learned_addr learned my addr 172.21.15.42:0/3397280649 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff53f59e640 1 -- 172.21.15.42:0/3397280649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a62e0 msgr2=0x563c9d7b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/3397280649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a59a0 0x563c9d7a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff53f59e640 1 --2- 172.21.15.42:0/3397280649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a62e0 0x563c9d7b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff53f59e640 1 -- 172.21.15.42:0/3397280649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a59a0 msgr2=0x563c9d7a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff53f59e640 1 --2- 172.21.15.42:0/3397280649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a59a0 0x563c9d7a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.794+0000 7ff53f59e640 1 -- 172.21.15.42:0/3397280649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c9d7a1ca0 con 0x563c9d7ab370 2024-09-19T09:41:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff53f59e640 1 --2- 172.21.15.42:0/3397280649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7a2400 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff53803c7e0 tx=0x7ff5380043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6330ff593ed608b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff524ff9640 1 -- 172.21.15.42:0/3397280649 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53804d040 con 0x563c9d7ab370 2024-09-19T09:41:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff524ff9640 1 -- 172.21.15.42:0/3397280649 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff538062070 con 0x563c9d7ab370 2024-09-19T09:41:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff524ff9640 1 -- 172.21.15.42:0/3397280649 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538035040 con 0x563c9d7ab370 2024-09-19T09:41:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff547e32740 1 -- 172.21.15.42:0/3397280649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 msgr2=0x563c9d7a2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff547e32740 1 --2- 172.21.15.42:0/3397280649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7a2400 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff53803c7e0 tx=0x7ff5380043b0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff547e32740 1 -- 172.21.15.42:0/3397280649 shutdown_connections 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff547e32740 1 --2- 172.21.15.42:0/3397280649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7ab370 0x563c9d7a2400 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff547e32740 1 --2- 172.21.15.42:0/3397280649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7a62e0 0x563c9d7b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff547e32740 1 --2- 172.21.15.42:0/3397280649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a59a0 0x563c9d7a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff547e32740 1 -- 172.21.15.42:0/3397280649 >> 172.21.15.42:0/3397280649 conn(0x563c9d7a1010 msgr2=0x563c9d7afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff547e32740 1 -- 172.21.15.42:0/3397280649 shutdown_connections 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.795+0000 7ff547e32740 1 -- 172.21.15.42:0/3397280649 wait complete. 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff547e32740 1 -- start start 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff547e32740 1 Processor -- start 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff547e32740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a59a0 0x563c9d7b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff547e32740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a62e0 0x563c9d7b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff547e32740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7ab370 0x563c9d7b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff547e32740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5401ac7a0 con 0x563c9d7a59a0 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff547e32740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff5401ac0d0 con 0x563c9d7a62e0 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff547e32740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff5401a9310 con 0x563c9d7ab370 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff547e32740 10 client.0 _ll_register_callbacks cb 0x7ff538009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff53ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a59a0 0x563c9d7b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff53ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a59a0 0x563c9d7b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40308/0 (socket says 172.21.15.42:40308) 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff53ed9d640 1 -- 172.21.15.42:0/2234492728 learned_addr learned my addr 172.21.15.42:0/2234492728 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff53e59c640 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a62e0 0x563c9d7b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff53ed9d640 1 -- 172.21.15.42:0/2234492728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7ab370 msgr2=0x563c9d7b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7ab370 0x563c9d7b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff53ed9d640 1 -- 172.21.15.42:0/2234492728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a62e0 msgr2=0x563c9d7b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a62e0 0x563c9d7b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.796+0000 7ff53ed9d640 1 -- 172.21.15.42:0/2234492728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c9d7b68c0 con 0x563c9d7a59a0 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff53ed9d640 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a59a0 0x563c9d7b4d60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff53000e6c0 tx=0x7ff5300094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b52a351ef77f272 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff522ff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff522ff5640 1 -- 172.21.15.42:0/2234492728 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53002b020 con 0x563c9d7a59a0 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff522ff5640 1 -- 172.21.15.42:0/2234492728 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ff53000ead0 con 0x563c9d7a59a0 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff547e32740 1 -- 172.21.15.42:0/2234492728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff538062070 con 0x563c9d7a59a0 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff522ff5640 1 -- 172.21.15.42:0/2234492728 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff530036050 con 0x563c9d7a59a0 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff547e32740 10 client.16143 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff547e32740 1 -- 172.21.15.42:0/2234492728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c9d826b10 con 0x563c9d7a59a0 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff522ff5640 1 -- 172.21.15.42:0/2234492728 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff538062070 con 0x563c9d7a59a0 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff522ff5640 1 -- 172.21.15.42:0/2234492728 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7ff53000f040 con 0x563c9d7a59a0 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff547e32740 10 client.16143 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff547e32740 10 client.16143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff547e32740 20 client.16143 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff547e32740 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563c9d827290 0x563c9d8296b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff547e32740 4 client.16143 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:41:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.797+0000 7ff547e32740 1 -- 172.21.15.42:0/2234492728 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c9d710d70 con 0x563c9d827290 2024-09-19T09:41:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.798+0000 7ff53e59c640 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563c9d827290 0x563c9d8296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.798+0000 7ff522ff5640 10 client.16143 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.798+0000 7ff53e59c640 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563c9d827290 0x563c9d8296b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f320bebf0916abbc server_cookie=d539d90a3ccc87be in_seq=0 out_seq=0 2024-09-19T09:41:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff522ff5640 1 -- 172.21.15.42:0/2234492728 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c9d710d70 con 0x563c9d827290 2024-09-19T09:41:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff522ff5640 10 client.16143 handle_command_reply: tid=0 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 client.16143 shutdown 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 -- 172.21.15.42:0/2234492728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a59a0 msgr2=0x563c9d7b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a59a0 0x563c9d7b4d60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff53000e6c0 tx=0x7ff5300094b0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 -- 172.21.15.42:0/2234492728 shutdown_connections 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563c9d827290 0x563c9d8296b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c9d7ab370 0x563c9d7b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563c9d7a62e0 0x563c9d7b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff522ff5640 0 client.16143 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 --2- 172.21.15.42:0/2234492728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c9d7a59a0 0x563c9d7b4d60 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 -- 172.21.15.42:0/2234492728 >> 172.21.15.42:0/2234492728 conn(0x563c9d7a1010 msgr2=0x563c9d79f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 -- 172.21.15.42:0/2234492728 shutdown_connections 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.805+0000 7ff547e32740 1 -- 172.21.15.42:0/2234492728 wait complete. 2024-09-19T09:41:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff547e32740 20 client.16143 trim_cache size 0 max 16384 2024-09-19T09:41:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:41:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:41:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:41:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:41:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 -- 172.21.15.42:0/227287619 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff5280a3370 msgr2=0x7ff5280a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff5280a3370 0x7ff5280a5830 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff538005ab0 tx=0x7ff5380315b0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 -- 172.21.15.42:0/227287619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff540104f10 msgr2=0x7ff540100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff540104f10 0x7ff540100590 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff53400d770 tx=0x7ff53400dc30 comp rx=0 tx=0).stop 2024-09-19T09:41:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 -- 172.21.15.42:0/227287619 shutdown_connections 2024-09-19T09:41:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ff5280a3370 0x7ff5280a5830 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff540107840 0x7ff540100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff540104f10 0x7ff540100590 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 --2- 172.21.15.42:0/227287619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5401025e0 0x7ff540101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:04.811 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 -- 172.21.15.42:0/227287619 >> 172.21.15.42:0/227287619 conn(0x7ff5400fc1e0 msgr2=0x7ff540102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:04.811 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 -- 172.21.15.42:0/227287619 shutdown_connections 2024-09-19T09:41:04.811 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:04.806+0000 7ff54509b640 1 -- 172.21.15.42:0/227287619 wait complete. 2024-09-19T09:41:05.208 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:41:05.245 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:41:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:05.530 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.141+0000 7f77a2ad9640 1 -- 172.21.15.42:0/1910706954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f779c106a90 msgr2=0x7f779c106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.141+0000 7f77a2ad9640 1 --2- 172.21.15.42:0/1910706954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f779c106a90 0x7f779c106e70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f778c009930 tx=0x7f778c02a420 comp rx=0 tx=0).stop 2024-09-19T09:41:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.141+0000 7f77a2ad9640 1 -- 172.21.15.42:0/1910706954 shutdown_connections 2024-09-19T09:41:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.141+0000 7f77a2ad9640 1 --2- 172.21.15.42:0/1910706954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f779c101430 0x7f779c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.141+0000 7f77a2ad9640 1 --2- 172.21.15.42:0/1910706954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c100a90 0x7f779c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.141+0000 7f77a2ad9640 1 --2- 172.21.15.42:0/1910706954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f779c106a90 0x7f779c106e70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.141+0000 7f77a2ad9640 1 -- 172.21.15.42:0/1910706954 >> 172.21.15.42:0/1910706954 conn(0x7f779c0fc7d0 msgr2=0x7f779c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.141+0000 7f77a2ad9640 1 -- 172.21.15.42:0/1910706954 shutdown_connections 2024-09-19T09:41:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.141+0000 7f77a2ad9640 1 -- 172.21.15.42:0/1910706954 wait complete. 2024-09-19T09:41:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a2ad9640 1 Processor -- start 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a2ad9640 1 -- start start 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a2ad9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f779c100a90 0x7f779c1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a2ad9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c101430 0x7f779c197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a2ad9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f779c106a90 0x7f779c197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a2ad9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f779c110e90 con 0x7f779c106a90 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a2ad9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f779c110d10 con 0x7f779c101430 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a2ad9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f779c111010 con 0x7f779c100a90 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a1076640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f779c106a90 0x7f779c197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a1076640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f779c106a90 0x7f779c197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40314/0 (socket says 172.21.15.42:40314) 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a1076640 1 -- 172.21.15.42:0/446990029 learned_addr learned my addr 172.21.15.42:0/446990029 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a0875640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f779c100a90 0x7f779c1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f779bfff640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c101430 0x7f779c197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a1076640 1 -- 172.21.15.42:0/446990029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f779c100a90 msgr2=0x7f779c1970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a1076640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f779c100a90 0x7f779c1970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a1076640 1 -- 172.21.15.42:0/446990029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c101430 msgr2=0x7f779c197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a1076640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c101430 0x7f779c197630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.142+0000 7f77a1076640 1 -- 172.21.15.42:0/446990029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c1a6960 con 0x7f779c106a90 2024-09-19T09:41:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.143+0000 7f77a1076640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f779c106a90 0x7f779c197b70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7794009fd0 tx=0x7f779400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.143+0000 7f7799ffb640 1 -- 172.21.15.42:0/446990029 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794017070 con 0x7f779c106a90 2024-09-19T09:41:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.143+0000 7f7799ffb640 1 -- 172.21.15.42:0/446990029 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7794003e50 con 0x7f779c106a90 2024-09-19T09:41:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.143+0000 7f7799ffb640 1 -- 172.21.15.42:0/446990029 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77940106c0 con 0x7f779c106a90 2024-09-19T09:41:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.143+0000 7f77a2ad9640 1 -- 172.21.15.42:0/446990029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779c1a6c50 con 0x7f779c106a90 2024-09-19T09:41:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.143+0000 7f77a2ad9640 1 -- 172.21.15.42:0/446990029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f779c1a7140 con 0x7f779c106a90 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.145+0000 7f7799ffb640 1 -- 172.21.15.42:0/446990029 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f7794003970 con 0x7f779c106a90 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a4eb2740 1 Processor -- start 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a4eb2740 1 -- start start 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e1604a0 0x55855e160880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e16b680 0x55855e16da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55855e0c62e0 con 0x55855e160dc0 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55855e06dce0 con 0x55855e16b680 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55855e0c22a0 con 0x55855e1604a0 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a0875640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a0875640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40318/0 (socket says 172.21.15.42:40318) 2024-09-19T09:41:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a0875640 1 -- 172.21.15.42:0/1609140612 learned_addr learned my addr 172.21.15.42:0/1609140612 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f7799ffb640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77880a32c0 0x7f77880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f779bfff640 1 --2- 172.21.15.42:0/1609140612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e1604a0 0x55855e160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f779bfff640 1 --2- 172.21.15.42:0/1609140612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e16b680 0x55855e16da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a0875640 1 -- 172.21.15.42:0/1609140612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e1604a0 msgr2=0x55855e160880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a0875640 1 --2- 172.21.15.42:0/1609140612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e1604a0 0x55855e160880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a0875640 1 -- 172.21.15.42:0/1609140612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e16b680 msgr2=0x55855e16da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a0875640 1 --2- 172.21.15.42:0/1609140612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e16b680 0x55855e16da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a0875640 1 -- 172.21.15.42:0/1609140612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55855e052440 con 0x55855e160dc0 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.146+0000 7f77a1076640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77880a32c0 0x7f77880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.147+0000 7f77a0875640 1 --2- 172.21.15.42:0/1609140612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16b140 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f778c02a940 tx=0x7f778c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bd9e0b70b24906 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.147+0000 7f7799ffb640 1 -- 172.21.15.42:0/446990029 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f77940cf630 con 0x7f779c106a90 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.147+0000 7f7792ffd640 1 -- 172.21.15.42:0/1609140612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c040070 con 0x55855e160dc0 2024-09-19T09:41:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.147+0000 7f7792ffd640 1 -- 172.21.15.42:0/1609140612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f778c0319f0 con 0x55855e160dc0 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.147+0000 7f7792ffd640 1 -- 172.21.15.42:0/1609140612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c035040 con 0x55855e160dc0 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1609140612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 msgr2=0x55855e16b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a1076640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77880a32c0 0x7f77880a5780 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7794097fe0 tx=0x7f77940bbf90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/1609140612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16b140 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f778c02a940 tx=0x7f778c005c00 comp rx=0 tx=0).stop 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1609140612 shutdown_connections 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/1609140612 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e16b680 0x55855e16da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/1609140612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16b140 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/1609140612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e1604a0 0x55855e160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1609140612 >> 172.21.15.42:0/1609140612 conn(0x55855e15ca30 msgr2=0x55855e15ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1609140612 shutdown_connections 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1609140612 wait complete. 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 -- start start 2024-09-19T09:41:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 Processor -- start 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e1604a0 0x55855e16ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.148+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e160dc0 0x55855e1680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e16b680 0x55855e1685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55855e16e250 con 0x55855e16b680 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55855e081050 con 0x55855e1604a0 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55855e16e3d0 con 0x55855e160dc0 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f77a4eb2740 10 client.0 _ll_register_callbacks cb 0x55855e0c1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f779bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e1604a0 0x55855e16ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f779bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e16b680 0x55855e1685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f779bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e16b680 0x55855e1685f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40322/0 (socket says 172.21.15.42:40322) 2024-09-19T09:41:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f77a0875640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e160dc0 0x55855e1680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f779bfff640 1 -- 172.21.15.42:0/3789242985 learned_addr learned my addr 172.21.15.42:0/3789242985 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f779bfff640 1 -- 172.21.15.42:0/3789242985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e160dc0 msgr2=0x55855e1680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f779bfff640 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e160dc0 0x55855e1680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f779bfff640 1 -- 172.21.15.42:0/3789242985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e1604a0 msgr2=0x55855e16ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f779bfff640 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e1604a0 0x55855e16ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f779bfff640 1 -- 172.21.15.42:0/3789242985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55855de373c0 con 0x55855e16b680 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f779bfff640 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e16b680 0x55855e1685f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7784014f90 tx=0x7f77840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db64809dd91a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f777bfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f777bfff640 1 -- 172.21.15.42:0/3789242985 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784014110 con 0x55855e16b680 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f777bfff640 1 -- 172.21.15.42:0/3789242985 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7784005020 con 0x55855e16b680 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.149+0000 7f77a4eb2740 1 -- 172.21.15.42:0/3789242985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f778c0319f0 con 0x55855e16b680 2024-09-19T09:41:06.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.150+0000 7f777bfff640 1 -- 172.21.15.42:0/3789242985 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f77840142b0 con 0x55855e16b680 2024-09-19T09:41:06.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.150+0000 7f77a4eb2740 10 client.16155 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:06.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.150+0000 7f77a4eb2740 1 -- 172.21.15.42:0/3789242985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55855e179a60 con 0x55855e16b680 2024-09-19T09:41:06.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.153+0000 7f777bfff640 1 -- 172.21.15.42:0/3789242985 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f778c0319f0 con 0x55855e16b680 2024-09-19T09:41:06.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.153+0000 7f777bfff640 1 -- 172.21.15.42:0/3789242985 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f7784012450 con 0x55855e16b680 2024-09-19T09:41:06.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.153+0000 7f77a4eb2740 10 client.16155 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:06.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.153+0000 7f77a4eb2740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:06.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.153+0000 7f77a4eb2740 20 client.16155 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:06.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.153+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55855e17af20 0x55855e17d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.153+0000 7f77a4eb2740 4 client.16155 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:06.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.153+0000 7f77a4eb2740 1 -- 172.21.15.42:0/3789242985 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55855e0d3850 con 0x55855e17af20 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.153+0000 7f77a0875640 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55855e17af20 0x55855e17d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.154+0000 7f77a0875640 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55855e17af20 0x55855e17d380 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6409d503f6f052 server_cookie=b711438e40923baa in_seq=0 out_seq=0 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.154+0000 7f777bfff640 10 client.16155 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.154+0000 7f777bfff640 1 -- 172.21.15.42:0/3789242985 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55855e0d3850 con 0x55855e17af20 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f777bfff640 10 client.16155 handle_command_reply: tid=0 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 client.16155 shutdown 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 -- 172.21.15.42:0/3789242985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e16b680 msgr2=0x55855e1685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e16b680 0x55855e1685f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7784014f90 tx=0x7f77840046c0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 -- 172.21.15.42:0/3789242985 shutdown_connections 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55855e17af20 0x55855e17d380 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e16b680 0x55855e1685f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e160dc0 0x55855e1680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/3789242985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e1604a0 0x55855e16ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 -- 172.21.15.42:0/3789242985 >> 172.21.15.42:0/3789242985 conn(0x55855e15ca30 msgr2=0x55855e162710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f777bfff640 0 client.16155 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 -- 172.21.15.42:0/3789242985 shutdown_connections 2024-09-19T09:41:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 1 -- 172.21.15.42:0/3789242985 wait complete. 2024-09-19T09:41:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.155+0000 7f77a4eb2740 20 client.16155 trim_cache size 0 max 16384 2024-09-19T09:41:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.172+0000 7f77a4eb2740 1 Processor -- start 2024-09-19T09:41:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.172+0000 7f77a4eb2740 1 -- start start 2024-09-19T09:41:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.172+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e1604a0 0x55855e1675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 0x55855e182c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f779c1af890 con 0x55855e160dc0 2024-09-19T09:41:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f779c1b1400 con 0x55855e1604a0 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f779c1aff60 con 0x55855e16b680 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a0875640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a0875640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40338/0 (socket says 172.21.15.42:40338) 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a0875640 1 -- 172.21.15.42:0/525136879 learned_addr learned my addr 172.21.15.42:0/525136879 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f779bfff640 1 --2- 172.21.15.42:0/525136879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e1604a0 0x55855e1675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f779bfff640 1 --2- 172.21.15.42:0/525136879 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 0x55855e182c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a0875640 1 -- 172.21.15.42:0/525136879 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 msgr2=0x55855e182c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a0875640 1 --2- 172.21.15.42:0/525136879 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 0x55855e182c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a0875640 1 -- 172.21.15.42:0/525136879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e1604a0 msgr2=0x55855e1675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a0875640 1 --2- 172.21.15.42:0/525136879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e1604a0 0x55855e1675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a0875640 1 -- 172.21.15.42:0/525136879 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55855e16b170 con 0x55855e160dc0 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f779bfff640 1 --2- 172.21.15.42:0/525136879 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 0x55855e182c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77a0875640 1 --2- 172.21.15.42:0/525136879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16a020 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55855e15d890 tx=0x7f778c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d99c0753bee227b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77927fc640 1 -- 172.21.15.42:0/525136879 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c040040 con 0x55855e160dc0 2024-09-19T09:41:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77927fc640 1 -- 172.21.15.42:0/525136879 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f778c0035f0 con 0x55855e160dc0 2024-09-19T09:41:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.173+0000 7f77927fc640 1 -- 172.21.15.42:0/525136879 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c035040 con 0x55855e160dc0 2024-09-19T09:41:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.174+0000 7f77a4eb2740 1 -- 172.21.15.42:0/525136879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 msgr2=0x55855e16a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.174+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/525136879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16a020 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55855e15d890 tx=0x7f778c02a420 comp rx=0 tx=0).stop 2024-09-19T09:41:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.174+0000 7f77a4eb2740 1 -- 172.21.15.42:0/525136879 shutdown_connections 2024-09-19T09:41:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.174+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/525136879 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 0x55855e182c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.174+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/525136879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e160dc0 0x55855e16a020 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.174+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/525136879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e1604a0 0x55855e1675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.174+0000 7f77a4eb2740 1 -- 172.21.15.42:0/525136879 >> 172.21.15.42:0/525136879 conn(0x55855e15ca30 msgr2=0x55855e169910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.174+0000 7f77a4eb2740 1 -- 172.21.15.42:0/525136879 shutdown_connections 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.174+0000 7f77a4eb2740 1 -- 172.21.15.42:0/525136879 wait complete. 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.174+0000 7f77a4eb2740 1 -- start start 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f77a4eb2740 1 Processor -- start 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e1604a0 0x55855e162bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e160dc0 0x55855e163100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f77a4eb2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 0x55855e163640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f779c1b0d00 con 0x55855e1604a0 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f779c1b0630 con 0x55855e160dc0 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f77a4eb2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f779c1ad870 con 0x55855e16b680 2024-09-19T09:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f77a4eb2740 10 client.0 _ll_register_callbacks cb 0x7f7784014ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f779bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e1604a0 0x55855e162bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f779bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e1604a0 0x55855e162bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40346/0 (socket says 172.21.15.42:40346) 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f779bfff640 1 -- 172.21.15.42:0/1481284556 learned_addr learned my addr 172.21.15.42:0/1481284556 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f779bfff640 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 0x55855e163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f77a0875640 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e160dc0 0x55855e163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f779bfff640 1 -- 172.21.15.42:0/1481284556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 msgr2=0x55855e163640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f779bfff640 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 0x55855e163640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f779bfff640 1 -- 172.21.15.42:0/1481284556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e160dc0 msgr2=0x55855e163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f779bfff640 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e160dc0 0x55855e163100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.175+0000 7f779bfff640 1 -- 172.21.15.42:0/1481284556 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55855e171b40 con 0x55855e1604a0 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.176+0000 7f779bfff640 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e1604a0 0x55855e162bc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7784005fd0 tx=0x7f7784014c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802ae3e1ff0492b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.176+0000 7f777bfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.176+0000 7f777bfff640 1 -- 172.21.15.42:0/1481284556 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784012450 con 0x55855e1604a0 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.176+0000 7f777bfff640 1 -- 172.21.15.42:0/1481284556 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f77840125f0 con 0x55855e1604a0 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.176+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1481284556 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f778c0035f0 con 0x55855e1604a0 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.176+0000 7f777bfff640 1 -- 172.21.15.42:0/1481284556 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7784004020 con 0x55855e1604a0 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.176+0000 7f77a4eb2740 10 client.16161 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.176+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1481284556 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55855e1e5e90 con 0x55855e1604a0 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.176+0000 7f777bfff640 1 -- 172.21.15.42:0/1481284556 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f778c0035f0 con 0x55855e1604a0 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.176+0000 7f777bfff640 1 -- 172.21.15.42:0/1481284556 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f778402c460 con 0x55855e1604a0 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f77a4eb2740 10 client.16161 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f77a4eb2740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f77a4eb2740 20 client.16161 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55855e1e65c0 0x55855e1e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f77a4eb2740 4 client.16161 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1481284556 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55855e0cdd60 con 0x55855e1e65c0 2024-09-19T09:41:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f77a0875640 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55855e1e65c0 0x55855e1e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f77a0875640 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55855e1e65c0 0x55855e1e89e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef03436f42771263 server_cookie=88a4d0d7d684fc7f in_seq=0 out_seq=0 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f777bfff640 10 client.16161 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f777bfff640 1 -- 172.21.15.42:0/1481284556 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55855e0cdd60 con 0x55855e1e65c0 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f777bfff640 10 client.16161 handle_command_reply: tid=0 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.177+0000 7f77a4eb2740 1 client.16161 shutdown 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1481284556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e1604a0 msgr2=0x55855e162bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e1604a0 0x55855e162bc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7784005fd0 tx=0x7f7784014c50 comp rx=0 tx=0).stop 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1481284556 shutdown_connections 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55855e1e65c0 0x55855e1e89e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55855e16b680 0x55855e163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55855e160dc0 0x55855e163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 1 --2- 172.21.15.42:0/1481284556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55855e1604a0 0x55855e162bc0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1481284556 >> 172.21.15.42:0/1481284556 conn(0x55855e15ca30 msgr2=0x55855e15bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f777bfff640 0 client.16161 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:06.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1481284556 shutdown_connections 2024-09-19T09:41:06.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 1 -- 172.21.15.42:0/1481284556 wait complete. 2024-09-19T09:41:06.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.178+0000 7f77a4eb2740 20 client.16161 trim_cache size 0 max 16384 2024-09-19T09:41:06.185 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:41:06.185 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-19T09:41:06.185 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-09-19T09:41:06.185 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:41:06.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 -- 172.21.15.42:0/446990029 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77880a32c0 msgr2=0x7f77880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77880a32c0 0x7f77880a5780 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7794097fe0 tx=0x7f77940bbf90 comp rx=0 tx=0).stop 2024-09-19T09:41:06.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 -- 172.21.15.42:0/446990029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f779c106a90 msgr2=0x7f779c197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f779c106a90 0x7f779c197b70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7794009fd0 tx=0x7f779400b260 comp rx=0 tx=0).stop 2024-09-19T09:41:06.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 -- 172.21.15.42:0/446990029 shutdown_connections 2024-09-19T09:41:06.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f77880a32c0 0x7f77880a5780 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f779c106a90 0x7f779c197b70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c101430 0x7f779c197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 --2- 172.21.15.42:0/446990029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f779c100a90 0x7f779c1970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 -- 172.21.15.42:0/446990029 >> 172.21.15.42:0/446990029 conn(0x7f779c0fc7d0 msgr2=0x7f779c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 -- 172.21.15.42:0/446990029 shutdown_connections 2024-09-19T09:41:06.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.179+0000 7f77a2ad9640 1 -- 172.21.15.42:0/446990029 wait complete. 2024-09-19T09:41:06.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:06 smithi042 ceph-mon[31223]: pgmap v390: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-19T09:41:06.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:06 smithi171 ceph-mon[35803]: pgmap v390: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-19T09:41:06.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:06 smithi136 ceph-mon[34840]: pgmap v390: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-19T09:41:06.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.346+0000 7f6380ff5640 1 -- 172.21.15.42:0/2264980110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637c106f10 msgr2=0x7f637c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.346+0000 7f6380ff5640 1 --2- 172.21.15.42:0/2264980110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637c106f10 0x7f637c10ea90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6374009ca0 tx=0x7f637402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.346+0000 7f6380ff5640 1 -- 172.21.15.42:0/2264980110 shutdown_connections 2024-09-19T09:41:06.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.346+0000 7f6380ff5640 1 --2- 172.21.15.42:0/2264980110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637c106f10 0x7f637c10ea90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.346+0000 7f6380ff5640 1 --2- 172.21.15.42:0/2264980110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f637c102790 0x7f637c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.346+0000 7f6380ff5640 1 --2- 172.21.15.42:0/2264980110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f637c101de0 0x7f637c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.346+0000 7f6380ff5640 1 -- 172.21.15.42:0/2264980110 >> 172.21.15.42:0/2264980110 conn(0x7f637c0fd8c0 msgr2=0x7f637c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.346+0000 7f6380ff5640 1 -- 172.21.15.42:0/2264980110 shutdown_connections 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.346+0000 7f6380ff5640 1 -- 172.21.15.42:0/2264980110 wait complete. 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.347+0000 7f6380ff5640 1 Processor -- start 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.347+0000 7f6380ff5640 1 -- start start 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6380ff5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f637c101de0 0x7f637c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6380ff5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637c102790 0x7f637c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6380ff5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f637c106f10 0x7f637c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6380ff5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f637c111f70 con 0x7f637c102790 2024-09-19T09:41:06.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6380ff5640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f637c111df0 con 0x7f637c101de0 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6380ff5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f637c1120f0 con 0x7f637c106f10 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6379d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637c102790 0x7f637c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6379d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637c102790 0x7f637c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40354/0 (socket says 172.21.15.42:40354) 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6379d9b640 1 -- 172.21.15.42:0/533134006 learned_addr learned my addr 172.21.15.42:0/533134006 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f637a59c640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f637c101de0 0x7f637c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f637ad9d640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f637c106f10 0x7f637c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6379d9b640 1 -- 172.21.15.42:0/533134006 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f637c106f10 msgr2=0x7f637c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6379d9b640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f637c106f10 0x7f637c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6379d9b640 1 -- 172.21.15.42:0/533134006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f637c101de0 msgr2=0x7f637c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6379d9b640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f637c101de0 0x7f637c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.348+0000 7f6379d9b640 1 -- 172.21.15.42:0/533134006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c19d380 con 0x7f637c102790 2024-09-19T09:41:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.349+0000 7f6379d9b640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637c102790 0x7f637c198910 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f637000d950 tx=0x7f637000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.349+0000 7f636b7fe640 1 -- 172.21.15.42:0/533134006 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370017070 con 0x7f637c102790 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.349+0000 7f6380ff5640 1 -- 172.21.15.42:0/533134006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637c19d670 con 0x7f637c102790 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.349+0000 7f636b7fe640 1 -- 172.21.15.42:0/533134006 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6370009c30 con 0x7f637c102790 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.349+0000 7f636b7fe640 1 -- 172.21.15.42:0/533134006 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637000f6b0 con 0x7f637c102790 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.349+0000 7f6380ff5640 1 -- 172.21.15.42:0/533134006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f637c1a4f50 con 0x7f637c102790 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.350+0000 7f6380ff5640 1 -- 172.21.15.42:0/533134006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f637c1021c0 con 0x7f637c102790 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.351+0000 7f636b7fe640 1 -- 172.21.15.42:0/533134006 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f63700109d0 con 0x7f637c102790 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.352+0000 7f636b7fe640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f63640a3240 0x7f63640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.352+0000 7f637a59c640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f63640a3240 0x7f63640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.352+0000 7f636b7fe640 1 -- 172.21.15.42:0/533134006 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f63700cf4e0 con 0x7f637c102790 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.352+0000 7f637a59c640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f63640a3240 0x7f63640a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f636c005fd0 tx=0x7f636c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.356+0000 7f636b7fe640 1 -- 172.21.15.42:0/533134006 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6370009de0 con 0x7f637c102790 2024-09-19T09:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.570+0000 7f6380ff5640 1 -- 172.21.15.42:0/533134006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f637c10a1b0 con 0x7f637c102790 2024-09-19T09:41:06.707 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:41:06.707 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"btime":"2024-09-19T09:40:47:118091+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:40:46.427379+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:41:06.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.570+0000 7f636b7fe640 1 -- 172.21.15.42:0/533134006 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f637009bb30 con 0x7f637c102790 2024-09-19T09:41:06.707 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-09-19T09:41:06.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 -- 172.21.15.42:0/533134006 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f63640a3240 msgr2=0x7f63640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f63640a3240 0x7f63640a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f636c005fd0 tx=0x7f636c00b390 comp rx=0 tx=0).stop 2024-09-19T09:41:06.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 -- 172.21.15.42:0/533134006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637c102790 msgr2=0x7f637c198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637c102790 0x7f637c198910 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f637000d950 tx=0x7f637000de10 comp rx=0 tx=0).stop 2024-09-19T09:41:06.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 -- 172.21.15.42:0/533134006 shutdown_connections 2024-09-19T09:41:06.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f63640a3240 0x7f63640a5700 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f637c106f10 0x7f637c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637c102790 0x7f637c198910 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 --2- 172.21.15.42:0/533134006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f637c101de0 0x7f637c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 -- 172.21.15.42:0/533134006 >> 172.21.15.42:0/533134006 conn(0x7f637c0fd8c0 msgr2=0x7f637c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 -- 172.21.15.42:0/533134006 shutdown_connections 2024-09-19T09:41:06.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:06.573+0000 7f6380ff5640 1 -- 172.21.15.42:0/533134006 wait complete. 2024-09-19T09:41:07.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:07 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/533134006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:07.467 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id 94257ecd --release --await' 2024-09-19T09:41:07.467 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id 94257ecd --release --await 2024-09-19T09:41:07.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:07 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/533134006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:07 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/533134006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:07.857 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:41:07.857 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:41:07.912 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:08.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.360+0000 7f337b946640 1 -- 172.21.15.42:0/3884711001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3374106a80 msgr2=0x7f3374106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.360+0000 7f337b946640 1 --2- 172.21.15.42:0/3884711001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3374106a80 0x7f3374106e60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3364009cd0 tx=0x7f336402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.361+0000 7f337b946640 1 -- 172.21.15.42:0/3884711001 shutdown_connections 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.361+0000 7f337b946640 1 --2- 172.21.15.42:0/3884711001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3374101420 0x7f337410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.361+0000 7f337b946640 1 --2- 172.21.15.42:0/3884711001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3374100a80 0x7f3374100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.361+0000 7f337b946640 1 --2- 172.21.15.42:0/3884711001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3374106a80 0x7f3374106e60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.361+0000 7f337b946640 1 -- 172.21.15.42:0/3884711001 >> 172.21.15.42:0/3884711001 conn(0x7f33740fc7a0 msgr2=0x7f33740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.361+0000 7f337b946640 1 -- 172.21.15.42:0/3884711001 shutdown_connections 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.361+0000 7f337b946640 1 -- 172.21.15.42:0/3884711001 wait complete. 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.361+0000 7f337b946640 1 Processor -- start 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.361+0000 7f337b946640 1 -- start start 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f337b946640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3374100a80 0x7f33741963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f337b946640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3374101420 0x7f33741968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f337b946640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3374106a80 0x7f337419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f337b946640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f337410fe10 con 0x7f3374106a80 2024-09-19T09:41:08.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f337b946640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f337410fc90 con 0x7f3374100a80 2024-09-19T09:41:08.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f337b946640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f337410ff90 con 0x7f3374101420 2024-09-19T09:41:08.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f3379ee3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3374106a80 0x7f337419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f3379ee3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3374106a80 0x7f337419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40368/0 (socket says 172.21.15.42:40368) 2024-09-19T09:41:08.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f3379ee3640 1 -- 172.21.15.42:0/2648999474 learned_addr learned my addr 172.21.15.42:0/2648999474 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:08.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f33796e2640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3374100a80 0x7f33741963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f3378ee1640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3374101420 0x7f33741968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f3379ee3640 1 -- 172.21.15.42:0/2648999474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3374101420 msgr2=0x7f33741968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f3379ee3640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3374101420 0x7f33741968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f3379ee3640 1 -- 172.21.15.42:0/2648999474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3374100a80 msgr2=0x7f33741963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f3379ee3640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3374100a80 0x7f33741963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f3379ee3640 1 -- 172.21.15.42:0/2648999474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337419b360 con 0x7f3374106a80 2024-09-19T09:41:08.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.362+0000 7f3379ee3640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3374106a80 0x7f337419ac80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f336c009fd0 tx=0x7f336c00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:08.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.363+0000 7f33727fc640 1 -- 172.21.15.42:0/2648999474 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c015020 con 0x7f3374106a80 2024-09-19T09:41:08.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.363+0000 7f33727fc640 1 -- 172.21.15.42:0/2648999474 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f336c011d10 con 0x7f3374106a80 2024-09-19T09:41:08.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.363+0000 7f337b946640 1 -- 172.21.15.42:0/2648999474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337419b650 con 0x7f3374106a80 2024-09-19T09:41:08.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.363+0000 7f33727fc640 1 -- 172.21.15.42:0/2648999474 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c00f2e0 con 0x7f3374106a80 2024-09-19T09:41:08.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.363+0000 7f337b946640 1 -- 172.21.15.42:0/2648999474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33741a2f30 con 0x7f3374106a80 2024-09-19T09:41:08.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.365+0000 7f33727fc640 1 -- 172.21.15.42:0/2648999474 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f336c018020 con 0x7f3374106a80 2024-09-19T09:41:08.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.366+0000 7f33727fc640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f335c0a54d0 0x7f335c0a7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.366+0000 7f337dd1f740 1 Processor -- start 2024-09-19T09:41:08.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.366+0000 7f33727fc640 1 -- 172.21.15.42:0/2648999474 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f336c0cf0f0 con 0x7f3374106a80 2024-09-19T09:41:08.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.366+0000 7f33796e2640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f335c0a54d0 0x7f335c0a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.366+0000 7f337dd1f740 1 -- start start 2024-09-19T09:41:08.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb584440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584980 0x556dbb58ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb58f240 0x556dbb591630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f337dd1f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556dbb4e9620 con 0x556dbb58f240 2024-09-19T09:41:08.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f337dd1f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556dbb490e50 con 0x556dbb584980 2024-09-19T09:41:08.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f337dd1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556dbb4e55e0 con 0x556dbb584060 2024-09-19T09:41:08.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f33796e2640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f335c0a54d0 0x7f335c0a7990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3364006010 tx=0x7f3364009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:08.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f3379ee3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb58f240 0x556dbb591630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f3379ee3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb58f240 0x556dbb591630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40384/0 (socket says 172.21.15.42:40384) 2024-09-19T09:41:08.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f3379ee3640 1 -- 172.21.15.42:0/2499463175 learned_addr learned my addr 172.21.15.42:0/2499463175 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:08.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f33796e2640 1 --2- 172.21.15.42:0/2499463175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb584440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f3378ee1640 1 --2- 172.21.15.42:0/2499463175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584980 0x556dbb58ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f3379ee3640 1 -- 172.21.15.42:0/2499463175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 msgr2=0x556dbb584440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f3379ee3640 1 --2- 172.21.15.42:0/2499463175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb584440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f3379ee3640 1 -- 172.21.15.42:0/2499463175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584980 msgr2=0x556dbb58ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f3379ee3640 1 --2- 172.21.15.42:0/2499463175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584980 0x556dbb58ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.367+0000 7f3379ee3640 1 -- 172.21.15.42:0/2499463175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dbb481d40 con 0x556dbb58f240 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.368+0000 7f3379ee3640 1 --2- 172.21.15.42:0/2499463175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb58f240 0x556dbb591630 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f336c09b680 tx=0x7f336c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0eb9d76f5b5e40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.368+0000 7f335b7fe640 1 -- 172.21.15.42:0/2499463175 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c09bdf0 con 0x556dbb58f240 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.368+0000 7f335b7fe640 1 -- 172.21.15.42:0/2499463175 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f336c09b6f0 con 0x556dbb58f240 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.368+0000 7f335b7fe640 1 -- 172.21.15.42:0/2499463175 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c09ab40 con 0x556dbb58f240 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 -- 172.21.15.42:0/2499463175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb58f240 msgr2=0x556dbb591630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 --2- 172.21.15.42:0/2499463175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb58f240 0x556dbb591630 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f336c09b680 tx=0x7f336c0047d0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 -- 172.21.15.42:0/2499463175 shutdown_connections 2024-09-19T09:41:08.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 --2- 172.21.15.42:0/2499463175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb58f240 0x556dbb591630 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 --2- 172.21.15.42:0/2499463175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584980 0x556dbb58ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 --2- 172.21.15.42:0/2499463175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb584440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 -- 172.21.15.42:0/2499463175 >> 172.21.15.42:0/2499463175 conn(0x556dbb5805f0 msgr2=0x556dbb5809d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:08.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 -- 172.21.15.42:0/2499463175 shutdown_connections 2024-09-19T09:41:08.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 -- 172.21.15.42:0/2499463175 wait complete. 2024-09-19T09:41:08.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 -- start start 2024-09-19T09:41:08.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.369+0000 7f337dd1f740 1 Processor -- start 2024-09-19T09:41:08.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb58c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 0x556dbb58cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f337dd1f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556dbb591e10 con 0x556dbb584980 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f337dd1f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556dbb471f10 con 0x556dbb58f240 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f337dd1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556dbb591f90 con 0x556dbb584060 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f337dd1f740 10 client.0 _ll_register_callbacks cb 0x556dbb495db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f3378ee1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f33796e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb58c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f3378ee1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40388/0 (socket says 172.21.15.42:40388) 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f33796e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb58c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:55060/0 (socket says 172.21.15.42:55060) 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f3378ee1640 1 -- 172.21.15.42:0/272437919 learned_addr learned my addr 172.21.15.42:0/272437919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f3379ee3640 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 0x556dbb58cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f33796e2640 1 -- 172.21.15.42:0/272437919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 msgr2=0x556dbb58cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f33796e2640 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 0x556dbb58cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f33796e2640 1 -- 172.21.15.42:0/272437919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 msgr2=0x556dbb58c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f33796e2640 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f33796e2640 1 -- 172.21.15.42:0/272437919 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dbb1f8580 con 0x556dbb584060 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.370+0000 7f3378ee1640 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.371+0000 7f3379ee3640 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 0x556dbb58cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.371+0000 7f33796e2640 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb58c170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f33640098d0 tx=0x7f336402a8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24971b0de686633b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.371+0000 7f3358ff9640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.371+0000 7f3358ff9640 1 -- 172.21.15.42:0/272437919 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364055060 con 0x556dbb584060 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.371+0000 7f3358ff9640 1 -- 172.21.15.42:0/272437919 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3364004510 con 0x556dbb584060 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.371+0000 7f337dd1f740 1 -- 172.21.15.42:0/272437919 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f336c09b6f0 con 0x556dbb584060 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.371+0000 7f3358ff9640 1 -- 172.21.15.42:0/272437919 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3364004750 con 0x556dbb584060 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.371+0000 7f337dd1f740 10 client.25567 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.371+0000 7f337dd1f740 1 -- 172.21.15.42:0/272437919 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556dbb2c2960 con 0x556dbb584060 2024-09-19T09:41:08.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.371+0000 7f3358ff9640 1 -- 172.21.15.42:0/272437919 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f336c09b6f0 con 0x556dbb584060 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.372+0000 7f3358ff9640 1 -- 172.21.15.42:0/272437919 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f3364030070 con 0x556dbb584060 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.372+0000 7f337dd1f740 10 client.25567 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.372+0000 7f337dd1f740 10 client.25567 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.372+0000 7f337dd1f740 20 client.25567 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.372+0000 7f337dd1f740 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x556dbb59eea0 0x556dbb5a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.372+0000 7f337dd1f740 4 client.25567 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.372+0000 7f337dd1f740 1 -- 172.21.15.42:0/272437919 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556dbb4f6b90 con 0x556dbb59eea0 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.372+0000 7f3378ee1640 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x556dbb59eea0 0x556dbb5a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.372+0000 7f3358ff9640 10 client.25567 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.372+0000 7f3378ee1640 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x556dbb59eea0 0x556dbb5a1290 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ead28f79204c26fb server_cookie=63d4de6cc95b7f82 in_seq=0 out_seq=0 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.373+0000 7f3358ff9640 1 -- 172.21.15.42:0/272437919 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556dbb4f6b90 con 0x556dbb59eea0 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.373+0000 7f3358ff9640 10 client.25567 handle_command_reply: tid=0 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.373+0000 7f337dd1f740 1 client.25567 shutdown 2024-09-19T09:41:08.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.373+0000 7f337dd1f740 1 -- 172.21.15.42:0/272437919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 msgr2=0x556dbb58c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.373+0000 7f337dd1f740 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb58c170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f33640098d0 tx=0x7f336402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.374+0000 7f337dd1f740 1 -- 172.21.15.42:0/272437919 shutdown_connections 2024-09-19T09:41:08.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.374+0000 7f337dd1f740 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x556dbb59eea0 0x556dbb5a1290 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.374+0000 7f337dd1f740 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 0x556dbb58cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.374+0000 7f337dd1f740 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.374+0000 7f3358ff9640 0 client.25567 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:08.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.374+0000 7f337dd1f740 1 --2- 172.21.15.42:0/272437919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb58c170 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.374+0000 7f337dd1f740 1 -- 172.21.15.42:0/272437919 >> 172.21.15.42:0/272437919 conn(0x556dbb5805f0 msgr2=0x556dbb5862d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:08.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.374+0000 7f337dd1f740 1 -- 172.21.15.42:0/272437919 shutdown_connections 2024-09-19T09:41:08.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.374+0000 7f337dd1f740 1 -- 172.21.15.42:0/272437919 wait complete. 2024-09-19T09:41:08.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.374+0000 7f337dd1f740 20 client.25567 trim_cache size 0 max 16384 2024-09-19T09:41:08.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f337dd1f740 1 Processor -- start 2024-09-19T09:41:08.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f337dd1f740 1 -- start start 2024-09-19T09:41:08.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb5809d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 0x556dbb5a6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f337dd1f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f33741ab5c0 con 0x556dbb584980 2024-09-19T09:41:08.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f337dd1f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f33741ad130 con 0x556dbb58f240 2024-09-19T09:41:08.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f337dd1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f33741abc90 con 0x556dbb584060 2024-09-19T09:41:08.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f3378ee1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f3378ee1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40404/0 (socket says 172.21.15.42:40404) 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f3378ee1640 1 -- 172.21.15.42:0/1591865584 learned_addr learned my addr 172.21.15.42:0/1591865584 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.392+0000 7f33796e2640 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb5809d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f3379ee3640 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 0x556dbb5a6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f3378ee1640 1 -- 172.21.15.42:0/1591865584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 msgr2=0x556dbb5809d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f3378ee1640 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb5809d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f3378ee1640 1 -- 172.21.15.42:0/1591865584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 msgr2=0x556dbb5a6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f3378ee1640 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 0x556dbb5a6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f3378ee1640 1 -- 172.21.15.42:0/1591865584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dbb586190 con 0x556dbb584980 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f3379ee3640 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 0x556dbb5a6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f33796e2640 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb5809d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f3378ee1640 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58e0e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x556dbb5a1b20 tx=0x7f3368008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c199ca1b28e393e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f335affd640 1 -- 172.21.15.42:0/1591865584 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33680133d0 con 0x556dbb584980 2024-09-19T09:41:08.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f335affd640 1 -- 172.21.15.42:0/1591865584 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3368011ab0 con 0x556dbb584980 2024-09-19T09:41:08.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.393+0000 7f335affd640 1 -- 172.21.15.42:0/1591865584 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368020c00 con 0x556dbb584980 2024-09-19T09:41:08.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.394+0000 7f337dd1f740 1 -- 172.21.15.42:0/1591865584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 msgr2=0x556dbb58e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.394+0000 7f337dd1f740 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58e0e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x556dbb5a1b20 tx=0x7f3368008040 comp rx=0 tx=0).stop 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.394+0000 7f337dd1f740 1 -- 172.21.15.42:0/1591865584 shutdown_connections 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.394+0000 7f337dd1f740 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb58f240 0x556dbb5a6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.394+0000 7f337dd1f740 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb58e0e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.394+0000 7f337dd1f740 1 --2- 172.21.15.42:0/1591865584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb584060 0x556dbb5809d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.394+0000 7f337dd1f740 1 -- 172.21.15.42:0/1591865584 >> 172.21.15.42:0/1591865584 conn(0x556dbb5805f0 msgr2=0x556dbb58d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.394+0000 7f337dd1f740 1 -- 172.21.15.42:0/1591865584 shutdown_connections 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.394+0000 7f337dd1f740 1 -- 172.21.15.42:0/1591865584 wait complete. 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.394+0000 7f337dd1f740 1 -- start start 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.395+0000 7f337dd1f740 1 Processor -- start 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.395+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584060 0x556dbb597ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.395+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb589070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.395+0000 7f337dd1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb58f240 0x556dbb589800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.395+0000 7f337dd1f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f33741aca30 con 0x556dbb584980 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.395+0000 7f337dd1f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f33741ac360 con 0x556dbb584060 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.395+0000 7f337dd1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f33741a95a0 con 0x556dbb58f240 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.395+0000 7f337dd1f740 10 client.0 _ll_register_callbacks cb 0x7f3364031d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.395+0000 7f3379ee3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb58f240 0x556dbb589800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.396+0000 7f3379ee3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb58f240 0x556dbb589800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:55066/0 (socket says 172.21.15.42:55066) 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.396+0000 7f3379ee3640 1 -- 172.21.15.42:0/2625704136 learned_addr learned my addr 172.21.15.42:0/2625704136 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.396+0000 7f33796e2640 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584060 0x556dbb597ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.396+0000 7f33796e2640 1 -- 172.21.15.42:0/2625704136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb58f240 msgr2=0x556dbb589800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.396+0000 7f33796e2640 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb58f240 0x556dbb589800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.396+0000 7f33796e2640 1 -- 172.21.15.42:0/2625704136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 msgr2=0x556dbb589070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.396+0000 7f33796e2640 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb589070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.396+0000 7f33796e2640 1 -- 172.21.15.42:0/2625704136 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dbb608b50 con 0x556dbb584060 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.396+0000 7f33796e2640 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584060 0x556dbb597ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f336402ae00 tx=0x7f3364050ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49afda40498528ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.396+0000 7f3358ff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.397+0000 7f3358ff9640 1 -- 172.21.15.42:0/2625704136 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336406b060 con 0x556dbb584060 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.397+0000 7f3358ff9640 1 -- 172.21.15.42:0/2625704136 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f336404d040 con 0x556dbb584060 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.397+0000 7f337dd1f740 1 -- 172.21.15.42:0/2625704136 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3368011ab0 con 0x556dbb584060 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.397+0000 7f3358ff9640 1 -- 172.21.15.42:0/2625704136 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3364055040 con 0x556dbb584060 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.397+0000 7f337dd1f740 10 client.25628 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.397+0000 7f337dd1f740 1 -- 172.21.15.42:0/2625704136 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556dbb609c90 con 0x556dbb584060 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.397+0000 7f3358ff9640 1 -- 172.21.15.42:0/2625704136 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3368011ab0 con 0x556dbb584060 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.398+0000 7f3358ff9640 1 -- 172.21.15.42:0/2625704136 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f3364030ac0 con 0x556dbb584060 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.398+0000 7f337dd1f740 10 client.25628 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.398+0000 7f337dd1f740 10 client.25628 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.398+0000 7f337dd1f740 20 client.25628 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.398+0000 7f337dd1f740 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x556dbb60a390 0x556dbb60c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.398+0000 7f337dd1f740 4 client.25628 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "94257ecd", "release": true, "await": true}] 2024-09-19T09:41:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.398+0000 7f337dd1f740 1 -- 172.21.15.42:0/2625704136 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "quiesce db", "set_id": "94257ecd", "release": true, "await": true}) -- 0x556dbb4f10a0 con 0x556dbb60a390 2024-09-19T09:41:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.398+0000 7f3378ee1640 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x556dbb60a390 0x556dbb60c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.398+0000 7f3358ff9640 10 client.25628 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.398+0000 7f3378ee1640 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x556dbb60a390 0x556dbb60c7f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe52fbff7af46d5d server_cookie=91ab080ba09096c9 in_seq=0 out_seq=0 2024-09-19T09:41:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.400+0000 7f3358ff9640 1 -- 172.21.15.42:0/2625704136 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556dbb4f10a0 con 0x556dbb60a390 2024-09-19T09:41:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f3358ff9640 10 client.25628 handle_command_reply: tid=0 2024-09-19T09:41:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 client.25628 shutdown 2024-09-19T09:41:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 -- 172.21.15.42:0/2625704136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584060 msgr2=0x556dbb597ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584060 0x556dbb597ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f336402ae00 tx=0x7f3364050ac0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 -- 172.21.15.42:0/2625704136 shutdown_connections 2024-09-19T09:41:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x556dbb60a390 0x556dbb60c7f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556dbb58f240 0x556dbb589800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556dbb584980 0x556dbb589070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 --2- 172.21.15.42:0/2625704136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dbb584060 0x556dbb597ab0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 -- 172.21.15.42:0/2625704136 >> 172.21.15.42:0/2625704136 conn(0x556dbb5805f0 msgr2=0x556dbb57ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f3358ff9640 0 client.25628 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 -- 172.21.15.42:0/2625704136 shutdown_connections 2024-09-19T09:41:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 1 -- 172.21.15.42:0/2625704136 wait complete. 2024-09-19T09:41:08.406 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:08 smithi042 ceph-mon[31223]: pgmap v391: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:41:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.401+0000 7f337dd1f740 20 client.25628 trim_cache size 0 max 16384 2024-09-19T09:41:08.407 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:41:08.407 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 29, 2024-09-19T09:41:08.407 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 24506, 2024-09-19T09:41:08.407 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 12, 2024-09-19T09:41:08.407 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-09-19T09:41:08.407 INFO:teuthology.orchestra.run.smithi042.stdout: "94257ecd": { 2024-09-19T09:41:08.407 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 12, 2024-09-19T09:41:08.407 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-09-19T09:41:08.407 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 140.3, 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:41:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:41:08.409 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:41:08.409 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:41:08.409 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:41:08.409 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:41:08.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 -- 172.21.15.42:0/2648999474 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f335c0a54d0 msgr2=0x7f335c0a7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f335c0a54d0 0x7f335c0a7990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3364006010 tx=0x7f3364009900 comp rx=0 tx=0).stop 2024-09-19T09:41:08.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 -- 172.21.15.42:0/2648999474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3374106a80 msgr2=0x7f337419ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3374106a80 0x7f337419ac80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f336c009fd0 tx=0x7f336c00b820 comp rx=0 tx=0).stop 2024-09-19T09:41:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 -- 172.21.15.42:0/2648999474 shutdown_connections 2024-09-19T09:41:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f335c0a54d0 0x7f335c0a7990 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3374106a80 0x7f337419ac80 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3374101420 0x7f33741968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 --2- 172.21.15.42:0/2648999474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3374100a80 0x7f33741963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 -- 172.21.15.42:0/2648999474 >> 172.21.15.42:0/2648999474 conn(0x7f33740fc7a0 msgr2=0x7f33740fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 -- 172.21.15.42:0/2648999474 shutdown_connections 2024-09-19T09:41:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:08.402+0000 7f337b946640 1 -- 172.21.15.42:0/2648999474 wait complete. 2024-09-19T09:41:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:08.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:08 smithi171 ceph-mon[35803]: pgmap v391: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:41:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:08 smithi136 ceph-mon[34840]: pgmap v391: 97 pgs: 97 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:41:09.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/157038231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b98102e00 msgr2=0x7f3b981031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:09.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 --2- 172.21.15.42:0/157038231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b98102e00 0x7f3b981031e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009900 tx=0x7f3b9402a480 comp rx=0 tx=0).stop 2024-09-19T09:41:09.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/157038231 shutdown_connections 2024-09-19T09:41:09.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 --2- 172.21.15.42:0/157038231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b9810c1a0 0x7f3b9810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 --2- 172.21.15.42:0/157038231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b98103720 0x7f3b9810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 --2- 172.21.15.42:0/157038231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b98102e00 0x7f3b981031e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/157038231 >> 172.21.15.42:0/157038231 conn(0x7f3b980fc7a0 msgr2=0x7f3b980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:09.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/157038231 shutdown_connections 2024-09-19T09:41:09.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/157038231 wait complete. 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 Processor -- start 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.149+0000 7f3b9f5ea640 1 -- start start 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9f5ea640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b98102e00 0x7f3b98198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9f5ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b98103720 0x7f3b98198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9f5ea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b9810c1a0 0x7f3b9819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9f5ea640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3b98111fb0 con 0x7f3b9810c1a0 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9f5ea640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3b98111e30 con 0x7f3b98102e00 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9f5ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3b98112130 con 0x7f3b98103720 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9db87640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b9810c1a0 0x7f3b9819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9db87640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b9810c1a0 0x7f3b9819ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40438/0 (socket says 172.21.15.42:40438) 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9db87640 1 -- 172.21.15.42:0/759492906 learned_addr learned my addr 172.21.15.42:0/759492906 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9d386640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b98102e00 0x7f3b98198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:09.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9cb85640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b98103720 0x7f3b98198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9db87640 1 -- 172.21.15.42:0/759492906 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b98103720 msgr2=0x7f3b98198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9db87640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b98103720 0x7f3b98198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9db87640 1 -- 172.21.15.42:0/759492906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b98102e00 msgr2=0x7f3b98198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9db87640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b98102e00 0x7f3b98198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9db87640 1 -- 172.21.15.42:0/759492906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9819d500 con 0x7f3b9810c1a0 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b9db87640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b9810c1a0 0x7f3b9819ce20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000eaa0 tx=0x7f3b9000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.150+0000 7f3b8e7fc640 1 -- 172.21.15.42:0/759492906 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90004d20 con 0x7f3b9810c1a0 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.151+0000 7f3b8e7fc640 1 -- 172.21.15.42:0/759492906 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b90005020 con 0x7f3b9810c1a0 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.151+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/759492906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9819d7f0 con 0x7f3b9810c1a0 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.151+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/759492906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b981a50d0 con 0x7f3b9810c1a0 2024-09-19T09:41:09.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.151+0000 7f3b8e7fc640 1 -- 172.21.15.42:0/759492906 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b900116d0 con 0x7f3b9810c1a0 2024-09-19T09:41:09.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.152+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/759492906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b981031e0 con 0x7f3b9810c1a0 2024-09-19T09:41:09.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.153+0000 7f3b8e7fc640 1 -- 172.21.15.42:0/759492906 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3b900051d0 con 0x7f3b9810c1a0 2024-09-19T09:41:09.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.154+0000 7f3b8e7fc640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3b840a32c0 0x7f3b840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:09.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.154+0000 7f3b9d386640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3b840a32c0 0x7f3b840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:09.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.154+0000 7f3b8e7fc640 1 -- 172.21.15.42:0/759492906 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3b900cfa60 con 0x7f3b9810c1a0 2024-09-19T09:41:09.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.154+0000 7f3b9d386640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3b840a32c0 0x7f3b840a5780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009230 tx=0x7f3b940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:09.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.158+0000 7f3b8e7fc640 1 -- 172.21.15.42:0/759492906 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b90016030 con 0x7f3b9810c1a0 2024-09-19T09:41:09.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.374+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/759492906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b9802d7c0 con 0x7f3b9810c1a0 2024-09-19T09:41:09.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.375+0000 7f3b8e7fc640 1 -- 172.21.15.42:0/759492906 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f3b9009c760 con 0x7f3b9810c1a0 2024-09-19T09:41:09.377 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:41:09.377 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"btime":"2024-09-19T09:40:47:118091+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:40:46.427379+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:41:09.377 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/759492906 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3b840a32c0 msgr2=0x7f3b840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3b840a32c0 0x7f3b840a5780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009230 tx=0x7f3b940058d0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/759492906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b9810c1a0 msgr2=0x7f3b9819ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b9810c1a0 0x7f3b9819ce20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000eaa0 tx=0x7f3b9000eea0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/759492906 shutdown_connections 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3b840a32c0 0x7f3b840a5780 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b9810c1a0 0x7f3b9819ce20 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b98103720 0x7f3b98198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 --2- 172.21.15.42:0/759492906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b98102e00 0x7f3b98198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/759492906 >> 172.21.15.42:0/759492906 conn(0x7f3b980fc7a0 msgr2=0x7f3b980fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/759492906 shutdown_connections 2024-09-19T09:41:09.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:09.377+0000 7f3b9f5ea640 1 -- 172.21.15.42:0/759492906 wait complete. 2024-09-19T09:41:09.610 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '94257ecd', total seconds elapsed: 24.7 2024-09-19T09:41:10.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:10 smithi042 ceph-mon[31223]: pgmap v392: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-19T09:41:10.205 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:10 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/759492906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:10.254 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:41:10.377 INFO:tasks.workunit.client.0.smithi042.stderr:+ tar xzf ltp-full.tgz 2024-09-19T09:41:10.524 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:10 smithi171 ceph-mon[35803]: pgmap v392: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-19T09:41:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:10 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/759492906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:10.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:10 smithi136 ceph-mon[34840]: pgmap v392: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-19T09:41:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:10 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/759492906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:10.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.948+0000 7f4da2f5b640 1 -- 172.21.15.42:0/2791527127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d9c100e20 msgr2=0x7f4d9c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.948+0000 7f4da2f5b640 1 --2- 172.21.15.42:0/2791527127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d9c100e20 0x7f4d9c101200 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009900 tx=0x7f4d9802a480 comp rx=0 tx=0).stop 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.948+0000 7f4da2f5b640 1 -- 172.21.15.42:0/2791527127 shutdown_connections 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.948+0000 7f4da2f5b640 1 --2- 172.21.15.42:0/2791527127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d9c102ef0 0x7f4d9c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.948+0000 7f4da2f5b640 1 --2- 172.21.15.42:0/2791527127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d9c102570 0x7f4d9c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.948+0000 7f4da2f5b640 1 --2- 172.21.15.42:0/2791527127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d9c100e20 0x7f4d9c101200 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.948+0000 7f4da2f5b640 1 -- 172.21.15.42:0/2791527127 >> 172.21.15.42:0/2791527127 conn(0x7f4d9c0fc7d0 msgr2=0x7f4d9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.948+0000 7f4da2f5b640 1 -- 172.21.15.42:0/2791527127 shutdown_connections 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.948+0000 7f4da2f5b640 1 -- 172.21.15.42:0/2791527127 wait complete. 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.948+0000 7f4da2f5b640 1 Processor -- start 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da2f5b640 1 -- start start 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da2f5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d9c100e20 0x7f4d9c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da2f5b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d9c102570 0x7f4d9c19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da2f5b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d9c102ef0 0x7f4d9c19f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da2f5b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c110f50 con 0x7f4d9c100e20 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da2f5b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c110dd0 con 0x7f4d9c102ef0 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da2f5b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c1110d0 con 0x7f4d9c102570 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da0cf7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d9c100e20 0x7f4d9c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da0cf7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d9c100e20 0x7f4d9c19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36958/0 (socket says 172.21.15.42:36958) 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da0cf7640 1 -- 172.21.15.42:0/1410804889 learned_addr learned my addr 172.21.15.42:0/1410804889 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da14f8640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d9c102ef0 0x7f4d9c19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4d93fff640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d9c102570 0x7f4d9c19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da0cf7640 1 -- 172.21.15.42:0/1410804889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d9c102570 msgr2=0x7f4d9c19ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d9c102570 0x7f4d9c19ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da0cf7640 1 -- 172.21.15.42:0/1410804889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d9c102ef0 msgr2=0x7f4d9c19f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:10.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d9c102ef0 0x7f4d9c19f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.949+0000 7f4da0cf7640 1 -- 172.21.15.42:0/1410804889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c19f6e0 con 0x7f4d9c100e20 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.950+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d9c100e20 0x7f4d9c19a730 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4d98006010 tx=0x7f4d98003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.950+0000 7f4d91ffb640 1 -- 172.21.15.42:0/1410804889 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9803f070 con 0x7f4d9c100e20 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.950+0000 7f4da2f5b640 1 -- 172.21.15.42:0/1410804889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9c19f970 con 0x7f4d9c100e20 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.950+0000 7f4d91ffb640 1 -- 172.21.15.42:0/1410804889 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d98031c30 con 0x7f4d9c100e20 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.950+0000 7f4d91ffb640 1 -- 172.21.15.42:0/1410804889 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d98035030 con 0x7f4d9c100e20 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.950+0000 7f4da2f5b640 1 -- 172.21.15.42:0/1410804889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9c1a72b0 con 0x7f4d9c100e20 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.952+0000 7f4d91ffb640 1 -- 172.21.15.42:0/1410804889 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f4d98042070 con 0x7f4d9c100e20 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da5334740 1 Processor -- start 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da5334740 1 -- start start 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da5334740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9bb40 0x562fffd9a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da5334740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 0x562fffd9aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da5334740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffda7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da5334740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562fffd002f0 con 0x562fffda5370 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da5334740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562fffca7cf0 con 0x562fffd9bb40 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da5334740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562fffcfc2b0 con 0x562fffd9a5d0 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da14f8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9bb40 0x562fffd9a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffda7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da14f8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9bb40 0x562fffd9a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:41836/0 (socket says 172.21.15.42:41836) 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da14f8640 1 -- 172.21.15.42:0/2469233217 learned_addr learned my addr 172.21.15.42:0/2469233217 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4d91ffb640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4d840a3240 0x7f4d840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.953+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/2469233217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 0x562fffd9aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4da14f8640 1 -- 172.21.15.42:0/2469233217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 msgr2=0x562fffd9aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4d91ffb640 1 -- 172.21.15.42:0/1410804889 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4d980efff0 con 0x7f4d9c100e20 2024-09-19T09:41:10.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4da14f8640 1 --2- 172.21.15.42:0/2469233217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 0x562fffd9aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4da14f8640 1 -- 172.21.15.42:0/2469233217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 msgr2=0x562fffda7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4da14f8640 1 --2- 172.21.15.42:0/2469233217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffda7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4da14f8640 1 -- 172.21.15.42:0/2469233217 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fffc8c3a0 con 0x562fffd9bb40 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4d93fff640 1 --2- 172.21.15.42:0/2469233217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffda7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/2469233217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 0x562fffd9aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4da14f8640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4d840a3240 0x7f4d840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4da14f8640 1 --2- 172.21.15.42:0/2469233217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9bb40 0x562fffd9a090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d94010440 tx=0x7f4d94010900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2610b2b08c44a2dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4d82ffd640 1 -- 172.21.15.42:0/2469233217 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9401d400 con 0x562fffd9bb40 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4d82ffd640 1 -- 172.21.15.42:0/2469233217 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d94013520 con 0x562fffd9bb40 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.954+0000 7f4d82ffd640 1 -- 172.21.15.42:0/2469233217 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94011920 con 0x562fffd9bb40 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.955+0000 7f4da14f8640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4d840a3240 0x7f4d840a5700 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4d94021000 tx=0x7f4d9401e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:10.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.955+0000 7f4da5334740 1 -- 172.21.15.42:0/2469233217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9bb40 msgr2=0x562fffd9a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.955+0000 7f4da5334740 1 --2- 172.21.15.42:0/2469233217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9bb40 0x562fffd9a090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d94010440 tx=0x7f4d94010900 comp rx=0 tx=0).stop 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.955+0000 7f4da5334740 1 -- 172.21.15.42:0/2469233217 shutdown_connections 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.955+0000 7f4da5334740 1 --2- 172.21.15.42:0/2469233217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffda7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.955+0000 7f4da5334740 1 --2- 172.21.15.42:0/2469233217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 0x562fffd9aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.955+0000 7f4da5334740 1 --2- 172.21.15.42:0/2469233217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9bb40 0x562fffd9a090 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.955+0000 7f4da5334740 1 -- 172.21.15.42:0/2469233217 >> 172.21.15.42:0/2469233217 conn(0x562fffd63310 msgr2=0x562fffd96c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.955+0000 7f4da5334740 1 -- 172.21.15.42:0/2469233217 shutdown_connections 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.955+0000 7f4da5334740 1 -- 172.21.15.42:0/2469233217 wait complete. 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4da5334740 1 -- start start 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4da5334740 1 Processor -- start 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4da5334740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 0x562fffda4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4da5334740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffda2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4da5334740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffda5370 0x562fffda2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4da5334740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562fffda8070 con 0x562fffd9bb40 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4da5334740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562fffcbb060 con 0x562fffda5370 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4da5334740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562fffda81f0 con 0x562fffd9a5d0 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4da5334740 10 client.0 _ll_register_callbacks cb 0x562fffa0e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffda2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffda2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36986/0 (socket says 172.21.15.42:36986) 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4da14f8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffda5370 0x562fffda2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.956+0000 7f4d93fff640 1 -- 172.21.15.42:0/4235549576 learned_addr learned my addr 172.21.15.42:0/4235549576 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 0x562fffda4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4d93fff640 1 -- 172.21.15.42:0/4235549576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 msgr2=0x562fffda4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4d93fff640 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 0x562fffda4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4d93fff640 1 -- 172.21.15.42:0/4235549576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffda5370 msgr2=0x562fffda2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:10.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4d93fff640 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffda5370 0x562fffda2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4d93fff640 1 -- 172.21.15.42:0/4235549576 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fffa713c0 con 0x562fffd9bb40 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4da14f8640 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffda5370 0x562fffda2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 0x562fffda4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4d93fff640 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffda2040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c012700 tx=0x7f4d8c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdba5b5db4cda99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4d7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4d7bfff640 1 -- 172.21.15.42:0/4235549576 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c004030 con 0x562fffd9bb40 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4da5334740 1 -- 172.21.15.42:0/4235549576 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d94013520 con 0x562fffd9bb40 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4d7bfff640 1 -- 172.21.15.42:0/4235549576 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4d8c0041d0 con 0x562fffd9bb40 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4d7bfff640 1 -- 172.21.15.42:0/4235549576 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4d8c0043d0 con 0x562fffd9bb40 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4da5334740 10 client.16200 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.957+0000 7f4da5334740 1 -- 172.21.15.42:0/4235549576 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562fffdb3b60 con 0x562fffd9bb40 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.958+0000 7f4d7bfff640 1 -- 172.21.15.42:0/4235549576 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d94013520 con 0x562fffd9bb40 2024-09-19T09:41:10.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.958+0000 7f4d7bfff640 1 -- 172.21.15.42:0/4235549576 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4d8c003ba0 con 0x562fffd9bb40 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.958+0000 7f4da5334740 10 client.16200 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.958+0000 7f4da5334740 10 client.16200 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.958+0000 7f4da5334740 20 client.16200 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.958+0000 7f4da5334740 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x562fffdb4fc0 0x562fffdb73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.958+0000 7f4da5334740 4 client.16200 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.958+0000 7f4da5334740 1 -- 172.21.15.42:0/4235549576 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fffd0d860 con 0x562fffdb4fc0 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.958+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x562fffdb4fc0 0x562fffdb73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.959+0000 7f4d7bfff640 10 client.16200 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.959+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x562fffdb4fc0 0x562fffdb73e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=131367a8f1a7c712 server_cookie=3741c72aa1ef0dc3 in_seq=0 out_seq=0 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.959+0000 7f4d7bfff640 1 -- 172.21.15.42:0/4235549576 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fffd0d860 con 0x562fffdb4fc0 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.959+0000 7f4d7bfff640 10 client.16200 handle_command_reply: tid=0 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.959+0000 7f4da5334740 1 client.16200 shutdown 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 1 -- 172.21.15.42:0/4235549576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 msgr2=0x562fffda2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffda2040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c012700 tx=0x7f4d8c012bc0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 1 -- 172.21.15.42:0/4235549576 shutdown_connections 2024-09-19T09:41:10.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x562fffdb4fc0 0x562fffdb73e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffda5370 0x562fffda2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffda2040 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 1 --2- 172.21.15.42:0/4235549576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9a5d0 0x562fffda4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 1 -- 172.21.15.42:0/4235549576 >> 172.21.15.42:0/4235549576 conn(0x562fffd63310 msgr2=0x562fffd9c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:10.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4d7bfff640 0 client.16200 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:41:10.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 1 -- 172.21.15.42:0/4235549576 shutdown_connections 2024-09-19T09:41:10.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 1 -- 172.21.15.42:0/4235549576 wait complete. 2024-09-19T09:41:10.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.960+0000 7f4da5334740 20 client.16200 trim_cache size 0 max 16384 2024-09-19T09:41:10.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.976+0000 7f4da5334740 1 Processor -- start 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.976+0000 7f4da5334740 1 -- start start 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.976+0000 7f4da5334740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffda2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.976+0000 7f4da5334740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9bb40 0x562fffdb1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.976+0000 7f4da5334740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffdbccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.976+0000 7f4da5334740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c1af840 con 0x562fffda5370 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.976+0000 7f4da5334740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c1b13b0 con 0x562fffd9a5d0 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.976+0000 7f4da5334740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c1aff10 con 0x562fffd9bb40 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da14f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffdbccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da0cf7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffda2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da0cf7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffda2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:41854/0 (socket says 172.21.15.42:41854) 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da14f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffdbccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36992/0 (socket says 172.21.15.42:36992) 2024-09-19T09:41:10.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da0cf7640 1 -- 172.21.15.42:0/3725578832 learned_addr learned my addr 172.21.15.42:0/3725578832 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4d93fff640 1 --2- 172.21.15.42:0/3725578832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9bb40 0x562fffdb1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da0cf7640 1 -- 172.21.15.42:0/3725578832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9bb40 msgr2=0x562fffdb1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/3725578832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9bb40 0x562fffdb1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da0cf7640 1 -- 172.21.15.42:0/3725578832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 msgr2=0x562fffdbccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/3725578832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffdbccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da0cf7640 1 -- 172.21.15.42:0/3725578832 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fffda29c0 con 0x562fffd9a5d0 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da14f8640 1 --2- 172.21.15.42:0/3725578832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffdbccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/3725578832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffda2010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d98000c00 tx=0x7f4d9802a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94787b83120a20b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4d827fc640 1 -- 172.21.15.42:0/3725578832 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d98049040 con 0x562fffd9a5d0 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4d827fc640 1 -- 172.21.15.42:0/3725578832 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d980c5200 con 0x562fffd9a5d0 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.977+0000 7f4d827fc640 1 -- 172.21.15.42:0/3725578832 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d980c4d70 con 0x562fffd9a5d0 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.978+0000 7f4da5334740 1 -- 172.21.15.42:0/3725578832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 msgr2=0x562fffda2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.978+0000 7f4da5334740 1 --2- 172.21.15.42:0/3725578832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffda2010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d98000c00 tx=0x7f4d9802a480 comp rx=0 tx=0).stop 2024-09-19T09:41:10.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.978+0000 7f4da5334740 1 -- 172.21.15.42:0/3725578832 shutdown_connections 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.978+0000 7f4da5334740 1 --2- 172.21.15.42:0/3725578832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffda5370 0x562fffdbccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.978+0000 7f4da5334740 1 --2- 172.21.15.42:0/3725578832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffd9bb40 0x562fffdb1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.978+0000 7f4da5334740 1 --2- 172.21.15.42:0/3725578832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffda2010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.978+0000 7f4da5334740 1 -- 172.21.15.42:0/3725578832 >> 172.21.15.42:0/3725578832 conn(0x562fffd63310 msgr2=0x562fffda1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.978+0000 7f4da5334740 1 -- 172.21.15.42:0/3725578832 shutdown_connections 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.978+0000 7f4da5334740 1 -- 172.21.15.42:0/3725578832 wait complete. 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4da5334740 1 -- start start 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4da5334740 1 Processor -- start 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4da5334740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffd9fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4da5334740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffdad480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4da5334740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffda5370 0x562fffdad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4da5334740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c1b0cb0 con 0x562fffd9bb40 2024-09-19T09:41:10.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4da5334740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c1b05e0 con 0x562fffd9a5d0 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4da5334740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c1ad820 con 0x562fffda5370 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4da5334740 10 client.0 _ll_register_callbacks cb 0x7f4d8c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4da0cf7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffd9fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.979+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffdad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffdad480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37004/0 (socket says 172.21.15.42:37004) 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d93fff640 1 -- 172.21.15.42:0/3016563896 learned_addr learned my addr 172.21.15.42:0/3016563896 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d93fff640 1 -- 172.21.15.42:0/3016563896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffda5370 msgr2=0x562fffdad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d93fff640 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffda5370 0x562fffdad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d93fff640 1 -- 172.21.15.42:0/3016563896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 msgr2=0x562fffd9fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d93fff640 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffd9fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d93fff640 1 -- 172.21.15.42:0/3016563896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fffd9e2d0 con 0x562fffd9bb40 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffd9fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:10.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d93fff640 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffdad480 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x562fffda3680 tx=0x7f4d8c0041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5262d9d3e60bce63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d7bfff640 1 -- 172.21.15.42:0/3016563896 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c00f9a0 con 0x562fffd9bb40 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4d7bfff640 1 -- 172.21.15.42:0/3016563896 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4d8c00fb40 con 0x562fffd9bb40 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.980+0000 7f4da5334740 1 -- 172.21.15.42:0/3016563896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d980c5200 con 0x562fffd9bb40 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4d7bfff640 1 -- 172.21.15.42:0/3016563896 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4d8c035070 con 0x562fffd9bb40 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4da5334740 10 client.16206 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4da5334740 1 -- 172.21.15.42:0/3016563896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562fffe1eea0 con 0x562fffd9bb40 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4d7bfff640 1 -- 172.21.15.42:0/3016563896 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d8c00fd40 con 0x562fffd9bb40 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4d7bfff640 1 -- 172.21.15.42:0/3016563896 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4d8c010a60 con 0x562fffd9bb40 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4da5334740 10 client.16206 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4da5334740 10 client.16206 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4da5334740 20 client.16206 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4da5334740 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x562fffe1f5f0 0x562fffe21a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:10.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4da5334740 4 client.16206 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:41:10.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4da5334740 1 -- 172.21.15.42:0/3016563896 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4d980c5200 con 0x562fffe1f5f0 2024-09-19T09:41:10.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.981+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x562fffe1f5f0 0x562fffe21a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:10.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da0cf7640 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x562fffe1f5f0 0x562fffe21a10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=defd680f21837834 server_cookie=e26c2de24ec3a3b7 in_seq=0 out_seq=0 2024-09-19T09:41:10.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4d7bfff640 10 client.16206 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:41:10.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4d7bfff640 1 -- 172.21.15.42:0/3016563896 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4d980c5200 con 0x562fffe1f5f0 2024-09-19T09:41:10.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4d7bfff640 10 client.16206 handle_command_reply: tid=0 2024-09-19T09:41:10.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da5334740 1 client.16206 shutdown 2024-09-19T09:41:10.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da5334740 1 -- 172.21.15.42:0/3016563896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 msgr2=0x562fffdad480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:10.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da5334740 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffdad480 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x562fffda3680 tx=0x7f4d8c0041f0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da5334740 1 -- 172.21.15.42:0/3016563896 shutdown_connections 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da5334740 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x562fffe1f5f0 0x562fffe21a10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da5334740 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fffda5370 0x562fffdad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da5334740 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fffd9bb40 0x562fffdad480 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da5334740 1 --2- 172.21.15.42:0/3016563896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fffd9a5d0 0x562fffd9fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da5334740 1 -- 172.21.15.42:0/3016563896 >> 172.21.15.42:0/3016563896 conn(0x562fffd63310 msgr2=0x562fffda0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4d7bfff640 0 client.16206 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.982+0000 7f4da5334740 1 -- 172.21.15.42:0/3016563896 shutdown_connections 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da5334740 1 -- 172.21.15.42:0/3016563896 wait complete. 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da5334740 20 client.16206 trim_cache size 0 max 16384 2024-09-19T09:41:10.994 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:41:10.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 -- 172.21.15.42:0/1410804889 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4d840a3240 msgr2=0x7f4d840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:10.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4d840a3240 0x7f4d840a5700 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4d94021000 tx=0x7f4d9401e000 comp rx=0 tx=0).stop 2024-09-19T09:41:10.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 -- 172.21.15.42:0/1410804889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d9c100e20 msgr2=0x7f4d9c19a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:10.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d9c100e20 0x7f4d9c19a730 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4d98006010 tx=0x7f4d98003c10 comp rx=0 tx=0).stop 2024-09-19T09:41:10.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 -- 172.21.15.42:0/1410804889 shutdown_connections 2024-09-19T09:41:10.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4d840a3240 0x7f4d840a5700 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d9c102ef0 0x7f4d9c19f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d9c102570 0x7f4d9c19ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 --2- 172.21.15.42:0/1410804889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d9c100e20 0x7f4d9c19a730 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:10.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 -- 172.21.15.42:0/1410804889 >> 172.21.15.42:0/1410804889 conn(0x7f4d9c0fc7d0 msgr2=0x7f4d9c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:10.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 -- 172.21.15.42:0/1410804889 shutdown_connections 2024-09-19T09:41:10.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:10.983+0000 7f4da2f5b640 1 -- 172.21.15.42:0/1410804889 wait complete. 2024-09-19T09:41:11.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:41:11.907 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:12.314 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:12 smithi042 ceph-mon[31223]: pgmap v393: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:41:12.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.400+0000 7fbaaf39b640 1 -- 172.21.15.42:0/2102823947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaa8101de0 msgr2=0x7fbaa81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.400+0000 7fbaaf39b640 1 --2- 172.21.15.42:0/2102823947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaa8101de0 0x7fbaa81021c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fba98009ca0 tx=0x7fba9802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.400+0000 7fbaaf39b640 1 -- 172.21.15.42:0/2102823947 shutdown_connections 2024-09-19T09:41:12.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.400+0000 7fbaaf39b640 1 --2- 172.21.15.42:0/2102823947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaa8106f10 0x7fbaa810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.400+0000 7fbaaf39b640 1 --2- 172.21.15.42:0/2102823947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbaa8102790 0x7fbaa81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.400+0000 7fbaaf39b640 1 --2- 172.21.15.42:0/2102823947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaa8101de0 0x7fbaa81021c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.400+0000 7fbaaf39b640 1 -- 172.21.15.42:0/2102823947 >> 172.21.15.42:0/2102823947 conn(0x7fbaa80fd8e0 msgr2=0x7fbaa80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.400+0000 7fbaaf39b640 1 -- 172.21.15.42:0/2102823947 shutdown_connections 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.400+0000 7fbaaf39b640 1 -- 172.21.15.42:0/2102823947 wait complete. 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaaf39b640 1 Processor -- start 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaaf39b640 1 -- start start 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaaf39b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaa8101de0 0x7fbaa819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaaf39b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbaa8102790 0x7fbaa819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaaf39b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaa8106f10 0x7fbaa819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaaf39b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa8076270 con 0x7fbaa8101de0 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaaf39b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa80760f0 con 0x7fbaa8106f10 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaaf39b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa80763f0 con 0x7fbaa8102790 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaad137640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaa8101de0 0x7fbaa819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaad137640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaa8101de0 0x7fbaa819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37010/0 (socket says 172.21.15.42:37010) 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaad137640 1 -- 172.21.15.42:0/3561143448 learned_addr learned my addr 172.21.15.42:0/3561143448 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaad938640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaa8106f10 0x7fbaa819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaac936640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbaa8102790 0x7fbaa819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaad137640 1 -- 172.21.15.42:0/3561143448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbaa8102790 msgr2=0x7fbaa819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaad137640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbaa8102790 0x7fbaa819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaad137640 1 -- 172.21.15.42:0/3561143448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaa8106f10 msgr2=0x7fbaa819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.401+0000 7fbaad137640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaa8106f10 0x7fbaa819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.402+0000 7fbaad137640 1 -- 172.21.15.42:0/3561143448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa819f5d0 con 0x7fbaa8101de0 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.402+0000 7fbaad137640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaa8101de0 0x7fbaa819a620 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fba9802ade0 tx=0x7fba980319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.402+0000 7fbaa67fc640 1 -- 172.21.15.42:0/3561143448 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9802fa20 con 0x7fbaa8101de0 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.402+0000 7fbaa67fc640 1 -- 172.21.15.42:0/3561143448 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba9802fbc0 con 0x7fbaa8101de0 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.402+0000 7fbaa67fc640 1 -- 172.21.15.42:0/3561143448 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba980466e0 con 0x7fbaa8101de0 2024-09-19T09:41:12.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.402+0000 7fbaaf39b640 1 -- 172.21.15.42:0/3561143448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa819f860 con 0x7fbaa8101de0 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.402+0000 7fbaaf39b640 1 -- 172.21.15.42:0/3561143448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa81a71a0 con 0x7fbaa8101de0 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.404+0000 7fbaa67fc640 1 -- 172.21.15.42:0/3561143448 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fba98046940 con 0x7fbaa8101de0 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbab1774740 1 Processor -- start 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbab1774740 1 -- start start 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbab1774740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea64090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbab1774740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea64a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbab1774740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea6f370 0x55cc9ea71760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbab1774740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cc9e9ca2f0 con 0x55cc9ea65b40 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbab1774740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55cc9e971cf0 con 0x55cc9ea6f370 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbab1774740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55cc9e9c62b0 con 0x55cc9ea645d0 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaad938640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea64090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaad938640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea64090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37014/0 (socket says 172.21.15.42:37014) 2024-09-19T09:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaad938640 1 -- 172.21.15.42:0/1729967633 learned_addr learned my addr 172.21.15.42:0/1729967633 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaac936640 1 --2- 172.21.15.42:0/1729967633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea6f370 0x55cc9ea71760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaad137640 1 --2- 172.21.15.42:0/1729967633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea64a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaad938640 1 -- 172.21.15.42:0/1729967633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 msgr2=0x55cc9ea64a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaad938640 1 --2- 172.21.15.42:0/1729967633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea64a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaad938640 1 -- 172.21.15.42:0/1729967633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea6f370 msgr2=0x55cc9ea71760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaad938640 1 --2- 172.21.15.42:0/1729967633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea6f370 0x55cc9ea71760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaa67fc640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fba900a3240 0x7fba900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.405+0000 7fbaad938640 1 -- 172.21.15.42:0/1729967633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc9e9563a0 con 0x55cc9ea65b40 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.406+0000 7fbaad137640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fba900a3240 0x7fba900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.406+0000 7fbaad938640 1 --2- 172.21.15.42:0/1729967633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea64090 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009c20 tx=0x7fbaa0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658d15c48ced88b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.406+0000 7fbaa67fc640 1 -- 172.21.15.42:0/3561143448 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fba980f0e10 con 0x7fbaa8101de0 2024-09-19T09:41:12.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.406+0000 7fba8f7fe640 1 -- 172.21.15.42:0/1729967633 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa001e070 con 0x55cc9ea65b40 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.406+0000 7fba8f7fe640 1 -- 172.21.15.42:0/1729967633 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa0019b10 con 0x55cc9ea65b40 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.406+0000 7fba8f7fe640 1 -- 172.21.15.42:0/1729967633 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000e980 con 0x55cc9ea65b40 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 -- 172.21.15.42:0/1729967633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 msgr2=0x55cc9ea64090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 --2- 172.21.15.42:0/1729967633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea64090 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009c20 tx=0x7fbaa0011810 comp rx=0 tx=0).stop 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbaad137640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fba900a3240 0x7fba900a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fba980eec60 tx=0x7fba980f48f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 -- 172.21.15.42:0/1729967633 shutdown_connections 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 --2- 172.21.15.42:0/1729967633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea6f370 0x55cc9ea71760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 --2- 172.21.15.42:0/1729967633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 --2- 172.21.15.42:0/1729967633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea64090 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 -- 172.21.15.42:0/1729967633 >> 172.21.15.42:0/1729967633 conn(0x55cc9ea2d310 msgr2=0x55cc9ea60c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 -- 172.21.15.42:0/1729967633 shutdown_connections 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 -- 172.21.15.42:0/1729967633 wait complete. 2024-09-19T09:41:12.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 -- start start 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.407+0000 7fbab1774740 1 Processor -- start 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbab1774740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea6ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbab1774740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea6c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbab1774740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 0x55cc9ea6c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbab1774740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cc9ea72070 con 0x55cc9ea6f370 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbab1774740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55cc9e985060 con 0x55cc9ea65b40 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbab1774740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55cc9ea721f0 con 0x55cc9ea645d0 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbab1774740 10 client.0 _ll_register_callbacks cb 0x55cc9e6d88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaac936640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea6c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaad938640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea6ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaad938640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea6ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:51436/0 (socket says 172.21.15.42:51436) 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaad938640 1 -- 172.21.15.42:0/2595735114 learned_addr learned my addr 172.21.15.42:0/2595735114 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaac936640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea6c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:41910/0 (socket says 172.21.15.42:41910) 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaad938640 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 0x55cc9ea6c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaac936640 1 -- 172.21.15.42:0/2595735114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 msgr2=0x55cc9ea6ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaac936640 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea6ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaac936640 1 -- 172.21.15.42:0/2595735114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 msgr2=0x55cc9ea6c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaac936640 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 0x55cc9ea6c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.408+0000 7fbaac936640 1 -- 172.21.15.42:0/2595735114 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc9e73b3c0 con 0x55cc9ea65b40 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fbaac936640 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea6c040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80fde00 tx=0x7fba9c011bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41e9175d5457257 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fba8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fba8cff9640 1 -- 172.21.15.42:0/2595735114 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00fd60 con 0x55cc9ea65b40 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fbab1774740 1 -- 172.21.15.42:0/2595735114 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaa0019b10 con 0x55cc9ea65b40 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fba8cff9640 1 -- 172.21.15.42:0/2595735114 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fba9c005020 con 0x55cc9ea65b40 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fba8cff9640 1 -- 172.21.15.42:0/2595735114 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fba9c005220 con 0x55cc9ea65b40 2024-09-19T09:41:12.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fbab1774740 10 client.25664 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fbab1774740 1 -- 172.21.15.42:0/2595735114 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cc9ea7dba0 con 0x55cc9ea65b40 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fba8cff9640 1 -- 172.21.15.42:0/2595735114 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa0019b10 con 0x55cc9ea65b40 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fba8cff9640 1 -- 172.21.15.42:0/2595735114 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fba9c018030 con 0x55cc9ea65b40 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fbab1774740 10 client.25664 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fbab1774740 10 client.25664 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fbab1774740 20 client.25664 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fbab1774740 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55cc9ea7f100 0x55cc9ea81520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fbab1774740 4 client.25664 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.409+0000 7fbab1774740 1 -- 172.21.15.42:0/2595735114 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc9e9d7860 con 0x55cc9ea7f100 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.410+0000 7fbaad938640 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55cc9ea7f100 0x55cc9ea81520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.410+0000 7fbaad938640 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55cc9ea7f100 0x55cc9ea81520 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=45ccf60b0f280e60 server_cookie=b9277e0fbaef6bbd in_seq=0 out_seq=0 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.410+0000 7fba8cff9640 10 client.25664 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:41:12.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fba8cff9640 1 -- 172.21.15.42:0/2595735114 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc9e9d7860 con 0x55cc9ea7f100 2024-09-19T09:41:12.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fba8cff9640 10 client.25664 handle_command_reply: tid=0 2024-09-19T09:41:12.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fbab1774740 1 client.25664 shutdown 2024-09-19T09:41:12.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fbab1774740 1 -- 172.21.15.42:0/2595735114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 msgr2=0x55cc9ea6c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fbab1774740 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea6c040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80fde00 tx=0x7fba9c011bc0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fbab1774740 1 -- 172.21.15.42:0/2595735114 shutdown_connections 2024-09-19T09:41:12.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fbab1774740 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55cc9ea7f100 0x55cc9ea81520 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fbab1774740 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 0x55cc9ea6c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fbab1774740 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea6c040 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fbab1774740 1 --2- 172.21.15.42:0/2595735114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea6ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.411+0000 7fbab1774740 1 -- 172.21.15.42:0/2595735114 >> 172.21.15.42:0/2595735114 conn(0x55cc9ea2d310 msgr2=0x55cc9ea66960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.412+0000 7fba8cff9640 0 client.25664 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.412+0000 7fbab1774740 1 -- 172.21.15.42:0/2595735114 shutdown_connections 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.412+0000 7fbab1774740 1 -- 172.21.15.42:0/2595735114 wait complete. 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.412+0000 7fbab1774740 20 client.25664 trim_cache size 0 max 16384 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.425+0000 7fbab1774740 1 Processor -- start 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.425+0000 7fbab1774740 1 -- start start 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.425+0000 7fbab1774740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea60d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.425+0000 7fbab1774740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea7b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.425+0000 7fbab1774740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 0x55cc9ea6b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.425+0000 7fbab1774740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81af7c0 con 0x55cc9ea6f370 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.425+0000 7fbab1774740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81b1330 con 0x55cc9ea65b40 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.425+0000 7fbab1774740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81afe90 con 0x55cc9ea645d0 2024-09-19T09:41:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaac936640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea7b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaac936640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea7b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:41924/0 (socket says 172.21.15.42:41924) 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaac936640 1 -- 172.21.15.42:0/1841883954 learned_addr learned my addr 172.21.15.42:0/1841883954 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaad938640 1 --2- 172.21.15.42:0/1841883954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea60d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaad938640 1 --2- 172.21.15.42:0/1841883954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 0x55cc9ea6b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaac936640 1 -- 172.21.15.42:0/1841883954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 msgr2=0x55cc9ea60d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaac936640 1 --2- 172.21.15.42:0/1841883954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea60d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaac936640 1 -- 172.21.15.42:0/1841883954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 msgr2=0x55cc9ea6b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaac936640 1 --2- 172.21.15.42:0/1841883954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 0x55cc9ea6b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaac936640 1 -- 172.21.15.42:0/1841883954 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc9ea6cc30 con 0x55cc9ea65b40 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaad938640 1 --2- 172.21.15.42:0/1841883954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 0x55cc9ea6b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:41:12.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.426+0000 7fbaac936640 1 --2- 172.21.15.42:0/1841883954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea7b310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0196e0 tx=0x7fba9c00ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=916b08764e477676 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:12.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fba8effd640 1 -- 172.21.15.42:0/1841883954 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c028040 con 0x55cc9ea65b40 2024-09-19T09:41:12.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fba8effd640 1 -- 172.21.15.42:0/1841883954 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba9c0055c0 con 0x55cc9ea65b40 2024-09-19T09:41:12.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fba8effd640 1 -- 172.21.15.42:0/1841883954 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0048c0 con 0x55cc9ea65b40 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fbab1774740 1 -- 172.21.15.42:0/1841883954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 msgr2=0x55cc9ea7b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fbab1774740 1 --2- 172.21.15.42:0/1841883954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea7b310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0196e0 tx=0x7fba9c00ceb0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fbab1774740 1 -- 172.21.15.42:0/1841883954 shutdown_connections 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fbab1774740 1 --2- 172.21.15.42:0/1841883954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea6f370 0x55cc9ea6b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fbab1774740 1 --2- 172.21.15.42:0/1841883954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea65b40 0x55cc9ea7b310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fbab1774740 1 --2- 172.21.15.42:0/1841883954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea645d0 0x55cc9ea60d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fbab1774740 1 -- 172.21.15.42:0/1841883954 >> 172.21.15.42:0/1841883954 conn(0x55cc9ea2d310 msgr2=0x55cc9ea6a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.427+0000 7fbab1774740 1 -- 172.21.15.42:0/1841883954 shutdown_connections 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.428+0000 7fbab1774740 1 -- 172.21.15.42:0/1841883954 wait complete. 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.428+0000 7fbab1774740 1 -- start start 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.428+0000 7fbab1774740 1 Processor -- start 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.428+0000 7fbab1774740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea645d0 0x55cc9ea77660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.428+0000 7fbab1774740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea77ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.428+0000 7fbab1774740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea6f370 0x55cc9ea68850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.428+0000 7fbab1774740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81b0c30 con 0x55cc9ea65b40 2024-09-19T09:41:12.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.428+0000 7fbab1774740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81b0560 con 0x55cc9ea645d0 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.428+0000 7fbab1774740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81ad7a0 con 0x55cc9ea6f370 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.428+0000 7fbab1774740 10 client.0 _ll_register_callbacks cb 0x7fba9c00c690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaad938640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea645d0 0x55cc9ea77660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaac936640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea77ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaad938640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea645d0 0x55cc9ea77660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:41940/0 (socket says 172.21.15.42:41940) 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaad938640 1 -- 172.21.15.42:0/4191841997 learned_addr learned my addr 172.21.15.42:0/4191841997 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaad938640 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea6f370 0x55cc9ea68850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaac936640 1 -- 172.21.15.42:0/4191841997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea6f370 msgr2=0x55cc9ea68850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaac936640 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea6f370 0x55cc9ea68850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaac936640 1 -- 172.21.15.42:0/4191841997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea645d0 msgr2=0x55cc9ea77660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaac936640 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea645d0 0x55cc9ea77660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaac936640 1 -- 172.21.15.42:0/4191841997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc9ea67120 con 0x55cc9ea65b40 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaad938640 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea645d0 0x55cc9ea77660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbaac936640 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea77ba0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55cc9ea5bd20 tx=0x7fba9c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb89b6b58e5174b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fba8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fba8cff9640 1 -- 172.21.15.42:0/4191841997 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c039070 con 0x55cc9ea65b40 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fba8cff9640 1 -- 172.21.15.42:0/4191841997 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fba9c004020 con 0x55cc9ea65b40 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.429+0000 7fbab1774740 1 -- 172.21.15.42:0/4191841997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba9c0055c0 con 0x55cc9ea65b40 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fba8cff9640 1 -- 172.21.15.42:0/4191841997 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fba9c028040 con 0x55cc9ea65b40 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fbab1774740 10 client.16224 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fbab1774740 1 -- 172.21.15.42:0/4191841997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cc9eafa630 con 0x55cc9ea65b40 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fba8cff9640 1 -- 172.21.15.42:0/4191841997 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba9c0055c0 con 0x55cc9ea65b40 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fba8cff9640 1 -- 172.21.15.42:0/4191841997 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fba9c03c030 con 0x55cc9ea65b40 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fbab1774740 10 client.16224 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fbab1774740 10 client.16224 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fbab1774740 20 client.16224 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fbab1774740 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55cc9eafabe0 0x55cc9eafcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fbab1774740 4 client.16224 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fbab1774740 1 -- 172.21.15.42:0/4191841997 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cc9e9d1d70 con 0x55cc9eafabe0 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.430+0000 7fbaad938640 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55cc9eafabe0 0x55cc9eafcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbaad938640 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55cc9eafabe0 0x55cc9eafcfd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=81921a94b7d7fce0 server_cookie=585b5cf14af9d38a in_seq=0 out_seq=0 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fba8cff9640 10 client.16224 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fba8cff9640 1 -- 172.21.15.42:0/4191841997 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cc9e9d1d70 con 0x55cc9eafabe0 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fba8cff9640 10 client.16224 handle_command_reply: tid=0 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 client.16224 shutdown 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 -- 172.21.15.42:0/4191841997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 msgr2=0x55cc9ea77ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea77ba0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55cc9ea5bd20 tx=0x7fba9c00c740 comp rx=0 tx=0).stop 2024-09-19T09:41:12.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 -- 172.21.15.42:0/4191841997 shutdown_connections 2024-09-19T09:41:12.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55cc9eafabe0 0x55cc9eafcfd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc9ea6f370 0x55cc9ea68850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cc9ea65b40 0x55cc9ea77ba0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fba8cff9640 0 client.16224 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:41:12.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 --2- 172.21.15.42:0/4191841997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cc9ea645d0 0x55cc9ea77660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 -- 172.21.15.42:0/4191841997 >> 172.21.15.42:0/4191841997 conn(0x55cc9ea2d310 msgr2=0x55cc9ea6d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:12.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 -- 172.21.15.42:0/4191841997 shutdown_connections 2024-09-19T09:41:12.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.431+0000 7fbab1774740 1 -- 172.21.15.42:0/4191841997 wait complete. 2024-09-19T09:41:12.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbab1774740 20 client.16224 trim_cache size 0 max 16384 2024-09-19T09:41:12.451 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:41:12.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 -- 172.21.15.42:0/3561143448 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fba900a3240 msgr2=0x7fba900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fba900a3240 0x7fba900a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fba980eec60 tx=0x7fba980f48f0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 -- 172.21.15.42:0/3561143448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaa8101de0 msgr2=0x7fbaa819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaa8101de0 0x7fbaa819a620 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fba9802ade0 tx=0x7fba980319f0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 -- 172.21.15.42:0/3561143448 shutdown_connections 2024-09-19T09:41:12.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fba900a3240 0x7fba900a5700 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaa8106f10 0x7fbaa819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbaa8102790 0x7fbaa819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 --2- 172.21.15.42:0/3561143448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaa8101de0 0x7fbaa819a620 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 -- 172.21.15.42:0/3561143448 >> 172.21.15.42:0/3561143448 conn(0x7fbaa80fd8e0 msgr2=0x7fbaa80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 -- 172.21.15.42:0/3561143448 shutdown_connections 2024-09-19T09:41:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:12.432+0000 7fbaaf39b640 1 -- 172.21.15.42:0/3561143448 wait complete. 2024-09-19T09:41:12.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:12 smithi171 ceph-mon[35803]: pgmap v393: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:41:12.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:12 smithi136 ceph-mon[34840]: pgmap v393: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:41:13.106 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:41:13.370 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:13.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.814+0000 7f7945a1b640 1 -- 172.21.15.42:0/918342923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7940102570 msgr2=0x7f79401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:13.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.814+0000 7f7945a1b640 1 --2- 172.21.15.42:0/918342923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7940102570 0x7f79401029b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7934009900 tx=0x7f793402a480 comp rx=0 tx=0).stop 2024-09-19T09:41:13.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.815+0000 7f7945a1b640 1 -- 172.21.15.42:0/918342923 shutdown_connections 2024-09-19T09:41:13.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.815+0000 7f7945a1b640 1 --2- 172.21.15.42:0/918342923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7940102ef0 0x7f794010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.815+0000 7f7945a1b640 1 --2- 172.21.15.42:0/918342923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7940102570 0x7f79401029b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.815+0000 7f7945a1b640 1 --2- 172.21.15.42:0/918342923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7940100e20 0x7f7940101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.815+0000 7f7945a1b640 1 -- 172.21.15.42:0/918342923 >> 172.21.15.42:0/918342923 conn(0x7f79400fc7d0 msgr2=0x7f79400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:13.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.815+0000 7f7945a1b640 1 -- 172.21.15.42:0/918342923 shutdown_connections 2024-09-19T09:41:13.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.815+0000 7f7945a1b640 1 -- 172.21.15.42:0/918342923 wait complete. 2024-09-19T09:41:13.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.815+0000 7f7945a1b640 1 Processor -- start 2024-09-19T09:41:13.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.815+0000 7f7945a1b640 1 -- start start 2024-09-19T09:41:13.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f7945a1b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7940100e20 0x7f794019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f7945a1b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7940102570 0x7f794019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f7945a1b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7940102ef0 0x7f794019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f7945a1b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7940110f80 con 0x7f7940102ef0 2024-09-19T09:41:13.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f7945a1b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7940110e00 con 0x7f7940100e20 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f7945a1b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7940111100 con 0x7f7940102570 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7940102ef0 0x7f794019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7940102ef0 0x7f794019ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37056/0 (socket says 172.21.15.42:37056) 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793f7fe640 1 -- 172.21.15.42:0/198036392 learned_addr learned my addr 172.21.15.42:0/198036392 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793effd640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7940100e20 0x7f794019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793e7fc640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7940102570 0x7f794019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793f7fe640 1 -- 172.21.15.42:0/198036392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7940102570 msgr2=0x7f794019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793f7fe640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7940102570 0x7f794019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793f7fe640 1 -- 172.21.15.42:0/198036392 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7940100e20 msgr2=0x7f794019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793f7fe640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7940100e20 0x7f794019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793f7fe640 1 -- 172.21.15.42:0/198036392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794019f640 con 0x7f7940102ef0 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f793f7fe640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7940102ef0 0x7f794019ef60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f793800e970 tx=0x7f793800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.816+0000 7f7944a19640 1 -- 172.21.15.42:0/198036392 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793800ccc0 con 0x7f7940102ef0 2024-09-19T09:41:13.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.817+0000 7f7945a1b640 1 -- 172.21.15.42:0/198036392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794019f930 con 0x7f7940102ef0 2024-09-19T09:41:13.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.817+0000 7f7944a19640 1 -- 172.21.15.42:0/198036392 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f793800ce60 con 0x7f7940102ef0 2024-09-19T09:41:13.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.817+0000 7f7944a19640 1 -- 172.21.15.42:0/198036392 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938010490 con 0x7f7940102ef0 2024-09-19T09:41:13.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.817+0000 7f7945a1b640 1 -- 172.21.15.42:0/198036392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79401a7210 con 0x7f7940102ef0 2024-09-19T09:41:13.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.819+0000 7f7947df4740 1 Processor -- start 2024-09-19T09:41:13.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.819+0000 7f7944a19640 1 -- 172.21.15.42:0/198036392 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f7938010770 con 0x7f7940102ef0 2024-09-19T09:41:13.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.819+0000 7f7947df4740 1 -- start start 2024-09-19T09:41:13.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.819+0000 7f7947df4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a181090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.819+0000 7f7947df4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a1815d0 0x55749a181a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.819+0000 7f7947df4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a18c370 0x55749a18e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.819+0000 7f7947df4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55749a0e72f0 con 0x55749a182b40 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.819+0000 7f7947df4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55749a08ecf0 con 0x55749a18c370 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.819+0000 7f7947df4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55749a0e32b0 con 0x55749a1815d0 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a181090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a181090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37070/0 (socket says 172.21.15.42:37070) 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793e7fc640 1 -- 172.21.15.42:0/2551208421 learned_addr learned my addr 172.21.15.42:0/2551208421 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793effd640 1 --2- 172.21.15.42:0/2551208421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a1815d0 0x55749a181a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f7944a19640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f79280a32c0 0x7f79280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793e7fc640 1 --2- 172.21.15.42:0/2551208421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a18c370 0x55749a18e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793e7fc640 1 -- 172.21.15.42:0/2551208421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a1815d0 msgr2=0x55749a181a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793e7fc640 1 --2- 172.21.15.42:0/2551208421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a1815d0 0x55749a181a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793e7fc640 1 -- 172.21.15.42:0/2551208421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a18c370 msgr2=0x55749a18e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:13.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793e7fc640 1 --2- 172.21.15.42:0/2551208421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a18c370 0x55749a18e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793f7fe640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f79280a32c0 0x7f79280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793e7fc640 1 -- 172.21.15.42:0/2551208421 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55749a0733a0 con 0x55749a182b40 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f793e7fc640 1 --2- 172.21.15.42:0/2551208421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a181090 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7934005c40 tx=0x7f7934005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950df247b9054540 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.820+0000 7f7944a19640 1 -- 172.21.15.42:0/198036392 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f79380cfd40 con 0x7f7940102ef0 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7925ffb640 1 -- 172.21.15.42:0/2551208421 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934035070 con 0x55749a182b40 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7925ffb640 1 -- 172.21.15.42:0/2551208421 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7934046070 con 0x55749a182b40 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7925ffb640 1 -- 172.21.15.42:0/2551208421 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934031bc0 con 0x55749a182b40 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7947df4740 1 -- 172.21.15.42:0/2551208421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 msgr2=0x55749a181090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f793f7fe640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f79280a32c0 0x7f79280a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7938098d10 tx=0x7f79380986f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7947df4740 1 --2- 172.21.15.42:0/2551208421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a181090 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7934005c40 tx=0x7f7934005b90 comp rx=0 tx=0).stop 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7947df4740 1 -- 172.21.15.42:0/2551208421 shutdown_connections 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7947df4740 1 --2- 172.21.15.42:0/2551208421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a18c370 0x55749a18e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7947df4740 1 --2- 172.21.15.42:0/2551208421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a1815d0 0x55749a181a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7947df4740 1 --2- 172.21.15.42:0/2551208421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a181090 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7947df4740 1 -- 172.21.15.42:0/2551208421 >> 172.21.15.42:0/2551208421 conn(0x55749a14a310 msgr2=0x55749a17dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:13.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7947df4740 1 -- 172.21.15.42:0/2551208421 shutdown_connections 2024-09-19T09:41:13.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.821+0000 7f7947df4740 1 -- 172.21.15.42:0/2551208421 wait complete. 2024-09-19T09:41:13.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f7947df4740 1 -- start start 2024-09-19T09:41:13.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f7947df4740 1 Processor -- start 2024-09-19T09:41:13.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f7947df4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a1815d0 0x55749a18bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f7947df4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a182b40 0x55749a189090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f7947df4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a18c370 0x55749a1897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f7947df4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55749a18f010 con 0x55749a18c370 2024-09-19T09:41:13.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f7947df4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55749a0a2060 con 0x55749a1815d0 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f7947df4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55749a18f190 con 0x55749a182b40 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f7947df4740 10 client.0 _ll_register_callbacks cb 0x557499df58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f793e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a18c370 0x55749a1897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f793e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a18c370 0x55749a1897d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37080/0 (socket says 172.21.15.42:37080) 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.822+0000 7f793e7fc640 1 -- 172.21.15.42:0/1866427675 learned_addr learned my addr 172.21.15.42:0/1866427675 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f793e7fc640 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a1815d0 0x55749a18bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f793effd640 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a182b40 0x55749a189090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f793e7fc640 1 -- 172.21.15.42:0/1866427675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a182b40 msgr2=0x55749a189090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f793e7fc640 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a182b40 0x55749a189090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f793e7fc640 1 -- 172.21.15.42:0/1866427675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a1815d0 msgr2=0x55749a18bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f793e7fc640 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a1815d0 0x55749a18bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f793e7fc640 1 -- 172.21.15.42:0/1866427675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557499e583c0 con 0x55749a18c370 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f793e7fc640 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a18c370 0x55749a1897d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f79340318a0 tx=0x7f79340317a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920d548c8a20b778 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f791effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f791effd640 1 -- 172.21.15.42:0/1866427675 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934035070 con 0x55749a18c370 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f791effd640 1 -- 172.21.15.42:0/1866427675 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7934005250 con 0x55749a18c370 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f7947df4740 1 -- 172.21.15.42:0/1866427675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7934046070 con 0x55749a18c370 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f791effd640 1 -- 172.21.15.42:0/1866427675 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7934005450 con 0x55749a18c370 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f7947df4740 10 client.16236 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.823+0000 7f7947df4740 1 -- 172.21.15.42:0/1866427675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55749a19ab40 con 0x55749a18c370 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f791effd640 1 -- 172.21.15.42:0/1866427675 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7934046070 con 0x55749a18c370 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f791effd640 1 -- 172.21.15.42:0/1866427675 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f793403c710 con 0x55749a18c370 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f7947df4740 10 client.16236 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f7947df4740 10 client.16236 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:41:13.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f7947df4740 20 client.16236 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f7947df4740 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55749a19be90 0x55749a19e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f7947df4740 4 client.16236 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f7947df4740 1 -- 172.21.15.42:0/1866427675 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55749a0f4860 con 0x55749a19be90 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f793effd640 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55749a19be90 0x55749a19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f791effd640 10 client.16236 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.824+0000 7f793effd640 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55749a19be90 0x55749a19e280 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f11cb71ce4048ed7 server_cookie=de7527b6413352ee in_seq=0 out_seq=0 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.826+0000 7f791effd640 1 -- 172.21.15.42:0/1866427675 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55749a0f4860 con 0x55749a19be90 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.826+0000 7f791effd640 10 client.16236 handle_command_reply: tid=0 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.826+0000 7f7947df4740 1 client.16236 shutdown 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 1 -- 172.21.15.42:0/1866427675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a18c370 msgr2=0x55749a1897d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a18c370 0x55749a1897d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f79340318a0 tx=0x7f79340317a0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 1 -- 172.21.15.42:0/1866427675 shutdown_connections 2024-09-19T09:41:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55749a19be90 0x55749a19e280 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f791effd640 0 client.16236 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:41:13.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a18c370 0x55749a1897d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a182b40 0x55749a189090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 1 --2- 172.21.15.42:0/1866427675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a1815d0 0x55749a18bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 1 -- 172.21.15.42:0/1866427675 >> 172.21.15.42:0/1866427675 conn(0x55749a14a310 msgr2=0x55749a183960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:13.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 1 -- 172.21.15.42:0/1866427675 shutdown_connections 2024-09-19T09:41:13.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 1 -- 172.21.15.42:0/1866427675 wait complete. 2024-09-19T09:41:13.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.827+0000 7f7947df4740 20 client.16236 trim_cache size 0 max 16384 2024-09-19T09:41:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f7947df4740 1 Processor -- start 2024-09-19T09:41:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f7947df4740 1 -- start start 2024-09-19T09:41:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f7947df4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a1815d0 0x55749a17cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f7947df4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a184120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f7947df4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a18c370 0x55749a184660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f7947df4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f79401af710 con 0x55749a182b40 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f7947df4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f79401b1280 con 0x55749a1815d0 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f7947df4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f79401afde0 con 0x55749a18c370 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f793effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a184120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f793effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a184120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37086/0 (socket says 172.21.15.42:37086) 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f793effd640 1 -- 172.21.15.42:0/2980754411 learned_addr learned my addr 172.21.15.42:0/2980754411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.840+0000 7f793e7fc640 1 --2- 172.21.15.42:0/2980754411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a1815d0 0x55749a17cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.841+0000 7f793e7fc640 1 --2- 172.21.15.42:0/2980754411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a18c370 0x55749a184660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.841+0000 7f793effd640 1 -- 172.21.15.42:0/2980754411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a18c370 msgr2=0x55749a184660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.841+0000 7f793effd640 1 --2- 172.21.15.42:0/2980754411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a18c370 0x55749a184660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.841+0000 7f793effd640 1 -- 172.21.15.42:0/2980754411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a1815d0 msgr2=0x55749a17cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.841+0000 7f793effd640 1 --2- 172.21.15.42:0/2980754411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a1815d0 0x55749a17cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.841+0000 7f793effd640 1 -- 172.21.15.42:0/2980754411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55749a17ded0 con 0x55749a182b40 2024-09-19T09:41:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.841+0000 7f793effd640 1 --2- 172.21.15.42:0/2980754411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a184120 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55749a188920 tx=0x7f7930012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fca57337b55bed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.841+0000 7f79257fa640 1 -- 172.21.15.42:0/2980754411 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930011ab0 con 0x55749a182b40 2024-09-19T09:41:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.841+0000 7f79257fa640 1 -- 172.21.15.42:0/2980754411 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7930011c50 con 0x55749a182b40 2024-09-19T09:41:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.841+0000 7f79257fa640 1 -- 172.21.15.42:0/2980754411 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930025610 con 0x55749a182b40 2024-09-19T09:41:13.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 -- 172.21.15.42:0/2980754411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 msgr2=0x55749a184120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:13.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 --2- 172.21.15.42:0/2980754411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a184120 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55749a188920 tx=0x7f7930012c00 comp rx=0 tx=0).stop 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 -- 172.21.15.42:0/2980754411 shutdown_connections 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 --2- 172.21.15.42:0/2980754411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a18c370 0x55749a184660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 --2- 172.21.15.42:0/2980754411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a182b40 0x55749a184120 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 --2- 172.21.15.42:0/2980754411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a1815d0 0x55749a17cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 -- 172.21.15.42:0/2980754411 >> 172.21.15.42:0/2980754411 conn(0x55749a14a310 msgr2=0x55749a17c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 -- 172.21.15.42:0/2980754411 shutdown_connections 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 -- 172.21.15.42:0/2980754411 wait complete. 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 -- start start 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.842+0000 7f7947df4740 1 Processor -- start 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f7947df4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a1815d0 0x55749a1a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f7947df4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a182b40 0x55749a19ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f7947df4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a18c370 0x55749a19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f7947df4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f79401b0b80 con 0x55749a1815d0 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f7947df4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f79401b04b0 con 0x55749a18c370 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f7947df4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f79401ad6f0 con 0x55749a182b40 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f7947df4740 10 client.0 _ll_register_callbacks cb 0x7f7930009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a1815d0 0x55749a1a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a1815d0 0x55749a1a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37100/0 (socket says 172.21.15.42:37100) 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793e7fc640 1 -- 172.21.15.42:0/1661812315 learned_addr learned my addr 172.21.15.42:0/1661812315 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793effd640 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a182b40 0x55749a19ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793e7fc640 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a18c370 0x55749a19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793e7fc640 1 -- 172.21.15.42:0/1661812315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a182b40 msgr2=0x55749a19ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793e7fc640 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a182b40 0x55749a19ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793e7fc640 1 -- 172.21.15.42:0/1661812315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a18c370 msgr2=0x55749a19f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793e7fc640 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a18c370 0x55749a19f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793e7fc640 1 -- 172.21.15.42:0/1661812315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55749a19fbf0 con 0x55749a1815d0 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f793e7fc640 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a1815d0 0x55749a1a1ad0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7934031470 tx=0x7f7934031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ea01bbc0886ce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.843+0000 7f791effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f791effd640 1 -- 172.21.15.42:0/1661812315 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934050070 con 0x55749a1815d0 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f791effd640 1 -- 172.21.15.42:0/1661812315 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f79340055f0 con 0x55749a1815d0 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f7947df4740 1 -- 172.21.15.42:0/1661812315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7930011c50 con 0x55749a1815d0 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f791effd640 1 -- 172.21.15.42:0/1661812315 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f793406d050 con 0x55749a1815d0 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f7947df4740 10 client.16242 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f7947df4740 1 -- 172.21.15.42:0/1661812315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55749a2068a0 con 0x55749a1815d0 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f791effd640 1 -- 172.21.15.42:0/1661812315 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7930011c50 con 0x55749a1815d0 2024-09-19T09:41:13.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f791effd640 1 -- 172.21.15.42:0/1661812315 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f7934064070 con 0x55749a1815d0 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f7947df4740 10 client.16242 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f7947df4740 10 client.16242 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f7947df4740 20 client.16242 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f7947df4740 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55749a19be90 0x55749a208f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f7947df4740 4 client.16242 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f7947df4740 1 -- 172.21.15.42:0/1661812315 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55749a0eed70 con 0x55749a19be90 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.844+0000 7f793effd640 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55749a19be90 0x55749a208f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.845+0000 7f793effd640 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55749a19be90 0x55749a208f80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30ac241d283dfc9b server_cookie=27203da1cedc209d in_seq=0 out_seq=0 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.845+0000 7f791effd640 10 client.16242 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.845+0000 7f791effd640 1 -- 172.21.15.42:0/1661812315 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55749a0eed70 con 0x55749a19be90 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.845+0000 7f791effd640 10 client.16242 handle_command_reply: tid=0 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.845+0000 7f7947df4740 1 client.16242 shutdown 2024-09-19T09:41:13.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 1 -- 172.21.15.42:0/1661812315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a1815d0 msgr2=0x55749a1a1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a1815d0 0x55749a1a1ad0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7934031470 tx=0x7f7934031400 comp rx=0 tx=0).stop 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 1 -- 172.21.15.42:0/1661812315 shutdown_connections 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55749a19be90 0x55749a208f80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55749a18c370 0x55749a19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55749a182b40 0x55749a19ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 1 --2- 172.21.15.42:0/1661812315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55749a1815d0 0x55749a1a1ad0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 1 -- 172.21.15.42:0/1661812315 >> 172.21.15.42:0/1661812315 conn(0x55749a14a310 msgr2=0x55749a18b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f791effd640 0 client.16242 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 1 -- 172.21.15.42:0/1661812315 shutdown_connections 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 1 -- 172.21.15.42:0/1661812315 wait complete. 2024-09-19T09:41:13.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7947df4740 20 client.16242 trim_cache size 0 max 16384 2024-09-19T09:41:13.854 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:41:13.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7945a1b640 1 -- 172.21.15.42:0/198036392 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f79280a32c0 msgr2=0x7f79280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7945a1b640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f79280a32c0 0x7f79280a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7938098d10 tx=0x7f79380986f0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7945a1b640 1 -- 172.21.15.42:0/198036392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7940102ef0 msgr2=0x7f794019ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.846+0000 7f7945a1b640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7940102ef0 0x7f794019ef60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f793800e970 tx=0x7f793800ed70 comp rx=0 tx=0).stop 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.847+0000 7f7945a1b640 1 -- 172.21.15.42:0/198036392 shutdown_connections 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.847+0000 7f7945a1b640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f79280a32c0 0x7f79280a5780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.847+0000 7f7945a1b640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7940102ef0 0x7f794019ef60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.847+0000 7f7945a1b640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7940102570 0x7f794019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.847+0000 7f7945a1b640 1 --2- 172.21.15.42:0/198036392 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7940100e20 0x7f794019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.847+0000 7f7945a1b640 1 -- 172.21.15.42:0/198036392 >> 172.21.15.42:0/198036392 conn(0x7f79400fc7d0 msgr2=0x7f794006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.847+0000 7f7945a1b640 1 -- 172.21.15.42:0/198036392 shutdown_connections 2024-09-19T09:41:13.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:13.847+0000 7f7945a1b640 1 -- 172.21.15.42:0/198036392 wait complete. 2024-09-19T09:41:14.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:14 smithi042 ceph-mon[31223]: pgmap v394: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-19T09:41:14.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:14 smithi171 ceph-mon[35803]: pgmap v394: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-19T09:41:14.607 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:41:14.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:14 smithi136 ceph-mon[34840]: pgmap v394: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-19T09:41:14.868 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.349+0000 7f4baf164640 1 -- 172.21.15.42:0/186497740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ba810c170 msgr2=0x7f4ba810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.349+0000 7f4baf164640 1 --2- 172.21.15.42:0/186497740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ba810c170 0x7f4ba810e610 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009900 tx=0x7f4ba002a480 comp rx=0 tx=0).stop 2024-09-19T09:41:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.349+0000 7f4baf164640 1 -- 172.21.15.42:0/186497740 shutdown_connections 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.349+0000 7f4baf164640 1 --2- 172.21.15.42:0/186497740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ba810c170 0x7f4ba810e610 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.349+0000 7f4baf164640 1 --2- 172.21.15.42:0/186497740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ba8103660 0x7f4ba810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.349+0000 7f4baf164640 1 --2- 172.21.15.42:0/186497740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ba8102d40 0x7f4ba8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.349+0000 7f4baf164640 1 -- 172.21.15.42:0/186497740 >> 172.21.15.42:0/186497740 conn(0x7f4ba80fc7a0 msgr2=0x7f4ba80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.349+0000 7f4baf164640 1 -- 172.21.15.42:0/186497740 shutdown_connections 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.349+0000 7f4baf164640 1 -- 172.21.15.42:0/186497740 wait complete. 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4baf164640 1 Processor -- start 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4baf164640 1 -- start start 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4baf164640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ba8102d40 0x7f4ba8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4baf164640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ba8103660 0x7f4ba81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4baf164640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ba810c170 0x7f4ba819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4baf164640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8111f50 con 0x7f4ba810c170 2024-09-19T09:41:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4baf164640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8111dd0 con 0x7f4ba8103660 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4baf164640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81120d0 con 0x7f4ba8102d40 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4bad701640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ba810c170 0x7f4ba819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4bad701640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ba810c170 0x7f4ba819cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37118/0 (socket says 172.21.15.42:37118) 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4bad701640 1 -- 172.21.15.42:0/880757979 learned_addr learned my addr 172.21.15.42:0/880757979 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.350+0000 7f4ba7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ba8103660 0x7f4ba81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4bacf00640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ba8102d40 0x7f4ba8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4bad701640 1 -- 172.21.15.42:0/880757979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ba8102d40 msgr2=0x7f4ba8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4bad701640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ba8102d40 0x7f4ba8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4bad701640 1 -- 172.21.15.42:0/880757979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ba8103660 msgr2=0x7f4ba81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4bad701640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ba8103660 0x7f4ba81989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4bad701640 1 -- 172.21.15.42:0/880757979 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba819d410 con 0x7f4ba810c170 2024-09-19T09:41:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ba8103660 0x7f4ba81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4bad701640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ba810c170 0x7f4ba819cd30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0005ab0 tx=0x7f4ba0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4ba5ffb640 1 -- 172.21.15.42:0/880757979 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba003f030 con 0x7f4ba810c170 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4baf164640 1 -- 172.21.15.42:0/880757979 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba819d6a0 con 0x7f4ba810c170 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4ba5ffb640 1 -- 172.21.15.42:0/880757979 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba0004440 con 0x7f4ba810c170 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4ba5ffb640 1 -- 172.21.15.42:0/880757979 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0035070 con 0x7f4ba810c170 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.351+0000 7f4baf164640 1 -- 172.21.15.42:0/880757979 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba81a4fe0 con 0x7f4ba810c170 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4ba5ffb640 1 -- 172.21.15.42:0/880757979 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f4ba0042030 con 0x7f4ba810c170 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4bb153d740 1 Processor -- start 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4bb153d740 1 -- start start 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f300b40 0x56366f2ff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f2ff5d0 0x56366f2ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f30a370 0x56366f30c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4bb153d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56366f2652f0 con 0x56366f30a370 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4bb153d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56366f20ccf0 con 0x56366f2ff5d0 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4bb153d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56366f2612b0 con 0x56366f300b40 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4ba5ffb640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b940a3240 0x7f4b940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4ba7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f30a370 0x56366f30c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4ba7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f30a370 0x56366f30c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37120/0 (socket says 172.21.15.42:37120) 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4ba7fff640 1 -- 172.21.15.42:0/3577106478 learned_addr learned my addr 172.21.15.42:0/3577106478 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.354+0000 7f4bacf00640 1 --2- 172.21.15.42:0/3577106478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f2ff5d0 0x56366f2ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4bad701640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b940a3240 0x7f4b940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/3577106478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f300b40 0x56366f2ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4ba5ffb640 1 -- 172.21.15.42:0/880757979 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4ba00efb80 con 0x7f4ba810c170 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4bacf00640 1 -- 172.21.15.42:0/3577106478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f300b40 msgr2=0x56366f2ff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4bacf00640 1 --2- 172.21.15.42:0/3577106478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f300b40 0x56366f2ff090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4bacf00640 1 -- 172.21.15.42:0/3577106478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f30a370 msgr2=0x56366f30c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4bacf00640 1 --2- 172.21.15.42:0/3577106478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f30a370 0x56366f30c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4bacf00640 1 -- 172.21.15.42:0/3577106478 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366f1f13a0 con 0x56366f2ff5d0 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/3577106478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f30a370 0x56366f30c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4bad701640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b940a3240 0x7f4b940a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00eff30 tx=0x7f4ba00e6f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4bacf00640 1 --2- 172.21.15.42:0/3577106478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f2ff5d0 0x56366f2ffa10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009c20 tx=0x7f4b90011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631807faf1092bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4b9effd640 1 -- 172.21.15.42:0/3577106478 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90009dd0 con 0x56366f2ff5d0 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4b9effd640 1 -- 172.21.15.42:0/3577106478 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b90005020 con 0x56366f2ff5d0 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.355+0000 7f4b9effd640 1 -- 172.21.15.42:0/3577106478 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90004ab0 con 0x56366f2ff5d0 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.356+0000 7f4bb153d740 1 -- 172.21.15.42:0/3577106478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f2ff5d0 msgr2=0x56366f2ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.356+0000 7f4bb153d740 1 --2- 172.21.15.42:0/3577106478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f2ff5d0 0x56366f2ffa10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009c20 tx=0x7f4b90011810 comp rx=0 tx=0).stop 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.356+0000 7f4bb153d740 1 -- 172.21.15.42:0/3577106478 shutdown_connections 2024-09-19T09:41:15.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.356+0000 7f4bb153d740 1 --2- 172.21.15.42:0/3577106478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f30a370 0x56366f30c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.356+0000 7f4bb153d740 1 --2- 172.21.15.42:0/3577106478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f2ff5d0 0x56366f2ffa10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.356+0000 7f4bb153d740 1 --2- 172.21.15.42:0/3577106478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f300b40 0x56366f2ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.356+0000 7f4bb153d740 1 -- 172.21.15.42:0/3577106478 >> 172.21.15.42:0/3577106478 conn(0x56366f2c8310 msgr2=0x56366f2fbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.356+0000 7f4bb153d740 1 -- 172.21.15.42:0/3577106478 shutdown_connections 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.356+0000 7f4bb153d740 1 -- 172.21.15.42:0/3577106478 wait complete. 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.356+0000 7f4bb153d740 1 -- start start 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bb153d740 1 Processor -- start 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f2ff5d0 0x56366f309d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f300b40 0x56366f307000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f30a370 0x56366f3075d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bb153d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56366f30d070 con 0x56366f300b40 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bb153d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56366f220060 con 0x56366f30a370 2024-09-19T09:41:15.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bb153d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56366f30d1f0 con 0x56366f2ff5d0 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bb153d740 10 client.0 _ll_register_callbacks cb 0x56366ef738c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bacf00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f300b40 0x56366f307000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bacf00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f300b40 0x56366f307000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37126/0 (socket says 172.21.15.42:37126) 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4bacf00640 1 -- 172.21.15.42:0/1075998206 learned_addr learned my addr 172.21.15.42:0/1075998206 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4ba7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f30a370 0x56366f3075d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.357+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f2ff5d0 0x56366f309d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4bacf00640 1 -- 172.21.15.42:0/1075998206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f2ff5d0 msgr2=0x56366f309d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4bacf00640 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f2ff5d0 0x56366f309d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4bacf00640 1 -- 172.21.15.42:0/1075998206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f30a370 msgr2=0x56366f3075d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4bacf00640 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f30a370 0x56366f3075d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4bacf00640 1 -- 172.21.15.42:0/1075998206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366efd63c0 con 0x56366f300b40 2024-09-19T09:41:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f30a370 0x56366f3075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4bacf00640 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f300b40 0x56366f307000 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4b9001b040 tx=0x7f4b900098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3343fe0c9ce032c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4b87fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4b87fff640 1 -- 172.21.15.42:0/1075998206 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90029020 con 0x56366f300b40 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4b87fff640 1 -- 172.21.15.42:0/1075998206 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4b90004a20 con 0x56366f300b40 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4bb153d740 1 -- 172.21.15.42:0/1075998206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b90005020 con 0x56366f300b40 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4b87fff640 1 -- 172.21.15.42:0/1075998206 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4b90034050 con 0x56366f300b40 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4bb153d740 10 client.16254 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4bb153d740 1 -- 172.21.15.42:0/1075998206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56366f318af0 con 0x56366f300b40 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.358+0000 7f4b87fff640 1 -- 172.21.15.42:0/1075998206 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b90005020 con 0x56366f300b40 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.359+0000 7f4b87fff640 1 -- 172.21.15.42:0/1075998206 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4b90023420 con 0x56366f300b40 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.359+0000 7f4bb153d740 10 client.16254 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.359+0000 7f4bb153d740 10 client.16254 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.359+0000 7f4bb153d740 20 client.16254 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.359+0000 7f4bb153d740 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x56366f319f50 0x56366f31c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.359+0000 7f4bb153d740 4 client.16254 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.359+0000 7f4bb153d740 1 -- 172.21.15.42:0/1075998206 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56366f272860 con 0x56366f319f50 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.359+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x56366f319f50 0x56366f31c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.359+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x56366f319f50 0x56366f31c340 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3e62c4d493ad3c server_cookie=c9b2ce6fcd561a1c in_seq=0 out_seq=0 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.359+0000 7f4b87fff640 10 client.16254 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4b87fff640 1 -- 172.21.15.42:0/1075998206 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56366f272860 con 0x56366f319f50 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4b87fff640 10 client.16254 handle_command_reply: tid=0 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 client.16254 shutdown 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 -- 172.21.15.42:0/1075998206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f300b40 msgr2=0x56366f307000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f300b40 0x56366f307000 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4b9001b040 tx=0x7f4b900098d0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 -- 172.21.15.42:0/1075998206 shutdown_connections 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x56366f319f50 0x56366f31c340 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f30a370 0x56366f3075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f300b40 0x56366f307000 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4b87fff640 0 client.16254 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:41:15.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 --2- 172.21.15.42:0/1075998206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f2ff5d0 0x56366f309d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 -- 172.21.15.42:0/1075998206 >> 172.21.15.42:0/1075998206 conn(0x56366f2c8310 msgr2=0x56366f3019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:15.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 -- 172.21.15.42:0/1075998206 shutdown_connections 2024-09-19T09:41:15.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 1 -- 172.21.15.42:0/1075998206 wait complete. 2024-09-19T09:41:15.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.360+0000 7f4bb153d740 20 client.16254 trim_cache size 0 max 16384 2024-09-19T09:41:15.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.373+0000 7f4bb153d740 1 Processor -- start 2024-09-19T09:41:15.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4bb153d740 1 -- start start 2024-09-19T09:41:15.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f316310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 0x56366f308f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f30a370 0x56366f321b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4bb153d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81ad660 con 0x56366f2ff5d0 2024-09-19T09:41:15.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4bb153d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81af1d0 con 0x56366f300b40 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4bb153d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81add30 con 0x56366f30a370 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4ba7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f316310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4ba7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f316310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37128/0 (socket says 172.21.15.42:37128) 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4ba7fff640 1 -- 172.21.15.42:0/1175603898 learned_addr learned my addr 172.21.15.42:0/1175603898 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4bacf00640 1 --2- 172.21.15.42:0/1175603898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 0x56366f308f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4ba7fff640 1 -- 172.21.15.42:0/1175603898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f30a370 msgr2=0x56366f321b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/1175603898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f30a370 0x56366f321b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4ba7fff640 1 -- 172.21.15.42:0/1175603898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 msgr2=0x56366f308f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/1175603898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 0x56366f308f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4ba7fff640 1 -- 172.21.15.42:0/1175603898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366f2fc960 con 0x56366f2ff5d0 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.374+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/1175603898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f316310 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x56366f31caf0 tx=0x7f4b98005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63a29e6f046ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4b9e7fc640 1 -- 172.21.15.42:0/1175603898 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800eea0 con 0x56366f2ff5d0 2024-09-19T09:41:15.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4b9e7fc640 1 -- 172.21.15.42:0/1175603898 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b980227b0 con 0x56366f2ff5d0 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4b9e7fc640 1 -- 172.21.15.42:0/1175603898 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b980053a0 con 0x56366f2ff5d0 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4bb153d740 1 -- 172.21.15.42:0/1175603898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 msgr2=0x56366f316310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4bb153d740 1 --2- 172.21.15.42:0/1175603898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f316310 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x56366f31caf0 tx=0x7f4b98005bd0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4bb153d740 1 -- 172.21.15.42:0/1175603898 shutdown_connections 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4bb153d740 1 --2- 172.21.15.42:0/1175603898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f30a370 0x56366f321b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4bb153d740 1 --2- 172.21.15.42:0/1175603898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 0x56366f308f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4bb153d740 1 --2- 172.21.15.42:0/1175603898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f316310 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4bb153d740 1 -- 172.21.15.42:0/1175603898 >> 172.21.15.42:0/1175603898 conn(0x56366f2c8310 msgr2=0x56366f308860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4bb153d740 1 -- 172.21.15.42:0/1175603898 shutdown_connections 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.375+0000 7f4bb153d740 1 -- 172.21.15.42:0/1175603898 wait complete. 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4bb153d740 1 -- start start 2024-09-19T09:41:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4bb153d740 1 Processor -- start 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f312830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 0x56366f312d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4bb153d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f30a370 0x56366f30ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4bb153d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81aead0 con 0x56366f2ff5d0 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4bb153d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81ae400 con 0x56366f300b40 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4bb153d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81ab640 con 0x56366f30a370 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4bb153d740 10 client.0 _ll_register_callbacks cb 0x7f4b980115e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4ba7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f312830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4ba7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f312830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37138/0 (socket says 172.21.15.42:37138) 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4bacf00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 0x56366f312d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.376+0000 7f4ba7fff640 1 -- 172.21.15.42:0/4215302305 learned_addr learned my addr 172.21.15.42:0/4215302305 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f30a370 0x56366f30ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4ba7fff640 1 -- 172.21.15.42:0/4215302305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f30a370 msgr2=0x56366f30ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f30a370 0x56366f30ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4ba7fff640 1 -- 172.21.15.42:0/4215302305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 msgr2=0x56366f312d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 0x56366f312d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4ba7fff640 1 -- 172.21.15.42:0/4215302305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366f302120 con 0x56366f2ff5d0 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4bacf00640 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 0x56366f312d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4ba7fff640 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f312830 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4b98003a20 tx=0x7f4b98003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56b10bd7a873aae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4b87fff640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4b87fff640 1 -- 172.21.15.42:0/4215302305 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98011030 con 0x56366f2ff5d0 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4b87fff640 1 -- 172.21.15.42:0/4215302305 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4b98030040 con 0x56366f2ff5d0 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4bb153d740 1 -- 172.21.15.42:0/4215302305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b980227b0 con 0x56366f2ff5d0 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.377+0000 7f4b87fff640 1 -- 172.21.15.42:0/4215302305 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4b9803c070 con 0x56366f2ff5d0 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4bb153d740 10 client.16260 fetch_fsmap learned FSMap version 29 2024-09-19T09:41:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4bb153d740 1 -- 172.21.15.42:0/4215302305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56366f3889d0 con 0x56366f2ff5d0 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4b87fff640 1 -- 172.21.15.42:0/4215302305 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b980227b0 con 0x56366f2ff5d0 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4b87fff640 1 -- 172.21.15.42:0/4215302305 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4b98005420 con 0x56366f2ff5d0 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4bb153d740 10 client.16260 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4bb153d740 10 client.16260 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4bb153d740 20 client.16260 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4bb153d740 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x56366f388f90 0x56366f38b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4bb153d740 4 client.16260 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4bb153d740 1 -- 172.21.15.42:0/4215302305 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56366f26cd70 con 0x56366f388f90 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.378+0000 7f4bacf00640 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x56366f388f90 0x56366f38b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bacf00640 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x56366f388f90 0x56366f38b3b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9932514a0826c613 server_cookie=b8f64f9501ef0afc in_seq=0 out_seq=0 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4b87fff640 10 client.16260 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4b87fff640 1 -- 172.21.15.42:0/4215302305 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56366f26cd70 con 0x56366f388f90 2024-09-19T09:41:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4b87fff640 10 client.16260 handle_command_reply: tid=0 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 client.16260 shutdown 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 -- 172.21.15.42:0/4215302305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 msgr2=0x56366f312830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f312830 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4b98003a20 tx=0x7f4b98003970 comp rx=0 tx=0).stop 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 -- 172.21.15.42:0/4215302305 shutdown_connections 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x56366f388f90 0x56366f38b3b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56366f30a370 0x56366f30ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366f300b40 0x56366f312d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 --2- 172.21.15.42:0/4215302305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56366f2ff5d0 0x56366f312830 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 -- 172.21.15.42:0/4215302305 >> 172.21.15.42:0/4215302305 conn(0x56366f2c8310 msgr2=0x56366f309080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4b87fff640 0 client.16260 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 -- 172.21.15.42:0/4215302305 shutdown_connections 2024-09-19T09:41:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 1 -- 172.21.15.42:0/4215302305 wait complete. 2024-09-19T09:41:15.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.379+0000 7f4bb153d740 20 client.16260 trim_cache size 0 max 16384 2024-09-19T09:41:15.388 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:41:15.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 -- 172.21.15.42:0/880757979 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b940a3240 msgr2=0x7f4b940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b940a3240 0x7f4b940a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00eff30 tx=0x7f4ba00e6f50 comp rx=0 tx=0).stop 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 -- 172.21.15.42:0/880757979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ba810c170 msgr2=0x7f4ba819cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ba810c170 0x7f4ba819cd30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0005ab0 tx=0x7f4ba0004040 comp rx=0 tx=0).stop 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 -- 172.21.15.42:0/880757979 shutdown_connections 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b940a3240 0x7f4b940a5700 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ba810c170 0x7f4ba819cd30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ba8103660 0x7f4ba81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 --2- 172.21.15.42:0/880757979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ba8102d40 0x7f4ba8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 -- 172.21.15.42:0/880757979 >> 172.21.15.42:0/880757979 conn(0x7f4ba80fc7a0 msgr2=0x7f4ba80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 -- 172.21.15.42:0/880757979 shutdown_connections 2024-09-19T09:41:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:15.380+0000 7f4baf164640 1 -- 172.21.15.42:0/880757979 wait complete. 2024-09-19T09:41:16.273 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:16 smithi042 ceph-mon[31223]: pgmap v395: 97 pgs: 97 active+clean; 10 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 357 KiB/s wr, 17 op/s 2024-09-19T09:41:16.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:41:16.538 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:16.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:16 smithi171 ceph-mon[35803]: pgmap v395: 97 pgs: 97 active+clean; 10 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 357 KiB/s wr, 17 op/s 2024-09-19T09:41:16.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:16 smithi136 ceph-mon[34840]: pgmap v395: 97 pgs: 97 active+clean; 10 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 357 KiB/s wr, 17 op/s 2024-09-19T09:41:17.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.038+0000 7f80d52bb640 1 -- 172.21.15.42:0/4078789310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80d0101de0 msgr2=0x7f80d01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.038+0000 7f80d52bb640 1 --2- 172.21.15.42:0/4078789310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80d0101de0 0x7f80d01021c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009900 tx=0x7f80c002a410 comp rx=0 tx=0).stop 2024-09-19T09:41:17.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.038+0000 7f80d52bb640 1 -- 172.21.15.42:0/4078789310 shutdown_connections 2024-09-19T09:41:17.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.038+0000 7f80d52bb640 1 --2- 172.21.15.42:0/4078789310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80d0106f10 0x7f80d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.038+0000 7f80d52bb640 1 --2- 172.21.15.42:0/4078789310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80d0102790 0x7f80d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.038+0000 7f80d52bb640 1 --2- 172.21.15.42:0/4078789310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80d0101de0 0x7f80d01021c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.038+0000 7f80d52bb640 1 -- 172.21.15.42:0/4078789310 >> 172.21.15.42:0/4078789310 conn(0x7f80d00fd8c0 msgr2=0x7f80d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.038+0000 7f80d52bb640 1 -- 172.21.15.42:0/4078789310 shutdown_connections 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.038+0000 7f80d52bb640 1 -- 172.21.15.42:0/4078789310 wait complete. 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80d52bb640 1 Processor -- start 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80d52bb640 1 -- start start 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80d52bb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80d0101de0 0x7f80d0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80d52bb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80d0102790 0x7f80d0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80d52bb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80d0106f10 0x7f80d019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80d52bb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f80d0111f30 con 0x7f80d0106f10 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80d52bb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f80d0111db0 con 0x7f80d0102790 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80d52bb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f80d01120b0 con 0x7f80d0101de0 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80c67fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80d0102790 0x7f80d0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80cf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80d0106f10 0x7f80d019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80c67fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80d0102790 0x7f80d0198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:42042/0 (socket says 172.21.15.42:42042) 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80c67fc640 1 -- 172.21.15.42:0/412647661 learned_addr learned my addr 172.21.15.42:0/412647661 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.039+0000 7f80ceffd640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80d0101de0 0x7f80d0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80c67fc640 1 -- 172.21.15.42:0/412647661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80d0101de0 msgr2=0x7f80d0198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80c67fc640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80d0101de0 0x7f80d0198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80c67fc640 1 -- 172.21.15.42:0/412647661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80d0106f10 msgr2=0x7f80d019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80c67fc640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80d0106f10 0x7f80d019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80c67fc640 1 -- 172.21.15.42:0/412647661 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d019d4c0 con 0x7f80d0102790 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80c67fc640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80d0102790 0x7f80d0198a50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f80b800e9f0 tx=0x7f80b800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80ccff9640 1 -- 172.21.15.42:0/412647661 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b800cd80 con 0x7f80d0102790 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80d52bb640 1 -- 172.21.15.42:0/412647661 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d019d7b0 con 0x7f80d0102790 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80ccff9640 1 -- 172.21.15.42:0/412647661 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b8010910 con 0x7f80d0102790 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80ccff9640 1 -- 172.21.15.42:0/412647661 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b80188f0 con 0x7f80d0102790 2024-09-19T09:41:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.040+0000 7f80d52bb640 1 -- 172.21.15.42:0/412647661 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d01a5090 con 0x7f80d0102790 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.042+0000 7f80ccff9640 1 -- 172.21.15.42:0/412647661 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f80b8010ac0 con 0x7f80d0102790 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80d7694740 1 Processor -- start 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80d7694740 1 -- start start 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80d7694740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb7b40 0x56292ecb6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80d7694740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb65d0 0x56292ecb6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80d7694740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecc1370 0x56292ecc3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80d7694740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56292ec1c2f0 con 0x56292ecc1370 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80d7694740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56292ebc3cf0 con 0x56292ecb65d0 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80d7694740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56292ec182b0 con 0x56292ecb7b40 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80ceffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb65d0 0x56292ecb6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80c67fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecc1370 0x56292ecc3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80ceffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb65d0 0x56292ecb6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:42050/0 (socket says 172.21.15.42:42050) 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80ceffd640 1 -- 172.21.15.42:0/992147056 learned_addr learned my addr 172.21.15.42:0/992147056 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:17.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.043+0000 7f80ccff9640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80bc0a3240 0x7f80bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80cf7fe640 1 --2- 172.21.15.42:0/992147056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb7b40 0x56292ecb6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80cf7fe640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80bc0a3240 0x7f80bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80ceffd640 1 -- 172.21.15.42:0/992147056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb7b40 msgr2=0x56292ecb6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80ceffd640 1 --2- 172.21.15.42:0/992147056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb7b40 0x56292ecb6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80ceffd640 1 -- 172.21.15.42:0/992147056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecc1370 msgr2=0x56292ecc3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80ceffd640 1 --2- 172.21.15.42:0/992147056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecc1370 0x56292ecc3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80ceffd640 1 -- 172.21.15.42:0/992147056 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56292eba83a0 con 0x56292ecb65d0 2024-09-19T09:41:17.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80ccff9640 1 -- 172.21.15.42:0/412647661 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f80b80cfd20 con 0x7f80d0102790 2024-09-19T09:41:17.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80cf7fe640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80bc0a3240 0x7f80bc0a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80c8005fd0 tx=0x7f80c8009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80ceffd640 1 --2- 172.21.15.42:0/992147056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb65d0 0x56292ecb6a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009900 tx=0x7f80c0005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73c6324263044db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80c57fa640 1 -- 172.21.15.42:0/992147056 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0040070 con 0x56292ecb65d0 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80c57fa640 1 -- 172.21.15.42:0/992147056 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80c00318f0 con 0x56292ecb65d0 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.044+0000 7f80c57fa640 1 -- 172.21.15.42:0/992147056 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0035040 con 0x56292ecb65d0 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.045+0000 7f80d7694740 1 -- 172.21.15.42:0/992147056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb65d0 msgr2=0x56292ecb6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.045+0000 7f80d7694740 1 --2- 172.21.15.42:0/992147056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb65d0 0x56292ecb6a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009900 tx=0x7f80c0005e00 comp rx=0 tx=0).stop 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.045+0000 7f80d7694740 1 -- 172.21.15.42:0/992147056 shutdown_connections 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.045+0000 7f80d7694740 1 --2- 172.21.15.42:0/992147056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecc1370 0x56292ecc3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.045+0000 7f80d7694740 1 --2- 172.21.15.42:0/992147056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb65d0 0x56292ecb6a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.045+0000 7f80d7694740 1 --2- 172.21.15.42:0/992147056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb7b40 0x56292ecb6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.045+0000 7f80d7694740 1 -- 172.21.15.42:0/992147056 >> 172.21.15.42:0/992147056 conn(0x56292ec7f310 msgr2=0x56292ecb2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.045+0000 7f80d7694740 1 -- 172.21.15.42:0/992147056 shutdown_connections 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.045+0000 7f80d7694740 1 -- 172.21.15.42:0/992147056 wait complete. 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80d7694740 1 -- start start 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80d7694740 1 Processor -- start 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80d7694740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292ecc0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80d7694740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb7b40 0x56292ecbdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80d7694740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecc1370 0x56292ecbe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80d7694740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56292ecc4010 con 0x56292ecb65d0 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80d7694740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56292ebd7060 con 0x56292ecb7b40 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80d7694740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56292ecc4190 con 0x56292ecc1370 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80d7694740 10 client.0 _ll_register_callbacks cb 0x56292e92a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:17.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80ceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292ecc0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80c67fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb7b40 0x56292ecbdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80ceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292ecc0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37168/0 (socket says 172.21.15.42:37168) 2024-09-19T09:41:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80ceffd640 1 -- 172.21.15.42:0/816262275 learned_addr learned my addr 172.21.15.42:0/816262275 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80cf7fe640 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecc1370 0x56292ecbe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80ceffd640 1 -- 172.21.15.42:0/816262275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecc1370 msgr2=0x56292ecbe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80ceffd640 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecc1370 0x56292ecbe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80ceffd640 1 -- 172.21.15.42:0/816262275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb7b40 msgr2=0x56292ecbdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80ceffd640 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb7b40 0x56292ecbdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80ceffd640 1 -- 172.21.15.42:0/816262275 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56292e98d3c0 con 0x56292ecb65d0 2024-09-19T09:41:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.046+0000 7f80c67fc640 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb7b40 0x56292ecbdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:17.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.047+0000 7f80ceffd640 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292ecc0d40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f80c002a930 tx=0x7f80c0005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9d960dc959aac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.047+0000 7f80b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:17.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.047+0000 7f80b67fc640 1 -- 172.21.15.42:0/816262275 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c004b020 con 0x56292ecb65d0 2024-09-19T09:41:17.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.047+0000 7f80b67fc640 1 -- 172.21.15.42:0/816262275 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f80c0004250 con 0x56292ecb65d0 2024-09-19T09:41:17.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.047+0000 7f80d7694740 1 -- 172.21.15.42:0/816262275 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80c00318f0 con 0x56292ecb65d0 2024-09-19T09:41:17.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.047+0000 7f80b67fc640 1 -- 172.21.15.42:0/816262275 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f80c0056050 con 0x56292ecb65d0 2024-09-19T09:41:17.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.047+0000 7f80d7694740 10 client.16272 fetch_fsmap learned FSMap version 30 2024-09-19T09:41:17.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.047+0000 7f80d7694740 1 -- 172.21.15.42:0/816262275 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56292eccfa80 con 0x56292ecb65d0 2024-09-19T09:41:17.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.047+0000 7f80b67fc640 1 -- 172.21.15.42:0/816262275 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80c00318f0 con 0x56292ecb65d0 2024-09-19T09:41:17.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.048+0000 7f80b67fc640 1 -- 172.21.15.42:0/816262275 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f80c00035f0 con 0x56292ecb65d0 2024-09-19T09:41:17.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.048+0000 7f80d7694740 10 client.16272 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:41:17.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.048+0000 7f80d7694740 10 client.16272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:17.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.048+0000 7f80d7694740 20 client.16272 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:17.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.048+0000 7f80d7694740 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56292ecd0dd0 0x56292ecd31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.048+0000 7f80d7694740 4 client.16272 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:17.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.048+0000 7f80d7694740 1 -- 172.21.15.42:0/816262275 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56292ec29860 con 0x56292ecd0dd0 2024-09-19T09:41:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.048+0000 7f80c67fc640 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56292ecd0dd0 0x56292ecd31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.048+0000 7f80c67fc640 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56292ecd0dd0 0x56292ecd31c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6de449539585ac4 server_cookie=b42e35f7bafc47b3 in_seq=0 out_seq=0 2024-09-19T09:41:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.048+0000 7f80b67fc640 10 client.16272 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80b67fc640 1 -- 172.21.15.42:0/816262275 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f80b80abe80 con 0x56292ecd0dd0 2024-09-19T09:41:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80b67fc640 10 client.16272 handle_command_reply: tid=0 2024-09-19T09:41:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 client.16272 shutdown 2024-09-19T09:41:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 -- 172.21.15.42:0/816262275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 msgr2=0x56292ecc0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292ecc0d40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f80c002a930 tx=0x7f80c0005250 comp rx=0 tx=0).stop 2024-09-19T09:41:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 -- 172.21.15.42:0/816262275 shutdown_connections 2024-09-19T09:41:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56292ecd0dd0 0x56292ecd31c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecc1370 0x56292ecbe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecb7b40 0x56292ecbdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 --2- 172.21.15.42:0/816262275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292ecc0d40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 -- 172.21.15.42:0/816262275 >> 172.21.15.42:0/816262275 conn(0x56292ec7f310 msgr2=0x56292ecb8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80b67fc640 0 client.16272 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 -- 172.21.15.42:0/816262275 shutdown_connections 2024-09-19T09:41:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 1 -- 172.21.15.42:0/816262275 wait complete. 2024-09-19T09:41:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.049+0000 7f80d7694740 20 client.16272 trim_cache size 0 max 16384 2024-09-19T09:41:17.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.064+0000 7f80d7694740 1 Processor -- start 2024-09-19T09:41:17.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.064+0000 7f80d7694740 1 -- start start 2024-09-19T09:41:17.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.064+0000 7f80d7694740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292eccd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.064+0000 7f80d7694740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb7b40 0x56292ecb2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80d7694740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 0x56292ecb2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80d7694740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f80d01ad620 con 0x56292ecb65d0 2024-09-19T09:41:17.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80d7694740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f80d01af250 con 0x56292ecc1370 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80d7694740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f80d01adcf0 con 0x56292ecb7b40 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80ceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292eccd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80cf7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 0x56292ecb2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80ceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292eccd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37184/0 (socket says 172.21.15.42:37184) 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80cf7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 0x56292ecb2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:42076/0 (socket says 172.21.15.42:42076) 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80ceffd640 1 -- 172.21.15.42:0/3835008880 learned_addr learned my addr 172.21.15.42:0/3835008880 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80c67fc640 1 --2- 172.21.15.42:0/3835008880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb7b40 0x56292ecb2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80ceffd640 1 -- 172.21.15.42:0/3835008880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb7b40 msgr2=0x56292ecb2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80ceffd640 1 --2- 172.21.15.42:0/3835008880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb7b40 0x56292ecb2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80ceffd640 1 -- 172.21.15.42:0/3835008880 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 msgr2=0x56292ecb2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80ceffd640 1 --2- 172.21.15.42:0/3835008880 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 0x56292ecb2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80ceffd640 1 -- 172.21.15.42:0/3835008880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56292ecb3180 con 0x56292ecb65d0 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80cf7fe640 1 --2- 172.21.15.42:0/3835008880 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 0x56292ecb2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.065+0000 7f80ceffd640 1 --2- 172.21.15.42:0/3835008880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292eccd2b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f80c0003a10 tx=0x7f80c0005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84256d6359cd9ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.066+0000 7f80c4ff9640 1 -- 172.21.15.42:0/3835008880 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c004b040 con 0x56292ecb65d0 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.066+0000 7f80c4ff9640 1 -- 172.21.15.42:0/3835008880 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80c0003c80 con 0x56292ecb65d0 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.066+0000 7f80c4ff9640 1 -- 172.21.15.42:0/3835008880 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0035070 con 0x56292ecb65d0 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.066+0000 7f80d7694740 1 -- 172.21.15.42:0/3835008880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 msgr2=0x56292eccd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.066+0000 7f80d7694740 1 --2- 172.21.15.42:0/3835008880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292eccd2b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f80c0003a10 tx=0x7f80c0005600 comp rx=0 tx=0).stop 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.066+0000 7f80d7694740 1 -- 172.21.15.42:0/3835008880 shutdown_connections 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.066+0000 7f80d7694740 1 --2- 172.21.15.42:0/3835008880 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 0x56292ecb2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.066+0000 7f80d7694740 1 --2- 172.21.15.42:0/3835008880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb7b40 0x56292ecb2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.066+0000 7f80d7694740 1 --2- 172.21.15.42:0/3835008880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb65d0 0x56292eccd2b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.066+0000 7f80d7694740 1 -- 172.21.15.42:0/3835008880 >> 172.21.15.42:0/3835008880 conn(0x56292ec7f310 msgr2=0x56292ecb92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 1 -- 172.21.15.42:0/3835008880 shutdown_connections 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 1 -- 172.21.15.42:0/3835008880 wait complete. 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 1 -- start start 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 1 Processor -- start 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb65d0 0x56292ecc9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb7b40 0x56292ecc9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 0x56292ecba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f80d01aeb50 con 0x56292ecb7b40 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f80d01ae480 con 0x56292ecc1370 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f80d01ab600 con 0x56292ecb65d0 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80d7694740 10 client.0 _ll_register_callbacks cb 0x7f80b8098440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80c67fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb7b40 0x56292ecc9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80c67fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb7b40 0x56292ecc9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37192/0 (socket says 172.21.15.42:37192) 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80c67fc640 1 -- 172.21.15.42:0/271436681 learned_addr learned my addr 172.21.15.42:0/271436681 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80cf7fe640 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 0x56292ecba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.067+0000 7f80ceffd640 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb65d0 0x56292ecc9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80c67fc640 1 -- 172.21.15.42:0/271436681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb65d0 msgr2=0x56292ecc9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80c67fc640 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb65d0 0x56292ecc9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80c67fc640 1 -- 172.21.15.42:0/271436681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 msgr2=0x56292ecba820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80c67fc640 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 0x56292ecba820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80c67fc640 1 -- 172.21.15.42:0/271436681 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56292ecbb000 con 0x56292ecb7b40 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80c67fc640 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb7b40 0x56292ecc9bb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f80b800cfd0 tx=0x7f80b80bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96494030ed423d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80b67fc640 1 -- 172.21.15.42:0/271436681 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b80a0670 con 0x56292ecb7b40 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80b67fc640 1 -- 172.21.15.42:0/271436681 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f80b80980c0 con 0x56292ecb7b40 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80d7694740 1 -- 172.21.15.42:0/271436681 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80c0003c80 con 0x56292ecb7b40 2024-09-19T09:41:17.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80b67fc640 1 -- 172.21.15.42:0/271436681 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f80b80a4f30 con 0x56292ecb7b40 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80d7694740 10 client.16278 fetch_fsmap learned FSMap version 30 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80d7694740 1 -- 172.21.15.42:0/271436681 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56292ed3f680 con 0x56292ecb7b40 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.068+0000 7f80b67fc640 1 -- 172.21.15.42:0/271436681 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80c0003c80 con 0x56292ecb7b40 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.069+0000 7f80b67fc640 1 -- 172.21.15.42:0/271436681 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f80b80bc0b0 con 0x56292ecb7b40 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.069+0000 7f80d7694740 10 client.16278 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.069+0000 7f80d7694740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.069+0000 7f80d7694740 20 client.16278 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.069+0000 7f80d7694740 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56292ed3fde0 0x56292ed42200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.069+0000 7f80d7694740 4 client.16278 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.069+0000 7f80d7694740 1 -- 172.21.15.42:0/271436681 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56292ec23d70 con 0x56292ed3fde0 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.069+0000 7f80ceffd640 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56292ed3fde0 0x56292ed42200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.069+0000 7f80b67fc640 10 client.16278 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.069+0000 7f80ceffd640 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56292ed3fde0 0x56292ed42200 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fbd049e26023c97 server_cookie=66ba487784efcaa9 in_seq=0 out_seq=0 2024-09-19T09:41:17.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80b67fc640 1 -- 172.21.15.42:0/271436681 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56292ec23d70 con 0x56292ed3fde0 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80b67fc640 10 client.16278 handle_command_reply: tid=0 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 client.16278 shutdown 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 -- 172.21.15.42:0/271436681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb7b40 msgr2=0x56292ecc9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb7b40 0x56292ecc9bb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f80b800cfd0 tx=0x7f80b80bc040 comp rx=0 tx=0).stop 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 -- 172.21.15.42:0/271436681 shutdown_connections 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56292ed3fde0 0x56292ed42200 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56292ecc1370 0x56292ecba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56292ecb7b40 0x56292ecc9bb0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 --2- 172.21.15.42:0/271436681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56292ecb65d0 0x56292ecc9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 -- 172.21.15.42:0/271436681 >> 172.21.15.42:0/271436681 conn(0x56292ec7f310 msgr2=0x56292ecbc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80b67fc640 0 client.16278 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:17.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 -- 172.21.15.42:0/271436681 shutdown_connections 2024-09-19T09:41:17.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 1 -- 172.21.15.42:0/271436681 wait complete. 2024-09-19T09:41:17.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d7694740 20 client.16278 trim_cache size 0 max 16384 2024-09-19T09:41:17.082 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d52bb640 1 -- 172.21.15.42:0/412647661 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80bc0a3240 msgr2=0x7f80bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d52bb640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80bc0a3240 0x7f80bc0a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80c8005fd0 tx=0x7f80c8009600 comp rx=0 tx=0).stop 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d52bb640 1 -- 172.21.15.42:0/412647661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80d0102790 msgr2=0x7f80d0198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.070+0000 7f80d52bb640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80d0102790 0x7f80d0198a50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f80b800e9f0 tx=0x7f80b800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.071+0000 7f80d52bb640 1 -- 172.21.15.42:0/412647661 shutdown_connections 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.071+0000 7f80d52bb640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80bc0a3240 0x7f80bc0a5700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.071+0000 7f80d52bb640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80d0106f10 0x7f80d019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.071+0000 7f80d52bb640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80d0102790 0x7f80d0198a50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.071+0000 7f80d52bb640 1 --2- 172.21.15.42:0/412647661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80d0101de0 0x7f80d0198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.071+0000 7f80d52bb640 1 -- 172.21.15.42:0/412647661 >> 172.21.15.42:0/412647661 conn(0x7f80d00fd8c0 msgr2=0x7f80d00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.071+0000 7f80d52bb640 1 -- 172.21.15.42:0/412647661 shutdown_connections 2024-09-19T09:41:17.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:17.071+0000 7f80d52bb640 1 -- 172.21.15.42:0/412647661 wait complete. 2024-09-19T09:41:17.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:17 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:17.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:17 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:17 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:17.901 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.897+0000 7f71073cd640 1 -- 172.21.15.42:0/1943223427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7100104f40 msgr2=0x7f71001053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.897+0000 7f71073cd640 1 --2- 172.21.15.42:0/1943223427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7100104f40 0x7f71001053c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009900 tx=0x7f70f002a410 comp rx=0 tx=0).stop 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.897+0000 7f71073cd640 1 -- 172.21.15.42:0/1943223427 shutdown_connections 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.897+0000 7f71073cd640 1 --2- 172.21.15.42:0/1943223427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100105900 0x7f710010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.897+0000 7f71073cd640 1 --2- 172.21.15.42:0/1943223427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7100104f40 0x7f71001053c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.897+0000 7f71073cd640 1 --2- 172.21.15.42:0/1943223427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7100103d50 0x7f7100104150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.897+0000 7f71073cd640 1 -- 172.21.15.42:0/1943223427 >> 172.21.15.42:0/1943223427 conn(0x7f71000ff4b0 msgr2=0x7f71001018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.897+0000 7f71073cd640 1 -- 172.21.15.42:0/1943223427 shutdown_connections 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.897+0000 7f71073cd640 1 -- 172.21.15.42:0/1943223427 wait complete. 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f71073cd640 1 Processor -- start 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f71073cd640 1 -- start start 2024-09-19T09:41:17.902 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f71073cd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7100103d50 0x7f7100199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.903 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f71073cd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7100104f40 0x7f710019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.903 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f71073cd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100105900 0x7f71001a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.903 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f71073cd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f710010fa20 con 0x7f7100104f40 2024-09-19T09:41:17.903 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f71073cd640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f710010f8a0 con 0x7f7100105900 2024-09-19T09:41:17.903 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f71073cd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f710010fba0 con 0x7f7100103d50 2024-09-19T09:41:17.903 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f7104968640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7100104f40 0x7f710019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.903 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f7104968640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7100104f40 0x7f710019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37206/0 (socket says 172.21.15.42:37206) 2024-09-19T09:41:17.903 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f7104968640 1 -- 172.21.15.42:0/2837237785 learned_addr learned my addr 172.21.15.42:0/2837237785 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:17.903 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f710596a640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100105900 0x7f71001a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.903 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f7105169640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7100103d50 0x7f7100199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f7104968640 1 -- 172.21.15.42:0/2837237785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7100103d50 msgr2=0x7f7100199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f7104968640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7100103d50 0x7f7100199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f7104968640 1 -- 172.21.15.42:0/2837237785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100105900 msgr2=0x7f71001a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f7104968640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100105900 0x7f71001a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.898+0000 7f7104968640 1 -- 172.21.15.42:0/2837237785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71001a1be0 con 0x7f7100104f40 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.899+0000 7f7104968640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7100104f40 0x7f710019a500 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f70f0031440 tx=0x7f70f0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.899+0000 7f70f67fc640 1 -- 172.21.15.42:0/2837237785 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f003f030 con 0x7f7100104f40 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.899+0000 7f70f67fc640 1 -- 172.21.15.42:0/2837237785 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70f0003ce0 con 0x7f7100104f40 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.899+0000 7f71073cd640 1 -- 172.21.15.42:0/2837237785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71001a1e70 con 0x7f7100104f40 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.899+0000 7f70f67fc640 1 -- 172.21.15.42:0/2837237785 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0035070 con 0x7f7100104f40 2024-09-19T09:41:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.899+0000 7f71073cd640 1 -- 172.21.15.42:0/2837237785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71001a22d0 con 0x7f7100104f40 2024-09-19T09:41:17.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.901+0000 7f70f67fc640 1 -- 172.21.15.42:0/2837237785 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f70f0042030 con 0x7f7100104f40 2024-09-19T09:41:17.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.901+0000 7f710a242740 1 Processor -- start 2024-09-19T09:41:17.911 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.901+0000 7f710a242740 1 -- start start 2024-09-19T09:41:17.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f710a242740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d6129b9a0 0x558d6129bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f710a242740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 0x558d612a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f710a242740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d612a1370 0x558d612a3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f710a242740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558d611ff2f0 con 0x558d612a1370 2024-09-19T09:41:17.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f710a242740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558d611a7270 con 0x558d6129c2e0 2024-09-19T09:41:17.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f710a242740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x558d611fb2b0 con 0x558d6129b9a0 2024-09-19T09:41:17.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f7104968640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d612a1370 0x558d612a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.912 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f7104968640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d612a1370 0x558d612a3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37228/0 (socket says 172.21.15.42:37228) 2024-09-19T09:41:17.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f7104968640 1 -- 172.21.15.42:0/3084752727 learned_addr learned my addr 172.21.15.42:0/3084752727 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:17.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f7105169640 1 --2- 172.21.15.42:0/3084752727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 0x558d612a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f70f67fc640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f70ec0a32f0 0x7f70ec0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f710596a640 1 --2- 172.21.15.42:0/3084752727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d6129b9a0 0x558d6129bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f7104968640 1 -- 172.21.15.42:0/3084752727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d6129b9a0 msgr2=0x558d6129bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.913 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f7104968640 1 --2- 172.21.15.42:0/3084752727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d6129b9a0 0x558d6129bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f7104968640 1 -- 172.21.15.42:0/3084752727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 msgr2=0x558d612a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f7104968640 1 --2- 172.21.15.42:0/3084752727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 0x558d612a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f7104968640 1 -- 172.21.15.42:0/3084752727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d611a6340 con 0x558d612a1370 2024-09-19T09:41:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f710596a640 1 --2- 172.21.15.42:0/3084752727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d6129b9a0 0x558d6129bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:41:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f710596a640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f70ec0a32f0 0x7f70ec0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.902+0000 7f70f67fc640 1 -- 172.21.15.42:0/2837237785 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f70f00efdd0 con 0x7f7100104f40 2024-09-19T09:41:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.903+0000 7f7104968640 1 --2- 172.21.15.42:0/3084752727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d612a1370 0x558d612a3830 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f70f009e0f0 tx=0x7f70f0086e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60672a11285a870b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.903+0000 7f710596a640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f70ec0a32f0 0x7f70ec0a57b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f70f8005fd0 tx=0x7f70f8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.903+0000 7f70eb7fe640 1 -- 172.21.15.42:0/3084752727 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0049070 con 0x558d612a1370 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.903+0000 7f70eb7fe640 1 -- 172.21.15.42:0/3084752727 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70f008af70 con 0x558d612a1370 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.903+0000 7f70eb7fe640 1 -- 172.21.15.42:0/3084752727 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f008f7a0 con 0x558d612a1370 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 -- 172.21.15.42:0/3084752727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d612a1370 msgr2=0x558d612a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 --2- 172.21.15.42:0/3084752727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d612a1370 0x558d612a3830 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f70f009e0f0 tx=0x7f70f0086e60 comp rx=0 tx=0).stop 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 -- 172.21.15.42:0/3084752727 shutdown_connections 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 --2- 172.21.15.42:0/3084752727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d612a1370 0x558d612a3830 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 --2- 172.21.15.42:0/3084752727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 0x558d612a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 --2- 172.21.15.42:0/3084752727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d6129b9a0 0x558d6129bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 -- 172.21.15.42:0/3084752727 >> 172.21.15.42:0/3084752727 conn(0x558d61297010 msgr2=0x558d61297410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 -- 172.21.15.42:0/3084752727 shutdown_connections 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 -- 172.21.15.42:0/3084752727 wait complete. 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 -- start start 2024-09-19T09:41:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 Processor -- start 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129b9a0 0x558d612a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 0x558d612a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 0x558d612ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558d612a4100 con 0x558d6129b9a0 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558d61188290 con 0x558d6129c2e0 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x558d612a4280 con 0x558d612a1370 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.904+0000 7f710a242740 10 client.0 _ll_register_callbacks cb 0x558d611b9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7105169640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129b9a0 0x558d612a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7105169640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129b9a0 0x558d612a5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37230/0 (socket says 172.21.15.42:37230) 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7105169640 1 -- 172.21.15.42:0/36873686 learned_addr learned my addr 172.21.15.42:0/36873686 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7104968640 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 0x558d612a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f710596a640 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 0x558d612ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7105169640 1 -- 172.21.15.42:0/36873686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 msgr2=0x558d612ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7105169640 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 0x558d612ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7105169640 1 -- 172.21.15.42:0/36873686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 msgr2=0x558d612a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7105169640 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 0x558d612a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7105169640 1 -- 172.21.15.42:0/36873686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d60f12210 con 0x558d6129b9a0 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f710596a640 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 0x558d612ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7104968640 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 0x558d612a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f7105169640 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129b9a0 0x558d612a5890 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0126e0 tx=0x7f70fc012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f73a5c9a5792de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f70e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f70e8ff9640 1 -- 172.21.15.42:0/36873686 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0121d0 con 0x558d6129b9a0 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f70e8ff9640 1 -- 172.21.15.42:0/36873686 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f70fc004050 con 0x558d6129b9a0 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f710a242740 1 -- 172.21.15.42:0/36873686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70f008af70 con 0x558d6129b9a0 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f70e8ff9640 1 -- 172.21.15.42:0/36873686 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f70fc022070 con 0x558d6129b9a0 2024-09-19T09:41:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f710a242740 10 client.16290 fetch_fsmap learned FSMap version 30 2024-09-19T09:41:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.905+0000 7f710a242740 1 -- 172.21.15.42:0/36873686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558d60fde620 con 0x558d6129b9a0 2024-09-19T09:41:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f70e8ff9640 1 -- 172.21.15.42:0/36873686 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70f008af70 con 0x558d6129b9a0 2024-09-19T09:41:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f70e8ff9640 1 -- 172.21.15.42:0/36873686 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f70fc0038f0 con 0x558d6129b9a0 2024-09-19T09:41:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f710a242740 10 client.16290 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:41:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f710a242740 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f710a242740 20 client.16290 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f710a242740 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x558d612b1550 0x558d612b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f710a242740 4 client.16290 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:17.918 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f710a242740 1 -- 172.21.15.42:0/36873686 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d6120ca20 con 0x558d612b1550 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f7104968640 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x558d612b1550 0x558d612b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f70e8ff9640 10 client.16290 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.906+0000 7f7104968640 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x558d612b1550 0x558d612b3990 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dfe3507c0a0d9eb server_cookie=d96e86cb68f088d8 in_seq=0 out_seq=0 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.907+0000 7f70e8ff9640 1 -- 172.21.15.42:0/36873686 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d6120ca20 con 0x558d612b1550 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.907+0000 7f70e8ff9640 10 client.16290 handle_command_reply: tid=0 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.907+0000 7f710a242740 1 client.16290 shutdown 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 1 -- 172.21.15.42:0/36873686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129b9a0 msgr2=0x558d612a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129b9a0 0x558d612a5890 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0126e0 tx=0x7f70fc012ba0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 1 -- 172.21.15.42:0/36873686 shutdown_connections 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x558d612b1550 0x558d612b3990 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.919 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 0x558d612ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129c2e0 0x558d612a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f70e8ff9640 0 client.16290 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 1 --2- 172.21.15.42:0/36873686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129b9a0 0x558d612a5890 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 1 -- 172.21.15.42:0/36873686 >> 172.21.15.42:0/36873686 conn(0x558d61297010 msgr2=0x558d61298820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 1 -- 172.21.15.42:0/36873686 shutdown_connections 2024-09-19T09:41:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 1 -- 172.21.15.42:0/36873686 wait complete. 2024-09-19T09:41:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.908+0000 7f710a242740 20 client.16290 trim_cache size 0 max 16384 2024-09-19T09:41:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f710a242740 1 Processor -- start 2024-09-19T09:41:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f710a242740 1 -- start start 2024-09-19T09:41:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f710a242740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129b9a0 0x558d61297e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f710a242740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f710a242740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 0x558d612983d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f710a242740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f71001ab260 con 0x558d6129c2e0 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f710a242740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f71001ace90 con 0x558d6129b9a0 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f710a242740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f71001ab930 con 0x558d612a1370 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f7104968640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f7104968640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37240/0 (socket says 172.21.15.42:37240) 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f7104968640 1 -- 172.21.15.42:0/3987697942 learned_addr learned my addr 172.21.15.42:0/3987697942 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f7105169640 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129b9a0 0x558d61297e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.923+0000 7f710596a640 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 0x558d612983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f7104968640 1 -- 172.21.15.42:0/3987697942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 msgr2=0x558d612983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f7104968640 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 0x558d612983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f7104968640 1 -- 172.21.15.42:0/3987697942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129b9a0 msgr2=0x558d61297e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f7104968640 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129b9a0 0x558d61297e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f7104968640 1 -- 172.21.15.42:0/3987697942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d612a0730 con 0x558d6129c2e0 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f710596a640 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 0x558d612983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f7105169640 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129b9a0 0x558d61297e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f7104968640 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612acdd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f70f0003fb0 tx=0x7f70f00b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d4eac363b16340 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f70eaffd640 1 -- 172.21.15.42:0/3987697942 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0049040 con 0x558d6129c2e0 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f70eaffd640 1 -- 172.21.15.42:0/3987697942 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70f00bc420 con 0x558d6129c2e0 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.924+0000 7f70eaffd640 1 -- 172.21.15.42:0/3987697942 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f00ed8d0 con 0x558d6129c2e0 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 -- 172.21.15.42:0/3987697942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 msgr2=0x558d612acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612acdd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f70f0003fb0 tx=0x7f70f00b8040 comp rx=0 tx=0).stop 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 -- 172.21.15.42:0/3987697942 shutdown_connections 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d612a1370 0x558d612983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612acdd0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 --2- 172.21.15.42:0/3987697942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d6129b9a0 0x558d61297e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.932 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 -- 172.21.15.42:0/3987697942 >> 172.21.15.42:0/3987697942 conn(0x558d61297010 msgr2=0x558d612a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 -- 172.21.15.42:0/3987697942 shutdown_connections 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 -- 172.21.15.42:0/3987697942 wait complete. 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 -- start start 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.925+0000 7f710a242740 1 Processor -- start 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f710a242740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d6129b9a0 0x558d612aa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f710a242740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f710a242740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d612a1370 0x558d612ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f710a242740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f71001ac790 con 0x558d6129c2e0 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f710a242740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f71001ac0c0 con 0x558d612a1370 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f710a242740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f71001a9240 con 0x558d6129b9a0 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f710a242740 10 client.0 _ll_register_callbacks cb 0x7f70fc009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f7104968640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f7104968640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612aa9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37250/0 (socket says 172.21.15.42:37250) 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f7104968640 1 -- 172.21.15.42:0/2082462961 learned_addr learned my addr 172.21.15.42:0/2082462961 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f7104968640 1 -- 172.21.15.42:0/2082462961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d6129b9a0 msgr2=0x558d612aa480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f7104968640 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d6129b9a0 0x558d612aa480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f7104968640 1 -- 172.21.15.42:0/2082462961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d612a1370 msgr2=0x558d612ab9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f7104968640 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d612a1370 0x558d612ab9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f7104968640 1 -- 172.21.15.42:0/2082462961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d612abfe0 con 0x558d6129c2e0 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f7104968640 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612aa9c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f70f00bc3b0 tx=0x7f70f0005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4c0bcd36075cb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.926+0000 7f70e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f70e8ff9640 1 -- 172.21.15.42:0/2082462961 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0049030 con 0x558d6129c2e0 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f70e8ff9640 1 -- 172.21.15.42:0/2082462961 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f70f00ed8d0 con 0x558d6129c2e0 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f710a242740 1 -- 172.21.15.42:0/2082462961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70f00bc420 con 0x558d6129c2e0 2024-09-19T09:41:17.934 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f70e8ff9640 1 -- 172.21.15.42:0/2082462961 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f70f003bcd0 con 0x558d6129c2e0 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f710a242740 10 client.16296 fetch_fsmap learned FSMap version 30 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f710a242740 1 -- 172.21.15.42:0/2082462961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558d612abfe0 con 0x558d6129c2e0 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f70e8ff9640 1 -- 172.21.15.42:0/2082462961 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70f00bc420 con 0x558d6129c2e0 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f70e8ff9640 1 -- 172.21.15.42:0/2082462961 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f70f00c4b50 con 0x558d6129c2e0 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f710a242740 10 client.16296 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f710a242740 10 client.16296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f710a242740 20 client.16296 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f710a242740 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x558d6131c620 0x558d6131ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f710a242740 4 client.16296 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f710a242740 1 -- 172.21.15.42:0/2082462961 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d61206d70 con 0x558d6131c620 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.927+0000 7f7105169640 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x558d6131c620 0x558d6131ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.928+0000 7f70e8ff9640 10 client.16296 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.928+0000 7f7105169640 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x558d6131c620 0x558d6131ea40 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8fe8f6f7cfef3cd server_cookie=449ac37986c4fa97 in_seq=0 out_seq=0 2024-09-19T09:41:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f70e8ff9640 1 -- 172.21.15.42:0/2082462961 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d61206d70 con 0x558d6131c620 2024-09-19T09:41:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f70e8ff9640 10 client.16296 handle_command_reply: tid=0 2024-09-19T09:41:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f710a242740 1 client.16296 shutdown 2024-09-19T09:41:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f710a242740 1 -- 172.21.15.42:0/2082462961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 msgr2=0x558d612aa9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f710a242740 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612aa9c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f70f00bc3b0 tx=0x7f70f0005d50 comp rx=0 tx=0).stop 2024-09-19T09:41:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f710a242740 1 -- 172.21.15.42:0/2082462961 shutdown_connections 2024-09-19T09:41:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f710a242740 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x558d6131c620 0x558d6131ea40 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f710a242740 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d612a1370 0x558d612ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f710a242740 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d6129c2e0 0x558d612aa9c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f70e8ff9640 0 client.16296 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f710a242740 1 --2- 172.21.15.42:0/2082462961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d6129b9a0 0x558d612aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.945+0000 7f710a242740 1 -- 172.21.15.42:0/2082462961 >> 172.21.15.42:0/2082462961 conn(0x558d61297010 msgr2=0x558d612959a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f710a242740 1 -- 172.21.15.42:0/2082462961 shutdown_connections 2024-09-19T09:41:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f710a242740 1 -- 172.21.15.42:0/2082462961 wait complete. 2024-09-19T09:41:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f710a242740 20 client.16296 trim_cache size 0 max 16384 2024-09-19T09:41:17.949 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:41:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:41:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:41:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:41:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 -- 172.21.15.42:0/2837237785 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f70ec0a32f0 msgr2=0x7f70ec0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f70ec0a32f0 0x7f70ec0a57b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f70f8005fd0 tx=0x7f70f8004a40 comp rx=0 tx=0).stop 2024-09-19T09:41:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 -- 172.21.15.42:0/2837237785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7100104f40 msgr2=0x7f710019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7100104f40 0x7f710019a500 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f70f0031440 tx=0x7f70f0032ce0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 -- 172.21.15.42:0/2837237785 shutdown_connections 2024-09-19T09:41:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f70ec0a32f0 0x7f70ec0a57b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7100105900 0x7f71001a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7100104f40 0x7f710019a500 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 --2- 172.21.15.42:0/2837237785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7100103d50 0x7f7100199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 -- 172.21.15.42:0/2837237785 >> 172.21.15.42:0/2837237785 conn(0x7f71000ff4b0 msgr2=0x7f71001082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 -- 172.21.15.42:0/2837237785 shutdown_connections 2024-09-19T09:41:17.951 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:17.946+0000 7f71073cd640 1 -- 172.21.15.42:0/2837237785 wait complete. 2024-09-19T09:41:18.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:18 smithi042 ceph-mon[31223]: pgmap v396: 97 pgs: 97 active+clean; 29 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 2.1 MiB/s wr, 152 op/s 2024-09-19T09:41:18.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:18 smithi171 ceph-mon[35803]: pgmap v396: 97 pgs: 97 active+clean; 29 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 2.1 MiB/s wr, 152 op/s 2024-09-19T09:41:18.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:18 smithi136 ceph-mon[34840]: pgmap v396: 97 pgs: 97 active+clean; 29 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 2.1 MiB/s wr, 152 op/s 2024-09-19T09:41:18.777 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:41:18.780 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:41:19.041 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:19.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.509+0000 7f76661e1640 1 -- 172.21.15.42:0/1959837252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76601008d0 msgr2=0x7f7660100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.509+0000 7f76661e1640 1 --2- 172.21.15.42:0/1959837252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76601008d0 0x7f7660100cb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7650009900 tx=0x7f765002a410 comp rx=0 tx=0).stop 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.509+0000 7f76661e1640 1 -- 172.21.15.42:0/1959837252 shutdown_connections 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.509+0000 7f76661e1640 1 --2- 172.21.15.42:0/1959837252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f766010e480 0x7f7660110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.509+0000 7f76661e1640 1 --2- 172.21.15.42:0/1959837252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7660101280 0x7f766010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.509+0000 7f76661e1640 1 --2- 172.21.15.42:0/1959837252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76601008d0 0x7f7660100cb0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.509+0000 7f76661e1640 1 -- 172.21.15.42:0/1959837252 >> 172.21.15.42:0/1959837252 conn(0x7f76600fc7a0 msgr2=0x7f76600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.509+0000 7f76661e1640 1 -- 172.21.15.42:0/1959837252 shutdown_connections 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.509+0000 7f76661e1640 1 -- 172.21.15.42:0/1959837252 wait complete. 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.510+0000 7f76661e1640 1 Processor -- start 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.510+0000 7f76661e1640 1 -- start start 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.510+0000 7f76661e1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76601008d0 0x7f76601a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.510+0000 7f76661e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7660101280 0x7f76601a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.510+0000 7f76661e1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f766010e480 0x7f766019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.510+0000 7f76661e1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7660114200 con 0x7f7660101280 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.510+0000 7f76661e1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7660114080 con 0x7f76601008d0 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.510+0000 7f76661e1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7660114380 con 0x7f766010e480 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7660101280 0x7f76601a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7660101280 0x7f76601a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37272/0 (socket says 172.21.15.42:37272) 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765effd640 1 -- 172.21.15.42:0/3680049521 learned_addr learned my addr 172.21.15.42:0/3680049521 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765f7fe640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76601008d0 0x7f76601a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765ffff640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f766010e480 0x7f766019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765effd640 1 -- 172.21.15.42:0/3680049521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f766010e480 msgr2=0x7f766019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765effd640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f766010e480 0x7f766019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765effd640 1 -- 172.21.15.42:0/3680049521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76601008d0 msgr2=0x7f76601a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:19.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765effd640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76601008d0 0x7f76601a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765effd640 1 -- 172.21.15.42:0/3680049521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766019acc0 con 0x7f7660101280 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765ffff640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f766010e480 0x7f766019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765effd640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7660101280 0x7f76601a0910 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f764800b4a0 tx=0x7f764800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765cff9640 1 -- 172.21.15.42:0/3680049521 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648014070 con 0x7f7660101280 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765cff9640 1 -- 172.21.15.42:0/3680049521 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7648010af0 con 0x7f7660101280 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f76661e1640 1 -- 172.21.15.42:0/3680049521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766019afb0 con 0x7f7660101280 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f765cff9640 1 -- 172.21.15.42:0/3680049521 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648017d10 con 0x7f7660101280 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.511+0000 7f76661e1640 1 -- 172.21.15.42:0/3680049521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76601a72a0 con 0x7f7660101280 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f765cff9640 1 -- 172.21.15.42:0/3680049521 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f7648017070 con 0x7f7660101280 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f76685ba740 1 Processor -- start 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f76685ba740 1 -- start start 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f765cff9640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f764c0a3240 0x7f764c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f76685ba740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 0x560e5435df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f76685ba740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e54368800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f76685ba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e5436b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f76685ba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560e542c3280 con 0x560e54368d40 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f76685ba740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560e5426ab10 con 0x560e5435e480 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f76685ba740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560e542bf240 con 0x560e5435db60 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.514+0000 7f765ffff640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f764c0a3240 0x7f764c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765cff9640 1 -- 172.21.15.42:0/3680049521 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f76480cedb0 con 0x7f7660101280 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e5436b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e5436b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37284/0 (socket says 172.21.15.42:37284) 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765ffff640 1 -- 172.21.15.42:0/1527844892 learned_addr learned my addr 172.21.15.42:0/1527844892 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765f7fe640 1 --2- 172.21.15.42:0/1527844892 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 0x560e5435df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765effd640 1 --2- 172.21.15.42:0/1527844892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e54368800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765ffff640 1 -- 172.21.15.42:0/1527844892 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 msgr2=0x560e5435df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765ffff640 1 --2- 172.21.15.42:0/1527844892 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 0x560e5435df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765ffff640 1 -- 172.21.15.42:0/1527844892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 msgr2=0x560e54368800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765ffff640 1 --2- 172.21.15.42:0/1527844892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e54368800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765ffff640 1 -- 172.21.15.42:0/1527844892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e542771f0 con 0x560e54368d40 2024-09-19T09:41:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765f7fe640 1 --2- 172.21.15.42:0/1527844892 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 0x560e5435df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:41:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765ffff640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f764c0a3240 0x7f764c0a5700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7658005fd0 tx=0x7f765800acf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f765ffff640 1 --2- 172.21.15.42:0/1527844892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e5436b130 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f765800fbb0 tx=0x7f7658019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906787bf386659e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f7655ffb640 1 -- 172.21.15.42:0/1527844892 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658022070 con 0x560e54368d40 2024-09-19T09:41:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f7655ffb640 1 -- 172.21.15.42:0/1527844892 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f765800dde0 con 0x560e54368d40 2024-09-19T09:41:19.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.515+0000 7f7655ffb640 1 -- 172.21.15.42:0/1527844892 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658010630 con 0x560e54368d40 2024-09-19T09:41:19.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.516+0000 7f76685ba740 1 -- 172.21.15.42:0/1527844892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 msgr2=0x560e5436b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:19.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.516+0000 7f76685ba740 1 --2- 172.21.15.42:0/1527844892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e5436b130 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f765800fbb0 tx=0x7f7658019000 comp rx=0 tx=0).stop 2024-09-19T09:41:19.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.516+0000 7f76685ba740 1 -- 172.21.15.42:0/1527844892 shutdown_connections 2024-09-19T09:41:19.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.516+0000 7f76685ba740 1 --2- 172.21.15.42:0/1527844892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e5436b130 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.516+0000 7f76685ba740 1 --2- 172.21.15.42:0/1527844892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e54368800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.516+0000 7f76685ba740 1 --2- 172.21.15.42:0/1527844892 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 0x560e5435df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.516+0000 7f76685ba740 1 -- 172.21.15.42:0/1527844892 >> 172.21.15.42:0/1527844892 conn(0x560e5435a0f0 msgr2=0x560e5435a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.516+0000 7f76685ba740 1 -- 172.21.15.42:0/1527844892 shutdown_connections 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.516+0000 7f76685ba740 1 -- 172.21.15.42:0/1527844892 wait complete. 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f76685ba740 1 -- start start 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f76685ba740 1 Processor -- start 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f76685ba740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 0x560e54365c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f76685ba740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e54366160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f76685ba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e543666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f76685ba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560e5436b910 con 0x560e54368d40 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f76685ba740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560e5427df10 con 0x560e5435e480 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f76685ba740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560e5436ba90 con 0x560e5435db60 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f76685ba740 10 client.0 _ll_register_callbacks cb 0x560e54246a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:19.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f765ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e543666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f765ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e543666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37300/0 (socket says 172.21.15.42:37300) 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.517+0000 7f765ffff640 1 -- 172.21.15.42:0/2802941256 learned_addr learned my addr 172.21.15.42:0/2802941256 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f765effd640 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e54366160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f765f7fe640 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 0x560e54365c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f765ffff640 1 -- 172.21.15.42:0/2802941256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 msgr2=0x560e54365c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f765ffff640 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 0x560e54365c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f765ffff640 1 -- 172.21.15.42:0/2802941256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 msgr2=0x560e54366160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f765ffff640 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e54366160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f765ffff640 1 -- 172.21.15.42:0/2802941256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e540346a0 con 0x560e54368d40 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f765f7fe640 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 0x560e54365c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f765ffff640 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e543666a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f765800a3c0 tx=0x7f765800aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab125247d3d40c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f763effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:19.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f763effd640 1 -- 172.21.15.42:0/2802941256 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658035060 con 0x560e54368d40 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f763effd640 1 -- 172.21.15.42:0/2802941256 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f765801e850 con 0x560e54368d40 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.518+0000 7f76685ba740 1 -- 172.21.15.42:0/2802941256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f765800dde0 con 0x560e54368d40 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f763effd640 1 -- 172.21.15.42:0/2802941256 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7658022040 con 0x560e54368d40 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f76685ba740 10 client.16308 fetch_fsmap learned FSMap version 30 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f76685ba740 1 -- 172.21.15.42:0/2802941256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560e54377560 con 0x560e54368d40 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f763effd640 1 -- 172.21.15.42:0/2802941256 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f765800dde0 con 0x560e54368d40 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f763effd640 1 -- 172.21.15.42:0/2802941256 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f765802f030 con 0x560e54368d40 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f76685ba740 10 client.16308 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f76685ba740 10 client.16308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f76685ba740 20 client.16308 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f76685ba740 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560e54378910 0x560e5437ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f76685ba740 4 client.16308 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:19.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f76685ba740 1 -- 172.21.15.42:0/2802941256 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e542d07f0 con 0x560e54378910 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.519+0000 7f765f7fe640 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560e54378910 0x560e5437ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.520+0000 7f765f7fe640 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560e54378910 0x560e5437ad00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=188946ea56f8da1b server_cookie=63a5b2311816439f in_seq=0 out_seq=0 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.520+0000 7f763effd640 10 client.16308 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.520+0000 7f763effd640 1 -- 172.21.15.42:0/2802941256 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e542d07f0 con 0x560e54378910 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f763effd640 10 client.16308 handle_command_reply: tid=0 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 client.16308 shutdown 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 -- 172.21.15.42:0/2802941256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 msgr2=0x560e543666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e543666a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f765800a3c0 tx=0x7f765800aaa0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 -- 172.21.15.42:0/2802941256 shutdown_connections 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560e54378910 0x560e5437ad00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e54368d40 0x560e543666a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e54366160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 --2- 172.21.15.42:0/2802941256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e5435db60 0x560e54365c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 -- 172.21.15.42:0/2802941256 >> 172.21.15.42:0/2802941256 conn(0x560e5435a0f0 msgr2=0x560e5435fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:19.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f763effd640 0 client.16308 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:19.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 -- 172.21.15.42:0/2802941256 shutdown_connections 2024-09-19T09:41:19.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 1 -- 172.21.15.42:0/2802941256 wait complete. 2024-09-19T09:41:19.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.521+0000 7f76685ba740 20 client.16308 trim_cache size 0 max 16384 2024-09-19T09:41:19.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.538+0000 7f76685ba740 1 Processor -- start 2024-09-19T09:41:19.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.538+0000 7f76685ba740 1 -- start start 2024-09-19T09:41:19.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.538+0000 7f76685ba740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435db60 0x560e543653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.538+0000 7f76685ba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435e480 0x560e54359160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.538+0000 7f76685ba740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e54368d40 0x560e54380470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.538+0000 7f76685ba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f76601af920 con 0x560e5435e480 2024-09-19T09:41:19.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.538+0000 7f76685ba740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f76601b1550 con 0x560e5435db60 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.538+0000 7f76685ba740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f76601afff0 con 0x560e54368d40 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f765effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435e480 0x560e54359160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f765effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435e480 0x560e54359160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37314/0 (socket says 172.21.15.42:37314) 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f765effd640 1 -- 172.21.15.42:0/692392690 learned_addr learned my addr 172.21.15.42:0/692392690 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f765f7fe640 1 --2- 172.21.15.42:0/692392690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435db60 0x560e543653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f765effd640 1 -- 172.21.15.42:0/692392690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e54368d40 msgr2=0x560e54380470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f765effd640 1 --2- 172.21.15.42:0/692392690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e54368d40 0x560e54380470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f765effd640 1 -- 172.21.15.42:0/692392690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435db60 msgr2=0x560e543653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f765effd640 1 --2- 172.21.15.42:0/692392690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435db60 0x560e543653d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f765effd640 1 -- 172.21.15.42:0/692392690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e54364170 con 0x560e5435e480 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f765effd640 1 --2- 172.21.15.42:0/692392690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435e480 0x560e54359160 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7648097d80 tx=0x7f76480047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e3c21a2a2d182 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f76557fa640 1 -- 172.21.15.42:0/692392690 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764809f760 con 0x560e5435e480 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f76557fa640 1 -- 172.21.15.42:0/692392690 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76480a4020 con 0x560e5435e480 2024-09-19T09:41:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.539+0000 7f76557fa640 1 -- 172.21.15.42:0/692392690 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76480a3df0 con 0x560e5435e480 2024-09-19T09:41:19.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.540+0000 7f76685ba740 1 -- 172.21.15.42:0/692392690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435e480 msgr2=0x560e54359160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:19.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.540+0000 7f76685ba740 1 --2- 172.21.15.42:0/692392690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435e480 0x560e54359160 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7648097d80 tx=0x7f76480047d0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.540+0000 7f76685ba740 1 -- 172.21.15.42:0/692392690 shutdown_connections 2024-09-19T09:41:19.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.540+0000 7f76685ba740 1 --2- 172.21.15.42:0/692392690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e54368d40 0x560e54380470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.540+0000 7f76685ba740 1 --2- 172.21.15.42:0/692392690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435e480 0x560e54359160 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.540+0000 7f76685ba740 1 --2- 172.21.15.42:0/692392690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435db60 0x560e543653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.540+0000 7f76685ba740 1 -- 172.21.15.42:0/692392690 >> 172.21.15.42:0/692392690 conn(0x560e5435a0f0 msgr2=0x560e54358a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.540+0000 7f76685ba740 1 -- 172.21.15.42:0/692392690 shutdown_connections 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.540+0000 7f76685ba740 1 -- 172.21.15.42:0/692392690 wait complete. 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.540+0000 7f76685ba740 1 -- start start 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f76685ba740 1 Processor -- start 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f76685ba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435db60 0x560e5436cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f76685ba740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e5436d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f76685ba740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e54368d40 0x560e5436d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f76685ba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f76601b0e50 con 0x560e5435db60 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f76685ba740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f76601b0780 con 0x560e5435e480 2024-09-19T09:41:19.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f76685ba740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f76601ad900 con 0x560e54368d40 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435db60 0x560e5436cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f76685ba740 10 client.0 _ll_register_callbacks cb 0x7f7658012f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435db60 0x560e5436cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37318/0 (socket says 172.21.15.42:37318) 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765f7fe640 1 -- 172.21.15.42:0/646987901 learned_addr learned my addr 172.21.15.42:0/646987901 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765effd640 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e5436d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765ffff640 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e54368d40 0x560e5436d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765f7fe640 1 -- 172.21.15.42:0/646987901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e54368d40 msgr2=0x560e5436d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765f7fe640 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e54368d40 0x560e5436d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765f7fe640 1 -- 172.21.15.42:0/646987901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 msgr2=0x560e5436d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765f7fe640 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e5436d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765f7fe640 1 -- 172.21.15.42:0/646987901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e543e2640 con 0x560e5435db60 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.541+0000 7f765ffff640 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e54368d40 0x560e5436d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:41:19.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f765f7fe640 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435db60 0x560e5436cc50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7650009900 tx=0x7f7650031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b484dd75abbdead2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f763effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f763effd640 1 -- 172.21.15.42:0/646987901 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650035040 con 0x560e5435db60 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f763effd640 1 -- 172.21.15.42:0/646987901 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7650004250 con 0x560e5435db60 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f76685ba740 1 -- 172.21.15.42:0/646987901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76480a4020 con 0x560e5435db60 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f763effd640 1 -- 172.21.15.42:0/646987901 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7650004450 con 0x560e5435db60 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f76685ba740 10 client.16314 fetch_fsmap learned FSMap version 30 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f76685ba740 1 -- 172.21.15.42:0/646987901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560e543e3980 con 0x560e5435db60 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f763effd640 1 -- 172.21.15.42:0/646987901 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76480a4020 con 0x560e5435db60 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f763effd640 1 -- 172.21.15.42:0/646987901 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f76500049f0 con 0x560e5435db60 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f76685ba740 10 client.16314 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f76685ba740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f76685ba740 20 client.16314 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:19.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f76685ba740 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560e543e40a0 0x560e543e6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:19.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f76685ba740 4 client.16314 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:41:19.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.542+0000 7f76685ba740 1 -- 172.21.15.42:0/646987901 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560e542cad00 con 0x560e543e40a0 2024-09-19T09:41:19.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.543+0000 7f765effd640 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560e543e40a0 0x560e543e6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:19.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.543+0000 7f765effd640 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560e543e40a0 0x560e543e6490 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0308cf9a63024b8 server_cookie=494a6ac0c424aeeb in_seq=0 out_seq=0 2024-09-19T09:41:19.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.543+0000 7f763effd640 10 client.16314 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:19.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f763effd640 1 -- 172.21.15.42:0/646987901 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560e542cad00 con 0x560e543e40a0 2024-09-19T09:41:19.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f763effd640 10 client.16314 handle_command_reply: tid=0 2024-09-19T09:41:19.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f76685ba740 1 client.16314 shutdown 2024-09-19T09:41:19.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f76685ba740 1 -- 172.21.15.42:0/646987901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435db60 msgr2=0x560e5436cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:19.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f76685ba740 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435db60 0x560e5436cc50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7650009900 tx=0x7f7650031a20 comp rx=0 tx=0).stop 2024-09-19T09:41:19.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f76685ba740 1 -- 172.21.15.42:0/646987901 shutdown_connections 2024-09-19T09:41:19.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f76685ba740 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560e543e40a0 0x560e543e6490 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f76685ba740 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560e54368d40 0x560e5436d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f76685ba740 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e5435e480 0x560e5436d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f763effd640 0 client.16314 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f76685ba740 1 --2- 172.21.15.42:0/646987901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e5435db60 0x560e5436cc50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.544+0000 7f76685ba740 1 -- 172.21.15.42:0/646987901 >> 172.21.15.42:0/646987901 conn(0x560e5435a0f0 msgr2=0x560e5435fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.545+0000 7f76685ba740 1 -- 172.21.15.42:0/646987901 shutdown_connections 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.545+0000 7f76685ba740 1 -- 172.21.15.42:0/646987901 wait complete. 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.545+0000 7f76685ba740 20 client.16314 trim_cache size 0 max 16384 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "2818dbe7-0fcd-4821-98da-df69cbe6f82e", 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-19T09:41:19.551 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:41:19.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.545+0000 7f76661e1640 1 -- 172.21.15.42:0/3680049521 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f764c0a3240 msgr2=0x7f764c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:19.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.545+0000 7f76661e1640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f764c0a3240 0x7f764c0a5700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7658005fd0 tx=0x7f765800acf0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.545+0000 7f76661e1640 1 -- 172.21.15.42:0/3680049521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7660101280 msgr2=0x7f76601a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:19.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.545+0000 7f76661e1640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7660101280 0x7f76601a0910 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f764800b4a0 tx=0x7f764800b960 comp rx=0 tx=0).stop 2024-09-19T09:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.546+0000 7f76661e1640 1 -- 172.21.15.42:0/3680049521 shutdown_connections 2024-09-19T09:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.546+0000 7f76661e1640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f764c0a3240 0x7f764c0a5700 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.546+0000 7f76661e1640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f766010e480 0x7f766019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.546+0000 7f76661e1640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7660101280 0x7f76601a0910 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.546+0000 7f76661e1640 1 --2- 172.21.15.42:0/3680049521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76601008d0 0x7f76601a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.546+0000 7f76661e1640 1 -- 172.21.15.42:0/3680049521 >> 172.21.15.42:0/3680049521 conn(0x7f76600fc7a0 msgr2=0x7f766010f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.546+0000 7f76661e1640 1 -- 172.21.15.42:0/3680049521 shutdown_connections 2024-09-19T09:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:19.546+0000 7f76661e1640 1 -- 172.21.15.42:0/3680049521 wait complete. 2024-09-19T09:41:20.342 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:41:20.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: pgmap v397: 97 pgs: 97 active+clean; 33 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.4 MiB/s wr, 229 op/s 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:20 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: pgmap v397: 97 pgs: 97 active+clean; 33 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.4 MiB/s wr, 229 op/s 2024-09-19T09:41:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:20.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:20 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: pgmap v397: 97 pgs: 97 active+clean; 33 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.4 MiB/s wr, 229 op/s 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:20 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.131+0000 7f2feb4ca640 1 -- 172.21.15.42:0/407717804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe4102d30 msgr2=0x7f2fe4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.131+0000 7f2feb4ca640 1 --2- 172.21.15.42:0/407717804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe4102d30 0x7f2fe4103110 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009cd0 tx=0x7f2fe002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.131+0000 7f2feb4ca640 1 -- 172.21.15.42:0/407717804 shutdown_connections 2024-09-19T09:41:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.131+0000 7f2feb4ca640 1 --2- 172.21.15.42:0/407717804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fe41082a0 0x7f2fe410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.131+0000 7f2feb4ca640 1 --2- 172.21.15.42:0/407717804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fe41036e0 0x7f2fe4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.131+0000 7f2feb4ca640 1 --2- 172.21.15.42:0/407717804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe4102d30 0x7f2fe4103110 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.131+0000 7f2feb4ca640 1 -- 172.21.15.42:0/407717804 >> 172.21.15.42:0/407717804 conn(0x7f2fe40fc7d0 msgr2=0x7f2fe40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.132+0000 7f2feb4ca640 1 -- 172.21.15.42:0/407717804 shutdown_connections 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.132+0000 7f2feb4ca640 1 -- 172.21.15.42:0/407717804 wait complete. 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.132+0000 7f2feb4ca640 1 Processor -- start 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.132+0000 7f2feb4ca640 1 -- start start 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2feb4ca640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fe4102d30 0x7f2fe41985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2feb4ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe41036e0 0x7f2fe4198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2feb4ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fe41082a0 0x7f2fe419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2feb4ca640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe41120a0 con 0x7f2fe41036e0 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2feb4ca640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4111f20 con 0x7f2fe4102d30 2024-09-19T09:41:21.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2feb4ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4112220 con 0x7f2fe41082a0 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe8a65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe41036e0 0x7f2fe4198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9266640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fe4102d30 0x7f2fe41985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9266640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fe4102d30 0x7f2fe41985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:59136/0 (socket says 172.21.15.42:59136) 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe8a65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe41036e0 0x7f2fe4198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40440/0 (socket says 172.21.15.42:40440) 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9266640 1 -- 172.21.15.42:0/3324452963 learned_addr learned my addr 172.21.15.42:0/3324452963 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fe41082a0 0x7f2fe419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9266640 1 -- 172.21.15.42:0/3324452963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fe41082a0 msgr2=0x7f2fe419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9266640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fe41082a0 0x7f2fe419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9266640 1 -- 172.21.15.42:0/3324452963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe41036e0 msgr2=0x7f2fe4198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9266640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe41036e0 0x7f2fe4198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9266640 1 -- 172.21.15.42:0/3324452963 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe419d590 con 0x7f2fe4102d30 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe8a65640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe41036e0 0x7f2fe4198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:21.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fe41082a0 0x7f2fe419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.133+0000 7f2fe9266640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fe4102d30 0x7f2fe41985e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2fe002ae00 tx=0x7f2fe0031e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.134+0000 7f2fda7fc640 1 -- 172.21.15.42:0/3324452963 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0003e00 con 0x7f2fe4102d30 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.134+0000 7f2fda7fc640 1 -- 172.21.15.42:0/3324452963 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe0004520 con 0x7f2fe4102d30 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.134+0000 7f2feb4ca640 1 -- 172.21.15.42:0/3324452963 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe419d820 con 0x7f2fe4102d30 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.134+0000 7f2fda7fc640 1 -- 172.21.15.42:0/3324452963 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0030de0 con 0x7f2fe4102d30 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.134+0000 7f2feb4ca640 1 -- 172.21.15.42:0/3324452963 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe41a5160 con 0x7f2fe4102d30 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fed8a3740 1 Processor -- start 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fed8a3740 1 -- start start 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fda7fc640 1 -- 172.21.15.42:0/3324452963 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2fe00046d0 con 0x7f2fe4102d30 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f34880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 0x560525f3f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 0x560525f41a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560525e9a2e0 con 0x560525f3f680 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560525e41ce0 con 0x560525f34dc0 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560525e962a0 con 0x560525f344a0 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fe9266640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 0x560525f3f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fe8a65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 0x560525f41a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fe9a67640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f34880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fe9a67640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f34880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:35154/0 (socket says 172.21.15.42:35154) 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fe9a67640 1 -- 172.21.15.42:0/555747768 learned_addr learned my addr 172.21.15.42:0/555747768 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.137+0000 7f2fe9266640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 0x560525f3f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:59144/0 (socket says 172.21.15.42:59144) 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fe9a67640 1 -- 172.21.15.42:0/555747768 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 msgr2=0x560525f3f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/555747768 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 0x560525f3f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fe9a67640 1 -- 172.21.15.42:0/555747768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 msgr2=0x560525f41a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/555747768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 0x560525f41a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fe9a67640 1 -- 172.21.15.42:0/555747768 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560525e26440 con 0x560525f344a0 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/555747768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f34880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc011440 tx=0x7f2fdc011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=699c6c7912bafa8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fda7fc640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2fd00a3240 0x7f2fd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fcf7fe640 1 -- 172.21.15.42:0/555747768 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc004020 con 0x560525f344a0 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fcf7fe640 1 -- 172.21.15.42:0/555747768 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fdc0041c0 con 0x560525f344a0 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fcf7fe640 1 -- 172.21.15.42:0/555747768 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc00f8b0 con 0x560525f344a0 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fe9266640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2fd00a3240 0x7f2fd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.138+0000 7f2fda7fc640 1 -- 172.21.15.42:0/3324452963 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2fe002e030 con 0x7f2fe4102d30 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fed8a3740 1 -- 172.21.15.42:0/555747768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 msgr2=0x560525f34880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fe9266640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2fd00a3240 0x7f2fd00a5700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00eeb50 tx=0x7f2fe00f45e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/555747768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f34880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc011440 tx=0x7f2fdc011900 comp rx=0 tx=0).stop 2024-09-19T09:41:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fed8a3740 1 -- 172.21.15.42:0/555747768 shutdown_connections 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/555747768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 0x560525f41a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/555747768 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 0x560525f3f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/555747768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f34880 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fed8a3740 1 -- 172.21.15.42:0/555747768 >> 172.21.15.42:0/555747768 conn(0x560525f30a30 msgr2=0x560525f30e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fed8a3740 1 -- 172.21.15.42:0/555747768 shutdown_connections 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fed8a3740 1 -- 172.21.15.42:0/555747768 wait complete. 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.139+0000 7f2fed8a3740 1 -- start start 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fed8a3740 1 Processor -- start 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f3ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 0x560525f3c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 0x560525f3c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560525f42250 con 0x560525f34dc0 2024-09-19T09:41:21.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560525e55050 con 0x560525f3f680 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560525f423d0 con 0x560525f344a0 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fed8a3740 10 client.0 _ll_register_callbacks cb 0x560525e95160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fe8a65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 0x560525f3c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fe9a67640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 0x560525f3c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fe9a67640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 0x560525f3c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:59146/0 (socket says 172.21.15.42:59146) 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fe9a67640 1 -- 172.21.15.42:0/73477717 learned_addr learned my addr 172.21.15.42:0/73477717 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.140+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f3ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fe8a65640 1 -- 172.21.15.42:0/73477717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 msgr2=0x560525f3ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fe8a65640 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f3ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fe8a65640 1 -- 172.21.15.42:0/73477717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 msgr2=0x560525f3c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fe8a65640 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 0x560525f3c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fe8a65640 1 -- 172.21.15.42:0/73477717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560525c0b3c0 con 0x560525f34dc0 2024-09-19T09:41:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 0x560525f3c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fe8a65640 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 0x560525f3c220 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40fee70 tx=0x7f2fd400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53486f1b23cc4ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fccff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fccff9640 1 -- 172.21.15.42:0/73477717 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4009e30 con 0x560525f34dc0 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fccff9640 1 -- 172.21.15.42:0/73477717 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2fd4012110 con 0x560525f34dc0 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fed8a3740 1 -- 172.21.15.42:0/73477717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fdc0041c0 con 0x560525f34dc0 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fccff9640 1 -- 172.21.15.42:0/73477717 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2fd4004050 con 0x560525f34dc0 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fed8a3740 10 client.16326 fetch_fsmap learned FSMap version 30 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fed8a3740 1 -- 172.21.15.42:0/73477717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560525f4dc30 con 0x560525f34dc0 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fccff9640 1 -- 172.21.15.42:0/73477717 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fdc0041c0 con 0x560525f34dc0 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.141+0000 7f2fccff9640 1 -- 172.21.15.42:0/73477717 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f2fd4010430 con 0x560525f34dc0 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.142+0000 7f2fed8a3740 10 client.16326 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.142+0000 7f2fed8a3740 10 client.16326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.142+0000 7f2fed8a3740 20 client.16326 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.142+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560525f4f140 0x560525f51560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.142+0000 7f2fed8a3740 4 client.16326 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.142+0000 7f2fed8a3740 1 -- 172.21.15.42:0/73477717 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560525ea7850 con 0x560525f4f140 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.142+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560525f4f140 0x560525f51560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.142+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560525f4f140 0x560525f51560 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e743a3d87731f2 server_cookie=1839a84d01ca67c2 in_seq=0 out_seq=0 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.142+0000 7f2fccff9640 10 client.16326 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fccff9640 1 -- 172.21.15.42:0/73477717 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560525ea7850 con 0x560525f4f140 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fccff9640 10 client.16326 handle_command_reply: tid=0 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 client.16326 shutdown 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 -- 172.21.15.42:0/73477717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 msgr2=0x560525f3c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 0x560525f3c220 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40fee70 tx=0x7f2fd400f790 comp rx=0 tx=0).stop 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 -- 172.21.15.42:0/73477717 shutdown_connections 2024-09-19T09:41:21.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560525f4f140 0x560525f51560 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 0x560525f3c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 0x560525f3c220 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/73477717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f3ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 -- 172.21.15.42:0/73477717 >> 172.21.15.42:0/73477717 conn(0x560525f30a30 msgr2=0x560525f36710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fccff9640 0 client.16326 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 -- 172.21.15.42:0/73477717 shutdown_connections 2024-09-19T09:41:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 1 -- 172.21.15.42:0/73477717 wait complete. 2024-09-19T09:41:21.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.143+0000 7f2fed8a3740 20 client.16326 trim_cache size 0 max 16384 2024-09-19T09:41:21.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fed8a3740 1 Processor -- start 2024-09-19T09:41:21.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fed8a3740 1 -- start start 2024-09-19T09:41:21.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f4b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 0x560525f37900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 0x560525f3e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe41ad6a0 con 0x560525f3f680 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe41af2d0 con 0x560525f34dc0 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe41add70 con 0x560525f344a0 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fe9a67640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 0x560525f3e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fe9a67640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 0x560525f3e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40468/0 (socket says 172.21.15.42:40468) 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.163+0000 7f2fe9a67640 1 -- 172.21.15.42:0/2732318939 learned_addr learned my addr 172.21.15.42:0/2732318939 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fe8a65640 1 --2- 172.21.15.42:0/2732318939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 0x560525f37900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/2732318939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f4b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fe9a67640 1 -- 172.21.15.42:0/2732318939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 msgr2=0x560525f4b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/2732318939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f4b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fe9a67640 1 -- 172.21.15.42:0/2732318939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 msgr2=0x560525f37900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/2732318939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 0x560525f37900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fe9a67640 1 -- 172.21.15.42:0/2732318939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560525f41db0 con 0x560525f3f680 2024-09-19T09:41:21.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/2732318939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 0x560525f3e190 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009250 tx=0x7f2fdc011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8fd37646cc346f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fceffd640 1 -- 172.21.15.42:0/2732318939 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc01d040 con 0x560525f3f680 2024-09-19T09:41:21.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fceffd640 1 -- 172.21.15.42:0/2732318939 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fdc01e040 con 0x560525f3f680 2024-09-19T09:41:21.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.164+0000 7f2fceffd640 1 -- 172.21.15.42:0/2732318939 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc00fa00 con 0x560525f3f680 2024-09-19T09:41:21.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.165+0000 7f2fed8a3740 1 -- 172.21.15.42:0/2732318939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 msgr2=0x560525f3e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.165+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/2732318939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 0x560525f3e190 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009250 tx=0x7f2fdc011900 comp rx=0 tx=0).stop 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.165+0000 7f2fed8a3740 1 -- 172.21.15.42:0/2732318939 shutdown_connections 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.165+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/2732318939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f3f680 0x560525f3e190 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.165+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/2732318939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f34dc0 0x560525f37900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.165+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/2732318939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f4b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.165+0000 7f2fed8a3740 1 -- 172.21.15.42:0/2732318939 >> 172.21.15.42:0/2732318939 conn(0x560525f30a30 msgr2=0x560525f3da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.165+0000 7f2fed8a3740 1 -- 172.21.15.42:0/2732318939 shutdown_connections 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.165+0000 7f2fed8a3740 1 -- 172.21.15.42:0/2732318939 wait complete. 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.166+0000 7f2fed8a3740 1 -- start start 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.166+0000 7f2fed8a3740 1 Processor -- start 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.166+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f42bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.166+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 0x560525f430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.166+0000 7f2fed8a3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 0x560525fb7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.166+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe41aebd0 con 0x560525f34dc0 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.166+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe41ae500 con 0x560525f3f680 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.166+0000 7f2fed8a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe41ab680 con 0x560525f344a0 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fed8a3740 10 client.0 _ll_register_callbacks cb 0x7f2fd4009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe9a67640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f42bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe8a65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 0x560525f430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe9a67640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f42bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:35176/0 (socket says 172.21.15.42:35176) 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe9a67640 1 -- 172.21.15.42:0/1951217618 learned_addr learned my addr 172.21.15.42:0/1951217618 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 0x560525fb7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe9a67640 1 -- 172.21.15.42:0/1951217618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 msgr2=0x560525fb7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 0x560525fb7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe9a67640 1 -- 172.21.15.42:0/1951217618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 msgr2=0x560525f430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 0x560525f430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe9a67640 1 -- 172.21.15.42:0/1951217618 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560525fb8390 con 0x560525f344a0 2024-09-19T09:41:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fe9a67640 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f42bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00f6e0 tx=0x7f2fdc005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb1aec01dc911249 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.167+0000 7f2fccff9640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:41:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fccff9640 1 -- 172.21.15.42:0/1951217618 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc01d070 con 0x560525f344a0 2024-09-19T09:41:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fccff9640 1 -- 172.21.15.42:0/1951217618 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f2fdc0035f0 con 0x560525f344a0 2024-09-19T09:41:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fed8a3740 1 -- 172.21.15.42:0/1951217618 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fdc01e040 con 0x560525f344a0 2024-09-19T09:41:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fccff9640 1 -- 172.21.15.42:0/1951217618 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2fdc0037f0 con 0x560525f344a0 2024-09-19T09:41:21.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fed8a3740 10 client.25684 fetch_fsmap learned FSMap version 30 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fed8a3740 1 -- 172.21.15.42:0/1951217618 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560525fb9680 con 0x560525f344a0 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fccff9640 1 -- 172.21.15.42:0/1951217618 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fdc01e040 con 0x560525f344a0 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fccff9640 1 -- 172.21.15.42:0/1951217618 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f2fdc004540 con 0x560525f344a0 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fed8a3740 10 client.25684 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fed8a3740 10 client.25684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fed8a3740 20 client.25684 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560525fb99b0 0x560525fbbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fed8a3740 4 client.25684 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.168+0000 7f2fed8a3740 1 -- 172.21.15.42:0/1951217618 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560525ea1d60 con 0x560525fb99b0 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.169+0000 7f2fe8a65640 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560525fb99b0 0x560525fbbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.169+0000 7f2fe8a65640 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560525fb99b0 0x560525fbbda0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae699f77f72540c8 server_cookie=f7a83d092de1516b in_seq=0 out_seq=0 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.169+0000 7f2fccff9640 10 client.25684 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.169+0000 7f2fccff9640 1 -- 172.21.15.42:0/1951217618 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x560525ea1d60 con 0x560525fb99b0 2024-09-19T09:41:21.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.169+0000 7f2fccff9640 10 client.25684 handle_command_reply: tid=0 2024-09-19T09:41:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.169+0000 7f2fed8a3740 1 client.25684 shutdown 2024-09-19T09:41:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.169+0000 7f2fed8a3740 1 -- 172.21.15.42:0/1951217618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 msgr2=0x560525f42bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.169+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f42bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00f6e0 tx=0x7f2fdc005850 comp rx=0 tx=0).stop 2024-09-19T09:41:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.169+0000 7f2fed8a3740 1 -- 172.21.15.42:0/1951217618 shutdown_connections 2024-09-19T09:41:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.169+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x560525fb99b0 0x560525fbbda0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560525f3f680 0x560525fb7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560525f34dc0 0x560525f430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2fed8a3740 1 --2- 172.21.15.42:0/1951217618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560525f344a0 0x560525f42bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2fed8a3740 1 -- 172.21.15.42:0/1951217618 >> 172.21.15.42:0/1951217618 conn(0x560525f30a30 msgr2=0x560525f2f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2fccff9640 0 client.25684 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2fed8a3740 1 -- 172.21.15.42:0/1951217618 shutdown_connections 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2fed8a3740 1 -- 172.21.15.42:0/1951217618 wait complete. 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2fed8a3740 20 client.25684 trim_cache size 0 max 16384 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stdout: "2818dbe7-0fcd-4821-98da-df69cbe6f82e": { 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-19T09:41:21.178 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "2818dbe7-0fcd-4821-98da-df69cbe6f82e", 2024-09-19T09:41:21.179 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-09-19T09:41:21.179 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:41:21.179 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:41:21.179 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:41:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2feb4ca640 1 -- 172.21.15.42:0/3324452963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2fd00a3240 msgr2=0x7f2fd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2feb4ca640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2fd00a3240 0x7f2fd00a5700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00eeb50 tx=0x7f2fe00f45e0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2feb4ca640 1 -- 172.21.15.42:0/3324452963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fe4102d30 msgr2=0x7f2fe41985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.170+0000 7f2feb4ca640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fe4102d30 0x7f2fe41985e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2fe002ae00 tx=0x7f2fe0031e60 comp rx=0 tx=0).stop 2024-09-19T09:41:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.171+0000 7f2feb4ca640 1 -- 172.21.15.42:0/3324452963 shutdown_connections 2024-09-19T09:41:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.171+0000 7f2feb4ca640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f2fd00a3240 0x7f2fd00a5700 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.171+0000 7f2feb4ca640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fe41082a0 0x7f2fe419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.171+0000 7f2feb4ca640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fe41036e0 0x7f2fe4198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.171+0000 7f2feb4ca640 1 --2- 172.21.15.42:0/3324452963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fe4102d30 0x7f2fe41985e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.171+0000 7f2feb4ca640 1 -- 172.21.15.42:0/3324452963 >> 172.21.15.42:0/3324452963 conn(0x7f2fe40fc7d0 msgr2=0x7f2fe4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.171+0000 7f2feb4ca640 1 -- 172.21.15.42:0/3324452963 shutdown_connections 2024-09-19T09:41:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:21.171+0000 7f2feb4ca640 1 -- 172.21.15.42:0/3324452963 wait complete. 2024-09-19T09:41:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub queued for path: / 2024-09-19T09:41:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:41:21.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub queued for path: / 2024-09-19T09:41:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:41:21.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub queued for path: / 2024-09-19T09:41:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:21.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:21.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:21.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:41:21.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:41:22.107 INFO:tasks.cephfs.filesystem:scrub status for tag:2818dbe7-0fcd-4821-98da-df69cbe6f82e - {'path': '/', 'tag': '2818dbe7-0fcd-4821-98da-df69cbe6f82e', 'options': 'recursive,force'} 2024-09-19T09:41:22.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:22 smithi042 ceph-mon[31223]: pgmap v398: 97 pgs: 97 active+clean; 38 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 246 op/s 2024-09-19T09:41:22.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:22 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:22.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:22 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:22.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:22 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:22.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:22 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:22.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:22 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:22.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:22 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:22 smithi171 ceph-mon[35803]: pgmap v398: 97 pgs: 97 active+clean; 38 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 246 op/s 2024-09-19T09:41:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:22 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:22 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:22 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:22 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:22 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:22.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:22 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:22.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:22 smithi136 ceph-mon[34840]: pgmap v398: 97 pgs: 97 active+clean; 38 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 246 op/s 2024-09-19T09:41:22.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:22 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:22.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:22 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:22.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:22 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:22.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:22 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:22.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:22 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:22.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:22 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:23.457 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:23 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:23.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:23 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:23.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:23.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:23 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: pgmap v399: 97 pgs: 97 active+clean; 38 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 250 op/s 2024-09-19T09:41:24.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:24.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:24.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:24.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:24.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:24.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:24 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: pgmap v399: 97 pgs: 97 active+clean; 38 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 250 op/s 2024-09-19T09:41:24.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:24.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:24.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:24.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:24.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:24.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:24 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: pgmap v399: 97 pgs: 97 active+clean; 38 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 250 op/s 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:24.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:24 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:25.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:25 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:25.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:25 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:25.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:25 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:25.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:25 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:25.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:25 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:41:25.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:25 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:25.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:25 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:25.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:25 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:25.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:25 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:25.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:25 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:25.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:25 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:41:25.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:25 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:25.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:25 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:25.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:25 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:25.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:25 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:25.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:25 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:25.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:25 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:41:25.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:25 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:26.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:26 smithi171 ceph-mon[35803]: pgmap v400: 97 pgs: 97 active+clean; 39 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 257 op/s 2024-09-19T09:41:26.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:26 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:26.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:26 smithi136 ceph-mon[34840]: pgmap v400: 97 pgs: 97 active+clean; 39 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 257 op/s 2024-09-19T09:41:26.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:26 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:26.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:26 smithi042 ceph-mon[31223]: pgmap v400: 97 pgs: 97 active+clean; 39 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 257 op/s 2024-09-19T09:41:26.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:26 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:41:28.376 INFO:tasks.workunit.client.0.smithi042.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-19T09:41:28.377 INFO:tasks.workunit.client.0.smithi042.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:41:28.378 INFO:tasks.workunit.client.0.smithi042.stderr:+ make 2024-09-19T09:41:28.544 INFO:tasks.workunit.client.0.smithi042.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-19T09:41:28.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:28 smithi171 ceph-mon[35803]: pgmap v401: 97 pgs: 97 active+clean; 46 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 267 op/s 2024-09-19T09:41:28.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:28 smithi136 ceph-mon[34840]: pgmap v401: 97 pgs: 97 active+clean; 46 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 267 op/s 2024-09-19T09:41:28.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:28 smithi042 ceph-mon[31223]: pgmap v401: 97 pgs: 97 active+clean; 46 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 267 op/s 2024-09-19T09:41:28.784 INFO:tasks.workunit.client.0.smithi042.stderr:++ readlink -f fsstress 2024-09-19T09:41:28.784 INFO:tasks.workunit.client.0.smithi042.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-19T09:41:28.784 INFO:tasks.workunit.client.0.smithi042.stderr:+ popd 2024-09-19T09:41:28.785 INFO:tasks.workunit.client.0.smithi042.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:41:28.785 INFO:tasks.workunit.client.0.smithi042.stderr:+ popd 2024-09-19T09:41:28.785 INFO:tasks.workunit.client.0.smithi042.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:41:28.785 INFO:tasks.workunit.client.0.smithi042.stderr:++ mktemp -d -p . 2024-09-19T09:41:28.787 INFO:tasks.workunit.client.0.smithi042.stderr:+ T=./tmp.yeyYVEglXo 2024-09-19T09:41:28.787 INFO:tasks.workunit.client.0.smithi042.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.yeyYVEglXo -l 1 -n 1000 -p 10 -v 2024-09-19T09:41:28.789 INFO:tasks.workunit.client.0.smithi042.stdout:seed = 1726478495 2024-09-19T09:41:28.792 INFO:tasks.workunit.client.0.smithi042.stdout:0/0: chown . 81836 1 2024-09-19T09:41:28.792 INFO:tasks.workunit.client.0.smithi042.stdout:0/1: dwrite - no filename 2024-09-19T09:41:28.792 INFO:tasks.workunit.client.0.smithi042.stdout:0/2: dread - no filename 2024-09-19T09:41:28.792 INFO:tasks.workunit.client.0.smithi042.stdout:0/3: dread - no filename 2024-09-19T09:41:28.792 INFO:tasks.workunit.client.0.smithi042.stdout:0/4: dwrite - no filename 2024-09-19T09:41:28.792 INFO:tasks.workunit.client.0.smithi042.stdout:0/5: dwrite - no filename 2024-09-19T09:41:28.793 INFO:tasks.workunit.client.0.smithi042.stdout:1/0: write - no filename 2024-09-19T09:41:28.793 INFO:tasks.workunit.client.0.smithi042.stdout:1/1: write - no filename 2024-09-19T09:41:28.793 INFO:tasks.workunit.client.0.smithi042.stdout:1/2: fsync - no filename 2024-09-19T09:41:28.793 INFO:tasks.workunit.client.0.smithi042.stdout:1/3: rename - no filename 2024-09-19T09:41:28.797 INFO:tasks.workunit.client.0.smithi042.stdout:1/4: creat f0 x:0 0 0 2024-09-19T09:41:28.797 INFO:tasks.workunit.client.0.smithi042.stdout:3/0: write - no filename 2024-09-19T09:41:28.797 INFO:tasks.workunit.client.0.smithi042.stdout:2/0: creat f0 x:0 0 0 2024-09-19T09:41:28.797 INFO:tasks.workunit.client.0.smithi042.stdout:1/5: creat f1 x:0 0 0 2024-09-19T09:41:28.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/0: dread - no filename 2024-09-19T09:41:28.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/1: truncate - no filename 2024-09-19T09:41:28.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/2: chown . 164 1 2024-09-19T09:41:28.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/3: truncate - no filename 2024-09-19T09:41:28.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/4: stat - no entries 2024-09-19T09:41:28.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/5: write - no filename 2024-09-19T09:41:28.800 INFO:tasks.workunit.client.0.smithi042.stdout:3/1: creat f0 x:0 0 0 2024-09-19T09:41:28.800 INFO:tasks.workunit.client.0.smithi042.stdout:3/2: dread - f0 zero size 2024-09-19T09:41:28.800 INFO:tasks.workunit.client.0.smithi042.stdout:2/1: symlink l1 0 2024-09-19T09:41:28.800 INFO:tasks.workunit.client.0.smithi042.stdout:2/2: fdatasync f0 0 2024-09-19T09:41:28.801 INFO:tasks.workunit.client.0.smithi042.stdout:1/6: rename f0 to f2 0 2024-09-19T09:41:28.802 INFO:tasks.workunit.client.0.smithi042.stdout:1/7: readlink - no filename 2024-09-19T09:41:28.802 INFO:tasks.workunit.client.0.smithi042.stdout:1/8: dread - f1 zero size 2024-09-19T09:41:28.802 INFO:tasks.workunit.client.0.smithi042.stdout:5/0: rename - no filename 2024-09-19T09:41:28.803 INFO:tasks.workunit.client.0.smithi042.stdout:5/1: dwrite - no filename 2024-09-19T09:41:28.803 INFO:tasks.workunit.client.0.smithi042.stdout:4/6: mkdir d0 0 2024-09-19T09:41:28.803 INFO:tasks.workunit.client.0.smithi042.stdout:4/7: write - no filename 2024-09-19T09:41:28.804 INFO:tasks.workunit.client.0.smithi042.stdout:3/3: mknod c1 0 2024-09-19T09:41:28.806 INFO:tasks.workunit.client.0.smithi042.stdout:6/0: dread - no filename 2024-09-19T09:41:28.807 INFO:tasks.workunit.client.0.smithi042.stdout:5/2: symlink l0 0 2024-09-19T09:41:28.807 INFO:tasks.workunit.client.0.smithi042.stdout:5/3: chown l0 204 1 2024-09-19T09:41:28.807 INFO:tasks.workunit.client.0.smithi042.stdout:5/4: read - no filename 2024-09-19T09:41:28.808 INFO:tasks.workunit.client.0.smithi042.stdout:4/8: creat d0/f1 x:0 0 0 2024-09-19T09:41:28.808 INFO:tasks.workunit.client.0.smithi042.stdout:4/9: chown d0 19090814 1 2024-09-19T09:41:28.808 INFO:tasks.workunit.client.0.smithi042.stdout:4/10: dread - d0/f1 zero size 2024-09-19T09:41:28.808 INFO:tasks.workunit.client.0.smithi042.stdout:4/11: chown d0 2 1 2024-09-19T09:41:28.808 INFO:tasks.workunit.client.0.smithi042.stdout:3/4: link c1 c2 0 2024-09-19T09:41:28.808 INFO:tasks.workunit.client.0.smithi042.stdout:3/5: write f0 [29421,80989] 0 2024-09-19T09:41:28.808 INFO:tasks.workunit.client.0.smithi042.stdout:6/1: mknod c0 0 2024-09-19T09:41:28.809 INFO:tasks.workunit.client.0.smithi042.stdout:6/2: dwrite - no filename 2024-09-19T09:41:28.810 INFO:tasks.workunit.client.0.smithi042.stdout:5/5: mknod c1 0 2024-09-19T09:41:28.810 INFO:tasks.workunit.client.0.smithi042.stdout:5/6: truncate - no filename 2024-09-19T09:41:28.813 INFO:tasks.workunit.client.0.smithi042.stdout:6/3: mkdir d1 0 2024-09-19T09:41:28.813 INFO:tasks.workunit.client.0.smithi042.stdout:6/4: chown d1 755897281 1 2024-09-19T09:41:28.813 INFO:tasks.workunit.client.0.smithi042.stdout:4/12: rename d0/f1 to d0/f2 0 2024-09-19T09:41:28.813 INFO:tasks.workunit.client.0.smithi042.stdout:4/13: dread - d0/f2 zero size 2024-09-19T09:41:28.813 INFO:tasks.workunit.client.0.smithi042.stdout:4/14: readlink - no filename 2024-09-19T09:41:28.813 INFO:tasks.workunit.client.0.smithi042.stdout:4/15: readlink - no filename 2024-09-19T09:41:28.813 INFO:tasks.workunit.client.0.smithi042.stdout:4/16: write d0/f2 [223524,49615] 0 2024-09-19T09:41:28.813 INFO:tasks.workunit.client.0.smithi042.stdout:7/0: mkdir d0 0 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:8/0: write - no filename 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:5/7: mkdir d2 0 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:8/1: chown . 729216714 1 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:8/2: chown . 1 1 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:8/3: read - no filename 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:8/4: getdents . 0 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:8/5: dwrite - no filename 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:6/5: mkdir d1/d2 0 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:6/6: truncate - no filename 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:6/7: chown c0 30896511 1 2024-09-19T09:41:28.817 INFO:tasks.workunit.client.0.smithi042.stdout:6/8: write - no filename 2024-09-19T09:41:28.818 INFO:tasks.workunit.client.0.smithi042.stdout:7/1: mknod d0/c1 0 2024-09-19T09:41:28.818 INFO:tasks.workunit.client.0.smithi042.stdout:7/2: chown d0 26854963 1 2024-09-19T09:41:28.818 INFO:tasks.workunit.client.0.smithi042.stdout:7/3: dread - no filename 2024-09-19T09:41:28.819 INFO:tasks.workunit.client.0.smithi042.stdout:7/4: dread - no filename 2024-09-19T09:41:28.819 INFO:tasks.workunit.client.0.smithi042.stdout:4/17: symlink d0/l3 0 2024-09-19T09:41:28.819 INFO:tasks.workunit.client.0.smithi042.stdout:9/0: dread - no filename 2024-09-19T09:41:28.821 INFO:tasks.workunit.client.0.smithi042.stdout:8/6: symlink l0 0 2024-09-19T09:41:28.822 INFO:tasks.workunit.client.0.smithi042.stdout:6/9: symlink d1/l3 0 2024-09-19T09:41:28.822 INFO:tasks.workunit.client.0.smithi042.stdout:6/10: dread - no filename 2024-09-19T09:41:28.822 INFO:tasks.workunit.client.0.smithi042.stdout:6/11: dread - no filename 2024-09-19T09:41:28.822 INFO:tasks.workunit.client.0.smithi042.stdout:6/12: dwrite - no filename 2024-09-19T09:41:28.822 INFO:tasks.workunit.client.0.smithi042.stdout:6/13: write - no filename 2024-09-19T09:41:28.822 INFO:tasks.workunit.client.0.smithi042.stdout:5/8: mknod d2/c3 0 2024-09-19T09:41:28.823 INFO:tasks.workunit.client.0.smithi042.stdout:5/9: chown d2/c3 11363731 1 2024-09-19T09:41:28.824 INFO:tasks.workunit.client.0.smithi042.stdout:7/5: symlink d0/l2 0 2024-09-19T09:41:28.825 INFO:tasks.workunit.client.0.smithi042.stdout:9/1: mknod c0 0 2024-09-19T09:41:28.826 INFO:tasks.workunit.client.0.smithi042.stdout:8/7: mkdir d1 0 2024-09-19T09:41:28.826 INFO:tasks.workunit.client.0.smithi042.stdout:8/8: fdatasync - no filename 2024-09-19T09:41:28.827 INFO:tasks.workunit.client.0.smithi042.stdout:8/9: readlink l0 0 2024-09-19T09:41:28.827 INFO:tasks.workunit.client.0.smithi042.stdout:7/6: rmdir d0 39 2024-09-19T09:41:28.827 INFO:tasks.workunit.client.0.smithi042.stdout:7/7: dwrite - no filename 2024-09-19T09:41:28.827 INFO:tasks.workunit.client.0.smithi042.stdout:5/10: mkdir d2/d4 0 2024-09-19T09:41:28.827 INFO:tasks.workunit.client.0.smithi042.stdout:5/11: rename d2/d4 to d2/d4/d5 22 2024-09-19T09:41:28.827 INFO:tasks.workunit.client.0.smithi042.stdout:5/12: readlink l0 0 2024-09-19T09:41:28.827 INFO:tasks.workunit.client.0.smithi042.stdout:5/13: dwrite - no filename 2024-09-19T09:41:28.831 INFO:tasks.workunit.client.0.smithi042.stdout:9/2: unlink c0 0 2024-09-19T09:41:28.831 INFO:tasks.workunit.client.0.smithi042.stdout:9/3: rename - no filename 2024-09-19T09:41:28.831 INFO:tasks.workunit.client.0.smithi042.stdout:9/4: unlink - no file 2024-09-19T09:41:28.831 INFO:tasks.workunit.client.0.smithi042.stdout:9/5: dread - no filename 2024-09-19T09:41:28.831 INFO:tasks.workunit.client.0.smithi042.stdout:9/6: write - no filename 2024-09-19T09:41:28.831 INFO:tasks.workunit.client.0.smithi042.stdout:8/10: creat d1/f2 x:0 0 0 2024-09-19T09:41:28.831 INFO:tasks.workunit.client.0.smithi042.stdout:8/11: write d1/f2 [399049,21851] 0 2024-09-19T09:41:28.831 INFO:tasks.workunit.client.0.smithi042.stdout:7/8: creat d0/f3 x:0 0 0 2024-09-19T09:41:28.831 INFO:tasks.workunit.client.0.smithi042.stdout:5/14: mknod d2/d4/c6 0 2024-09-19T09:41:28.831 INFO:tasks.workunit.client.0.smithi042.stdout:5/15: dread - no filename 2024-09-19T09:41:28.837 INFO:tasks.workunit.client.0.smithi042.stdout:9/7: creat f1 x:0 0 0 2024-09-19T09:41:28.837 INFO:tasks.workunit.client.0.smithi042.stdout:7/9: symlink d0/l4 0 2024-09-19T09:41:28.837 INFO:tasks.workunit.client.0.smithi042.stdout:5/16: creat d2/f7 x:0 0 0 2024-09-19T09:41:28.837 INFO:tasks.workunit.client.0.smithi042.stdout:9/8: creat f2 x:0 0 0 2024-09-19T09:41:28.844 INFO:tasks.workunit.client.0.smithi042.stdout:7/10: creat d0/f5 x:0 0 0 2024-09-19T09:41:28.845 INFO:tasks.workunit.client.0.smithi042.stdout:7/11: write d0/f3 [323392,37623] 0 2024-09-19T09:41:28.845 INFO:tasks.workunit.client.0.smithi042.stdout:7/12: stat d0/l2 0 2024-09-19T09:41:28.845 INFO:tasks.workunit.client.0.smithi042.stdout:7/13: write d0/f3 [498101,97808] 0 2024-09-19T09:41:28.845 INFO:tasks.workunit.client.0.smithi042.stdout:5/17: rmdir d2 39 2024-09-19T09:41:28.845 INFO:tasks.workunit.client.0.smithi042.stdout:5/18: readlink l0 0 2024-09-19T09:41:28.852 INFO:tasks.workunit.client.0.smithi042.stdout:7/14: rename d0/f3 to d0/f6 0 2024-09-19T09:41:28.852 INFO:tasks.workunit.client.0.smithi042.stdout:7/15: readlink d0/l4 0 2024-09-19T09:41:28.852 INFO:tasks.workunit.client.0.smithi042.stdout:7/16: truncate d0/f5 130276 0 2024-09-19T09:41:28.852 INFO:tasks.workunit.client.0.smithi042.stdout:7/17: truncate d0/f5 1014515 0 2024-09-19T09:41:28.861 INFO:tasks.workunit.client.0.smithi042.stdout:7/18: symlink d0/l7 0 2024-09-19T09:41:28.864 INFO:tasks.workunit.client.0.smithi042.stdout:7/19: mknod d0/c8 0 2024-09-19T09:41:29.090 INFO:tasks.workunit.client.0.smithi042.stdout:2/3: dwrite f0 [0,4194304] 0 2024-09-19T09:41:29.090 INFO:tasks.workunit.client.0.smithi042.stdout:2/4: chown l1 223827 1 2024-09-19T09:41:29.090 INFO:tasks.workunit.client.0.smithi042.stdout:2/5: chown f0 37304116 1 2024-09-19T09:41:29.090 INFO:tasks.workunit.client.0.smithi042.stdout:2/6: chown l1 506023601 1 2024-09-19T09:41:29.109 INFO:tasks.workunit.client.0.smithi042.stdout:2/7: fsync f0 0 2024-09-19T09:41:29.114 INFO:tasks.workunit.client.0.smithi042.stdout:1/9: fsync f2 0 2024-09-19T09:41:29.114 INFO:tasks.workunit.client.0.smithi042.stdout:1/10: write f2 [575263,54930] 0 2024-09-19T09:41:29.125 INFO:tasks.workunit.client.0.smithi042.stdout:4/18: rename d0/f2 to d0/f4 0 2024-09-19T09:41:29.144 INFO:tasks.workunit.client.0.smithi042.stdout:8/12: fsync d1/f2 0 2024-09-19T09:41:29.145 INFO:tasks.workunit.client.0.smithi042.stdout:5/19: getdents d2/d4 0 2024-09-19T09:41:29.145 INFO:tasks.workunit.client.0.smithi042.stdout:5/20: chown d2/f7 17081956 1 2024-09-19T09:41:29.318 INFO:tasks.workunit.client.0.smithi042.stdout:2/8: read f0 [3954268,98725] 0 2024-09-19T09:41:29.432 INFO:tasks.workunit.client.0.smithi042.stdout:2/9: dwrite f0 [0,4194304] 0 2024-09-19T09:41:29.507 INFO:tasks.workunit.client.0.smithi042.stdout:4/19: dread d0/f4 [0,4194304] 0 2024-09-19T09:41:29.524 INFO:tasks.workunit.client.0.smithi042.stdout:7/20: dread d0/f6 [0,4194304] 0 2024-09-19T09:41:29.626 INFO:tasks.workunit.client.0.smithi042.stdout:9/9: dwrite f1 [0,4194304] 0 2024-09-19T09:41:29.626 INFO:tasks.workunit.client.0.smithi042.stdout:9/10: write f2 [537748,55538] 0 2024-09-19T09:41:29.703 INFO:tasks.workunit.client.0.smithi042.stdout:5/21: dwrite d2/f7 [0,4194304] 0 2024-09-19T09:41:29.831 INFO:tasks.workunit.client.0.smithi042.stdout:3/6: dread f0 [0,4194304] 0 2024-09-19T09:41:29.831 INFO:tasks.workunit.client.0.smithi042.stdout:3/7: write f0 [826732,112395] 0 2024-09-19T09:41:29.899 INFO:tasks.workunit.client.0.smithi042.stdout:1/11: creat f3 x:0 0 0 2024-09-19T09:41:30.035 INFO:tasks.workunit.client.0.smithi042.stdout:2/10: dwrite f0 [4194304,4194304] 0 2024-09-19T09:41:30.101 INFO:tasks.workunit.client.0.smithi042.stdout:8/13: link l0 d1/l3 0 2024-09-19T09:41:30.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:30 smithi171 ceph-mon[35803]: pgmap v402: 97 pgs: 97 active+clean; 48 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-09-19T09:41:30.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:30 smithi136 ceph-mon[34840]: pgmap v402: 97 pgs: 97 active+clean; 48 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-09-19T09:41:30.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:30 smithi042 ceph-mon[31223]: pgmap v402: 97 pgs: 97 active+clean; 48 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-09-19T09:41:31.051 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.047+0000 7f782018d640 1 -- 172.21.15.42:0/3090839105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7818104f90 msgr2=0x7f7818107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.047+0000 7f782018d640 1 --2- 172.21.15.42:0/3090839105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7818104f90 0x7f7818107380 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f780c009900 tx=0x7f780c02a410 comp rx=0 tx=0).stop 2024-09-19T09:41:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.047+0000 7f782018d640 1 -- 172.21.15.42:0/3090839105 shutdown_connections 2024-09-19T09:41:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.047+0000 7f782018d640 1 --2- 172.21.15.42:0/3090839105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78181078c0 0x7f7818109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.047+0000 7f782018d640 1 --2- 172.21.15.42:0/3090839105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7818104f90 0x7f7818107380 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.047+0000 7f782018d640 1 --2- 172.21.15.42:0/3090839105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818102660 0x7f7818104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.047+0000 7f782018d640 1 -- 172.21.15.42:0/3090839105 >> 172.21.15.42:0/3090839105 conn(0x7f78180fc1e0 msgr2=0x7f78180fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.047+0000 7f782018d640 1 -- 172.21.15.42:0/3090839105 shutdown_connections 2024-09-19T09:41:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f782018d640 1 -- 172.21.15.42:0/3090839105 wait complete. 2024-09-19T09:41:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f782018d640 1 Processor -- start 2024-09-19T09:41:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f782018d640 1 -- start start 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f782018d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7818102660 0x7f7818197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f782018d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818104f90 0x7f78181983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f782018d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78181078c0 0x7f781819f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f782018d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f781810d7d0 con 0x7f78181078c0 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f782018d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f781810d650 con 0x7f7818102660 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f782018d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f781810d950 con 0x7f7818104f90 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f781e72a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78181078c0 0x7f781819f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f781df29640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7818102660 0x7f7818197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.048+0000 7f781e72a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78181078c0 0x7f781819f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34418/0 (socket says 172.21.15.42:34418) 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f781e72a640 1 -- 172.21.15.42:0/3119119721 learned_addr learned my addr 172.21.15.42:0/3119119721 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f781d728640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818104f90 0x7f78181983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f781e72a640 1 -- 172.21.15.42:0/3119119721 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818104f90 msgr2=0x7f78181983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f781e72a640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818104f90 0x7f78181983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f781e72a640 1 -- 172.21.15.42:0/3119119721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7818102660 msgr2=0x7f7818197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f781e72a640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7818102660 0x7f7818197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f781e72a640 1 -- 172.21.15.42:0/3119119721 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781819fa80 con 0x7f78181078c0 2024-09-19T09:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f781df29640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7818102660 0x7f7818197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f781e72a640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78181078c0 0x7f781819f410 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f781000e970 tx=0x7f781000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f7816ffd640 1 -- 172.21.15.42:0/3119119721 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781000ccc0 con 0x7f78181078c0 2024-09-19T09:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f7816ffd640 1 -- 172.21.15.42:0/3119119721 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7810005500 con 0x7f78181078c0 2024-09-19T09:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f782018d640 1 -- 172.21.15.42:0/3119119721 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781819fd70 con 0x7f78181078c0 2024-09-19T09:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f7816ffd640 1 -- 172.21.15.42:0/3119119721 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810010690 con 0x7f78181078c0 2024-09-19T09:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.049+0000 7f782018d640 1 -- 172.21.15.42:0/3119119721 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78181a01e0 con 0x7f78181078c0 2024-09-19T09:41:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.052+0000 7f7816ffd640 1 -- 172.21.15.42:0/3119119721 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f78100046c0 con 0x7f78181078c0 2024-09-19T09:41:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.052+0000 7f7823005740 1 Processor -- start 2024-09-19T09:41:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.052+0000 7f7823005740 1 -- start start 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f7823005740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddc9a0 0x55970cddcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f7823005740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddd2e0 0x55970cde1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f7823005740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 0x55970cde4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f7823005740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55970cd402f0 con 0x55970cde2370 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f7823005740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55970cce8270 con 0x55970cddc9a0 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f7823005740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55970cd3c2b0 con 0x55970cddd2e0 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781d728640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 0x55970cde4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781df29640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddd2e0 0x55970cde1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781d728640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddc9a0 0x55970cddcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781df29640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddd2e0 0x55970cde1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:39736/0 (socket says 172.21.15.42:39736) 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781d728640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddc9a0 0x55970cddcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:44618/0 (socket says 172.21.15.42:44618) 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781df29640 1 -- 172.21.15.42:0/1819287395 learned_addr learned my addr 172.21.15.42:0/1819287395 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f7816ffd640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78000a32f0 0x7f78000a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781df29640 1 -- 172.21.15.42:0/1819287395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddc9a0 msgr2=0x55970cddcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781df29640 1 --2- 172.21.15.42:0/1819287395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddc9a0 0x55970cddcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781df29640 1 -- 172.21.15.42:0/1819287395 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 msgr2=0x55970cde4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781df29640 1 --2- 172.21.15.42:0/1819287395 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 0x55970cde4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781df29640 1 -- 172.21.15.42:0/1819287395 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55970cce7340 con 0x55970cddd2e0 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f781e72a640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78000a32f0 0x7f78000a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.053+0000 7f7816ffd640 1 -- 172.21.15.42:0/3119119721 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f78100cfd20 con 0x7f78181078c0 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.054+0000 7f781df29640 1 --2- 172.21.15.42:0/1819287395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddd2e0 0x55970cde1da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7808011860 tx=0x7f7808011d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3ea063a02d8e4a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.054+0000 7f77fffff640 1 -- 172.21.15.42:0/1819287395 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78080112f0 con 0x55970cddd2e0 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.054+0000 7f77fffff640 1 -- 172.21.15.42:0/1819287395 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7808003e50 con 0x55970cddd2e0 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.054+0000 7f77fffff640 1 -- 172.21.15.42:0/1819287395 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78080044c0 con 0x55970cddd2e0 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.054+0000 7f781e72a640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78000a32f0 0x7f78000a57b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7810098cf0 tx=0x7f7810091800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 -- 172.21.15.42:0/1819287395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddd2e0 msgr2=0x55970cde1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 --2- 172.21.15.42:0/1819287395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddd2e0 0x55970cde1da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7808011860 tx=0x7f7808011d20 comp rx=0 tx=0).stop 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 -- 172.21.15.42:0/1819287395 shutdown_connections 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 --2- 172.21.15.42:0/1819287395 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 0x55970cde4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 --2- 172.21.15.42:0/1819287395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddd2e0 0x55970cde1da0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 --2- 172.21.15.42:0/1819287395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddc9a0 0x55970cddcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 -- 172.21.15.42:0/1819287395 >> 172.21.15.42:0/1819287395 conn(0x55970cdd8010 msgr2=0x55970cdd8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 -- 172.21.15.42:0/1819287395 shutdown_connections 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 -- 172.21.15.42:0/1819287395 wait complete. 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 -- start start 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.055+0000 7f7823005740 1 Processor -- start 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f7823005740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cde6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f7823005740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cde7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f7823005740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cde2370 0x55970cdee170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f7823005740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55970cde5340 con 0x55970cddc9a0 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f7823005740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55970ccc9290 con 0x55970cddd2e0 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f7823005740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55970cde54c0 con 0x55970cde2370 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f7823005740 10 client.0 _ll_register_callbacks cb 0x55970ccfa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781d728640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cde6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781d728640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cde6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34438/0 (socket says 172.21.15.42:34438) 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781d728640 1 -- 172.21.15.42:0/4193346530 learned_addr learned my addr 172.21.15.42:0/4193346530 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781df29640 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cde7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781d728640 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cde2370 0x55970cdee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781d728640 1 -- 172.21.15.42:0/4193346530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cde2370 msgr2=0x55970cdee170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781d728640 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cde2370 0x55970cdee170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781d728640 1 -- 172.21.15.42:0/4193346530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 msgr2=0x55970cde7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781d728640 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cde7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781d728640 1 -- 172.21.15.42:0/4193346530 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55970ca53210 con 0x55970cddc9a0 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f781d728640 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cde6bf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f780c0314e0 tx=0x7f780c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a05499e9a60d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f77fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f77fd7fa640 1 -- 172.21.15.42:0/4193346530 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c035040 con 0x55970cddc9a0 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.056+0000 7f77fd7fa640 1 -- 172.21.15.42:0/4193346530 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f780c004020 con 0x55970cddc9a0 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f7823005740 1 -- 172.21.15.42:0/4193346530 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7808003e50 con 0x55970cddc9a0 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f77fd7fa640 1 -- 172.21.15.42:0/4193346530 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f780c051050 con 0x55970cddc9a0 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f7823005740 10 client.16344 fetch_fsmap learned FSMap version 30 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f7823005740 1 -- 172.21.15.42:0/4193346530 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55970cb1f620 con 0x55970cddc9a0 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f77fd7fa640 1 -- 172.21.15.42:0/4193346530 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7808003e50 con 0x55970cddc9a0 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f77fd7fa640 1 -- 172.21.15.42:0/4193346530 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f780c0035f0 con 0x55970cddc9a0 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f7823005740 10 client.16344 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f7823005740 10 client.16344 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f7823005740 20 client.16344 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f7823005740 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55970cdf2860 0x55970cdf4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f7823005740 4 client.16344 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f7823005740 1 -- 172.21.15.42:0/4193346530 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55970cd4da20 con 0x55970cdf2860 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.057+0000 7f781df29640 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55970cdf2860 0x55970cdf4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.058+0000 7f781df29640 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55970cdf2860 0x55970cdf4cb0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=100711c340227f1b server_cookie=b77c6473315eed4a in_seq=0 out_seq=0 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.058+0000 7f77fd7fa640 10 client.16344 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f77fd7fa640 1 -- 172.21.15.42:0/4193346530 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55970cd4da20 con 0x55970cdf2860 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f77fd7fa640 10 client.16344 handle_command_reply: tid=0 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 client.16344 shutdown 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 -- 172.21.15.42:0/4193346530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 msgr2=0x55970cde6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cde6bf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f780c0314e0 tx=0x7f780c02a410 comp rx=0 tx=0).stop 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 -- 172.21.15.42:0/4193346530 shutdown_connections 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55970cdf2860 0x55970cdf4cb0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cde2370 0x55970cdee170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cde7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f77fd7fa640 0 client.16344 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 --2- 172.21.15.42:0/4193346530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cde6bf0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 -- 172.21.15.42:0/4193346530 >> 172.21.15.42:0/4193346530 conn(0x55970cdd8010 msgr2=0x55970cdd9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 -- 172.21.15.42:0/4193346530 shutdown_connections 2024-09-19T09:41:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 1 -- 172.21.15.42:0/4193346530 wait complete. 2024-09-19T09:41:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.059+0000 7f7823005740 20 client.16344 trim_cache size 0 max 16384 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f7823005740 1 Processor -- start 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f7823005740 1 -- start start 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f7823005740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddc9a0 0x55970cde71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f7823005740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cdee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f7823005740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 0x55970cdd70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f7823005740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78181a90c0 con 0x55970cde2370 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f7823005740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f78181aacf0 con 0x55970cddd2e0 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f7823005740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f78181a9790 con 0x55970cddc9a0 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f781d728640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 0x55970cdd70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f781d728640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 0x55970cdd70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34450/0 (socket says 172.21.15.42:34450) 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f781df29640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cdee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f781d728640 1 -- 172.21.15.42:0/2786574916 learned_addr learned my addr 172.21.15.42:0/2786574916 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.074+0000 7f781d728640 1 --2- 172.21.15.42:0/2786574916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddc9a0 0x55970cde71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.075+0000 7f781d728640 1 -- 172.21.15.42:0/2786574916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddc9a0 msgr2=0x55970cde71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.075+0000 7f781d728640 1 --2- 172.21.15.42:0/2786574916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddc9a0 0x55970cde71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.075+0000 7f781d728640 1 -- 172.21.15.42:0/2786574916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 msgr2=0x55970cdee130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.075+0000 7f781d728640 1 --2- 172.21.15.42:0/2786574916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cdee130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.075+0000 7f781d728640 1 -- 172.21.15.42:0/2786574916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55970cddd7c0 con 0x55970cde2370 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.075+0000 7f781df29640 1 --2- 172.21.15.42:0/2786574916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cdee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.075+0000 7f781d728640 1 --2- 172.21.15.42:0/2786574916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 0x55970cdd70b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f780c009850 tx=0x7f780c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1719d00ee32af16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.075+0000 7f77ff7fe640 1 -- 172.21.15.42:0/2786574916 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c035070 con 0x55970cde2370 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.075+0000 7f77ff7fe640 1 -- 172.21.15.42:0/2786574916 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f780c0035f0 con 0x55970cde2370 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.075+0000 7f77ff7fe640 1 -- 172.21.15.42:0/2786574916 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c003e90 con 0x55970cde2370 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 -- 172.21.15.42:0/2786574916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 msgr2=0x55970cdd70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 --2- 172.21.15.42:0/2786574916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 0x55970cdd70b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f780c009850 tx=0x7f780c005fd0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 -- 172.21.15.42:0/2786574916 shutdown_connections 2024-09-19T09:41:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 --2- 172.21.15.42:0/2786574916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cde2370 0x55970cdd70b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 --2- 172.21.15.42:0/2786574916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cdee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 --2- 172.21.15.42:0/2786574916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cddc9a0 0x55970cde71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 -- 172.21.15.42:0/2786574916 >> 172.21.15.42:0/2786574916 conn(0x55970cdd8010 msgr2=0x55970cdd69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 -- 172.21.15.42:0/2786574916 shutdown_connections 2024-09-19T09:41:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 -- 172.21.15.42:0/2786574916 wait complete. 2024-09-19T09:41:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 -- start start 2024-09-19T09:41:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.076+0000 7f7823005740 1 Processor -- start 2024-09-19T09:41:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f7823005740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cdeb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f7823005740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cdebc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f7823005740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cde2370 0x55970cdecbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f7823005740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78181aa5f0 con 0x55970cddc9a0 2024-09-19T09:41:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f7823005740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f78181a9f20 con 0x55970cddd2e0 2024-09-19T09:41:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f7823005740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f78181a70a0 con 0x55970cde2370 2024-09-19T09:41:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f7823005740 10 client.0 _ll_register_callbacks cb 0x7f780c032ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781d728640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cdeb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781d728640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cdeb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34466/0 (socket says 172.21.15.42:34466) 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781d728640 1 -- 172.21.15.42:0/676654293 learned_addr learned my addr 172.21.15.42:0/676654293 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781df29640 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cdebc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781d728640 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cde2370 0x55970cdecbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781df29640 1 -- 172.21.15.42:0/676654293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cde2370 msgr2=0x55970cdecbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781df29640 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cde2370 0x55970cdecbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781df29640 1 -- 172.21.15.42:0/676654293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 msgr2=0x55970cdeb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781df29640 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cdeb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781df29640 1 -- 172.21.15.42:0/676654293 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55970cded1d0 con 0x55970cddd2e0 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781d728640 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cdeb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f781df29640 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cdebc00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7808004000 tx=0x7f7808009fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe0bd58afdb5b1e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.077+0000 7f77fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:41:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f77fd7fa640 1 -- 172.21.15.42:0/676654293 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78080039f0 con 0x55970cddd2e0 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f7823005740 1 -- 172.21.15.42:0/676654293 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f780c0035f0 con 0x55970cddd2e0 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f77fd7fa640 1 -- 172.21.15.42:0/676654293 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f7808023040 con 0x55970cddd2e0 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f77fd7fa640 1 -- 172.21.15.42:0/676654293 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7808039050 con 0x55970cddd2e0 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f7823005740 10 client.25787 fetch_fsmap learned FSMap version 30 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f7823005740 1 -- 172.21.15.42:0/676654293 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55970ce5d590 con 0x55970cddd2e0 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f77fd7fa640 1 -- 172.21.15.42:0/676654293 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f780c0035f0 con 0x55970cddd2e0 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f77fd7fa640 1 -- 172.21.15.42:0/676654293 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 30) ==== 8382+0+0 (secure 0 0 0) 0x7f7808030070 con 0x55970cddd2e0 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f7823005740 10 client.25787 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f7823005740 10 client.25787 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f7823005740 20 client.25787 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f7823005740 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55970ce5dbf0 0x55970ce60010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f7823005740 4 client.25787 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.078+0000 7f7823005740 1 -- 172.21.15.42:0/676654293 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55970cd47d70 con 0x55970ce5dbf0 2024-09-19T09:41:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.079+0000 7f781d728640 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55970ce5dbf0 0x55970ce60010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.079+0000 7f781d728640 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55970ce5dbf0 0x55970ce60010 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b97efe6a1ae8d5c0 server_cookie=b39d4b3668f766af in_seq=0 out_seq=0 2024-09-19T09:41:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.079+0000 7f77fd7fa640 10 client.25787 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f77fd7fa640 1 -- 172.21.15.42:0/676654293 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55970cd47d70 con 0x55970ce5dbf0 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f77fd7fa640 10 client.25787 handle_command_reply: tid=0 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 client.25787 shutdown 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 -- 172.21.15.42:0/676654293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 msgr2=0x55970cdebc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cdebc00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7808004000 tx=0x7f7808009fd0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 -- 172.21.15.42:0/676654293 shutdown_connections 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55970ce5dbf0 0x55970ce60010 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55970cde2370 0x55970cdecbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55970cddd2e0 0x55970cdebc00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 --2- 172.21.15.42:0/676654293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55970cddc9a0 0x55970cdeb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f77fd7fa640 0 client.25787 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 -- 172.21.15.42:0/676654293 >> 172.21.15.42:0/676654293 conn(0x55970cdd8010 msgr2=0x55970cdd69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 -- 172.21.15.42:0/676654293 shutdown_connections 2024-09-19T09:41:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.994+0000 7f7823005740 1 -- 172.21.15.42:0/676654293 wait complete. 2024-09-19T09:41:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f7823005740 20 client.25787 trim_cache size 0 max 16384 2024-09-19T09:41:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:41:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:41:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:41:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:41:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 -- 172.21.15.42:0/3119119721 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78000a32f0 msgr2=0x7f78000a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78000a32f0 0x7f78000a57b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7810098cf0 tx=0x7f7810091800 comp rx=0 tx=0).stop 2024-09-19T09:41:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 -- 172.21.15.42:0/3119119721 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78181078c0 msgr2=0x7f781819f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78181078c0 0x7f781819f410 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f781000e970 tx=0x7f781000ee30 comp rx=0 tx=0).stop 2024-09-19T09:41:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 -- 172.21.15.42:0/3119119721 shutdown_connections 2024-09-19T09:41:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f78000a32f0 0x7f78000a57b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78181078c0 0x7f781819f410 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818104f90 0x7f78181983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 --2- 172.21.15.42:0/3119119721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7818102660 0x7f7818197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 -- 172.21.15.42:0/3119119721 >> 172.21.15.42:0/3119119721 conn(0x7f78180fc1e0 msgr2=0x7f7818102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 -- 172.21.15.42:0/3119119721 shutdown_connections 2024-09-19T09:41:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:31.995+0000 7f782018d640 1 -- 172.21.15.42:0/3119119721 wait complete. 2024-09-19T09:41:32.590 INFO:tasks.workunit.client.0.smithi042.stdout:9/11: creat f3 x:0 0 0 2024-09-19T09:41:32.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:32 smithi171 ceph-mon[35803]: pgmap v403: 97 pgs: 97 active+clean; 80 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 438 op/s 2024-09-19T09:41:32.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:32 smithi136 ceph-mon[34840]: pgmap v403: 97 pgs: 97 active+clean; 80 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 438 op/s 2024-09-19T09:41:32.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:32 smithi042 ceph-mon[31223]: pgmap v403: 97 pgs: 97 active+clean; 80 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 438 op/s 2024-09-19T09:41:32.899 INFO:tasks.workunit.client.0.smithi042.stdout:5/22: mkdir d2/d8 0 2024-09-19T09:41:32.899 INFO:tasks.workunit.client.0.smithi042.stdout:5/23: truncate d2/f7 4870845 0 2024-09-19T09:41:33.503 INFO:tasks.workunit.client.0.smithi042.stdout:3/8: symlink l3 0 2024-09-19T09:41:34.282 INFO:tasks.workunit.client.0.smithi042.stdout:1/12: mkdir d4 0 2024-09-19T09:41:34.282 INFO:tasks.workunit.client.0.smithi042.stdout:1/13: dread - f1 zero size 2024-09-19T09:41:34.283 INFO:tasks.workunit.client.0.smithi042.stdout:8/14: link l0 d1/l4 0 2024-09-19T09:41:34.284 INFO:tasks.workunit.client.0.smithi042.stdout:8/15: read d1/f2 [283040,46545] 0 2024-09-19T09:41:34.289 INFO:tasks.workunit.client.0.smithi042.stdout:2/11: creat f2 x:0 0 0 2024-09-19T09:41:34.301 INFO:tasks.workunit.client.0.smithi042.stdout:1/14: dwrite f1 [0,4194304] 0 2024-09-19T09:41:34.316 INFO:tasks.workunit.client.0.smithi042.stdout:4/20: creat d0/f5 x:0 0 0 2024-09-19T09:41:34.321 INFO:tasks.workunit.client.0.smithi042.stdout:5/24: mkdir d2/d4/d9 0 2024-09-19T09:41:34.321 INFO:tasks.workunit.client.0.smithi042.stdout:3/9: mkdir d4 0 2024-09-19T09:41:34.321 INFO:tasks.workunit.client.0.smithi042.stdout:3/10: write f0 [1975700,20540] 0 2024-09-19T09:41:34.321 INFO:tasks.workunit.client.0.smithi042.stdout:8/16: truncate d1/f2 186844 0 2024-09-19T09:41:34.324 INFO:tasks.workunit.client.0.smithi042.stdout:1/15: unlink f3 0 2024-09-19T09:41:34.328 INFO:tasks.workunit.client.0.smithi042.stdout:4/21: dread d0/f4 [0,4194304] 0 2024-09-19T09:41:34.328 INFO:tasks.workunit.client.0.smithi042.stdout:4/22: chown d0 31600 1 2024-09-19T09:41:34.329 INFO:tasks.workunit.client.0.smithi042.stdout:5/25: creat d2/d4/fa x:0 0 0 2024-09-19T09:41:34.331 INFO:tasks.workunit.client.0.smithi042.stdout:3/11: creat d4/f5 x:0 0 0 2024-09-19T09:41:34.331 INFO:tasks.workunit.client.0.smithi042.stdout:3/12: write f0 [2599379,1910] 0 2024-09-19T09:41:34.332 INFO:tasks.workunit.client.0.smithi042.stdout:1/16: write f1 [2218890,22879] 0 2024-09-19T09:41:34.333 INFO:tasks.workunit.client.0.smithi042.stdout:3/13: creat d4/f6 x:0 0 0 2024-09-19T09:41:34.335 INFO:tasks.workunit.client.0.smithi042.stdout:4/23: symlink d0/l6 0 2024-09-19T09:41:34.336 INFO:tasks.workunit.client.0.smithi042.stdout:1/17: mkdir d4/d5 0 2024-09-19T09:41:34.337 INFO:tasks.workunit.client.0.smithi042.stdout:3/14: rmdir d4 39 2024-09-19T09:41:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:3/15: symlink d4/l7 0 2024-09-19T09:41:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:3/16: dread - d4/f5 zero size 2024-09-19T09:41:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:3/17: write d4/f6 [309120,16681] 0 2024-09-19T09:41:34.341 INFO:tasks.workunit.client.0.smithi042.stdout:4/24: link d0/f5 d0/f7 0 2024-09-19T09:41:34.342 INFO:tasks.workunit.client.0.smithi042.stdout:4/25: read d0/f4 [84234,105869] 0 2024-09-19T09:41:34.344 INFO:tasks.workunit.client.0.smithi042.stdout:4/26: symlink d0/l8 0 2024-09-19T09:41:34.346 INFO:tasks.workunit.client.0.smithi042.stdout:4/27: symlink d0/l9 0 2024-09-19T09:41:34.346 INFO:tasks.workunit.client.0.smithi042.stdout:4/28: chown d0/l9 523061837 1 2024-09-19T09:41:34.348 INFO:tasks.workunit.client.0.smithi042.stdout:4/29: symlink d0/la 0 2024-09-19T09:41:34.350 INFO:tasks.workunit.client.0.smithi042.stdout:5/26: dwrite d2/d4/fa [0,4194304] 0 2024-09-19T09:41:34.353 INFO:tasks.workunit.client.0.smithi042.stdout:5/27: mkdir d2/db 0 2024-09-19T09:41:34.353 INFO:tasks.workunit.client.0.smithi042.stdout:5/28: readlink l0 0 2024-09-19T09:41:34.372 INFO:tasks.workunit.client.0.smithi042.stdout:7/21: truncate d0/f5 226830 0 2024-09-19T09:41:34.553 INFO:tasks.workunit.client.0.smithi042.stdout:2/12: fsync f2 0 2024-09-19T09:41:34.557 INFO:tasks.workunit.client.0.smithi042.stdout:3/18: rmdir d4 39 2024-09-19T09:41:34.559 INFO:tasks.workunit.client.0.smithi042.stdout:8/17: truncate d1/f2 322622 0 2024-09-19T09:41:34.559 INFO:tasks.workunit.client.0.smithi042.stdout:8/18: chown d1/l4 19 1 2024-09-19T09:41:34.561 INFO:tasks.workunit.client.0.smithi042.stdout:9/12: truncate f1 3369199 0 2024-09-19T09:41:34.562 INFO:tasks.workunit.client.0.smithi042.stdout:9/13: getdents . 0 2024-09-19T09:41:34.564 INFO:tasks.workunit.client.0.smithi042.stdout:3/19: dread d4/f6 [0,4194304] 0 2024-09-19T09:41:34.564 INFO:tasks.workunit.client.0.smithi042.stdout:3/20: dread - d4/f5 zero size 2024-09-19T09:41:34.564 INFO:tasks.workunit.client.0.smithi042.stdout:3/21: chown c1 679936 1 2024-09-19T09:41:34.564 INFO:tasks.workunit.client.0.smithi042.stdout:3/22: truncate d4/f5 84700 0 2024-09-19T09:41:34.565 INFO:tasks.workunit.client.0.smithi042.stdout:3/23: unlink d4/f5 0 2024-09-19T09:41:34.565 INFO:tasks.workunit.client.0.smithi042.stdout:1/18: getdents d4 0 2024-09-19T09:41:34.567 INFO:tasks.workunit.client.0.smithi042.stdout:3/24: mkdir d4/d8 0 2024-09-19T09:41:34.567 INFO:tasks.workunit.client.0.smithi042.stdout:3/25: truncate d4/f6 1272390 0 2024-09-19T09:41:34.568 INFO:tasks.workunit.client.0.smithi042.stdout:1/19: mkdir d4/d5/d6 0 2024-09-19T09:41:34.568 INFO:tasks.workunit.client.0.smithi042.stdout:3/26: mkdir d4/d8/d9 0 2024-09-19T09:41:34.570 INFO:tasks.workunit.client.0.smithi042.stdout:1/20: rename d4/d5/d6 to d4/d7 0 2024-09-19T09:41:34.570 INFO:tasks.workunit.client.0.smithi042.stdout:4/30: stat d0 0 2024-09-19T09:41:34.570 INFO:tasks.workunit.client.0.smithi042.stdout:4/31: write d0/f4 [91280,34939] 0 2024-09-19T09:41:34.571 INFO:tasks.workunit.client.0.smithi042.stdout:3/27: creat d4/fa x:0 0 0 2024-09-19T09:41:34.571 INFO:tasks.workunit.client.0.smithi042.stdout:3/28: chown d4/f6 1728362 1 2024-09-19T09:41:34.571 INFO:tasks.workunit.client.0.smithi042.stdout:3/29: write d4/f6 [1582665,127072] 0 2024-09-19T09:41:34.573 INFO:tasks.workunit.client.0.smithi042.stdout:4/32: creat d0/fb x:0 0 0 2024-09-19T09:41:34.573 INFO:tasks.workunit.client.0.smithi042.stdout:4/33: readlink d0/l8 0 2024-09-19T09:41:34.574 INFO:tasks.workunit.client.0.smithi042.stdout:4/34: creat d0/fc x:0 0 0 2024-09-19T09:41:34.574 INFO:tasks.workunit.client.0.smithi042.stdout:4/35: write d0/f7 [315704,36426] 0 2024-09-19T09:41:34.574 INFO:tasks.workunit.client.0.smithi042.stdout:5/29: truncate d2/f7 2817041 0 2024-09-19T09:41:34.576 INFO:tasks.workunit.client.0.smithi042.stdout:5/30: mkdir d2/dc 0 2024-09-19T09:41:34.576 INFO:tasks.workunit.client.0.smithi042.stdout:5/31: chown d2 0 1 2024-09-19T09:41:34.579 INFO:tasks.workunit.client.0.smithi042.stdout:5/32: link d2/c3 d2/db/cd 0 2024-09-19T09:41:34.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:34 smithi171 ceph-mon[35803]: pgmap v404: 97 pgs: 97 active+clean; 100 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 588 op/s 2024-09-19T09:41:34.597 INFO:tasks.workunit.client.0.smithi042.stdout:1/21: dwrite f1 [0,4194304] 0 2024-09-19T09:41:34.602 INFO:tasks.workunit.client.0.smithi042.stdout:4/36: dwrite d0/fc [0,4194304] 0 2024-09-19T09:41:34.603 INFO:tasks.workunit.client.0.smithi042.stdout:3/30: dwrite d4/f6 [0,4194304] 0 2024-09-19T09:41:34.617 INFO:tasks.workunit.client.0.smithi042.stdout:8/19: truncate d1/f2 809091 0 2024-09-19T09:41:34.623 INFO:tasks.workunit.client.0.smithi042.stdout:3/31: fsync d4/fa 0 2024-09-19T09:41:34.623 INFO:tasks.workunit.client.0.smithi042.stdout:1/22: dwrite f2 [0,4194304] 0 2024-09-19T09:41:34.623 INFO:tasks.workunit.client.0.smithi042.stdout:1/23: chown f2 1118216 1 2024-09-19T09:41:34.625 INFO:tasks.workunit.client.0.smithi042.stdout:7/22: truncate d0/f5 850555 0 2024-09-19T09:41:34.630 INFO:tasks.workunit.client.0.smithi042.stdout:1/24: dread f2 [0,4194304] 0 2024-09-19T09:41:34.630 INFO:tasks.workunit.client.0.smithi042.stdout:1/25: rename d4/d5 to d4/d5/d8 22 2024-09-19T09:41:34.633 INFO:tasks.workunit.client.0.smithi042.stdout:8/20: symlink d1/l5 0 2024-09-19T09:41:34.634 INFO:tasks.workunit.client.0.smithi042.stdout:3/32: rmdir d4 39 2024-09-19T09:41:34.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:34 smithi136 ceph-mon[34840]: pgmap v404: 97 pgs: 97 active+clean; 100 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 588 op/s 2024-09-19T09:41:34.636 INFO:tasks.workunit.client.0.smithi042.stdout:4/37: mknod d0/cd 0 2024-09-19T09:41:34.638 INFO:tasks.workunit.client.0.smithi042.stdout:7/23: rename d0/c1 to d0/c9 0 2024-09-19T09:41:34.638 INFO:tasks.workunit.client.0.smithi042.stdout:1/26: creat d4/d5/f9 x:0 0 0 2024-09-19T09:41:34.639 INFO:tasks.workunit.client.0.smithi042.stdout:3/33: dread f0 [0,4194304] 0 2024-09-19T09:41:34.639 INFO:tasks.workunit.client.0.smithi042.stdout:3/34: dread - d4/fa zero size 2024-09-19T09:41:34.641 INFO:tasks.workunit.client.0.smithi042.stdout:4/38: creat d0/fe x:0 0 0 2024-09-19T09:41:34.641 INFO:tasks.workunit.client.0.smithi042.stdout:3/35: creat d4/d8/d9/fb x:0 0 0 2024-09-19T09:41:34.642 INFO:tasks.workunit.client.0.smithi042.stdout:4/39: rmdir d0 39 2024-09-19T09:41:34.644 INFO:tasks.workunit.client.0.smithi042.stdout:4/40: symlink d0/lf 0 2024-09-19T09:41:34.645 INFO:tasks.workunit.client.0.smithi042.stdout:4/41: readlink d0/l9 0 2024-09-19T09:41:34.646 INFO:tasks.workunit.client.0.smithi042.stdout:4/42: creat d0/f10 x:0 0 0 2024-09-19T09:41:34.658 INFO:tasks.workunit.client.0.smithi042.stdout:1/27: dwrite f2 [0,4194304] 0 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:6/14: sync 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:6/15: dread - no filename 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:0/6: sync 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:0/7: read - no filename 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:6/16: readlink d1/l3 0 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:6/17: chown d1/d2 191 1 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:0/8: getdents . 0 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:6/18: rename d1 to d1/d4 22 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:6/19: write - no filename 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:6/20: truncate - no filename 2024-09-19T09:41:34.661 INFO:tasks.workunit.client.0.smithi042.stdout:7/24: dwrite d0/f6 [0,4194304] 0 2024-09-19T09:41:34.668 INFO:tasks.workunit.client.0.smithi042.stdout:6/21: rename d1/d2 to d1/d5 0 2024-09-19T09:41:34.668 INFO:tasks.workunit.client.0.smithi042.stdout:0/9: creat f0 x:0 0 0 2024-09-19T09:41:34.668 INFO:tasks.workunit.client.0.smithi042.stdout:8/21: write d1/f2 [1494422,15960] 0 2024-09-19T09:41:34.668 INFO:tasks.workunit.client.0.smithi042.stdout:0/10: write f0 [27668,85892] 0 2024-09-19T09:41:34.669 INFO:tasks.workunit.client.0.smithi042.stdout:8/22: write d1/f2 [1108142,34544] 0 2024-09-19T09:41:34.670 INFO:tasks.workunit.client.0.smithi042.stdout:6/22: creat d1/f6 x:0 0 0 2024-09-19T09:41:34.674 INFO:tasks.workunit.client.0.smithi042.stdout:0/11: dread f0 [0,4194304] 0 2024-09-19T09:41:34.674 INFO:tasks.workunit.client.0.smithi042.stdout:0/12: rmdir - no directory 2024-09-19T09:41:34.676 INFO:tasks.workunit.client.0.smithi042.stdout:8/23: dread d1/f2 [0,4194304] 0 2024-09-19T09:41:34.677 INFO:tasks.workunit.client.0.smithi042.stdout:0/13: creat f1 x:0 0 0 2024-09-19T09:41:34.679 INFO:tasks.workunit.client.0.smithi042.stdout:0/14: mkdir d2 0 2024-09-19T09:41:34.679 INFO:tasks.workunit.client.0.smithi042.stdout:0/15: getdents d2 0 2024-09-19T09:41:34.682 INFO:tasks.workunit.client.0.smithi042.stdout:0/16: creat d2/f3 x:0 0 0 2024-09-19T09:41:34.682 INFO:tasks.workunit.client.0.smithi042.stdout:0/17: stat d2/f3 0 2024-09-19T09:41:34.683 INFO:tasks.workunit.client.0.smithi042.stdout:0/18: creat d2/f4 x:0 0 0 2024-09-19T09:41:34.683 INFO:tasks.workunit.client.0.smithi042.stdout:0/19: truncate f0 852876 0 2024-09-19T09:41:34.683 INFO:tasks.workunit.client.0.smithi042.stdout:0/20: dread - d2/f3 zero size 2024-09-19T09:41:34.684 INFO:tasks.workunit.client.0.smithi042.stdout:0/21: chown d2 1 1 2024-09-19T09:41:34.684 INFO:tasks.workunit.client.0.smithi042.stdout:0/22: rename d2/f4 to d2/f5 0 2024-09-19T09:41:34.686 INFO:tasks.workunit.client.0.smithi042.stdout:7/25: dwrite d0/f6 [0,4194304] 0 2024-09-19T09:41:34.688 INFO:tasks.workunit.client.0.smithi042.stdout:7/26: dread d0/f5 [0,4194304] 0 2024-09-19T09:41:34.688 INFO:tasks.workunit.client.0.smithi042.stdout:7/27: readlink d0/l2 0 2024-09-19T09:41:34.688 INFO:tasks.workunit.client.0.smithi042.stdout:9/14: dwrite f1 [0,4194304] 0 2024-09-19T09:41:34.688 INFO:tasks.workunit.client.0.smithi042.stdout:9/15: chown f2 62 1 2024-09-19T09:41:34.690 INFO:tasks.workunit.client.0.smithi042.stdout:7/28: creat d0/fa x:0 0 0 2024-09-19T09:41:34.691 INFO:tasks.workunit.client.0.smithi042.stdout:5/33: write d2/f7 [111527,71047] 0 2024-09-19T09:41:34.693 INFO:tasks.workunit.client.0.smithi042.stdout:7/29: link d0/fa d0/fb 0 2024-09-19T09:41:34.702 INFO:tasks.workunit.client.0.smithi042.stdout:5/34: write d2/d4/fa [3321685,80070] 0 2024-09-19T09:41:34.702 INFO:tasks.workunit.client.0.smithi042.stdout:5/35: chown d2/d4 0 1 2024-09-19T09:41:34.703 INFO:tasks.workunit.client.0.smithi042.stdout:1/28: truncate f2 2461636 0 2024-09-19T09:41:34.703 INFO:tasks.workunit.client.0.smithi042.stdout:3/36: dwrite d4/f6 [4194304,4194304] 0 2024-09-19T09:41:34.703 INFO:tasks.workunit.client.0.smithi042.stdout:3/37: read f0 [1148014,47628] 0 2024-09-19T09:41:34.703 INFO:tasks.workunit.client.0.smithi042.stdout:5/36: unlink d2/c3 0 2024-09-19T09:41:34.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:34 smithi042 ceph-mon[31223]: pgmap v404: 97 pgs: 97 active+clean; 100 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 588 op/s 2024-09-19T09:41:34.705 INFO:tasks.workunit.client.0.smithi042.stdout:6/23: rmdir d1/d5 0 2024-09-19T09:41:34.707 INFO:tasks.workunit.client.0.smithi042.stdout:3/38: mkdir d4/d8/d9/dc 0 2024-09-19T09:41:34.707 INFO:tasks.workunit.client.0.smithi042.stdout:3/39: dread - d4/fa zero size 2024-09-19T09:41:34.708 INFO:tasks.workunit.client.0.smithi042.stdout:5/37: creat d2/db/fe x:0 0 0 2024-09-19T09:41:34.709 INFO:tasks.workunit.client.0.smithi042.stdout:6/24: rename c0 to d1/c7 0 2024-09-19T09:41:34.710 INFO:tasks.workunit.client.0.smithi042.stdout:6/25: stat d1 0 2024-09-19T09:41:34.710 INFO:tasks.workunit.client.0.smithi042.stdout:6/26: write d1/f6 [622901,56352] 0 2024-09-19T09:41:34.710 INFO:tasks.workunit.client.0.smithi042.stdout:6/27: write d1/f6 [1374820,101541] 0 2024-09-19T09:41:34.710 INFO:tasks.workunit.client.0.smithi042.stdout:2/13: dread f0 [4194304,4194304] 0 2024-09-19T09:41:34.710 INFO:tasks.workunit.client.0.smithi042.stdout:9/16: dwrite f1 [0,4194304] 0 2024-09-19T09:41:34.710 INFO:tasks.workunit.client.0.smithi042.stdout:3/40: rmdir d4/d8/d9 39 2024-09-19T09:41:34.710 INFO:tasks.workunit.client.0.smithi042.stdout:3/41: chown d4/l7 0 1 2024-09-19T09:41:34.710 INFO:tasks.workunit.client.0.smithi042.stdout:3/42: chown f0 983433 1 2024-09-19T09:41:34.711 INFO:tasks.workunit.client.0.smithi042.stdout:3/43: read f0 [2215119,30866] 0 2024-09-19T09:41:34.711 INFO:tasks.workunit.client.0.smithi042.stdout:5/38: mkdir d2/db/df 0 2024-09-19T09:41:34.713 INFO:tasks.workunit.client.0.smithi042.stdout:9/17: symlink l4 0 2024-09-19T09:41:34.715 INFO:tasks.workunit.client.0.smithi042.stdout:3/44: rename d4/fa to d4/d8/fd 0 2024-09-19T09:41:34.716 INFO:tasks.workunit.client.0.smithi042.stdout:5/39: creat d2/db/f10 x:0 0 0 2024-09-19T09:41:34.716 INFO:tasks.workunit.client.0.smithi042.stdout:8/24: truncate d1/f2 1092418 0 2024-09-19T09:41:34.718 INFO:tasks.workunit.client.0.smithi042.stdout:3/45: unlink d4/f6 0 2024-09-19T09:41:34.718 INFO:tasks.workunit.client.0.smithi042.stdout:3/46: chown d4/d8/fd 14274 1 2024-09-19T09:41:34.720 INFO:tasks.workunit.client.0.smithi042.stdout:0/23: unlink d2/f5 0 2024-09-19T09:41:34.720 INFO:tasks.workunit.client.0.smithi042.stdout:0/24: chown d2 251 1 2024-09-19T09:41:34.725 INFO:tasks.workunit.client.0.smithi042.stdout:0/25: dread f0 [0,4194304] 0 2024-09-19T09:41:34.725 INFO:tasks.workunit.client.0.smithi042.stdout:0/26: readlink - no filename 2024-09-19T09:41:34.725 INFO:tasks.workunit.client.0.smithi042.stdout:3/47: mkdir d4/d8/de 0 2024-09-19T09:41:34.725 INFO:tasks.workunit.client.0.smithi042.stdout:3/48: fdatasync d4/d8/fd 0 2024-09-19T09:41:34.725 INFO:tasks.workunit.client.0.smithi042.stdout:3/49: write d4/d8/fd [760733,116729] 0 2024-09-19T09:41:34.725 INFO:tasks.workunit.client.0.smithi042.stdout:3/50: chown c1 7686 1 2024-09-19T09:41:34.726 INFO:tasks.workunit.client.0.smithi042.stdout:3/51: chown d4/d8/fd 6 1 2024-09-19T09:41:34.728 INFO:tasks.workunit.client.0.smithi042.stdout:7/30: getdents d0 0 2024-09-19T09:41:34.730 INFO:tasks.workunit.client.0.smithi042.stdout:9/18: write f1 [1944744,103938] 0 2024-09-19T09:41:34.730 INFO:tasks.workunit.client.0.smithi042.stdout:0/27: mknod d2/c6 0 2024-09-19T09:41:34.730 INFO:tasks.workunit.client.0.smithi042.stdout:0/28: read - f1 zero size 2024-09-19T09:41:34.732 INFO:tasks.workunit.client.0.smithi042.stdout:2/14: dwrite f2 [0,4194304] 0 2024-09-19T09:41:34.732 INFO:tasks.workunit.client.0.smithi042.stdout:6/28: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:41:34.732 INFO:tasks.workunit.client.0.smithi042.stdout:9/19: fdatasync f1 0 2024-09-19T09:41:34.738 INFO:tasks.workunit.client.0.smithi042.stdout:3/52: creat d4/ff x:0 0 0 2024-09-19T09:41:34.738 INFO:tasks.workunit.client.0.smithi042.stdout:3/53: readlink d4/l7 0 2024-09-19T09:41:34.743 INFO:tasks.workunit.client.0.smithi042.stdout:6/29: write d1/f6 [258812,105968] 0 2024-09-19T09:41:34.745 INFO:tasks.workunit.client.0.smithi042.stdout:3/54: symlink d4/l10 0 2024-09-19T09:41:34.745 INFO:tasks.workunit.client.0.smithi042.stdout:1/29: write f2 [1972362,1839] 0 2024-09-19T09:41:34.749 INFO:tasks.workunit.client.0.smithi042.stdout:8/25: write d1/f2 [937149,124250] 0 2024-09-19T09:41:34.749 INFO:tasks.workunit.client.0.smithi042.stdout:0/29: dwrite d2/f3 [0,4194304] 0 2024-09-19T09:41:34.751 INFO:tasks.workunit.client.0.smithi042.stdout:1/30: rmdir d4/d7 0 2024-09-19T09:41:34.752 INFO:tasks.workunit.client.0.smithi042.stdout:8/26: getdents d1 0 2024-09-19T09:41:34.752 INFO:tasks.workunit.client.0.smithi042.stdout:8/27: write d1/f2 [1992493,91953] 0 2024-09-19T09:41:34.753 INFO:tasks.workunit.client.0.smithi042.stdout:6/30: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:34.757 INFO:tasks.workunit.client.0.smithi042.stdout:5/40: truncate d2/f7 2737136 0 2024-09-19T09:41:34.758 INFO:tasks.workunit.client.0.smithi042.stdout:0/30: rename d2/c6 to d2/c7 0 2024-09-19T09:41:34.760 INFO:tasks.workunit.client.0.smithi042.stdout:8/28: rename d1/l4 to d1/l6 0 2024-09-19T09:41:34.760 INFO:tasks.workunit.client.0.smithi042.stdout:8/29: write d1/f2 [766214,97944] 0 2024-09-19T09:41:34.761 INFO:tasks.workunit.client.0.smithi042.stdout:1/31: dread f1 [0,4194304] 0 2024-09-19T09:41:34.761 INFO:tasks.workunit.client.0.smithi042.stdout:8/30: creat d1/f7 x:0 0 0 2024-09-19T09:41:34.762 INFO:tasks.workunit.client.0.smithi042.stdout:8/31: write d1/f2 [963964,91330] 0 2024-09-19T09:41:34.765 INFO:tasks.workunit.client.0.smithi042.stdout:1/32: rename f2 to d4/fa 0 2024-09-19T09:41:34.767 INFO:tasks.workunit.client.0.smithi042.stdout:3/55: dwrite d4/ff [0,4194304] 0 2024-09-19T09:41:34.772 INFO:tasks.workunit.client.0.smithi042.stdout:3/56: rename d4/d8/d9/fb to d4/f11 0 2024-09-19T09:41:34.772 INFO:tasks.workunit.client.0.smithi042.stdout:0/31: read d2/f3 [1063835,22897] 0 2024-09-19T09:41:34.773 INFO:tasks.workunit.client.0.smithi042.stdout:0/32: creat d2/f8 x:0 0 0 2024-09-19T09:41:34.774 INFO:tasks.workunit.client.0.smithi042.stdout:0/33: creat d2/f9 x:0 0 0 2024-09-19T09:41:34.774 INFO:tasks.workunit.client.0.smithi042.stdout:0/34: write f1 [557124,9893] 0 2024-09-19T09:41:34.774 INFO:tasks.workunit.client.0.smithi042.stdout:0/35: stat d2/f9 0 2024-09-19T09:41:34.775 INFO:tasks.workunit.client.0.smithi042.stdout:0/36: chown d2/f3 53777861 1 2024-09-19T09:41:34.779 INFO:tasks.workunit.client.0.smithi042.stdout:1/33: dread d4/fa [0,4194304] 0 2024-09-19T09:41:34.781 INFO:tasks.workunit.client.0.smithi042.stdout:2/15: dread f0 [0,4194304] 0 2024-09-19T09:41:34.790 INFO:tasks.workunit.client.0.smithi042.stdout:2/16: write f0 [7267719,53759] 0 2024-09-19T09:41:34.790 INFO:tasks.workunit.client.0.smithi042.stdout:2/17: chown f2 5 1 2024-09-19T09:41:34.792 INFO:tasks.workunit.client.0.smithi042.stdout:6/31: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:41:34.796 INFO:tasks.workunit.client.0.smithi042.stdout:8/32: fdatasync d1/f2 0 2024-09-19T09:41:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:8/33: chown d1/l3 19802 1 2024-09-19T09:41:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:8/34: fdatasync d1/f7 0 2024-09-19T09:41:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:8/35: readlink d1/l6 0 2024-09-19T09:41:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:0/37: fsync d2/f8 0 2024-09-19T09:41:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:1/34: truncate d4/fa 612262 0 2024-09-19T09:41:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:2/18: dread f0 [4194304,4194304] 0 2024-09-19T09:41:34.802 INFO:tasks.workunit.client.0.smithi042.stdout:0/38: rename d2/f8 to d2/fa 0 2024-09-19T09:41:34.803 INFO:tasks.workunit.client.0.smithi042.stdout:1/35: creat d4/fb x:0 0 0 2024-09-19T09:41:34.803 INFO:tasks.workunit.client.0.smithi042.stdout:7/31: dwrite d0/f5 [0,4194304] 0 2024-09-19T09:41:34.804 INFO:tasks.workunit.client.0.smithi042.stdout:0/39: creat d2/fb x:0 0 0 2024-09-19T09:41:34.805 INFO:tasks.workunit.client.0.smithi042.stdout:6/32: write d1/f6 [2286282,46746] 0 2024-09-19T09:41:34.806 INFO:tasks.workunit.client.0.smithi042.stdout:1/36: getdents d4/d5 0 2024-09-19T09:41:34.807 INFO:tasks.workunit.client.0.smithi042.stdout:0/40: creat d2/fc x:0 0 0 2024-09-19T09:41:34.807 INFO:tasks.workunit.client.0.smithi042.stdout:0/41: readlink - no filename 2024-09-19T09:41:34.807 INFO:tasks.workunit.client.0.smithi042.stdout:5/41: dwrite d2/db/f10 [0,4194304] 0 2024-09-19T09:41:34.808 INFO:tasks.workunit.client.0.smithi042.stdout:9/20: dwrite f2 [0,4194304] 0 2024-09-19T09:41:34.808 INFO:tasks.workunit.client.0.smithi042.stdout:9/21: chown l4 14 1 2024-09-19T09:41:34.808 INFO:tasks.workunit.client.0.smithi042.stdout:6/33: unlink d1/l3 0 2024-09-19T09:41:34.808 INFO:tasks.workunit.client.0.smithi042.stdout:2/19: mknod c3 0 2024-09-19T09:41:34.810 INFO:tasks.workunit.client.0.smithi042.stdout:1/37: link d4/fb d4/d5/fc 0 2024-09-19T09:41:34.810 INFO:tasks.workunit.client.0.smithi042.stdout:7/32: write d0/f6 [523751,102130] 0 2024-09-19T09:41:34.811 INFO:tasks.workunit.client.0.smithi042.stdout:0/42: creat d2/fd x:0 0 0 2024-09-19T09:41:34.811 INFO:tasks.workunit.client.0.smithi042.stdout:0/43: dread - d2/fd zero size 2024-09-19T09:41:34.811 INFO:tasks.workunit.client.0.smithi042.stdout:0/44: dread - d2/fc zero size 2024-09-19T09:41:34.811 INFO:tasks.workunit.client.0.smithi042.stdout:0/45: dread - d2/fb zero size 2024-09-19T09:41:34.811 INFO:tasks.workunit.client.0.smithi042.stdout:0/46: dread - d2/fa zero size 2024-09-19T09:41:34.811 INFO:tasks.workunit.client.0.smithi042.stdout:0/47: write f1 [1357228,63276] 0 2024-09-19T09:41:34.812 INFO:tasks.workunit.client.0.smithi042.stdout:3/57: dwrite d4/ff [0,4194304] 0 2024-09-19T09:41:34.813 INFO:tasks.workunit.client.0.smithi042.stdout:5/42: getdents d2/db 0 2024-09-19T09:41:34.814 INFO:tasks.workunit.client.0.smithi042.stdout:9/22: rename f3 to f5 0 2024-09-19T09:41:34.815 INFO:tasks.workunit.client.0.smithi042.stdout:9/23: stat f1 0 2024-09-19T09:41:34.816 INFO:tasks.workunit.client.0.smithi042.stdout:6/34: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:34.817 INFO:tasks.workunit.client.0.smithi042.stdout:6/35: write d1/f6 [2305970,76387] 0 2024-09-19T09:41:34.817 INFO:tasks.workunit.client.0.smithi042.stdout:7/33: symlink d0/lc 0 2024-09-19T09:41:34.817 INFO:tasks.workunit.client.0.smithi042.stdout:7/34: chown d0/l4 22577444 1 2024-09-19T09:41:34.817 INFO:tasks.workunit.client.0.smithi042.stdout:7/35: stat d0/fb 0 2024-09-19T09:41:34.817 INFO:tasks.workunit.client.0.smithi042.stdout:8/36: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:41:34.822 INFO:tasks.workunit.client.0.smithi042.stdout:0/48: creat d2/fe x:0 0 0 2024-09-19T09:41:34.823 INFO:tasks.workunit.client.0.smithi042.stdout:0/49: dread - d2/fd zero size 2024-09-19T09:41:34.823 INFO:tasks.workunit.client.0.smithi042.stdout:3/58: mkdir d4/d8/d9/d12 0 2024-09-19T09:41:34.823 INFO:tasks.workunit.client.0.smithi042.stdout:6/36: mknod d1/c8 0 2024-09-19T09:41:34.823 INFO:tasks.workunit.client.0.smithi042.stdout:1/38: getdents d4/d5 0 2024-09-19T09:41:34.823 INFO:tasks.workunit.client.0.smithi042.stdout:6/37: chown d1/c8 24301 1 2024-09-19T09:41:34.823 INFO:tasks.workunit.client.0.smithi042.stdout:1/39: dread - d4/d5/f9 zero size 2024-09-19T09:41:34.823 INFO:tasks.workunit.client.0.smithi042.stdout:3/59: write d4/d8/fd [1036403,119067] 0 2024-09-19T09:41:34.824 INFO:tasks.workunit.client.0.smithi042.stdout:0/50: write f0 [138010,5589] 0 2024-09-19T09:41:34.824 INFO:tasks.workunit.client.0.smithi042.stdout:0/51: dread - d2/fc zero size 2024-09-19T09:41:34.824 INFO:tasks.workunit.client.0.smithi042.stdout:0/52: dread - d2/fd zero size 2024-09-19T09:41:34.826 INFO:tasks.workunit.client.0.smithi042.stdout:2/20: rename f0 to f4 0 2024-09-19T09:41:34.827 INFO:tasks.workunit.client.0.smithi042.stdout:6/38: mknod d1/c9 0 2024-09-19T09:41:34.827 INFO:tasks.workunit.client.0.smithi042.stdout:0/53: rename d2/f3 to d2/ff 0 2024-09-19T09:41:34.827 INFO:tasks.workunit.client.0.smithi042.stdout:2/21: chown l1 7823096 1 2024-09-19T09:41:34.827 INFO:tasks.workunit.client.0.smithi042.stdout:2/22: chown f2 73639277 1 2024-09-19T09:41:34.829 INFO:tasks.workunit.client.0.smithi042.stdout:0/54: mkdir d2/d10 0 2024-09-19T09:41:34.829 INFO:tasks.workunit.client.0.smithi042.stdout:9/24: dread f1 [0,4194304] 0 2024-09-19T09:41:34.829 INFO:tasks.workunit.client.0.smithi042.stdout:9/25: stat f5 0 2024-09-19T09:41:34.829 INFO:tasks.workunit.client.0.smithi042.stdout:9/26: truncate f5 811678 0 2024-09-19T09:41:34.830 INFO:tasks.workunit.client.0.smithi042.stdout:0/55: symlink d2/d10/l11 0 2024-09-19T09:41:34.830 INFO:tasks.workunit.client.0.smithi042.stdout:0/56: truncate f1 2247056 0 2024-09-19T09:41:34.831 INFO:tasks.workunit.client.0.smithi042.stdout:9/27: symlink l6 0 2024-09-19T09:41:34.831 INFO:tasks.workunit.client.0.smithi042.stdout:0/57: rmdir d2 39 2024-09-19T09:41:34.832 INFO:tasks.workunit.client.0.smithi042.stdout:2/23: mknod c5 0 2024-09-19T09:41:34.833 INFO:tasks.workunit.client.0.smithi042.stdout:9/28: rename l4 to l7 0 2024-09-19T09:41:34.834 INFO:tasks.workunit.client.0.smithi042.stdout:0/58: mkdir d2/d10/d12 0 2024-09-19T09:41:34.838 INFO:tasks.workunit.client.0.smithi042.stdout:8/37: write d1/f7 [1671188,97741] 0 2024-09-19T09:41:34.838 INFO:tasks.workunit.client.0.smithi042.stdout:8/38: write d1/f2 [2694055,101385] 0 2024-09-19T09:41:34.839 INFO:tasks.workunit.client.0.smithi042.stdout:3/60: truncate d4/d8/fd 204127 0 2024-09-19T09:41:34.841 INFO:tasks.workunit.client.0.smithi042.stdout:3/61: unlink d4/l7 0 2024-09-19T09:41:34.842 INFO:tasks.workunit.client.0.smithi042.stdout:9/29: write f2 [3505916,112060] 0 2024-09-19T09:41:34.843 INFO:tasks.workunit.client.0.smithi042.stdout:9/30: dread f5 [0,4194304] 0 2024-09-19T09:41:34.844 INFO:tasks.workunit.client.0.smithi042.stdout:9/31: dread f5 [0,4194304] 0 2024-09-19T09:41:34.845 INFO:tasks.workunit.client.0.smithi042.stdout:7/36: dwrite d0/fb [0,4194304] 0 2024-09-19T09:41:34.845 INFO:tasks.workunit.client.0.smithi042.stdout:7/37: chown d0/c8 212 1 2024-09-19T09:41:34.846 INFO:tasks.workunit.client.0.smithi042.stdout:9/32: mkdir d8 0 2024-09-19T09:41:34.846 INFO:tasks.workunit.client.0.smithi042.stdout:6/39: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:34.847 INFO:tasks.workunit.client.0.smithi042.stdout:2/24: write f2 [1651737,98408] 0 2024-09-19T09:41:34.847 INFO:tasks.workunit.client.0.smithi042.stdout:2/25: write f2 [789115,6574] 0 2024-09-19T09:41:34.849 INFO:tasks.workunit.client.0.smithi042.stdout:6/40: rmdir d1 39 2024-09-19T09:41:34.850 INFO:tasks.workunit.client.0.smithi042.stdout:6/41: write d1/f6 [1948681,123059] 0 2024-09-19T09:41:34.858 INFO:tasks.workunit.client.0.smithi042.stdout:0/59: dwrite d2/fd [0,4194304] 0 2024-09-19T09:41:34.858 INFO:tasks.workunit.client.0.smithi042.stdout:7/38: write d0/fb [3341886,12924] 0 2024-09-19T09:41:34.859 INFO:tasks.workunit.client.0.smithi042.stdout:0/60: getdents d2/d10 0 2024-09-19T09:41:34.860 INFO:tasks.workunit.client.0.smithi042.stdout:7/39: link d0/l2 d0/ld 0 2024-09-19T09:41:34.865 INFO:tasks.workunit.client.0.smithi042.stdout:0/61: creat d2/f13 x:0 0 0 2024-09-19T09:41:34.866 INFO:tasks.workunit.client.0.smithi042.stdout:0/62: rmdir d2/d10 39 2024-09-19T09:41:34.867 INFO:tasks.workunit.client.0.smithi042.stdout:0/63: rmdir d2/d10 39 2024-09-19T09:41:34.870 INFO:tasks.workunit.client.0.smithi042.stdout:5/43: dwrite d2/db/f10 [0,4194304] 0 2024-09-19T09:41:34.870 INFO:tasks.workunit.client.0.smithi042.stdout:5/44: write d2/f7 [3453272,52749] 0 2024-09-19T09:41:34.873 INFO:tasks.workunit.client.0.smithi042.stdout:3/62: dwrite d4/f11 [0,4194304] 0 2024-09-19T09:41:34.875 INFO:tasks.workunit.client.0.smithi042.stdout:3/63: creat d4/d8/d9/dc/f13 x:0 0 0 2024-09-19T09:41:34.877 INFO:tasks.workunit.client.0.smithi042.stdout:6/42: truncate d1/f6 1777954 0 2024-09-19T09:41:34.878 INFO:tasks.workunit.client.0.smithi042.stdout:6/43: mknod d1/ca 0 2024-09-19T09:41:34.880 INFO:tasks.workunit.client.0.smithi042.stdout:6/44: symlink d1/lb 0 2024-09-19T09:41:34.880 INFO:tasks.workunit.client.0.smithi042.stdout:6/45: readlink d1/lb 0 2024-09-19T09:41:34.880 INFO:tasks.workunit.client.0.smithi042.stdout:1/40: dwrite f1 [0,4194304] 0 2024-09-19T09:41:34.882 INFO:tasks.workunit.client.0.smithi042.stdout:1/41: mknod d4/d5/cd 0 2024-09-19T09:41:34.883 INFO:tasks.workunit.client.0.smithi042.stdout:9/33: dwrite f2 [4194304,4194304] 0 2024-09-19T09:41:34.883 INFO:tasks.workunit.client.0.smithi042.stdout:0/64: read d2/fd [3187096,36462] 0 2024-09-19T09:41:34.883 INFO:tasks.workunit.client.0.smithi042.stdout:1/42: link f1 d4/d5/fe 0 2024-09-19T09:41:34.885 INFO:tasks.workunit.client.0.smithi042.stdout:0/65: symlink d2/l14 0 2024-09-19T09:41:34.886 INFO:tasks.workunit.client.0.smithi042.stdout:3/64: getdents d4/d8/d9/dc 0 2024-09-19T09:41:34.888 INFO:tasks.workunit.client.0.smithi042.stdout:7/40: dwrite d0/f5 [0,4194304] 0 2024-09-19T09:41:34.888 INFO:tasks.workunit.client.0.smithi042.stdout:7/41: chown d0/f5 83 1 2024-09-19T09:41:34.889 INFO:tasks.workunit.client.0.smithi042.stdout:7/42: creat d0/fe x:0 0 0 2024-09-19T09:41:34.890 INFO:tasks.workunit.client.0.smithi042.stdout:8/39: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:41:34.890 INFO:tasks.workunit.client.0.smithi042.stdout:8/40: chown d1/f2 7 1 2024-09-19T09:41:34.893 INFO:tasks.workunit.client.0.smithi042.stdout:9/34: dread f2 [4194304,4194304] 0 2024-09-19T09:41:34.893 INFO:tasks.workunit.client.0.smithi042.stdout:8/41: creat d1/f8 x:0 0 0 2024-09-19T09:41:34.894 INFO:tasks.workunit.client.0.smithi042.stdout:5/45: dwrite d2/db/f10 [0,4194304] 0 2024-09-19T09:41:34.896 INFO:tasks.workunit.client.0.smithi042.stdout:3/65: dread d4/ff [0,4194304] 0 2024-09-19T09:41:34.899 INFO:tasks.workunit.client.0.smithi042.stdout:9/35: mknod d8/c9 0 2024-09-19T09:41:34.901 INFO:tasks.workunit.client.0.smithi042.stdout:7/43: getdents d0 0 2024-09-19T09:41:34.901 INFO:tasks.workunit.client.0.smithi042.stdout:0/66: dwrite d2/f13 [0,4194304] 0 2024-09-19T09:41:34.904 INFO:tasks.workunit.client.0.smithi042.stdout:8/42: link d1/f7 d1/f9 0 2024-09-19T09:41:34.908 INFO:tasks.workunit.client.0.smithi042.stdout:3/66: unlink c2 0 2024-09-19T09:41:34.909 INFO:tasks.workunit.client.0.smithi042.stdout:9/36: mkdir d8/da 0 2024-09-19T09:41:34.909 INFO:tasks.workunit.client.0.smithi042.stdout:9/37: chown d8/da 40119938 1 2024-09-19T09:41:34.909 INFO:tasks.workunit.client.0.smithi042.stdout:9/38: read f1 [2121318,90208] 0 2024-09-19T09:41:34.910 INFO:tasks.workunit.client.0.smithi042.stdout:6/46: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:41:34.910 INFO:tasks.workunit.client.0.smithi042.stdout:6/47: chown d1/c7 63 1 2024-09-19T09:41:34.910 INFO:tasks.workunit.client.0.smithi042.stdout:7/44: symlink d0/lf 0 2024-09-19T09:41:34.912 INFO:tasks.workunit.client.0.smithi042.stdout:0/67: creat d2/d10/f15 x:0 0 0 2024-09-19T09:41:34.912 INFO:tasks.workunit.client.0.smithi042.stdout:0/68: dread - d2/d10/f15 zero size 2024-09-19T09:41:34.912 INFO:tasks.workunit.client.0.smithi042.stdout:0/69: fsync d2/fb 0 2024-09-19T09:41:34.912 INFO:tasks.workunit.client.0.smithi042.stdout:0/70: chown d2/fe 1101 1 2024-09-19T09:41:34.913 INFO:tasks.workunit.client.0.smithi042.stdout:5/46: mkdir d2/db/df/d11 0 2024-09-19T09:41:34.913 INFO:tasks.workunit.client.0.smithi042.stdout:5/47: stat d2/d4/d9 0 2024-09-19T09:41:34.913 INFO:tasks.workunit.client.0.smithi042.stdout:3/67: mknod d4/d8/d9/d12/c14 0 2024-09-19T09:41:34.915 INFO:tasks.workunit.client.0.smithi042.stdout:9/39: mkdir d8/db 0 2024-09-19T09:41:34.916 INFO:tasks.workunit.client.0.smithi042.stdout:6/48: getdents d1 0 2024-09-19T09:41:34.916 INFO:tasks.workunit.client.0.smithi042.stdout:6/49: stat d1/c7 0 2024-09-19T09:41:34.917 INFO:tasks.workunit.client.0.smithi042.stdout:7/45: getdents d0 0 2024-09-19T09:41:34.919 INFO:tasks.workunit.client.0.smithi042.stdout:0/71: unlink d2/f9 0 2024-09-19T09:41:34.919 INFO:tasks.workunit.client.0.smithi042.stdout:0/72: dread - d2/fa zero size 2024-09-19T09:41:34.919 INFO:tasks.workunit.client.0.smithi042.stdout:0/73: chown d2/fe 32774648 1 2024-09-19T09:41:34.919 INFO:tasks.workunit.client.0.smithi042.stdout:8/43: truncate d1/f7 522332 0 2024-09-19T09:41:34.919 INFO:tasks.workunit.client.0.smithi042.stdout:8/44: dread - d1/f8 zero size 2024-09-19T09:41:34.920 INFO:tasks.workunit.client.0.smithi042.stdout:5/48: rename d2 to d2/db/d12 22 2024-09-19T09:41:34.920 INFO:tasks.workunit.client.0.smithi042.stdout:3/68: mknod d4/c15 0 2024-09-19T09:41:34.921 INFO:tasks.workunit.client.0.smithi042.stdout:9/40: symlink d8/da/lc 0 2024-09-19T09:41:34.923 INFO:tasks.workunit.client.0.smithi042.stdout:2/26: truncate f4 98649 0 2024-09-19T09:41:34.923 INFO:tasks.workunit.client.0.smithi042.stdout:6/50: creat d1/fc x:0 0 0 2024-09-19T09:41:34.923 INFO:tasks.workunit.client.0.smithi042.stdout:6/51: dread - d1/fc zero size 2024-09-19T09:41:34.924 INFO:tasks.workunit.client.0.smithi042.stdout:0/74: mkdir d2/d10/d12/d16 0 2024-09-19T09:41:34.929 INFO:tasks.workunit.client.0.smithi042.stdout:3/69: symlink d4/d8/d9/l16 0 2024-09-19T09:41:34.929 INFO:tasks.workunit.client.0.smithi042.stdout:3/70: chown d4/d8 118120 1 2024-09-19T09:41:34.930 INFO:tasks.workunit.client.0.smithi042.stdout:3/71: fdatasync d4/d8/fd 0 2024-09-19T09:41:34.930 INFO:tasks.workunit.client.0.smithi042.stdout:0/75: mknod d2/d10/d12/d16/c17 0 2024-09-19T09:41:34.930 INFO:tasks.workunit.client.0.smithi042.stdout:8/45: dread d1/f9 [0,4194304] 0 2024-09-19T09:41:34.930 INFO:tasks.workunit.client.0.smithi042.stdout:5/49: symlink d2/db/l13 0 2024-09-19T09:41:34.930 INFO:tasks.workunit.client.0.smithi042.stdout:3/72: rename d4/d8/fd to d4/d8/d9/f17 0 2024-09-19T09:41:34.930 INFO:tasks.workunit.client.0.smithi042.stdout:3/73: write d4/d8/d9/dc/f13 [212009,130839] 0 2024-09-19T09:41:34.930 INFO:tasks.workunit.client.0.smithi042.stdout:8/46: mkdir d1/da 0 2024-09-19T09:41:34.932 INFO:tasks.workunit.client.0.smithi042.stdout:5/50: truncate d2/d4/fa 2573385 0 2024-09-19T09:41:34.933 INFO:tasks.workunit.client.0.smithi042.stdout:3/74: symlink d4/l18 0 2024-09-19T09:41:34.934 INFO:tasks.workunit.client.0.smithi042.stdout:8/47: symlink d1/da/lb 0 2024-09-19T09:41:34.935 INFO:tasks.workunit.client.0.smithi042.stdout:8/48: write d1/f8 [345460,77682] 0 2024-09-19T09:41:34.935 INFO:tasks.workunit.client.0.smithi042.stdout:5/51: rename l0 to d2/db/df/d11/l14 0 2024-09-19T09:41:34.936 INFO:tasks.workunit.client.0.smithi042.stdout:3/75: rmdir d4 39 2024-09-19T09:41:34.939 INFO:tasks.workunit.client.0.smithi042.stdout:5/52: truncate d2/f7 1284953 0 2024-09-19T09:41:34.943 INFO:tasks.workunit.client.0.smithi042.stdout:3/76: creat d4/d8/f19 x:0 0 0 2024-09-19T09:41:34.945 INFO:tasks.workunit.client.0.smithi042.stdout:3/77: creat d4/d8/d9/d12/f1a x:0 0 0 2024-09-19T09:41:34.946 INFO:tasks.workunit.client.0.smithi042.stdout:3/78: write d4/d8/d9/d12/f1a [833754,102638] 0 2024-09-19T09:41:34.946 INFO:tasks.workunit.client.0.smithi042.stdout:5/53: dread d2/db/f10 [0,4194304] 0 2024-09-19T09:41:34.946 INFO:tasks.workunit.client.0.smithi042.stdout:5/54: fsync d2/d4/fa 0 2024-09-19T09:41:34.948 INFO:tasks.workunit.client.0.smithi042.stdout:3/79: mkdir d4/d8/d9/d1b 0 2024-09-19T09:41:34.949 INFO:tasks.workunit.client.0.smithi042.stdout:5/55: dread d2/db/f10 [0,4194304] 0 2024-09-19T09:41:34.950 INFO:tasks.workunit.client.0.smithi042.stdout:3/80: creat d4/d8/f1c x:0 0 0 2024-09-19T09:41:34.954 INFO:tasks.workunit.client.0.smithi042.stdout:6/52: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:41:34.955 INFO:tasks.workunit.client.0.smithi042.stdout:6/53: readlink d1/lb 0 2024-09-19T09:41:34.956 INFO:tasks.workunit.client.0.smithi042.stdout:6/54: mknod d1/cd 0 2024-09-19T09:41:34.957 INFO:tasks.workunit.client.0.smithi042.stdout:6/55: mkdir d1/de 0 2024-09-19T09:41:34.958 INFO:tasks.workunit.client.0.smithi042.stdout:6/56: chown d1/c7 1 1 2024-09-19T09:41:34.958 INFO:tasks.workunit.client.0.smithi042.stdout:6/57: mknod d1/de/cf 0 2024-09-19T09:41:34.958 INFO:tasks.workunit.client.0.smithi042.stdout:6/58: chown d1/fc 11054681 1 2024-09-19T09:41:34.963 INFO:tasks.workunit.client.0.smithi042.stdout:2/27: dwrite f4 [0,4194304] 0 2024-09-19T09:41:34.963 INFO:tasks.workunit.client.0.smithi042.stdout:9/41: dwrite f1 [0,4194304] 0 2024-09-19T09:41:34.963 INFO:tasks.workunit.client.0.smithi042.stdout:0/76: dwrite d2/d10/f15 [0,4194304] 0 2024-09-19T09:41:34.966 INFO:tasks.workunit.client.0.smithi042.stdout:6/59: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:34.966 INFO:tasks.workunit.client.0.smithi042.stdout:6/60: fsync d1/f6 0 2024-09-19T09:41:34.969 INFO:tasks.workunit.client.0.smithi042.stdout:9/42: mkdir d8/db/dd 0 2024-09-19T09:41:34.969 INFO:tasks.workunit.client.0.smithi042.stdout:0/77: mkdir d2/d10/d12/d16/d18 0 2024-09-19T09:41:34.970 INFO:tasks.workunit.client.0.smithi042.stdout:9/43: chown f2 2350 1 2024-09-19T09:41:34.970 INFO:tasks.workunit.client.0.smithi042.stdout:3/81: getdents d4/d8 0 2024-09-19T09:41:34.970 INFO:tasks.workunit.client.0.smithi042.stdout:3/82: symlink d4/d8/d9/l1d 0 2024-09-19T09:41:34.971 INFO:tasks.workunit.client.0.smithi042.stdout:6/61: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:34.972 INFO:tasks.workunit.client.0.smithi042.stdout:3/83: creat d4/d8/d9/f1e x:0 0 0 2024-09-19T09:41:34.974 INFO:tasks.workunit.client.0.smithi042.stdout:3/84: symlink d4/d8/d9/l1f 0 2024-09-19T09:41:34.982 INFO:tasks.workunit.client.0.smithi042.stdout:0/78: write d2/d10/f15 [1769057,70793] 0 2024-09-19T09:41:34.982 INFO:tasks.workunit.client.0.smithi042.stdout:0/79: write f0 [1268143,40116] 0 2024-09-19T09:41:34.982 INFO:tasks.workunit.client.0.smithi042.stdout:0/80: chown d2/c7 866213136 1 2024-09-19T09:41:34.983 INFO:tasks.workunit.client.0.smithi042.stdout:9/44: dread f1 [0,4194304] 0 2024-09-19T09:41:34.983 INFO:tasks.workunit.client.0.smithi042.stdout:0/81: mkdir d2/d10/d12/d19 0 2024-09-19T09:41:34.983 INFO:tasks.workunit.client.0.smithi042.stdout:0/82: chown d2/l14 5688671 1 2024-09-19T09:41:34.983 INFO:tasks.workunit.client.0.smithi042.stdout:0/83: readlink d2/l14 0 2024-09-19T09:41:34.984 INFO:tasks.workunit.client.0.smithi042.stdout:0/84: write d2/fc [519736,15341] 0 2024-09-19T09:41:34.984 INFO:tasks.workunit.client.0.smithi042.stdout:9/45: unlink l7 0 2024-09-19T09:41:34.984 INFO:tasks.workunit.client.0.smithi042.stdout:0/85: mknod d2/d10/d12/d16/d18/c1a 0 2024-09-19T09:41:34.985 INFO:tasks.workunit.client.0.smithi042.stdout:6/62: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:34.985 INFO:tasks.workunit.client.0.smithi042.stdout:9/46: creat d8/fe x:0 0 0 2024-09-19T09:41:34.985 INFO:tasks.workunit.client.0.smithi042.stdout:0/86: read d2/fc [150926,120337] 0 2024-09-19T09:41:34.986 INFO:tasks.workunit.client.0.smithi042.stdout:0/87: creat d2/d10/f1b x:0 0 0 2024-09-19T09:41:34.987 INFO:tasks.workunit.client.0.smithi042.stdout:6/63: rename d1/lb to d1/l10 0 2024-09-19T09:41:34.987 INFO:tasks.workunit.client.0.smithi042.stdout:6/64: dread - d1/fc zero size 2024-09-19T09:41:34.988 INFO:tasks.workunit.client.0.smithi042.stdout:6/65: symlink d1/de/l11 0 2024-09-19T09:41:34.988 INFO:tasks.workunit.client.0.smithi042.stdout:2/28: dwrite f2 [4194304,4194304] 0 2024-09-19T09:41:34.988 INFO:tasks.workunit.client.0.smithi042.stdout:2/29: fdatasync f4 0 2024-09-19T09:41:35.004 INFO:tasks.workunit.client.0.smithi042.stdout:3/85: dwrite d4/d8/f1c [0,4194304] 0 2024-09-19T09:41:35.006 INFO:tasks.workunit.client.0.smithi042.stdout:3/86: creat d4/d8/f20 x:0 0 0 2024-09-19T09:41:35.013 INFO:tasks.workunit.client.0.smithi042.stdout:3/87: write d4/d8/f1c [3059898,112955] 0 2024-09-19T09:41:35.014 INFO:tasks.workunit.client.0.smithi042.stdout:9/47: dwrite f1 [0,4194304] 0 2024-09-19T09:41:35.014 INFO:tasks.workunit.client.0.smithi042.stdout:6/66: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:41:35.017 INFO:tasks.workunit.client.0.smithi042.stdout:6/67: mkdir d1/de/d12 0 2024-09-19T09:41:35.024 INFO:tasks.workunit.client.0.smithi042.stdout:2/30: dwrite f4 [0,4194304] 0 2024-09-19T09:41:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:9/48: dread f1 [0,4194304] 0 2024-09-19T09:41:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:9/49: rename d8/db/dd to d8/db/dd/df 22 2024-09-19T09:41:35.032 INFO:tasks.workunit.client.0.smithi042.stdout:6/68: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:35.032 INFO:tasks.workunit.client.0.smithi042.stdout:9/50: creat d8/da/f10 x:0 0 0 2024-09-19T09:41:35.032 INFO:tasks.workunit.client.0.smithi042.stdout:6/69: write d1/f6 [4832637,82525] 0 2024-09-19T09:41:35.033 INFO:tasks.workunit.client.0.smithi042.stdout:2/31: dread f2 [4194304,4194304] 0 2024-09-19T09:41:35.033 INFO:tasks.workunit.client.0.smithi042.stdout:2/32: fsync f2 0 2024-09-19T09:41:35.033 INFO:tasks.workunit.client.0.smithi042.stdout:9/51: rename f2 to d8/f11 0 2024-09-19T09:41:35.034 INFO:tasks.workunit.client.0.smithi042.stdout:9/52: rmdir d8/db/dd 0 2024-09-19T09:41:35.036 INFO:tasks.workunit.client.0.smithi042.stdout:9/53: rename d8/da/lc to d8/db/l12 0 2024-09-19T09:41:35.036 INFO:tasks.workunit.client.0.smithi042.stdout:3/88: dwrite d4/d8/f1c [4194304,4194304] 0 2024-09-19T09:41:35.036 INFO:tasks.workunit.client.0.smithi042.stdout:3/89: write f0 [2999876,35590] 0 2024-09-19T09:41:35.037 INFO:tasks.workunit.client.0.smithi042.stdout:9/54: rmdir d8/da 39 2024-09-19T09:41:35.037 INFO:tasks.workunit.client.0.smithi042.stdout:9/55: write d8/f11 [3301514,20027] 0 2024-09-19T09:41:35.037 INFO:tasks.workunit.client.0.smithi042.stdout:9/56: stat d8/da/f10 0 2024-09-19T09:41:35.041 INFO:tasks.workunit.client.0.smithi042.stdout:3/90: mknod d4/d8/c21 0 2024-09-19T09:41:35.041 INFO:tasks.workunit.client.0.smithi042.stdout:3/91: read - d4/d8/d9/f1e zero size 2024-09-19T09:41:35.043 INFO:tasks.workunit.client.0.smithi042.stdout:3/92: mknod d4/d8/d9/d1b/c22 0 2024-09-19T09:41:35.044 INFO:tasks.workunit.client.0.smithi042.stdout:2/33: rename f4 to f6 0 2024-09-19T09:41:35.046 INFO:tasks.workunit.client.0.smithi042.stdout:2/34: mkdir d7 0 2024-09-19T09:41:35.056 INFO:tasks.workunit.client.0.smithi042.stdout:9/57: dwrite d8/fe [0,4194304] 0 2024-09-19T09:41:35.060 INFO:tasks.workunit.client.0.smithi042.stdout:9/58: truncate d8/f11 2154356 0 2024-09-19T09:41:35.061 INFO:tasks.workunit.client.0.smithi042.stdout:9/59: symlink d8/db/l13 0 2024-09-19T09:41:35.061 INFO:tasks.workunit.client.0.smithi042.stdout:9/60: mknod d8/da/c14 0 2024-09-19T09:41:35.062 INFO:tasks.workunit.client.0.smithi042.stdout:9/61: write d8/da/f10 [201327,90480] 0 2024-09-19T09:41:35.066 INFO:tasks.workunit.client.0.smithi042.stdout:9/62: dread d8/da/f10 [0,4194304] 0 2024-09-19T09:41:35.066 INFO:tasks.workunit.client.0.smithi042.stdout:9/63: write f5 [1835932,2020] 0 2024-09-19T09:41:35.067 INFO:tasks.workunit.client.0.smithi042.stdout:3/93: dwrite f0 [0,4194304] 0 2024-09-19T09:41:35.067 INFO:tasks.workunit.client.0.smithi042.stdout:3/94: rename d4/d8 to d4/d8/d9/dc/d23 22 2024-09-19T09:41:35.067 INFO:tasks.workunit.client.0.smithi042.stdout:9/64: creat d8/f15 x:0 0 0 2024-09-19T09:41:35.067 INFO:tasks.workunit.client.0.smithi042.stdout:9/65: dread - d8/f15 zero size 2024-09-19T09:41:35.068 INFO:tasks.workunit.client.0.smithi042.stdout:3/95: mknod d4/c24 0 2024-09-19T09:41:35.070 INFO:tasks.workunit.client.0.smithi042.stdout:9/66: rename d8/da/c14 to d8/c16 0 2024-09-19T09:41:35.075 INFO:tasks.workunit.client.0.smithi042.stdout:9/67: dread f1 [0,4194304] 0 2024-09-19T09:41:35.075 INFO:tasks.workunit.client.0.smithi042.stdout:9/68: readlink d8/db/l12 0 2024-09-19T09:41:35.100 INFO:tasks.workunit.client.0.smithi042.stdout:9/69: dwrite d8/f11 [0,4194304] 0 2024-09-19T09:41:35.100 INFO:tasks.workunit.client.0.smithi042.stdout:9/70: write d8/f15 [855326,34169] 0 2024-09-19T09:41:35.104 INFO:tasks.workunit.client.0.smithi042.stdout:9/71: truncate d8/f15 421967 0 2024-09-19T09:41:35.105 INFO:tasks.workunit.client.0.smithi042.stdout:9/72: unlink l6 0 2024-09-19T09:41:35.107 INFO:tasks.workunit.client.0.smithi042.stdout:9/73: fsync d8/f15 0 2024-09-19T09:41:35.108 INFO:tasks.workunit.client.0.smithi042.stdout:9/74: rmdir d8/db 39 2024-09-19T09:41:35.612 INFO:tasks.workunit.client.0.smithi042.stdout:2/35: dread f6 [0,4194304] 0 2024-09-19T09:41:35.631 INFO:tasks.workunit.client.0.smithi042.stdout:2/36: dwrite f2 [0,4194304] 0 2024-09-19T09:41:35.631 INFO:tasks.workunit.client.0.smithi042.stdout:2/37: creat d7/f8 x:0 0 0 2024-09-19T09:41:35.641 INFO:tasks.workunit.client.0.smithi042.stdout:2/38: write f2 [3173321,85142] 0 2024-09-19T09:41:35.641 INFO:tasks.workunit.client.0.smithi042.stdout:2/39: chown f2 67472 1 2024-09-19T09:41:35.665 INFO:tasks.workunit.client.0.smithi042.stdout:2/40: dwrite f6 [0,4194304] 0 2024-09-19T09:41:35.688 INFO:tasks.workunit.client.0.smithi042.stdout:2/41: dwrite f2 [4194304,4194304] 0 2024-09-19T09:41:35.705 INFO:tasks.workunit.client.0.smithi042.stdout:2/42: dwrite f2 [0,4194304] 0 2024-09-19T09:41:35.705 INFO:tasks.workunit.client.0.smithi042.stdout:2/43: stat d7 0 2024-09-19T09:41:35.730 INFO:tasks.workunit.client.0.smithi042.stdout:2/44: dwrite f6 [0,4194304] 0 2024-09-19T09:41:35.736 INFO:tasks.workunit.client.0.smithi042.stdout:2/45: write f6 [206174,64490] 0 2024-09-19T09:41:35.753 INFO:tasks.workunit.client.0.smithi042.stdout:2/46: dwrite f2 [0,4194304] 0 2024-09-19T09:41:35.753 INFO:tasks.workunit.client.0.smithi042.stdout:2/47: stat d7/f8 0 2024-09-19T09:41:35.753 INFO:tasks.workunit.client.0.smithi042.stdout:2/48: fsync f2 0 2024-09-19T09:41:35.754 INFO:tasks.workunit.client.0.smithi042.stdout:2/49: creat d7/f9 x:0 0 0 2024-09-19T09:41:35.755 INFO:tasks.workunit.client.0.smithi042.stdout:2/50: creat d7/fa x:0 0 0 2024-09-19T09:41:35.767 INFO:tasks.workunit.client.0.smithi042.stdout:2/51: dread f6 [0,4194304] 0 2024-09-19T09:41:35.768 INFO:tasks.workunit.client.0.smithi042.stdout:2/52: symlink d7/lb 0 2024-09-19T09:41:35.896 INFO:tasks.workunit.client.0.smithi042.stdout:4/43: sync 2024-09-19T09:41:35.896 INFO:tasks.workunit.client.0.smithi042.stdout:1/43: sync 2024-09-19T09:41:35.896 INFO:tasks.workunit.client.0.smithi042.stdout:7/46: sync 2024-09-19T09:41:35.896 INFO:tasks.workunit.client.0.smithi042.stdout:1/44: chown d4/d5/fe 2084212975 1 2024-09-19T09:41:35.901 INFO:tasks.workunit.client.0.smithi042.stdout:4/44: symlink d0/l11 0 2024-09-19T09:41:35.901 INFO:tasks.workunit.client.0.smithi042.stdout:4/45: chown d0/fc 454410772 1 2024-09-19T09:41:35.901 INFO:tasks.workunit.client.0.smithi042.stdout:7/47: mknod d0/c10 0 2024-09-19T09:41:35.901 INFO:tasks.workunit.client.0.smithi042.stdout:7/48: write d0/f6 [3608268,14763] 0 2024-09-19T09:41:35.901 INFO:tasks.workunit.client.0.smithi042.stdout:7/49: chown d0/fb 31948869 1 2024-09-19T09:41:35.903 INFO:tasks.workunit.client.0.smithi042.stdout:7/50: creat d0/f11 x:0 0 0 2024-09-19T09:41:35.903 INFO:tasks.workunit.client.0.smithi042.stdout:4/46: symlink d0/l12 0 2024-09-19T09:41:35.904 INFO:tasks.workunit.client.0.smithi042.stdout:7/51: creat d0/f12 x:0 0 0 2024-09-19T09:41:35.904 INFO:tasks.workunit.client.0.smithi042.stdout:7/52: stat d0 0 2024-09-19T09:41:35.905 INFO:tasks.workunit.client.0.smithi042.stdout:4/47: unlink d0/l11 0 2024-09-19T09:41:35.905 INFO:tasks.workunit.client.0.smithi042.stdout:4/48: fsync d0/f7 0 2024-09-19T09:41:35.905 INFO:tasks.workunit.client.0.smithi042.stdout:4/49: write d0/fe [772673,52884] 0 2024-09-19T09:41:35.906 INFO:tasks.workunit.client.0.smithi042.stdout:4/50: fsync d0/f10 0 2024-09-19T09:41:35.906 INFO:tasks.workunit.client.0.smithi042.stdout:7/53: creat d0/f13 x:0 0 0 2024-09-19T09:41:35.906 INFO:tasks.workunit.client.0.smithi042.stdout:7/54: write d0/f11 [511177,44902] 0 2024-09-19T09:41:35.907 INFO:tasks.workunit.client.0.smithi042.stdout:4/51: mknod d0/c13 0 2024-09-19T09:41:35.908 INFO:tasks.workunit.client.0.smithi042.stdout:7/55: mkdir d0/d14 0 2024-09-19T09:41:35.909 INFO:tasks.workunit.client.0.smithi042.stdout:7/56: rename d0/f11 to d0/d14/f15 0 2024-09-19T09:41:35.910 INFO:tasks.workunit.client.0.smithi042.stdout:4/52: rename d0/f10 to d0/f14 0 2024-09-19T09:41:35.910 INFO:tasks.workunit.client.0.smithi042.stdout:4/53: chown d0/l8 0 1 2024-09-19T09:41:35.911 INFO:tasks.workunit.client.0.smithi042.stdout:4/54: creat d0/f15 x:0 0 0 2024-09-19T09:41:35.913 INFO:tasks.workunit.client.0.smithi042.stdout:7/57: link d0/c9 d0/c16 0 2024-09-19T09:41:35.913 INFO:tasks.workunit.client.0.smithi042.stdout:4/55: rmdir d0 39 2024-09-19T09:41:35.914 INFO:tasks.workunit.client.0.smithi042.stdout:7/58: creat d0/f17 x:0 0 0 2024-09-19T09:41:35.915 INFO:tasks.workunit.client.0.smithi042.stdout:7/59: mkdir d0/d14/d18 0 2024-09-19T09:41:35.915 INFO:tasks.workunit.client.0.smithi042.stdout:7/60: getdents d0/d14/d18 0 2024-09-19T09:41:35.916 INFO:tasks.workunit.client.0.smithi042.stdout:4/56: rename d0/f7 to d0/f16 0 2024-09-19T09:41:35.917 INFO:tasks.workunit.client.0.smithi042.stdout:1/45: dwrite d4/fa [0,4194304] 0 2024-09-19T09:41:35.918 INFO:tasks.workunit.client.0.smithi042.stdout:1/46: write d4/d5/f9 [118328,125759] 0 2024-09-19T09:41:35.918 INFO:tasks.workunit.client.0.smithi042.stdout:1/47: fsync d4/fa 0 2024-09-19T09:41:35.918 INFO:tasks.workunit.client.0.smithi042.stdout:1/48: dread - d4/d5/fc zero size 2024-09-19T09:41:35.919 INFO:tasks.workunit.client.0.smithi042.stdout:1/49: creat d4/d5/ff x:0 0 0 2024-09-19T09:41:35.927 INFO:tasks.workunit.client.0.smithi042.stdout:7/61: link d0/d14/f15 d0/d14/d18/f19 0 2024-09-19T09:41:35.929 INFO:tasks.workunit.client.0.smithi042.stdout:1/50: dread f1 [0,4194304] 0 2024-09-19T09:41:35.930 INFO:tasks.workunit.client.0.smithi042.stdout:1/51: creat d4/f10 x:0 0 0 2024-09-19T09:41:35.930 INFO:tasks.workunit.client.0.smithi042.stdout:1/52: chown d4/f10 1379 1 2024-09-19T09:41:35.931 INFO:tasks.workunit.client.0.smithi042.stdout:1/53: mknod d4/c11 0 2024-09-19T09:41:35.931 INFO:tasks.workunit.client.0.smithi042.stdout:1/54: chown d4/c11 10914 1 2024-09-19T09:41:35.937 INFO:tasks.workunit.client.0.smithi042.stdout:4/57: dwrite d0/fc [0,4194304] 0 2024-09-19T09:41:35.939 INFO:tasks.workunit.client.0.smithi042.stdout:1/55: dread d4/d5/fe [0,4194304] 0 2024-09-19T09:41:35.940 INFO:tasks.workunit.client.0.smithi042.stdout:1/56: chown f1 35 1 2024-09-19T09:41:35.940 INFO:tasks.workunit.client.0.smithi042.stdout:1/57: fdatasync d4/fb 0 2024-09-19T09:41:35.940 INFO:tasks.workunit.client.0.smithi042.stdout:4/58: creat d0/f17 x:0 0 0 2024-09-19T09:41:35.940 INFO:tasks.workunit.client.0.smithi042.stdout:1/58: mkdir d4/d12 0 2024-09-19T09:41:35.940 INFO:tasks.workunit.client.0.smithi042.stdout:1/59: getdents d4/d12 0 2024-09-19T09:41:35.941 INFO:tasks.workunit.client.0.smithi042.stdout:1/60: creat d4/f13 x:0 0 0 2024-09-19T09:41:35.941 INFO:tasks.workunit.client.0.smithi042.stdout:1/61: chown d4/d5/ff 3178 1 2024-09-19T09:41:35.941 INFO:tasks.workunit.client.0.smithi042.stdout:1/62: chown d4/d12 112 1 2024-09-19T09:41:35.942 INFO:tasks.workunit.client.0.smithi042.stdout:1/63: write d4/f13 [980113,54630] 0 2024-09-19T09:41:35.942 INFO:tasks.workunit.client.0.smithi042.stdout:1/64: truncate d4/d5/ff 416133 0 2024-09-19T09:41:35.942 INFO:tasks.workunit.client.0.smithi042.stdout:1/65: creat d4/f14 x:0 0 0 2024-09-19T09:41:35.946 INFO:tasks.workunit.client.0.smithi042.stdout:0/88: sync 2024-09-19T09:41:35.946 INFO:tasks.workunit.client.0.smithi042.stdout:5/56: sync 2024-09-19T09:41:35.946 INFO:tasks.workunit.client.0.smithi042.stdout:9/75: sync 2024-09-19T09:41:35.946 INFO:tasks.workunit.client.0.smithi042.stdout:2/53: sync 2024-09-19T09:41:35.946 INFO:tasks.workunit.client.0.smithi042.stdout:3/96: sync 2024-09-19T09:41:35.946 INFO:tasks.workunit.client.0.smithi042.stdout:6/70: sync 2024-09-19T09:41:35.947 INFO:tasks.workunit.client.0.smithi042.stdout:8/49: sync 2024-09-19T09:41:35.947 INFO:tasks.workunit.client.0.smithi042.stdout:0/89: rmdir d2/d10/d12 39 2024-09-19T09:41:35.948 INFO:tasks.workunit.client.0.smithi042.stdout:1/66: read f1 [3019420,34726] 0 2024-09-19T09:41:35.948 INFO:tasks.workunit.client.0.smithi042.stdout:1/67: chown d4/f14 122 1 2024-09-19T09:41:35.948 INFO:tasks.workunit.client.0.smithi042.stdout:1/68: fdatasync d4/d5/ff 0 2024-09-19T09:41:35.948 INFO:tasks.workunit.client.0.smithi042.stdout:1/69: dread - d4/f10 zero size 2024-09-19T09:41:35.948 INFO:tasks.workunit.client.0.smithi042.stdout:5/57: getdents d2 0 2024-09-19T09:41:35.948 INFO:tasks.workunit.client.0.smithi042.stdout:9/76: mkdir d8/da/d17 0 2024-09-19T09:41:35.949 INFO:tasks.workunit.client.0.smithi042.stdout:3/97: mknod d4/c25 0 2024-09-19T09:41:35.950 INFO:tasks.workunit.client.0.smithi042.stdout:0/90: creat d2/f1c x:0 0 0 2024-09-19T09:41:35.951 INFO:tasks.workunit.client.0.smithi042.stdout:1/70: mkdir d4/d15 0 2024-09-19T09:41:35.952 INFO:tasks.workunit.client.0.smithi042.stdout:5/58: rmdir d2/d4/d9 0 2024-09-19T09:41:35.952 INFO:tasks.workunit.client.0.smithi042.stdout:5/59: fsync d2/db/f10 0 2024-09-19T09:41:35.952 INFO:tasks.workunit.client.0.smithi042.stdout:7/62: dwrite d0/f5 [0,4194304] 0 2024-09-19T09:41:35.952 INFO:tasks.workunit.client.0.smithi042.stdout:6/71: link d1/c7 d1/c13 0 2024-09-19T09:41:35.954 INFO:tasks.workunit.client.0.smithi042.stdout:3/98: mkdir d4/d8/d9/dc/d26 0 2024-09-19T09:41:35.955 INFO:tasks.workunit.client.0.smithi042.stdout:0/91: mkdir d2/d10/d1d 0 2024-09-19T09:41:35.956 INFO:tasks.workunit.client.0.smithi042.stdout:1/71: truncate d4/fa 1827986 0 2024-09-19T09:41:35.956 INFO:tasks.workunit.client.0.smithi042.stdout:1/72: dread - d4/f14 zero size 2024-09-19T09:41:35.957 INFO:tasks.workunit.client.0.smithi042.stdout:1/73: read - d4/fb zero size 2024-09-19T09:41:35.958 INFO:tasks.workunit.client.0.smithi042.stdout:7/63: truncate d0/fa 2247438 0 2024-09-19T09:41:35.959 INFO:tasks.workunit.client.0.smithi042.stdout:6/72: unlink d1/de/l11 0 2024-09-19T09:41:35.960 INFO:tasks.workunit.client.0.smithi042.stdout:0/92: mkdir d2/d10/d1e 0 2024-09-19T09:41:35.961 INFO:tasks.workunit.client.0.smithi042.stdout:1/74: creat d4/d5/f16 x:0 0 0 2024-09-19T09:41:35.961 INFO:tasks.workunit.client.0.smithi042.stdout:1/75: fdatasync d4/fb 0 2024-09-19T09:41:35.962 INFO:tasks.workunit.client.0.smithi042.stdout:3/99: write d4/d8/f1c [4297037,120872] 0 2024-09-19T09:41:35.962 INFO:tasks.workunit.client.0.smithi042.stdout:2/54: truncate f6 3902151 0 2024-09-19T09:41:35.962 INFO:tasks.workunit.client.0.smithi042.stdout:2/55: dread - d7/f9 zero size 2024-09-19T09:41:35.962 INFO:tasks.workunit.client.0.smithi042.stdout:2/56: stat c5 0 2024-09-19T09:41:35.962 INFO:tasks.workunit.client.0.smithi042.stdout:2/57: dread - d7/f9 zero size 2024-09-19T09:41:35.963 INFO:tasks.workunit.client.0.smithi042.stdout:2/58: truncate d7/fa 980796 0 2024-09-19T09:41:35.963 INFO:tasks.workunit.client.0.smithi042.stdout:7/64: creat d0/f1a x:0 0 0 2024-09-19T09:41:35.964 INFO:tasks.workunit.client.0.smithi042.stdout:3/100: creat d4/d8/d9/dc/d26/f27 x:0 0 0 2024-09-19T09:41:35.965 INFO:tasks.workunit.client.0.smithi042.stdout:2/59: rename l1 to d7/lc 0 2024-09-19T09:41:35.965 INFO:tasks.workunit.client.0.smithi042.stdout:7/65: unlink d0/d14/d18/f19 0 2024-09-19T09:41:35.966 INFO:tasks.workunit.client.0.smithi042.stdout:2/60: mkdir d7/dd 0 2024-09-19T09:41:35.966 INFO:tasks.workunit.client.0.smithi042.stdout:6/73: rename d1/l10 to d1/l14 0 2024-09-19T09:41:35.967 INFO:tasks.workunit.client.0.smithi042.stdout:3/101: symlink d4/d8/d9/l28 0 2024-09-19T09:41:35.967 INFO:tasks.workunit.client.0.smithi042.stdout:2/61: creat d7/fe x:0 0 0 2024-09-19T09:41:35.968 INFO:tasks.workunit.client.0.smithi042.stdout:2/62: dread d7/fa [0,4194304] 0 2024-09-19T09:41:35.968 INFO:tasks.workunit.client.0.smithi042.stdout:6/74: mkdir d1/de/d15 0 2024-09-19T09:41:35.969 INFO:tasks.workunit.client.0.smithi042.stdout:7/66: read d0/d14/f15 [366504,96383] 0 2024-09-19T09:41:35.969 INFO:tasks.workunit.client.0.smithi042.stdout:7/67: dread - d0/f1a zero size 2024-09-19T09:41:35.970 INFO:tasks.workunit.client.0.smithi042.stdout:3/102: creat d4/d8/d9/d12/f29 x:0 0 0 2024-09-19T09:41:35.970 INFO:tasks.workunit.client.0.smithi042.stdout:3/103: write f0 [4734637,4981] 0 2024-09-19T09:41:35.970 INFO:tasks.workunit.client.0.smithi042.stdout:3/104: chown d4/d8/d9/dc/f13 20452 1 2024-09-19T09:41:35.972 INFO:tasks.workunit.client.0.smithi042.stdout:9/77: dwrite f1 [0,4194304] 0 2024-09-19T09:41:35.972 INFO:tasks.workunit.client.0.smithi042.stdout:8/50: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:41:35.973 INFO:tasks.workunit.client.0.smithi042.stdout:0/93: write d2/f13 [3991998,72061] 0 2024-09-19T09:41:35.973 INFO:tasks.workunit.client.0.smithi042.stdout:6/75: dread d1/f6 [4194304,4194304] 0 2024-09-19T09:41:35.973 INFO:tasks.workunit.client.0.smithi042.stdout:0/94: dread - d2/fb zero size 2024-09-19T09:41:35.978 INFO:tasks.workunit.client.0.smithi042.stdout:8/51: getdents d1 0 2024-09-19T09:41:35.978 INFO:tasks.workunit.client.0.smithi042.stdout:8/52: chown d1/l6 1 1 2024-09-19T09:41:35.978 INFO:tasks.workunit.client.0.smithi042.stdout:9/78: rmdir d8/da/d17 0 2024-09-19T09:41:35.979 INFO:tasks.workunit.client.0.smithi042.stdout:9/79: truncate d8/da/f10 1054248 0 2024-09-19T09:41:35.979 INFO:tasks.workunit.client.0.smithi042.stdout:9/80: fsync d8/da/f10 0 2024-09-19T09:41:35.981 INFO:tasks.workunit.client.0.smithi042.stdout:6/76: mknod d1/c16 0 2024-09-19T09:41:35.983 INFO:tasks.workunit.client.0.smithi042.stdout:8/53: creat d1/fc x:0 0 0 2024-09-19T09:41:35.988 INFO:tasks.workunit.client.0.smithi042.stdout:9/81: dread d8/fe [0,4194304] 0 2024-09-19T09:41:35.990 INFO:tasks.workunit.client.0.smithi042.stdout:8/54: unlink d1/l6 0 2024-09-19T09:41:35.991 INFO:tasks.workunit.client.0.smithi042.stdout:9/82: mknod d8/c18 0 2024-09-19T09:41:35.992 INFO:tasks.workunit.client.0.smithi042.stdout:9/83: write d8/fe [4447489,66357] 0 2024-09-19T09:41:35.992 INFO:tasks.workunit.client.0.smithi042.stdout:1/76: dwrite d4/f10 [0,4194304] 0 2024-09-19T09:41:35.993 INFO:tasks.workunit.client.0.smithi042.stdout:6/77: mknod d1/c17 0 2024-09-19T09:41:35.993 INFO:tasks.workunit.client.0.smithi042.stdout:6/78: stat d1/c17 0 2024-09-19T09:41:35.993 INFO:tasks.workunit.client.0.smithi042.stdout:8/55: getdents d1/da 0 2024-09-19T09:41:35.994 INFO:tasks.workunit.client.0.smithi042.stdout:8/56: write d1/fc [564411,107848] 0 2024-09-19T09:41:35.994 INFO:tasks.workunit.client.0.smithi042.stdout:8/57: stat d1/f7 0 2024-09-19T09:41:35.995 INFO:tasks.workunit.client.0.smithi042.stdout:9/84: write d8/fe [3038640,121123] 0 2024-09-19T09:41:35.996 INFO:tasks.workunit.client.0.smithi042.stdout:7/68: rmdir d0/d14/d18 0 2024-09-19T09:41:36.000 INFO:tasks.workunit.client.0.smithi042.stdout:1/77: creat d4/d15/f17 x:0 0 0 2024-09-19T09:41:36.000 INFO:tasks.workunit.client.0.smithi042.stdout:1/78: stat d4 0 2024-09-19T09:41:36.000 INFO:tasks.workunit.client.0.smithi042.stdout:1/79: write d4/f13 [1595101,92539] 0 2024-09-19T09:41:36.002 INFO:tasks.workunit.client.0.smithi042.stdout:8/58: mkdir d1/da/dd 0 2024-09-19T09:41:36.003 INFO:tasks.workunit.client.0.smithi042.stdout:7/69: mknod d0/d14/c1b 0 2024-09-19T09:41:36.003 INFO:tasks.workunit.client.0.smithi042.stdout:3/105: dwrite d4/d8/f1c [0,4194304] 0 2024-09-19T09:41:36.004 INFO:tasks.workunit.client.0.smithi042.stdout:1/80: rmdir d4 39 2024-09-19T09:41:36.005 INFO:tasks.workunit.client.0.smithi042.stdout:9/85: dread d8/fe [4194304,4194304] 0 2024-09-19T09:41:36.006 INFO:tasks.workunit.client.0.smithi042.stdout:6/79: link d1/f6 d1/f18 0 2024-09-19T09:41:36.006 INFO:tasks.workunit.client.0.smithi042.stdout:9/86: write d8/da/f10 [52081,88405] 0 2024-09-19T09:41:36.007 INFO:tasks.workunit.client.0.smithi042.stdout:0/95: dwrite d2/f13 [0,4194304] 0 2024-09-19T09:41:36.007 INFO:tasks.workunit.client.0.smithi042.stdout:2/63: dwrite f6 [0,4194304] 0 2024-09-19T09:41:36.007 INFO:tasks.workunit.client.0.smithi042.stdout:8/59: mknod d1/ce 0 2024-09-19T09:41:36.008 INFO:tasks.workunit.client.0.smithi042.stdout:2/64: symlink d7/lf 0 2024-09-19T09:41:36.008 INFO:tasks.workunit.client.0.smithi042.stdout:2/65: write d7/fa [254846,104308] 0 2024-09-19T09:41:36.010 INFO:tasks.workunit.client.0.smithi042.stdout:3/106: mkdir d4/d2a 0 2024-09-19T09:41:36.010 INFO:tasks.workunit.client.0.smithi042.stdout:3/107: fsync d4/d8/d9/d12/f1a 0 2024-09-19T09:41:36.010 INFO:tasks.workunit.client.0.smithi042.stdout:3/108: fdatasync d4/f11 0 2024-09-19T09:41:36.010 INFO:tasks.workunit.client.0.smithi042.stdout:3/109: write d4/d8/d9/d12/f29 [600076,56649] 0 2024-09-19T09:41:36.010 INFO:tasks.workunit.client.0.smithi042.stdout:3/110: fsync f0 0 2024-09-19T09:41:36.010 INFO:tasks.workunit.client.0.smithi042.stdout:3/111: write d4/d8/d9/dc/d26/f27 [566855,8569] 0 2024-09-19T09:41:36.010 INFO:tasks.workunit.client.0.smithi042.stdout:3/112: read d4/d8/d9/f17 [142356,86891] 0 2024-09-19T09:41:36.010 INFO:tasks.workunit.client.0.smithi042.stdout:1/81: creat d4/d12/f18 x:0 0 0 2024-09-19T09:41:36.011 INFO:tasks.workunit.client.0.smithi042.stdout:9/87: getdents d8/db 0 2024-09-19T09:41:36.012 INFO:tasks.workunit.client.0.smithi042.stdout:6/80: creat d1/de/d12/f19 x:0 0 0 2024-09-19T09:41:36.013 INFO:tasks.workunit.client.0.smithi042.stdout:0/96: mknod d2/d10/d12/c1f 0 2024-09-19T09:41:36.015 INFO:tasks.workunit.client.0.smithi042.stdout:8/60: creat d1/da/dd/ff x:0 0 0 2024-09-19T09:41:36.015 INFO:tasks.workunit.client.0.smithi042.stdout:1/82: dread f1 [0,4194304] 0 2024-09-19T09:41:36.016 INFO:tasks.workunit.client.0.smithi042.stdout:9/88: mkdir d8/da/d19 0 2024-09-19T09:41:36.016 INFO:tasks.workunit.client.0.smithi042.stdout:6/81: mknod d1/de/c1a 0 2024-09-19T09:41:36.017 INFO:tasks.workunit.client.0.smithi042.stdout:9/89: dread d8/f15 [0,4194304] 0 2024-09-19T09:41:36.017 INFO:tasks.workunit.client.0.smithi042.stdout:0/97: truncate d2/ff 3629809 0 2024-09-19T09:41:36.018 INFO:tasks.workunit.client.0.smithi042.stdout:8/61: unlink l0 0 2024-09-19T09:41:36.019 INFO:tasks.workunit.client.0.smithi042.stdout:1/83: rename d4/d5 to d4/d15/d19 0 2024-09-19T09:41:36.019 INFO:tasks.workunit.client.0.smithi042.stdout:1/84: dread - d4/d15/d19/f16 zero size 2024-09-19T09:41:36.020 INFO:tasks.workunit.client.0.smithi042.stdout:9/90: rmdir d8/db 39 2024-09-19T09:41:36.020 INFO:tasks.workunit.client.0.smithi042.stdout:9/91: write d8/da/f10 [29070,48908] 0 2024-09-19T09:41:36.020 INFO:tasks.workunit.client.0.smithi042.stdout:9/92: write d8/fe [3705763,55973] 0 2024-09-19T09:41:36.021 INFO:tasks.workunit.client.0.smithi042.stdout:0/98: unlink d2/f13 0 2024-09-19T09:41:36.021 INFO:tasks.workunit.client.0.smithi042.stdout:0/99: truncate d2/f1c 313082 0 2024-09-19T09:41:36.022 INFO:tasks.workunit.client.0.smithi042.stdout:1/85: creat d4/d15/d19/f1a x:0 0 0 2024-09-19T09:41:36.022 INFO:tasks.workunit.client.0.smithi042.stdout:1/86: dread - d4/d15/d19/f16 zero size 2024-09-19T09:41:36.022 INFO:tasks.workunit.client.0.smithi042.stdout:1/87: chown d4/d15/d19/fc 3462 1 2024-09-19T09:41:36.023 INFO:tasks.workunit.client.0.smithi042.stdout:0/100: rmdir d2/d10 39 2024-09-19T09:41:36.023 INFO:tasks.workunit.client.0.smithi042.stdout:0/101: stat f1 0 2024-09-19T09:41:36.023 INFO:tasks.workunit.client.0.smithi042.stdout:0/102: chown d2/fa 43 1 2024-09-19T09:41:36.025 INFO:tasks.workunit.client.0.smithi042.stdout:6/82: write d1/f18 [3982038,125778] 0 2024-09-19T09:41:36.026 INFO:tasks.workunit.client.0.smithi042.stdout:1/88: mknod d4/d12/c1b 0 2024-09-19T09:41:36.027 INFO:tasks.workunit.client.0.smithi042.stdout:0/103: mknod d2/d10/d12/d16/c20 0 2024-09-19T09:41:36.031 INFO:tasks.workunit.client.0.smithi042.stdout:6/83: fsync d1/f18 0 2024-09-19T09:41:36.031 INFO:tasks.workunit.client.0.smithi042.stdout:0/104: link d2/d10/f1b d2/f21 0 2024-09-19T09:41:36.033 INFO:tasks.workunit.client.0.smithi042.stdout:3/113: dwrite d4/d8/d9/f1e [0,4194304] 0 2024-09-19T09:41:36.033 INFO:tasks.workunit.client.0.smithi042.stdout:3/114: chown d4/d8/d9/dc/d26 187 1 2024-09-19T09:41:36.034 INFO:tasks.workunit.client.0.smithi042.stdout:6/84: unlink d1/c7 0 2024-09-19T09:41:36.035 INFO:tasks.workunit.client.0.smithi042.stdout:0/105: creat d2/d10/d12/d16/d18/f22 x:0 0 0 2024-09-19T09:41:36.037 INFO:tasks.workunit.client.0.smithi042.stdout:9/93: dwrite f1 [0,4194304] 0 2024-09-19T09:41:36.038 INFO:tasks.workunit.client.0.smithi042.stdout:3/115: creat d4/d8/d9/dc/f2b x:0 0 0 2024-09-19T09:41:36.039 INFO:tasks.workunit.client.0.smithi042.stdout:4/59: sync 2024-09-19T09:41:36.041 INFO:tasks.workunit.client.0.smithi042.stdout:0/106: mknod d2/d10/d12/d19/c23 0 2024-09-19T09:41:36.041 INFO:tasks.workunit.client.0.smithi042.stdout:9/94: dread d8/fe [0,4194304] 0 2024-09-19T09:41:36.041 INFO:tasks.workunit.client.0.smithi042.stdout:9/95: fdatasync d8/f15 0 2024-09-19T09:41:36.044 INFO:tasks.workunit.client.0.smithi042.stdout:9/96: creat d8/f1a x:0 0 0 2024-09-19T09:41:36.044 INFO:tasks.workunit.client.0.smithi042.stdout:1/89: getdents d4 0 2024-09-19T09:41:36.046 INFO:tasks.workunit.client.0.smithi042.stdout:4/60: rename d0/f17 to d0/f18 0 2024-09-19T09:41:36.048 INFO:tasks.workunit.client.0.smithi042.stdout:9/97: creat d8/da/d19/f1b x:0 0 0 2024-09-19T09:41:36.048 INFO:tasks.workunit.client.0.smithi042.stdout:9/98: write d8/f15 [760127,94144] 0 2024-09-19T09:41:36.048 INFO:tasks.workunit.client.0.smithi042.stdout:1/90: creat d4/d15/f1c x:0 0 0 2024-09-19T09:41:36.049 INFO:tasks.workunit.client.0.smithi042.stdout:1/91: truncate d4/d15/d19/ff 1224321 0 2024-09-19T09:41:36.049 INFO:tasks.workunit.client.0.smithi042.stdout:1/92: fsync d4/d12/f18 0 2024-09-19T09:41:36.051 INFO:tasks.workunit.client.0.smithi042.stdout:1/93: mkdir d4/d1d 0 2024-09-19T09:41:36.051 INFO:tasks.workunit.client.0.smithi042.stdout:1/94: dread - d4/fb zero size 2024-09-19T09:41:36.051 INFO:tasks.workunit.client.0.smithi042.stdout:1/95: fdatasync d4/d15/f17 0 2024-09-19T09:41:36.052 INFO:tasks.workunit.client.0.smithi042.stdout:6/85: truncate d1/f6 4528035 0 2024-09-19T09:41:36.052 INFO:tasks.workunit.client.0.smithi042.stdout:6/86: write d1/fc [926329,13909] 0 2024-09-19T09:41:36.053 INFO:tasks.workunit.client.0.smithi042.stdout:6/87: chown d1/c8 988905 1 2024-09-19T09:41:36.060 INFO:tasks.workunit.client.0.smithi042.stdout:3/116: dread d4/d8/d9/f1e [0,4194304] 0 2024-09-19T09:41:36.060 INFO:tasks.workunit.client.0.smithi042.stdout:3/117: rename d4 to d4/d8/d9/d2c 22 2024-09-19T09:41:36.061 INFO:tasks.workunit.client.0.smithi042.stdout:3/118: chown c1 12 1 2024-09-19T09:41:36.061 INFO:tasks.workunit.client.0.smithi042.stdout:3/119: chown d4/f11 12 1 2024-09-19T09:41:36.071 INFO:tasks.workunit.client.0.smithi042.stdout:0/107: dwrite d2/d10/f15 [0,4194304] 0 2024-09-19T09:41:36.072 INFO:tasks.workunit.client.0.smithi042.stdout:0/108: dread - d2/d10/d12/d16/d18/f22 zero size 2024-09-19T09:41:36.072 INFO:tasks.workunit.client.0.smithi042.stdout:0/109: write d2/d10/f15 [4608028,4613] 0 2024-09-19T09:41:36.073 INFO:tasks.workunit.client.0.smithi042.stdout:4/61: dwrite d0/fb [0,4194304] 0 2024-09-19T09:41:36.077 INFO:tasks.workunit.client.0.smithi042.stdout:5/60: sync 2024-09-19T09:41:36.080 INFO:tasks.workunit.client.0.smithi042.stdout:4/62: creat d0/f19 x:0 0 0 2024-09-19T09:41:36.081 INFO:tasks.workunit.client.0.smithi042.stdout:5/61: creat d2/d4/f15 x:0 0 0 2024-09-19T09:41:36.081 INFO:tasks.workunit.client.0.smithi042.stdout:5/62: write d2/f7 [1071563,119005] 0 2024-09-19T09:41:36.082 INFO:tasks.workunit.client.0.smithi042.stdout:5/63: read - d2/db/fe zero size 2024-09-19T09:41:36.082 INFO:tasks.workunit.client.0.smithi042.stdout:6/88: dwrite d1/fc [0,4194304] 0 2024-09-19T09:41:36.083 INFO:tasks.workunit.client.0.smithi042.stdout:4/63: mknod d0/c1a 0 2024-09-19T09:41:36.084 INFO:tasks.workunit.client.0.smithi042.stdout:9/99: dwrite d8/fe [0,4194304] 0 2024-09-19T09:41:36.084 INFO:tasks.workunit.client.0.smithi042.stdout:9/100: dread - d8/f1a zero size 2024-09-19T09:41:36.084 INFO:tasks.workunit.client.0.smithi042.stdout:5/64: symlink d2/d4/l16 0 2024-09-19T09:41:36.088 INFO:tasks.workunit.client.0.smithi042.stdout:9/101: mkdir d8/da/d19/d1c 0 2024-09-19T09:41:36.088 INFO:tasks.workunit.client.0.smithi042.stdout:9/102: getdents d8/db 0 2024-09-19T09:41:36.088 INFO:tasks.workunit.client.0.smithi042.stdout:9/103: chown d8/da 134177120 1 2024-09-19T09:41:36.088 INFO:tasks.workunit.client.0.smithi042.stdout:9/104: write d8/f15 [1570099,22016] 0 2024-09-19T09:41:36.088 INFO:tasks.workunit.client.0.smithi042.stdout:6/89: symlink d1/de/d12/l1b 0 2024-09-19T09:41:36.088 INFO:tasks.workunit.client.0.smithi042.stdout:6/90: chown d1 4 1 2024-09-19T09:41:36.088 INFO:tasks.workunit.client.0.smithi042.stdout:6/91: readlink d1/de/d12/l1b 0 2024-09-19T09:41:36.089 INFO:tasks.workunit.client.0.smithi042.stdout:4/64: mkdir d0/d1b 0 2024-09-19T09:41:36.089 INFO:tasks.workunit.client.0.smithi042.stdout:9/105: mkdir d8/d1d 0 2024-09-19T09:41:36.090 INFO:tasks.workunit.client.0.smithi042.stdout:1/96: dwrite d4/d15/d19/f9 [0,4194304] 0 2024-09-19T09:41:36.090 INFO:tasks.workunit.client.0.smithi042.stdout:1/97: getdents d4/d1d 0 2024-09-19T09:41:36.091 INFO:tasks.workunit.client.0.smithi042.stdout:4/65: mkdir d0/d1b/d1c 0 2024-09-19T09:41:36.093 INFO:tasks.workunit.client.0.smithi042.stdout:1/98: getdents d4/d12 0 2024-09-19T09:41:36.093 INFO:tasks.workunit.client.0.smithi042.stdout:1/99: chown d4/d15 10 1 2024-09-19T09:41:36.093 INFO:tasks.workunit.client.0.smithi042.stdout:4/66: mknod d0/d1b/d1c/c1d 0 2024-09-19T09:41:36.096 INFO:tasks.workunit.client.0.smithi042.stdout:0/110: dwrite d2/fe [0,4194304] 0 2024-09-19T09:41:36.096 INFO:tasks.workunit.client.0.smithi042.stdout:0/111: truncate f0 2165709 0 2024-09-19T09:41:36.097 INFO:tasks.workunit.client.0.smithi042.stdout:9/106: dread d8/f11 [0,4194304] 0 2024-09-19T09:41:36.101 INFO:tasks.workunit.client.0.smithi042.stdout:4/67: getdents d0 0 2024-09-19T09:41:36.101 INFO:tasks.workunit.client.0.smithi042.stdout:4/68: readlink d0/la 0 2024-09-19T09:41:36.101 INFO:tasks.workunit.client.0.smithi042.stdout:6/92: write d1/fc [469532,80614] 0 2024-09-19T09:41:36.103 INFO:tasks.workunit.client.0.smithi042.stdout:1/100: dread d4/f13 [0,4194304] 0 2024-09-19T09:41:36.103 INFO:tasks.workunit.client.0.smithi042.stdout:1/101: chown d4/c11 12239 1 2024-09-19T09:41:36.103 INFO:tasks.workunit.client.0.smithi042.stdout:6/93: readlink d1/l14 0 2024-09-19T09:41:36.104 INFO:tasks.workunit.client.0.smithi042.stdout:7/70: sync 2024-09-19T09:41:36.104 INFO:tasks.workunit.client.0.smithi042.stdout:7/71: stat d0/ld 0 2024-09-19T09:41:36.105 INFO:tasks.workunit.client.0.smithi042.stdout:6/94: read d1/f6 [3070598,2194] 0 2024-09-19T09:41:36.107 INFO:tasks.workunit.client.0.smithi042.stdout:7/72: unlink d0/f12 0 2024-09-19T09:41:36.109 INFO:tasks.workunit.client.0.smithi042.stdout:6/95: mkdir d1/de/d12/d1c 0 2024-09-19T09:41:36.110 INFO:tasks.workunit.client.0.smithi042.stdout:6/96: rename d1/de/d15 to d1/de/d15/d1d 22 2024-09-19T09:41:36.110 INFO:tasks.workunit.client.0.smithi042.stdout:7/73: getdents d0/d14 0 2024-09-19T09:41:36.110 INFO:tasks.workunit.client.0.smithi042.stdout:6/97: write d1/f6 [1975768,4050] 0 2024-09-19T09:41:36.110 INFO:tasks.workunit.client.0.smithi042.stdout:7/74: write d0/f6 [2541758,130919] 0 2024-09-19T09:41:36.110 INFO:tasks.workunit.client.0.smithi042.stdout:7/75: readlink d0/ld 0 2024-09-19T09:41:36.110 INFO:tasks.workunit.client.0.smithi042.stdout:7/76: dread - d0/f17 zero size 2024-09-19T09:41:36.110 INFO:tasks.workunit.client.0.smithi042.stdout:1/102: dread f1 [0,4194304] 0 2024-09-19T09:41:36.110 INFO:tasks.workunit.client.0.smithi042.stdout:1/103: chown d4/d15/f1c 1466 1 2024-09-19T09:41:36.111 INFO:tasks.workunit.client.0.smithi042.stdout:6/98: rmdir d1/de/d15 0 2024-09-19T09:41:36.111 INFO:tasks.workunit.client.0.smithi042.stdout:6/99: write d1/fc [457587,102797] 0 2024-09-19T09:41:36.113 INFO:tasks.workunit.client.0.smithi042.stdout:1/104: mkdir d4/d1e 0 2024-09-19T09:41:36.115 INFO:tasks.workunit.client.0.smithi042.stdout:7/77: rename d0/fe to d0/d14/f1c 0 2024-09-19T09:41:36.116 INFO:tasks.workunit.client.0.smithi042.stdout:1/105: creat d4/d1e/f1f x:0 0 0 2024-09-19T09:41:36.116 INFO:tasks.workunit.client.0.smithi042.stdout:1/106: fsync d4/f13 0 2024-09-19T09:41:36.117 INFO:tasks.workunit.client.0.smithi042.stdout:1/107: truncate d4/d15/d19/f9 1412552 0 2024-09-19T09:41:36.119 INFO:tasks.workunit.client.0.smithi042.stdout:0/112: dwrite f0 [0,4194304] 0 2024-09-19T09:41:36.119 INFO:tasks.workunit.client.0.smithi042.stdout:0/113: truncate f1 2635798 0 2024-09-19T09:41:36.120 INFO:tasks.workunit.client.0.smithi042.stdout:7/78: dread d0/fb [0,4194304] 0 2024-09-19T09:41:36.120 INFO:tasks.workunit.client.0.smithi042.stdout:5/65: dwrite d2/f7 [0,4194304] 0 2024-09-19T09:41:36.120 INFO:tasks.workunit.client.0.smithi042.stdout:7/79: dread - d0/f13 zero size 2024-09-19T09:41:36.123 INFO:tasks.workunit.client.0.smithi042.stdout:0/114: mkdir d2/d10/d12/d24 0 2024-09-19T09:41:36.123 INFO:tasks.workunit.client.0.smithi042.stdout:0/115: dread - d2/d10/d12/d16/d18/f22 zero size 2024-09-19T09:41:36.123 INFO:tasks.workunit.client.0.smithi042.stdout:0/116: write d2/f1c [1206952,115115] 0 2024-09-19T09:41:36.123 INFO:tasks.workunit.client.0.smithi042.stdout:1/108: dread d4/d15/d19/fe [0,4194304] 0 2024-09-19T09:41:36.125 INFO:tasks.workunit.client.0.smithi042.stdout:0/117: rename d2/f21 to d2/d10/d1d/f25 0 2024-09-19T09:41:36.125 INFO:tasks.workunit.client.0.smithi042.stdout:0/118: truncate f0 4688758 0 2024-09-19T09:41:36.125 INFO:tasks.workunit.client.0.smithi042.stdout:0/119: chown d2/d10/d12/d24 0 1 2024-09-19T09:41:36.126 INFO:tasks.workunit.client.0.smithi042.stdout:1/109: mkdir d4/d1d/d20 0 2024-09-19T09:41:36.126 INFO:tasks.workunit.client.0.smithi042.stdout:1/110: write d4/f14 [955014,28616] 0 2024-09-19T09:41:36.127 INFO:tasks.workunit.client.0.smithi042.stdout:4/69: dwrite d0/f5 [0,4194304] 0 2024-09-19T09:41:36.127 INFO:tasks.workunit.client.0.smithi042.stdout:4/70: readlink d0/lf 0 2024-09-19T09:41:36.127 INFO:tasks.workunit.client.0.smithi042.stdout:1/111: rename d4/fb to d4/d15/f21 0 2024-09-19T09:41:36.132 INFO:tasks.workunit.client.0.smithi042.stdout:5/66: dread d2/d4/fa [0,4194304] 0 2024-09-19T09:41:36.132 INFO:tasks.workunit.client.0.smithi042.stdout:5/67: rename d2/db to d2/db/df/d11/d17 22 2024-09-19T09:41:36.133 INFO:tasks.workunit.client.0.smithi042.stdout:4/71: creat d0/d1b/f1e x:0 0 0 2024-09-19T09:41:36.134 INFO:tasks.workunit.client.0.smithi042.stdout:1/112: creat d4/f22 x:0 0 0 2024-09-19T09:41:36.136 INFO:tasks.workunit.client.0.smithi042.stdout:4/72: write d0/f18 [575478,91067] 0 2024-09-19T09:41:36.138 INFO:tasks.workunit.client.0.smithi042.stdout:1/113: unlink d4/fa 0 2024-09-19T09:41:36.139 INFO:tasks.workunit.client.0.smithi042.stdout:1/114: getdents d4/d1d/d20 0 2024-09-19T09:41:36.141 INFO:tasks.workunit.client.0.smithi042.stdout:6/100: dwrite d1/f6 [4194304,4194304] 0 2024-09-19T09:41:36.141 INFO:tasks.workunit.client.0.smithi042.stdout:4/73: link d0/f16 d0/d1b/d1c/f1f 0 2024-09-19T09:41:36.141 INFO:tasks.workunit.client.0.smithi042.stdout:1/115: mknod d4/d15/d19/c23 0 2024-09-19T09:41:36.141 INFO:tasks.workunit.client.0.smithi042.stdout:1/116: dread - d4/d15/f21 zero size 2024-09-19T09:41:36.144 INFO:tasks.workunit.client.0.smithi042.stdout:0/120: write d2/d10/f15 [999166,89097] 0 2024-09-19T09:41:36.144 INFO:tasks.workunit.client.0.smithi042.stdout:0/121: dread - d2/d10/d1d/f25 zero size 2024-09-19T09:41:36.147 INFO:tasks.workunit.client.0.smithi042.stdout:6/101: creat d1/de/d12/f1e x:0 0 0 2024-09-19T09:41:36.147 INFO:tasks.workunit.client.0.smithi042.stdout:6/102: chown d1/de/cf 53 1 2024-09-19T09:41:36.147 INFO:tasks.workunit.client.0.smithi042.stdout:6/103: write d1/de/d12/f19 [10831,9435] 0 2024-09-19T09:41:36.149 INFO:tasks.workunit.client.0.smithi042.stdout:2/66: sync 2024-09-19T09:41:36.149 INFO:tasks.workunit.client.0.smithi042.stdout:2/67: read - d7/fe zero size 2024-09-19T09:41:36.150 INFO:tasks.workunit.client.0.smithi042.stdout:7/80: dwrite d0/d14/f15 [0,4194304] 0 2024-09-19T09:41:36.150 INFO:tasks.workunit.client.0.smithi042.stdout:7/81: readlink d0/lc 0 2024-09-19T09:41:36.150 INFO:tasks.workunit.client.0.smithi042.stdout:0/122: symlink d2/d10/l26 0 2024-09-19T09:41:36.151 INFO:tasks.workunit.client.0.smithi042.stdout:6/104: symlink d1/de/d12/l1f 0 2024-09-19T09:41:36.151 INFO:tasks.workunit.client.0.smithi042.stdout:6/105: fdatasync d1/fc 0 2024-09-19T09:41:36.153 INFO:tasks.workunit.client.0.smithi042.stdout:0/123: write d2/f1c [1121754,28944] 0 2024-09-19T09:41:36.155 INFO:tasks.workunit.client.0.smithi042.stdout:2/68: link f2 d7/f10 0 2024-09-19T09:41:36.155 INFO:tasks.workunit.client.0.smithi042.stdout:2/69: fdatasync d7/fa 0 2024-09-19T09:41:36.156 INFO:tasks.workunit.client.0.smithi042.stdout:0/124: mknod d2/d10/c27 0 2024-09-19T09:41:36.156 INFO:tasks.workunit.client.0.smithi042.stdout:5/68: dwrite d2/db/f10 [4194304,4194304] 0 2024-09-19T09:41:36.157 INFO:tasks.workunit.client.0.smithi042.stdout:5/69: chown d2/d4/c6 3 1 2024-09-19T09:41:36.157 INFO:tasks.workunit.client.0.smithi042.stdout:5/70: fdatasync d2/d4/fa 0 2024-09-19T09:41:36.157 INFO:tasks.workunit.client.0.smithi042.stdout:7/82: dread d0/f6 [0,4194304] 0 2024-09-19T09:41:36.157 INFO:tasks.workunit.client.0.smithi042.stdout:7/83: read d0/fb [1716429,68963] 0 2024-09-19T09:41:36.157 INFO:tasks.workunit.client.0.smithi042.stdout:5/71: mknod d2/d4/c18 0 2024-09-19T09:41:36.157 INFO:tasks.workunit.client.0.smithi042.stdout:5/72: chown d2/db/cd 282876 1 2024-09-19T09:41:36.157 INFO:tasks.workunit.client.0.smithi042.stdout:7/84: rmdir d0 39 2024-09-19T09:41:36.158 INFO:tasks.workunit.client.0.smithi042.stdout:7/85: fsync d0/fa 0 2024-09-19T09:41:36.159 INFO:tasks.workunit.client.0.smithi042.stdout:5/73: symlink d2/dc/l19 0 2024-09-19T09:41:36.161 INFO:tasks.workunit.client.0.smithi042.stdout:5/74: creat d2/dc/f1a x:0 0 0 2024-09-19T09:41:36.171 INFO:tasks.workunit.client.0.smithi042.stdout:7/86: dread d0/d14/f15 [0,4194304] 0 2024-09-19T09:41:36.171 INFO:tasks.workunit.client.0.smithi042.stdout:7/87: dread - d0/f17 zero size 2024-09-19T09:41:36.171 INFO:tasks.workunit.client.0.smithi042.stdout:7/88: chown d0/d14/c1b 15198 1 2024-09-19T09:41:36.172 INFO:tasks.workunit.client.0.smithi042.stdout:7/89: unlink d0/d14/c1b 0 2024-09-19T09:41:36.173 INFO:tasks.workunit.client.0.smithi042.stdout:5/75: dread d2/d4/fa [0,4194304] 0 2024-09-19T09:41:36.173 INFO:tasks.workunit.client.0.smithi042.stdout:5/76: write d2/dc/f1a [203141,45965] 0 2024-09-19T09:41:36.173 INFO:tasks.workunit.client.0.smithi042.stdout:7/90: symlink d0/l1d 0 2024-09-19T09:41:36.174 INFO:tasks.workunit.client.0.smithi042.stdout:7/91: truncate d0/f1a 258941 0 2024-09-19T09:41:36.174 INFO:tasks.workunit.client.0.smithi042.stdout:5/77: creat d2/f1b x:0 0 0 2024-09-19T09:41:36.175 INFO:tasks.workunit.client.0.smithi042.stdout:7/92: creat d0/f1e x:0 0 0 2024-09-19T09:41:36.176 INFO:tasks.workunit.client.0.smithi042.stdout:4/74: dwrite d0/d1b/d1c/f1f [0,4194304] 0 2024-09-19T09:41:36.176 INFO:tasks.workunit.client.0.smithi042.stdout:5/78: creat d2/d8/f1c x:0 0 0 2024-09-19T09:41:36.176 INFO:tasks.workunit.client.0.smithi042.stdout:4/75: write d0/f19 [53030,22756] 0 2024-09-19T09:41:36.176 INFO:tasks.workunit.client.0.smithi042.stdout:2/70: dwrite d7/fe [0,4194304] 0 2024-09-19T09:41:36.176 INFO:tasks.workunit.client.0.smithi042.stdout:6/106: dwrite d1/f18 [0,4194304] 0 2024-09-19T09:41:36.178 INFO:tasks.workunit.client.0.smithi042.stdout:5/79: creat d2/dc/f1d x:0 0 0 2024-09-19T09:41:36.178 INFO:tasks.workunit.client.0.smithi042.stdout:5/80: write d2/dc/f1a [216299,21179] 0 2024-09-19T09:41:36.179 INFO:tasks.workunit.client.0.smithi042.stdout:7/93: mknod d0/c1f 0 2024-09-19T09:41:36.180 INFO:tasks.workunit.client.0.smithi042.stdout:2/71: fsync d7/f10 0 2024-09-19T09:41:36.180 INFO:tasks.workunit.client.0.smithi042.stdout:2/72: chown d7/lb 476 1 2024-09-19T09:41:36.180 INFO:tasks.workunit.client.0.smithi042.stdout:2/73: stat d7/fa 0 2024-09-19T09:41:36.180 INFO:tasks.workunit.client.0.smithi042.stdout:5/81: creat d2/f1e x:0 0 0 2024-09-19T09:41:36.180 INFO:tasks.workunit.client.0.smithi042.stdout:7/94: mknod d0/d14/c20 0 2024-09-19T09:41:36.181 INFO:tasks.workunit.client.0.smithi042.stdout:2/74: symlink d7/l11 0 2024-09-19T09:41:36.181 INFO:tasks.workunit.client.0.smithi042.stdout:6/107: mkdir d1/d20 0 2024-09-19T09:41:36.181 INFO:tasks.workunit.client.0.smithi042.stdout:6/108: rmdir d1/de/d12 39 2024-09-19T09:41:36.182 INFO:tasks.workunit.client.0.smithi042.stdout:6/109: unlink d1/de/d12/f1e 0 2024-09-19T09:41:36.183 INFO:tasks.workunit.client.0.smithi042.stdout:4/76: dread d0/f16 [0,4194304] 0 2024-09-19T09:41:36.184 INFO:tasks.workunit.client.0.smithi042.stdout:4/77: mknod d0/d1b/d1c/c20 0 2024-09-19T09:41:36.184 INFO:tasks.workunit.client.0.smithi042.stdout:4/78: stat d0/d1b/d1c/c20 0 2024-09-19T09:41:36.186 INFO:tasks.workunit.client.0.smithi042.stdout:5/82: write d2/db/f10 [3494765,122263] 0 2024-09-19T09:41:36.186 INFO:tasks.workunit.client.0.smithi042.stdout:5/83: write d2/d4/fa [1288655,79712] 0 2024-09-19T09:41:36.186 INFO:tasks.workunit.client.0.smithi042.stdout:5/84: readlink d2/db/df/d11/l14 0 2024-09-19T09:41:36.186 INFO:tasks.workunit.client.0.smithi042.stdout:7/95: dread d0/d14/f15 [0,4194304] 0 2024-09-19T09:41:36.189 INFO:tasks.workunit.client.0.smithi042.stdout:5/85: fsync d2/dc/f1a 0 2024-09-19T09:41:36.192 INFO:tasks.workunit.client.0.smithi042.stdout:5/86: creat d2/db/df/d11/f1f x:0 0 0 2024-09-19T09:41:36.192 INFO:tasks.workunit.client.0.smithi042.stdout:8/62: sync 2024-09-19T09:41:36.193 INFO:tasks.workunit.client.0.smithi042.stdout:3/120: sync 2024-09-19T09:41:36.193 INFO:tasks.workunit.client.0.smithi042.stdout:3/121: fsync d4/ff 0 2024-09-19T09:41:36.193 INFO:tasks.workunit.client.0.smithi042.stdout:3/122: truncate f0 4888509 0 2024-09-19T09:41:36.193 INFO:tasks.workunit.client.0.smithi042.stdout:3/123: fdatasync d4/f11 0 2024-09-19T09:41:36.194 INFO:tasks.workunit.client.0.smithi042.stdout:7/96: write d0/d14/f15 [1128088,8507] 0 2024-09-19T09:41:36.195 INFO:tasks.workunit.client.0.smithi042.stdout:3/124: mknod d4/d8/d9/d1b/c2d 0 2024-09-19T09:41:36.195 INFO:tasks.workunit.client.0.smithi042.stdout:3/125: write f0 [5503967,122056] 0 2024-09-19T09:41:36.195 INFO:tasks.workunit.client.0.smithi042.stdout:3/126: read d4/d8/d9/f17 [74837,23814] 0 2024-09-19T09:41:36.197 INFO:tasks.workunit.client.0.smithi042.stdout:3/127: unlink d4/f11 0 2024-09-19T09:41:36.197 INFO:tasks.workunit.client.0.smithi042.stdout:3/128: chown d4/d8/de 11 1 2024-09-19T09:41:36.200 INFO:tasks.workunit.client.0.smithi042.stdout:3/129: mknod d4/d8/d9/dc/d26/c2e 0 2024-09-19T09:41:36.202 INFO:tasks.workunit.client.0.smithi042.stdout:7/97: dread d0/fb [0,4194304] 0 2024-09-19T09:41:36.204 INFO:tasks.workunit.client.0.smithi042.stdout:7/98: symlink d0/l21 0 2024-09-19T09:41:36.205 INFO:tasks.workunit.client.0.smithi042.stdout:7/99: dread - d0/d14/f1c zero size 2024-09-19T09:41:36.206 INFO:tasks.workunit.client.0.smithi042.stdout:7/100: rename d0/ld to d0/d14/l22 0 2024-09-19T09:41:36.208 INFO:tasks.workunit.client.0.smithi042.stdout:7/101: rmdir d0/d14 39 2024-09-19T09:41:36.210 INFO:tasks.workunit.client.0.smithi042.stdout:8/63: dread d1/f9 [0,4194304] 0 2024-09-19T09:41:36.210 INFO:tasks.workunit.client.0.smithi042.stdout:8/64: stat d1/f9 0 2024-09-19T09:41:36.211 INFO:tasks.workunit.client.0.smithi042.stdout:8/65: write d1/f8 [887231,74009] 0 2024-09-19T09:41:36.212 INFO:tasks.workunit.client.0.smithi042.stdout:7/102: dread d0/f6 [0,4194304] 0 2024-09-19T09:41:36.213 INFO:tasks.workunit.client.0.smithi042.stdout:8/66: creat d1/f10 x:0 0 0 2024-09-19T09:41:36.213 INFO:tasks.workunit.client.0.smithi042.stdout:6/110: dwrite d1/fc [0,4194304] 0 2024-09-19T09:41:36.213 INFO:tasks.workunit.client.0.smithi042.stdout:7/103: rmdir d0/d14 39 2024-09-19T09:41:36.215 INFO:tasks.workunit.client.0.smithi042.stdout:6/111: mknod d1/de/d12/d1c/c21 0 2024-09-19T09:41:36.217 INFO:tasks.workunit.client.0.smithi042.stdout:7/104: creat d0/f23 x:0 0 0 2024-09-19T09:41:36.217 INFO:tasks.workunit.client.0.smithi042.stdout:8/67: mknod d1/da/c11 0 2024-09-19T09:41:36.219 INFO:tasks.workunit.client.0.smithi042.stdout:4/79: dwrite d0/f14 [0,4194304] 0 2024-09-19T09:41:36.220 INFO:tasks.workunit.client.0.smithi042.stdout:4/80: read - d0/d1b/f1e zero size 2024-09-19T09:41:36.220 INFO:tasks.workunit.client.0.smithi042.stdout:7/105: link d0/c16 d0/d14/c24 0 2024-09-19T09:41:36.220 INFO:tasks.workunit.client.0.smithi042.stdout:7/106: chown d0/d14 0 1 2024-09-19T09:41:36.220 INFO:tasks.workunit.client.0.smithi042.stdout:2/75: dwrite f6 [4194304,4194304] 0 2024-09-19T09:41:36.222 INFO:tasks.workunit.client.0.smithi042.stdout:6/112: unlink d1/ca 0 2024-09-19T09:41:36.223 INFO:tasks.workunit.client.0.smithi042.stdout:6/113: fsync d1/de/d12/f19 0 2024-09-19T09:41:36.224 INFO:tasks.workunit.client.0.smithi042.stdout:8/68: dread d1/f2 [0,4194304] 0 2024-09-19T09:41:36.225 INFO:tasks.workunit.client.0.smithi042.stdout:3/130: dwrite d4/d8/d9/dc/f13 [0,4194304] 0 2024-09-19T09:41:36.225 INFO:tasks.workunit.client.0.smithi042.stdout:4/81: rename d0/l6 to d0/d1b/d1c/l21 0 2024-09-19T09:41:36.226 INFO:tasks.workunit.client.0.smithi042.stdout:4/82: write d0/d1b/f1e [138200,108058] 0 2024-09-19T09:41:36.227 INFO:tasks.workunit.client.0.smithi042.stdout:2/76: dread f2 [4194304,4194304] 0 2024-09-19T09:41:36.227 INFO:tasks.workunit.client.0.smithi042.stdout:5/87: dwrite d2/d4/f15 [0,4194304] 0 2024-09-19T09:41:36.227 INFO:tasks.workunit.client.0.smithi042.stdout:7/107: creat d0/f25 x:0 0 0 2024-09-19T09:41:36.227 INFO:tasks.workunit.client.0.smithi042.stdout:7/108: dread - d0/f25 zero size 2024-09-19T09:41:36.227 INFO:tasks.workunit.client.0.smithi042.stdout:7/109: stat d0/l4 0 2024-09-19T09:41:36.227 INFO:tasks.workunit.client.0.smithi042.stdout:7/110: fsync d0/f5 0 2024-09-19T09:41:36.232 INFO:tasks.workunit.client.0.smithi042.stdout:8/69: read d1/fc [584747,126545] 0 2024-09-19T09:41:36.232 INFO:tasks.workunit.client.0.smithi042.stdout:3/131: write d4/d8/d9/dc/f13 [3554978,63068] 0 2024-09-19T09:41:36.234 INFO:tasks.workunit.client.0.smithi042.stdout:5/88: rename d2/db/df to d2/d4/d20 0 2024-09-19T09:41:36.235 INFO:tasks.workunit.client.0.smithi042.stdout:6/114: truncate d1/f18 307424 0 2024-09-19T09:41:36.236 INFO:tasks.workunit.client.0.smithi042.stdout:4/83: dread d0/fb [0,4194304] 0 2024-09-19T09:41:36.236 INFO:tasks.workunit.client.0.smithi042.stdout:8/70: readlink d1/l3 0 2024-09-19T09:41:36.237 INFO:tasks.workunit.client.0.smithi042.stdout:3/132: symlink d4/d8/d9/l2f 0 2024-09-19T09:41:36.238 INFO:tasks.workunit.client.0.smithi042.stdout:8/71: write d1/f2 [1146081,110561] 0 2024-09-19T09:41:36.239 INFO:tasks.workunit.client.0.smithi042.stdout:7/111: rename d0/f13 to d0/f26 0 2024-09-19T09:41:36.239 INFO:tasks.workunit.client.0.smithi042.stdout:7/112: fdatasync d0/f26 0 2024-09-19T09:41:36.240 INFO:tasks.workunit.client.0.smithi042.stdout:3/133: symlink d4/d8/d9/l30 0 2024-09-19T09:41:36.241 INFO:tasks.workunit.client.0.smithi042.stdout:8/72: creat d1/da/f12 x:0 0 0 2024-09-19T09:41:36.241 INFO:tasks.workunit.client.0.smithi042.stdout:8/73: dread - d1/f10 zero size 2024-09-19T09:41:36.242 INFO:tasks.workunit.client.0.smithi042.stdout:7/113: rmdir d0 39 2024-09-19T09:41:36.242 INFO:tasks.workunit.client.0.smithi042.stdout:6/115: dread d1/fc [0,4194304] 0 2024-09-19T09:41:36.245 INFO:tasks.workunit.client.0.smithi042.stdout:9/107: sync 2024-09-19T09:41:36.245 INFO:tasks.workunit.client.0.smithi042.stdout:9/108: readlink d8/db/l12 0 2024-09-19T09:41:36.246 INFO:tasks.workunit.client.0.smithi042.stdout:9/109: read d8/f15 [38190,47453] 0 2024-09-19T09:41:36.247 INFO:tasks.workunit.client.0.smithi042.stdout:7/114: dread d0/fb [0,4194304] 0 2024-09-19T09:41:36.247 INFO:tasks.workunit.client.0.smithi042.stdout:7/115: chown d0/d14/c20 374316085 1 2024-09-19T09:41:36.247 INFO:tasks.workunit.client.0.smithi042.stdout:4/84: rename d0/l3 to d0/d1b/l22 0 2024-09-19T09:41:36.249 INFO:tasks.workunit.client.0.smithi042.stdout:6/116: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:36.249 INFO:tasks.workunit.client.0.smithi042.stdout:3/134: rename d4/c15 to d4/d8/d9/d12/c31 0 2024-09-19T09:41:36.250 INFO:tasks.workunit.client.0.smithi042.stdout:4/85: creat d0/d1b/f23 x:0 0 0 2024-09-19T09:41:36.250 INFO:tasks.workunit.client.0.smithi042.stdout:4/86: stat d0/l12 0 2024-09-19T09:41:36.251 INFO:tasks.workunit.client.0.smithi042.stdout:6/117: mkdir d1/de/d12/d22 0 2024-09-19T09:41:36.251 INFO:tasks.workunit.client.0.smithi042.stdout:3/135: getdents d4/d8 0 2024-09-19T09:41:36.252 INFO:tasks.workunit.client.0.smithi042.stdout:3/136: fdatasync d4/d8/d9/dc/d26/f27 0 2024-09-19T09:41:36.252 INFO:tasks.workunit.client.0.smithi042.stdout:4/87: link d0/f19 d0/d1b/f24 0 2024-09-19T09:41:36.253 INFO:tasks.workunit.client.0.smithi042.stdout:7/116: rename d0/d14/f15 to d0/f27 0 2024-09-19T09:41:36.254 INFO:tasks.workunit.client.0.smithi042.stdout:3/137: creat d4/d8/d9/dc/d26/f32 x:0 0 0 2024-09-19T09:41:36.254 INFO:tasks.workunit.client.0.smithi042.stdout:6/118: dread d1/fc [0,4194304] 0 2024-09-19T09:41:36.254 INFO:tasks.workunit.client.0.smithi042.stdout:4/88: creat d0/d1b/d1c/f25 x:0 0 0 2024-09-19T09:41:36.255 INFO:tasks.workunit.client.0.smithi042.stdout:7/117: rename d0/f1e to d0/d14/f28 0 2024-09-19T09:41:36.256 INFO:tasks.workunit.client.0.smithi042.stdout:6/119: symlink d1/de/l23 0 2024-09-19T09:41:36.256 INFO:tasks.workunit.client.0.smithi042.stdout:6/120: truncate d1/de/d12/f19 487942 0 2024-09-19T09:41:36.256 INFO:tasks.workunit.client.0.smithi042.stdout:6/121: write d1/f18 [1102201,79249] 0 2024-09-19T09:41:36.256 INFO:tasks.workunit.client.0.smithi042.stdout:6/122: stat d1/cd 0 2024-09-19T09:41:36.257 INFO:tasks.workunit.client.0.smithi042.stdout:6/123: creat d1/f24 x:0 0 0 2024-09-19T09:41:36.260 INFO:tasks.workunit.client.0.smithi042.stdout:8/74: dwrite d1/f10 [0,4194304] 0 2024-09-19T09:41:36.260 INFO:tasks.workunit.client.0.smithi042.stdout:4/89: write d0/d1b/d1c/f1f [1338174,81633] 0 2024-09-19T09:41:36.260 INFO:tasks.workunit.client.0.smithi042.stdout:4/90: write d0/f19 [142390,92416] 0 2024-09-19T09:41:36.262 INFO:tasks.workunit.client.0.smithi042.stdout:6/124: fdatasync d1/f18 0 2024-09-19T09:41:36.262 INFO:tasks.workunit.client.0.smithi042.stdout:6/125: chown d1/de/l23 173632764 1 2024-09-19T09:41:36.262 INFO:tasks.workunit.client.0.smithi042.stdout:6/126: getdents d1/d20 0 2024-09-19T09:41:36.263 INFO:tasks.workunit.client.0.smithi042.stdout:4/91: creat d0/d1b/f26 x:0 0 0 2024-09-19T09:41:36.265 INFO:tasks.workunit.client.0.smithi042.stdout:5/89: dwrite d2/f1b [0,4194304] 0 2024-09-19T09:41:36.266 INFO:tasks.workunit.client.0.smithi042.stdout:2/77: dwrite d7/f10 [4194304,4194304] 0 2024-09-19T09:41:36.266 INFO:tasks.workunit.client.0.smithi042.stdout:2/78: fdatasync d7/fa 0 2024-09-19T09:41:36.268 INFO:tasks.workunit.client.0.smithi042.stdout:6/127: dread d1/fc [0,4194304] 0 2024-09-19T09:41:36.269 INFO:tasks.workunit.client.0.smithi042.stdout:6/128: readlink d1/de/l23 0 2024-09-19T09:41:36.270 INFO:tasks.workunit.client.0.smithi042.stdout:6/129: creat d1/de/d12/d22/f25 x:0 0 0 2024-09-19T09:41:36.270 INFO:tasks.workunit.client.0.smithi042.stdout:6/130: chown d1/cd 2 1 2024-09-19T09:41:36.271 INFO:tasks.workunit.client.0.smithi042.stdout:2/79: creat d7/dd/f12 x:0 0 0 2024-09-19T09:41:36.272 INFO:tasks.workunit.client.0.smithi042.stdout:6/131: getdents d1/de/d12/d1c 0 2024-09-19T09:41:36.272 INFO:tasks.workunit.client.0.smithi042.stdout:6/132: write d1/f24 [184025,39504] 0 2024-09-19T09:41:36.277 INFO:tasks.workunit.client.0.smithi042.stdout:6/133: dread d1/f24 [0,4194304] 0 2024-09-19T09:41:36.284 INFO:tasks.workunit.client.0.smithi042.stdout:6/134: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:36.287 INFO:tasks.workunit.client.0.smithi042.stdout:7/118: dwrite d0/fa [0,4194304] 0 2024-09-19T09:41:36.287 INFO:tasks.workunit.client.0.smithi042.stdout:7/119: read d0/f27 [604061,95297] 0 2024-09-19T09:41:36.287 INFO:tasks.workunit.client.0.smithi042.stdout:6/135: rename d1/c16 to d1/de/d12/d1c/c26 0 2024-09-19T09:41:36.294 INFO:tasks.workunit.client.0.smithi042.stdout:9/110: dwrite d8/da/f10 [0,4194304] 0 2024-09-19T09:41:36.295 INFO:tasks.workunit.client.0.smithi042.stdout:7/120: dread d0/f27 [0,4194304] 0 2024-09-19T09:41:36.295 INFO:tasks.workunit.client.0.smithi042.stdout:0/125: sync 2024-09-19T09:41:36.295 INFO:tasks.workunit.client.0.smithi042.stdout:1/117: sync 2024-09-19T09:41:36.296 INFO:tasks.workunit.client.0.smithi042.stdout:1/118: readlink - no filename 2024-09-19T09:41:36.296 INFO:tasks.workunit.client.0.smithi042.stdout:0/126: readlink d2/d10/l26 0 2024-09-19T09:41:36.299 INFO:tasks.workunit.client.0.smithi042.stdout:9/111: creat d8/da/f1e x:0 0 0 2024-09-19T09:41:36.299 INFO:tasks.workunit.client.0.smithi042.stdout:1/119: creat d4/d1d/d20/f24 x:0 0 0 2024-09-19T09:41:36.299 INFO:tasks.workunit.client.0.smithi042.stdout:1/120: read - d4/d15/f21 zero size 2024-09-19T09:41:36.301 INFO:tasks.workunit.client.0.smithi042.stdout:0/127: rename d2/d10/l11 to d2/d10/d12/d19/l28 0 2024-09-19T09:41:36.301 INFO:tasks.workunit.client.0.smithi042.stdout:0/128: chown d2/d10/f1b 158 1 2024-09-19T09:41:36.302 INFO:tasks.workunit.client.0.smithi042.stdout:1/121: mkdir d4/d1e/d25 0 2024-09-19T09:41:36.302 INFO:tasks.workunit.client.0.smithi042.stdout:1/122: chown d4/f13 1459 1 2024-09-19T09:41:36.303 INFO:tasks.workunit.client.0.smithi042.stdout:1/123: stat d4/d15/d19/f9 0 2024-09-19T09:41:36.303 INFO:tasks.workunit.client.0.smithi042.stdout:1/124: chown d4/d12/c1b 164361780 1 2024-09-19T09:41:36.303 INFO:tasks.workunit.client.0.smithi042.stdout:1/125: dread - d4/d15/d19/fc zero size 2024-09-19T09:41:36.304 INFO:tasks.workunit.client.0.smithi042.stdout:0/129: creat d2/d10/d12/d24/f29 x:0 0 0 2024-09-19T09:41:36.304 INFO:tasks.workunit.client.0.smithi042.stdout:0/130: fsync d2/fa 0 2024-09-19T09:41:36.304 INFO:tasks.workunit.client.0.smithi042.stdout:1/126: mknod d4/d15/c26 0 2024-09-19T09:41:36.305 INFO:tasks.workunit.client.0.smithi042.stdout:0/131: symlink d2/d10/d12/d24/l2a 0 2024-09-19T09:41:36.305 INFO:tasks.workunit.client.0.smithi042.stdout:0/132: fdatasync d2/d10/d12/d16/d18/f22 0 2024-09-19T09:41:36.306 INFO:tasks.workunit.client.0.smithi042.stdout:1/127: getdents d4/d1d 0 2024-09-19T09:41:36.307 INFO:tasks.workunit.client.0.smithi042.stdout:1/128: truncate d4/d15/d19/f16 163906 0 2024-09-19T09:41:36.307 INFO:tasks.workunit.client.0.smithi042.stdout:6/136: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:41:36.307 INFO:tasks.workunit.client.0.smithi042.stdout:6/137: fsync d1/de/d12/f19 0 2024-09-19T09:41:36.307 INFO:tasks.workunit.client.0.smithi042.stdout:0/133: link d2/fc d2/d10/d1d/f2b 0 2024-09-19T09:41:36.308 INFO:tasks.workunit.client.0.smithi042.stdout:1/129: symlink d4/d15/l27 0 2024-09-19T09:41:36.309 INFO:tasks.workunit.client.0.smithi042.stdout:6/138: creat d1/d20/f27 x:0 0 0 2024-09-19T09:41:36.310 INFO:tasks.workunit.client.0.smithi042.stdout:8/75: dwrite d1/f9 [0,4194304] 0 2024-09-19T09:41:36.310 INFO:tasks.workunit.client.0.smithi042.stdout:1/130: creat d4/d1e/d25/f28 x:0 0 0 2024-09-19T09:41:36.310 INFO:tasks.workunit.client.0.smithi042.stdout:1/131: chown d4/d15/d19/f9 75 1 2024-09-19T09:41:36.311 INFO:tasks.workunit.client.0.smithi042.stdout:1/132: mkdir d4/d29 0 2024-09-19T09:41:36.315 INFO:tasks.workunit.client.0.smithi042.stdout:9/112: dwrite d8/f1a [0,4194304] 0 2024-09-19T09:41:36.315 INFO:tasks.workunit.client.0.smithi042.stdout:9/113: chown d8/da 96 1 2024-09-19T09:41:36.317 INFO:tasks.workunit.client.0.smithi042.stdout:9/114: truncate d8/fe 2849408 0 2024-09-19T09:41:36.317 INFO:tasks.workunit.client.0.smithi042.stdout:9/115: chown d8/da/f1e 445496 1 2024-09-19T09:41:36.317 INFO:tasks.workunit.client.0.smithi042.stdout:9/116: truncate d8/da/f1e 735850 0 2024-09-19T09:41:36.317 INFO:tasks.workunit.client.0.smithi042.stdout:9/117: fdatasync f1 0 2024-09-19T09:41:36.318 INFO:tasks.workunit.client.0.smithi042.stdout:8/76: dread d1/f8 [0,4194304] 0 2024-09-19T09:41:36.318 INFO:tasks.workunit.client.0.smithi042.stdout:9/118: creat d8/d1d/f1f x:0 0 0 2024-09-19T09:41:36.318 INFO:tasks.workunit.client.0.smithi042.stdout:9/119: write d8/da/d19/f1b [495331,92773] 0 2024-09-19T09:41:36.318 INFO:tasks.workunit.client.0.smithi042.stdout:9/120: rename d8/da/d19 to d8/da/d19/d20 22 2024-09-19T09:41:36.319 INFO:tasks.workunit.client.0.smithi042.stdout:3/138: dwrite d4/d8/f1c [4194304,4194304] 0 2024-09-19T09:41:36.319 INFO:tasks.workunit.client.0.smithi042.stdout:3/139: chown d4/d8/d9/d12 1335330 1 2024-09-19T09:41:36.319 INFO:tasks.workunit.client.0.smithi042.stdout:3/140: dread - d4/d8/f19 zero size 2024-09-19T09:41:36.319 INFO:tasks.workunit.client.0.smithi042.stdout:3/141: read - d4/d8/d9/dc/f2b zero size 2024-09-19T09:41:36.321 INFO:tasks.workunit.client.0.smithi042.stdout:6/139: write d1/f18 [788970,62823] 0 2024-09-19T09:41:36.321 INFO:tasks.workunit.client.0.smithi042.stdout:6/140: write d1/f6 [3193130,1353] 0 2024-09-19T09:41:36.321 INFO:tasks.workunit.client.0.smithi042.stdout:3/142: link d4/d8/d9/dc/d26/f27 d4/d8/f33 0 2024-09-19T09:41:36.321 INFO:tasks.workunit.client.0.smithi042.stdout:3/143: dread - d4/d8/d9/dc/d26/f32 zero size 2024-09-19T09:41:36.322 INFO:tasks.workunit.client.0.smithi042.stdout:6/141: creat d1/de/f28 x:0 0 0 2024-09-19T09:41:36.324 INFO:tasks.workunit.client.0.smithi042.stdout:6/142: unlink d1/de/l23 0 2024-09-19T09:41:36.325 INFO:tasks.workunit.client.0.smithi042.stdout:4/92: dwrite d0/fb [0,4194304] 0 2024-09-19T09:41:36.327 INFO:tasks.workunit.client.0.smithi042.stdout:3/144: write d4/d8/d9/f1e [2954872,120474] 0 2024-09-19T09:41:36.329 INFO:tasks.workunit.client.0.smithi042.stdout:3/145: creat d4/f34 x:0 0 0 2024-09-19T09:41:36.331 INFO:tasks.workunit.client.0.smithi042.stdout:3/146: mkdir d4/d8/d9/dc/d26/d35 0 2024-09-19T09:41:36.334 INFO:tasks.workunit.client.0.smithi042.stdout:0/134: getdents d2/d10/d1d 0 2024-09-19T09:41:36.335 INFO:tasks.workunit.client.0.smithi042.stdout:8/77: dwrite d1/f10 [0,4194304] 0 2024-09-19T09:41:36.336 INFO:tasks.workunit.client.0.smithi042.stdout:8/78: write d1/da/f12 [963215,2211] 0 2024-09-19T09:41:36.338 INFO:tasks.workunit.client.0.smithi042.stdout:6/143: dread d1/f18 [0,4194304] 0 2024-09-19T09:41:36.338 INFO:tasks.workunit.client.0.smithi042.stdout:6/144: fdatasync d1/de/d12/d22/f25 0 2024-09-19T09:41:36.338 INFO:tasks.workunit.client.0.smithi042.stdout:0/135: symlink d2/d10/d12/d19/l2c 0 2024-09-19T09:41:36.338 INFO:tasks.workunit.client.0.smithi042.stdout:0/136: write d2/d10/f1b [148256,18130] 0 2024-09-19T09:41:36.338 INFO:tasks.workunit.client.0.smithi042.stdout:8/79: creat d1/da/f13 x:0 0 0 2024-09-19T09:41:36.339 INFO:tasks.workunit.client.0.smithi042.stdout:0/137: creat d2/d10/d12/d16/f2d x:0 0 0 2024-09-19T09:41:36.340 INFO:tasks.workunit.client.0.smithi042.stdout:9/121: read d8/da/f10 [2088215,119991] 0 2024-09-19T09:41:36.340 INFO:tasks.workunit.client.0.smithi042.stdout:5/90: dwrite d2/db/f10 [4194304,4194304] 0 2024-09-19T09:41:36.340 INFO:tasks.workunit.client.0.smithi042.stdout:8/80: mkdir d1/da/d14 0 2024-09-19T09:41:36.340 INFO:tasks.workunit.client.0.smithi042.stdout:8/81: dread - d1/da/dd/ff zero size 2024-09-19T09:41:36.341 INFO:tasks.workunit.client.0.smithi042.stdout:0/138: mkdir d2/d10/d12/d2e 0 2024-09-19T09:41:36.341 INFO:tasks.workunit.client.0.smithi042.stdout:0/139: write d2/d10/d1d/f25 [652457,79381] 0 2024-09-19T09:41:36.341 INFO:tasks.workunit.client.0.smithi042.stdout:2/80: dwrite d7/fa [0,4194304] 0 2024-09-19T09:41:36.341 INFO:tasks.workunit.client.0.smithi042.stdout:5/91: mknod d2/d4/d20/c21 0 2024-09-19T09:41:36.342 INFO:tasks.workunit.client.0.smithi042.stdout:1/133: dwrite d4/d1e/d25/f28 [0,4194304] 0 2024-09-19T09:41:36.342 INFO:tasks.workunit.client.0.smithi042.stdout:1/134: readlink d4/d15/l27 0 2024-09-19T09:41:36.342 INFO:tasks.workunit.client.0.smithi042.stdout:0/140: unlink d2/fa 0 2024-09-19T09:41:36.344 INFO:tasks.workunit.client.0.smithi042.stdout:2/81: mknod d7/dd/c13 0 2024-09-19T09:41:36.344 INFO:tasks.workunit.client.0.smithi042.stdout:4/93: dread d0/f14 [0,4194304] 0 2024-09-19T09:41:36.344 INFO:tasks.workunit.client.0.smithi042.stdout:4/94: chown d0/fb 506465318 1 2024-09-19T09:41:36.345 INFO:tasks.workunit.client.0.smithi042.stdout:1/135: symlink d4/d1e/d25/l2a 0 2024-09-19T09:41:36.345 INFO:tasks.workunit.client.0.smithi042.stdout:6/145: write d1/fc [1555947,36714] 0 2024-09-19T09:41:36.345 INFO:tasks.workunit.client.0.smithi042.stdout:6/146: fdatasync d1/f24 0 2024-09-19T09:41:36.345 INFO:tasks.workunit.client.0.smithi042.stdout:6/147: dread - d1/de/f28 zero size 2024-09-19T09:41:36.345 INFO:tasks.workunit.client.0.smithi042.stdout:6/148: stat d1/de/d12/f19 0 2024-09-19T09:41:36.346 INFO:tasks.workunit.client.0.smithi042.stdout:6/149: stat d1/de/d12/d22/f25 0 2024-09-19T09:41:36.346 INFO:tasks.workunit.client.0.smithi042.stdout:0/141: rmdir d2/d10/d12/d24 39 2024-09-19T09:41:36.346 INFO:tasks.workunit.client.0.smithi042.stdout:2/82: mkdir d7/dd/d14 0 2024-09-19T09:41:36.353 INFO:tasks.workunit.client.0.smithi042.stdout:0/142: link d2/fd d2/d10/d12/d16/f2f 0 2024-09-19T09:41:36.353 INFO:tasks.workunit.client.0.smithi042.stdout:0/143: read - d2/d10/d12/d16/f2d zero size 2024-09-19T09:41:36.354 INFO:tasks.workunit.client.0.smithi042.stdout:4/95: symlink d0/l27 0 2024-09-19T09:41:36.355 INFO:tasks.workunit.client.0.smithi042.stdout:1/136: write d4/f10 [2031846,70622] 0 2024-09-19T09:41:36.355 INFO:tasks.workunit.client.0.smithi042.stdout:6/150: dread d1/f18 [0,4194304] 0 2024-09-19T09:41:36.356 INFO:tasks.workunit.client.0.smithi042.stdout:4/96: truncate d0/f14 1555292 0 2024-09-19T09:41:36.356 INFO:tasks.workunit.client.0.smithi042.stdout:4/97: truncate d0/d1b/f23 233351 0 2024-09-19T09:41:36.356 INFO:tasks.workunit.client.0.smithi042.stdout:4/98: write d0/fc [4546982,129151] 0 2024-09-19T09:41:36.356 INFO:tasks.workunit.client.0.smithi042.stdout:4/99: read - d0/d1b/d1c/f25 zero size 2024-09-19T09:41:36.356 INFO:tasks.workunit.client.0.smithi042.stdout:4/100: write d0/fc [5660591,97] 0 2024-09-19T09:41:36.356 INFO:tasks.workunit.client.0.smithi042.stdout:6/151: mknod d1/d20/c29 0 2024-09-19T09:41:36.356 INFO:tasks.workunit.client.0.smithi042.stdout:3/147: dwrite d4/d8/f33 [0,4194304] 0 2024-09-19T09:41:36.361 INFO:tasks.workunit.client.0.smithi042.stdout:3/148: creat d4/d8/f36 x:0 0 0 2024-09-19T09:41:36.361 INFO:tasks.workunit.client.0.smithi042.stdout:3/149: chown d4/d8/d9/l2f 1 1 2024-09-19T09:41:36.362 INFO:tasks.workunit.client.0.smithi042.stdout:4/101: mkdir d0/d28 0 2024-09-19T09:41:36.363 INFO:tasks.workunit.client.0.smithi042.stdout:8/82: dwrite d1/f10 [0,4194304] 0 2024-09-19T09:41:36.365 INFO:tasks.workunit.client.0.smithi042.stdout:3/150: mknod d4/d2a/c37 0 2024-09-19T09:41:36.368 INFO:tasks.workunit.client.0.smithi042.stdout:8/83: unlink d1/fc 0 2024-09-19T09:41:36.369 INFO:tasks.workunit.client.0.smithi042.stdout:9/122: dwrite d8/f15 [0,4194304] 0 2024-09-19T09:41:36.369 INFO:tasks.workunit.client.0.smithi042.stdout:3/151: symlink d4/d8/d9/dc/l38 0 2024-09-19T09:41:36.372 INFO:tasks.workunit.client.0.smithi042.stdout:4/102: rename d0/f18 to d0/d1b/d1c/f29 0 2024-09-19T09:41:36.373 INFO:tasks.workunit.client.0.smithi042.stdout:0/144: getdents d2 0 2024-09-19T09:41:36.373 INFO:tasks.workunit.client.0.smithi042.stdout:0/145: read - d2/fb zero size 2024-09-19T09:41:36.374 INFO:tasks.workunit.client.0.smithi042.stdout:4/103: dread d0/d1b/f24 [0,4194304] 0 2024-09-19T09:41:36.375 INFO:tasks.workunit.client.0.smithi042.stdout:9/123: truncate d8/fe 702013 0 2024-09-19T09:41:36.377 INFO:tasks.workunit.client.0.smithi042.stdout:3/152: mkdir d4/d8/d9/d39 0 2024-09-19T09:41:36.379 INFO:tasks.workunit.client.0.smithi042.stdout:4/104: creat d0/d1b/f2a x:0 0 0 2024-09-19T09:41:36.379 INFO:tasks.workunit.client.0.smithi042.stdout:4/105: write d0/d1b/f23 [826898,73025] 0 2024-09-19T09:41:36.379 INFO:tasks.workunit.client.0.smithi042.stdout:4/106: fsync d0/d1b/f26 0 2024-09-19T09:41:36.379 INFO:tasks.workunit.client.0.smithi042.stdout:4/107: dread - d0/d1b/d1c/f25 zero size 2024-09-19T09:41:36.379 INFO:tasks.workunit.client.0.smithi042.stdout:4/108: chown d0/d1b/d1c/f1f 147514720 1 2024-09-19T09:41:36.380 INFO:tasks.workunit.client.0.smithi042.stdout:4/109: stat d0/d1b/f24 0 2024-09-19T09:41:36.380 INFO:tasks.workunit.client.0.smithi042.stdout:4/110: chown d0/d1b/f1e 0 1 2024-09-19T09:41:36.381 INFO:tasks.workunit.client.0.smithi042.stdout:4/111: write d0/f16 [1997609,101170] 0 2024-09-19T09:41:36.381 INFO:tasks.workunit.client.0.smithi042.stdout:4/112: truncate d0/f19 1132600 0 2024-09-19T09:41:36.382 INFO:tasks.workunit.client.0.smithi042.stdout:0/146: dread d2/fd [0,4194304] 0 2024-09-19T09:41:36.386 INFO:tasks.workunit.client.0.smithi042.stdout:8/84: dread d1/f9 [0,4194304] 0 2024-09-19T09:41:36.388 INFO:tasks.workunit.client.0.smithi042.stdout:8/85: creat d1/da/d14/f15 x:0 0 0 2024-09-19T09:41:36.388 INFO:tasks.workunit.client.0.smithi042.stdout:8/86: readlink d1/l3 0 2024-09-19T09:41:36.388 INFO:tasks.workunit.client.0.smithi042.stdout:8/87: stat d1/f8 0 2024-09-19T09:41:36.388 INFO:tasks.workunit.client.0.smithi042.stdout:8/88: truncate d1/da/dd/ff 578655 0 2024-09-19T09:41:36.390 INFO:tasks.workunit.client.0.smithi042.stdout:8/89: unlink d1/da/c11 0 2024-09-19T09:41:36.390 INFO:tasks.workunit.client.0.smithi042.stdout:8/90: truncate d1/da/dd/ff 1166164 0 2024-09-19T09:41:36.392 INFO:tasks.workunit.client.0.smithi042.stdout:8/91: rename d1/f2 to d1/da/dd/f16 0 2024-09-19T09:41:36.394 INFO:tasks.workunit.client.0.smithi042.stdout:0/147: write f0 [1282822,45542] 0 2024-09-19T09:41:36.395 INFO:tasks.workunit.client.0.smithi042.stdout:8/92: rename d1/f8 to d1/da/d14/f17 0 2024-09-19T09:41:36.395 INFO:tasks.workunit.client.0.smithi042.stdout:3/153: dwrite d4/d8/d9/dc/d26/f27 [0,4194304] 0 2024-09-19T09:41:36.397 INFO:tasks.workunit.client.0.smithi042.stdout:0/148: link d2/fb d2/d10/d1d/f30 0 2024-09-19T09:41:36.397 INFO:tasks.workunit.client.0.smithi042.stdout:0/149: fsync d2/fd 0 2024-09-19T09:41:36.397 INFO:tasks.workunit.client.0.smithi042.stdout:0/150: write f0 [3641723,65620] 0 2024-09-19T09:41:36.397 INFO:tasks.workunit.client.0.smithi042.stdout:0/151: truncate d2/d10/d1d/f25 1460690 0 2024-09-19T09:41:36.399 INFO:tasks.workunit.client.0.smithi042.stdout:3/154: dread d4/ff [0,4194304] 0 2024-09-19T09:41:36.405 INFO:tasks.workunit.client.0.smithi042.stdout:0/152: dread f0 [0,4194304] 0 2024-09-19T09:41:36.405 INFO:tasks.workunit.client.0.smithi042.stdout:8/93: link d1/f10 d1/f18 0 2024-09-19T09:41:36.407 INFO:tasks.workunit.client.0.smithi042.stdout:9/124: unlink d8/fe 0 2024-09-19T09:41:36.407 INFO:tasks.workunit.client.0.smithi042.stdout:9/125: readlink d8/db/l12 0 2024-09-19T09:41:36.407 INFO:tasks.workunit.client.0.smithi042.stdout:9/126: stat f5 0 2024-09-19T09:41:36.407 INFO:tasks.workunit.client.0.smithi042.stdout:9/127: write d8/da/f10 [2660450,19645] 0 2024-09-19T09:41:36.408 INFO:tasks.workunit.client.0.smithi042.stdout:0/153: creat d2/d10/d12/f31 x:0 0 0 2024-09-19T09:41:36.408 INFO:tasks.workunit.client.0.smithi042.stdout:0/154: chown d2/l14 2515473 1 2024-09-19T09:41:36.410 INFO:tasks.workunit.client.0.smithi042.stdout:0/155: mkdir d2/d10/d12/d2e/d32 0 2024-09-19T09:41:36.412 INFO:tasks.workunit.client.0.smithi042.stdout:0/156: symlink d2/d10/d1e/l33 0 2024-09-19T09:41:36.412 INFO:tasks.workunit.client.0.smithi042.stdout:0/157: readlink d2/d10/d12/d19/l2c 0 2024-09-19T09:41:36.417 INFO:tasks.workunit.client.0.smithi042.stdout:8/94: write d1/f9 [1888861,62373] 0 2024-09-19T09:41:36.418 INFO:tasks.workunit.client.0.smithi042.stdout:8/95: getdents d1/da 0 2024-09-19T09:41:36.423 INFO:tasks.workunit.client.0.smithi042.stdout:7/121: sync 2024-09-19T09:41:36.425 INFO:tasks.workunit.client.0.smithi042.stdout:7/122: rename d0/l7 to d0/d14/l29 0 2024-09-19T09:41:36.427 INFO:tasks.workunit.client.0.smithi042.stdout:7/123: creat d0/d14/f2a x:0 0 0 2024-09-19T09:41:36.427 INFO:tasks.workunit.client.0.smithi042.stdout:3/155: dwrite d4/d8/d9/f1e [0,4194304] 0 2024-09-19T09:41:36.428 INFO:tasks.workunit.client.0.smithi042.stdout:7/124: rmdir d0 39 2024-09-19T09:41:36.430 INFO:tasks.workunit.client.0.smithi042.stdout:7/125: mknod d0/c2b 0 2024-09-19T09:41:36.436 INFO:tasks.workunit.client.0.smithi042.stdout:7/126: dread d0/f27 [0,4194304] 0 2024-09-19T09:41:36.436 INFO:tasks.workunit.client.0.smithi042.stdout:7/127: chown d0/f25 108 1 2024-09-19T09:41:36.436 INFO:tasks.workunit.client.0.smithi042.stdout:9/128: dwrite d8/da/d19/f1b [0,4194304] 0 2024-09-19T09:41:36.437 INFO:tasks.workunit.client.0.smithi042.stdout:0/158: dwrite d2/fc [0,4194304] 0 2024-09-19T09:41:36.437 INFO:tasks.workunit.client.0.smithi042.stdout:3/156: dread d4/d8/d9/dc/d26/f27 [0,4194304] 0 2024-09-19T09:41:36.437 INFO:tasks.workunit.client.0.smithi042.stdout:3/157: stat d4/d8/d9/l2f 0 2024-09-19T09:41:36.437 INFO:tasks.workunit.client.0.smithi042.stdout:8/96: dwrite d1/da/f12 [0,4194304] 0 2024-09-19T09:41:36.437 INFO:tasks.workunit.client.0.smithi042.stdout:8/97: write d1/f18 [4261001,2201] 0 2024-09-19T09:41:36.437 INFO:tasks.workunit.client.0.smithi042.stdout:8/98: write d1/da/d14/f17 [1285799,35453] 0 2024-09-19T09:41:36.439 INFO:tasks.workunit.client.0.smithi042.stdout:9/129: mkdir d8/da/d19/d1c/d21 0 2024-09-19T09:41:36.441 INFO:tasks.workunit.client.0.smithi042.stdout:0/159: mkdir d2/d10/d1d/d34 0 2024-09-19T09:41:36.442 INFO:tasks.workunit.client.0.smithi042.stdout:0/160: write f1 [3261887,76680] 0 2024-09-19T09:41:36.443 INFO:tasks.workunit.client.0.smithi042.stdout:7/128: rename d0/c16 to d0/c2c 0 2024-09-19T09:41:36.445 INFO:tasks.workunit.client.0.smithi042.stdout:3/158: unlink d4/d8/d9/d1b/c22 0 2024-09-19T09:41:36.445 INFO:tasks.workunit.client.0.smithi042.stdout:8/99: rmdir d1 39 2024-09-19T09:41:36.447 INFO:tasks.workunit.client.0.smithi042.stdout:0/161: rmdir d2/d10/d1d 39 2024-09-19T09:41:36.447 INFO:tasks.workunit.client.0.smithi042.stdout:0/162: fdatasync d2/d10/d1d/f2b 0 2024-09-19T09:41:36.447 INFO:tasks.workunit.client.0.smithi042.stdout:9/130: dread f1 [0,4194304] 0 2024-09-19T09:41:36.448 INFO:tasks.workunit.client.0.smithi042.stdout:7/129: unlink d0/c1f 0 2024-09-19T09:41:36.448 INFO:tasks.workunit.client.0.smithi042.stdout:7/130: chown d0/f26 124 1 2024-09-19T09:41:36.448 INFO:tasks.workunit.client.0.smithi042.stdout:7/131: chown d0/f27 21575994 1 2024-09-19T09:41:36.449 INFO:tasks.workunit.client.0.smithi042.stdout:3/159: mknod d4/d2a/c3a 0 2024-09-19T09:41:36.449 INFO:tasks.workunit.client.0.smithi042.stdout:3/160: stat f0 0 2024-09-19T09:41:36.449 INFO:tasks.workunit.client.0.smithi042.stdout:8/100: symlink d1/da/d14/l19 0 2024-09-19T09:41:36.449 INFO:tasks.workunit.client.0.smithi042.stdout:8/101: dread - d1/da/d14/f15 zero size 2024-09-19T09:41:36.450 INFO:tasks.workunit.client.0.smithi042.stdout:8/102: chown d1/da/d14/f15 30 1 2024-09-19T09:41:36.450 INFO:tasks.workunit.client.0.smithi042.stdout:0/163: creat d2/d10/d1d/f35 x:0 0 0 2024-09-19T09:41:36.450 INFO:tasks.workunit.client.0.smithi042.stdout:0/164: chown d2/d10/d12/d2e 1185 1 2024-09-19T09:41:36.450 INFO:tasks.workunit.client.0.smithi042.stdout:0/165: write f1 [4099017,111327] 0 2024-09-19T09:41:36.451 INFO:tasks.workunit.client.0.smithi042.stdout:3/161: truncate f0 5214698 0 2024-09-19T09:41:36.451 INFO:tasks.workunit.client.0.smithi042.stdout:8/103: creat d1/da/d14/f1a x:0 0 0 2024-09-19T09:41:36.452 INFO:tasks.workunit.client.0.smithi042.stdout:0/166: mknod d2/d10/d1d/d34/c36 0 2024-09-19T09:41:36.452 INFO:tasks.workunit.client.0.smithi042.stdout:0/167: chown d2/d10/d1d/d34 32 1 2024-09-19T09:41:36.452 INFO:tasks.workunit.client.0.smithi042.stdout:0/168: dread - d2/d10/d12/d16/d18/f22 zero size 2024-09-19T09:41:36.453 INFO:tasks.workunit.client.0.smithi042.stdout:8/104: creat d1/da/f1b x:0 0 0 2024-09-19T09:41:36.454 INFO:tasks.workunit.client.0.smithi042.stdout:0/169: getdents d2/d10/d12/d16/d18 0 2024-09-19T09:41:36.456 INFO:tasks.workunit.client.0.smithi042.stdout:9/131: dread d8/f11 [0,4194304] 0 2024-09-19T09:41:36.456 INFO:tasks.workunit.client.0.smithi042.stdout:9/132: stat d8/f15 0 2024-09-19T09:41:36.459 INFO:tasks.workunit.client.0.smithi042.stdout:0/170: getdents d2/d10/d12 0 2024-09-19T09:41:36.461 INFO:tasks.workunit.client.0.smithi042.stdout:9/133: link d8/f15 d8/db/f22 0 2024-09-19T09:41:36.463 INFO:tasks.workunit.client.0.smithi042.stdout:0/171: symlink d2/d10/l37 0 2024-09-19T09:41:36.464 INFO:tasks.workunit.client.0.smithi042.stdout:9/134: truncate f1 2882853 0 2024-09-19T09:41:36.464 INFO:tasks.workunit.client.0.smithi042.stdout:7/132: dwrite d0/d14/f2a [0,4194304] 0 2024-09-19T09:41:36.465 INFO:tasks.workunit.client.0.smithi042.stdout:8/105: link d1/l5 d1/l1c 0 2024-09-19T09:41:36.466 INFO:tasks.workunit.client.0.smithi042.stdout:0/172: mknod d2/d10/d1d/c38 0 2024-09-19T09:41:36.467 INFO:tasks.workunit.client.0.smithi042.stdout:9/135: symlink d8/da/d19/d1c/l23 0 2024-09-19T09:41:36.467 INFO:tasks.workunit.client.0.smithi042.stdout:9/136: chown d8/db/l13 80 1 2024-09-19T09:41:36.467 INFO:tasks.workunit.client.0.smithi042.stdout:9/137: readlink d8/da/d19/d1c/l23 0 2024-09-19T09:41:36.467 INFO:tasks.workunit.client.0.smithi042.stdout:9/138: dread - d8/d1d/f1f zero size 2024-09-19T09:41:36.469 INFO:tasks.workunit.client.0.smithi042.stdout:8/106: unlink d1/l5 0 2024-09-19T09:41:36.469 INFO:tasks.workunit.client.0.smithi042.stdout:9/139: creat d8/f24 x:0 0 0 2024-09-19T09:41:36.470 INFO:tasks.workunit.client.0.smithi042.stdout:9/140: rmdir d8/d1d 39 2024-09-19T09:41:36.472 INFO:tasks.workunit.client.0.smithi042.stdout:8/107: symlink d1/l1d 0 2024-09-19T09:41:36.473 INFO:tasks.workunit.client.0.smithi042.stdout:9/141: truncate d8/f1a 424080 0 2024-09-19T09:41:36.474 INFO:tasks.workunit.client.0.smithi042.stdout:8/108: getdents d1/da 0 2024-09-19T09:41:36.476 INFO:tasks.workunit.client.0.smithi042.stdout:9/142: symlink d8/l25 0 2024-09-19T09:41:36.476 INFO:tasks.workunit.client.0.smithi042.stdout:9/143: dread d8/da/f1e [0,4194304] 0 2024-09-19T09:41:36.477 INFO:tasks.workunit.client.0.smithi042.stdout:9/144: creat d8/db/f26 x:0 0 0 2024-09-19T09:41:36.478 INFO:tasks.workunit.client.0.smithi042.stdout:9/145: getdents d8/da/d19 0 2024-09-19T09:41:36.479 INFO:tasks.workunit.client.0.smithi042.stdout:9/146: symlink d8/db/l27 0 2024-09-19T09:41:36.480 INFO:tasks.workunit.client.0.smithi042.stdout:9/147: mkdir d8/d1d/d28 0 2024-09-19T09:41:36.480 INFO:tasks.workunit.client.0.smithi042.stdout:9/148: write d8/db/f26 [761951,90852] 0 2024-09-19T09:41:36.482 INFO:tasks.workunit.client.0.smithi042.stdout:9/149: symlink d8/da/d19/l29 0 2024-09-19T09:41:36.483 INFO:tasks.workunit.client.0.smithi042.stdout:9/150: creat d8/da/d19/f2a x:0 0 0 2024-09-19T09:41:36.484 INFO:tasks.workunit.client.0.smithi042.stdout:7/133: dwrite d0/d14/f28 [0,4194304] 0 2024-09-19T09:41:36.484 INFO:tasks.workunit.client.0.smithi042.stdout:8/109: getdents d1 0 2024-09-19T09:41:36.484 INFO:tasks.workunit.client.0.smithi042.stdout:9/151: rmdir d8/d1d 39 2024-09-19T09:41:36.486 INFO:tasks.workunit.client.0.smithi042.stdout:5/92: sync 2024-09-19T09:41:36.486 INFO:tasks.workunit.client.0.smithi042.stdout:2/83: sync 2024-09-19T09:41:36.487 INFO:tasks.workunit.client.0.smithi042.stdout:2/84: rename d7/fa to d7/dd/f15 0 2024-09-19T09:41:36.488 INFO:tasks.workunit.client.0.smithi042.stdout:2/85: truncate d7/f10 5972546 0 2024-09-19T09:41:36.488 INFO:tasks.workunit.client.0.smithi042.stdout:2/86: chown d7/dd/c13 145327 1 2024-09-19T09:41:36.489 INFO:tasks.workunit.client.0.smithi042.stdout:8/110: link d1/l1d d1/da/d14/l1e 0 2024-09-19T09:41:36.490 INFO:tasks.workunit.client.0.smithi042.stdout:0/173: dwrite d2/d10/d1d/f35 [0,4194304] 0 2024-09-19T09:41:36.490 INFO:tasks.workunit.client.0.smithi042.stdout:0/174: stat d2/d10/d1d/f2b 0 2024-09-19T09:41:36.490 INFO:tasks.workunit.client.0.smithi042.stdout:0/175: chown d2/d10/d1d/f2b 4 1 2024-09-19T09:41:36.491 INFO:tasks.workunit.client.0.smithi042.stdout:9/152: rmdir d8/da/d19/d1c 39 2024-09-19T09:41:36.491 INFO:tasks.workunit.client.0.smithi042.stdout:9/153: write d8/f11 [4230017,48998] 0 2024-09-19T09:41:36.491 INFO:tasks.workunit.client.0.smithi042.stdout:9/154: chown d8/da/d19/d1c/l23 2 1 2024-09-19T09:41:36.493 INFO:tasks.workunit.client.0.smithi042.stdout:5/93: getdents d2/d4/d20 0 2024-09-19T09:41:36.493 INFO:tasks.workunit.client.0.smithi042.stdout:7/134: mknod d0/c2d 0 2024-09-19T09:41:36.494 INFO:tasks.workunit.client.0.smithi042.stdout:5/94: dread - d2/f1e zero size 2024-09-19T09:41:36.494 INFO:tasks.workunit.client.0.smithi042.stdout:5/95: truncate d2/dc/f1a 736203 0 2024-09-19T09:41:36.502 INFO:tasks.workunit.client.0.smithi042.stdout:7/135: symlink d0/d14/l2e 0 2024-09-19T09:41:36.503 INFO:tasks.workunit.client.0.smithi042.stdout:8/111: symlink d1/da/d14/l1f 0 2024-09-19T09:41:36.504 INFO:tasks.workunit.client.0.smithi042.stdout:8/112: mknod d1/da/dd/c20 0 2024-09-19T09:41:36.504 INFO:tasks.workunit.client.0.smithi042.stdout:8/113: write d1/f7 [5058271,7912] 0 2024-09-19T09:41:36.505 INFO:tasks.workunit.client.0.smithi042.stdout:8/114: creat d1/da/f21 x:0 0 0 2024-09-19T09:41:36.507 INFO:tasks.workunit.client.0.smithi042.stdout:8/115: unlink d1/da/d14/f15 0 2024-09-19T09:41:36.507 INFO:tasks.workunit.client.0.smithi042.stdout:8/116: stat d1/f7 0 2024-09-19T09:41:36.512 INFO:tasks.workunit.client.0.smithi042.stdout:0/176: dread d2/d10/d1d/f35 [0,4194304] 0 2024-09-19T09:41:36.518 INFO:tasks.workunit.client.0.smithi042.stdout:9/155: dwrite d8/f11 [4194304,4194304] 0 2024-09-19T09:41:36.522 INFO:tasks.workunit.client.0.smithi042.stdout:5/96: dwrite d2/f7 [0,4194304] 0 2024-09-19T09:41:36.523 INFO:tasks.workunit.client.0.smithi042.stdout:2/87: dwrite d7/f8 [0,4194304] 0 2024-09-19T09:41:36.523 INFO:tasks.workunit.client.0.smithi042.stdout:2/88: stat f2 0 2024-09-19T09:41:36.523 INFO:tasks.workunit.client.0.smithi042.stdout:2/89: readlink d7/lf 0 2024-09-19T09:41:36.524 INFO:tasks.workunit.client.0.smithi042.stdout:2/90: chown d7/dd/f12 106796 1 2024-09-19T09:41:36.524 INFO:tasks.workunit.client.0.smithi042.stdout:5/97: symlink d2/dc/l22 0 2024-09-19T09:41:36.525 INFO:tasks.workunit.client.0.smithi042.stdout:2/91: rename d7/f8 to d7/dd/f16 0 2024-09-19T09:41:36.526 INFO:tasks.workunit.client.0.smithi042.stdout:2/92: creat d7/f17 x:0 0 0 2024-09-19T09:41:36.527 INFO:tasks.workunit.client.0.smithi042.stdout:8/117: truncate d1/f9 4694595 0 2024-09-19T09:41:36.529 INFO:tasks.workunit.client.0.smithi042.stdout:7/136: dwrite d0/fb [0,4194304] 0 2024-09-19T09:41:36.529 INFO:tasks.workunit.client.0.smithi042.stdout:7/137: write d0/f26 [959199,66078] 0 2024-09-19T09:41:36.529 INFO:tasks.workunit.client.0.smithi042.stdout:9/156: dread d8/da/f10 [0,4194304] 0 2024-09-19T09:41:36.529 INFO:tasks.workunit.client.0.smithi042.stdout:5/98: truncate d2/db/f10 108630 0 2024-09-19T09:41:36.530 INFO:tasks.workunit.client.0.smithi042.stdout:9/157: creat d8/da/d19/f2b x:0 0 0 2024-09-19T09:41:36.531 INFO:tasks.workunit.client.0.smithi042.stdout:5/99: creat d2/d4/d20/d11/f23 x:0 0 0 2024-09-19T09:41:36.531 INFO:tasks.workunit.client.0.smithi042.stdout:5/100: fdatasync d2/dc/f1d 0 2024-09-19T09:41:36.531 INFO:tasks.workunit.client.0.smithi042.stdout:8/118: mknod d1/c22 0 2024-09-19T09:41:36.532 INFO:tasks.workunit.client.0.smithi042.stdout:7/138: mknod d0/c2f 0 2024-09-19T09:41:36.533 INFO:tasks.workunit.client.0.smithi042.stdout:9/158: creat d8/f2c x:0 0 0 2024-09-19T09:41:36.533 INFO:tasks.workunit.client.0.smithi042.stdout:9/159: write d8/f15 [5107994,112432] 0 2024-09-19T09:41:36.534 INFO:tasks.workunit.client.0.smithi042.stdout:2/93: write d7/dd/f16 [757856,78274] 0 2024-09-19T09:41:36.534 INFO:tasks.workunit.client.0.smithi042.stdout:2/94: write f2 [6475960,79183] 0 2024-09-19T09:41:36.534 INFO:tasks.workunit.client.0.smithi042.stdout:5/101: getdents d2 0 2024-09-19T09:41:36.534 INFO:tasks.workunit.client.0.smithi042.stdout:2/95: truncate d7/f17 961500 0 2024-09-19T09:41:36.535 INFO:tasks.workunit.client.0.smithi042.stdout:9/160: creat d8/d1d/d28/f2d x:0 0 0 2024-09-19T09:41:36.536 INFO:tasks.workunit.client.0.smithi042.stdout:9/161: dread d8/da/f1e [0,4194304] 0 2024-09-19T09:41:36.537 INFO:tasks.workunit.client.0.smithi042.stdout:5/102: getdents d2/d4 0 2024-09-19T09:41:36.537 INFO:tasks.workunit.client.0.smithi042.stdout:5/103: write d2/d4/fa [1087942,121840] 0 2024-09-19T09:41:36.537 INFO:tasks.workunit.client.0.smithi042.stdout:4/113: sync 2024-09-19T09:41:36.537 INFO:tasks.workunit.client.0.smithi042.stdout:1/137: sync 2024-09-19T09:41:36.537 INFO:tasks.workunit.client.0.smithi042.stdout:6/152: sync 2024-09-19T09:41:36.537 INFO:tasks.workunit.client.0.smithi042.stdout:6/153: chown d1/de/d12/l1b 56680321 1 2024-09-19T09:41:36.537 INFO:tasks.workunit.client.0.smithi042.stdout:9/162: rmdir d8/d1d 39 2024-09-19T09:41:36.538 INFO:tasks.workunit.client.0.smithi042.stdout:5/104: getdents d2/d8 0 2024-09-19T09:41:36.538 INFO:tasks.workunit.client.0.smithi042.stdout:5/105: dread - d2/d8/f1c zero size 2024-09-19T09:41:36.539 INFO:tasks.workunit.client.0.smithi042.stdout:2/96: rename c3 to d7/c18 0 2024-09-19T09:41:36.539 INFO:tasks.workunit.client.0.smithi042.stdout:5/106: write d2/d4/fa [1581038,54761] 0 2024-09-19T09:41:36.539 INFO:tasks.workunit.client.0.smithi042.stdout:4/114: rmdir d0/d1b/d1c 39 2024-09-19T09:41:36.539 INFO:tasks.workunit.client.0.smithi042.stdout:4/115: write d0/f4 [1257444,63448] 0 2024-09-19T09:41:36.540 INFO:tasks.workunit.client.0.smithi042.stdout:0/177: dwrite f0 [0,4194304] 0 2024-09-19T09:41:36.540 INFO:tasks.workunit.client.0.smithi042.stdout:0/178: fsync f1 0 2024-09-19T09:41:36.540 INFO:tasks.workunit.client.0.smithi042.stdout:0/179: readlink d2/d10/l26 0 2024-09-19T09:41:36.540 INFO:tasks.workunit.client.0.smithi042.stdout:6/154: truncate d1/f6 70799 0 2024-09-19T09:41:36.540 INFO:tasks.workunit.client.0.smithi042.stdout:2/97: creat d7/f19 x:0 0 0 2024-09-19T09:41:36.541 INFO:tasks.workunit.client.0.smithi042.stdout:1/138: rename d4/d15/f1c to d4/d1d/f2b 0 2024-09-19T09:41:36.541 INFO:tasks.workunit.client.0.smithi042.stdout:1/139: getdents d4/d29 0 2024-09-19T09:41:36.541 INFO:tasks.workunit.client.0.smithi042.stdout:4/116: creat d0/d1b/f2b x:0 0 0 2024-09-19T09:41:36.542 INFO:tasks.workunit.client.0.smithi042.stdout:2/98: creat d7/f1a x:0 0 0 2024-09-19T09:41:36.543 INFO:tasks.workunit.client.0.smithi042.stdout:2/99: symlink d7/l1b 0 2024-09-19T09:41:36.545 INFO:tasks.workunit.client.0.smithi042.stdout:2/100: unlink d7/l1b 0 2024-09-19T09:41:36.545 INFO:tasks.workunit.client.0.smithi042.stdout:2/101: chown d7/f17 112 1 2024-09-19T09:41:36.545 INFO:tasks.workunit.client.0.smithi042.stdout:2/102: chown d7/dd/f15 101 1 2024-09-19T09:41:36.545 INFO:tasks.workunit.client.0.smithi042.stdout:2/103: fdatasync d7/fe 0 2024-09-19T09:41:36.546 INFO:tasks.workunit.client.0.smithi042.stdout:2/104: chown d7/dd/d14 46019 1 2024-09-19T09:41:36.546 INFO:tasks.workunit.client.0.smithi042.stdout:2/105: fdatasync d7/dd/f15 0 2024-09-19T09:41:36.546 INFO:tasks.workunit.client.0.smithi042.stdout:2/106: fsync f6 0 2024-09-19T09:41:36.546 INFO:tasks.workunit.client.0.smithi042.stdout:4/117: unlink d0/d1b/d1c/f29 0 2024-09-19T09:41:36.546 INFO:tasks.workunit.client.0.smithi042.stdout:4/118: fsync d0/fb 0 2024-09-19T09:41:36.546 INFO:tasks.workunit.client.0.smithi042.stdout:4/119: read d0/f4 [1295246,89311] 0 2024-09-19T09:41:36.546 INFO:tasks.workunit.client.0.smithi042.stdout:5/107: dread d2/db/f10 [0,4194304] 0 2024-09-19T09:41:36.547 INFO:tasks.workunit.client.0.smithi042.stdout:4/120: creat d0/d1b/d1c/f2c x:0 0 0 2024-09-19T09:41:36.548 INFO:tasks.workunit.client.0.smithi042.stdout:2/107: rename d7/f17 to d7/f1c 0 2024-09-19T09:41:36.549 INFO:tasks.workunit.client.0.smithi042.stdout:5/108: creat d2/dc/f24 x:0 0 0 2024-09-19T09:41:36.550 INFO:tasks.workunit.client.0.smithi042.stdout:2/108: creat d7/dd/d14/f1d x:0 0 0 2024-09-19T09:41:36.551 INFO:tasks.workunit.client.0.smithi042.stdout:5/109: mkdir d2/d25 0 2024-09-19T09:41:36.556 INFO:tasks.workunit.client.0.smithi042.stdout:3/162: sync 2024-09-19T09:41:36.559 INFO:tasks.workunit.client.0.smithi042.stdout:3/163: rename d4/d8/d9/d12/c14 to d4/d2a/c3b 0 2024-09-19T09:41:36.559 INFO:tasks.workunit.client.0.smithi042.stdout:8/119: dwrite d1/da/f21 [0,4194304] 0 2024-09-19T09:41:36.559 INFO:tasks.workunit.client.0.smithi042.stdout:0/180: dread d2/fc [0,4194304] 0 2024-09-19T09:41:36.563 INFO:tasks.workunit.client.0.smithi042.stdout:3/164: rmdir d4/d8/d9/dc/d26 39 2024-09-19T09:41:36.563 INFO:tasks.workunit.client.0.smithi042.stdout:3/165: readlink d4/d8/d9/l1f 0 2024-09-19T09:41:36.563 INFO:tasks.workunit.client.0.smithi042.stdout:3/166: truncate d4/d8/d9/dc/d26/f32 442773 0 2024-09-19T09:41:36.564 INFO:tasks.workunit.client.0.smithi042.stdout:0/181: creat d2/d10/d12/d2e/d32/f39 x:0 0 0 2024-09-19T09:41:36.565 INFO:tasks.workunit.client.0.smithi042.stdout:3/167: creat d4/d8/d9/dc/d26/f3c x:0 0 0 2024-09-19T09:41:36.565 INFO:tasks.workunit.client.0.smithi042.stdout:3/168: chown d4 11014 1 2024-09-19T09:41:36.571 INFO:tasks.workunit.client.0.smithi042.stdout:6/155: dwrite d1/f24 [0,4194304] 0 2024-09-19T09:41:36.571 INFO:tasks.workunit.client.0.smithi042.stdout:6/156: chown d1/de/d12/d22/f25 4179 1 2024-09-19T09:41:36.571 INFO:tasks.workunit.client.0.smithi042.stdout:6/157: write d1/de/d12/d22/f25 [908653,115011] 0 2024-09-19T09:41:36.571 INFO:tasks.workunit.client.0.smithi042.stdout:6/158: fsync d1/de/f28 0 2024-09-19T09:41:36.571 INFO:tasks.workunit.client.0.smithi042.stdout:6/159: fdatasync d1/de/f28 0 2024-09-19T09:41:36.571 INFO:tasks.workunit.client.0.smithi042.stdout:1/140: dwrite f1 [0,4194304] 0 2024-09-19T09:41:36.573 INFO:tasks.workunit.client.0.smithi042.stdout:6/160: creat d1/de/d12/d22/f2a x:0 0 0 2024-09-19T09:41:36.573 INFO:tasks.workunit.client.0.smithi042.stdout:1/141: symlink d4/d12/l2c 0 2024-09-19T09:41:36.574 INFO:tasks.workunit.client.0.smithi042.stdout:6/161: symlink d1/de/d12/d1c/l2b 0 2024-09-19T09:41:36.575 INFO:tasks.workunit.client.0.smithi042.stdout:1/142: creat d4/d12/f2d x:0 0 0 2024-09-19T09:41:36.576 INFO:tasks.workunit.client.0.smithi042.stdout:6/162: symlink d1/de/d12/l2c 0 2024-09-19T09:41:36.577 INFO:tasks.workunit.client.0.smithi042.stdout:6/163: fdatasync d1/de/d12/d22/f25 0 2024-09-19T09:41:36.580 INFO:tasks.workunit.client.0.smithi042.stdout:2/109: dread d7/dd/f15 [0,4194304] 0 2024-09-19T09:41:36.581 INFO:tasks.workunit.client.0.smithi042.stdout:2/110: creat d7/dd/f1e x:0 0 0 2024-09-19T09:41:36.581 INFO:tasks.workunit.client.0.smithi042.stdout:2/111: write d7/f10 [6612443,40356] 0 2024-09-19T09:41:36.581 INFO:tasks.workunit.client.0.smithi042.stdout:2/112: readlink d7/lf 0 2024-09-19T09:41:36.582 INFO:tasks.workunit.client.0.smithi042.stdout:2/113: unlink d7/f19 0 2024-09-19T09:41:36.583 INFO:tasks.workunit.client.0.smithi042.stdout:2/114: mkdir d7/dd/d1f 0 2024-09-19T09:41:36.584 INFO:tasks.workunit.client.0.smithi042.stdout:2/115: symlink d7/dd/l20 0 2024-09-19T09:41:36.593 INFO:tasks.workunit.client.0.smithi042.stdout:2/116: dread d7/dd/f15 [0,4194304] 0 2024-09-19T09:41:36.594 INFO:tasks.workunit.client.0.smithi042.stdout:2/117: truncate d7/dd/f15 4008589 0 2024-09-19T09:41:36.595 INFO:tasks.workunit.client.0.smithi042.stdout:7/139: dwrite d0/f26 [0,4194304] 0 2024-09-19T09:41:36.595 INFO:tasks.workunit.client.0.smithi042.stdout:7/140: fdatasync d0/f1a 0 2024-09-19T09:41:36.595 INFO:tasks.workunit.client.0.smithi042.stdout:2/118: creat d7/dd/d1f/f21 x:0 0 0 2024-09-19T09:41:36.596 INFO:tasks.workunit.client.0.smithi042.stdout:7/141: read d0/f1a [39959,32661] 0 2024-09-19T09:41:36.596 INFO:tasks.workunit.client.0.smithi042.stdout:7/142: fsync d0/f26 0 2024-09-19T09:41:36.596 INFO:tasks.workunit.client.0.smithi042.stdout:2/119: truncate d7/f1c 620865 0 2024-09-19T09:41:36.596 INFO:tasks.workunit.client.0.smithi042.stdout:2/120: chown d7/dd/d14 66 1 2024-09-19T09:41:36.596 INFO:tasks.workunit.client.0.smithi042.stdout:2/121: fdatasync d7/f9 0 2024-09-19T09:41:36.596 INFO:tasks.workunit.client.0.smithi042.stdout:2/122: chown f6 62050 1 2024-09-19T09:41:36.597 INFO:tasks.workunit.client.0.smithi042.stdout:2/123: stat d7/f10 0 2024-09-19T09:41:36.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:36 smithi171 ceph-mon[35803]: pgmap v405: 97 pgs: 97 active+clean; 127 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 782 op/s 2024-09-19T09:41:36.598 INFO:tasks.workunit.client.0.smithi042.stdout:7/143: mkdir d0/d30 0 2024-09-19T09:41:36.607 INFO:tasks.workunit.client.0.smithi042.stdout:0/182: dwrite d2/d10/f1b [0,4194304] 0 2024-09-19T09:41:36.609 INFO:tasks.workunit.client.0.smithi042.stdout:8/120: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:41:36.609 INFO:tasks.workunit.client.0.smithi042.stdout:4/121: dwrite d0/d1b/f23 [0,4194304] 0 2024-09-19T09:41:36.609 INFO:tasks.workunit.client.0.smithi042.stdout:6/164: dwrite d1/d20/f27 [0,4194304] 0 2024-09-19T09:41:36.609 INFO:tasks.workunit.client.0.smithi042.stdout:9/163: dwrite f5 [0,4194304] 0 2024-09-19T09:41:36.609 INFO:tasks.workunit.client.0.smithi042.stdout:3/169: dwrite d4/d8/f19 [0,4194304] 0 2024-09-19T09:41:36.609 INFO:tasks.workunit.client.0.smithi042.stdout:3/170: dread - d4/d8/f20 zero size 2024-09-19T09:41:36.609 INFO:tasks.workunit.client.0.smithi042.stdout:8/121: dread d1/da/dd/ff [0,4194304] 0 2024-09-19T09:41:36.609 INFO:tasks.workunit.client.0.smithi042.stdout:8/122: dread - d1/da/f13 zero size 2024-09-19T09:41:36.609 INFO:tasks.workunit.client.0.smithi042.stdout:4/122: write d0/f19 [683496,24115] 0 2024-09-19T09:41:36.609 INFO:tasks.workunit.client.0.smithi042.stdout:4/123: stat d0/fb 0 2024-09-19T09:41:36.613 INFO:tasks.workunit.client.0.smithi042.stdout:0/183: mknod d2/c3a 0 2024-09-19T09:41:36.613 INFO:tasks.workunit.client.0.smithi042.stdout:0/184: readlink d2/d10/d12/d19/l2c 0 2024-09-19T09:41:36.616 INFO:tasks.workunit.client.0.smithi042.stdout:6/165: creat d1/de/f2d x:0 0 0 2024-09-19T09:41:36.616 INFO:tasks.workunit.client.0.smithi042.stdout:6/166: fsync d1/d20/f27 0 2024-09-19T09:41:36.617 INFO:tasks.workunit.client.0.smithi042.stdout:7/144: dwrite d0/d14/f1c [0,4194304] 0 2024-09-19T09:41:36.617 INFO:tasks.workunit.client.0.smithi042.stdout:3/171: write d4/d8/f33 [3715655,103762] 0 2024-09-19T09:41:36.617 INFO:tasks.workunit.client.0.smithi042.stdout:3/172: stat d4/f34 0 2024-09-19T09:41:36.620 INFO:tasks.workunit.client.0.smithi042.stdout:8/123: dread d1/da/f21 [0,4194304] 0 2024-09-19T09:41:36.621 INFO:tasks.workunit.client.0.smithi042.stdout:4/124: creat d0/d28/f2d x:0 0 0 2024-09-19T09:41:36.622 INFO:tasks.workunit.client.0.smithi042.stdout:0/185: link d2/l14 d2/l3b 0 2024-09-19T09:41:36.622 INFO:tasks.workunit.client.0.smithi042.stdout:3/173: fsync d4/d8/d9/dc/d26/f27 0 2024-09-19T09:41:36.622 INFO:tasks.workunit.client.0.smithi042.stdout:3/174: read - d4/d8/f36 zero size 2024-09-19T09:41:36.624 INFO:tasks.workunit.client.0.smithi042.stdout:8/124: symlink d1/da/l23 0 2024-09-19T09:41:36.625 INFO:tasks.workunit.client.0.smithi042.stdout:4/125: mkdir d0/d1b/d1c/d2e 0 2024-09-19T09:41:36.625 INFO:tasks.workunit.client.0.smithi042.stdout:4/126: chown d0/d1b/d1c/f25 72 1 2024-09-19T09:41:36.625 INFO:tasks.workunit.client.0.smithi042.stdout:0/186: mkdir d2/d3c 0 2024-09-19T09:41:36.626 INFO:tasks.workunit.client.0.smithi042.stdout:6/167: dread d1/d20/f27 [0,4194304] 0 2024-09-19T09:41:36.627 INFO:tasks.workunit.client.0.smithi042.stdout:3/175: link c1 d4/d2a/c3d 0 2024-09-19T09:41:36.627 INFO:tasks.workunit.client.0.smithi042.stdout:3/176: chown d4/d8/d9/l30 959970847 1 2024-09-19T09:41:36.628 INFO:tasks.workunit.client.0.smithi042.stdout:3/177: write d4/d8/f33 [4734253,1237] 0 2024-09-19T09:41:36.628 INFO:tasks.workunit.client.0.smithi042.stdout:3/178: write d4/d8/d9/f17 [913835,72659] 0 2024-09-19T09:41:36.628 INFO:tasks.workunit.client.0.smithi042.stdout:3/179: rename d4 to d4/d8/d9/d12/d3e 22 2024-09-19T09:41:36.628 INFO:tasks.workunit.client.0.smithi042.stdout:7/145: mknod d0/c31 0 2024-09-19T09:41:36.629 INFO:tasks.workunit.client.0.smithi042.stdout:7/146: chown d0/l2 423 1 2024-09-19T09:41:36.629 INFO:tasks.workunit.client.0.smithi042.stdout:7/147: dread d0/f1a [0,4194304] 0 2024-09-19T09:41:36.629 INFO:tasks.workunit.client.0.smithi042.stdout:4/127: creat d0/d1b/f2f x:0 0 0 2024-09-19T09:41:36.630 INFO:tasks.workunit.client.0.smithi042.stdout:3/180: mknod d4/c3f 0 2024-09-19T09:41:36.631 INFO:tasks.workunit.client.0.smithi042.stdout:4/128: symlink d0/d1b/d1c/d2e/l30 0 2024-09-19T09:41:36.631 INFO:tasks.workunit.client.0.smithi042.stdout:4/129: read - d0/d1b/f2f zero size 2024-09-19T09:41:36.632 INFO:tasks.workunit.client.0.smithi042.stdout:7/148: mknod d0/c32 0 2024-09-19T09:41:36.632 INFO:tasks.workunit.client.0.smithi042.stdout:4/130: symlink d0/d1b/d1c/d2e/l31 0 2024-09-19T09:41:36.632 INFO:tasks.workunit.client.0.smithi042.stdout:4/131: fsync d0/d1b/f23 0 2024-09-19T09:41:36.633 INFO:tasks.workunit.client.0.smithi042.stdout:7/149: creat d0/f33 x:0 0 0 2024-09-19T09:41:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:36 smithi136 ceph-mon[34840]: pgmap v405: 97 pgs: 97 active+clean; 127 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 782 op/s 2024-09-19T09:41:36.635 INFO:tasks.workunit.client.0.smithi042.stdout:9/164: dwrite d8/f2c [0,4194304] 0 2024-09-19T09:41:36.636 INFO:tasks.workunit.client.0.smithi042.stdout:9/165: write d8/da/d19/f2b [541892,93514] 0 2024-09-19T09:41:36.638 INFO:tasks.workunit.client.0.smithi042.stdout:9/166: getdents d8/da/d19/d1c 0 2024-09-19T09:41:36.639 INFO:tasks.workunit.client.0.smithi042.stdout:9/167: mknod d8/d1d/c2e 0 2024-09-19T09:41:36.639 INFO:tasks.workunit.client.0.smithi042.stdout:9/168: dread - d8/f24 zero size 2024-09-19T09:41:36.641 INFO:tasks.workunit.client.0.smithi042.stdout:9/169: rename d8/l25 to d8/da/l2f 0 2024-09-19T09:41:36.642 INFO:tasks.workunit.client.0.smithi042.stdout:8/125: read d1/f7 [2602215,116187] 0 2024-09-19T09:41:36.645 INFO:tasks.workunit.client.0.smithi042.stdout:4/132: getdents d0/d1b 0 2024-09-19T09:41:36.649 INFO:tasks.workunit.client.0.smithi042.stdout:3/181: dwrite f0 [4194304,4194304] 0 2024-09-19T09:41:36.649 INFO:tasks.workunit.client.0.smithi042.stdout:6/168: dwrite d1/de/f2d [0,4194304] 0 2024-09-19T09:41:36.649 INFO:tasks.workunit.client.0.smithi042.stdout:6/169: chown d1/f6 114 1 2024-09-19T09:41:36.651 INFO:tasks.workunit.client.0.smithi042.stdout:3/182: rename d4/d8/d9/f17 to d4/d2a/f40 0 2024-09-19T09:41:36.651 INFO:tasks.workunit.client.0.smithi042.stdout:9/170: read d8/f2c [3917855,73897] 0 2024-09-19T09:41:36.651 INFO:tasks.workunit.client.0.smithi042.stdout:9/171: chown f1 2878095 1 2024-09-19T09:41:36.652 INFO:tasks.workunit.client.0.smithi042.stdout:9/172: fsync f5 0 2024-09-19T09:41:36.652 INFO:tasks.workunit.client.0.smithi042.stdout:3/183: mkdir d4/d41 0 2024-09-19T09:41:36.653 INFO:tasks.workunit.client.0.smithi042.stdout:9/173: symlink d8/da/l30 0 2024-09-19T09:41:36.653 INFO:tasks.workunit.client.0.smithi042.stdout:6/170: mkdir d1/d2e 0 2024-09-19T09:41:36.653 INFO:tasks.workunit.client.0.smithi042.stdout:6/171: stat d1/f18 0 2024-09-19T09:41:36.654 INFO:tasks.workunit.client.0.smithi042.stdout:3/184: rmdir d4/d8/d9 39 2024-09-19T09:41:36.654 INFO:tasks.workunit.client.0.smithi042.stdout:7/150: dwrite d0/f5 [4194304,4194304] 0 2024-09-19T09:41:36.654 INFO:tasks.workunit.client.0.smithi042.stdout:9/174: mkdir d8/db/d31 0 2024-09-19T09:41:36.656 INFO:tasks.workunit.client.0.smithi042.stdout:3/185: rename d4/l10 to d4/d8/d9/d12/l42 0 2024-09-19T09:41:36.657 INFO:tasks.workunit.client.0.smithi042.stdout:6/172: symlink d1/l2f 0 2024-09-19T09:41:36.657 INFO:tasks.workunit.client.0.smithi042.stdout:6/173: chown d1/d20/c29 61095725 1 2024-09-19T09:41:36.658 INFO:tasks.workunit.client.0.smithi042.stdout:7/151: mknod d0/c34 0 2024-09-19T09:41:36.658 INFO:tasks.workunit.client.0.smithi042.stdout:7/152: fdatasync d0/f25 0 2024-09-19T09:41:36.658 INFO:tasks.workunit.client.0.smithi042.stdout:7/153: write d0/f27 [726854,104928] 0 2024-09-19T09:41:36.659 INFO:tasks.workunit.client.0.smithi042.stdout:7/154: link d0/f25 d0/f35 0 2024-09-19T09:41:36.659 INFO:tasks.workunit.client.0.smithi042.stdout:7/155: stat d0/l1d 0 2024-09-19T09:41:36.660 INFO:tasks.workunit.client.0.smithi042.stdout:7/156: creat d0/f36 x:0 0 0 2024-09-19T09:41:36.660 INFO:tasks.workunit.client.0.smithi042.stdout:7/157: fsync d0/f26 0 2024-09-19T09:41:36.661 INFO:tasks.workunit.client.0.smithi042.stdout:7/158: symlink d0/l37 0 2024-09-19T09:41:36.673 INFO:tasks.workunit.client.0.smithi042.stdout:8/126: dwrite d1/da/dd/f16 [0,4194304] 0 2024-09-19T09:41:36.674 INFO:tasks.workunit.client.0.smithi042.stdout:4/133: dwrite d0/d1b/d1c/f1f [4194304,4194304] 0 2024-09-19T09:41:36.674 INFO:tasks.workunit.client.0.smithi042.stdout:4/134: dread - d0/d1b/d1c/f2c zero size 2024-09-19T09:41:36.674 INFO:tasks.workunit.client.0.smithi042.stdout:4/135: chown d0/d1b/f2a 1 1 2024-09-19T09:41:36.675 INFO:tasks.workunit.client.0.smithi042.stdout:6/174: dread d1/fc [0,4194304] 0 2024-09-19T09:41:36.675 INFO:tasks.workunit.client.0.smithi042.stdout:6/175: write d1/fc [4834441,86032] 0 2024-09-19T09:41:36.675 INFO:tasks.workunit.client.0.smithi042.stdout:6/176: dread - d1/de/f28 zero size 2024-09-19T09:41:36.675 INFO:tasks.workunit.client.0.smithi042.stdout:9/175: dwrite d8/da/d19/f2a [0,4194304] 0 2024-09-19T09:41:36.676 INFO:tasks.workunit.client.0.smithi042.stdout:8/127: unlink d1/da/dd/ff 0 2024-09-19T09:41:36.679 INFO:tasks.workunit.client.0.smithi042.stdout:3/186: dwrite d4/d8/f20 [0,4194304] 0 2024-09-19T09:41:36.679 INFO:tasks.workunit.client.0.smithi042.stdout:4/136: dread d0/f4 [0,4194304] 0 2024-09-19T09:41:36.680 INFO:tasks.workunit.client.0.smithi042.stdout:8/128: chown d1/l1d 1 1 2024-09-19T09:41:36.680 INFO:tasks.workunit.client.0.smithi042.stdout:8/129: fdatasync d1/da/f12 0 2024-09-19T09:41:36.682 INFO:tasks.workunit.client.0.smithi042.stdout:7/159: dwrite d0/f17 [0,4194304] 0 2024-09-19T09:41:36.682 INFO:tasks.workunit.client.0.smithi042.stdout:7/160: readlink d0/l21 0 2024-09-19T09:41:36.682 INFO:tasks.workunit.client.0.smithi042.stdout:7/161: readlink d0/l1d 0 2024-09-19T09:41:36.688 INFO:tasks.workunit.client.0.smithi042.stdout:8/130: dread d1/da/f21 [0,4194304] 0 2024-09-19T09:41:36.689 INFO:tasks.workunit.client.0.smithi042.stdout:4/137: creat d0/d1b/f32 x:0 0 0 2024-09-19T09:41:36.691 INFO:tasks.workunit.client.0.smithi042.stdout:8/131: mknod d1/da/dd/c24 0 2024-09-19T09:41:36.692 INFO:tasks.workunit.client.0.smithi042.stdout:4/138: symlink d0/d1b/l33 0 2024-09-19T09:41:36.693 INFO:tasks.workunit.client.0.smithi042.stdout:4/139: dread - d0/d1b/f2f zero size 2024-09-19T09:41:36.693 INFO:tasks.workunit.client.0.smithi042.stdout:7/162: link d0/f33 d0/f38 0 2024-09-19T09:41:36.693 INFO:tasks.workunit.client.0.smithi042.stdout:7/163: truncate d0/f1a 1099782 0 2024-09-19T09:41:36.698 INFO:tasks.workunit.client.0.smithi042.stdout:4/140: mknod d0/d1b/c34 0 2024-09-19T09:41:36.698 INFO:tasks.workunit.client.0.smithi042.stdout:7/164: unlink d0/d14/f28 0 2024-09-19T09:41:36.698 INFO:tasks.workunit.client.0.smithi042.stdout:5/110: sync 2024-09-19T09:41:36.698 INFO:tasks.workunit.client.0.smithi042.stdout:1/143: sync 2024-09-19T09:41:36.699 INFO:tasks.workunit.client.0.smithi042.stdout:2/124: sync 2024-09-19T09:41:36.699 INFO:tasks.workunit.client.0.smithi042.stdout:0/187: sync 2024-09-19T09:41:36.699 INFO:tasks.workunit.client.0.smithi042.stdout:0/188: write d2/d10/d12/d2e/d32/f39 [36598,124624] 0 2024-09-19T09:41:36.699 INFO:tasks.workunit.client.0.smithi042.stdout:2/125: mkdir d7/dd/d22 0 2024-09-19T09:41:36.699 INFO:tasks.workunit.client.0.smithi042.stdout:2/126: rename d7/dd to d7/dd/d1f/d23 22 2024-09-19T09:41:36.700 INFO:tasks.workunit.client.0.smithi042.stdout:2/127: chown d7/dd/f1e 47 1 2024-09-19T09:41:36.700 INFO:tasks.workunit.client.0.smithi042.stdout:7/165: unlink d0/l21 0 2024-09-19T09:41:36.700 INFO:tasks.workunit.client.0.smithi042.stdout:3/187: dwrite d4/d2a/f40 [0,4194304] 0 2024-09-19T09:41:36.700 INFO:tasks.workunit.client.0.smithi042.stdout:4/141: truncate d0/fb 375975 0 2024-09-19T09:41:36.700 INFO:tasks.workunit.client.0.smithi042.stdout:2/128: link d7/dd/f12 d7/dd/d22/f24 0 2024-09-19T09:41:36.701 INFO:tasks.workunit.client.0.smithi042.stdout:1/144: mkdir d4/d15/d2e 0 2024-09-19T09:41:36.701 INFO:tasks.workunit.client.0.smithi042.stdout:1/145: stat d4/d15/d19/cd 0 2024-09-19T09:41:36.701 INFO:tasks.workunit.client.0.smithi042.stdout:2/129: link d7/fe d7/dd/d14/f25 0 2024-09-19T09:41:36.701 INFO:tasks.workunit.client.0.smithi042.stdout:2/130: readlink d7/lb 0 2024-09-19T09:41:36.702 INFO:tasks.workunit.client.0.smithi042.stdout:0/189: unlink d2/d10/d12/d19/l2c 0 2024-09-19T09:41:36.702 INFO:tasks.workunit.client.0.smithi042.stdout:2/131: symlink d7/l26 0 2024-09-19T09:41:36.702 INFO:tasks.workunit.client.0.smithi042.stdout:2/132: stat d7/dd/d1f 0 2024-09-19T09:41:36.703 INFO:tasks.workunit.client.0.smithi042.stdout:7/166: creat d0/d30/f39 x:0 0 0 2024-09-19T09:41:36.704 INFO:tasks.workunit.client.0.smithi042.stdout:3/188: link d4/d8/d9/l1d d4/d2a/l43 0 2024-09-19T09:41:36.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:36 smithi042 ceph-mon[31223]: pgmap v405: 97 pgs: 97 active+clean; 127 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 782 op/s 2024-09-19T09:41:36.705 INFO:tasks.workunit.client.0.smithi042.stdout:2/133: mknod d7/dd/d22/c27 0 2024-09-19T09:41:36.705 INFO:tasks.workunit.client.0.smithi042.stdout:6/177: dwrite d1/d20/f27 [0,4194304] 0 2024-09-19T09:41:36.705 INFO:tasks.workunit.client.0.smithi042.stdout:6/178: fsync d1/f18 0 2024-09-19T09:41:36.705 INFO:tasks.workunit.client.0.smithi042.stdout:0/190: mknod d2/d10/d12/d19/c3d 0 2024-09-19T09:41:36.705 INFO:tasks.workunit.client.0.smithi042.stdout:3/189: truncate d4/d8/d9/dc/d26/f27 1811163 0 2024-09-19T09:41:36.705 INFO:tasks.workunit.client.0.smithi042.stdout:2/134: mkdir d7/dd/d22/d28 0 2024-09-19T09:41:36.708 INFO:tasks.workunit.client.0.smithi042.stdout:6/179: creat d1/d2e/f30 x:0 0 0 2024-09-19T09:41:36.708 INFO:tasks.workunit.client.0.smithi042.stdout:6/180: truncate d1/f18 218851 0 2024-09-19T09:41:36.710 INFO:tasks.workunit.client.0.smithi042.stdout:6/181: creat d1/d2e/f31 x:0 0 0 2024-09-19T09:41:36.715 INFO:tasks.workunit.client.0.smithi042.stdout:1/146: dread d4/d15/d19/f9 [0,4194304] 0 2024-09-19T09:41:36.715 INFO:tasks.workunit.client.0.smithi042.stdout:1/147: fsync d4/d15/f17 0 2024-09-19T09:41:36.717 INFO:tasks.workunit.client.0.smithi042.stdout:1/148: unlink d4/d15/l27 0 2024-09-19T09:41:36.719 INFO:tasks.workunit.client.0.smithi042.stdout:0/191: dread f1 [0,4194304] 0 2024-09-19T09:41:36.721 INFO:tasks.workunit.client.0.smithi042.stdout:1/149: mknod d4/d15/d19/c2f 0 2024-09-19T09:41:36.722 INFO:tasks.workunit.client.0.smithi042.stdout:0/192: mknod d2/c3e 0 2024-09-19T09:41:36.722 INFO:tasks.workunit.client.0.smithi042.stdout:8/132: dwrite d1/f18 [0,4194304] 0 2024-09-19T09:41:36.722 INFO:tasks.workunit.client.0.smithi042.stdout:1/150: truncate d4/d1e/d25/f28 2414450 0 2024-09-19T09:41:36.724 INFO:tasks.workunit.client.0.smithi042.stdout:1/151: mknod d4/d1e/c30 0 2024-09-19T09:41:36.726 INFO:tasks.workunit.client.0.smithi042.stdout:1/152: mkdir d4/d15/d2e/d31 0 2024-09-19T09:41:36.727 INFO:tasks.workunit.client.0.smithi042.stdout:8/133: rename d1/l1c to d1/l25 0 2024-09-19T09:41:36.727 INFO:tasks.workunit.client.0.smithi042.stdout:8/134: chown d1/da/dd 7 1 2024-09-19T09:41:36.727 INFO:tasks.workunit.client.0.smithi042.stdout:8/135: dread - d1/da/f13 zero size 2024-09-19T09:41:36.728 INFO:tasks.workunit.client.0.smithi042.stdout:1/153: mknod d4/d15/d2e/c32 0 2024-09-19T09:41:36.728 INFO:tasks.workunit.client.0.smithi042.stdout:1/154: stat d4 0 2024-09-19T09:41:36.731 INFO:tasks.workunit.client.0.smithi042.stdout:1/155: creat d4/d1e/d25/f33 x:0 0 0 2024-09-19T09:41:36.733 INFO:tasks.workunit.client.0.smithi042.stdout:1/156: unlink d4/d15/d19/c23 0 2024-09-19T09:41:36.733 INFO:tasks.workunit.client.0.smithi042.stdout:1/157: fdatasync d4/d15/d19/f1a 0 2024-09-19T09:41:36.733 INFO:tasks.workunit.client.0.smithi042.stdout:1/158: write d4/d15/f17 [1016474,108041] 0 2024-09-19T09:41:36.734 INFO:tasks.workunit.client.0.smithi042.stdout:0/193: dread f0 [0,4194304] 0 2024-09-19T09:41:36.734 INFO:tasks.workunit.client.0.smithi042.stdout:1/159: mkdir d4/d15/d34 0 2024-09-19T09:41:36.737 INFO:tasks.workunit.client.0.smithi042.stdout:1/160: mkdir d4/d1e/d25/d35 0 2024-09-19T09:41:36.737 INFO:tasks.workunit.client.0.smithi042.stdout:1/161: symlink d4/d1e/l36 0 2024-09-19T09:41:36.737 INFO:tasks.workunit.client.0.smithi042.stdout:1/162: chown d4/d15/d19/ff 831385 1 2024-09-19T09:41:36.738 INFO:tasks.workunit.client.0.smithi042.stdout:1/163: getdents d4/d29 0 2024-09-19T09:41:36.738 INFO:tasks.workunit.client.0.smithi042.stdout:1/164: link d4/d15/d19/fc d4/d15/d2e/f37 0 2024-09-19T09:41:36.738 INFO:tasks.workunit.client.0.smithi042.stdout:1/165: stat d4/d1e/f1f 0 2024-09-19T09:41:36.740 INFO:tasks.workunit.client.0.smithi042.stdout:5/111: dwrite d2/db/f10 [0,4194304] 0 2024-09-19T09:41:36.746 INFO:tasks.workunit.client.0.smithi042.stdout:4/142: dwrite d0/fe [0,4194304] 0 2024-09-19T09:41:36.747 INFO:tasks.workunit.client.0.smithi042.stdout:4/143: fsync d0/d1b/d1c/f25 0 2024-09-19T09:41:36.748 INFO:tasks.workunit.client.0.smithi042.stdout:8/136: read d1/da/dd/f16 [4016184,108574] 0 2024-09-19T09:41:36.750 INFO:tasks.workunit.client.0.smithi042.stdout:2/135: dwrite d7/f9 [0,4194304] 0 2024-09-19T09:41:36.750 INFO:tasks.workunit.client.0.smithi042.stdout:8/137: fsync d1/f10 0 2024-09-19T09:41:36.750 INFO:tasks.workunit.client.0.smithi042.stdout:4/144: mknod d0/c35 0 2024-09-19T09:41:36.751 INFO:tasks.workunit.client.0.smithi042.stdout:8/138: chown d1/l3 240 1 2024-09-19T09:41:36.752 INFO:tasks.workunit.client.0.smithi042.stdout:2/136: link c5 d7/dd/d22/c29 0 2024-09-19T09:41:36.752 INFO:tasks.workunit.client.0.smithi042.stdout:4/145: mkdir d0/d28/d36 0 2024-09-19T09:41:36.753 INFO:tasks.workunit.client.0.smithi042.stdout:2/137: truncate d7/dd/f15 1345540 0 2024-09-19T09:41:36.753 INFO:tasks.workunit.client.0.smithi042.stdout:2/138: write d7/f1c [1413895,65326] 0 2024-09-19T09:41:36.753 INFO:tasks.workunit.client.0.smithi042.stdout:8/139: unlink d1/f7 0 2024-09-19T09:41:36.754 INFO:tasks.workunit.client.0.smithi042.stdout:2/139: mkdir d7/dd/d22/d2a 0 2024-09-19T09:41:36.755 INFO:tasks.workunit.client.0.smithi042.stdout:8/140: creat d1/f26 x:0 0 0 2024-09-19T09:41:36.756 INFO:tasks.workunit.client.0.smithi042.stdout:6/182: dwrite d1/de/f2d [0,4194304] 0 2024-09-19T09:41:36.756 INFO:tasks.workunit.client.0.smithi042.stdout:4/146: mknod d0/c37 0 2024-09-19T09:41:36.756 INFO:tasks.workunit.client.0.smithi042.stdout:4/147: read d0/f4 [38504,5685] 0 2024-09-19T09:41:36.756 INFO:tasks.workunit.client.0.smithi042.stdout:2/140: symlink d7/dd/d1f/l2b 0 2024-09-19T09:41:36.757 INFO:tasks.workunit.client.0.smithi042.stdout:3/190: dwrite d4/d8/d9/d12/f29 [0,4194304] 0 2024-09-19T09:41:36.757 INFO:tasks.workunit.client.0.smithi042.stdout:3/191: chown d4/d8/d9/l1d 0 1 2024-09-19T09:41:36.757 INFO:tasks.workunit.client.0.smithi042.stdout:3/192: dread - d4/d8/d9/dc/f2b zero size 2024-09-19T09:41:36.757 INFO:tasks.workunit.client.0.smithi042.stdout:2/141: mknod d7/dd/d14/c2c 0 2024-09-19T09:41:36.758 INFO:tasks.workunit.client.0.smithi042.stdout:6/183: mkdir d1/d20/d32 0 2024-09-19T09:41:36.759 INFO:tasks.workunit.client.0.smithi042.stdout:2/142: creat d7/dd/f2d x:0 0 0 2024-09-19T09:41:36.759 INFO:tasks.workunit.client.0.smithi042.stdout:2/143: stat d7/dd/d1f/l2b 0 2024-09-19T09:41:36.759 INFO:tasks.workunit.client.0.smithi042.stdout:2/144: stat d7/dd/f15 0 2024-09-19T09:41:36.760 INFO:tasks.workunit.client.0.smithi042.stdout:6/184: rmdir d1 39 2024-09-19T09:41:36.761 INFO:tasks.workunit.client.0.smithi042.stdout:4/148: mknod d0/c38 0 2024-09-19T09:41:36.761 INFO:tasks.workunit.client.0.smithi042.stdout:4/149: dread - d0/d28/f2d zero size 2024-09-19T09:41:36.763 INFO:tasks.workunit.client.0.smithi042.stdout:6/185: symlink d1/d20/d32/l33 0 2024-09-19T09:41:36.763 INFO:tasks.workunit.client.0.smithi042.stdout:6/186: chown d1/d20/f27 78 1 2024-09-19T09:41:36.763 INFO:tasks.workunit.client.0.smithi042.stdout:6/187: stat d1/de/d12/d1c/l2b 0 2024-09-19T09:41:36.763 INFO:tasks.workunit.client.0.smithi042.stdout:6/188: readlink d1/de/d12/l1f 0 2024-09-19T09:41:36.764 INFO:tasks.workunit.client.0.smithi042.stdout:8/141: write d1/da/f12 [3395498,91249] 0 2024-09-19T09:41:36.764 INFO:tasks.workunit.client.0.smithi042.stdout:4/150: rename d0/d1b/l22 to d0/d1b/d1c/l39 0 2024-09-19T09:41:36.765 INFO:tasks.workunit.client.0.smithi042.stdout:0/194: dwrite d2/d10/d1d/f35 [0,4194304] 0 2024-09-19T09:41:36.765 INFO:tasks.workunit.client.0.smithi042.stdout:6/189: mkdir d1/de/d12/d22/d34 0 2024-09-19T09:41:36.766 INFO:tasks.workunit.client.0.smithi042.stdout:6/190: chown d1/de/d12/d22/f25 1524855 1 2024-09-19T09:41:36.766 INFO:tasks.workunit.client.0.smithi042.stdout:3/193: write d4/d8/f19 [4143923,10195] 0 2024-09-19T09:41:36.767 INFO:tasks.workunit.client.0.smithi042.stdout:8/142: truncate d1/da/dd/f16 644402 0 2024-09-19T09:41:36.768 INFO:tasks.workunit.client.0.smithi042.stdout:0/195: mknod d2/d10/d12/c3f 0 2024-09-19T09:41:36.769 INFO:tasks.workunit.client.0.smithi042.stdout:0/196: write f0 [4680468,39188] 0 2024-09-19T09:41:36.769 INFO:tasks.workunit.client.0.smithi042.stdout:1/166: dwrite d4/f10 [4194304,4194304] 0 2024-09-19T09:41:36.769 INFO:tasks.workunit.client.0.smithi042.stdout:1/167: write d4/d15/d19/ff [1809106,106394] 0 2024-09-19T09:41:36.769 INFO:tasks.workunit.client.0.smithi042.stdout:1/168: fdatasync f1 0 2024-09-19T09:41:36.771 INFO:tasks.workunit.client.0.smithi042.stdout:6/191: creat d1/de/f35 x:0 0 0 2024-09-19T09:41:36.771 INFO:tasks.workunit.client.0.smithi042.stdout:5/112: dwrite d2/d4/d20/d11/f23 [0,4194304] 0 2024-09-19T09:41:36.771 INFO:tasks.workunit.client.0.smithi042.stdout:5/113: dread - d2/db/fe zero size 2024-09-19T09:41:36.773 INFO:tasks.workunit.client.0.smithi042.stdout:3/194: creat d4/d8/d9/dc/d26/d35/f44 x:0 0 0 2024-09-19T09:41:36.774 INFO:tasks.workunit.client.0.smithi042.stdout:2/145: dread f6 [4194304,4194304] 0 2024-09-19T09:41:36.774 INFO:tasks.workunit.client.0.smithi042.stdout:2/146: write d7/f9 [5180644,82383] 0 2024-09-19T09:41:36.774 INFO:tasks.workunit.client.0.smithi042.stdout:4/151: dread d0/fb [0,4194304] 0 2024-09-19T09:41:36.776 INFO:tasks.workunit.client.0.smithi042.stdout:2/147: symlink d7/dd/l2e 0 2024-09-19T09:41:36.776 INFO:tasks.workunit.client.0.smithi042.stdout:0/197: getdents d2 0 2024-09-19T09:41:36.776 INFO:tasks.workunit.client.0.smithi042.stdout:0/198: fdatasync d2/fc 0 2024-09-19T09:41:36.776 INFO:tasks.workunit.client.0.smithi042.stdout:2/148: rmdir d7/dd/d14 39 2024-09-19T09:41:36.776 INFO:tasks.workunit.client.0.smithi042.stdout:2/149: fdatasync f6 0 2024-09-19T09:41:36.778 INFO:tasks.workunit.client.0.smithi042.stdout:2/150: mknod d7/dd/d22/d2a/c2f 0 2024-09-19T09:41:36.778 INFO:tasks.workunit.client.0.smithi042.stdout:1/169: creat d4/d29/f38 x:0 0 0 2024-09-19T09:41:36.778 INFO:tasks.workunit.client.0.smithi042.stdout:1/170: chown d4/d15/d19 809417130 1 2024-09-19T09:41:36.780 INFO:tasks.workunit.client.0.smithi042.stdout:2/151: rmdir d7/dd/d22/d28 0 2024-09-19T09:41:36.781 INFO:tasks.workunit.client.0.smithi042.stdout:2/152: mkdir d7/dd/d22/d30 0 2024-09-19T09:41:36.781 INFO:tasks.workunit.client.0.smithi042.stdout:2/153: read - d7/dd/f12 zero size 2024-09-19T09:41:36.782 INFO:tasks.workunit.client.0.smithi042.stdout:3/195: rename d4/d8/d9/dc/d26/f3c to d4/d8/d9/dc/f45 0 2024-09-19T09:41:36.782 INFO:tasks.workunit.client.0.smithi042.stdout:2/154: creat d7/dd/d14/f31 x:0 0 0 2024-09-19T09:41:36.786 INFO:tasks.workunit.client.0.smithi042.stdout:5/114: write d2/f1b [3251019,108108] 0 2024-09-19T09:41:36.787 INFO:tasks.workunit.client.0.smithi042.stdout:2/155: write d7/f1c [430356,65256] 0 2024-09-19T09:41:36.787 INFO:tasks.workunit.client.0.smithi042.stdout:6/192: write d1/de/f2d [2969883,69632] 0 2024-09-19T09:41:36.787 INFO:tasks.workunit.client.0.smithi042.stdout:6/193: write d1/f6 [347986,3321] 0 2024-09-19T09:41:36.787 INFO:tasks.workunit.client.0.smithi042.stdout:6/194: write d1/f18 [920253,9769] 0 2024-09-19T09:41:36.787 INFO:tasks.workunit.client.0.smithi042.stdout:2/156: creat d7/dd/d22/f32 x:0 0 0 2024-09-19T09:41:36.787 INFO:tasks.workunit.client.0.smithi042.stdout:0/199: truncate d2/d10/f1b 93542 0 2024-09-19T09:41:36.788 INFO:tasks.workunit.client.0.smithi042.stdout:2/157: mknod d7/dd/d1f/c33 0 2024-09-19T09:41:36.788 INFO:tasks.workunit.client.0.smithi042.stdout:3/196: symlink d4/d8/d9/dc/l46 0 2024-09-19T09:41:36.789 INFO:tasks.workunit.client.0.smithi042.stdout:3/197: dread d4/d8/d9/dc/d26/f32 [0,4194304] 0 2024-09-19T09:41:36.789 INFO:tasks.workunit.client.0.smithi042.stdout:5/115: unlink d2/d8/f1c 0 2024-09-19T09:41:36.789 INFO:tasks.workunit.client.0.smithi042.stdout:5/116: truncate d2/dc/f1d 691273 0 2024-09-19T09:41:36.790 INFO:tasks.workunit.client.0.smithi042.stdout:2/158: creat d7/dd/d22/d30/f34 x:0 0 0 2024-09-19T09:41:36.790 INFO:tasks.workunit.client.0.smithi042.stdout:3/198: dread d4/d8/d9/dc/d26/f32 [0,4194304] 0 2024-09-19T09:41:36.790 INFO:tasks.workunit.client.0.smithi042.stdout:3/199: dread - d4/f34 zero size 2024-09-19T09:41:36.790 INFO:tasks.workunit.client.0.smithi042.stdout:3/200: readlink d4/d8/d9/l2f 0 2024-09-19T09:41:36.790 INFO:tasks.workunit.client.0.smithi042.stdout:3/201: chown d4/d8/f19 1702 1 2024-09-19T09:41:36.790 INFO:tasks.workunit.client.0.smithi042.stdout:2/159: mkdir d7/dd/d14/d35 0 2024-09-19T09:41:36.791 INFO:tasks.workunit.client.0.smithi042.stdout:4/152: symlink d0/l3a 0 2024-09-19T09:41:36.791 INFO:tasks.workunit.client.0.smithi042.stdout:2/160: rename d7/dd/d1f/c33 to d7/dd/d1f/c36 0 2024-09-19T09:41:36.791 INFO:tasks.workunit.client.0.smithi042.stdout:2/161: rmdir d7/dd 39 2024-09-19T09:41:36.792 INFO:tasks.workunit.client.0.smithi042.stdout:2/162: truncate d7/dd/d14/f31 358749 0 2024-09-19T09:41:36.792 INFO:tasks.workunit.client.0.smithi042.stdout:0/200: unlink d2/fc 0 2024-09-19T09:41:36.795 INFO:tasks.workunit.client.0.smithi042.stdout:3/202: rename d4/d8/d9/dc/f13 to d4/d8/d9/dc/d26/f47 0 2024-09-19T09:41:36.795 INFO:tasks.workunit.client.0.smithi042.stdout:3/203: write d4/d8/d9/dc/d26/f47 [1556538,76620] 0 2024-09-19T09:41:36.795 INFO:tasks.workunit.client.0.smithi042.stdout:3/204: chown d4/d8/d9/f1e 152465 1 2024-09-19T09:41:36.795 INFO:tasks.workunit.client.0.smithi042.stdout:7/167: sync 2024-09-19T09:41:36.795 INFO:tasks.workunit.client.0.smithi042.stdout:9/176: sync 2024-09-19T09:41:36.795 INFO:tasks.workunit.client.0.smithi042.stdout:4/153: dread d0/f16 [0,4194304] 0 2024-09-19T09:41:36.796 INFO:tasks.workunit.client.0.smithi042.stdout:9/177: mkdir d8/d32 0 2024-09-19T09:41:36.796 INFO:tasks.workunit.client.0.smithi042.stdout:9/178: write d8/f2c [3414723,18869] 0 2024-09-19T09:41:36.796 INFO:tasks.workunit.client.0.smithi042.stdout:9/179: truncate d8/d1d/f1f 22768 0 2024-09-19T09:41:36.796 INFO:tasks.workunit.client.0.smithi042.stdout:4/154: dread d0/d1b/f1e [0,4194304] 0 2024-09-19T09:41:36.796 INFO:tasks.workunit.client.0.smithi042.stdout:7/168: mkdir d0/d14/d3a 0 2024-09-19T09:41:36.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/155: mkdir d0/d1b/d1c/d2e/d3b 0 2024-09-19T09:41:36.800 INFO:tasks.workunit.client.0.smithi042.stdout:2/163: getdents d7/dd/d14 0 2024-09-19T09:41:36.801 INFO:tasks.workunit.client.0.smithi042.stdout:7/169: unlink d0/c2d 0 2024-09-19T09:41:36.801 INFO:tasks.workunit.client.0.smithi042.stdout:7/170: dread - d0/f33 zero size 2024-09-19T09:41:36.802 INFO:tasks.workunit.client.0.smithi042.stdout:2/164: creat d7/dd/f37 x:0 0 0 2024-09-19T09:41:36.802 INFO:tasks.workunit.client.0.smithi042.stdout:2/165: rmdir d7/dd/d14 39 2024-09-19T09:41:36.802 INFO:tasks.workunit.client.0.smithi042.stdout:0/201: dread d2/fd [0,4194304] 0 2024-09-19T09:41:36.803 INFO:tasks.workunit.client.0.smithi042.stdout:2/166: creat d7/dd/d14/d35/f38 x:0 0 0 2024-09-19T09:41:36.803 INFO:tasks.workunit.client.0.smithi042.stdout:2/167: chown d7/dd/d14/f25 1230012 1 2024-09-19T09:41:36.804 INFO:tasks.workunit.client.0.smithi042.stdout:4/156: creat d0/d1b/d1c/d2e/d3b/f3c x:0 0 0 2024-09-19T09:41:36.804 INFO:tasks.workunit.client.0.smithi042.stdout:4/157: stat d0/d1b/f23 0 2024-09-19T09:41:36.805 INFO:tasks.workunit.client.0.smithi042.stdout:2/168: unlink d7/lb 0 2024-09-19T09:41:36.805 INFO:tasks.workunit.client.0.smithi042.stdout:2/169: write d7/dd/f12 [215137,35975] 0 2024-09-19T09:41:36.805 INFO:tasks.workunit.client.0.smithi042.stdout:2/170: read d7/dd/f16 [1177649,109613] 0 2024-09-19T09:41:36.806 INFO:tasks.workunit.client.0.smithi042.stdout:2/171: dread - d7/dd/f37 zero size 2024-09-19T09:41:36.806 INFO:tasks.workunit.client.0.smithi042.stdout:2/172: chown d7/dd/d22/f32 0 1 2024-09-19T09:41:36.806 INFO:tasks.workunit.client.0.smithi042.stdout:7/171: rmdir d0/d14 39 2024-09-19T09:41:36.806 INFO:tasks.workunit.client.0.smithi042.stdout:7/172: write d0/f38 [111777,108606] 0 2024-09-19T09:41:36.806 INFO:tasks.workunit.client.0.smithi042.stdout:7/173: dread - d0/f25 zero size 2024-09-19T09:41:36.806 INFO:tasks.workunit.client.0.smithi042.stdout:2/173: unlink d7/dd/f1e 0 2024-09-19T09:41:36.808 INFO:tasks.workunit.client.0.smithi042.stdout:9/180: getdents d8 0 2024-09-19T09:41:36.808 INFO:tasks.workunit.client.0.smithi042.stdout:9/181: write d8/f2c [4248490,64363] 0 2024-09-19T09:41:36.810 INFO:tasks.workunit.client.0.smithi042.stdout:4/158: mknod d0/d28/c3d 0 2024-09-19T09:41:36.814 INFO:tasks.workunit.client.0.smithi042.stdout:5/117: rmdir d2/d8 0 2024-09-19T09:41:36.814 INFO:tasks.workunit.client.0.smithi042.stdout:5/118: dread - d2/db/fe zero size 2024-09-19T09:41:36.816 INFO:tasks.workunit.client.0.smithi042.stdout:2/174: write d7/f10 [2278335,58065] 0 2024-09-19T09:41:36.816 INFO:tasks.workunit.client.0.smithi042.stdout:9/182: mknod d8/da/c33 0 2024-09-19T09:41:36.816 INFO:tasks.workunit.client.0.smithi042.stdout:9/183: getdents d8/da/d19/d1c 0 2024-09-19T09:41:36.817 INFO:tasks.workunit.client.0.smithi042.stdout:2/175: creat d7/dd/d22/d2a/f39 x:0 0 0 2024-09-19T09:41:36.817 INFO:tasks.workunit.client.0.smithi042.stdout:7/174: getdents d0/d14 0 2024-09-19T09:41:36.818 INFO:tasks.workunit.client.0.smithi042.stdout:6/195: dwrite d1/de/f28 [0,4194304] 0 2024-09-19T09:41:36.818 INFO:tasks.workunit.client.0.smithi042.stdout:5/119: symlink d2/l26 0 2024-09-19T09:41:36.819 INFO:tasks.workunit.client.0.smithi042.stdout:9/184: creat d8/db/f34 x:0 0 0 2024-09-19T09:41:36.820 INFO:tasks.workunit.client.0.smithi042.stdout:6/196: chown d1/c17 3 1 2024-09-19T09:41:36.820 INFO:tasks.workunit.client.0.smithi042.stdout:6/197: write d1/d2e/f31 [449314,37541] 0 2024-09-19T09:41:36.822 INFO:tasks.workunit.client.0.smithi042.stdout:6/198: rename d1/c13 to d1/c36 0 2024-09-19T09:41:36.822 INFO:tasks.workunit.client.0.smithi042.stdout:6/199: readlink d1/l14 0 2024-09-19T09:41:36.824 INFO:tasks.workunit.client.0.smithi042.stdout:2/176: dread d7/f9 [0,4194304] 0 2024-09-19T09:41:36.825 INFO:tasks.workunit.client.0.smithi042.stdout:2/177: link d7/dd/d22/f32 d7/dd/d22/d30/f3a 0 2024-09-19T09:41:36.826 INFO:tasks.workunit.client.0.smithi042.stdout:2/178: unlink d7/dd/d22/d30/f3a 0 2024-09-19T09:41:36.829 INFO:tasks.workunit.client.0.smithi042.stdout:0/202: dwrite f0 [0,4194304] 0 2024-09-19T09:41:36.831 INFO:tasks.workunit.client.0.smithi042.stdout:0/203: link d2/d10/d12/d16/f2f d2/d10/d12/f40 0 2024-09-19T09:41:36.831 INFO:tasks.workunit.client.0.smithi042.stdout:0/204: fsync d2/d10/f1b 0 2024-09-19T09:41:36.832 INFO:tasks.workunit.client.0.smithi042.stdout:0/205: symlink d2/d10/l41 0 2024-09-19T09:41:36.833 INFO:tasks.workunit.client.0.smithi042.stdout:0/206: creat d2/d10/d12/d24/f42 x:0 0 0 2024-09-19T09:41:36.835 INFO:tasks.workunit.client.0.smithi042.stdout:0/207: link d2/c7 d2/d10/d1d/d34/c43 0 2024-09-19T09:41:36.836 INFO:tasks.workunit.client.0.smithi042.stdout:7/175: write d0/fb [2739942,102274] 0 2024-09-19T09:41:36.837 INFO:tasks.workunit.client.0.smithi042.stdout:0/208: unlink d2/d10/d12/d24/l2a 0 2024-09-19T09:41:36.839 INFO:tasks.workunit.client.0.smithi042.stdout:7/176: unlink d0/f26 0 2024-09-19T09:41:36.843 INFO:tasks.workunit.client.0.smithi042.stdout:5/120: dwrite d2/dc/f1a [0,4194304] 0 2024-09-19T09:41:36.843 INFO:tasks.workunit.client.0.smithi042.stdout:7/177: rename d0/c31 to d0/d14/c3b 0 2024-09-19T09:41:36.844 INFO:tasks.workunit.client.0.smithi042.stdout:0/209: truncate d2/d10/d1d/f25 77921 0 2024-09-19T09:41:36.844 INFO:tasks.workunit.client.0.smithi042.stdout:9/185: dwrite f5 [4194304,4194304] 0 2024-09-19T09:41:36.847 INFO:tasks.workunit.client.0.smithi042.stdout:5/121: mknod d2/d25/c27 0 2024-09-19T09:41:36.847 INFO:tasks.workunit.client.0.smithi042.stdout:5/122: write d2/f1b [270553,85311] 0 2024-09-19T09:41:36.847 INFO:tasks.workunit.client.0.smithi042.stdout:7/178: mkdir d0/d14/d3c 0 2024-09-19T09:41:36.847 INFO:tasks.workunit.client.0.smithi042.stdout:7/179: fsync d0/d14/f1c 0 2024-09-19T09:41:36.847 INFO:tasks.workunit.client.0.smithi042.stdout:7/180: fsync d0/d14/f2a 0 2024-09-19T09:41:36.848 INFO:tasks.workunit.client.0.smithi042.stdout:9/186: mknod d8/da/d19/d1c/d21/c35 0 2024-09-19T09:41:36.849 INFO:tasks.workunit.client.0.smithi042.stdout:2/179: dwrite d7/f1c [0,4194304] 0 2024-09-19T09:41:36.849 INFO:tasks.workunit.client.0.smithi042.stdout:2/180: chown d7/f1a 2406 1 2024-09-19T09:41:36.849 INFO:tasks.workunit.client.0.smithi042.stdout:7/181: truncate d0/d14/f1c 777083 0 2024-09-19T09:41:36.850 INFO:tasks.workunit.client.0.smithi042.stdout:2/181: mknod d7/dd/d14/c3b 0 2024-09-19T09:41:36.850 INFO:tasks.workunit.client.0.smithi042.stdout:2/182: chown d7/dd/d14/c2c 1 1 2024-09-19T09:41:36.850 INFO:tasks.workunit.client.0.smithi042.stdout:9/187: symlink d8/da/d19/d1c/l36 0 2024-09-19T09:41:36.850 INFO:tasks.workunit.client.0.smithi042.stdout:2/183: dread - d7/dd/d22/f32 zero size 2024-09-19T09:41:36.851 INFO:tasks.workunit.client.0.smithi042.stdout:2/184: dread - d7/dd/d22/f32 zero size 2024-09-19T09:41:36.851 INFO:tasks.workunit.client.0.smithi042.stdout:0/210: getdents d2/d10/d12 0 2024-09-19T09:41:36.852 INFO:tasks.workunit.client.0.smithi042.stdout:2/185: creat d7/dd/d22/f3c x:0 0 0 2024-09-19T09:41:36.853 INFO:tasks.workunit.client.0.smithi042.stdout:0/211: unlink d2/ff 0 2024-09-19T09:41:36.864 INFO:tasks.workunit.client.0.smithi042.stdout:9/188: dread d8/da/d19/f2a [0,4194304] 0 2024-09-19T09:41:36.865 INFO:tasks.workunit.client.0.smithi042.stdout:9/189: mknod d8/d1d/d28/c37 0 2024-09-19T09:41:36.866 INFO:tasks.workunit.client.0.smithi042.stdout:9/190: write d8/d1d/d28/f2d [309787,59148] 0 2024-09-19T09:41:36.867 INFO:tasks.workunit.client.0.smithi042.stdout:9/191: rmdir d8/d1d 39 2024-09-19T09:41:36.868 INFO:tasks.workunit.client.0.smithi042.stdout:9/192: rmdir d8/d1d 39 2024-09-19T09:41:36.895 INFO:tasks.workunit.client.0.smithi042.stdout:2/186: dwrite d7/f10 [4194304,4194304] 0 2024-09-19T09:41:36.896 INFO:tasks.workunit.client.0.smithi042.stdout:0/212: dwrite d2/d10/d1d/f30 [0,4194304] 0 2024-09-19T09:41:36.897 INFO:tasks.workunit.client.0.smithi042.stdout:2/187: write d7/dd/f15 [743997,36216] 0 2024-09-19T09:41:36.898 INFO:tasks.workunit.client.0.smithi042.stdout:9/193: dwrite d8/f2c [0,4194304] 0 2024-09-19T09:41:36.898 INFO:tasks.workunit.client.0.smithi042.stdout:7/182: dwrite d0/f25 [0,4194304] 0 2024-09-19T09:41:36.898 INFO:tasks.workunit.client.0.smithi042.stdout:7/183: truncate d0/f36 499268 0 2024-09-19T09:41:36.898 INFO:tasks.workunit.client.0.smithi042.stdout:5/123: dwrite d2/f1b [0,4194304] 0 2024-09-19T09:41:36.898 INFO:tasks.workunit.client.0.smithi042.stdout:0/213: mknod d2/d10/d1e/c44 0 2024-09-19T09:41:36.902 INFO:tasks.workunit.client.0.smithi042.stdout:9/194: write d8/da/d19/f2a [3766120,90874] 0 2024-09-19T09:41:36.905 INFO:tasks.workunit.client.0.smithi042.stdout:0/214: rmdir d2/d10/d12 39 2024-09-19T09:41:36.905 INFO:tasks.workunit.client.0.smithi042.stdout:0/215: write d2/d10/d12/f31 [794345,114038] 0 2024-09-19T09:41:36.905 INFO:tasks.workunit.client.0.smithi042.stdout:0/216: write d2/d10/d12/d16/f2f [3393558,69657] 0 2024-09-19T09:41:36.906 INFO:tasks.workunit.client.0.smithi042.stdout:9/195: mknod d8/da/d19/d1c/d21/c38 0 2024-09-19T09:41:36.907 INFO:tasks.workunit.client.0.smithi042.stdout:9/196: mkdir d8/db/d31/d39 0 2024-09-19T09:41:36.909 INFO:tasks.workunit.client.0.smithi042.stdout:1/171: sync 2024-09-19T09:41:36.909 INFO:tasks.workunit.client.0.smithi042.stdout:8/143: sync 2024-09-19T09:41:36.914 INFO:tasks.workunit.client.0.smithi042.stdout:5/124: dread d2/f1b [0,4194304] 0 2024-09-19T09:41:36.915 INFO:tasks.workunit.client.0.smithi042.stdout:7/184: dread d0/f27 [0,4194304] 0 2024-09-19T09:41:36.917 INFO:tasks.workunit.client.0.smithi042.stdout:7/185: mkdir d0/d3d 0 2024-09-19T09:41:36.925 INFO:tasks.workunit.client.0.smithi042.stdout:0/217: dread d2/d10/d1d/f2b [0,4194304] 0 2024-09-19T09:41:36.925 INFO:tasks.workunit.client.0.smithi042.stdout:0/218: chown f1 3475 1 2024-09-19T09:41:36.927 INFO:tasks.workunit.client.0.smithi042.stdout:0/219: unlink d2/d10/d1d/f35 0 2024-09-19T09:41:36.927 INFO:tasks.workunit.client.0.smithi042.stdout:0/220: dread - d2/d10/d12/d24/f29 zero size 2024-09-19T09:41:36.927 INFO:tasks.workunit.client.0.smithi042.stdout:0/221: chown d2/c3e 15740624 1 2024-09-19T09:41:36.928 INFO:tasks.workunit.client.0.smithi042.stdout:0/222: symlink d2/d10/d12/d16/d18/l45 0 2024-09-19T09:41:36.931 INFO:tasks.workunit.client.0.smithi042.stdout:5/125: write d2/f7 [2094229,114822] 0 2024-09-19T09:41:36.932 INFO:tasks.workunit.client.0.smithi042.stdout:5/126: rmdir d2/d4 39 2024-09-19T09:41:36.933 INFO:tasks.workunit.client.0.smithi042.stdout:2/188: dwrite d7/dd/d22/f32 [0,4194304] 0 2024-09-19T09:41:36.933 INFO:tasks.workunit.client.0.smithi042.stdout:9/197: fdatasync d8/d1d/d28/f2d 0 2024-09-19T09:41:36.933 INFO:tasks.workunit.client.0.smithi042.stdout:9/198: fdatasync d8/da/d19/f2b 0 2024-09-19T09:41:36.933 INFO:tasks.workunit.client.0.smithi042.stdout:5/127: creat d2/dc/f28 x:0 0 0 2024-09-19T09:41:36.933 INFO:tasks.workunit.client.0.smithi042.stdout:5/128: chown d2/d4/d20/d11/f23 36943160 1 2024-09-19T09:41:36.934 INFO:tasks.workunit.client.0.smithi042.stdout:9/199: symlink d8/d32/l3a 0 2024-09-19T09:41:36.934 INFO:tasks.workunit.client.0.smithi042.stdout:2/189: rmdir d7/dd/d22 39 2024-09-19T09:41:36.935 INFO:tasks.workunit.client.0.smithi042.stdout:5/129: mknod d2/d4/d20/d11/c29 0 2024-09-19T09:41:36.936 INFO:tasks.workunit.client.0.smithi042.stdout:1/172: dwrite d4/d15/d19/f1a [0,4194304] 0 2024-09-19T09:41:36.936 INFO:tasks.workunit.client.0.smithi042.stdout:1/173: chown d4/d12/c1b 3 1 2024-09-19T09:41:36.936 INFO:tasks.workunit.client.0.smithi042.stdout:1/174: fsync d4/d1e/d25/f28 0 2024-09-19T09:41:36.936 INFO:tasks.workunit.client.0.smithi042.stdout:1/175: readlink d4/d1e/l36 0 2024-09-19T09:41:36.936 INFO:tasks.workunit.client.0.smithi042.stdout:7/186: dwrite d0/f6 [0,4194304] 0 2024-09-19T09:41:36.938 INFO:tasks.workunit.client.0.smithi042.stdout:1/176: creat d4/d1e/f39 x:0 0 0 2024-09-19T09:41:36.938 INFO:tasks.workunit.client.0.smithi042.stdout:1/177: readlink d4/d1e/d25/l2a 0 2024-09-19T09:41:36.938 INFO:tasks.workunit.client.0.smithi042.stdout:1/178: chown d4/d1e/f39 6620 1 2024-09-19T09:41:36.938 INFO:tasks.workunit.client.0.smithi042.stdout:7/187: truncate d0/f17 2074293 0 2024-09-19T09:41:36.939 INFO:tasks.workunit.client.0.smithi042.stdout:1/179: symlink d4/d29/l3a 0 2024-09-19T09:41:36.939 INFO:tasks.workunit.client.0.smithi042.stdout:7/188: creat d0/d14/d3a/f3e x:0 0 0 2024-09-19T09:41:36.942 INFO:tasks.workunit.client.0.smithi042.stdout:0/223: dread d2/fb [0,4194304] 0 2024-09-19T09:41:36.943 INFO:tasks.workunit.client.0.smithi042.stdout:8/144: dwrite d1/da/dd/f16 [0,4194304] 0 2024-09-19T09:41:36.943 INFO:tasks.workunit.client.0.smithi042.stdout:8/145: fdatasync d1/da/f21 0 2024-09-19T09:41:36.943 INFO:tasks.workunit.client.0.smithi042.stdout:8/146: chown d1/da/d14/l1f 161810 1 2024-09-19T09:41:36.944 INFO:tasks.workunit.client.0.smithi042.stdout:8/147: write d1/da/d14/f17 [44690,2362] 0 2024-09-19T09:41:36.947 INFO:tasks.workunit.client.0.smithi042.stdout:8/148: truncate d1/f18 3010346 0 2024-09-19T09:41:36.947 INFO:tasks.workunit.client.0.smithi042.stdout:8/149: chown d1 1193830 1 2024-09-19T09:41:36.949 INFO:tasks.workunit.client.0.smithi042.stdout:8/150: creat d1/da/d14/f27 x:0 0 0 2024-09-19T09:41:36.951 INFO:tasks.workunit.client.0.smithi042.stdout:8/151: rmdir d1/da/dd 39 2024-09-19T09:41:36.951 INFO:tasks.workunit.client.0.smithi042.stdout:8/152: dread - d1/da/d14/f1a zero size 2024-09-19T09:41:36.962 INFO:tasks.workunit.client.0.smithi042.stdout:5/130: dwrite d2/dc/f1d [0,4194304] 0 2024-09-19T09:41:36.962 INFO:tasks.workunit.client.0.smithi042.stdout:5/131: stat d2/d25 0 2024-09-19T09:41:36.962 INFO:tasks.workunit.client.0.smithi042.stdout:5/132: truncate d2/d4/d20/d11/f1f 337189 0 2024-09-19T09:41:36.966 INFO:tasks.workunit.client.0.smithi042.stdout:7/189: dwrite d0/fb [0,4194304] 0 2024-09-19T09:41:36.966 INFO:tasks.workunit.client.0.smithi042.stdout:7/190: stat d0/c9 0 2024-09-19T09:41:36.966 INFO:tasks.workunit.client.0.smithi042.stdout:7/191: write d0/f1a [1852727,93862] 0 2024-09-19T09:41:36.968 INFO:tasks.workunit.client.0.smithi042.stdout:5/133: mknod d2/db/c2a 0 2024-09-19T09:41:36.968 INFO:tasks.workunit.client.0.smithi042.stdout:5/134: write d2/f7 [120452,87327] 0 2024-09-19T09:41:36.968 INFO:tasks.workunit.client.0.smithi042.stdout:7/192: creat d0/d14/d3a/f3f x:0 0 0 2024-09-19T09:41:36.969 INFO:tasks.workunit.client.0.smithi042.stdout:1/180: dwrite d4/d15/d19/fc [0,4194304] 0 2024-09-19T09:41:36.973 INFO:tasks.workunit.client.0.smithi042.stdout:5/135: creat d2/d25/f2b x:0 0 0 2024-09-19T09:41:36.974 INFO:tasks.workunit.client.0.smithi042.stdout:1/181: creat d4/d15/d34/f3b x:0 0 0 2024-09-19T09:41:36.976 INFO:tasks.workunit.client.0.smithi042.stdout:2/190: dwrite d7/dd/d14/f25 [4194304,4194304] 0 2024-09-19T09:41:36.976 INFO:tasks.workunit.client.0.smithi042.stdout:2/191: dread - d7/f1a zero size 2024-09-19T09:41:36.976 INFO:tasks.workunit.client.0.smithi042.stdout:5/136: unlink d2/db/cd 0 2024-09-19T09:41:36.976 INFO:tasks.workunit.client.0.smithi042.stdout:5/137: stat d2/d4/d20/c21 0 2024-09-19T09:41:36.976 INFO:tasks.workunit.client.0.smithi042.stdout:9/200: dwrite d8/da/f1e [0,4194304] 0 2024-09-19T09:41:36.976 INFO:tasks.workunit.client.0.smithi042.stdout:0/224: dwrite d2/f1c [0,4194304] 0 2024-09-19T09:41:36.977 INFO:tasks.workunit.client.0.smithi042.stdout:1/182: mkdir d4/d1e/d25/d35/d3c 0 2024-09-19T09:41:36.977 INFO:tasks.workunit.client.0.smithi042.stdout:1/183: chown d4/d1e/c30 881 1 2024-09-19T09:41:36.978 INFO:tasks.workunit.client.0.smithi042.stdout:5/138: creat d2/d4/d20/f2c x:0 0 0 2024-09-19T09:41:36.978 INFO:tasks.workunit.client.0.smithi042.stdout:5/139: chown d2/d4/d20/d11/c29 498 1 2024-09-19T09:41:36.983 INFO:tasks.workunit.client.0.smithi042.stdout:5/140: creat d2/d4/d20/f2d x:0 0 0 2024-09-19T09:41:36.985 INFO:tasks.workunit.client.0.smithi042.stdout:5/141: mkdir d2/d4/d2e 0 2024-09-19T09:41:36.985 INFO:tasks.workunit.client.0.smithi042.stdout:5/142: fdatasync d2/d4/d20/d11/f1f 0 2024-09-19T09:41:36.986 INFO:tasks.workunit.client.0.smithi042.stdout:4/159: sync 2024-09-19T09:41:36.986 INFO:tasks.workunit.client.0.smithi042.stdout:6/200: sync 2024-09-19T09:41:36.986 INFO:tasks.workunit.client.0.smithi042.stdout:4/160: dread - d0/d1b/f26 zero size 2024-09-19T09:41:36.986 INFO:tasks.workunit.client.0.smithi042.stdout:6/201: readlink d1/de/d12/l1b 0 2024-09-19T09:41:36.986 INFO:tasks.workunit.client.0.smithi042.stdout:3/205: sync 2024-09-19T09:41:36.987 INFO:tasks.workunit.client.0.smithi042.stdout:9/201: dread d8/f11 [4194304,4194304] 0 2024-09-19T09:41:36.987 INFO:tasks.workunit.client.0.smithi042.stdout:9/202: write d8/da/f10 [650637,103988] 0 2024-09-19T09:41:36.987 INFO:tasks.workunit.client.0.smithi042.stdout:4/161: symlink d0/d28/d36/l3e 0 2024-09-19T09:41:36.987 INFO:tasks.workunit.client.0.smithi042.stdout:4/162: chown d0/f15 1245462 1 2024-09-19T09:41:36.987 INFO:tasks.workunit.client.0.smithi042.stdout:4/163: chown d0/f4 831599303 1 2024-09-19T09:41:36.988 INFO:tasks.workunit.client.0.smithi042.stdout:7/193: write d0/d14/f2a [3167107,100093] 0 2024-09-19T09:41:36.988 INFO:tasks.workunit.client.0.smithi042.stdout:1/184: dread d4/d15/d19/fc [0,4194304] 0 2024-09-19T09:41:36.988 INFO:tasks.workunit.client.0.smithi042.stdout:6/202: truncate d1/d20/f27 2405168 0 2024-09-19T09:41:36.989 INFO:tasks.workunit.client.0.smithi042.stdout:6/203: write d1/de/f35 [368315,21400] 0 2024-09-19T09:41:36.989 INFO:tasks.workunit.client.0.smithi042.stdout:9/203: mknod d8/db/c3b 0 2024-09-19T09:41:36.990 INFO:tasks.workunit.client.0.smithi042.stdout:4/164: mkdir d0/d1b/d1c/d2e/d3f 0 2024-09-19T09:41:36.991 INFO:tasks.workunit.client.0.smithi042.stdout:7/194: unlink d0/c34 0 2024-09-19T09:41:36.992 INFO:tasks.workunit.client.0.smithi042.stdout:1/185: symlink d4/d15/l3d 0 2024-09-19T09:41:36.993 INFO:tasks.workunit.client.0.smithi042.stdout:9/204: symlink d8/d32/l3c 0 2024-09-19T09:41:36.995 INFO:tasks.workunit.client.0.smithi042.stdout:7/195: rename d0/d30 to d0/d40 0 2024-09-19T09:41:36.995 INFO:tasks.workunit.client.0.smithi042.stdout:7/196: chown d0/c2c 214546376 1 2024-09-19T09:41:37.003 INFO:tasks.workunit.client.0.smithi042.stdout:6/204: dread d1/de/f28 [0,4194304] 0 2024-09-19T09:41:37.004 INFO:tasks.workunit.client.0.smithi042.stdout:0/225: dwrite d2/d10/f15 [4194304,4194304] 0 2024-09-19T09:41:37.004 INFO:tasks.workunit.client.0.smithi042.stdout:0/226: chown d2/d10/d12/d16/c17 9 1 2024-09-19T09:41:37.004 INFO:tasks.workunit.client.0.smithi042.stdout:3/206: read d4/d8/d9/f1e [3351385,21884] 0 2024-09-19T09:41:37.005 INFO:tasks.workunit.client.0.smithi042.stdout:5/143: dread d2/dc/f1a [0,4194304] 0 2024-09-19T09:41:37.006 INFO:tasks.workunit.client.0.smithi042.stdout:3/207: unlink d4/d8/c21 0 2024-09-19T09:41:37.006 INFO:tasks.workunit.client.0.smithi042.stdout:3/208: chown d4/d8/d9 16679719 1 2024-09-19T09:41:37.007 INFO:tasks.workunit.client.0.smithi042.stdout:5/144: creat d2/db/f2f x:0 0 0 2024-09-19T09:41:37.008 INFO:tasks.workunit.client.0.smithi042.stdout:3/209: truncate f0 1230013 0 2024-09-19T09:41:37.009 INFO:tasks.workunit.client.0.smithi042.stdout:3/210: mkdir d4/d8/d9/d12/d48 0 2024-09-19T09:41:37.013 INFO:tasks.workunit.client.0.smithi042.stdout:7/197: dread d0/d14/f2a [0,4194304] 0 2024-09-19T09:41:37.013 INFO:tasks.workunit.client.0.smithi042.stdout:6/205: dread d1/de/d12/f19 [0,4194304] 0 2024-09-19T09:41:37.013 INFO:tasks.workunit.client.0.smithi042.stdout:6/206: stat d1/de/d12 0 2024-09-19T09:41:37.013 INFO:tasks.workunit.client.0.smithi042.stdout:6/207: chown d1/de/f28 5817 1 2024-09-19T09:41:37.013 INFO:tasks.workunit.client.0.smithi042.stdout:6/208: chown d1/de/d12/l1b 739 1 2024-09-19T09:41:37.013 INFO:tasks.workunit.client.0.smithi042.stdout:6/209: dread - d1/de/d12/d22/f2a zero size 2024-09-19T09:41:37.015 INFO:tasks.workunit.client.0.smithi042.stdout:7/198: creat d0/d14/d3c/f41 x:0 0 0 2024-09-19T09:41:37.017 INFO:tasks.workunit.client.0.smithi042.stdout:6/210: creat d1/de/d12/d1c/f37 x:0 0 0 2024-09-19T09:41:37.018 INFO:tasks.workunit.client.0.smithi042.stdout:6/211: dread - d1/d2e/f30 zero size 2024-09-19T09:41:37.018 INFO:tasks.workunit.client.0.smithi042.stdout:3/211: dread d4/d8/d9/dc/d26/f47 [0,4194304] 0 2024-09-19T09:41:37.019 INFO:tasks.workunit.client.0.smithi042.stdout:3/212: write d4/d8/f20 [4263062,14926] 0 2024-09-19T09:41:37.019 INFO:tasks.workunit.client.0.smithi042.stdout:3/213: chown d4/d8/d9/dc/d26/d35/f44 27 1 2024-09-19T09:41:37.019 INFO:tasks.workunit.client.0.smithi042.stdout:7/199: mknod d0/d14/d3a/c42 0 2024-09-19T09:41:37.020 INFO:tasks.workunit.client.0.smithi042.stdout:6/212: rmdir d1/d20 39 2024-09-19T09:41:37.020 INFO:tasks.workunit.client.0.smithi042.stdout:6/213: chown d1/fc 54224365 1 2024-09-19T09:41:37.020 INFO:tasks.workunit.client.0.smithi042.stdout:6/214: truncate d1/de/d12/d22/f25 1761975 0 2024-09-19T09:41:37.021 INFO:tasks.workunit.client.0.smithi042.stdout:2/192: dwrite d7/dd/d14/d35/f38 [0,4194304] 0 2024-09-19T09:41:37.022 INFO:tasks.workunit.client.0.smithi042.stdout:2/193: symlink d7/l3d 0 2024-09-19T09:41:37.024 INFO:tasks.workunit.client.0.smithi042.stdout:2/194: symlink d7/dd/d22/d30/l3e 0 2024-09-19T09:41:37.028 INFO:tasks.workunit.client.0.smithi042.stdout:2/195: dread d7/f9 [0,4194304] 0 2024-09-19T09:41:37.028 INFO:tasks.workunit.client.0.smithi042.stdout:4/165: dwrite d0/d1b/d1c/d2e/d3b/f3c [0,4194304] 0 2024-09-19T09:41:37.029 INFO:tasks.workunit.client.0.smithi042.stdout:2/196: mkdir d7/dd/d1f/d3f 0 2024-09-19T09:41:37.029 INFO:tasks.workunit.client.0.smithi042.stdout:9/205: dwrite d8/f1a [0,4194304] 0 2024-09-19T09:41:37.029 INFO:tasks.workunit.client.0.smithi042.stdout:1/186: dwrite d4/d1d/d20/f24 [0,4194304] 0 2024-09-19T09:41:37.029 INFO:tasks.workunit.client.0.smithi042.stdout:5/145: write d2/dc/f1a [1441434,27481] 0 2024-09-19T09:41:37.030 INFO:tasks.workunit.client.0.smithi042.stdout:2/197: creat d7/dd/f40 x:0 0 0 2024-09-19T09:41:37.030 INFO:tasks.workunit.client.0.smithi042.stdout:2/198: dread - d7/dd/d22/f3c zero size 2024-09-19T09:41:37.030 INFO:tasks.workunit.client.0.smithi042.stdout:2/199: write d7/dd/d14/f1d [319027,31218] 0 2024-09-19T09:41:37.031 INFO:tasks.workunit.client.0.smithi042.stdout:2/200: mknod d7/dd/d1f/d3f/c41 0 2024-09-19T09:41:37.031 INFO:tasks.workunit.client.0.smithi042.stdout:2/201: chown d7/dd/d14/c3b 644395 1 2024-09-19T09:41:37.031 INFO:tasks.workunit.client.0.smithi042.stdout:2/202: truncate d7/dd/d22/d30/f34 444809 0 2024-09-19T09:41:37.032 INFO:tasks.workunit.client.0.smithi042.stdout:4/166: creat d0/d1b/f40 x:0 0 0 2024-09-19T09:41:37.038 INFO:tasks.workunit.client.0.smithi042.stdout:5/146: creat d2/db/f30 x:0 0 0 2024-09-19T09:41:37.038 INFO:tasks.workunit.client.0.smithi042.stdout:5/147: write d2/f1e [772438,25236] 0 2024-09-19T09:41:37.039 INFO:tasks.workunit.client.0.smithi042.stdout:5/148: mkdir d2/d4/d20/d31 0 2024-09-19T09:41:37.041 INFO:tasks.workunit.client.0.smithi042.stdout:9/206: read d8/f2c [1140834,10697] 0 2024-09-19T09:41:37.041 INFO:tasks.workunit.client.0.smithi042.stdout:5/149: creat d2/d4/d20/d31/f32 x:0 0 0 2024-09-19T09:41:37.041 INFO:tasks.workunit.client.0.smithi042.stdout:5/150: stat d2/l26 0 2024-09-19T09:41:37.043 INFO:tasks.workunit.client.0.smithi042.stdout:5/151: symlink d2/d4/d2e/l33 0 2024-09-19T09:41:37.044 INFO:tasks.workunit.client.0.smithi042.stdout:5/152: mknod d2/d4/d2e/c34 0 2024-09-19T09:41:37.044 INFO:tasks.workunit.client.0.smithi042.stdout:5/153: chown d2 251080 1 2024-09-19T09:41:37.044 INFO:tasks.workunit.client.0.smithi042.stdout:2/203: fsync d7/dd/f40 0 2024-09-19T09:41:37.045 INFO:tasks.workunit.client.0.smithi042.stdout:3/214: dwrite d4/d8/f19 [0,4194304] 0 2024-09-19T09:41:37.046 INFO:tasks.workunit.client.0.smithi042.stdout:2/204: symlink d7/dd/d22/d2a/l42 0 2024-09-19T09:41:37.051 INFO:tasks.workunit.client.0.smithi042.stdout:9/207: dread d8/da/d19/f1b [0,4194304] 0 2024-09-19T09:41:37.051 INFO:tasks.workunit.client.0.smithi042.stdout:8/153: sync 2024-09-19T09:41:37.051 INFO:tasks.workunit.client.0.smithi042.stdout:9/208: write d8/db/f34 [603691,25662] 0 2024-09-19T09:41:37.051 INFO:tasks.workunit.client.0.smithi042.stdout:7/200: dwrite d0/fb [4194304,4194304] 0 2024-09-19T09:41:37.055 INFO:tasks.workunit.client.0.smithi042.stdout:8/154: unlink d1/da/lb 0 2024-09-19T09:41:37.055 INFO:tasks.workunit.client.0.smithi042.stdout:8/155: truncate d1/da/f1b 881172 0 2024-09-19T09:41:37.055 INFO:tasks.workunit.client.0.smithi042.stdout:8/156: fdatasync d1/f18 0 2024-09-19T09:41:37.056 INFO:tasks.workunit.client.0.smithi042.stdout:7/201: dread d0/d14/f1c [0,4194304] 0 2024-09-19T09:41:37.056 INFO:tasks.workunit.client.0.smithi042.stdout:7/202: write d0/f36 [575516,64161] 0 2024-09-19T09:41:37.058 INFO:tasks.workunit.client.0.smithi042.stdout:8/157: creat d1/da/f28 x:0 0 0 2024-09-19T09:41:37.058 INFO:tasks.workunit.client.0.smithi042.stdout:8/158: truncate d1/da/f13 124026 0 2024-09-19T09:41:37.059 INFO:tasks.workunit.client.0.smithi042.stdout:7/203: link d0/d14/l2e d0/d3d/l43 0 2024-09-19T09:41:37.059 INFO:tasks.workunit.client.0.smithi042.stdout:3/215: read d4/d8/f19 [3376587,221] 0 2024-09-19T09:41:37.061 INFO:tasks.workunit.client.0.smithi042.stdout:7/204: mkdir d0/d14/d44 0 2024-09-19T09:41:37.061 INFO:tasks.workunit.client.0.smithi042.stdout:7/205: dread - d0/d14/d3a/f3f zero size 2024-09-19T09:41:37.062 INFO:tasks.workunit.client.0.smithi042.stdout:1/187: dwrite d4/d15/f21 [0,4194304] 0 2024-09-19T09:41:37.062 INFO:tasks.workunit.client.0.smithi042.stdout:1/188: dread - d4/d12/f2d zero size 2024-09-19T09:41:37.062 INFO:tasks.workunit.client.0.smithi042.stdout:4/167: dwrite d0/fc [0,4194304] 0 2024-09-19T09:41:37.063 INFO:tasks.workunit.client.0.smithi042.stdout:3/216: mknod d4/d8/d9/d39/c49 0 2024-09-19T09:41:37.063 INFO:tasks.workunit.client.0.smithi042.stdout:3/217: write d4/d8/d9/dc/f2b [774303,25571] 0 2024-09-19T09:41:37.065 INFO:tasks.workunit.client.0.smithi042.stdout:2/205: write d7/f1c [3196026,75864] 0 2024-09-19T09:41:37.065 INFO:tasks.workunit.client.0.smithi042.stdout:2/206: fsync d7/dd/d22/f24 0 2024-09-19T09:41:37.067 INFO:tasks.workunit.client.0.smithi042.stdout:3/218: rmdir d4/d41 0 2024-09-19T09:41:37.067 INFO:tasks.workunit.client.0.smithi042.stdout:5/154: dwrite d2/db/f30 [0,4194304] 0 2024-09-19T09:41:37.068 INFO:tasks.workunit.client.0.smithi042.stdout:6/215: dwrite d1/de/f28 [0,4194304] 0 2024-09-19T09:41:37.069 INFO:tasks.workunit.client.0.smithi042.stdout:3/219: dread d4/d8/d9/dc/f2b [0,4194304] 0 2024-09-19T09:41:37.074 INFO:tasks.workunit.client.0.smithi042.stdout:6/216: rmdir d1 39 2024-09-19T09:41:37.088 INFO:tasks.workunit.client.0.smithi042.stdout:4/168: dwrite d0/d1b/f2f [0,4194304] 0 2024-09-19T09:41:37.089 INFO:tasks.workunit.client.0.smithi042.stdout:1/189: dwrite d4/d15/d19/fe [0,4194304] 0 2024-09-19T09:41:37.091 INFO:tasks.workunit.client.0.smithi042.stdout:8/159: dwrite d1/da/f1b [0,4194304] 0 2024-09-19T09:41:37.091 INFO:tasks.workunit.client.0.smithi042.stdout:5/155: write d2/f1b [3599856,84875] 0 2024-09-19T09:41:37.091 INFO:tasks.workunit.client.0.smithi042.stdout:5/156: readlink d2/d4/l16 0 2024-09-19T09:41:37.091 INFO:tasks.workunit.client.0.smithi042.stdout:6/217: write d1/de/f28 [543221,6049] 0 2024-09-19T09:41:37.091 INFO:tasks.workunit.client.0.smithi042.stdout:6/218: read - d1/de/d12/d22/f2a zero size 2024-09-19T09:41:37.091 INFO:tasks.workunit.client.0.smithi042.stdout:1/190: rename d4/d15/d34 to d4/d29/d3e 0 2024-09-19T09:41:37.093 INFO:tasks.workunit.client.0.smithi042.stdout:3/220: getdents d4 0 2024-09-19T09:41:37.093 INFO:tasks.workunit.client.0.smithi042.stdout:3/221: write d4/d8/d9/dc/d26/d35/f44 [880219,35686] 0 2024-09-19T09:41:37.094 INFO:tasks.workunit.client.0.smithi042.stdout:8/160: getdents d1/da/d14 0 2024-09-19T09:41:37.095 INFO:tasks.workunit.client.0.smithi042.stdout:5/157: creat d2/d4/d20/d11/f35 x:0 0 0 2024-09-19T09:41:37.095 INFO:tasks.workunit.client.0.smithi042.stdout:1/191: rmdir d4/d1d/d20 39 2024-09-19T09:41:37.096 INFO:tasks.workunit.client.0.smithi042.stdout:1/192: write d4/d15/d19/fe [4317924,13953] 0 2024-09-19T09:41:37.096 INFO:tasks.workunit.client.0.smithi042.stdout:7/206: dwrite d0/fa [0,4194304] 0 2024-09-19T09:41:37.097 INFO:tasks.workunit.client.0.smithi042.stdout:3/222: symlink d4/d8/d9/d12/l4a 0 2024-09-19T09:41:37.097 INFO:tasks.workunit.client.0.smithi042.stdout:8/161: mknod d1/da/d14/c29 0 2024-09-19T09:41:37.099 INFO:tasks.workunit.client.0.smithi042.stdout:1/193: getdents d4/d15/d2e 0 2024-09-19T09:41:37.099 INFO:tasks.workunit.client.0.smithi042.stdout:1/194: fsync d4/d15/d19/ff 0 2024-09-19T09:41:37.099 INFO:tasks.workunit.client.0.smithi042.stdout:1/195: truncate d4/d29/d3e/f3b 408843 0 2024-09-19T09:41:37.099 INFO:tasks.workunit.client.0.smithi042.stdout:1/196: fsync d4/f14 0 2024-09-19T09:41:37.099 INFO:tasks.workunit.client.0.smithi042.stdout:3/223: mkdir d4/d8/d9/d39/d4b 0 2024-09-19T09:41:37.100 INFO:tasks.workunit.client.0.smithi042.stdout:6/219: write d1/f24 [2608167,47900] 0 2024-09-19T09:41:37.101 INFO:tasks.workunit.client.0.smithi042.stdout:8/162: getdents d1 0 2024-09-19T09:41:37.101 INFO:tasks.workunit.client.0.smithi042.stdout:8/163: dread - d1/f26 zero size 2024-09-19T09:41:37.102 INFO:tasks.workunit.client.0.smithi042.stdout:0/227: sync 2024-09-19T09:41:37.102 INFO:tasks.workunit.client.0.smithi042.stdout:0/228: fdatasync d2/d10/d12/d16/f2d 0 2024-09-19T09:41:37.103 INFO:tasks.workunit.client.0.smithi042.stdout:0/229: write d2/d10/d12/f40 [1165473,30437] 0 2024-09-19T09:41:37.103 INFO:tasks.workunit.client.0.smithi042.stdout:6/220: getdents d1 0 2024-09-19T09:41:37.103 INFO:tasks.workunit.client.0.smithi042.stdout:6/221: stat d1/f6 0 2024-09-19T09:41:37.105 INFO:tasks.workunit.client.0.smithi042.stdout:0/230: getdents d2/d10 0 2024-09-19T09:41:37.107 INFO:tasks.workunit.client.0.smithi042.stdout:8/164: symlink d1/da/d14/l2a 0 2024-09-19T09:41:37.107 INFO:tasks.workunit.client.0.smithi042.stdout:8/165: chown d1/ce 184 1 2024-09-19T09:41:37.117 INFO:tasks.workunit.client.0.smithi042.stdout:4/169: dwrite d0/d1b/f23 [0,4194304] 0 2024-09-19T09:41:37.124 INFO:tasks.workunit.client.0.smithi042.stdout:3/224: dwrite d4/f34 [0,4194304] 0 2024-09-19T09:41:37.129 INFO:tasks.workunit.client.0.smithi042.stdout:1/197: dwrite d4/d12/f18 [0,4194304] 0 2024-09-19T09:41:37.129 INFO:tasks.workunit.client.0.smithi042.stdout:7/207: dwrite d0/f27 [0,4194304] 0 2024-09-19T09:41:37.130 INFO:tasks.workunit.client.0.smithi042.stdout:7/208: write d0/f38 [267962,13447] 0 2024-09-19T09:41:37.131 INFO:tasks.workunit.client.0.smithi042.stdout:8/166: dwrite d1/f9 [0,4194304] 0 2024-09-19T09:41:37.131 INFO:tasks.workunit.client.0.smithi042.stdout:8/167: chown d1/da/f13 58837758 1 2024-09-19T09:41:37.132 INFO:tasks.workunit.client.0.smithi042.stdout:1/198: symlink d4/d15/d19/l3f 0 2024-09-19T09:41:37.133 INFO:tasks.workunit.client.0.smithi042.stdout:7/209: symlink d0/d3d/l45 0 2024-09-19T09:41:37.135 INFO:tasks.workunit.client.0.smithi042.stdout:7/210: rename d0/l2 to d0/d14/d3a/l46 0 2024-09-19T09:41:37.135 INFO:tasks.workunit.client.0.smithi042.stdout:8/168: dread d1/da/f12 [0,4194304] 0 2024-09-19T09:41:37.135 INFO:tasks.workunit.client.0.smithi042.stdout:7/211: mkdir d0/d14/d44/d47 0 2024-09-19T09:41:37.136 INFO:tasks.workunit.client.0.smithi042.stdout:1/199: write d4/d15/d19/f9 [774418,51373] 0 2024-09-19T09:41:37.136 INFO:tasks.workunit.client.0.smithi042.stdout:1/200: chown d4/d1d/f2b 27292713 1 2024-09-19T09:41:37.137 INFO:tasks.workunit.client.0.smithi042.stdout:1/201: fdatasync d4/d12/f2d 0 2024-09-19T09:41:37.137 INFO:tasks.workunit.client.0.smithi042.stdout:1/202: fsync d4/d15/d19/fc 0 2024-09-19T09:41:37.137 INFO:tasks.workunit.client.0.smithi042.stdout:1/203: write d4/d15/f17 [1606456,81600] 0 2024-09-19T09:41:37.137 INFO:tasks.workunit.client.0.smithi042.stdout:1/204: write d4/d15/d19/fc [4270392,68310] 0 2024-09-19T09:41:37.138 INFO:tasks.workunit.client.0.smithi042.stdout:1/205: symlink d4/d12/l40 0 2024-09-19T09:41:37.140 INFO:tasks.workunit.client.0.smithi042.stdout:4/170: dwrite d0/d1b/d1c/f2c [0,4194304] 0 2024-09-19T09:41:37.141 INFO:tasks.workunit.client.0.smithi042.stdout:8/169: read d1/f18 [549397,72679] 0 2024-09-19T09:41:37.142 INFO:tasks.workunit.client.0.smithi042.stdout:4/171: creat d0/d1b/f41 x:0 0 0 2024-09-19T09:41:37.144 INFO:tasks.workunit.client.0.smithi042.stdout:8/170: write d1/da/d14/f1a [714313,84776] 0 2024-09-19T09:41:37.145 INFO:tasks.workunit.client.0.smithi042.stdout:4/172: symlink d0/d1b/d1c/l42 0 2024-09-19T09:41:37.146 INFO:tasks.workunit.client.0.smithi042.stdout:4/173: write d0/f19 [121647,83854] 0 2024-09-19T09:41:37.147 INFO:tasks.workunit.client.0.smithi042.stdout:4/174: creat d0/d1b/d1c/d2e/f43 x:0 0 0 2024-09-19T09:41:37.147 INFO:tasks.workunit.client.0.smithi042.stdout:8/171: dread d1/da/d14/f17 [0,4194304] 0 2024-09-19T09:41:37.148 INFO:tasks.workunit.client.0.smithi042.stdout:4/175: mkdir d0/d1b/d1c/d2e/d44 0 2024-09-19T09:41:37.149 INFO:tasks.workunit.client.0.smithi042.stdout:1/206: read d4/d15/d19/f1a [2745225,103700] 0 2024-09-19T09:41:37.149 INFO:tasks.workunit.client.0.smithi042.stdout:4/176: symlink d0/d1b/d1c/d2e/l45 0 2024-09-19T09:41:37.150 INFO:tasks.workunit.client.0.smithi042.stdout:3/225: dwrite d4/d8/d9/d12/f29 [0,4194304] 0 2024-09-19T09:41:37.151 INFO:tasks.workunit.client.0.smithi042.stdout:1/207: mknod d4/d1d/d20/c41 0 2024-09-19T09:41:37.152 INFO:tasks.workunit.client.0.smithi042.stdout:4/177: creat d0/d1b/d1c/d2e/d44/f46 x:0 0 0 2024-09-19T09:41:37.154 INFO:tasks.workunit.client.0.smithi042.stdout:8/172: link d1/da/d14/f27 d1/da/d14/f2b 0 2024-09-19T09:41:37.156 INFO:tasks.workunit.client.0.smithi042.stdout:7/212: dwrite d0/fb [0,4194304] 0 2024-09-19T09:41:37.157 INFO:tasks.workunit.client.0.smithi042.stdout:8/173: unlink d1/da/f1b 0 2024-09-19T09:41:37.157 INFO:tasks.workunit.client.0.smithi042.stdout:8/174: write d1/f26 [900595,121755] 0 2024-09-19T09:41:37.157 INFO:tasks.workunit.client.0.smithi042.stdout:8/175: chown d1/da/d14/c29 556239635 1 2024-09-19T09:41:37.158 INFO:tasks.workunit.client.0.smithi042.stdout:8/176: rename d1/da/dd/c24 to d1/da/dd/c2c 0 2024-09-19T09:41:37.162 INFO:tasks.workunit.client.0.smithi042.stdout:4/178: write d0/fc [5321954,86154] 0 2024-09-19T09:41:37.162 INFO:tasks.workunit.client.0.smithi042.stdout:4/179: write d0/d1b/d1c/d2e/d44/f46 [147727,34311] 0 2024-09-19T09:41:37.162 INFO:tasks.workunit.client.0.smithi042.stdout:4/180: chown d0/c13 405444762 1 2024-09-19T09:41:37.169 INFO:tasks.workunit.client.0.smithi042.stdout:4/181: getdents d0/d1b/d1c 0 2024-09-19T09:41:37.172 INFO:tasks.workunit.client.0.smithi042.stdout:4/182: creat d0/d1b/d1c/d2e/d3b/f47 x:0 0 0 2024-09-19T09:41:37.175 INFO:tasks.workunit.client.0.smithi042.stdout:1/208: dwrite d4/d1d/d20/f24 [0,4194304] 0 2024-09-19T09:41:37.180 INFO:tasks.workunit.client.0.smithi042.stdout:4/183: creat d0/d1b/d1c/d2e/d3b/f48 x:0 0 0 2024-09-19T09:41:37.180 INFO:tasks.workunit.client.0.smithi042.stdout:8/177: dwrite d1/f9 [0,4194304] 0 2024-09-19T09:41:37.180 INFO:tasks.workunit.client.0.smithi042.stdout:1/209: mkdir d4/d15/d19/d42 0 2024-09-19T09:41:37.181 INFO:tasks.workunit.client.0.smithi042.stdout:1/210: stat d4/d1e 0 2024-09-19T09:41:37.181 INFO:tasks.workunit.client.0.smithi042.stdout:4/184: symlink d0/d28/l49 0 2024-09-19T09:41:37.181 INFO:tasks.workunit.client.0.smithi042.stdout:8/178: creat d1/da/dd/f2d x:0 0 0 2024-09-19T09:41:37.181 INFO:tasks.workunit.client.0.smithi042.stdout:4/185: dread d0/d1b/f1e [0,4194304] 0 2024-09-19T09:41:37.181 INFO:tasks.workunit.client.0.smithi042.stdout:4/186: dread - d0/d1b/f2b zero size 2024-09-19T09:41:37.182 INFO:tasks.workunit.client.0.smithi042.stdout:1/211: creat d4/d1e/d25/d35/d3c/f43 x:0 0 0 2024-09-19T09:41:37.182 INFO:tasks.workunit.client.0.smithi042.stdout:1/212: readlink d4/d12/l2c 0 2024-09-19T09:41:37.182 INFO:tasks.workunit.client.0.smithi042.stdout:8/179: mkdir d1/d2e 0 2024-09-19T09:41:37.183 INFO:tasks.workunit.client.0.smithi042.stdout:4/187: symlink d0/d1b/d1c/d2e/l4a 0 2024-09-19T09:41:37.184 INFO:tasks.workunit.client.0.smithi042.stdout:1/213: mkdir d4/d15/d44 0 2024-09-19T09:41:37.184 INFO:tasks.workunit.client.0.smithi042.stdout:3/226: dwrite d4/d8/f36 [0,4194304] 0 2024-09-19T09:41:37.184 INFO:tasks.workunit.client.0.smithi042.stdout:3/227: chown d4/c25 6767 1 2024-09-19T09:41:37.184 INFO:tasks.workunit.client.0.smithi042.stdout:4/188: mknod d0/d1b/d1c/d2e/d3f/c4b 0 2024-09-19T09:41:37.185 INFO:tasks.workunit.client.0.smithi042.stdout:8/180: dread d1/f10 [0,4194304] 0 2024-09-19T09:41:37.186 INFO:tasks.workunit.client.0.smithi042.stdout:3/228: rmdir d4/d8/d9/d1b 39 2024-09-19T09:41:37.186 INFO:tasks.workunit.client.0.smithi042.stdout:7/213: dwrite d0/f33 [0,4194304] 0 2024-09-19T09:41:37.191 INFO:tasks.workunit.client.0.smithi042.stdout:3/229: dread d4/ff [0,4194304] 0 2024-09-19T09:41:37.191 INFO:tasks.workunit.client.0.smithi042.stdout:3/230: fsync d4/d8/f20 0 2024-09-19T09:41:37.191 INFO:tasks.workunit.client.0.smithi042.stdout:3/231: chown d4/d8/f33 3 1 2024-09-19T09:41:37.197 INFO:tasks.workunit.client.0.smithi042.stdout:3/232: dread d4/d8/f20 [0,4194304] 0 2024-09-19T09:41:37.199 INFO:tasks.workunit.client.0.smithi042.stdout:3/233: mkdir d4/d8/d4c 0 2024-09-19T09:41:37.202 INFO:tasks.workunit.client.0.smithi042.stdout:3/234: dread f0 [0,4194304] 0 2024-09-19T09:41:37.203 INFO:tasks.workunit.client.0.smithi042.stdout:3/235: rmdir d4/d8/d9/dc/d26/d35 39 2024-09-19T09:41:37.204 INFO:tasks.workunit.client.0.smithi042.stdout:3/236: getdents d4/d8/d9/dc/d26 0 2024-09-19T09:41:37.205 INFO:tasks.workunit.client.0.smithi042.stdout:3/237: mknod d4/d8/d9/dc/d26/d35/c4d 0 2024-09-19T09:41:37.205 INFO:tasks.workunit.client.0.smithi042.stdout:3/238: fdatasync d4/ff 0 2024-09-19T09:41:37.205 INFO:tasks.workunit.client.0.smithi042.stdout:3/239: stat d4/ff 0 2024-09-19T09:41:37.206 INFO:tasks.workunit.client.0.smithi042.stdout:3/240: creat d4/d2a/f4e x:0 0 0 2024-09-19T09:41:37.207 INFO:tasks.workunit.client.0.smithi042.stdout:1/214: dwrite d4/d1d/d20/f24 [0,4194304] 0 2024-09-19T09:41:37.212 INFO:tasks.workunit.client.0.smithi042.stdout:7/214: dread d0/f1a [0,4194304] 0 2024-09-19T09:41:37.212 INFO:tasks.workunit.client.0.smithi042.stdout:7/215: readlink d0/lf 0 2024-09-19T09:41:37.213 INFO:tasks.workunit.client.0.smithi042.stdout:8/181: dwrite d1/da/d14/f2b [0,4194304] 0 2024-09-19T09:41:37.214 INFO:tasks.workunit.client.0.smithi042.stdout:7/216: unlink d0/c32 0 2024-09-19T09:41:37.216 INFO:tasks.workunit.client.0.smithi042.stdout:4/189: dwrite d0/f15 [0,4194304] 0 2024-09-19T09:41:37.216 INFO:tasks.workunit.client.0.smithi042.stdout:4/190: chown d0/l8 151644461 1 2024-09-19T09:41:37.216 INFO:tasks.workunit.client.0.smithi042.stdout:4/191: chown d0/f15 54788 1 2024-09-19T09:41:37.217 INFO:tasks.workunit.client.0.smithi042.stdout:8/182: creat d1/da/f2f x:0 0 0 2024-09-19T09:41:37.218 INFO:tasks.workunit.client.0.smithi042.stdout:7/217: unlink d0/d3d/l43 0 2024-09-19T09:41:37.218 INFO:tasks.workunit.client.0.smithi042.stdout:7/218: write d0/d14/d3a/f3f [419247,32724] 0 2024-09-19T09:41:37.218 INFO:tasks.workunit.client.0.smithi042.stdout:3/241: dread d4/f34 [0,4194304] 0 2024-09-19T09:41:37.218 INFO:tasks.workunit.client.0.smithi042.stdout:3/242: write d4/d2a/f4e [29747,127993] 0 2024-09-19T09:41:37.221 INFO:tasks.workunit.client.0.smithi042.stdout:7/219: rename d0/d14/d3a/l46 to d0/d40/l48 0 2024-09-19T09:41:37.221 INFO:tasks.workunit.client.0.smithi042.stdout:7/220: truncate d0/f25 4383099 0 2024-09-19T09:41:37.221 INFO:tasks.workunit.client.0.smithi042.stdout:7/221: read - d0/d14/d3a/f3e zero size 2024-09-19T09:41:37.221 INFO:tasks.workunit.client.0.smithi042.stdout:7/222: stat d0/f5 0 2024-09-19T09:41:37.221 INFO:tasks.workunit.client.0.smithi042.stdout:3/243: dread d4/d8/d9/d12/f1a [0,4194304] 0 2024-09-19T09:41:37.222 INFO:tasks.workunit.client.0.smithi042.stdout:7/223: unlink d0/d14/d3c/f41 0 2024-09-19T09:41:37.222 INFO:tasks.workunit.client.0.smithi042.stdout:7/224: chown d0/d14/c24 26492254 1 2024-09-19T09:41:37.224 INFO:tasks.workunit.client.0.smithi042.stdout:3/244: unlink d4/ff 0 2024-09-19T09:41:37.226 INFO:tasks.workunit.client.0.smithi042.stdout:9/209: sync 2024-09-19T09:41:37.226 INFO:tasks.workunit.client.0.smithi042.stdout:2/207: sync 2024-09-19T09:41:37.227 INFO:tasks.workunit.client.0.smithi042.stdout:2/208: mkdir d7/dd/d22/d43 0 2024-09-19T09:41:37.230 INFO:tasks.workunit.client.0.smithi042.stdout:2/209: mknod d7/dd/d14/c44 0 2024-09-19T09:41:37.230 INFO:tasks.workunit.client.0.smithi042.stdout:7/225: dread d0/f33 [0,4194304] 0 2024-09-19T09:41:37.230 INFO:tasks.workunit.client.0.smithi042.stdout:2/210: chown d7/l26 3529 1 2024-09-19T09:41:37.230 INFO:tasks.workunit.client.0.smithi042.stdout:2/211: fsync f6 0 2024-09-19T09:41:37.231 INFO:tasks.workunit.client.0.smithi042.stdout:1/215: dwrite d4/f14 [0,4194304] 0 2024-09-19T09:41:37.232 INFO:tasks.workunit.client.0.smithi042.stdout:2/212: mkdir d7/dd/d14/d35/d45 0 2024-09-19T09:41:37.234 INFO:tasks.workunit.client.0.smithi042.stdout:1/216: mkdir d4/d15/d19/d45 0 2024-09-19T09:41:37.234 INFO:tasks.workunit.client.0.smithi042.stdout:1/217: readlink d4/d15/d19/l3f 0 2024-09-19T09:41:37.234 INFO:tasks.workunit.client.0.smithi042.stdout:2/213: mknod d7/dd/d22/d30/c46 0 2024-09-19T09:41:37.234 INFO:tasks.workunit.client.0.smithi042.stdout:2/214: stat d7/dd/d22/d30/f34 0 2024-09-19T09:41:37.234 INFO:tasks.workunit.client.0.smithi042.stdout:1/218: chown d4/c11 3 1 2024-09-19T09:41:37.235 INFO:tasks.workunit.client.0.smithi042.stdout:1/219: creat d4/d1e/d25/f46 x:0 0 0 2024-09-19T09:41:37.235 INFO:tasks.workunit.client.0.smithi042.stdout:1/220: write d4/d15/f21 [4238389,66047] 0 2024-09-19T09:41:37.244 INFO:tasks.workunit.client.0.smithi042.stdout:7/226: dread d0/f27 [0,4194304] 0 2024-09-19T09:41:37.244 INFO:tasks.workunit.client.0.smithi042.stdout:4/192: dwrite d0/d1b/f2f [0,4194304] 0 2024-09-19T09:41:37.244 INFO:tasks.workunit.client.0.smithi042.stdout:7/227: stat d0/d14/d3a/f3e 0 2024-09-19T09:41:37.244 INFO:tasks.workunit.client.0.smithi042.stdout:7/228: fsync d0/f33 0 2024-09-19T09:41:37.244 INFO:tasks.workunit.client.0.smithi042.stdout:7/229: chown d0/d14/f1c 2 1 2024-09-19T09:41:37.247 INFO:tasks.workunit.client.0.smithi042.stdout:4/193: symlink d0/d1b/d1c/d2e/d3b/l4c 0 2024-09-19T09:41:37.247 INFO:tasks.workunit.client.0.smithi042.stdout:7/230: symlink d0/d40/l49 0 2024-09-19T09:41:37.248 INFO:tasks.workunit.client.0.smithi042.stdout:4/194: truncate d0/d1b/f23 3532001 0 2024-09-19T09:41:37.248 INFO:tasks.workunit.client.0.smithi042.stdout:4/195: chown d0/l8 288133 1 2024-09-19T09:41:37.249 INFO:tasks.workunit.client.0.smithi042.stdout:7/231: creat d0/d3d/f4a x:0 0 0 2024-09-19T09:41:37.250 INFO:tasks.workunit.client.0.smithi042.stdout:7/232: creat d0/d3d/f4b x:0 0 0 2024-09-19T09:41:37.252 INFO:tasks.workunit.client.0.smithi042.stdout:7/233: symlink d0/d14/d3c/l4c 0 2024-09-19T09:41:37.253 INFO:tasks.workunit.client.0.smithi042.stdout:7/234: symlink d0/d3d/l4d 0 2024-09-19T09:41:37.253 INFO:tasks.workunit.client.0.smithi042.stdout:7/235: write d0/d3d/f4b [976516,14856] 0 2024-09-19T09:41:37.253 INFO:tasks.workunit.client.0.smithi042.stdout:8/183: dwrite d1/f26 [0,4194304] 0 2024-09-19T09:41:37.254 INFO:tasks.workunit.client.0.smithi042.stdout:8/184: dread d1/da/f13 [0,4194304] 0 2024-09-19T09:41:37.255 INFO:tasks.workunit.client.0.smithi042.stdout:3/245: dwrite d4/f34 [0,4194304] 0 2024-09-19T09:41:37.255 INFO:tasks.workunit.client.0.smithi042.stdout:3/246: truncate d4/d8/d9/dc/d26/f32 487086 0 2024-09-19T09:41:37.255 INFO:tasks.workunit.client.0.smithi042.stdout:7/236: creat d0/d14/f4e x:0 0 0 2024-09-19T09:41:37.259 INFO:tasks.workunit.client.0.smithi042.stdout:3/247: dread d4/d8/f20 [0,4194304] 0 2024-09-19T09:41:37.260 INFO:tasks.workunit.client.0.smithi042.stdout:4/196: dread d0/f16 [4194304,4194304] 0 2024-09-19T09:41:37.260 INFO:tasks.workunit.client.0.smithi042.stdout:7/237: creat d0/d40/f4f x:0 0 0 2024-09-19T09:41:37.261 INFO:tasks.workunit.client.0.smithi042.stdout:7/238: dread d0/f36 [0,4194304] 0 2024-09-19T09:41:37.261 INFO:tasks.workunit.client.0.smithi042.stdout:7/239: fsync d0/f36 0 2024-09-19T09:41:37.262 INFO:tasks.workunit.client.0.smithi042.stdout:3/248: dread d4/d8/f33 [0,4194304] 0 2024-09-19T09:41:37.262 INFO:tasks.workunit.client.0.smithi042.stdout:4/197: rmdir d0/d1b/d1c/d2e/d44 39 2024-09-19T09:41:37.262 INFO:tasks.workunit.client.0.smithi042.stdout:7/240: truncate d0/f6 3677605 0 2024-09-19T09:41:37.262 INFO:tasks.workunit.client.0.smithi042.stdout:7/241: fdatasync d0/f1a 0 2024-09-19T09:41:37.264 INFO:tasks.workunit.client.0.smithi042.stdout:3/249: mkdir d4/d8/d9/d1b/d4f 0 2024-09-19T09:41:37.266 INFO:tasks.workunit.client.0.smithi042.stdout:4/198: creat d0/f4d x:0 0 0 2024-09-19T09:41:37.268 INFO:tasks.workunit.client.0.smithi042.stdout:3/250: rename d4/c3f to d4/d8/c50 0 2024-09-19T09:41:37.268 INFO:tasks.workunit.client.0.smithi042.stdout:1/221: dwrite d4/d12/f18 [0,4194304] 0 2024-09-19T09:41:37.269 INFO:tasks.workunit.client.0.smithi042.stdout:4/199: unlink d0/d28/f2d 0 2024-09-19T09:41:37.270 INFO:tasks.workunit.client.0.smithi042.stdout:1/222: rename d4/d1e/f39 to d4/f47 0 2024-09-19T09:41:37.270 INFO:tasks.workunit.client.0.smithi042.stdout:1/223: stat d4/d29/d3e 0 2024-09-19T09:41:37.270 INFO:tasks.workunit.client.0.smithi042.stdout:1/224: stat d4/d1e/f1f 0 2024-09-19T09:41:37.271 INFO:tasks.workunit.client.0.smithi042.stdout:4/200: creat d0/d1b/d1c/d2e/d3f/f4e x:0 0 0 2024-09-19T09:41:37.272 INFO:tasks.workunit.client.0.smithi042.stdout:1/225: getdents d4/d1e/d25 0 2024-09-19T09:41:37.272 INFO:tasks.workunit.client.0.smithi042.stdout:1/226: readlink d4/d15/l3d 0 2024-09-19T09:41:37.272 INFO:tasks.workunit.client.0.smithi042.stdout:0/231: sync 2024-09-19T09:41:37.272 INFO:tasks.workunit.client.0.smithi042.stdout:6/222: sync 2024-09-19T09:41:37.272 INFO:tasks.workunit.client.0.smithi042.stdout:5/158: sync 2024-09-19T09:41:37.273 INFO:tasks.workunit.client.0.smithi042.stdout:5/159: getdents d2/d4/d20/d11 0 2024-09-19T09:41:37.274 INFO:tasks.workunit.client.0.smithi042.stdout:6/223: creat d1/d20/f38 x:0 0 0 2024-09-19T09:41:37.274 INFO:tasks.workunit.client.0.smithi042.stdout:6/224: write d1/d20/f38 [905087,513] 0 2024-09-19T09:41:37.274 INFO:tasks.workunit.client.0.smithi042.stdout:6/225: stat d1/de/d12/f19 0 2024-09-19T09:41:37.274 INFO:tasks.workunit.client.0.smithi042.stdout:6/226: rename d1 to d1/d20/d39 22 2024-09-19T09:41:37.275 INFO:tasks.workunit.client.0.smithi042.stdout:0/232: creat d2/d10/d12/d2e/f46 x:0 0 0 2024-09-19T09:41:37.276 INFO:tasks.workunit.client.0.smithi042.stdout:6/227: rmdir d1/de/d12/d1c 39 2024-09-19T09:41:37.276 INFO:tasks.workunit.client.0.smithi042.stdout:6/228: write d1/de/f28 [474244,51240] 0 2024-09-19T09:41:37.276 INFO:tasks.workunit.client.0.smithi042.stdout:0/233: getdents d2/d10/d12/d19 0 2024-09-19T09:41:37.278 INFO:tasks.workunit.client.0.smithi042.stdout:8/185: dwrite d1/da/dd/f16 [0,4194304] 0 2024-09-19T09:41:37.278 INFO:tasks.workunit.client.0.smithi042.stdout:2/215: dwrite d7/dd/f16 [0,4194304] 0 2024-09-19T09:41:37.280 INFO:tasks.workunit.client.0.smithi042.stdout:8/186: mknod d1/da/c30 0 2024-09-19T09:41:37.280 INFO:tasks.workunit.client.0.smithi042.stdout:8/187: write d1/f9 [5583842,50094] 0 2024-09-19T09:41:37.281 INFO:tasks.workunit.client.0.smithi042.stdout:2/216: creat d7/dd/f47 x:0 0 0 2024-09-19T09:41:37.282 INFO:tasks.workunit.client.0.smithi042.stdout:4/201: dread d0/f4 [0,4194304] 0 2024-09-19T09:41:37.283 INFO:tasks.workunit.client.0.smithi042.stdout:3/251: read d4/d2a/f40 [4086455,90513] 0 2024-09-19T09:41:37.283 INFO:tasks.workunit.client.0.smithi042.stdout:8/188: link d1/da/d14/l19 d1/da/d14/l31 0 2024-09-19T09:41:37.284 INFO:tasks.workunit.client.0.smithi042.stdout:8/189: chown d1/da/f21 57 1 2024-09-19T09:41:37.284 INFO:tasks.workunit.client.0.smithi042.stdout:8/190: readlink d1/da/d14/l19 0 2024-09-19T09:41:37.285 INFO:tasks.workunit.client.0.smithi042.stdout:7/242: write d0/f6 [2347827,92531] 0 2024-09-19T09:41:37.285 INFO:tasks.workunit.client.0.smithi042.stdout:7/243: chown d0/c9 46051780 1 2024-09-19T09:41:37.285 INFO:tasks.workunit.client.0.smithi042.stdout:7/244: write d0/f1a [81660,16328] 0 2024-09-19T09:41:37.285 INFO:tasks.workunit.client.0.smithi042.stdout:4/202: link d0/fe d0/d1b/d1c/f4f 0 2024-09-19T09:41:37.287 INFO:tasks.workunit.client.0.smithi042.stdout:1/227: dread d4/d15/d19/fe [0,4194304] 0 2024-09-19T09:41:37.287 INFO:tasks.workunit.client.0.smithi042.stdout:3/252: creat d4/d8/d9/dc/d26/d35/f51 x:0 0 0 2024-09-19T09:41:37.288 INFO:tasks.workunit.client.0.smithi042.stdout:8/191: mkdir d1/da/d32 0 2024-09-19T09:41:37.288 INFO:tasks.workunit.client.0.smithi042.stdout:8/192: chown d1/da/dd/f2d 11 1 2024-09-19T09:41:37.289 INFO:tasks.workunit.client.0.smithi042.stdout:6/229: dread d1/de/f2d [0,4194304] 0 2024-09-19T09:41:37.289 INFO:tasks.workunit.client.0.smithi042.stdout:3/253: getdents d4/d8/d9/dc 0 2024-09-19T09:41:37.289 INFO:tasks.workunit.client.0.smithi042.stdout:3/254: truncate d4/d8/d9/dc/d26/f47 4958333 0 2024-09-19T09:41:37.290 INFO:tasks.workunit.client.0.smithi042.stdout:2/217: read d7/dd/f16 [2397838,85443] 0 2024-09-19T09:41:37.291 INFO:tasks.workunit.client.0.smithi042.stdout:8/193: rename d1/da/dd/f2d to d1/da/f33 0 2024-09-19T09:41:37.291 INFO:tasks.workunit.client.0.smithi042.stdout:8/194: chown d1/l1d 789 1 2024-09-19T09:41:37.292 INFO:tasks.workunit.client.0.smithi042.stdout:3/255: creat d4/f52 x:0 0 0 2024-09-19T09:41:37.292 INFO:tasks.workunit.client.0.smithi042.stdout:2/218: mkdir d7/dd/d48 0 2024-09-19T09:41:37.309 INFO:tasks.workunit.client.0.smithi042.stdout:4/203: dread d0/f15 [0,4194304] 0 2024-09-19T09:41:37.309 INFO:tasks.workunit.client.0.smithi042.stdout:5/160: dwrite d2/db/fe [0,4194304] 0 2024-09-19T09:41:37.309 INFO:tasks.workunit.client.0.smithi042.stdout:5/161: stat d2/d4/f15 0 2024-09-19T09:41:37.313 INFO:tasks.workunit.client.0.smithi042.stdout:4/204: creat d0/d1b/d1c/d2e/f50 x:0 0 0 2024-09-19T09:41:37.314 INFO:tasks.workunit.client.0.smithi042.stdout:0/234: dwrite d2/d10/d12/d16/f2f [0,4194304] 0 2024-09-19T09:41:37.314 INFO:tasks.workunit.client.0.smithi042.stdout:0/235: chown d2/d10/d12/d2e/f46 38253620 1 2024-09-19T09:41:37.318 INFO:tasks.workunit.client.0.smithi042.stdout:5/162: dread d2/d4/fa [0,4194304] 0 2024-09-19T09:41:37.318 INFO:tasks.workunit.client.0.smithi042.stdout:4/205: creat d0/d1b/d1c/f51 x:0 0 0 2024-09-19T09:41:37.318 INFO:tasks.workunit.client.0.smithi042.stdout:4/206: dread - d0/d1b/f40 zero size 2024-09-19T09:41:37.319 INFO:tasks.workunit.client.0.smithi042.stdout:0/236: creat d2/d10/d12/d16/d18/f47 x:0 0 0 2024-09-19T09:41:37.320 INFO:tasks.workunit.client.0.smithi042.stdout:0/237: write d2/d10/f15 [8469016,46928] 0 2024-09-19T09:41:37.320 INFO:tasks.workunit.client.0.smithi042.stdout:0/238: read d2/d10/d12/d2e/d32/f39 [92093,127917] 0 2024-09-19T09:41:37.322 INFO:tasks.workunit.client.0.smithi042.stdout:5/163: rename d2/d4/d20/f2d to d2/d4/d20/d11/f36 0 2024-09-19T09:41:37.323 INFO:tasks.workunit.client.0.smithi042.stdout:0/239: truncate d2/d10/d12/f31 896236 0 2024-09-19T09:41:37.323 INFO:tasks.workunit.client.0.smithi042.stdout:0/240: chown d2/d10/d1d/f2b 85 1 2024-09-19T09:41:37.324 INFO:tasks.workunit.client.0.smithi042.stdout:5/164: mkdir d2/d25/d37 0 2024-09-19T09:41:37.325 INFO:tasks.workunit.client.0.smithi042.stdout:5/165: chown d2/d4/d20/f2c 1 1 2024-09-19T09:41:37.325 INFO:tasks.workunit.client.0.smithi042.stdout:5/166: truncate d2/d4/d20/d11/f23 4690386 0 2024-09-19T09:41:37.325 INFO:tasks.workunit.client.0.smithi042.stdout:5/167: getdents d2/d25/d37 0 2024-09-19T09:41:37.325 INFO:tasks.workunit.client.0.smithi042.stdout:5/168: stat d2/l26 0 2024-09-19T09:41:37.325 INFO:tasks.workunit.client.0.smithi042.stdout:5/169: fdatasync d2/db/f30 0 2024-09-19T09:41:37.325 INFO:tasks.workunit.client.0.smithi042.stdout:5/170: stat d2/dc 0 2024-09-19T09:41:37.325 INFO:tasks.workunit.client.0.smithi042.stdout:5/171: write d2/db/f2f [151294,77686] 0 2024-09-19T09:41:37.326 INFO:tasks.workunit.client.0.smithi042.stdout:0/241: symlink d2/d10/d12/d2e/l48 0 2024-09-19T09:41:37.326 INFO:tasks.workunit.client.0.smithi042.stdout:0/242: mknod d2/d10/d12/d2e/c49 0 2024-09-19T09:41:37.326 INFO:tasks.workunit.client.0.smithi042.stdout:0/243: fsync d2/fb 0 2024-09-19T09:41:37.328 INFO:tasks.workunit.client.0.smithi042.stdout:0/244: rename d2/d10/d12/d16/f2f to d2/d10/d1d/d34/f4a 0 2024-09-19T09:41:37.328 INFO:tasks.workunit.client.0.smithi042.stdout:0/245: chown d2/d10/d12/d2e/c49 4819271 1 2024-09-19T09:41:37.328 INFO:tasks.workunit.client.0.smithi042.stdout:0/246: chown d2/d10/d12/d16/f2d 65503887 1 2024-09-19T09:41:37.328 INFO:tasks.workunit.client.0.smithi042.stdout:8/195: dwrite d1/da/d14/f1a [0,4194304] 0 2024-09-19T09:41:37.331 INFO:tasks.workunit.client.0.smithi042.stdout:6/230: dwrite d1/d20/f38 [0,4194304] 0 2024-09-19T09:41:37.331 INFO:tasks.workunit.client.0.smithi042.stdout:7/245: dwrite d0/d3d/f4b [0,4194304] 0 2024-09-19T09:41:37.331 INFO:tasks.workunit.client.0.smithi042.stdout:3/256: dwrite d4/d8/d9/dc/d26/f47 [0,4194304] 0 2024-09-19T09:41:37.332 INFO:tasks.workunit.client.0.smithi042.stdout:0/247: dread d2/d10/d1d/f30 [0,4194304] 0 2024-09-19T09:41:37.333 INFO:tasks.workunit.client.0.smithi042.stdout:1/228: dwrite d4/d12/f2d [0,4194304] 0 2024-09-19T09:41:37.338 INFO:tasks.workunit.client.0.smithi042.stdout:8/196: link d1/da/dd/c20 d1/c34 0 2024-09-19T09:41:37.340 INFO:tasks.workunit.client.0.smithi042.stdout:6/231: mkdir d1/de/d12/d1c/d3a 0 2024-09-19T09:41:37.342 INFO:tasks.workunit.client.0.smithi042.stdout:7/246: rename d0/d14/c3b to d0/d14/d3a/c50 0 2024-09-19T09:41:37.343 INFO:tasks.workunit.client.0.smithi042.stdout:0/248: symlink d2/d10/d1d/d34/l4b 0 2024-09-19T09:41:37.344 INFO:tasks.workunit.client.0.smithi042.stdout:5/172: dwrite d2/d4/d20/d11/f35 [0,4194304] 0 2024-09-19T09:41:37.344 INFO:tasks.workunit.client.0.smithi042.stdout:5/173: chown d2/d4/d20 94007 1 2024-09-19T09:41:37.346 INFO:tasks.workunit.client.0.smithi042.stdout:1/229: unlink d4/d1d/d20/f24 0 2024-09-19T09:41:37.346 INFO:tasks.workunit.client.0.smithi042.stdout:1/230: chown d4/d29/d3e/f3b 14601 1 2024-09-19T09:41:37.347 INFO:tasks.workunit.client.0.smithi042.stdout:8/197: getdents d1/da 0 2024-09-19T09:41:37.348 INFO:tasks.workunit.client.0.smithi042.stdout:6/232: creat d1/d2e/f3b x:0 0 0 2024-09-19T09:41:37.349 INFO:tasks.workunit.client.0.smithi042.stdout:7/247: mknod d0/d14/d3c/c51 0 2024-09-19T09:41:37.350 INFO:tasks.workunit.client.0.smithi042.stdout:0/249: rename d2/d10/d12/d16/f2d to d2/d10/d12/d2e/f4c 0 2024-09-19T09:41:37.350 INFO:tasks.workunit.client.0.smithi042.stdout:0/250: fsync d2/d10/d12/f31 0 2024-09-19T09:41:37.353 INFO:tasks.workunit.client.0.smithi042.stdout:5/174: creat d2/d4/d20/f38 x:0 0 0 2024-09-19T09:41:37.354 INFO:tasks.workunit.client.0.smithi042.stdout:1/231: unlink d4/d12/f18 0 2024-09-19T09:41:37.355 INFO:tasks.workunit.client.0.smithi042.stdout:8/198: creat d1/f35 x:0 0 0 2024-09-19T09:41:37.356 INFO:tasks.workunit.client.0.smithi042.stdout:6/233: truncate d1/de/f2d 702261 0 2024-09-19T09:41:37.357 INFO:tasks.workunit.client.0.smithi042.stdout:0/251: rmdir d2/d3c 0 2024-09-19T09:41:37.358 INFO:tasks.workunit.client.0.smithi042.stdout:1/232: write d4/d1e/d25/f28 [2280796,89183] 0 2024-09-19T09:41:37.359 INFO:tasks.workunit.client.0.smithi042.stdout:8/199: mknod d1/d2e/c36 0 2024-09-19T09:41:37.359 INFO:tasks.workunit.client.0.smithi042.stdout:6/234: rmdir d1/de/d12/d22 39 2024-09-19T09:41:37.360 INFO:tasks.workunit.client.0.smithi042.stdout:6/235: stat d1/de/f28 0 2024-09-19T09:41:37.360 INFO:tasks.workunit.client.0.smithi042.stdout:6/236: truncate d1/f18 1890262 0 2024-09-19T09:41:37.360 INFO:tasks.workunit.client.0.smithi042.stdout:7/248: mknod d0/c52 0 2024-09-19T09:41:37.361 INFO:tasks.workunit.client.0.smithi042.stdout:1/233: symlink d4/d1e/d25/l48 0 2024-09-19T09:41:37.362 INFO:tasks.workunit.client.0.smithi042.stdout:8/200: symlink d1/da/dd/l37 0 2024-09-19T09:41:37.364 INFO:tasks.workunit.client.0.smithi042.stdout:6/237: mkdir d1/d20/d3c 0 2024-09-19T09:41:37.364 INFO:tasks.workunit.client.0.smithi042.stdout:6/238: read - d1/d2e/f30 zero size 2024-09-19T09:41:37.365 INFO:tasks.workunit.client.0.smithi042.stdout:1/234: mknod d4/d1e/c49 0 2024-09-19T09:41:37.366 INFO:tasks.workunit.client.0.smithi042.stdout:6/239: rmdir d1/de/d12/d1c 39 2024-09-19T09:41:37.366 INFO:tasks.workunit.client.0.smithi042.stdout:6/240: fsync d1/d20/f27 0 2024-09-19T09:41:37.367 INFO:tasks.workunit.client.0.smithi042.stdout:1/235: creat d4/d29/f4a x:0 0 0 2024-09-19T09:41:37.374 INFO:tasks.workunit.client.0.smithi042.stdout:1/236: mkdir d4/d15/d19/d42/d4b 0 2024-09-19T09:41:37.374 INFO:tasks.workunit.client.0.smithi042.stdout:1/237: stat d4/d15/d19/ff 0 2024-09-19T09:41:37.375 INFO:tasks.workunit.client.0.smithi042.stdout:5/175: getdents d2/d4/d20 0 2024-09-19T09:41:37.375 INFO:tasks.workunit.client.0.smithi042.stdout:1/238: write d4/d29/f4a [350989,81131] 0 2024-09-19T09:41:37.375 INFO:tasks.workunit.client.0.smithi042.stdout:5/176: write d2/d4/d20/d31/f32 [916144,23031] 0 2024-09-19T09:41:37.376 INFO:tasks.workunit.client.0.smithi042.stdout:5/177: creat d2/dc/f39 x:0 0 0 2024-09-19T09:41:37.378 INFO:tasks.workunit.client.0.smithi042.stdout:5/178: rename d2/d4/d20/d11/c29 to d2/d4/d20/d11/c3a 0 2024-09-19T09:41:37.379 INFO:tasks.workunit.client.0.smithi042.stdout:5/179: truncate d2/f7 1953514 0 2024-09-19T09:41:37.381 INFO:tasks.workunit.client.0.smithi042.stdout:5/180: truncate d2/db/f30 4121864 0 2024-09-19T09:41:37.382 INFO:tasks.workunit.client.0.smithi042.stdout:0/252: dwrite d2/d10/d12/f31 [0,4194304] 0 2024-09-19T09:41:37.382 INFO:tasks.workunit.client.0.smithi042.stdout:0/253: write d2/d10/f1b [812004,17867] 0 2024-09-19T09:41:37.382 INFO:tasks.workunit.client.0.smithi042.stdout:8/201: dwrite d1/da/d14/f1a [0,4194304] 0 2024-09-19T09:41:37.383 INFO:tasks.workunit.client.0.smithi042.stdout:5/181: mknod d2/d4/d20/d11/c3b 0 2024-09-19T09:41:37.383 INFO:tasks.workunit.client.0.smithi042.stdout:5/182: dread - d2/d4/d20/d11/f36 zero size 2024-09-19T09:41:37.385 INFO:tasks.workunit.client.0.smithi042.stdout:7/249: dwrite d0/d14/d3a/f3e [0,4194304] 0 2024-09-19T09:41:37.389 INFO:tasks.workunit.client.0.smithi042.stdout:8/202: rename d1/f18 to d1/da/f38 0 2024-09-19T09:41:37.389 INFO:tasks.workunit.client.0.smithi042.stdout:8/203: chown d1/l3 63002398 1 2024-09-19T09:41:37.389 INFO:tasks.workunit.client.0.smithi042.stdout:8/204: readlink d1/da/l23 0 2024-09-19T09:41:37.393 INFO:tasks.workunit.client.0.smithi042.stdout:7/250: truncate d0/d3d/f4b 571030 0 2024-09-19T09:41:37.393 INFO:tasks.workunit.client.0.smithi042.stdout:8/205: symlink d1/d2e/l39 0 2024-09-19T09:41:37.395 INFO:tasks.workunit.client.0.smithi042.stdout:5/183: mkdir d2/db/d3c 0 2024-09-19T09:41:37.397 INFO:tasks.workunit.client.0.smithi042.stdout:7/251: mknod d0/d14/d3c/c53 0 2024-09-19T09:41:37.397 INFO:tasks.workunit.client.0.smithi042.stdout:7/252: dread - d0/d40/f4f zero size 2024-09-19T09:41:37.397 INFO:tasks.workunit.client.0.smithi042.stdout:7/253: truncate d0/d3d/f4a 34793 0 2024-09-19T09:41:37.397 INFO:tasks.workunit.client.0.smithi042.stdout:7/254: chown d0/fa 1473996 1 2024-09-19T09:41:37.399 INFO:tasks.workunit.client.0.smithi042.stdout:5/184: mkdir d2/dc/d3d 0 2024-09-19T09:41:37.399 INFO:tasks.workunit.client.0.smithi042.stdout:5/185: dread - d2/dc/f28 zero size 2024-09-19T09:41:37.402 INFO:tasks.workunit.client.0.smithi042.stdout:6/241: dwrite d1/fc [0,4194304] 0 2024-09-19T09:41:37.402 INFO:tasks.workunit.client.0.smithi042.stdout:6/242: chown d1/d2e 10246775 1 2024-09-19T09:41:37.404 INFO:tasks.workunit.client.0.smithi042.stdout:1/239: dwrite d4/d29/d3e/f3b [0,4194304] 0 2024-09-19T09:41:37.404 INFO:tasks.workunit.client.0.smithi042.stdout:1/240: fdatasync d4/d1e/f1f 0 2024-09-19T09:41:37.404 INFO:tasks.workunit.client.0.smithi042.stdout:6/243: creat d1/de/d12/d22/d34/f3d x:0 0 0 2024-09-19T09:41:37.406 INFO:tasks.workunit.client.0.smithi042.stdout:1/241: symlink d4/d1e/l4c 0 2024-09-19T09:41:37.406 INFO:tasks.workunit.client.0.smithi042.stdout:1/242: fsync d4/f14 0 2024-09-19T09:41:37.407 INFO:tasks.workunit.client.0.smithi042.stdout:6/244: symlink d1/d20/l3e 0 2024-09-19T09:41:37.407 INFO:tasks.workunit.client.0.smithi042.stdout:6/245: chown d1/de/d12/f19 5 1 2024-09-19T09:41:37.407 INFO:tasks.workunit.client.0.smithi042.stdout:6/246: readlink d1/de/d12/d1c/l2b 0 2024-09-19T09:41:37.407 INFO:tasks.workunit.client.0.smithi042.stdout:6/247: chown d1/d20/d3c 11756 1 2024-09-19T09:41:37.408 INFO:tasks.workunit.client.0.smithi042.stdout:1/243: creat d4/d15/d19/d45/f4d x:0 0 0 2024-09-19T09:41:37.409 INFO:tasks.workunit.client.0.smithi042.stdout:0/254: dwrite d2/d10/d12/d2e/f46 [0,4194304] 0 2024-09-19T09:41:37.410 INFO:tasks.workunit.client.0.smithi042.stdout:1/244: rename d4/d15/d19/d42/d4b to d4/d4e 0 2024-09-19T09:41:37.414 INFO:tasks.workunit.client.0.smithi042.stdout:9/210: sync 2024-09-19T09:41:37.415 INFO:tasks.workunit.client.0.smithi042.stdout:1/245: rmdir d4/d15/d2e/d31 0 2024-09-19T09:41:37.415 INFO:tasks.workunit.client.0.smithi042.stdout:1/246: readlink d4/d15/l3d 0 2024-09-19T09:41:37.416 INFO:tasks.workunit.client.0.smithi042.stdout:9/211: creat d8/f3d x:0 0 0 2024-09-19T09:41:37.416 INFO:tasks.workunit.client.0.smithi042.stdout:9/212: stat d8/da/l30 0 2024-09-19T09:41:37.416 INFO:tasks.workunit.client.0.smithi042.stdout:0/255: read d2/d10/d1d/f2b [1627659,118261] 0 2024-09-19T09:41:37.419 INFO:tasks.workunit.client.0.smithi042.stdout:1/247: truncate d4/f10 5930557 0 2024-09-19T09:41:37.419 INFO:tasks.workunit.client.0.smithi042.stdout:1/248: rename d4/d4e to d4/d4e/d4f 22 2024-09-19T09:41:37.420 INFO:tasks.workunit.client.0.smithi042.stdout:9/213: symlink d8/db/d31/l3e 0 2024-09-19T09:41:37.421 INFO:tasks.workunit.client.0.smithi042.stdout:8/206: dwrite d1/da/f21 [4194304,4194304] 0 2024-09-19T09:41:37.423 INFO:tasks.workunit.client.0.smithi042.stdout:0/256: rmdir d2/d10/d12/d16 39 2024-09-19T09:41:37.424 INFO:tasks.workunit.client.0.smithi042.stdout:9/214: creat d8/d1d/f3f x:0 0 0 2024-09-19T09:41:37.424 INFO:tasks.workunit.client.0.smithi042.stdout:7/255: dwrite d0/d14/f4e [0,4194304] 0 2024-09-19T09:41:37.426 INFO:tasks.workunit.client.0.smithi042.stdout:8/207: creat d1/da/dd/f3a x:0 0 0 2024-09-19T09:41:37.426 INFO:tasks.workunit.client.0.smithi042.stdout:8/208: stat d1/da/dd/f3a 0 2024-09-19T09:41:37.427 INFO:tasks.workunit.client.0.smithi042.stdout:0/257: mknod d2/d10/d12/d19/c4d 0 2024-09-19T09:41:37.427 INFO:tasks.workunit.client.0.smithi042.stdout:0/258: write d2/d10/d1d/f25 [1832486,11071] 0 2024-09-19T09:41:37.428 INFO:tasks.workunit.client.0.smithi042.stdout:9/215: truncate d8/da/d19/f2b 634019 0 2024-09-19T09:41:37.429 INFO:tasks.workunit.client.0.smithi042.stdout:5/186: dwrite d2/d4/d20/d11/f36 [0,4194304] 0 2024-09-19T09:41:37.429 INFO:tasks.workunit.client.0.smithi042.stdout:5/187: dread - d2/dc/f39 zero size 2024-09-19T09:41:37.435 INFO:tasks.workunit.client.0.smithi042.stdout:7/256: rmdir d0/d3d 39 2024-09-19T09:41:37.435 INFO:tasks.workunit.client.0.smithi042.stdout:8/209: symlink d1/l3b 0 2024-09-19T09:41:37.435 INFO:tasks.workunit.client.0.smithi042.stdout:0/259: mknod d2/d10/d12/d2e/c4e 0 2024-09-19T09:41:37.438 INFO:tasks.workunit.client.0.smithi042.stdout:7/257: unlink d0/l1d 0 2024-09-19T09:41:37.438 INFO:tasks.workunit.client.0.smithi042.stdout:7/258: fdatasync d0/f17 0 2024-09-19T09:41:37.440 INFO:tasks.workunit.client.0.smithi042.stdout:7/259: truncate d0/fb 18994 0 2024-09-19T09:41:37.441 INFO:tasks.workunit.client.0.smithi042.stdout:8/210: mknod d1/da/d14/c3c 0 2024-09-19T09:41:37.441 INFO:tasks.workunit.client.0.smithi042.stdout:8/211: stat d1/d2e/c36 0 2024-09-19T09:41:37.442 INFO:tasks.workunit.client.0.smithi042.stdout:0/260: mknod d2/d10/d1d/c4f 0 2024-09-19T09:41:37.442 INFO:tasks.workunit.client.0.smithi042.stdout:0/261: chown d2/d10/d12/d19/l28 289846822 1 2024-09-19T09:41:37.443 INFO:tasks.workunit.client.0.smithi042.stdout:7/260: creat d0/d14/d44/f54 x:0 0 0 2024-09-19T09:41:37.445 INFO:tasks.workunit.client.0.smithi042.stdout:0/262: mknod d2/c50 0 2024-09-19T09:41:37.445 INFO:tasks.workunit.client.0.smithi042.stdout:0/263: write d2/d10/d12/f40 [5235024,13437] 0 2024-09-19T09:41:37.446 INFO:tasks.workunit.client.0.smithi042.stdout:7/261: mkdir d0/d3d/d55 0 2024-09-19T09:41:37.448 INFO:tasks.workunit.client.0.smithi042.stdout:9/216: dwrite d8/da/d19/f2a [4194304,4194304] 0 2024-09-19T09:41:37.448 INFO:tasks.workunit.client.0.smithi042.stdout:9/217: dread - d8/f24 zero size 2024-09-19T09:41:37.449 INFO:tasks.workunit.client.0.smithi042.stdout:9/218: symlink d8/d32/l40 0 2024-09-19T09:41:37.450 INFO:tasks.workunit.client.0.smithi042.stdout:9/219: stat d8/c9 0 2024-09-19T09:41:37.450 INFO:tasks.workunit.client.0.smithi042.stdout:9/220: symlink d8/d32/l41 0 2024-09-19T09:41:37.451 INFO:tasks.workunit.client.0.smithi042.stdout:9/221: chown d8/db/d31 515 1 2024-09-19T09:41:37.452 INFO:tasks.workunit.client.0.smithi042.stdout:5/188: dwrite d2/d4/d20/d11/f1f [0,4194304] 0 2024-09-19T09:41:37.454 INFO:tasks.workunit.client.0.smithi042.stdout:7/262: write d0/f33 [885337,46347] 0 2024-09-19T09:41:37.456 INFO:tasks.workunit.client.0.smithi042.stdout:2/219: sync 2024-09-19T09:41:37.456 INFO:tasks.workunit.client.0.smithi042.stdout:2/220: write d7/f1c [4428276,18321] 0 2024-09-19T09:41:37.459 INFO:tasks.workunit.client.0.smithi042.stdout:7/263: dread d0/f17 [0,4194304] 0 2024-09-19T09:41:37.462 INFO:tasks.workunit.client.0.smithi042.stdout:8/212: dwrite d1/f10 [0,4194304] 0 2024-09-19T09:41:37.466 INFO:tasks.workunit.client.0.smithi042.stdout:5/189: dread d2/d4/fa [0,4194304] 0 2024-09-19T09:41:37.468 INFO:tasks.workunit.client.0.smithi042.stdout:5/190: rmdir d2/dc/d3d 0 2024-09-19T09:41:37.469 INFO:tasks.workunit.client.0.smithi042.stdout:5/191: mkdir d2/d4/d3e 0 2024-09-19T09:41:37.471 INFO:tasks.workunit.client.0.smithi042.stdout:0/264: dwrite d2/d10/d12/f31 [0,4194304] 0 2024-09-19T09:41:37.471 INFO:tasks.workunit.client.0.smithi042.stdout:7/264: dread d0/f25 [0,4194304] 0 2024-09-19T09:41:37.474 INFO:tasks.workunit.client.0.smithi042.stdout:5/192: dread d2/d4/d20/d31/f32 [0,4194304] 0 2024-09-19T09:41:37.474 INFO:tasks.workunit.client.0.smithi042.stdout:5/193: dread - d2/d4/d20/f38 zero size 2024-09-19T09:41:37.474 INFO:tasks.workunit.client.0.smithi042.stdout:5/194: read d2/d4/fa [2228622,92959] 0 2024-09-19T09:41:37.483 INFO:tasks.workunit.client.0.smithi042.stdout:2/221: dwrite f2 [0,4194304] 0 2024-09-19T09:41:37.484 INFO:tasks.workunit.client.0.smithi042.stdout:8/213: dwrite d1/da/d14/f17 [0,4194304] 0 2024-09-19T09:41:37.485 INFO:tasks.workunit.client.0.smithi042.stdout:2/222: creat d7/dd/d14/f49 x:0 0 0 2024-09-19T09:41:37.487 INFO:tasks.workunit.client.0.smithi042.stdout:8/214: mkdir d1/da/d32/d3d 0 2024-09-19T09:41:37.487 INFO:tasks.workunit.client.0.smithi042.stdout:8/215: write d1/da/f33 [805092,23695] 0 2024-09-19T09:41:37.488 INFO:tasks.workunit.client.0.smithi042.stdout:8/216: symlink d1/da/dd/l3e 0 2024-09-19T09:41:37.488 INFO:tasks.workunit.client.0.smithi042.stdout:8/217: truncate d1/da/f2f 187867 0 2024-09-19T09:41:37.489 INFO:tasks.workunit.client.0.smithi042.stdout:8/218: mkdir d1/da/d3f 0 2024-09-19T09:41:37.489 INFO:tasks.workunit.client.0.smithi042.stdout:8/219: truncate d1/da/d14/f2b 4253835 0 2024-09-19T09:41:37.489 INFO:tasks.workunit.client.0.smithi042.stdout:8/220: mknod d1/c40 0 2024-09-19T09:41:37.490 INFO:tasks.workunit.client.0.smithi042.stdout:2/223: truncate d7/f10 5200812 0 2024-09-19T09:41:37.491 INFO:tasks.workunit.client.0.smithi042.stdout:2/224: rmdir d7/dd/d14/d35 39 2024-09-19T09:41:37.491 INFO:tasks.workunit.client.0.smithi042.stdout:0/265: dwrite d2/d10/d12/d2e/f46 [0,4194304] 0 2024-09-19T09:41:37.493 INFO:tasks.workunit.client.0.smithi042.stdout:0/266: mkdir d2/d10/d12/d16/d51 0 2024-09-19T09:41:37.498 INFO:tasks.workunit.client.0.smithi042.stdout:2/225: dread d7/dd/f16 [0,4194304] 0 2024-09-19T09:41:37.499 INFO:tasks.workunit.client.0.smithi042.stdout:2/226: rename d7/dd/f2d to d7/dd/d22/f4a 0 2024-09-19T09:41:37.500 INFO:tasks.workunit.client.0.smithi042.stdout:2/227: truncate d7/dd/f37 8188 0 2024-09-19T09:41:37.501 INFO:tasks.workunit.client.0.smithi042.stdout:2/228: creat d7/f4b x:0 0 0 2024-09-19T09:41:37.501 INFO:tasks.workunit.client.0.smithi042.stdout:2/229: write d7/dd/f15 [271774,46790] 0 2024-09-19T09:41:37.501 INFO:tasks.workunit.client.0.smithi042.stdout:5/195: dwrite d2/d4/d20/d11/f23 [0,4194304] 0 2024-09-19T09:41:37.503 INFO:tasks.workunit.client.0.smithi042.stdout:5/196: creat d2/db/d3c/f3f x:0 0 0 2024-09-19T09:41:37.504 INFO:tasks.workunit.client.0.smithi042.stdout:5/197: readlink d2/dc/l22 0 2024-09-19T09:41:37.514 INFO:tasks.workunit.client.0.smithi042.stdout:0/267: dwrite d2/d10/d12/d2e/d32/f39 [0,4194304] 0 2024-09-19T09:41:37.515 INFO:tasks.workunit.client.0.smithi042.stdout:8/221: dwrite d1/da/f21 [0,4194304] 0 2024-09-19T09:41:37.517 INFO:tasks.workunit.client.0.smithi042.stdout:0/268: mkdir d2/d10/d12/d16/d18/d52 0 2024-09-19T09:41:37.519 INFO:tasks.workunit.client.0.smithi042.stdout:8/222: rmdir d1/da/dd 39 2024-09-19T09:41:37.523 INFO:tasks.workunit.client.0.smithi042.stdout:4/207: sync 2024-09-19T09:41:37.523 INFO:tasks.workunit.client.0.smithi042.stdout:3/257: sync 2024-09-19T09:41:37.523 INFO:tasks.workunit.client.0.smithi042.stdout:0/269: mknod d2/d10/d12/d16/d18/d52/c53 0 2024-09-19T09:41:37.523 INFO:tasks.workunit.client.0.smithi042.stdout:0/270: fdatasync d2/f1c 0 2024-09-19T09:41:37.524 INFO:tasks.workunit.client.0.smithi042.stdout:5/198: dwrite d2/dc/f39 [0,4194304] 0 2024-09-19T09:41:37.524 INFO:tasks.workunit.client.0.smithi042.stdout:5/199: chown d2/d25 33573824 1 2024-09-19T09:41:37.524 INFO:tasks.workunit.client.0.smithi042.stdout:5/200: write d2/d4/fa [3392178,69278] 0 2024-09-19T09:41:37.524 INFO:tasks.workunit.client.0.smithi042.stdout:4/208: mknod d0/d1b/d1c/c52 0 2024-09-19T09:41:37.528 INFO:tasks.workunit.client.0.smithi042.stdout:5/201: rename d2/dc/f39 to d2/d25/f40 0 2024-09-19T09:41:37.528 INFO:tasks.workunit.client.0.smithi042.stdout:0/271: dread d2/d10/f1b [0,4194304] 0 2024-09-19T09:41:37.528 INFO:tasks.workunit.client.0.smithi042.stdout:4/209: rmdir d0/d1b/d1c/d2e/d3b 39 2024-09-19T09:41:37.528 INFO:tasks.workunit.client.0.smithi042.stdout:4/210: readlink d0/d1b/d1c/l21 0 2024-09-19T09:41:37.528 INFO:tasks.workunit.client.0.smithi042.stdout:4/211: dread - d0/d1b/d1c/d2e/f43 zero size 2024-09-19T09:41:37.528 INFO:tasks.workunit.client.0.smithi042.stdout:4/212: dread - d0/d1b/d1c/d2e/d3b/f47 zero size 2024-09-19T09:41:37.537 INFO:tasks.workunit.client.0.smithi042.stdout:8/223: dwrite d1/da/d14/f1a [0,4194304] 0 2024-09-19T09:41:37.541 INFO:tasks.workunit.client.0.smithi042.stdout:8/224: mkdir d1/da/d32/d41 0 2024-09-19T09:41:37.546 INFO:tasks.workunit.client.0.smithi042.stdout:3/258: dwrite d4/d8/d9/dc/d26/d35/f51 [0,4194304] 0 2024-09-19T09:41:37.546 INFO:tasks.workunit.client.0.smithi042.stdout:3/259: dread - d4/f52 zero size 2024-09-19T09:41:37.548 INFO:tasks.workunit.client.0.smithi042.stdout:3/260: getdents d4/d8 0 2024-09-19T09:41:37.549 INFO:tasks.workunit.client.0.smithi042.stdout:0/272: dwrite d2/d10/d1d/f2b [0,4194304] 0 2024-09-19T09:41:37.549 INFO:tasks.workunit.client.0.smithi042.stdout:0/273: chown d2/d10/d12/d2e/f4c 2 1 2024-09-19T09:41:37.551 INFO:tasks.workunit.client.0.smithi042.stdout:0/274: creat d2/f54 x:0 0 0 2024-09-19T09:41:37.551 INFO:tasks.workunit.client.0.smithi042.stdout:0/275: read - d2/d10/d12/d24/f29 zero size 2024-09-19T09:41:37.554 INFO:tasks.workunit.client.0.smithi042.stdout:8/225: write d1/da/d14/f27 [4143382,5217] 0 2024-09-19T09:41:37.555 INFO:tasks.workunit.client.0.smithi042.stdout:8/226: fsync d1/da/dd/f3a 0 2024-09-19T09:41:37.555 INFO:tasks.workunit.client.0.smithi042.stdout:3/261: dread d4/d8/d9/dc/d26/f47 [0,4194304] 0 2024-09-19T09:41:37.555 INFO:tasks.workunit.client.0.smithi042.stdout:3/262: getdents d4/d8/d9/dc 0 2024-09-19T09:41:37.556 INFO:tasks.workunit.client.0.smithi042.stdout:3/263: unlink d4/d8/d9/dc/l46 0 2024-09-19T09:41:37.557 INFO:tasks.workunit.client.0.smithi042.stdout:3/264: symlink d4/l53 0 2024-09-19T09:41:37.558 INFO:tasks.workunit.client.0.smithi042.stdout:3/265: creat d4/d8/d9/d39/d4b/f54 x:0 0 0 2024-09-19T09:41:37.558 INFO:tasks.workunit.client.0.smithi042.stdout:5/202: dwrite d2/db/f10 [0,4194304] 0 2024-09-19T09:41:37.558 INFO:tasks.workunit.client.0.smithi042.stdout:4/213: dwrite d0/d1b/d1c/f2c [4194304,4194304] 0 2024-09-19T09:41:37.558 INFO:tasks.workunit.client.0.smithi042.stdout:4/214: readlink d0/d1b/d1c/l21 0 2024-09-19T09:41:37.558 INFO:tasks.workunit.client.0.smithi042.stdout:4/215: chown d0/d1b/d1c/f2c 83855656 1 2024-09-19T09:41:37.559 INFO:tasks.workunit.client.0.smithi042.stdout:4/216: chown d0/f5 60 1 2024-09-19T09:41:37.559 INFO:tasks.workunit.client.0.smithi042.stdout:3/266: creat d4/d8/d9/d39/f55 x:0 0 0 2024-09-19T09:41:37.561 INFO:tasks.workunit.client.0.smithi042.stdout:5/203: link d2/dc/l22 d2/db/d3c/l41 0 2024-09-19T09:41:37.563 INFO:tasks.workunit.client.0.smithi042.stdout:4/217: creat d0/d1b/d1c/d2e/d3b/f53 x:0 0 0 2024-09-19T09:41:37.563 INFO:tasks.workunit.client.0.smithi042.stdout:4/218: dread - d0/d1b/d1c/f25 zero size 2024-09-19T09:41:37.563 INFO:tasks.workunit.client.0.smithi042.stdout:4/219: stat d0/d1b/f23 0 2024-09-19T09:41:37.563 INFO:tasks.workunit.client.0.smithi042.stdout:4/220: fsync d0/d1b/f2a 0 2024-09-19T09:41:37.563 INFO:tasks.workunit.client.0.smithi042.stdout:4/221: rename d0/d1b/d1c to d0/d1b/d1c/d54 22 2024-09-19T09:41:37.564 INFO:tasks.workunit.client.0.smithi042.stdout:3/267: link d4/f34 d4/d8/d9/f56 0 2024-09-19T09:41:37.565 INFO:tasks.workunit.client.0.smithi042.stdout:4/222: link d0/d1b/f32 d0/d1b/d1c/f55 0 2024-09-19T09:41:37.566 INFO:tasks.workunit.client.0.smithi042.stdout:8/227: dread d1/da/d14/f2b [0,4194304] 0 2024-09-19T09:41:37.566 INFO:tasks.workunit.client.0.smithi042.stdout:8/228: readlink d1/da/l23 0 2024-09-19T09:41:37.566 INFO:tasks.workunit.client.0.smithi042.stdout:3/268: mknod d4/d8/d9/dc/d26/d35/c57 0 2024-09-19T09:41:37.567 INFO:tasks.workunit.client.0.smithi042.stdout:5/204: mkdir d2/db/d42 0 2024-09-19T09:41:37.568 INFO:tasks.workunit.client.0.smithi042.stdout:4/223: getdents d0/d1b/d1c/d2e/d3f 0 2024-09-19T09:41:37.572 INFO:tasks.workunit.client.0.smithi042.stdout:8/229: dread d1/da/d14/f2b [0,4194304] 0 2024-09-19T09:41:37.577 INFO:tasks.workunit.client.0.smithi042.stdout:3/269: write d4/d8/d9/d12/f29 [4120527,70071] 0 2024-09-19T09:41:37.577 INFO:tasks.workunit.client.0.smithi042.stdout:5/205: dread d2/d4/fa [0,4194304] 0 2024-09-19T09:41:37.577 INFO:tasks.workunit.client.0.smithi042.stdout:3/270: readlink l3 0 2024-09-19T09:41:37.577 INFO:tasks.workunit.client.0.smithi042.stdout:5/206: readlink d2/d4/d20/d11/l14 0 2024-09-19T09:41:37.579 INFO:tasks.workunit.client.0.smithi042.stdout:5/207: rename d2/d4/c6 to d2/d4/d2e/c43 0 2024-09-19T09:41:37.580 INFO:tasks.workunit.client.0.smithi042.stdout:3/271: unlink d4/d8/d9/dc/d26/d35/c57 0 2024-09-19T09:41:37.581 INFO:tasks.workunit.client.0.smithi042.stdout:8/230: write d1/f10 [1918250,7581] 0 2024-09-19T09:41:37.583 INFO:tasks.workunit.client.0.smithi042.stdout:8/231: unlink d1/f10 0 2024-09-19T09:41:37.584 INFO:tasks.workunit.client.0.smithi042.stdout:8/232: mknod d1/da/d32/d41/c42 0 2024-09-19T09:41:37.586 INFO:tasks.workunit.client.0.smithi042.stdout:3/272: getdents d4/d8/d9 0 2024-09-19T09:41:37.591 INFO:tasks.workunit.client.0.smithi042.stdout:4/224: dwrite d0/d1b/d1c/d2e/d3b/f47 [0,4194304] 0 2024-09-19T09:41:37.591 INFO:tasks.workunit.client.0.smithi042.stdout:4/225: dread - d0/d1b/f40 zero size 2024-09-19T09:41:37.591 INFO:tasks.workunit.client.0.smithi042.stdout:4/226: truncate d0/d1b/d1c/f51 493134 0 2024-09-19T09:41:37.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:37 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:41:37.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:37 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:41:37.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:37 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:41:37.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:37 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:41:37.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:37 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:41:37.608 INFO:tasks.workunit.client.0.smithi042.stdout:8/233: dwrite d1/f26 [0,4194304] 0 2024-09-19T09:41:37.609 INFO:tasks.workunit.client.0.smithi042.stdout:8/234: dread - d1/da/f28 zero size 2024-09-19T09:41:37.612 INFO:tasks.workunit.client.0.smithi042.stdout:8/235: dread d1/da/f38 [0,4194304] 0 2024-09-19T09:41:37.613 INFO:tasks.workunit.client.0.smithi042.stdout:4/227: dwrite d0/fe [0,4194304] 0 2024-09-19T09:41:37.613 INFO:tasks.workunit.client.0.smithi042.stdout:4/228: dread - d0/d1b/f2b zero size 2024-09-19T09:41:37.613 INFO:tasks.workunit.client.0.smithi042.stdout:5/208: dwrite d2/d4/d20/f2c [0,4194304] 0 2024-09-19T09:41:37.614 INFO:tasks.workunit.client.0.smithi042.stdout:8/236: symlink d1/da/d32/d3d/l43 0 2024-09-19T09:41:37.617 INFO:tasks.workunit.client.0.smithi042.stdout:4/229: mkdir d0/d1b/d56 0 2024-09-19T09:41:37.617 INFO:tasks.workunit.client.0.smithi042.stdout:4/230: chown d0/f19 1758499052 1 2024-09-19T09:41:37.618 INFO:tasks.workunit.client.0.smithi042.stdout:5/209: truncate d2/db/f30 2681772 0 2024-09-19T09:41:37.619 INFO:tasks.workunit.client.0.smithi042.stdout:8/237: creat d1/da/d32/d3d/f44 x:0 0 0 2024-09-19T09:41:37.620 INFO:tasks.workunit.client.0.smithi042.stdout:4/231: rmdir d0/d1b/d1c/d2e/d44 39 2024-09-19T09:41:37.620 INFO:tasks.workunit.client.0.smithi042.stdout:4/232: write d0/d1b/f40 [952275,66262] 0 2024-09-19T09:41:37.620 INFO:tasks.workunit.client.0.smithi042.stdout:3/273: dwrite d4/d8/f36 [4194304,4194304] 0 2024-09-19T09:41:37.620 INFO:tasks.workunit.client.0.smithi042.stdout:3/274: truncate d4/d8/d9/dc/f45 552666 0 2024-09-19T09:41:37.620 INFO:tasks.workunit.client.0.smithi042.stdout:3/275: readlink l3 0 2024-09-19T09:41:37.621 INFO:tasks.workunit.client.0.smithi042.stdout:5/210: symlink d2/d25/l44 0 2024-09-19T09:41:37.621 INFO:tasks.workunit.client.0.smithi042.stdout:8/238: write d1/da/d14/f1a [5180397,5071] 0 2024-09-19T09:41:37.624 INFO:tasks.workunit.client.0.smithi042.stdout:3/276: symlink d4/d8/d9/d39/d4b/l58 0 2024-09-19T09:41:37.624 INFO:tasks.workunit.client.0.smithi042.stdout:4/233: dread d0/f19 [0,4194304] 0 2024-09-19T09:41:37.625 INFO:tasks.workunit.client.0.smithi042.stdout:5/211: creat d2/d4/d20/f45 x:0 0 0 2024-09-19T09:41:37.625 INFO:tasks.workunit.client.0.smithi042.stdout:5/212: fsync d2/d25/f2b 0 2024-09-19T09:41:37.625 INFO:tasks.workunit.client.0.smithi042.stdout:5/213: chown d2/f1b 524239 1 2024-09-19T09:41:37.625 INFO:tasks.workunit.client.0.smithi042.stdout:3/277: dread d4/d2a/f4e [0,4194304] 0 2024-09-19T09:41:37.625 INFO:tasks.workunit.client.0.smithi042.stdout:4/234: dread d0/d1b/d1c/f51 [0,4194304] 0 2024-09-19T09:41:37.626 INFO:tasks.workunit.client.0.smithi042.stdout:5/214: mknod d2/c46 0 2024-09-19T09:41:37.626 INFO:tasks.workunit.client.0.smithi042.stdout:5/215: truncate d2/f7 2516533 0 2024-09-19T09:41:37.626 INFO:tasks.workunit.client.0.smithi042.stdout:3/278: dread d4/d2a/f4e [0,4194304] 0 2024-09-19T09:41:37.627 INFO:tasks.workunit.client.0.smithi042.stdout:3/279: creat d4/d8/d9/dc/f59 x:0 0 0 2024-09-19T09:41:37.629 INFO:tasks.workunit.client.0.smithi042.stdout:3/280: unlink d4/d8/d9/d39/f55 0 2024-09-19T09:41:37.631 INFO:tasks.workunit.client.0.smithi042.stdout:3/281: dread d4/d8/f33 [0,4194304] 0 2024-09-19T09:41:37.632 INFO:tasks.workunit.client.0.smithi042.stdout:6/248: sync 2024-09-19T09:41:37.632 INFO:tasks.workunit.client.0.smithi042.stdout:1/249: sync 2024-09-19T09:41:37.632 INFO:tasks.workunit.client.0.smithi042.stdout:5/216: dread d2/dc/f1a [0,4194304] 0 2024-09-19T09:41:37.633 INFO:tasks.workunit.client.0.smithi042.stdout:6/249: mkdir d1/de/d12/d22/d34/d3f 0 2024-09-19T09:41:37.634 INFO:tasks.workunit.client.0.smithi042.stdout:6/250: readlink d1/l2f 0 2024-09-19T09:41:37.634 INFO:tasks.workunit.client.0.smithi042.stdout:6/251: write d1/de/d12/d22/d34/f3d [280223,8694] 0 2024-09-19T09:41:37.634 INFO:tasks.workunit.client.0.smithi042.stdout:6/252: truncate d1/de/d12/d22/f2a 107578 0 2024-09-19T09:41:37.635 INFO:tasks.workunit.client.0.smithi042.stdout:6/253: mknod d1/d2e/c40 0 2024-09-19T09:41:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:37 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:41:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:37 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:41:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:37 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:41:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:37 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:41:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:37 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:41:37.636 INFO:tasks.workunit.client.0.smithi042.stdout:4/235: dread d0/d1b/f2f [0,4194304] 0 2024-09-19T09:41:37.636 INFO:tasks.workunit.client.0.smithi042.stdout:6/254: unlink d1/c36 0 2024-09-19T09:41:37.637 INFO:tasks.workunit.client.0.smithi042.stdout:8/239: dwrite d1/f35 [0,4194304] 0 2024-09-19T09:41:37.637 INFO:tasks.workunit.client.0.smithi042.stdout:4/236: dread d0/d1b/f1e [0,4194304] 0 2024-09-19T09:41:37.637 INFO:tasks.workunit.client.0.smithi042.stdout:4/237: chown d0/d1b/d1c/f25 688266357 1 2024-09-19T09:41:37.639 INFO:tasks.workunit.client.0.smithi042.stdout:8/240: mknod d1/d2e/c45 0 2024-09-19T09:41:37.640 INFO:tasks.workunit.client.0.smithi042.stdout:4/238: truncate d0/d1b/d1c/f1f 3833769 0 2024-09-19T09:41:37.640 INFO:tasks.workunit.client.0.smithi042.stdout:4/239: fsync d0/f19 0 2024-09-19T09:41:37.640 INFO:tasks.workunit.client.0.smithi042.stdout:1/250: dread d4/d15/d2e/f37 [0,4194304] 0 2024-09-19T09:41:37.641 INFO:tasks.workunit.client.0.smithi042.stdout:6/255: dread d1/de/f2d [0,4194304] 0 2024-09-19T09:41:37.641 INFO:tasks.workunit.client.0.smithi042.stdout:5/217: dread d2/db/f2f [0,4194304] 0 2024-09-19T09:41:37.647 INFO:tasks.workunit.client.0.smithi042.stdout:1/251: mknod d4/d15/d19/d42/c50 0 2024-09-19T09:41:37.648 INFO:tasks.workunit.client.0.smithi042.stdout:5/218: write d2/db/fe [2183506,17214] 0 2024-09-19T09:41:37.649 INFO:tasks.workunit.client.0.smithi042.stdout:6/256: mknod d1/de/c41 0 2024-09-19T09:41:37.649 INFO:tasks.workunit.client.0.smithi042.stdout:6/257: fsync d1/f24 0 2024-09-19T09:41:37.651 INFO:tasks.workunit.client.0.smithi042.stdout:6/258: dread d1/de/f2d [0,4194304] 0 2024-09-19T09:41:37.651 INFO:tasks.workunit.client.0.smithi042.stdout:6/259: chown d1/d2e/f31 73764 1 2024-09-19T09:41:37.651 INFO:tasks.workunit.client.0.smithi042.stdout:1/252: mkdir d4/d15/d19/d42/d51 0 2024-09-19T09:41:37.652 INFO:tasks.workunit.client.0.smithi042.stdout:5/219: rmdir d2 39 2024-09-19T09:41:37.653 INFO:tasks.workunit.client.0.smithi042.stdout:6/260: creat d1/de/d12/d1c/d3a/f42 x:0 0 0 2024-09-19T09:41:37.654 INFO:tasks.workunit.client.0.smithi042.stdout:6/261: write d1/de/d12/d22/f2a [360545,97218] 0 2024-09-19T09:41:37.654 INFO:tasks.workunit.client.0.smithi042.stdout:6/262: write d1/de/d12/d22/f25 [2205152,62399] 0 2024-09-19T09:41:37.654 INFO:tasks.workunit.client.0.smithi042.stdout:3/282: dwrite d4/d8/d9/f1e [0,4194304] 0 2024-09-19T09:41:37.654 INFO:tasks.workunit.client.0.smithi042.stdout:1/253: creat d4/d15/d19/d45/f52 x:0 0 0 2024-09-19T09:41:37.656 INFO:tasks.workunit.client.0.smithi042.stdout:5/220: rename d2/dc/f28 to d2/dc/f47 0 2024-09-19T09:41:37.657 INFO:tasks.workunit.client.0.smithi042.stdout:6/263: symlink d1/d20/l43 0 2024-09-19T09:41:37.658 INFO:tasks.workunit.client.0.smithi042.stdout:3/283: creat d4/d8/d9/d12/d48/f5a x:0 0 0 2024-09-19T09:41:37.659 INFO:tasks.workunit.client.0.smithi042.stdout:1/254: link d4/d12/l40 d4/d15/l53 0 2024-09-19T09:41:37.660 INFO:tasks.workunit.client.0.smithi042.stdout:5/221: mknod d2/db/d3c/c48 0 2024-09-19T09:41:37.660 INFO:tasks.workunit.client.0.smithi042.stdout:9/222: sync 2024-09-19T09:41:37.661 INFO:tasks.workunit.client.0.smithi042.stdout:6/264: mknod d1/de/d12/d22/c44 0 2024-09-19T09:41:37.661 INFO:tasks.workunit.client.0.smithi042.stdout:6/265: write d1/de/d12/d22/d34/f3d [1044767,83361] 0 2024-09-19T09:41:37.662 INFO:tasks.workunit.client.0.smithi042.stdout:1/255: symlink d4/d1e/d25/l54 0 2024-09-19T09:41:37.666 INFO:tasks.workunit.client.0.smithi042.stdout:5/222: rename d2/db/d3c/l41 to d2/d4/d20/l49 0 2024-09-19T09:41:37.666 INFO:tasks.workunit.client.0.smithi042.stdout:6/266: mkdir d1/d20/d45 0 2024-09-19T09:41:37.666 INFO:tasks.workunit.client.0.smithi042.stdout:5/223: write d2/d4/d20/f38 [1037702,105048] 0 2024-09-19T09:41:37.667 INFO:tasks.workunit.client.0.smithi042.stdout:1/256: creat d4/d4e/f55 x:0 0 0 2024-09-19T09:41:37.670 INFO:tasks.workunit.client.0.smithi042.stdout:5/224: mknod d2/dc/c4a 0 2024-09-19T09:41:37.670 INFO:tasks.workunit.client.0.smithi042.stdout:5/225: stat d2/f1e 0 2024-09-19T09:41:37.672 INFO:tasks.workunit.client.0.smithi042.stdout:5/226: mknod d2/db/c4b 0 2024-09-19T09:41:37.674 INFO:tasks.workunit.client.0.smithi042.stdout:6/267: dread d1/fc [0,4194304] 0 2024-09-19T09:41:37.674 INFO:tasks.workunit.client.0.smithi042.stdout:6/268: write d1/d2e/f30 [437595,127849] 0 2024-09-19T09:41:37.675 INFO:tasks.workunit.client.0.smithi042.stdout:4/240: truncate d0/f16 3266296 0 2024-09-19T09:41:37.675 INFO:tasks.workunit.client.0.smithi042.stdout:3/284: dwrite d4/d8/d9/d12/f29 [4194304,4194304] 0 2024-09-19T09:41:37.686 INFO:tasks.workunit.client.0.smithi042.stdout:1/257: dread d4/d29/d3e/f3b [0,4194304] 0 2024-09-19T09:41:37.687 INFO:tasks.workunit.client.0.smithi042.stdout:1/258: truncate d4/f14 3133326 0 2024-09-19T09:41:37.687 INFO:tasks.workunit.client.0.smithi042.stdout:1/259: read d4/d15/d19/f9 [922001,124936] 0 2024-09-19T09:41:37.688 INFO:tasks.workunit.client.0.smithi042.stdout:1/260: getdents d4/d1d 0 2024-09-19T09:41:37.691 INFO:tasks.workunit.client.0.smithi042.stdout:9/223: dwrite d8/f15 [0,4194304] 0 2024-09-19T09:41:37.692 INFO:tasks.workunit.client.0.smithi042.stdout:1/261: dread d4/d29/f4a [0,4194304] 0 2024-09-19T09:41:37.699 INFO:tasks.workunit.client.0.smithi042.stdout:1/262: mknod d4/d4e/c56 0 2024-09-19T09:41:37.703 INFO:tasks.workunit.client.0.smithi042.stdout:5/227: dwrite d2/d4/d20/d11/f35 [0,4194304] 0 2024-09-19T09:41:37.704 INFO:tasks.workunit.client.0.smithi042.stdout:5/228: truncate d2/d4/f15 2290767 0 2024-09-19T09:41:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:37 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:41:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:37 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:41:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:37 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:41:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:37 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:41:37.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:37 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:41:37.709 INFO:tasks.workunit.client.0.smithi042.stdout:1/263: dread d4/d29/d3e/f3b [0,4194304] 0 2024-09-19T09:41:37.709 INFO:tasks.workunit.client.0.smithi042.stdout:5/229: dread d2/f7 [0,4194304] 0 2024-09-19T09:41:37.710 INFO:tasks.workunit.client.0.smithi042.stdout:1/264: creat d4/d4e/f57 x:0 0 0 2024-09-19T09:41:37.712 INFO:tasks.workunit.client.0.smithi042.stdout:6/269: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:41:37.714 INFO:tasks.workunit.client.0.smithi042.stdout:3/285: dwrite d4/d8/f19 [4194304,4194304] 0 2024-09-19T09:41:37.714 INFO:tasks.workunit.client.0.smithi042.stdout:4/241: dwrite d0/d1b/f40 [0,4194304] 0 2024-09-19T09:41:37.714 INFO:tasks.workunit.client.0.smithi042.stdout:4/242: truncate d0/d1b/f32 753014 0 2024-09-19T09:41:37.714 INFO:tasks.workunit.client.0.smithi042.stdout:4/243: read d0/d1b/f24 [734093,65788] 0 2024-09-19T09:41:37.714 INFO:tasks.workunit.client.0.smithi042.stdout:4/244: fsync d0/d1b/d1c/d2e/f43 0 2024-09-19T09:41:37.715 INFO:tasks.workunit.client.0.smithi042.stdout:4/245: chown d0/d1b/d1c/l21 18960598 1 2024-09-19T09:41:37.715 INFO:tasks.workunit.client.0.smithi042.stdout:4/246: write d0/d1b/f24 [141005,73493] 0 2024-09-19T09:41:37.715 INFO:tasks.workunit.client.0.smithi042.stdout:4/247: fsync d0/d1b/d1c/f25 0 2024-09-19T09:41:37.715 INFO:tasks.workunit.client.0.smithi042.stdout:4/248: fdatasync d0/f4d 0 2024-09-19T09:41:37.718 INFO:tasks.workunit.client.0.smithi042.stdout:9/224: dwrite d8/d1d/d28/f2d [0,4194304] 0 2024-09-19T09:41:37.719 INFO:tasks.workunit.client.0.smithi042.stdout:5/230: dread d2/d4/fa [0,4194304] 0 2024-09-19T09:41:37.719 INFO:tasks.workunit.client.0.smithi042.stdout:3/286: symlink d4/d8/d9/d1b/l5b 0 2024-09-19T09:41:37.725 INFO:tasks.workunit.client.0.smithi042.stdout:1/265: dwrite d4/d15/d19/ff [0,4194304] 0 2024-09-19T09:41:37.726 INFO:tasks.workunit.client.0.smithi042.stdout:9/225: rename d8/da/l2f to d8/db/d31/l42 0 2024-09-19T09:41:37.727 INFO:tasks.workunit.client.0.smithi042.stdout:5/231: creat d2/d4/d2e/f4c x:0 0 0 2024-09-19T09:41:37.728 INFO:tasks.workunit.client.0.smithi042.stdout:3/287: mkdir d4/d8/d9/dc/d26/d5c 0 2024-09-19T09:41:37.729 INFO:tasks.workunit.client.0.smithi042.stdout:3/288: stat d4/d8/d9/d1b/c2d 0 2024-09-19T09:41:37.729 INFO:tasks.workunit.client.0.smithi042.stdout:3/289: read d4/d8/d9/dc/d26/f27 [1359889,42392] 0 2024-09-19T09:41:37.729 INFO:tasks.workunit.client.0.smithi042.stdout:3/290: truncate d4/d2a/f40 4440085 0 2024-09-19T09:41:37.729 INFO:tasks.workunit.client.0.smithi042.stdout:4/249: symlink d0/l57 0 2024-09-19T09:41:37.731 INFO:tasks.workunit.client.0.smithi042.stdout:0/276: sync 2024-09-19T09:41:37.731 INFO:tasks.workunit.client.0.smithi042.stdout:7/265: sync 2024-09-19T09:41:37.731 INFO:tasks.workunit.client.0.smithi042.stdout:2/230: sync 2024-09-19T09:41:37.731 INFO:tasks.workunit.client.0.smithi042.stdout:7/266: write d0/fa [265370,89393] 0 2024-09-19T09:41:37.731 INFO:tasks.workunit.client.0.smithi042.stdout:9/226: dread d8/da/d19/f1b [0,4194304] 0 2024-09-19T09:41:37.732 INFO:tasks.workunit.client.0.smithi042.stdout:1/266: mknod d4/d1e/d25/d35/c58 0 2024-09-19T09:41:37.732 INFO:tasks.workunit.client.0.smithi042.stdout:2/231: mkdir d7/dd/d14/d35/d4c 0 2024-09-19T09:41:37.732 INFO:tasks.workunit.client.0.smithi042.stdout:2/232: truncate d7/f1a 239848 0 2024-09-19T09:41:37.733 INFO:tasks.workunit.client.0.smithi042.stdout:5/232: rename d2/dc to d2/d25/d4d 0 2024-09-19T09:41:37.734 INFO:tasks.workunit.client.0.smithi042.stdout:3/291: link d4/c24 d4/d8/d9/d1b/d4f/c5d 0 2024-09-19T09:41:37.735 INFO:tasks.workunit.client.0.smithi042.stdout:4/250: mknod d0/d1b/d1c/d2e/d3b/c58 0 2024-09-19T09:41:37.735 INFO:tasks.workunit.client.0.smithi042.stdout:4/251: readlink d0/d1b/d1c/d2e/l45 0 2024-09-19T09:41:37.736 INFO:tasks.workunit.client.0.smithi042.stdout:7/267: getdents d0/d14/d3c 0 2024-09-19T09:41:37.737 INFO:tasks.workunit.client.0.smithi042.stdout:9/227: rmdir d8/d32 39 2024-09-19T09:41:37.737 INFO:tasks.workunit.client.0.smithi042.stdout:8/241: sync 2024-09-19T09:41:37.738 INFO:tasks.workunit.client.0.smithi042.stdout:1/267: creat d4/d1e/d25/d35/d3c/f59 x:0 0 0 2024-09-19T09:41:37.739 INFO:tasks.workunit.client.0.smithi042.stdout:0/277: dread d2/d10/d1d/f2b [0,4194304] 0 2024-09-19T09:41:37.739 INFO:tasks.workunit.client.0.smithi042.stdout:3/292: mknod d4/d8/d9/c5e 0 2024-09-19T09:41:37.740 INFO:tasks.workunit.client.0.smithi042.stdout:4/252: creat d0/d1b/d1c/f59 x:0 0 0 2024-09-19T09:41:37.741 INFO:tasks.workunit.client.0.smithi042.stdout:4/253: write d0/d1b/f2a [1010356,70701] 0 2024-09-19T09:41:37.742 INFO:tasks.workunit.client.0.smithi042.stdout:5/233: dread d2/f1b [0,4194304] 0 2024-09-19T09:41:37.742 INFO:tasks.workunit.client.0.smithi042.stdout:9/228: creat d8/d1d/d28/f43 x:0 0 0 2024-09-19T09:41:37.744 INFO:tasks.workunit.client.0.smithi042.stdout:1/268: creat d4/d1e/d25/d35/f5a x:0 0 0 2024-09-19T09:41:37.744 INFO:tasks.workunit.client.0.smithi042.stdout:8/242: dread d1/da/f33 [0,4194304] 0 2024-09-19T09:41:37.745 INFO:tasks.workunit.client.0.smithi042.stdout:0/278: creat d2/d10/d12/d16/d18/d52/f55 x:0 0 0 2024-09-19T09:41:37.745 INFO:tasks.workunit.client.0.smithi042.stdout:0/279: fsync d2/f54 0 2024-09-19T09:41:37.745 INFO:tasks.workunit.client.0.smithi042.stdout:0/280: write d2/d10/d12/d24/f29 [903494,98304] 0 2024-09-19T09:41:37.745 INFO:tasks.workunit.client.0.smithi042.stdout:0/281: fsync d2/fb 0 2024-09-19T09:41:37.746 INFO:tasks.workunit.client.0.smithi042.stdout:1/269: write d4/d29/f4a [174284,57713] 0 2024-09-19T09:41:37.746 INFO:tasks.workunit.client.0.smithi042.stdout:0/282: write d2/d10/d12/d16/d18/d52/f55 [949993,89204] 0 2024-09-19T09:41:37.746 INFO:tasks.workunit.client.0.smithi042.stdout:3/293: link f0 d4/d8/d4c/f5f 0 2024-09-19T09:41:37.746 INFO:tasks.workunit.client.0.smithi042.stdout:4/254: mkdir d0/d1b/d1c/d2e/d3f/d5a 0 2024-09-19T09:41:37.749 INFO:tasks.workunit.client.0.smithi042.stdout:7/268: mkdir d0/d56 0 2024-09-19T09:41:37.749 INFO:tasks.workunit.client.0.smithi042.stdout:5/234: truncate d2/d4/d20/d11/f35 3602669 0 2024-09-19T09:41:37.749 INFO:tasks.workunit.client.0.smithi042.stdout:9/229: creat d8/da/d19/d1c/d21/f44 x:0 0 0 2024-09-19T09:41:37.749 INFO:tasks.workunit.client.0.smithi042.stdout:5/235: chown d2/f7 1386591932 1 2024-09-19T09:41:37.750 INFO:tasks.workunit.client.0.smithi042.stdout:8/243: mkdir d1/da/d32/d46 0 2024-09-19T09:41:37.750 INFO:tasks.workunit.client.0.smithi042.stdout:8/244: truncate d1/da/f28 311017 0 2024-09-19T09:41:37.750 INFO:tasks.workunit.client.0.smithi042.stdout:1/270: mkdir d4/d15/d19/d42/d5b 0 2024-09-19T09:41:37.751 INFO:tasks.workunit.client.0.smithi042.stdout:1/271: read - d4/d15/d19/d45/f4d zero size 2024-09-19T09:41:37.751 INFO:tasks.workunit.client.0.smithi042.stdout:1/272: fsync d4/d15/d19/f1a 0 2024-09-19T09:41:37.751 INFO:tasks.workunit.client.0.smithi042.stdout:1/273: stat d4/d15/d19/d42/c50 0 2024-09-19T09:41:37.752 INFO:tasks.workunit.client.0.smithi042.stdout:3/294: mknod d4/d8/d9/c60 0 2024-09-19T09:41:37.752 INFO:tasks.workunit.client.0.smithi042.stdout:3/295: rename d4/d8 to d4/d8/d4c/d61 22 2024-09-19T09:41:37.752 INFO:tasks.workunit.client.0.smithi042.stdout:7/269: rmdir d0/d14/d44 39 2024-09-19T09:41:37.754 INFO:tasks.workunit.client.0.smithi042.stdout:8/245: unlink d1/da/f28 0 2024-09-19T09:41:37.756 INFO:tasks.workunit.client.0.smithi042.stdout:3/296: getdents d4/d8/d9/d1b 0 2024-09-19T09:41:37.760 INFO:tasks.workunit.client.0.smithi042.stdout:8/246: rmdir d1/da/d32/d3d 39 2024-09-19T09:41:37.761 INFO:tasks.workunit.client.0.smithi042.stdout:7/270: truncate d0/f38 3616981 0 2024-09-19T09:41:37.761 INFO:tasks.workunit.client.0.smithi042.stdout:8/247: chown d1/da/d14 1180680 1 2024-09-19T09:41:37.762 INFO:tasks.workunit.client.0.smithi042.stdout:8/248: truncate d1/da/d14/f2b 1842445 0 2024-09-19T09:41:37.764 INFO:tasks.workunit.client.0.smithi042.stdout:7/271: symlink d0/d3d/d55/l57 0 2024-09-19T09:41:37.766 INFO:tasks.workunit.client.0.smithi042.stdout:8/249: symlink d1/l47 0 2024-09-19T09:41:37.769 INFO:tasks.workunit.client.0.smithi042.stdout:7/272: link d0/d14/d3a/c50 d0/c58 0 2024-09-19T09:41:37.769 INFO:tasks.workunit.client.0.smithi042.stdout:7/273: dread - d0/f23 zero size 2024-09-19T09:41:37.772 INFO:tasks.workunit.client.0.smithi042.stdout:4/255: dwrite d0/f14 [0,4194304] 0 2024-09-19T09:41:37.772 INFO:tasks.workunit.client.0.smithi042.stdout:4/256: readlink d0/l3a 0 2024-09-19T09:41:37.775 INFO:tasks.workunit.client.0.smithi042.stdout:4/257: rename d0/d1b/f24 to d0/d1b/d1c/d2e/d3f/d5a/f5b 0 2024-09-19T09:41:37.779 INFO:tasks.workunit.client.0.smithi042.stdout:7/274: dread d0/f33 [0,4194304] 0 2024-09-19T09:41:37.782 INFO:tasks.workunit.client.0.smithi042.stdout:4/258: dread d0/d1b/d1c/f1f [0,4194304] 0 2024-09-19T09:41:37.782 INFO:tasks.workunit.client.0.smithi042.stdout:0/283: dwrite d2/d10/d12/d2e/f46 [0,4194304] 0 2024-09-19T09:41:37.783 INFO:tasks.workunit.client.0.smithi042.stdout:7/275: creat d0/f59 x:0 0 0 2024-09-19T09:41:37.783 INFO:tasks.workunit.client.0.smithi042.stdout:7/276: chown d0/d14/d3c/c51 827812 1 2024-09-19T09:41:37.783 INFO:tasks.workunit.client.0.smithi042.stdout:7/277: fdatasync d0/d40/f4f 0 2024-09-19T09:41:37.783 INFO:tasks.workunit.client.0.smithi042.stdout:7/278: getdents d0/d56 0 2024-09-19T09:41:37.783 INFO:tasks.workunit.client.0.smithi042.stdout:4/259: rmdir d0/d28/d36 39 2024-09-19T09:41:37.784 INFO:tasks.workunit.client.0.smithi042.stdout:4/260: fsync d0/d1b/d1c/d2e/d44/f46 0 2024-09-19T09:41:37.785 INFO:tasks.workunit.client.0.smithi042.stdout:3/297: dwrite d4/d8/f20 [0,4194304] 0 2024-09-19T09:41:37.785 INFO:tasks.workunit.client.0.smithi042.stdout:3/298: fdatasync d4/d8/d9/dc/f2b 0 2024-09-19T09:41:37.785 INFO:tasks.workunit.client.0.smithi042.stdout:5/236: dwrite d2/d4/fa [0,4194304] 0 2024-09-19T09:41:37.785 INFO:tasks.workunit.client.0.smithi042.stdout:5/237: chown d2/d25/d4d/l19 3331 1 2024-09-19T09:41:37.785 INFO:tasks.workunit.client.0.smithi042.stdout:7/279: creat d0/d3d/f5a x:0 0 0 2024-09-19T09:41:37.786 INFO:tasks.workunit.client.0.smithi042.stdout:7/280: read d0/d3d/f4a [21079,19584] 0 2024-09-19T09:41:37.787 INFO:tasks.workunit.client.0.smithi042.stdout:4/261: symlink d0/d28/l5c 0 2024-09-19T09:41:37.788 INFO:tasks.workunit.client.0.smithi042.stdout:3/299: rmdir d4/d8/de 0 2024-09-19T09:41:37.790 INFO:tasks.workunit.client.0.smithi042.stdout:5/238: unlink d2/d4/d20/f2c 0 2024-09-19T09:41:37.790 INFO:tasks.workunit.client.0.smithi042.stdout:7/281: link d0/d14/d3c/c53 d0/d56/c5b 0 2024-09-19T09:41:37.792 INFO:tasks.workunit.client.0.smithi042.stdout:4/262: truncate d0/d1b/d1c/f2c 1075710 0 2024-09-19T09:41:37.793 INFO:tasks.workunit.client.0.smithi042.stdout:1/274: dwrite d4/d29/f4a [0,4194304] 0 2024-09-19T09:41:37.793 INFO:tasks.workunit.client.0.smithi042.stdout:1/275: chown d4/d1e/l36 161176 1 2024-09-19T09:41:37.796 INFO:tasks.workunit.client.0.smithi042.stdout:1/276: creat d4/d1e/d25/d35/d3c/f5c x:0 0 0 2024-09-19T09:41:37.798 INFO:tasks.workunit.client.0.smithi042.stdout:1/277: mknod d4/d15/d44/c5d 0 2024-09-19T09:41:37.799 INFO:tasks.workunit.client.0.smithi042.stdout:0/284: write d2/d10/d12/f40 [3429336,71330] 0 2024-09-19T09:41:37.799 INFO:tasks.workunit.client.0.smithi042.stdout:8/250: dwrite d1/f9 [0,4194304] 0 2024-09-19T09:41:37.802 INFO:tasks.workunit.client.0.smithi042.stdout:1/278: symlink d4/d4e/l5e 0 2024-09-19T09:41:37.802 INFO:tasks.workunit.client.0.smithi042.stdout:1/279: write d4/d29/f38 [810980,124990] 0 2024-09-19T09:41:37.803 INFO:tasks.workunit.client.0.smithi042.stdout:5/239: read d2/db/f30 [2277966,84565] 0 2024-09-19T09:41:37.803 INFO:tasks.workunit.client.0.smithi042.stdout:5/240: write d2/db/f2f [94953,74720] 0 2024-09-19T09:41:37.805 INFO:tasks.workunit.client.0.smithi042.stdout:0/285: dread f1 [0,4194304] 0 2024-09-19T09:41:37.806 INFO:tasks.workunit.client.0.smithi042.stdout:8/251: link d1/d2e/c45 d1/da/d3f/c48 0 2024-09-19T09:41:37.806 INFO:tasks.workunit.client.0.smithi042.stdout:1/280: write d4/d15/d2e/f37 [4021284,71482] 0 2024-09-19T09:41:37.806 INFO:tasks.workunit.client.0.smithi042.stdout:8/252: fdatasync d1/f9 0 2024-09-19T09:41:37.808 INFO:tasks.workunit.client.0.smithi042.stdout:0/286: creat d2/d10/d12/d16/d51/f56 x:0 0 0 2024-09-19T09:41:37.808 INFO:tasks.workunit.client.0.smithi042.stdout:8/253: readlink d1/da/l23 0 2024-09-19T09:41:37.811 INFO:tasks.workunit.client.0.smithi042.stdout:4/263: dwrite d0/d1b/d1c/d2e/d3b/f53 [0,4194304] 0 2024-09-19T09:41:37.814 INFO:tasks.workunit.client.0.smithi042.stdout:7/282: dwrite d0/d40/f4f [0,4194304] 0 2024-09-19T09:41:37.815 INFO:tasks.workunit.client.0.smithi042.stdout:4/264: rename d0/l9 to d0/d1b/d1c/d2e/d3f/d5a/l5d 0 2024-09-19T09:41:37.815 INFO:tasks.workunit.client.0.smithi042.stdout:4/265: write d0/d1b/d1c/d2e/d3b/f48 [977076,50433] 0 2024-09-19T09:41:37.817 INFO:tasks.workunit.client.0.smithi042.stdout:7/283: mkdir d0/d56/d5c 0 2024-09-19T09:41:37.817 INFO:tasks.workunit.client.0.smithi042.stdout:7/284: truncate d0/d3d/f4b 1546153 0 2024-09-19T09:41:37.818 INFO:tasks.workunit.client.0.smithi042.stdout:4/266: unlink d0/d1b/d1c/c1d 0 2024-09-19T09:41:37.818 INFO:tasks.workunit.client.0.smithi042.stdout:7/285: mkdir d0/d14/d5d 0 2024-09-19T09:41:37.820 INFO:tasks.workunit.client.0.smithi042.stdout:4/267: symlink d0/d1b/d1c/l5e 0 2024-09-19T09:41:37.820 INFO:tasks.workunit.client.0.smithi042.stdout:8/254: dread d1/da/d14/f1a [0,4194304] 0 2024-09-19T09:41:37.821 INFO:tasks.workunit.client.0.smithi042.stdout:8/255: chown d1/da/d14/f17 17325936 1 2024-09-19T09:41:37.821 INFO:tasks.workunit.client.0.smithi042.stdout:4/268: symlink d0/d1b/d1c/d2e/d44/l5f 0 2024-09-19T09:41:37.826 INFO:tasks.workunit.client.0.smithi042.stdout:4/269: dread d0/d1b/f1e [0,4194304] 0 2024-09-19T09:41:37.826 INFO:tasks.workunit.client.0.smithi042.stdout:4/270: fsync d0/fe 0 2024-09-19T09:41:37.826 INFO:tasks.workunit.client.0.smithi042.stdout:4/271: chown d0/d1b/d1c/l42 1529 1 2024-09-19T09:41:37.828 INFO:tasks.workunit.client.0.smithi042.stdout:4/272: write d0/f4 [443425,100098] 0 2024-09-19T09:41:37.828 INFO:tasks.workunit.client.0.smithi042.stdout:8/256: dread d1/f35 [0,4194304] 0 2024-09-19T09:41:37.830 INFO:tasks.workunit.client.0.smithi042.stdout:4/273: mknod d0/d1b/d1c/d2e/d3f/c60 0 2024-09-19T09:41:37.830 INFO:tasks.workunit.client.0.smithi042.stdout:4/274: write d0/f4d [1031564,55809] 0 2024-09-19T09:41:37.830 INFO:tasks.workunit.client.0.smithi042.stdout:4/275: fdatasync d0/f14 0 2024-09-19T09:41:37.831 INFO:tasks.workunit.client.0.smithi042.stdout:4/276: truncate d0/d1b/d1c/d2e/d3b/f3c 480147 0 2024-09-19T09:41:37.831 INFO:tasks.workunit.client.0.smithi042.stdout:8/257: truncate d1/da/f12 3630915 0 2024-09-19T09:41:37.832 INFO:tasks.workunit.client.0.smithi042.stdout:4/277: mkdir d0/d1b/d1c/d61 0 2024-09-19T09:41:37.833 INFO:tasks.workunit.client.0.smithi042.stdout:5/241: dwrite d2/d4/d20/d31/f32 [0,4194304] 0 2024-09-19T09:41:37.834 INFO:tasks.workunit.client.0.smithi042.stdout:5/242: chown d2/f1e 703038596 1 2024-09-19T09:41:37.834 INFO:tasks.workunit.client.0.smithi042.stdout:4/278: mknod d0/d1b/d1c/d61/c62 0 2024-09-19T09:41:37.836 INFO:tasks.workunit.client.0.smithi042.stdout:7/286: dwrite d0/f6 [0,4194304] 0 2024-09-19T09:41:37.837 INFO:tasks.workunit.client.0.smithi042.stdout:7/287: fdatasync d0/f27 0 2024-09-19T09:41:37.837 INFO:tasks.workunit.client.0.smithi042.stdout:7/288: readlink d0/d40/l48 0 2024-09-19T09:41:37.837 INFO:tasks.workunit.client.0.smithi042.stdout:0/287: dwrite d2/fb [4194304,4194304] 0 2024-09-19T09:41:37.840 INFO:tasks.workunit.client.0.smithi042.stdout:4/279: rename d0/l12 to d0/d1b/d1c/d2e/d3f/d5a/l63 0 2024-09-19T09:41:37.840 INFO:tasks.workunit.client.0.smithi042.stdout:4/280: chown d0/d1b/d1c/d2e/f43 536153094 1 2024-09-19T09:41:37.842 INFO:tasks.workunit.client.0.smithi042.stdout:0/288: dread d2/d10/d1d/f25 [0,4194304] 0 2024-09-19T09:41:37.842 INFO:tasks.workunit.client.0.smithi042.stdout:4/281: read d0/d1b/d1c/d2e/d3b/f48 [236310,24781] 0 2024-09-19T09:41:37.842 INFO:tasks.workunit.client.0.smithi042.stdout:4/282: dread - d0/d1b/d1c/d2e/f50 zero size 2024-09-19T09:41:37.842 INFO:tasks.workunit.client.0.smithi042.stdout:4/283: stat d0/f19 0 2024-09-19T09:41:37.842 INFO:tasks.workunit.client.0.smithi042.stdout:4/284: dread - d0/d1b/d1c/d2e/d3f/f4e zero size 2024-09-19T09:41:37.842 INFO:tasks.workunit.client.0.smithi042.stdout:4/285: chown d0/c35 33528503 1 2024-09-19T09:41:37.843 INFO:tasks.workunit.client.0.smithi042.stdout:0/289: mkdir d2/d10/d12/d16/d57 0 2024-09-19T09:41:37.844 INFO:tasks.workunit.client.0.smithi042.stdout:8/258: write d1/f9 [2488380,31996] 0 2024-09-19T09:41:37.844 INFO:tasks.workunit.client.0.smithi042.stdout:0/290: symlink d2/d10/d12/d2e/l58 0 2024-09-19T09:41:37.847 INFO:tasks.workunit.client.0.smithi042.stdout:0/291: creat d2/d10/d1d/f59 x:0 0 0 2024-09-19T09:41:37.847 INFO:tasks.workunit.client.0.smithi042.stdout:6/270: sync 2024-09-19T09:41:37.847 INFO:tasks.workunit.client.0.smithi042.stdout:6/271: readlink d1/de/d12/l1b 0 2024-09-19T09:41:37.847 INFO:tasks.workunit.client.0.smithi042.stdout:0/292: mkdir d2/d10/d12/d19/d5a 0 2024-09-19T09:41:37.849 INFO:tasks.workunit.client.0.smithi042.stdout:6/272: rename d1/d20/d3c to d1/d20/d32/d46 0 2024-09-19T09:41:37.849 INFO:tasks.workunit.client.0.smithi042.stdout:6/273: write d1/de/d12/d1c/f37 [262953,74630] 0 2024-09-19T09:41:37.849 INFO:tasks.workunit.client.0.smithi042.stdout:6/274: dread - d1/de/d12/d1c/d3a/f42 zero size 2024-09-19T09:41:37.850 INFO:tasks.workunit.client.0.smithi042.stdout:0/293: unlink f1 0 2024-09-19T09:41:37.853 INFO:tasks.workunit.client.0.smithi042.stdout:6/275: creat d1/de/d12/d1c/d3a/f47 x:0 0 0 2024-09-19T09:41:37.854 INFO:tasks.workunit.client.0.smithi042.stdout:6/276: chown d1/de/f35 249 1 2024-09-19T09:41:37.854 INFO:tasks.workunit.client.0.smithi042.stdout:6/277: chown d1/d2e 11983338 1 2024-09-19T09:41:37.855 INFO:tasks.workunit.client.0.smithi042.stdout:6/278: mknod d1/de/d12/d1c/d3a/c48 0 2024-09-19T09:41:37.855 INFO:tasks.workunit.client.0.smithi042.stdout:6/279: readlink d1/d20/l3e 0 2024-09-19T09:41:37.855 INFO:tasks.workunit.client.0.smithi042.stdout:6/280: rmdir d1/de/d12/d1c 39 2024-09-19T09:41:37.857 INFO:tasks.workunit.client.0.smithi042.stdout:6/281: link d1/d20/f38 d1/d20/d32/d46/f49 0 2024-09-19T09:41:37.860 INFO:tasks.workunit.client.0.smithi042.stdout:8/259: dwrite d1/da/f2f [0,4194304] 0 2024-09-19T09:41:37.863 INFO:tasks.workunit.client.0.smithi042.stdout:8/260: creat d1/da/dd/f49 x:0 0 0 2024-09-19T09:41:37.863 INFO:tasks.workunit.client.0.smithi042.stdout:8/261: read d1/da/d14/f27 [7932,115594] 0 2024-09-19T09:41:37.863 INFO:tasks.workunit.client.0.smithi042.stdout:8/262: truncate d1/da/d14/f1a 1494615 0 2024-09-19T09:41:37.864 INFO:tasks.workunit.client.0.smithi042.stdout:8/263: creat d1/d2e/f4a x:0 0 0 2024-09-19T09:41:37.865 INFO:tasks.workunit.client.0.smithi042.stdout:8/264: readlink d1/da/d14/l1f 0 2024-09-19T09:41:37.870 INFO:tasks.workunit.client.0.smithi042.stdout:8/265: dread d1/f35 [0,4194304] 0 2024-09-19T09:41:37.870 INFO:tasks.workunit.client.0.smithi042.stdout:8/266: stat d1/da/d14/f27 0 2024-09-19T09:41:37.870 INFO:tasks.workunit.client.0.smithi042.stdout:8/267: dread - d1/da/dd/f49 zero size 2024-09-19T09:41:37.871 INFO:tasks.workunit.client.0.smithi042.stdout:0/294: dwrite d2/d10/f1b [0,4194304] 0 2024-09-19T09:41:37.876 INFO:tasks.workunit.client.0.smithi042.stdout:8/268: dread d1/da/d14/f17 [0,4194304] 0 2024-09-19T09:41:37.877 INFO:tasks.workunit.client.0.smithi042.stdout:8/269: fdatasync d1/da/d14/f1a 0 2024-09-19T09:41:37.877 INFO:tasks.workunit.client.0.smithi042.stdout:8/270: truncate d1/da/d14/f17 314147 0 2024-09-19T09:41:37.879 INFO:tasks.workunit.client.0.smithi042.stdout:8/271: rename d1/da/d14/l2a to d1/da/d32/d41/l4b 0 2024-09-19T09:41:37.879 INFO:tasks.workunit.client.0.smithi042.stdout:0/295: dread d2/d10/f1b [0,4194304] 0 2024-09-19T09:41:37.886 INFO:tasks.workunit.client.0.smithi042.stdout:8/272: dread d1/f26 [0,4194304] 0 2024-09-19T09:41:37.886 INFO:tasks.workunit.client.0.smithi042.stdout:8/273: truncate d1/da/dd/f16 895950 0 2024-09-19T09:41:37.887 INFO:tasks.workunit.client.0.smithi042.stdout:8/274: mknod d1/c4c 0 2024-09-19T09:41:37.896 INFO:tasks.workunit.client.0.smithi042.stdout:0/296: dwrite d2/f1c [4194304,4194304] 0 2024-09-19T09:41:37.896 INFO:tasks.workunit.client.0.smithi042.stdout:8/275: write d1/da/f2f [1914122,94291] 0 2024-09-19T09:41:37.916 INFO:tasks.workunit.client.0.smithi042.stdout:2/233: sync 2024-09-19T09:41:37.916 INFO:tasks.workunit.client.0.smithi042.stdout:2/234: truncate d7/dd/f40 840174 0 2024-09-19T09:41:37.916 INFO:tasks.workunit.client.0.smithi042.stdout:2/235: truncate d7/dd/d14/f1d 865764 0 2024-09-19T09:41:37.916 INFO:tasks.workunit.client.0.smithi042.stdout:2/236: read d7/dd/d22/d30/f34 [138819,7622] 0 2024-09-19T09:41:37.916 INFO:tasks.workunit.client.0.smithi042.stdout:2/237: chown d7/l26 4323089 1 2024-09-19T09:41:37.924 INFO:tasks.workunit.client.0.smithi042.stdout:8/276: dwrite d1/da/dd/f16 [0,4194304] 0 2024-09-19T09:41:37.931 INFO:tasks.workunit.client.0.smithi042.stdout:2/238: dwrite d7/dd/d14/f25 [4194304,4194304] 0 2024-09-19T09:41:37.932 INFO:tasks.workunit.client.0.smithi042.stdout:8/277: write d1/da/dd/f16 [2938766,88295] 0 2024-09-19T09:41:37.934 INFO:tasks.workunit.client.0.smithi042.stdout:8/278: dread d1/da/d14/f1a [0,4194304] 0 2024-09-19T09:41:37.935 INFO:tasks.workunit.client.0.smithi042.stdout:8/279: symlink d1/da/d32/d41/l4d 0 2024-09-19T09:41:37.936 INFO:tasks.workunit.client.0.smithi042.stdout:8/280: rename d1/f35 to d1/da/d32/d41/f4e 0 2024-09-19T09:41:37.941 INFO:tasks.workunit.client.0.smithi042.stdout:8/281: write d1/da/d32/d41/f4e [927322,16170] 0 2024-09-19T09:41:37.943 INFO:tasks.workunit.client.0.smithi042.stdout:8/282: rename d1/l47 to d1/da/d32/l4f 0 2024-09-19T09:41:37.943 INFO:tasks.workunit.client.0.smithi042.stdout:8/283: getdents d1/da/d32/d46 0 2024-09-19T09:41:37.943 INFO:tasks.workunit.client.0.smithi042.stdout:8/284: chown d1/da/d32/d41 13387 1 2024-09-19T09:41:37.943 INFO:tasks.workunit.client.0.smithi042.stdout:8/285: chown d1/da/dd/c2c 18 1 2024-09-19T09:41:37.944 INFO:tasks.workunit.client.0.smithi042.stdout:8/286: creat d1/da/d3f/f50 x:0 0 0 2024-09-19T09:41:37.945 INFO:tasks.workunit.client.0.smithi042.stdout:8/287: rename d1/da/d14/f27 to d1/d2e/f51 0 2024-09-19T09:41:37.946 INFO:tasks.workunit.client.0.smithi042.stdout:8/288: symlink d1/da/d14/l52 0 2024-09-19T09:41:37.946 INFO:tasks.workunit.client.0.smithi042.stdout:8/289: fdatasync d1/da/f33 0 2024-09-19T09:41:37.951 INFO:tasks.workunit.client.0.smithi042.stdout:2/239: dwrite d7/f1c [0,4194304] 0 2024-09-19T09:41:37.951 INFO:tasks.workunit.client.0.smithi042.stdout:2/240: getdents d7/dd/d14/d35/d4c 0 2024-09-19T09:41:37.951 INFO:tasks.workunit.client.0.smithi042.stdout:2/241: chown d7/dd/d14/f49 102 1 2024-09-19T09:41:37.952 INFO:tasks.workunit.client.0.smithi042.stdout:2/242: write d7/dd/d14/f25 [9009711,5866] 0 2024-09-19T09:41:37.952 INFO:tasks.workunit.client.0.smithi042.stdout:2/243: stat d7/dd/d14/d35/d4c 0 2024-09-19T09:41:37.953 INFO:tasks.workunit.client.0.smithi042.stdout:2/244: creat d7/dd/d22/d30/f4d x:0 0 0 2024-09-19T09:41:37.953 INFO:tasks.workunit.client.0.smithi042.stdout:2/245: read d7/dd/d22/d30/f34 [237309,6537] 0 2024-09-19T09:41:37.959 INFO:tasks.workunit.client.0.smithi042.stdout:2/246: dread d7/f9 [0,4194304] 0 2024-09-19T09:41:37.960 INFO:tasks.workunit.client.0.smithi042.stdout:2/247: write d7/dd/d14/f31 [1257232,11513] 0 2024-09-19T09:41:37.960 INFO:tasks.workunit.client.0.smithi042.stdout:2/248: truncate d7/dd/d22/d2a/f39 651269 0 2024-09-19T09:41:37.960 INFO:tasks.workunit.client.0.smithi042.stdout:2/249: readlink d7/l3d 0 2024-09-19T09:41:37.960 INFO:tasks.workunit.client.0.smithi042.stdout:8/290: dwrite d1/da/d14/f1a [0,4194304] 0 2024-09-19T09:41:37.960 INFO:tasks.workunit.client.0.smithi042.stdout:2/250: mkdir d7/dd/d14/d35/d4e 0 2024-09-19T09:41:37.962 INFO:tasks.workunit.client.0.smithi042.stdout:2/251: creat d7/dd/d14/d35/f4f x:0 0 0 2024-09-19T09:41:37.962 INFO:tasks.workunit.client.0.smithi042.stdout:8/291: mknod d1/d2e/c53 0 2024-09-19T09:41:37.962 INFO:tasks.workunit.client.0.smithi042.stdout:2/252: symlink d7/l50 0 2024-09-19T09:41:37.963 INFO:tasks.workunit.client.0.smithi042.stdout:2/253: read d7/dd/d22/d2a/f39 [21688,118955] 0 2024-09-19T09:41:37.963 INFO:tasks.workunit.client.0.smithi042.stdout:9/230: sync 2024-09-19T09:41:37.963 INFO:tasks.workunit.client.0.smithi042.stdout:9/231: fdatasync d8/d1d/f1f 0 2024-09-19T09:41:37.963 INFO:tasks.workunit.client.0.smithi042.stdout:9/232: chown d8/da/d19/l29 1514293043 1 2024-09-19T09:41:37.964 INFO:tasks.workunit.client.0.smithi042.stdout:2/254: mknod d7/dd/d14/d35/d45/c51 0 2024-09-19T09:41:37.964 INFO:tasks.workunit.client.0.smithi042.stdout:9/233: link d8/c16 d8/c45 0 2024-09-19T09:41:37.965 INFO:tasks.workunit.client.0.smithi042.stdout:9/234: mknod d8/da/c46 0 2024-09-19T09:41:37.965 INFO:tasks.workunit.client.0.smithi042.stdout:9/235: symlink d8/db/l47 0 2024-09-19T09:41:37.970 INFO:tasks.workunit.client.0.smithi042.stdout:2/255: write d7/dd/d14/f25 [7515891,75468] 0 2024-09-19T09:41:37.970 INFO:tasks.workunit.client.0.smithi042.stdout:2/256: fsync d7/dd/f47 0 2024-09-19T09:41:37.972 INFO:tasks.workunit.client.0.smithi042.stdout:2/257: creat d7/dd/d22/d43/f52 x:0 0 0 2024-09-19T09:41:37.974 INFO:tasks.workunit.client.0.smithi042.stdout:2/258: mknod d7/dd/d14/d35/d4e/c53 0 2024-09-19T09:41:37.974 INFO:tasks.workunit.client.0.smithi042.stdout:2/259: write d7/dd/d22/d30/f34 [1171927,23689] 0 2024-09-19T09:41:37.984 INFO:tasks.workunit.client.0.smithi042.stdout:8/292: dwrite d1/da/d14/f2b [0,4194304] 0 2024-09-19T09:41:37.985 INFO:tasks.workunit.client.0.smithi042.stdout:8/293: creat d1/da/d32/f54 x:0 0 0 2024-09-19T09:41:37.988 INFO:tasks.workunit.client.0.smithi042.stdout:2/260: dread d7/dd/d14/f25 [0,4194304] 0 2024-09-19T09:41:37.988 INFO:tasks.workunit.client.0.smithi042.stdout:2/261: write d7/dd/d22/f32 [4985828,53554] 0 2024-09-19T09:41:37.992 INFO:tasks.workunit.client.0.smithi042.stdout:8/294: dread d1/f9 [0,4194304] 0 2024-09-19T09:41:37.994 INFO:tasks.workunit.client.0.smithi042.stdout:8/295: mkdir d1/da/d32/d41/d55 0 2024-09-19T09:41:37.997 INFO:tasks.workunit.client.0.smithi042.stdout:8/296: symlink d1/da/d3f/l56 0 2024-09-19T09:41:38.001 INFO:tasks.workunit.client.0.smithi042.stdout:8/297: creat d1/da/d32/d41/f57 x:0 0 0 2024-09-19T09:41:38.001 INFO:tasks.workunit.client.0.smithi042.stdout:8/298: read - d1/da/d32/d3d/f44 zero size 2024-09-19T09:41:38.006 INFO:tasks.workunit.client.0.smithi042.stdout:2/262: dwrite d7/f10 [0,4194304] 0 2024-09-19T09:41:38.010 INFO:tasks.workunit.client.0.smithi042.stdout:2/263: rename d7/lc to d7/dd/d14/d35/d4e/l54 0 2024-09-19T09:41:38.010 INFO:tasks.workunit.client.0.smithi042.stdout:2/264: fsync d7/f4b 0 2024-09-19T09:41:38.012 INFO:tasks.workunit.client.0.smithi042.stdout:7/289: sync 2024-09-19T09:41:38.012 INFO:tasks.workunit.client.0.smithi042.stdout:3/300: sync 2024-09-19T09:41:38.012 INFO:tasks.workunit.client.0.smithi042.stdout:3/301: chown f0 1 1 2024-09-19T09:41:38.012 INFO:tasks.workunit.client.0.smithi042.stdout:5/243: sync 2024-09-19T09:41:38.012 INFO:tasks.workunit.client.0.smithi042.stdout:1/281: sync 2024-09-19T09:41:38.013 INFO:tasks.workunit.client.0.smithi042.stdout:7/290: symlink d0/d14/d44/d47/l5e 0 2024-09-19T09:41:38.015 INFO:tasks.workunit.client.0.smithi042.stdout:7/291: truncate d0/d14/f2a 4074666 0 2024-09-19T09:41:38.017 INFO:tasks.workunit.client.0.smithi042.stdout:2/265: dread d7/f9 [0,4194304] 0 2024-09-19T09:41:38.019 INFO:tasks.workunit.client.0.smithi042.stdout:1/282: dread f1 [0,4194304] 0 2024-09-19T09:41:38.020 INFO:tasks.workunit.client.0.smithi042.stdout:1/283: write d4/d15/d19/d45/f52 [413458,84657] 0 2024-09-19T09:41:38.021 INFO:tasks.workunit.client.0.smithi042.stdout:3/302: dread d4/d2a/f40 [0,4194304] 0 2024-09-19T09:41:38.021 INFO:tasks.workunit.client.0.smithi042.stdout:7/292: dread d0/d14/d3a/f3f [0,4194304] 0 2024-09-19T09:41:38.024 INFO:tasks.workunit.client.0.smithi042.stdout:8/299: dwrite d1/f9 [0,4194304] 0 2024-09-19T09:41:38.024 INFO:tasks.workunit.client.0.smithi042.stdout:8/300: write d1/d2e/f51 [4331401,125303] 0 2024-09-19T09:41:38.024 INFO:tasks.workunit.client.0.smithi042.stdout:3/303: dread d4/d8/d9/dc/d26/d35/f44 [0,4194304] 0 2024-09-19T09:41:38.026 INFO:tasks.workunit.client.0.smithi042.stdout:3/304: creat d4/d2a/f62 x:0 0 0 2024-09-19T09:41:38.026 INFO:tasks.workunit.client.0.smithi042.stdout:1/284: dread d4/d15/d19/fc [0,4194304] 0 2024-09-19T09:41:38.026 INFO:tasks.workunit.client.0.smithi042.stdout:1/285: write d4/d15/d2e/f37 [3735724,73962] 0 2024-09-19T09:41:38.027 INFO:tasks.workunit.client.0.smithi042.stdout:3/305: rename d4/d2a/f40 to d4/d8/d9/d1b/f63 0 2024-09-19T09:41:38.027 INFO:tasks.workunit.client.0.smithi042.stdout:3/306: stat f0 0 2024-09-19T09:41:38.028 INFO:tasks.workunit.client.0.smithi042.stdout:1/286: unlink d4/d29/l3a 0 2024-09-19T09:41:38.029 INFO:tasks.workunit.client.0.smithi042.stdout:3/307: mkdir d4/d8/d9/d1b/d64 0 2024-09-19T09:41:38.029 INFO:tasks.workunit.client.0.smithi042.stdout:1/287: symlink d4/d15/d19/d45/l5f 0 2024-09-19T09:41:38.030 INFO:tasks.workunit.client.0.smithi042.stdout:3/308: rmdir d4/d8/d9/d39 39 2024-09-19T09:41:38.031 INFO:tasks.workunit.client.0.smithi042.stdout:8/301: dread d1/da/f38 [0,4194304] 0 2024-09-19T09:41:38.031 INFO:tasks.workunit.client.0.smithi042.stdout:8/302: fdatasync d1/da/d14/f1a 0 2024-09-19T09:41:38.031 INFO:tasks.workunit.client.0.smithi042.stdout:2/266: write d7/f1c [4147687,11225] 0 2024-09-19T09:41:38.031 INFO:tasks.workunit.client.0.smithi042.stdout:2/267: stat d7/dd/d22/d43/f52 0 2024-09-19T09:41:38.031 INFO:tasks.workunit.client.0.smithi042.stdout:2/268: read d7/f1c [1022696,59890] 0 2024-09-19T09:41:38.031 INFO:tasks.workunit.client.0.smithi042.stdout:3/309: mkdir d4/d65 0 2024-09-19T09:41:38.031 INFO:tasks.workunit.client.0.smithi042.stdout:3/310: chown d4/d8/d9/c60 1083 1 2024-09-19T09:41:38.031 INFO:tasks.workunit.client.0.smithi042.stdout:3/311: truncate d4/d2a/f62 1047396 0 2024-09-19T09:41:38.032 INFO:tasks.workunit.client.0.smithi042.stdout:8/303: mkdir d1/da/d32/d3d/d58 0 2024-09-19T09:41:38.032 INFO:tasks.workunit.client.0.smithi042.stdout:8/304: write d1/da/d3f/f50 [451253,20554] 0 2024-09-19T09:41:38.032 INFO:tasks.workunit.client.0.smithi042.stdout:2/269: truncate f2 3542807 0 2024-09-19T09:41:38.032 INFO:tasks.workunit.client.0.smithi042.stdout:8/305: mkdir d1/da/d32/d3d/d59 0 2024-09-19T09:41:38.032 INFO:tasks.workunit.client.0.smithi042.stdout:8/306: truncate d1/da/d32/d41/f57 1005525 0 2024-09-19T09:41:38.033 INFO:tasks.workunit.client.0.smithi042.stdout:8/307: creat d1/da/f5a x:0 0 0 2024-09-19T09:41:38.038 INFO:tasks.workunit.client.0.smithi042.stdout:2/270: getdents d7 0 2024-09-19T09:41:38.040 INFO:tasks.workunit.client.0.smithi042.stdout:8/308: truncate d1/f9 5423485 0 2024-09-19T09:41:38.041 INFO:tasks.workunit.client.0.smithi042.stdout:2/271: mknod d7/dd/d22/d2a/c55 0 2024-09-19T09:41:38.041 INFO:tasks.workunit.client.0.smithi042.stdout:2/272: dread - d7/dd/d22/d43/f52 zero size 2024-09-19T09:41:38.041 INFO:tasks.workunit.client.0.smithi042.stdout:8/309: write d1/da/d32/d41/f57 [386072,51977] 0 2024-09-19T09:41:38.041 INFO:tasks.workunit.client.0.smithi042.stdout:8/310: readlink d1/da/d14/l19 0 2024-09-19T09:41:38.041 INFO:tasks.workunit.client.0.smithi042.stdout:8/311: truncate d1/da/d32/d41/f57 1114536 0 2024-09-19T09:41:38.041 INFO:tasks.workunit.client.0.smithi042.stdout:1/288: write d4/d29/f4a [1300826,100813] 0 2024-09-19T09:41:38.042 INFO:tasks.workunit.client.0.smithi042.stdout:8/312: link d1/da/dd/c2c d1/da/dd/c5b 0 2024-09-19T09:41:38.042 INFO:tasks.workunit.client.0.smithi042.stdout:8/313: fsync d1/da/dd/f49 0 2024-09-19T09:41:38.042 INFO:tasks.workunit.client.0.smithi042.stdout:2/273: creat d7/dd/d14/f56 x:0 0 0 2024-09-19T09:41:38.053 INFO:tasks.workunit.client.0.smithi042.stdout:1/289: dread d4/d12/f2d [0,4194304] 0 2024-09-19T09:41:38.054 INFO:tasks.workunit.client.0.smithi042.stdout:1/290: chown d4/d15/d19/fe 5 1 2024-09-19T09:41:38.055 INFO:tasks.workunit.client.0.smithi042.stdout:1/291: link d4/d15/d19/c2f d4/d15/d19/d45/c60 0 2024-09-19T09:41:38.056 INFO:tasks.workunit.client.0.smithi042.stdout:1/292: dread - d4/f22 zero size 2024-09-19T09:41:38.056 INFO:tasks.workunit.client.0.smithi042.stdout:1/293: dread - d4/d1e/d25/d35/d3c/f59 zero size 2024-09-19T09:41:38.056 INFO:tasks.workunit.client.0.smithi042.stdout:1/294: truncate d4/d1e/d25/d35/f5a 643813 0 2024-09-19T09:41:38.058 INFO:tasks.workunit.client.0.smithi042.stdout:7/293: dwrite d0/d14/d3a/f3e [0,4194304] 0 2024-09-19T09:41:38.059 INFO:tasks.workunit.client.0.smithi042.stdout:5/244: dwrite d2/d4/d20/d11/f23 [0,4194304] 0 2024-09-19T09:41:38.059 INFO:tasks.workunit.client.0.smithi042.stdout:5/245: readlink d2/d4/d20/d11/l14 0 2024-09-19T09:41:38.059 INFO:tasks.workunit.client.0.smithi042.stdout:3/312: dwrite d4/d2a/f4e [0,4194304] 0 2024-09-19T09:41:38.071 INFO:tasks.workunit.client.0.smithi042.stdout:2/274: dwrite d7/dd/d14/f56 [0,4194304] 0 2024-09-19T09:41:38.072 INFO:tasks.workunit.client.0.smithi042.stdout:5/246: dread d2/d4/d20/d11/f36 [0,4194304] 0 2024-09-19T09:41:38.072 INFO:tasks.workunit.client.0.smithi042.stdout:2/275: mknod d7/dd/d14/d35/d4c/c57 0 2024-09-19T09:41:38.075 INFO:tasks.workunit.client.0.smithi042.stdout:6/282: sync 2024-09-19T09:41:38.075 INFO:tasks.workunit.client.0.smithi042.stdout:4/286: sync 2024-09-19T09:41:38.075 INFO:tasks.workunit.client.0.smithi042.stdout:9/236: sync 2024-09-19T09:41:38.075 INFO:tasks.workunit.client.0.smithi042.stdout:0/297: sync 2024-09-19T09:41:38.076 INFO:tasks.workunit.client.0.smithi042.stdout:4/287: getdents d0/d28 0 2024-09-19T09:41:38.077 INFO:tasks.workunit.client.0.smithi042.stdout:4/288: getdents d0/d1b/d1c 0 2024-09-19T09:41:38.079 INFO:tasks.workunit.client.0.smithi042.stdout:4/289: mkdir d0/d1b/d1c/d2e/d64 0 2024-09-19T09:41:38.080 INFO:tasks.workunit.client.0.smithi042.stdout:4/290: mknod d0/d28/d36/c65 0 2024-09-19T09:41:38.081 INFO:tasks.workunit.client.0.smithi042.stdout:4/291: rmdir d0/d1b 39 2024-09-19T09:41:38.082 INFO:tasks.workunit.client.0.smithi042.stdout:4/292: dread - d0/d1b/d1c/d2e/d3f/f4e zero size 2024-09-19T09:41:38.082 INFO:tasks.workunit.client.0.smithi042.stdout:4/293: chown d0/d1b/d1c/d2e/d3f/c4b 3086 1 2024-09-19T09:41:38.082 INFO:tasks.workunit.client.0.smithi042.stdout:7/294: dwrite d0/f17 [0,4194304] 0 2024-09-19T09:41:38.082 INFO:tasks.workunit.client.0.smithi042.stdout:7/295: truncate d0/f1a 2010615 0 2024-09-19T09:41:38.082 INFO:tasks.workunit.client.0.smithi042.stdout:7/296: dread - d0/d14/d44/f54 zero size 2024-09-19T09:41:38.083 INFO:tasks.workunit.client.0.smithi042.stdout:4/294: creat d0/d28/d36/f66 x:0 0 0 2024-09-19T09:41:38.084 INFO:tasks.workunit.client.0.smithi042.stdout:3/313: dwrite d4/f52 [0,4194304] 0 2024-09-19T09:41:38.085 INFO:tasks.workunit.client.0.smithi042.stdout:7/297: getdents d0 0 2024-09-19T09:41:38.085 INFO:tasks.workunit.client.0.smithi042.stdout:1/295: dwrite d4/d15/d2e/f37 [0,4194304] 0 2024-09-19T09:41:38.087 INFO:tasks.workunit.client.0.smithi042.stdout:3/314: dread d4/d8/d4c/f5f [0,4194304] 0 2024-09-19T09:41:38.089 INFO:tasks.workunit.client.0.smithi042.stdout:4/295: mkdir d0/d67 0 2024-09-19T09:41:38.089 INFO:tasks.workunit.client.0.smithi042.stdout:3/315: rmdir d4/d8/d9/d39/d4b 39 2024-09-19T09:41:38.089 INFO:tasks.workunit.client.0.smithi042.stdout:4/296: stat d0/d1b/f41 0 2024-09-19T09:41:38.089 INFO:tasks.workunit.client.0.smithi042.stdout:3/316: chown d4/d8/d9/d1b/l5b 3762 1 2024-09-19T09:41:38.089 INFO:tasks.workunit.client.0.smithi042.stdout:3/317: chown d4/d8/d9/c5e 24399121 1 2024-09-19T09:41:38.090 INFO:tasks.workunit.client.0.smithi042.stdout:4/297: mknod d0/d1b/d1c/d2e/d64/c68 0 2024-09-19T09:41:38.092 INFO:tasks.workunit.client.0.smithi042.stdout:7/298: dread d0/fb [0,4194304] 0 2024-09-19T09:41:38.092 INFO:tasks.workunit.client.0.smithi042.stdout:7/299: chown d0/c10 12970565 1 2024-09-19T09:41:38.093 INFO:tasks.workunit.client.0.smithi042.stdout:4/298: dread d0/fb [0,4194304] 0 2024-09-19T09:41:38.093 INFO:tasks.workunit.client.0.smithi042.stdout:7/300: creat d0/d3d/d55/f5f x:0 0 0 2024-09-19T09:41:38.095 INFO:tasks.workunit.client.0.smithi042.stdout:4/299: mkdir d0/d1b/d69 0 2024-09-19T09:41:38.096 INFO:tasks.workunit.client.0.smithi042.stdout:7/301: mknod d0/d56/c60 0 2024-09-19T09:41:38.096 INFO:tasks.workunit.client.0.smithi042.stdout:3/318: truncate d4/f52 1269300 0 2024-09-19T09:41:38.098 INFO:tasks.workunit.client.0.smithi042.stdout:4/300: truncate d0/f5 256043 0 2024-09-19T09:41:38.098 INFO:tasks.workunit.client.0.smithi042.stdout:4/301: getdents d0/d1b/d69 0 2024-09-19T09:41:38.100 INFO:tasks.workunit.client.0.smithi042.stdout:7/302: dread d0/f38 [0,4194304] 0 2024-09-19T09:41:38.101 INFO:tasks.workunit.client.0.smithi042.stdout:7/303: chown d0/d3d/d55/l57 0 1 2024-09-19T09:41:38.101 INFO:tasks.workunit.client.0.smithi042.stdout:7/304: truncate d0/d3d/f4b 2260809 0 2024-09-19T09:41:38.101 INFO:tasks.workunit.client.0.smithi042.stdout:4/302: mkdir d0/d1b/d1c/d6a 0 2024-09-19T09:41:38.103 INFO:tasks.workunit.client.0.smithi042.stdout:0/298: dwrite d2/d10/d1d/f2b [0,4194304] 0 2024-09-19T09:41:38.110 INFO:tasks.workunit.client.0.smithi042.stdout:4/303: dread d0/f5 [0,4194304] 0 2024-09-19T09:41:38.110 INFO:tasks.workunit.client.0.smithi042.stdout:4/304: readlink d0/d1b/d1c/l5e 0 2024-09-19T09:41:38.116 INFO:tasks.workunit.client.0.smithi042.stdout:0/299: write d2/d10/d12/f31 [584957,93865] 0 2024-09-19T09:41:38.118 INFO:tasks.workunit.client.0.smithi042.stdout:0/300: mkdir d2/d10/d12/d24/d5b 0 2024-09-19T09:41:38.118 INFO:tasks.workunit.client.0.smithi042.stdout:0/301: stat d2/d10/d1d/f59 0 2024-09-19T09:41:38.118 INFO:tasks.workunit.client.0.smithi042.stdout:0/302: fsync d2/d10/d12/d16/d18/f47 0 2024-09-19T09:41:38.121 INFO:tasks.workunit.client.0.smithi042.stdout:6/283: dwrite d1/d2e/f30 [0,4194304] 0 2024-09-19T09:41:38.122 INFO:tasks.workunit.client.0.smithi042.stdout:6/284: dread d1/de/d12/f19 [0,4194304] 0 2024-09-19T09:41:38.122 INFO:tasks.workunit.client.0.smithi042.stdout:6/285: readlink d1/de/d12/l1b 0 2024-09-19T09:41:38.125 INFO:tasks.workunit.client.0.smithi042.stdout:9/237: dwrite d8/d1d/d28/f2d [4194304,4194304] 0 2024-09-19T09:41:38.127 INFO:tasks.workunit.client.0.smithi042.stdout:9/238: getdents d8/da 0 2024-09-19T09:41:38.130 INFO:tasks.workunit.client.0.smithi042.stdout:9/239: link f1 d8/d32/f48 0 2024-09-19T09:41:38.130 INFO:tasks.workunit.client.0.smithi042.stdout:9/240: write d8/f2c [3330952,102401] 0 2024-09-19T09:41:38.130 INFO:tasks.workunit.client.0.smithi042.stdout:9/241: write d8/da/d19/f1b [4948649,66915] 0 2024-09-19T09:41:38.131 INFO:tasks.workunit.client.0.smithi042.stdout:9/242: stat d8/c45 0 2024-09-19T09:41:38.132 INFO:tasks.workunit.client.0.smithi042.stdout:9/243: mkdir d8/d1d/d49 0 2024-09-19T09:41:38.136 INFO:tasks.workunit.client.0.smithi042.stdout:6/286: write d1/f18 [3500078,24400] 0 2024-09-19T09:41:38.136 INFO:tasks.workunit.client.0.smithi042.stdout:5/247: dwrite d2/db/d3c/f3f [0,4194304] 0 2024-09-19T09:41:38.137 INFO:tasks.workunit.client.0.smithi042.stdout:3/319: dwrite d4/d8/d9/dc/d26/f32 [0,4194304] 0 2024-09-19T09:41:38.137 INFO:tasks.workunit.client.0.smithi042.stdout:3/320: readlink d4/d8/d9/d12/l42 0 2024-09-19T09:41:38.138 INFO:tasks.workunit.client.0.smithi042.stdout:7/305: dwrite d0/f6 [4194304,4194304] 0 2024-09-19T09:41:38.138 INFO:tasks.workunit.client.0.smithi042.stdout:7/306: chown d0/d14/d3a 0 1 2024-09-19T09:41:38.138 INFO:tasks.workunit.client.0.smithi042.stdout:1/296: dwrite d4/d1e/d25/f46 [0,4194304] 0 2024-09-19T09:41:38.138 INFO:tasks.workunit.client.0.smithi042.stdout:6/287: mkdir d1/d20/d45/d4a 0 2024-09-19T09:41:38.138 INFO:tasks.workunit.client.0.smithi042.stdout:6/288: write d1/f6 [5129710,120242] 0 2024-09-19T09:41:38.140 INFO:tasks.workunit.client.0.smithi042.stdout:5/248: getdents d2/db/d3c 0 2024-09-19T09:41:38.141 INFO:tasks.workunit.client.0.smithi042.stdout:0/303: dwrite d2/d10/d12/d16/d51/f56 [0,4194304] 0 2024-09-19T09:41:38.143 INFO:tasks.workunit.client.0.smithi042.stdout:4/305: dwrite d0/d1b/d1c/d2e/d3f/d5a/f5b [0,4194304] 0 2024-09-19T09:41:38.143 INFO:tasks.workunit.client.0.smithi042.stdout:4/306: getdents d0/d1b/d56 0 2024-09-19T09:41:38.143 INFO:tasks.workunit.client.0.smithi042.stdout:4/307: chown d0/d1b/d1c/d2e/d3b 10314276 1 2024-09-19T09:41:38.143 INFO:tasks.workunit.client.0.smithi042.stdout:4/308: chown d0/d1b/d1c/d2e/d3b/f47 442 1 2024-09-19T09:41:38.144 INFO:tasks.workunit.client.0.smithi042.stdout:1/297: mkdir d4/d15/d61 0 2024-09-19T09:41:38.144 INFO:tasks.workunit.client.0.smithi042.stdout:1/298: write d4/d29/f4a [4461134,20301] 0 2024-09-19T09:41:38.144 INFO:tasks.workunit.client.0.smithi042.stdout:1/299: fdatasync d4/d1e/d25/f33 0 2024-09-19T09:41:38.146 INFO:tasks.workunit.client.0.smithi042.stdout:6/289: mknod d1/d20/d32/c4b 0 2024-09-19T09:41:38.149 INFO:tasks.workunit.client.0.smithi042.stdout:7/307: write d0/f5 [8359728,27225] 0 2024-09-19T09:41:38.149 INFO:tasks.workunit.client.0.smithi042.stdout:6/290: fdatasync d1/f6 0 2024-09-19T09:41:38.151 INFO:tasks.workunit.client.0.smithi042.stdout:5/249: creat d2/d4/d2e/f4e x:0 0 0 2024-09-19T09:41:38.151 INFO:tasks.workunit.client.0.smithi042.stdout:5/250: chown d2/d4/d20/f38 77201350 1 2024-09-19T09:41:38.151 INFO:tasks.workunit.client.0.smithi042.stdout:9/244: dwrite d8/f1a [0,4194304] 0 2024-09-19T09:41:38.151 INFO:tasks.workunit.client.0.smithi042.stdout:9/245: write d8/da/d19/d1c/d21/f44 [899052,33585] 0 2024-09-19T09:41:38.152 INFO:tasks.workunit.client.0.smithi042.stdout:9/246: fsync d8/da/f10 0 2024-09-19T09:41:38.152 INFO:tasks.workunit.client.0.smithi042.stdout:9/247: chown d8/da 2061580500 1 2024-09-19T09:41:38.154 INFO:tasks.workunit.client.0.smithi042.stdout:0/304: symlink d2/d10/d12/d19/l5c 0 2024-09-19T09:41:38.158 INFO:tasks.workunit.client.0.smithi042.stdout:9/248: write d8/f15 [2109412,98520] 0 2024-09-19T09:41:38.159 INFO:tasks.workunit.client.0.smithi042.stdout:4/309: mkdir d0/d1b/d1c/d2e/d3f/d6b 0 2024-09-19T09:41:38.159 INFO:tasks.workunit.client.0.smithi042.stdout:4/310: dread - d0/d1b/f2b zero size 2024-09-19T09:41:38.161 INFO:tasks.workunit.client.0.smithi042.stdout:1/300: getdents d4/d1d/d20 0 2024-09-19T09:41:38.161 INFO:tasks.workunit.client.0.smithi042.stdout:1/301: chown d4/d15/d19/l3f 685 1 2024-09-19T09:41:38.163 INFO:tasks.workunit.client.0.smithi042.stdout:6/291: creat d1/de/d12/d22/f4c x:0 0 0 2024-09-19T09:41:38.163 INFO:tasks.workunit.client.0.smithi042.stdout:6/292: write d1/de/d12/d1c/d3a/f42 [963011,116382] 0 2024-09-19T09:41:38.163 INFO:tasks.workunit.client.0.smithi042.stdout:6/293: write d1/f24 [4755596,75627] 0 2024-09-19T09:41:38.164 INFO:tasks.workunit.client.0.smithi042.stdout:5/251: unlink d2/d25/c27 0 2024-09-19T09:41:38.168 INFO:tasks.workunit.client.0.smithi042.stdout:9/249: mkdir d8/da/d19/d1c/d4a 0 2024-09-19T09:41:38.169 INFO:tasks.workunit.client.0.smithi042.stdout:1/302: rmdir d4/d15/d44 39 2024-09-19T09:41:38.171 INFO:tasks.workunit.client.0.smithi042.stdout:6/294: creat d1/de/d12/d1c/d3a/f4d x:0 0 0 2024-09-19T09:41:38.173 INFO:tasks.workunit.client.0.smithi042.stdout:5/252: symlink d2/d25/d37/l4f 0 2024-09-19T09:41:38.173 INFO:tasks.workunit.client.0.smithi042.stdout:9/250: creat d8/d1d/f4b x:0 0 0 2024-09-19T09:41:38.175 INFO:tasks.workunit.client.0.smithi042.stdout:1/303: rename d4/d1e/l36 to d4/d29/d3e/l62 0 2024-09-19T09:41:38.175 INFO:tasks.workunit.client.0.smithi042.stdout:8/314: sync 2024-09-19T09:41:38.176 INFO:tasks.workunit.client.0.smithi042.stdout:6/295: mknod d1/d20/d32/d46/c4e 0 2024-09-19T09:41:38.177 INFO:tasks.workunit.client.0.smithi042.stdout:5/253: creat d2/d25/d37/f50 x:0 0 0 2024-09-19T09:41:38.177 INFO:tasks.workunit.client.0.smithi042.stdout:5/254: dread - d2/d25/d37/f50 zero size 2024-09-19T09:41:38.178 INFO:tasks.workunit.client.0.smithi042.stdout:9/251: rename d8/db/l47 to d8/db/d31/l4c 0 2024-09-19T09:41:38.178 INFO:tasks.workunit.client.0.smithi042.stdout:4/311: dwrite d0/d1b/d1c/f25 [0,4194304] 0 2024-09-19T09:41:38.178 INFO:tasks.workunit.client.0.smithi042.stdout:4/312: stat d0/d1b/f2b 0 2024-09-19T09:41:38.179 INFO:tasks.workunit.client.0.smithi042.stdout:1/304: mknod d4/d15/d44/c63 0 2024-09-19T09:41:38.179 INFO:tasks.workunit.client.0.smithi042.stdout:1/305: dread - d4/d1d/f2b zero size 2024-09-19T09:41:38.179 INFO:tasks.workunit.client.0.smithi042.stdout:8/315: creat d1/da/dd/f5c x:0 0 0 2024-09-19T09:41:38.181 INFO:tasks.workunit.client.0.smithi042.stdout:6/296: mkdir d1/de/d12/d1c/d4f 0 2024-09-19T09:41:38.182 INFO:tasks.workunit.client.0.smithi042.stdout:5/255: mknod d2/d4/d20/c51 0 2024-09-19T09:41:38.184 INFO:tasks.workunit.client.0.smithi042.stdout:4/313: truncate d0/d1b/d1c/d2e/d3b/f48 516836 0 2024-09-19T09:41:38.185 INFO:tasks.workunit.client.0.smithi042.stdout:4/314: truncate d0/f5 932482 0 2024-09-19T09:41:38.187 INFO:tasks.workunit.client.0.smithi042.stdout:8/316: unlink d1/da/dd/c2c 0 2024-09-19T09:41:38.187 INFO:tasks.workunit.client.0.smithi042.stdout:8/317: fsync d1/da/f5a 0 2024-09-19T09:41:38.189 INFO:tasks.workunit.client.0.smithi042.stdout:8/318: creat d1/da/d32/d3d/d58/f5d x:0 0 0 2024-09-19T09:41:38.191 INFO:tasks.workunit.client.0.smithi042.stdout:4/315: rename d0/d1b/d1c/d2e/f43 to d0/f6c 0 2024-09-19T09:41:38.191 INFO:tasks.workunit.client.0.smithi042.stdout:2/276: sync 2024-09-19T09:41:38.191 INFO:tasks.workunit.client.0.smithi042.stdout:2/277: read - d7/dd/d22/f4a zero size 2024-09-19T09:41:38.191 INFO:tasks.workunit.client.0.smithi042.stdout:2/278: chown d7/dd/d22/d2a/l42 125847413 1 2024-09-19T09:41:38.192 INFO:tasks.workunit.client.0.smithi042.stdout:8/319: write d1/da/f13 [506114,17971] 0 2024-09-19T09:41:38.193 INFO:tasks.workunit.client.0.smithi042.stdout:2/279: rename d7/dd/d22/d2a/l42 to d7/l58 0 2024-09-19T09:41:38.193 INFO:tasks.workunit.client.0.smithi042.stdout:4/316: creat d0/d67/f6d x:0 0 0 2024-09-19T09:41:38.193 INFO:tasks.workunit.client.0.smithi042.stdout:4/317: fdatasync d0/d1b/d1c/d2e/f50 0 2024-09-19T09:41:38.193 INFO:tasks.workunit.client.0.smithi042.stdout:4/318: write d0/d1b/d1c/f1f [1256300,52995] 0 2024-09-19T09:41:38.194 INFO:tasks.workunit.client.0.smithi042.stdout:8/320: dread d1/da/f33 [0,4194304] 0 2024-09-19T09:41:38.194 INFO:tasks.workunit.client.0.smithi042.stdout:8/321: dread - d1/d2e/f4a zero size 2024-09-19T09:41:38.194 INFO:tasks.workunit.client.0.smithi042.stdout:8/322: dread - d1/da/f5a zero size 2024-09-19T09:41:38.194 INFO:tasks.workunit.client.0.smithi042.stdout:5/256: dread d2/d4/d20/d11/f1f [0,4194304] 0 2024-09-19T09:41:38.194 INFO:tasks.workunit.client.0.smithi042.stdout:1/306: dread d4/d15/d19/fe [0,4194304] 0 2024-09-19T09:41:38.195 INFO:tasks.workunit.client.0.smithi042.stdout:2/280: dread d7/dd/f12 [0,4194304] 0 2024-09-19T09:41:38.196 INFO:tasks.workunit.client.0.smithi042.stdout:1/307: mknod d4/d1d/d20/c64 0 2024-09-19T09:41:38.197 INFO:tasks.workunit.client.0.smithi042.stdout:2/281: rename d7/f1a to d7/dd/f59 0 2024-09-19T09:41:38.198 INFO:tasks.workunit.client.0.smithi042.stdout:1/308: symlink d4/l65 0 2024-09-19T09:41:38.199 INFO:tasks.workunit.client.0.smithi042.stdout:2/282: rmdir d7/dd/d22/d43 39 2024-09-19T09:41:38.199 INFO:tasks.workunit.client.0.smithi042.stdout:6/297: dwrite d1/de/d12/d22/f25 [0,4194304] 0 2024-09-19T09:41:38.201 INFO:tasks.workunit.client.0.smithi042.stdout:4/319: write d0/f15 [1272468,115804] 0 2024-09-19T09:41:38.201 INFO:tasks.workunit.client.0.smithi042.stdout:4/320: write d0/d1b/f2b [391983,119502] 0 2024-09-19T09:41:38.201 INFO:tasks.workunit.client.0.smithi042.stdout:2/283: link d7/f1c d7/dd/d48/f5a 0 2024-09-19T09:41:38.201 INFO:tasks.workunit.client.0.smithi042.stdout:2/284: truncate d7/dd/d22/d30/f4d 67195 0 2024-09-19T09:41:38.201 INFO:tasks.workunit.client.0.smithi042.stdout:2/285: stat d7/dd/c13 0 2024-09-19T09:41:38.202 INFO:tasks.workunit.client.0.smithi042.stdout:2/286: mknod d7/dd/d48/c5b 0 2024-09-19T09:41:38.202 INFO:tasks.workunit.client.0.smithi042.stdout:2/287: write d7/dd/d22/f4a [1041980,106615] 0 2024-09-19T09:41:38.203 INFO:tasks.workunit.client.0.smithi042.stdout:9/252: dwrite d8/d1d/f3f [0,4194304] 0 2024-09-19T09:41:38.203 INFO:tasks.workunit.client.0.smithi042.stdout:6/298: creat d1/de/d12/d22/d34/d3f/f50 x:0 0 0 2024-09-19T09:41:38.203 INFO:tasks.workunit.client.0.smithi042.stdout:2/288: link d7/dd/f15 d7/dd/d1f/d3f/f5c 0 2024-09-19T09:41:38.203 INFO:tasks.workunit.client.0.smithi042.stdout:2/289: fdatasync d7/dd/f59 0 2024-09-19T09:41:38.204 INFO:tasks.workunit.client.0.smithi042.stdout:8/323: dread d1/da/f2f [0,4194304] 0 2024-09-19T09:41:38.204 INFO:tasks.workunit.client.0.smithi042.stdout:2/290: mknod d7/dd/c5d 0 2024-09-19T09:41:38.208 INFO:tasks.workunit.client.0.smithi042.stdout:4/321: dread d0/d1b/d1c/d2e/d3b/f47 [0,4194304] 0 2024-09-19T09:41:38.211 INFO:tasks.workunit.client.0.smithi042.stdout:6/299: write d1/de/d12/d22/d34/f3d [709455,102419] 0 2024-09-19T09:41:38.211 INFO:tasks.workunit.client.0.smithi042.stdout:6/300: readlink d1/l2f 0 2024-09-19T09:41:38.213 INFO:tasks.workunit.client.0.smithi042.stdout:9/253: unlink d8/c16 0 2024-09-19T09:41:38.214 INFO:tasks.workunit.client.0.smithi042.stdout:4/322: mkdir d0/d1b/d1c/d2e/d3f/d6e 0 2024-09-19T09:41:38.215 INFO:tasks.workunit.client.0.smithi042.stdout:4/323: write d0/d1b/d1c/f51 [414458,24217] 0 2024-09-19T09:41:38.215 INFO:tasks.workunit.client.0.smithi042.stdout:4/324: chown d0/d1b/d1c/f2c 68635550 1 2024-09-19T09:41:38.216 INFO:tasks.workunit.client.0.smithi042.stdout:6/301: truncate d1/d20/f27 2181583 0 2024-09-19T09:41:38.217 INFO:tasks.workunit.client.0.smithi042.stdout:9/254: mknod d8/da/d19/d1c/c4d 0 2024-09-19T09:41:38.219 INFO:tasks.workunit.client.0.smithi042.stdout:4/325: creat d0/d1b/f6f x:0 0 0 2024-09-19T09:41:38.219 INFO:tasks.workunit.client.0.smithi042.stdout:6/302: symlink d1/l51 0 2024-09-19T09:41:38.220 INFO:tasks.workunit.client.0.smithi042.stdout:4/326: write d0/f4d [664208,49118] 0 2024-09-19T09:41:38.221 INFO:tasks.workunit.client.0.smithi042.stdout:6/303: creat d1/f52 x:0 0 0 2024-09-19T09:41:38.223 INFO:tasks.workunit.client.0.smithi042.stdout:6/304: symlink d1/d20/d32/d46/l53 0 2024-09-19T09:41:38.225 INFO:tasks.workunit.client.0.smithi042.stdout:9/255: write d8/da/d19/f1b [515121,104586] 0 2024-09-19T09:41:38.226 INFO:tasks.workunit.client.0.smithi042.stdout:2/291: rename d7/dd/d22/d2a to d7/dd/d14/d35/d45/d5e 0 2024-09-19T09:41:38.226 INFO:tasks.workunit.client.0.smithi042.stdout:2/292: chown d7 0 1 2024-09-19T09:41:38.226 INFO:tasks.workunit.client.0.smithi042.stdout:2/293: fsync d7/dd/d22/f3c 0 2024-09-19T09:41:38.226 INFO:tasks.workunit.client.0.smithi042.stdout:2/294: chown d7/dd/d14/d35 16191 1 2024-09-19T09:41:38.226 INFO:tasks.workunit.client.0.smithi042.stdout:2/295: truncate d7/dd/d22/d30/f4d 825717 0 2024-09-19T09:41:38.226 INFO:tasks.workunit.client.0.smithi042.stdout:2/296: read - d7/f4b zero size 2024-09-19T09:41:38.226 INFO:tasks.workunit.client.0.smithi042.stdout:8/324: dwrite d1/da/f33 [0,4194304] 0 2024-09-19T09:41:38.226 INFO:tasks.workunit.client.0.smithi042.stdout:8/325: stat d1/da/d32/d3d/d58/f5d 0 2024-09-19T09:41:38.227 INFO:tasks.workunit.client.0.smithi042.stdout:5/257: dwrite d2/d25/d4d/f47 [0,4194304] 0 2024-09-19T09:41:38.227 INFO:tasks.workunit.client.0.smithi042.stdout:5/258: chown d2/d25 0 1 2024-09-19T09:41:38.227 INFO:tasks.workunit.client.0.smithi042.stdout:5/259: chown d2/d4/d20/d31 532390978 1 2024-09-19T09:41:38.227 INFO:tasks.workunit.client.0.smithi042.stdout:1/309: dwrite d4/d29/d3e/f3b [0,4194304] 0 2024-09-19T09:41:38.228 INFO:tasks.workunit.client.0.smithi042.stdout:1/310: write d4/f10 [6573645,78027] 0 2024-09-19T09:41:38.228 INFO:tasks.workunit.client.0.smithi042.stdout:2/297: mknod d7/c5f 0 2024-09-19T09:41:38.228 INFO:tasks.workunit.client.0.smithi042.stdout:9/256: rmdir d8/d1d/d49 0 2024-09-19T09:41:38.229 INFO:tasks.workunit.client.0.smithi042.stdout:2/298: unlink d7/dd/d22/f3c 0 2024-09-19T09:41:38.231 INFO:tasks.workunit.client.0.smithi042.stdout:4/327: rename d0/d1b/d1c/d2e/d64 to d0/d28/d70 0 2024-09-19T09:41:38.232 INFO:tasks.workunit.client.0.smithi042.stdout:2/299: creat d7/dd/d22/d30/f60 x:0 0 0 2024-09-19T09:41:38.232 INFO:tasks.workunit.client.0.smithi042.stdout:2/300: read d7/dd/f16 [1147276,87464] 0 2024-09-19T09:41:38.234 INFO:tasks.workunit.client.0.smithi042.stdout:8/326: creat d1/da/d3f/f5e x:0 0 0 2024-09-19T09:41:38.239 INFO:tasks.workunit.client.0.smithi042.stdout:5/260: mknod d2/db/d42/c52 0 2024-09-19T09:41:38.243 INFO:tasks.workunit.client.0.smithi042.stdout:1/311: mknod d4/d15/d2e/c66 0 2024-09-19T09:41:38.243 INFO:tasks.workunit.client.0.smithi042.stdout:1/312: chown d4/d15/d19/d42/c50 14 1 2024-09-19T09:41:38.243 INFO:tasks.workunit.client.0.smithi042.stdout:1/313: chown d4/d1e/f1f 905792055 1 2024-09-19T09:41:38.244 INFO:tasks.workunit.client.0.smithi042.stdout:9/257: link d8/d32/l41 d8/db/d31/d39/l4e 0 2024-09-19T09:41:38.246 INFO:tasks.workunit.client.0.smithi042.stdout:8/327: creat d1/da/f5f x:0 0 0 2024-09-19T09:41:38.247 INFO:tasks.workunit.client.0.smithi042.stdout:1/314: mknod d4/d15/d44/c67 0 2024-09-19T09:41:38.247 INFO:tasks.workunit.client.0.smithi042.stdout:1/315: fsync d4/d15/d19/f16 0 2024-09-19T09:41:38.249 INFO:tasks.workunit.client.0.smithi042.stdout:9/258: creat d8/d1d/d28/f4f x:0 0 0 2024-09-19T09:41:38.250 INFO:tasks.workunit.client.0.smithi042.stdout:6/305: dwrite d1/de/d12/d22/f4c [0,4194304] 0 2024-09-19T09:41:38.250 INFO:tasks.workunit.client.0.smithi042.stdout:6/306: chown d1/d20/c29 85528656 1 2024-09-19T09:41:38.250 INFO:tasks.workunit.client.0.smithi042.stdout:6/307: chown d1/de/c41 26611 1 2024-09-19T09:41:38.250 INFO:tasks.workunit.client.0.smithi042.stdout:6/308: chown d1/fc 11710 1 2024-09-19T09:41:38.250 INFO:tasks.workunit.client.0.smithi042.stdout:6/309: chown d1/d20/d32/d46/l53 1 1 2024-09-19T09:41:38.250 INFO:tasks.workunit.client.0.smithi042.stdout:6/310: fdatasync d1/de/f2d 0 2024-09-19T09:41:38.250 INFO:tasks.workunit.client.0.smithi042.stdout:6/311: chown d1/l14 371541623 1 2024-09-19T09:41:38.251 INFO:tasks.workunit.client.0.smithi042.stdout:8/328: creat d1/d2e/f60 x:0 0 0 2024-09-19T09:41:38.253 INFO:tasks.workunit.client.0.smithi042.stdout:1/316: symlink d4/d1d/l68 0 2024-09-19T09:41:38.256 INFO:tasks.workunit.client.0.smithi042.stdout:4/328: dwrite d0/d1b/d1c/f25 [4194304,4194304] 0 2024-09-19T09:41:38.256 INFO:tasks.workunit.client.0.smithi042.stdout:2/301: dwrite d7/dd/f47 [0,4194304] 0 2024-09-19T09:41:38.256 INFO:tasks.workunit.client.0.smithi042.stdout:2/302: stat d7/dd/d22/d30 0 2024-09-19T09:41:38.258 INFO:tasks.workunit.client.0.smithi042.stdout:2/303: truncate d7/dd/d14/f1d 633908 0 2024-09-19T09:41:38.259 INFO:tasks.workunit.client.0.smithi042.stdout:2/304: mkdir d7/dd/d14/d35/d4c/d61 0 2024-09-19T09:41:38.261 INFO:tasks.workunit.client.0.smithi042.stdout:1/317: mkdir d4/d15/d2e/d69 0 2024-09-19T09:41:38.261 INFO:tasks.workunit.client.0.smithi042.stdout:1/318: dread - d4/d1e/d25/d35/d3c/f59 zero size 2024-09-19T09:41:38.262 INFO:tasks.workunit.client.0.smithi042.stdout:4/329: dread d0/f4 [0,4194304] 0 2024-09-19T09:41:38.263 INFO:tasks.workunit.client.0.smithi042.stdout:6/312: truncate d1/de/d12/d1c/d3a/f42 925763 0 2024-09-19T09:41:38.263 INFO:tasks.workunit.client.0.smithi042.stdout:6/313: chown d1/de/d12/d1c/d3a/c48 112 1 2024-09-19T09:41:38.265 INFO:tasks.workunit.client.0.smithi042.stdout:2/305: dread d7/dd/d48/f5a [0,4194304] 0 2024-09-19T09:41:38.266 INFO:tasks.workunit.client.0.smithi042.stdout:2/306: dread d7/dd/f59 [0,4194304] 0 2024-09-19T09:41:38.267 INFO:tasks.workunit.client.0.smithi042.stdout:8/329: symlink d1/da/d14/l61 0 2024-09-19T09:41:38.271 INFO:tasks.workunit.client.0.smithi042.stdout:1/319: symlink d4/l6a 0 2024-09-19T09:41:38.273 INFO:tasks.workunit.client.0.smithi042.stdout:6/314: mkdir d1/de/d54 0 2024-09-19T09:41:38.273 INFO:tasks.workunit.client.0.smithi042.stdout:6/315: write d1/de/d12/d1c/d3a/f47 [952189,15249] 0 2024-09-19T09:41:38.274 INFO:tasks.workunit.client.0.smithi042.stdout:8/330: write d1/da/dd/f5c [169888,91692] 0 2024-09-19T09:41:38.274 INFO:tasks.workunit.client.0.smithi042.stdout:8/331: read - d1/da/d3f/f5e zero size 2024-09-19T09:41:38.275 INFO:tasks.workunit.client.0.smithi042.stdout:4/330: rename d0/d67/f6d to d0/f71 0 2024-09-19T09:41:38.275 INFO:tasks.workunit.client.0.smithi042.stdout:4/331: chown d0/d1b/d1c/d2e/d3b 84 1 2024-09-19T09:41:38.275 INFO:tasks.workunit.client.0.smithi042.stdout:4/332: chown d0/l8 997 1 2024-09-19T09:41:38.275 INFO:tasks.workunit.client.0.smithi042.stdout:4/333: write d0/d1b/f26 [392547,129490] 0 2024-09-19T09:41:38.276 INFO:tasks.workunit.client.0.smithi042.stdout:4/334: readlink d0/d1b/d1c/d2e/d3f/d5a/l63 0 2024-09-19T09:41:38.276 INFO:tasks.workunit.client.0.smithi042.stdout:4/335: write d0/d28/d36/f66 [352007,123441] 0 2024-09-19T09:41:38.276 INFO:tasks.workunit.client.0.smithi042.stdout:4/336: readlink d0/d1b/d1c/d2e/l31 0 2024-09-19T09:41:38.276 INFO:tasks.workunit.client.0.smithi042.stdout:6/316: rename d1/de/d12/d22/f4c to d1/d20/d45/d4a/f55 0 2024-09-19T09:41:38.276 INFO:tasks.workunit.client.0.smithi042.stdout:6/317: chown d1/de/d12/d22/d34/d3f/f50 1373213 1 2024-09-19T09:41:38.276 INFO:tasks.workunit.client.0.smithi042.stdout:6/318: chown d1/de/d12 185 1 2024-09-19T09:41:38.278 INFO:tasks.workunit.client.0.smithi042.stdout:6/319: creat d1/d20/f56 x:0 0 0 2024-09-19T09:41:38.279 INFO:tasks.workunit.client.0.smithi042.stdout:1/320: dread d4/d15/f21 [0,4194304] 0 2024-09-19T09:41:38.279 INFO:tasks.workunit.client.0.smithi042.stdout:6/320: creat d1/d2e/f57 x:0 0 0 2024-09-19T09:41:38.279 INFO:tasks.workunit.client.0.smithi042.stdout:6/321: chown d1/fc 115643336 1 2024-09-19T09:41:38.281 INFO:tasks.workunit.client.0.smithi042.stdout:7/308: sync 2024-09-19T09:41:38.281 INFO:tasks.workunit.client.0.smithi042.stdout:3/321: sync 2024-09-19T09:41:38.281 INFO:tasks.workunit.client.0.smithi042.stdout:7/309: dread - d0/d3d/f5a zero size 2024-09-19T09:41:38.282 INFO:tasks.workunit.client.0.smithi042.stdout:3/322: symlink d4/d8/d9/d1b/d4f/l66 0 2024-09-19T09:41:38.283 INFO:tasks.workunit.client.0.smithi042.stdout:7/310: creat d0/d3d/f61 x:0 0 0 2024-09-19T09:41:38.285 INFO:tasks.workunit.client.0.smithi042.stdout:3/323: rmdir d4/d8/d9/d1b/d64 0 2024-09-19T09:41:38.287 INFO:tasks.workunit.client.0.smithi042.stdout:7/311: rename d0/f25 to d0/d56/f62 0 2024-09-19T09:41:38.289 INFO:tasks.workunit.client.0.smithi042.stdout:3/324: creat d4/d8/d9/f67 x:0 0 0 2024-09-19T09:41:38.289 INFO:tasks.workunit.client.0.smithi042.stdout:7/312: rmdir d0/d56 39 2024-09-19T09:41:38.290 INFO:tasks.workunit.client.0.smithi042.stdout:0/305: sync 2024-09-19T09:41:38.290 INFO:tasks.workunit.client.0.smithi042.stdout:7/313: creat d0/d56/d5c/f63 x:0 0 0 2024-09-19T09:41:38.291 INFO:tasks.workunit.client.0.smithi042.stdout:7/314: rmdir d0/d14/d3c 39 2024-09-19T09:41:38.291 INFO:tasks.workunit.client.0.smithi042.stdout:7/315: chown d0 0 1 2024-09-19T09:41:38.292 INFO:tasks.workunit.client.0.smithi042.stdout:7/316: symlink d0/d14/l64 0 2024-09-19T09:41:38.298 INFO:tasks.workunit.client.0.smithi042.stdout:8/332: dwrite d1/da/f2f [0,4194304] 0 2024-09-19T09:41:38.298 INFO:tasks.workunit.client.0.smithi042.stdout:8/333: fsync d1/f9 0 2024-09-19T09:41:38.300 INFO:tasks.workunit.client.0.smithi042.stdout:8/334: link d1/da/d3f/l56 d1/l62 0 2024-09-19T09:41:38.301 INFO:tasks.workunit.client.0.smithi042.stdout:8/335: creat d1/da/f63 x:0 0 0 2024-09-19T09:41:38.304 INFO:tasks.workunit.client.0.smithi042.stdout:8/336: truncate d1/da/d32/d41/f4e 4068985 0 2024-09-19T09:41:38.308 INFO:tasks.workunit.client.0.smithi042.stdout:1/321: dwrite d4/d15/d19/f16 [0,4194304] 0 2024-09-19T09:41:38.308 INFO:tasks.workunit.client.0.smithi042.stdout:1/322: truncate d4/d1e/d25/d35/d3c/f59 65743 0 2024-09-19T09:41:38.309 INFO:tasks.workunit.client.0.smithi042.stdout:8/337: getdents d1/da 0 2024-09-19T09:41:38.309 INFO:tasks.workunit.client.0.smithi042.stdout:8/338: stat d1/da/d14 0 2024-09-19T09:41:38.310 INFO:tasks.workunit.client.0.smithi042.stdout:1/323: symlink d4/d15/d44/l6b 0 2024-09-19T09:41:38.310 INFO:tasks.workunit.client.0.smithi042.stdout:1/324: chown d4/d15/l53 464400 1 2024-09-19T09:41:38.312 INFO:tasks.workunit.client.0.smithi042.stdout:8/339: link d1/d2e/f51 d1/da/d32/f64 0 2024-09-19T09:41:38.312 INFO:tasks.workunit.client.0.smithi042.stdout:1/325: symlink d4/d12/l6c 0 2024-09-19T09:41:38.316 INFO:tasks.workunit.client.0.smithi042.stdout:3/325: dwrite d4/d8/f1c [0,4194304] 0 2024-09-19T09:41:38.317 INFO:tasks.workunit.client.0.smithi042.stdout:1/326: dread d4/d12/f2d [0,4194304] 0 2024-09-19T09:41:38.317 INFO:tasks.workunit.client.0.smithi042.stdout:1/327: read d4/d15/d19/f9 [143791,32210] 0 2024-09-19T09:41:38.317 INFO:tasks.workunit.client.0.smithi042.stdout:1/328: read - d4/d4e/f57 zero size 2024-09-19T09:41:38.318 INFO:tasks.workunit.client.0.smithi042.stdout:1/329: mknod d4/d1d/d20/c6d 0 2024-09-19T09:41:38.318 INFO:tasks.workunit.client.0.smithi042.stdout:1/330: readlink d4/d4e/l5e 0 2024-09-19T09:41:38.319 INFO:tasks.workunit.client.0.smithi042.stdout:1/331: mknod d4/d15/d44/c6e 0 2024-09-19T09:41:38.320 INFO:tasks.workunit.client.0.smithi042.stdout:3/326: dread d4/d8/d9/dc/d26/f47 [0,4194304] 0 2024-09-19T09:41:38.321 INFO:tasks.workunit.client.0.smithi042.stdout:3/327: readlink d4/d8/d9/d1b/d4f/l66 0 2024-09-19T09:41:38.329 INFO:tasks.workunit.client.0.smithi042.stdout:3/328: dread d4/d8/d9/d1b/f63 [0,4194304] 0 2024-09-19T09:41:38.329 INFO:tasks.workunit.client.0.smithi042.stdout:4/337: dwrite d0/f4d [0,4194304] 0 2024-09-19T09:41:38.331 INFO:tasks.workunit.client.0.smithi042.stdout:3/329: getdents d4/d8/d4c 0 2024-09-19T09:41:38.332 INFO:tasks.workunit.client.0.smithi042.stdout:6/322: dread d1/de/d12/d22/f25 [0,4194304] 0 2024-09-19T09:41:38.333 INFO:tasks.workunit.client.0.smithi042.stdout:4/338: rename d0/l27 to d0/d1b/d1c/d2e/d44/l72 0 2024-09-19T09:41:38.333 INFO:tasks.workunit.client.0.smithi042.stdout:4/339: write d0/d1b/d1c/f51 [529517,97703] 0 2024-09-19T09:41:38.334 INFO:tasks.workunit.client.0.smithi042.stdout:3/330: creat d4/d8/d9/d39/d4b/f68 x:0 0 0 2024-09-19T09:41:38.335 INFO:tasks.workunit.client.0.smithi042.stdout:6/323: link d1/de/d12/d22/f25 d1/d20/d32/f58 0 2024-09-19T09:41:38.335 INFO:tasks.workunit.client.0.smithi042.stdout:6/324: chown d1/d20/d32/l33 22596 1 2024-09-19T09:41:38.337 INFO:tasks.workunit.client.0.smithi042.stdout:6/325: mknod d1/de/c59 0 2024-09-19T09:41:38.337 INFO:tasks.workunit.client.0.smithi042.stdout:6/326: dread - d1/d20/f56 zero size 2024-09-19T09:41:38.341 INFO:tasks.workunit.client.0.smithi042.stdout:6/327: dread d1/de/d12/d22/f25 [0,4194304] 0 2024-09-19T09:41:38.341 INFO:tasks.workunit.client.0.smithi042.stdout:6/328: write d1/de/d12/f19 [996160,111459] 0 2024-09-19T09:41:38.351 INFO:tasks.workunit.client.0.smithi042.stdout:8/340: dwrite d1/da/d14/f1a [0,4194304] 0 2024-09-19T09:41:38.352 INFO:tasks.workunit.client.0.smithi042.stdout:6/329: write d1/d20/f38 [96206,36604] 0 2024-09-19T09:41:38.352 INFO:tasks.workunit.client.0.smithi042.stdout:8/341: read d1/da/dd/f5c [96141,53147] 0 2024-09-19T09:41:38.353 INFO:tasks.workunit.client.0.smithi042.stdout:0/306: dwrite d2/fb [4194304,4194304] 0 2024-09-19T09:41:38.354 INFO:tasks.workunit.client.0.smithi042.stdout:6/330: creat d1/d20/d32/f5a x:0 0 0 2024-09-19T09:41:38.356 INFO:tasks.workunit.client.0.smithi042.stdout:3/331: write d4/d8/d9/f56 [3791416,72805] 0 2024-09-19T09:41:38.358 INFO:tasks.workunit.client.0.smithi042.stdout:3/332: symlink d4/d8/d9/d1b/d4f/l69 0 2024-09-19T09:41:38.358 INFO:tasks.workunit.client.0.smithi042.stdout:4/340: dwrite d0/d1b/d1c/d2e/d44/f46 [0,4194304] 0 2024-09-19T09:41:38.359 INFO:tasks.workunit.client.0.smithi042.stdout:3/333: mknod d4/c6a 0 2024-09-19T09:41:38.361 INFO:tasks.workunit.client.0.smithi042.stdout:1/332: dwrite d4/d15/d19/f9 [0,4194304] 0 2024-09-19T09:41:38.367 INFO:tasks.workunit.client.0.smithi042.stdout:8/342: read d1/da/f2f [1823152,112998] 0 2024-09-19T09:41:38.367 INFO:tasks.workunit.client.0.smithi042.stdout:8/343: truncate d1/f26 5045773 0 2024-09-19T09:41:38.367 INFO:tasks.workunit.client.0.smithi042.stdout:8/344: truncate d1/da/d32/d3d/d58/f5d 327735 0 2024-09-19T09:41:38.367 INFO:tasks.workunit.client.0.smithi042.stdout:8/345: write d1/da/d3f/f5e [101176,128055] 0 2024-09-19T09:41:38.367 INFO:tasks.workunit.client.0.smithi042.stdout:4/341: write d0/d1b/d1c/f4f [257720,46149] 0 2024-09-19T09:41:38.369 INFO:tasks.workunit.client.0.smithi042.stdout:4/342: link d0/d1b/d1c/d2e/d3f/c4b d0/d1b/d69/c73 0 2024-09-19T09:41:38.370 INFO:tasks.workunit.client.0.smithi042.stdout:4/343: symlink d0/d1b/d1c/d2e/d3f/d6e/l74 0 2024-09-19T09:41:38.376 INFO:tasks.workunit.client.0.smithi042.stdout:4/344: fdatasync d0/fe 0 2024-09-19T09:41:38.376 INFO:tasks.workunit.client.0.smithi042.stdout:3/334: write d4/d8/f19 [4445484,94870] 0 2024-09-19T09:41:38.377 INFO:tasks.workunit.client.0.smithi042.stdout:3/335: dread d4/d8/d9/dc/f45 [0,4194304] 0 2024-09-19T09:41:38.380 INFO:tasks.workunit.client.0.smithi042.stdout:4/345: creat d0/d1b/d1c/d2e/d3f/d5a/f75 x:0 0 0 2024-09-19T09:41:38.384 INFO:tasks.workunit.client.0.smithi042.stdout:3/336: mkdir d4/d8/d4c/d6b 0 2024-09-19T09:41:38.384 INFO:tasks.workunit.client.0.smithi042.stdout:3/337: fsync d4/d2a/f62 0 2024-09-19T09:41:38.387 INFO:tasks.workunit.client.0.smithi042.stdout:0/307: dwrite f0 [0,4194304] 0 2024-09-19T09:41:38.392 INFO:tasks.workunit.client.0.smithi042.stdout:6/331: dwrite d1/f6 [4194304,4194304] 0 2024-09-19T09:41:38.392 INFO:tasks.workunit.client.0.smithi042.stdout:6/332: fsync d1/d2e/f3b 0 2024-09-19T09:41:38.392 INFO:tasks.workunit.client.0.smithi042.stdout:6/333: chown d1/de/d12 591854 1 2024-09-19T09:41:38.393 INFO:tasks.workunit.client.0.smithi042.stdout:6/334: getdents d1/de/d12/d22/d34/d3f 0 2024-09-19T09:41:38.403 INFO:tasks.workunit.client.0.smithi042.stdout:8/346: dwrite d1/da/d32/d3d/d58/f5d [0,4194304] 0 2024-09-19T09:41:38.403 INFO:tasks.workunit.client.0.smithi042.stdout:1/333: dwrite d4/d1e/d25/d35/d3c/f43 [0,4194304] 0 2024-09-19T09:41:38.404 INFO:tasks.workunit.client.0.smithi042.stdout:4/346: dwrite d0/d1b/d1c/d2e/d3b/f47 [0,4194304] 0 2024-09-19T09:41:38.407 INFO:tasks.workunit.client.0.smithi042.stdout:1/334: symlink d4/d15/d19/d42/d5b/l6f 0 2024-09-19T09:41:38.408 INFO:tasks.workunit.client.0.smithi042.stdout:1/335: stat d4/d1e/d25/f28 0 2024-09-19T09:41:38.409 INFO:tasks.workunit.client.0.smithi042.stdout:4/347: creat d0/d1b/d1c/d2e/f76 x:0 0 0 2024-09-19T09:41:38.411 INFO:tasks.workunit.client.0.smithi042.stdout:1/336: link d4/d1e/d25/l2a d4/d15/d19/d42/l70 0 2024-09-19T09:41:38.412 INFO:tasks.workunit.client.0.smithi042.stdout:1/337: chown f1 31 1 2024-09-19T09:41:38.412 INFO:tasks.workunit.client.0.smithi042.stdout:1/338: fdatasync d4/d15/d19/f1a 0 2024-09-19T09:41:38.412 INFO:tasks.workunit.client.0.smithi042.stdout:1/339: write d4/d1d/f2b [576341,31388] 0 2024-09-19T09:41:38.412 INFO:tasks.workunit.client.0.smithi042.stdout:5/261: sync 2024-09-19T09:41:38.414 INFO:tasks.workunit.client.0.smithi042.stdout:1/340: creat d4/d15/d44/f71 x:0 0 0 2024-09-19T09:41:38.415 INFO:tasks.workunit.client.0.smithi042.stdout:1/341: creat d4/d1e/d25/d35/f72 x:0 0 0 2024-09-19T09:41:38.416 INFO:tasks.workunit.client.0.smithi042.stdout:1/342: creat d4/d15/d19/d42/f73 x:0 0 0 2024-09-19T09:41:38.416 INFO:tasks.workunit.client.0.smithi042.stdout:1/343: fdatasync d4/d1e/d25/d35/d3c/f43 0 2024-09-19T09:41:38.417 INFO:tasks.workunit.client.0.smithi042.stdout:1/344: mknod d4/d1d/c74 0 2024-09-19T09:41:38.426 INFO:tasks.workunit.client.0.smithi042.stdout:5/262: dread d2/d4/fa [0,4194304] 0 2024-09-19T09:41:38.430 INFO:tasks.workunit.client.0.smithi042.stdout:3/338: dwrite d4/d2a/f4e [0,4194304] 0 2024-09-19T09:41:38.430 INFO:tasks.workunit.client.0.smithi042.stdout:3/339: chown d4/d8/d9/dc/d26/f32 13988 1 2024-09-19T09:41:38.430 INFO:tasks.workunit.client.0.smithi042.stdout:5/263: rename d2/d4/d20/d11/f36 to d2/db/d3c/f53 0 2024-09-19T09:41:38.430 INFO:tasks.workunit.client.0.smithi042.stdout:0/308: dwrite d2/d10/d12/f40 [4194304,4194304] 0 2024-09-19T09:41:38.430 INFO:tasks.workunit.client.0.smithi042.stdout:6/335: dwrite d1/de/d12/d22/d34/f3d [0,4194304] 0 2024-09-19T09:41:38.430 INFO:tasks.workunit.client.0.smithi042.stdout:6/336: read d1/f18 [3943636,19817] 0 2024-09-19T09:41:38.430 INFO:tasks.workunit.client.0.smithi042.stdout:6/337: chown d1/de/d12/d22/c44 8 1 2024-09-19T09:41:38.431 INFO:tasks.workunit.client.0.smithi042.stdout:3/340: unlink d4/d2a/f62 0 2024-09-19T09:41:38.432 INFO:tasks.workunit.client.0.smithi042.stdout:0/309: rename d2/d10/d12/d19/l28 to d2/d10/d12/d16/d18/d52/l5d 0 2024-09-19T09:41:38.434 INFO:tasks.workunit.client.0.smithi042.stdout:3/341: truncate d4/d8/d9/dc/f45 425639 0 2024-09-19T09:41:38.434 INFO:tasks.workunit.client.0.smithi042.stdout:3/342: readlink d4/d8/d9/l1d 0 2024-09-19T09:41:38.435 INFO:tasks.workunit.client.0.smithi042.stdout:6/338: rename d1/de/cf to d1/de/d12/d1c/c5b 0 2024-09-19T09:41:38.435 INFO:tasks.workunit.client.0.smithi042.stdout:6/339: read - d1/d20/f56 zero size 2024-09-19T09:41:38.435 INFO:tasks.workunit.client.0.smithi042.stdout:0/310: creat d2/d10/d12/d16/f5e x:0 0 0 2024-09-19T09:41:38.435 INFO:tasks.workunit.client.0.smithi042.stdout:0/311: fsync d2/fd 0 2024-09-19T09:41:38.437 INFO:tasks.workunit.client.0.smithi042.stdout:6/340: creat d1/de/d12/d22/d34/d3f/f5c x:0 0 0 2024-09-19T09:41:38.437 INFO:tasks.workunit.client.0.smithi042.stdout:1/345: dwrite f1 [4194304,4194304] 0 2024-09-19T09:41:38.437 INFO:tasks.workunit.client.0.smithi042.stdout:1/346: readlink d4/d1e/d25/l2a 0 2024-09-19T09:41:38.439 INFO:tasks.workunit.client.0.smithi042.stdout:6/341: dread d1/de/d12/d1c/d3a/f42 [0,4194304] 0 2024-09-19T09:41:38.439 INFO:tasks.workunit.client.0.smithi042.stdout:6/342: write d1/de/f2d [11162,42371] 0 2024-09-19T09:41:38.439 INFO:tasks.workunit.client.0.smithi042.stdout:0/312: symlink d2/d10/d12/l5f 0 2024-09-19T09:41:38.442 INFO:tasks.workunit.client.0.smithi042.stdout:0/313: rename d2/c3e to d2/d10/d12/d2e/d32/c60 0 2024-09-19T09:41:38.443 INFO:tasks.workunit.client.0.smithi042.stdout:6/343: dread d1/de/d12/d22/f25 [0,4194304] 0 2024-09-19T09:41:38.444 INFO:tasks.workunit.client.0.smithi042.stdout:1/347: write d4/d15/d2e/f37 [3674356,4031] 0 2024-09-19T09:41:38.446 INFO:tasks.workunit.client.0.smithi042.stdout:6/344: truncate d1/d20/d32/d46/f49 1874703 0 2024-09-19T09:41:38.446 INFO:tasks.workunit.client.0.smithi042.stdout:6/345: fdatasync d1/d20/d32/f58 0 2024-09-19T09:41:38.446 INFO:tasks.workunit.client.0.smithi042.stdout:6/346: write d1/de/d12/d1c/f37 [977672,38319] 0 2024-09-19T09:41:38.447 INFO:tasks.workunit.client.0.smithi042.stdout:6/347: rmdir d1 39 2024-09-19T09:41:38.448 INFO:tasks.workunit.client.0.smithi042.stdout:6/348: mkdir d1/de/d5d 0 2024-09-19T09:41:38.449 INFO:tasks.workunit.client.0.smithi042.stdout:6/349: creat d1/f5e x:0 0 0 2024-09-19T09:41:38.451 INFO:tasks.workunit.client.0.smithi042.stdout:6/350: mkdir d1/de/d12/d1c/d5f 0 2024-09-19T09:41:38.453 INFO:tasks.workunit.client.0.smithi042.stdout:1/348: dread d4/d1e/d25/f46 [0,4194304] 0 2024-09-19T09:41:38.453 INFO:tasks.workunit.client.0.smithi042.stdout:1/349: truncate d4/d1e/d25/d35/d3c/f59 287772 0 2024-09-19T09:41:38.461 INFO:tasks.workunit.client.0.smithi042.stdout:3/343: dwrite f0 [0,4194304] 0 2024-09-19T09:41:38.461 INFO:tasks.workunit.client.0.smithi042.stdout:3/344: chown d4/d8/d4c/f5f 452912 1 2024-09-19T09:41:38.463 INFO:tasks.workunit.client.0.smithi042.stdout:6/351: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:38.463 INFO:tasks.workunit.client.0.smithi042.stdout:6/352: write d1/d20/d32/f58 [4275438,87080] 0 2024-09-19T09:41:38.471 INFO:tasks.workunit.client.0.smithi042.stdout:3/345: dread d4/d8/f36 [0,4194304] 0 2024-09-19T09:41:38.472 INFO:tasks.workunit.client.0.smithi042.stdout:3/346: creat d4/d8/d9/d12/f6c x:0 0 0 2024-09-19T09:41:38.474 INFO:tasks.workunit.client.0.smithi042.stdout:0/314: dwrite d2/d10/f1b [0,4194304] 0 2024-09-19T09:41:38.475 INFO:tasks.workunit.client.0.smithi042.stdout:0/315: readlink d2/d10/d1e/l33 0 2024-09-19T09:41:38.475 INFO:tasks.workunit.client.0.smithi042.stdout:0/316: truncate d2/d10/d12/d2e/f4c 944723 0 2024-09-19T09:41:38.475 INFO:tasks.workunit.client.0.smithi042.stdout:1/350: dwrite d4/f13 [0,4194304] 0 2024-09-19T09:41:38.476 INFO:tasks.workunit.client.0.smithi042.stdout:0/317: symlink d2/d10/d12/d24/l61 0 2024-09-19T09:41:38.478 INFO:tasks.workunit.client.0.smithi042.stdout:0/318: mknod d2/d10/d12/d16/d18/d52/c62 0 2024-09-19T09:41:38.479 INFO:tasks.workunit.client.0.smithi042.stdout:0/319: mknod d2/d10/d12/d16/d18/d52/c63 0 2024-09-19T09:41:38.479 INFO:tasks.workunit.client.0.smithi042.stdout:3/347: dread d4/d8/d4c/f5f [0,4194304] 0 2024-09-19T09:41:38.480 INFO:tasks.workunit.client.0.smithi042.stdout:0/320: stat d2/fd 0 2024-09-19T09:41:38.480 INFO:tasks.workunit.client.0.smithi042.stdout:0/321: dread - d2/d10/d1d/f59 zero size 2024-09-19T09:41:38.480 INFO:tasks.workunit.client.0.smithi042.stdout:2/307: sync 2024-09-19T09:41:38.480 INFO:tasks.workunit.client.0.smithi042.stdout:9/259: sync 2024-09-19T09:41:38.480 INFO:tasks.workunit.client.0.smithi042.stdout:7/317: sync 2024-09-19T09:41:38.481 INFO:tasks.workunit.client.0.smithi042.stdout:9/260: chown f1 1816 1 2024-09-19T09:41:38.481 INFO:tasks.workunit.client.0.smithi042.stdout:2/308: creat d7/f62 x:0 0 0 2024-09-19T09:41:38.481 INFO:tasks.workunit.client.0.smithi042.stdout:9/261: getdents d8/d1d 0 2024-09-19T09:41:38.483 INFO:tasks.workunit.client.0.smithi042.stdout:9/262: creat d8/da/f50 x:0 0 0 2024-09-19T09:41:38.485 INFO:tasks.workunit.client.0.smithi042.stdout:9/263: getdents d8/db 0 2024-09-19T09:41:38.485 INFO:tasks.workunit.client.0.smithi042.stdout:3/348: read d4/d8/f36 [3079652,37844] 0 2024-09-19T09:41:38.486 INFO:tasks.workunit.client.0.smithi042.stdout:9/264: mkdir d8/da/d51 0 2024-09-19T09:41:38.486 INFO:tasks.workunit.client.0.smithi042.stdout:3/349: mkdir d4/d8/d9/dc/d26/d6d 0 2024-09-19T09:41:38.487 INFO:tasks.workunit.client.0.smithi042.stdout:3/350: stat d4/d8/d9/d12/c31 0 2024-09-19T09:41:38.488 INFO:tasks.workunit.client.0.smithi042.stdout:3/351: creat d4/d8/d9/dc/f6e x:0 0 0 2024-09-19T09:41:38.489 INFO:tasks.workunit.client.0.smithi042.stdout:3/352: mknod d4/d8/d9/d1b/c6f 0 2024-09-19T09:41:38.490 INFO:tasks.workunit.client.0.smithi042.stdout:3/353: creat d4/d8/d9/d1b/d4f/f70 x:0 0 0 2024-09-19T09:41:38.492 INFO:tasks.workunit.client.0.smithi042.stdout:3/354: unlink d4/d8/d9/d1b/d4f/l69 0 2024-09-19T09:41:38.492 INFO:tasks.workunit.client.0.smithi042.stdout:0/322: write d2/d10/f1b [3795708,30440] 0 2024-09-19T09:41:38.493 INFO:tasks.workunit.client.0.smithi042.stdout:3/355: creat d4/d8/d4c/f71 x:0 0 0 2024-09-19T09:41:38.493 INFO:tasks.workunit.client.0.smithi042.stdout:3/356: fsync d4/d8/d9/dc/d26/d35/f51 0 2024-09-19T09:41:38.494 INFO:tasks.workunit.client.0.smithi042.stdout:0/323: unlink d2/fd 0 2024-09-19T09:41:38.494 INFO:tasks.workunit.client.0.smithi042.stdout:0/324: write d2/d10/f1b [975028,39180] 0 2024-09-19T09:41:38.494 INFO:tasks.workunit.client.0.smithi042.stdout:7/318: write d0/d56/f62 [3247060,105198] 0 2024-09-19T09:41:38.495 INFO:tasks.workunit.client.0.smithi042.stdout:3/357: creat d4/d8/f72 x:0 0 0 2024-09-19T09:41:38.496 INFO:tasks.workunit.client.0.smithi042.stdout:7/319: creat d0/d40/f65 x:0 0 0 2024-09-19T09:41:38.496 INFO:tasks.workunit.client.0.smithi042.stdout:3/358: creat d4/f73 x:0 0 0 2024-09-19T09:41:38.497 INFO:tasks.workunit.client.0.smithi042.stdout:7/320: creat d0/d56/f66 x:0 0 0 2024-09-19T09:41:38.499 INFO:tasks.workunit.client.0.smithi042.stdout:0/325: fdatasync d2/d10/d1d/f25 0 2024-09-19T09:41:38.499 INFO:tasks.workunit.client.0.smithi042.stdout:3/359: rename d4/d8/d9/dc/f45 to d4/f74 0 2024-09-19T09:41:38.500 INFO:tasks.workunit.client.0.smithi042.stdout:1/351: dwrite d4/d15/d44/f71 [0,4194304] 0 2024-09-19T09:41:38.500 INFO:tasks.workunit.client.0.smithi042.stdout:1/352: chown d4/d1e/d25/d35/d3c 891 1 2024-09-19T09:41:38.501 INFO:tasks.workunit.client.0.smithi042.stdout:0/326: mkdir d2/d10/d12/d2e/d32/d64 0 2024-09-19T09:41:38.502 INFO:tasks.workunit.client.0.smithi042.stdout:1/353: creat d4/d1e/d25/d35/f75 x:0 0 0 2024-09-19T09:41:38.502 INFO:tasks.workunit.client.0.smithi042.stdout:0/327: symlink d2/d10/d12/d2e/d32/d64/l65 0 2024-09-19T09:41:38.503 INFO:tasks.workunit.client.0.smithi042.stdout:1/354: mkdir d4/d1e/d25/d35/d3c/d76 0 2024-09-19T09:41:38.504 INFO:tasks.workunit.client.0.smithi042.stdout:1/355: mknod d4/d1e/d25/d35/c77 0 2024-09-19T09:41:38.506 INFO:tasks.workunit.client.0.smithi042.stdout:1/356: symlink d4/d15/d19/d42/d51/l78 0 2024-09-19T09:41:38.508 INFO:tasks.workunit.client.0.smithi042.stdout:1/357: mkdir d4/d15/d19/d42/d51/d79 0 2024-09-19T09:41:38.509 INFO:tasks.workunit.client.0.smithi042.stdout:1/358: mknod d4/d1e/d25/d35/d3c/c7a 0 2024-09-19T09:41:38.512 INFO:tasks.workunit.client.0.smithi042.stdout:9/265: dwrite d8/d1d/f1f [0,4194304] 0 2024-09-19T09:41:38.512 INFO:tasks.workunit.client.0.smithi042.stdout:2/309: dwrite d7/dd/d14/d35/f38 [0,4194304] 0 2024-09-19T09:41:38.513 INFO:tasks.workunit.client.0.smithi042.stdout:2/310: mkdir d7/dd/d14/d35/d4e/d63 0 2024-09-19T09:41:38.514 INFO:tasks.workunit.client.0.smithi042.stdout:2/311: read - d7/dd/d14/f49 zero size 2024-09-19T09:41:38.514 INFO:tasks.workunit.client.0.smithi042.stdout:2/312: chown d7/dd/d14/f56 0 1 2024-09-19T09:41:38.515 INFO:tasks.workunit.client.0.smithi042.stdout:2/313: mknod d7/dd/d14/d35/d45/c64 0 2024-09-19T09:41:38.515 INFO:tasks.workunit.client.0.smithi042.stdout:9/266: symlink d8/da/l52 0 2024-09-19T09:41:38.518 INFO:tasks.workunit.client.0.smithi042.stdout:2/314: rename d7/dd/d14/d35/f38 to d7/dd/d14/d35/d4e/f65 0 2024-09-19T09:41:38.518 INFO:tasks.workunit.client.0.smithi042.stdout:0/328: read d2/f1c [4929502,98658] 0 2024-09-19T09:41:38.518 INFO:tasks.workunit.client.0.smithi042.stdout:0/329: stat d2/d10/l26 0 2024-09-19T09:41:38.519 INFO:tasks.workunit.client.0.smithi042.stdout:2/315: rmdir d7/dd/d14 39 2024-09-19T09:41:38.519 INFO:tasks.workunit.client.0.smithi042.stdout:2/316: rmdir d7/dd/d14/d35/d4c 39 2024-09-19T09:41:38.521 INFO:tasks.workunit.client.0.smithi042.stdout:2/317: mkdir d7/dd/d22/d30/d66 0 2024-09-19T09:41:38.522 INFO:tasks.workunit.client.0.smithi042.stdout:0/330: symlink d2/d10/d1d/l66 0 2024-09-19T09:41:38.522 INFO:tasks.workunit.client.0.smithi042.stdout:2/318: unlink d7/dd/d14/d35/f4f 0 2024-09-19T09:41:38.522 INFO:tasks.workunit.client.0.smithi042.stdout:2/319: fdatasync d7/dd/d14/f1d 0 2024-09-19T09:41:38.522 INFO:tasks.workunit.client.0.smithi042.stdout:0/331: write d2/d10/d12/d16/d18/f47 [11570,69864] 0 2024-09-19T09:41:38.525 INFO:tasks.workunit.client.0.smithi042.stdout:3/360: write d4/d8/d9/dc/d26/d35/f51 [4134811,72151] 0 2024-09-19T09:41:38.525 INFO:tasks.workunit.client.0.smithi042.stdout:3/361: chown d4/d2a 1682857 1 2024-09-19T09:41:38.527 INFO:tasks.workunit.client.0.smithi042.stdout:3/362: unlink d4/d8/d9/f67 0 2024-09-19T09:41:38.529 INFO:tasks.workunit.client.0.smithi042.stdout:7/321: dwrite d0/d40/f4f [0,4194304] 0 2024-09-19T09:41:38.529 INFO:tasks.workunit.client.0.smithi042.stdout:3/363: creat d4/d2a/f75 x:0 0 0 2024-09-19T09:41:38.529 INFO:tasks.workunit.client.0.smithi042.stdout:3/364: readlink d4/l18 0 2024-09-19T09:41:38.530 INFO:tasks.workunit.client.0.smithi042.stdout:3/365: mkdir d4/d2a/d76 0 2024-09-19T09:41:38.530 INFO:tasks.workunit.client.0.smithi042.stdout:2/320: read d7/dd/d22/f32 [3195157,112841] 0 2024-09-19T09:41:38.530 INFO:tasks.workunit.client.0.smithi042.stdout:2/321: write d7/dd/f37 [975091,88974] 0 2024-09-19T09:41:38.531 INFO:tasks.workunit.client.0.smithi042.stdout:3/366: creat d4/d8/d9/d1b/d4f/f77 x:0 0 0 2024-09-19T09:41:38.531 INFO:tasks.workunit.client.0.smithi042.stdout:2/322: mknod d7/dd/d14/d35/d4c/c67 0 2024-09-19T09:41:38.532 INFO:tasks.workunit.client.0.smithi042.stdout:3/367: rename d4/d65 to d4/d78 0 2024-09-19T09:41:38.533 INFO:tasks.workunit.client.0.smithi042.stdout:2/323: link d7/dd/d14/d35/d45/d5e/f39 d7/dd/d14/f68 0 2024-09-19T09:41:38.536 INFO:tasks.workunit.client.0.smithi042.stdout:2/324: rename d7/dd/d14/f68 to d7/dd/d1f/d3f/f69 0 2024-09-19T09:41:38.536 INFO:tasks.workunit.client.0.smithi042.stdout:2/325: chown d7/dd/d22/d30/l3e 458905 1 2024-09-19T09:41:38.536 INFO:tasks.workunit.client.0.smithi042.stdout:2/326: write d7/dd/d22/d30/f34 [1417770,110985] 0 2024-09-19T09:41:38.538 INFO:tasks.workunit.client.0.smithi042.stdout:2/327: rmdir d7 39 2024-09-19T09:41:38.539 INFO:tasks.workunit.client.0.smithi042.stdout:2/328: write d7/dd/d14/f49 [980334,99103] 0 2024-09-19T09:41:38.541 INFO:tasks.workunit.client.0.smithi042.stdout:2/329: creat d7/f6a x:0 0 0 2024-09-19T09:41:38.543 INFO:tasks.workunit.client.0.smithi042.stdout:2/330: mkdir d7/dd/d14/d35/d6b 0 2024-09-19T09:41:38.565 INFO:tasks.workunit.client.0.smithi042.stdout:7/322: dwrite d0/d40/f65 [0,4194304] 0 2024-09-19T09:41:38.565 INFO:tasks.workunit.client.0.smithi042.stdout:7/323: stat d0/c9 0 2024-09-19T09:41:38.565 INFO:tasks.workunit.client.0.smithi042.stdout:7/324: fsync d0/d3d/d55/f5f 0 2024-09-19T09:41:38.565 INFO:tasks.workunit.client.0.smithi042.stdout:9/267: dwrite d8/f15 [0,4194304] 0 2024-09-19T09:41:38.565 INFO:tasks.workunit.client.0.smithi042.stdout:9/268: read - d8/d1d/f4b zero size 2024-09-19T09:41:38.566 INFO:tasks.workunit.client.0.smithi042.stdout:7/325: mknod d0/c67 0 2024-09-19T09:41:38.567 INFO:tasks.workunit.client.0.smithi042.stdout:2/331: dwrite d7/dd/f40 [0,4194304] 0 2024-09-19T09:41:38.567 INFO:tasks.workunit.client.0.smithi042.stdout:1/359: dwrite d4/d15/d44/f71 [4194304,4194304] 0 2024-09-19T09:41:38.568 INFO:tasks.workunit.client.0.smithi042.stdout:1/360: rmdir d4/d15/d19/d42/d5b 39 2024-09-19T09:41:38.568 INFO:tasks.workunit.client.0.smithi042.stdout:1/361: write d4/d15/d19/fc [3978959,17712] 0 2024-09-19T09:41:38.569 INFO:tasks.workunit.client.0.smithi042.stdout:9/269: dread d8/da/d19/f1b [0,4194304] 0 2024-09-19T09:41:38.569 INFO:tasks.workunit.client.0.smithi042.stdout:1/362: creat d4/f7b x:0 0 0 2024-09-19T09:41:38.569 INFO:tasks.workunit.client.0.smithi042.stdout:1/363: write d4/d1d/f2b [1521531,7375] 0 2024-09-19T09:41:38.572 INFO:tasks.workunit.client.0.smithi042.stdout:1/364: mknod d4/d15/d19/d42/d51/d79/c7c 0 2024-09-19T09:41:38.573 INFO:tasks.workunit.client.0.smithi042.stdout:2/332: link d7/dd/d48/f5a d7/dd/d1f/d3f/f6c 0 2024-09-19T09:41:38.573 INFO:tasks.workunit.client.0.smithi042.stdout:2/333: truncate d7/f4b 689621 0 2024-09-19T09:41:38.573 INFO:tasks.workunit.client.0.smithi042.stdout:1/365: symlink d4/d15/d2e/l7d 0 2024-09-19T09:41:38.577 INFO:tasks.workunit.client.0.smithi042.stdout:8/347: sync 2024-09-19T09:41:38.580 INFO:tasks.workunit.client.0.smithi042.stdout:8/348: symlink d1/da/dd/l65 0 2024-09-19T09:41:38.580 INFO:tasks.workunit.client.0.smithi042.stdout:8/349: truncate d1/d2e/f60 6425 0 2024-09-19T09:41:38.582 INFO:tasks.workunit.client.0.smithi042.stdout:2/334: read f2 [1969912,125177] 0 2024-09-19T09:41:38.587 INFO:tasks.workunit.client.0.smithi042.stdout:2/335: read d7/dd/d22/f4a [969587,119133] 0 2024-09-19T09:41:38.589 INFO:tasks.workunit.client.0.smithi042.stdout:1/366: dread d4/d15/d19/fc [0,4194304] 0 2024-09-19T09:41:38.589 INFO:tasks.workunit.client.0.smithi042.stdout:7/326: dwrite d0/f27 [4194304,4194304] 0 2024-09-19T09:41:38.590 INFO:tasks.workunit.client.0.smithi042.stdout:2/336: symlink d7/l6d 0 2024-09-19T09:41:38.590 INFO:tasks.workunit.client.0.smithi042.stdout:2/337: write d7/dd/d1f/d3f/f5c [1539890,103240] 0 2024-09-19T09:41:38.590 INFO:tasks.workunit.client.0.smithi042.stdout:2/338: truncate d7/dd/d22/f32 5055112 0 2024-09-19T09:41:38.590 INFO:tasks.workunit.client.0.smithi042.stdout:1/367: symlink d4/d1e/d25/d35/d3c/d76/l7e 0 2024-09-19T09:41:38.591 INFO:tasks.workunit.client.0.smithi042.stdout:2/339: creat d7/dd/f6e x:0 0 0 2024-09-19T09:41:38.592 INFO:tasks.workunit.client.0.smithi042.stdout:2/340: symlink d7/dd/d22/d30/d66/l6f 0 2024-09-19T09:41:38.594 INFO:tasks.workunit.client.0.smithi042.stdout:7/327: rmdir d0/d40 39 2024-09-19T09:41:38.595 INFO:tasks.workunit.client.0.smithi042.stdout:1/368: mkdir d4/d1d/d20/d7f 0 2024-09-19T09:41:38.596 INFO:tasks.workunit.client.0.smithi042.stdout:7/328: link d0/d56/c60 d0/d14/c68 0 2024-09-19T09:41:38.596 INFO:tasks.workunit.client.0.smithi042.stdout:7/329: chown d0/d14/c68 701418 1 2024-09-19T09:41:38.596 INFO:tasks.workunit.client.0.smithi042.stdout:9/270: dwrite d8/f3d [0,4194304] 0 2024-09-19T09:41:38.596 INFO:tasks.workunit.client.0.smithi042.stdout:7/330: mknod d0/d14/c69 0 2024-09-19T09:41:38.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:38 smithi171 ceph-mon[35803]: pgmap v406: 97 pgs: 97 active+clean; 207 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 19 MiB/s wr, 833 op/s 2024-09-19T09:41:38.597 INFO:tasks.workunit.client.0.smithi042.stdout:5/264: sync 2024-09-19T09:41:38.598 INFO:tasks.workunit.client.0.smithi042.stdout:6/353: sync 2024-09-19T09:41:38.598 INFO:tasks.workunit.client.0.smithi042.stdout:6/354: write d1/f18 [23921,65432] 0 2024-09-19T09:41:38.598 INFO:tasks.workunit.client.0.smithi042.stdout:8/350: dwrite d1/da/f33 [4194304,4194304] 0 2024-09-19T09:41:38.598 INFO:tasks.workunit.client.0.smithi042.stdout:8/351: dread d1/d2e/f60 [0,4194304] 0 2024-09-19T09:41:38.599 INFO:tasks.workunit.client.0.smithi042.stdout:4/348: sync 2024-09-19T09:41:38.601 INFO:tasks.workunit.client.0.smithi042.stdout:9/271: mknod d8/d1d/c53 0 2024-09-19T09:41:38.603 INFO:tasks.workunit.client.0.smithi042.stdout:7/331: rename d0/l4 to d0/d3d/l6a 0 2024-09-19T09:41:38.603 INFO:tasks.workunit.client.0.smithi042.stdout:5/265: dread d2/f1e [0,4194304] 0 2024-09-19T09:41:38.604 INFO:tasks.workunit.client.0.smithi042.stdout:4/349: write d0/d1b/f26 [383500,24253] 0 2024-09-19T09:41:38.607 INFO:tasks.workunit.client.0.smithi042.stdout:8/352: rename d1/da/d3f/l56 to d1/l66 0 2024-09-19T09:41:38.608 INFO:tasks.workunit.client.0.smithi042.stdout:7/332: creat d0/d14/f6b x:0 0 0 2024-09-19T09:41:38.609 INFO:tasks.workunit.client.0.smithi042.stdout:5/266: truncate d2/d25/f40 3111292 0 2024-09-19T09:41:38.609 INFO:tasks.workunit.client.0.smithi042.stdout:5/267: write d2/db/f10 [5039989,45132] 0 2024-09-19T09:41:38.610 INFO:tasks.workunit.client.0.smithi042.stdout:9/272: mkdir d8/d32/d54 0 2024-09-19T09:41:38.610 INFO:tasks.workunit.client.0.smithi042.stdout:9/273: chown d8/da/d19/d1c/d21 24793558 1 2024-09-19T09:41:38.610 INFO:tasks.workunit.client.0.smithi042.stdout:9/274: getdents d8/da/d19/d1c/d4a 0 2024-09-19T09:41:38.611 INFO:tasks.workunit.client.0.smithi042.stdout:9/275: chown d8/db/d31/l42 20 1 2024-09-19T09:41:38.612 INFO:tasks.workunit.client.0.smithi042.stdout:8/353: unlink d1/da/f38 0 2024-09-19T09:41:38.613 INFO:tasks.workunit.client.0.smithi042.stdout:7/333: creat d0/d40/f6c x:0 0 0 2024-09-19T09:41:38.613 INFO:tasks.workunit.client.0.smithi042.stdout:2/341: dwrite d7/dd/d22/f32 [4194304,4194304] 0 2024-09-19T09:41:38.614 INFO:tasks.workunit.client.0.smithi042.stdout:5/268: truncate d2/d4/d20/d11/f23 3577507 0 2024-09-19T09:41:38.615 INFO:tasks.workunit.client.0.smithi042.stdout:2/342: getdents d7/dd/d22 0 2024-09-19T09:41:38.616 INFO:tasks.workunit.client.0.smithi042.stdout:7/334: rmdir d0/d56/d5c 39 2024-09-19T09:41:38.616 INFO:tasks.workunit.client.0.smithi042.stdout:1/369: dwrite d4/d15/d19/d45/f4d [0,4194304] 0 2024-09-19T09:41:38.618 INFO:tasks.workunit.client.0.smithi042.stdout:5/269: creat d2/db/d3c/f54 x:0 0 0 2024-09-19T09:41:38.619 INFO:tasks.workunit.client.0.smithi042.stdout:7/335: creat d0/d56/d5c/f6d x:0 0 0 2024-09-19T09:41:38.623 INFO:tasks.workunit.client.0.smithi042.stdout:4/350: dwrite d0/d1b/d1c/f4f [0,4194304] 0 2024-09-19T09:41:38.623 INFO:tasks.workunit.client.0.smithi042.stdout:4/351: readlink d0/l3a 0 2024-09-19T09:41:38.624 INFO:tasks.workunit.client.0.smithi042.stdout:7/336: link d0/f23 d0/d14/d3a/f6e 0 2024-09-19T09:41:38.624 INFO:tasks.workunit.client.0.smithi042.stdout:7/337: write d0/d14/d3a/f3f [1015398,10581] 0 2024-09-19T09:41:38.625 INFO:tasks.workunit.client.0.smithi042.stdout:4/352: unlink d0/lf 0 2024-09-19T09:41:38.625 INFO:tasks.workunit.client.0.smithi042.stdout:4/353: readlink d0/d28/l49 0 2024-09-19T09:41:38.625 INFO:tasks.workunit.client.0.smithi042.stdout:1/370: write d4/d1e/d25/f46 [3813165,5700] 0 2024-09-19T09:41:38.625 INFO:tasks.workunit.client.0.smithi042.stdout:1/371: dread - d4/f47 zero size 2024-09-19T09:41:38.625 INFO:tasks.workunit.client.0.smithi042.stdout:1/372: truncate d4/d29/f4a 5163053 0 2024-09-19T09:41:38.626 INFO:tasks.workunit.client.0.smithi042.stdout:4/354: getdents d0/d28/d36 0 2024-09-19T09:41:38.627 INFO:tasks.workunit.client.0.smithi042.stdout:1/373: fsync d4/d1e/d25/f46 0 2024-09-19T09:41:38.627 INFO:tasks.workunit.client.0.smithi042.stdout:1/374: write d4/d1e/d25/d35/d3c/f5c [397786,87521] 0 2024-09-19T09:41:38.627 INFO:tasks.workunit.client.0.smithi042.stdout:4/355: symlink d0/d1b/d1c/d2e/d3f/d6e/l77 0 2024-09-19T09:41:38.628 INFO:tasks.workunit.client.0.smithi042.stdout:9/276: dread d8/f11 [0,4194304] 0 2024-09-19T09:41:38.628 INFO:tasks.workunit.client.0.smithi042.stdout:1/375: truncate d4/d15/d19/fc 876183 0 2024-09-19T09:41:38.628 INFO:tasks.workunit.client.0.smithi042.stdout:1/376: read d4/d1e/d25/f46 [706659,119447] 0 2024-09-19T09:41:38.629 INFO:tasks.workunit.client.0.smithi042.stdout:4/356: symlink d0/d1b/d1c/l78 0 2024-09-19T09:41:38.629 INFO:tasks.workunit.client.0.smithi042.stdout:4/357: read d0/d1b/f26 [145709,25413] 0 2024-09-19T09:41:38.629 INFO:tasks.workunit.client.0.smithi042.stdout:5/270: dread d2/d25/f40 [0,4194304] 0 2024-09-19T09:41:38.630 INFO:tasks.workunit.client.0.smithi042.stdout:9/277: rename d8/da/c33 to d8/d1d/c55 0 2024-09-19T09:41:38.630 INFO:tasks.workunit.client.0.smithi042.stdout:4/358: rename d0 to d0/d1b/d1c/d2e/d79 22 2024-09-19T09:41:38.631 INFO:tasks.workunit.client.0.smithi042.stdout:1/377: truncate d4/d29/d3e/f3b 1004288 0 2024-09-19T09:41:38.633 INFO:tasks.workunit.client.0.smithi042.stdout:8/354: dwrite d1/da/d14/f1a [0,4194304] 0 2024-09-19T09:41:38.633 INFO:tasks.workunit.client.0.smithi042.stdout:5/271: rmdir d2/d4/d3e 0 2024-09-19T09:41:38.633 INFO:tasks.workunit.client.0.smithi042.stdout:7/338: dread d0/f6 [0,4194304] 0 2024-09-19T09:41:38.634 INFO:tasks.workunit.client.0.smithi042.stdout:9/278: rmdir d8/d32/d54 0 2024-09-19T09:41:38.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:38 smithi136 ceph-mon[34840]: pgmap v406: 97 pgs: 97 active+clean; 207 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 19 MiB/s wr, 833 op/s 2024-09-19T09:41:38.635 INFO:tasks.workunit.client.0.smithi042.stdout:4/359: mknod d0/d1b/d1c/d2e/d3f/d6e/c7a 0 2024-09-19T09:41:38.635 INFO:tasks.workunit.client.0.smithi042.stdout:4/360: write d0/d1b/d1c/f4f [4765765,80425] 0 2024-09-19T09:41:38.637 INFO:tasks.workunit.client.0.smithi042.stdout:1/378: symlink d4/d1d/l80 0 2024-09-19T09:41:38.638 INFO:tasks.workunit.client.0.smithi042.stdout:8/355: creat d1/da/d3f/f67 x:0 0 0 2024-09-19T09:41:38.640 INFO:tasks.workunit.client.0.smithi042.stdout:5/272: rename d2/d25/d4d/c4a to d2/d4/d20/d11/c55 0 2024-09-19T09:41:38.641 INFO:tasks.workunit.client.0.smithi042.stdout:7/339: getdents d0/d3d/d55 0 2024-09-19T09:41:38.641 INFO:tasks.workunit.client.0.smithi042.stdout:7/340: write d0/d56/d5c/f63 [264637,5731] 0 2024-09-19T09:41:38.642 INFO:tasks.workunit.client.0.smithi042.stdout:7/341: write d0/f59 [1008824,103983] 0 2024-09-19T09:41:38.642 INFO:tasks.workunit.client.0.smithi042.stdout:7/342: chown d0/c67 4383769 1 2024-09-19T09:41:38.648 INFO:tasks.workunit.client.0.smithi042.stdout:5/273: creat d2/d4/f56 x:0 0 0 2024-09-19T09:41:38.649 INFO:tasks.workunit.client.0.smithi042.stdout:2/343: dwrite f6 [0,4194304] 0 2024-09-19T09:41:38.656 INFO:tasks.workunit.client.0.smithi042.stdout:8/356: getdents d1/da/d3f 0 2024-09-19T09:41:38.658 INFO:tasks.workunit.client.0.smithi042.stdout:5/274: rename d2/d4/d20/d11 to d2/d4/d2e/d57 0 2024-09-19T09:41:38.658 INFO:tasks.workunit.client.0.smithi042.stdout:5/275: dread - d2/db/d3c/f54 zero size 2024-09-19T09:41:38.659 INFO:tasks.workunit.client.0.smithi042.stdout:4/361: dwrite d0/d1b/f1e [0,4194304] 0 2024-09-19T09:41:38.660 INFO:tasks.workunit.client.0.smithi042.stdout:5/276: symlink d2/db/d3c/l58 0 2024-09-19T09:41:38.661 INFO:tasks.workunit.client.0.smithi042.stdout:4/362: link d0/d1b/d1c/d2e/d3f/d5a/l5d d0/d1b/d1c/d2e/d3f/l7b 0 2024-09-19T09:41:38.662 INFO:tasks.workunit.client.0.smithi042.stdout:4/363: write d0/d1b/d1c/f51 [708027,99482] 0 2024-09-19T09:41:38.662 INFO:tasks.workunit.client.0.smithi042.stdout:5/277: rmdir d2/d25/d37 39 2024-09-19T09:41:38.663 INFO:tasks.workunit.client.0.smithi042.stdout:4/364: creat d0/d1b/d1c/d6a/f7c x:0 0 0 2024-09-19T09:41:38.664 INFO:tasks.workunit.client.0.smithi042.stdout:5/278: mknod d2/db/d3c/c59 0 2024-09-19T09:41:38.665 INFO:tasks.workunit.client.0.smithi042.stdout:4/365: creat d0/d1b/d1c/d2e/d3b/f7d x:0 0 0 2024-09-19T09:41:38.667 INFO:tasks.workunit.client.0.smithi042.stdout:5/279: symlink d2/db/l5a 0 2024-09-19T09:41:38.667 INFO:tasks.workunit.client.0.smithi042.stdout:4/366: dread d0/d1b/d1c/d2e/d3b/f3c [0,4194304] 0 2024-09-19T09:41:38.668 INFO:tasks.workunit.client.0.smithi042.stdout:5/280: unlink d2/d4/d20/c51 0 2024-09-19T09:41:38.669 INFO:tasks.workunit.client.0.smithi042.stdout:5/281: symlink d2/db/l5b 0 2024-09-19T09:41:38.669 INFO:tasks.workunit.client.0.smithi042.stdout:4/367: read d0/d1b/d1c/f2c [106651,67599] 0 2024-09-19T09:41:38.670 INFO:tasks.workunit.client.0.smithi042.stdout:5/282: unlink d2/d25/d37/f50 0 2024-09-19T09:41:38.670 INFO:tasks.workunit.client.0.smithi042.stdout:5/283: fdatasync d2/db/fe 0 2024-09-19T09:41:38.671 INFO:tasks.workunit.client.0.smithi042.stdout:5/284: mknod d2/d25/c5c 0 2024-09-19T09:41:38.672 INFO:tasks.workunit.client.0.smithi042.stdout:4/368: getdents d0 0 2024-09-19T09:41:38.673 INFO:tasks.workunit.client.0.smithi042.stdout:5/285: mkdir d2/d4/d2e/d5d 0 2024-09-19T09:41:38.673 INFO:tasks.workunit.client.0.smithi042.stdout:4/369: symlink d0/d67/l7e 0 2024-09-19T09:41:38.675 INFO:tasks.workunit.client.0.smithi042.stdout:4/370: getdents d0/d1b/d1c/d2e/d3f/d6e 0 2024-09-19T09:41:38.675 INFO:tasks.workunit.client.0.smithi042.stdout:4/371: fdatasync d0/d1b/d1c/d2e/d3f/f4e 0 2024-09-19T09:41:38.675 INFO:tasks.workunit.client.0.smithi042.stdout:4/372: write d0/d1b/d1c/d2e/d3f/d5a/f5b [4529736,79470] 0 2024-09-19T09:41:38.675 INFO:tasks.workunit.client.0.smithi042.stdout:4/373: write d0/d1b/d1c/f55 [1370364,38621] 0 2024-09-19T09:41:38.676 INFO:tasks.workunit.client.0.smithi042.stdout:5/286: link d2/db/d3c/l58 d2/db/l5e 0 2024-09-19T09:41:38.676 INFO:tasks.workunit.client.0.smithi042.stdout:5/287: truncate d2/d4/d20/f45 231139 0 2024-09-19T09:41:38.681 INFO:tasks.workunit.client.0.smithi042.stdout:5/288: write d2/d4/d2e/d57/f23 [2452776,39176] 0 2024-09-19T09:41:38.684 INFO:tasks.workunit.client.0.smithi042.stdout:5/289: symlink d2/d25/d4d/l5f 0 2024-09-19T09:41:38.685 INFO:tasks.workunit.client.0.smithi042.stdout:5/290: mkdir d2/d4/d20/d60 0 2024-09-19T09:41:38.685 INFO:tasks.workunit.client.0.smithi042.stdout:5/291: chown d2/f7 181440 1 2024-09-19T09:41:38.685 INFO:tasks.workunit.client.0.smithi042.stdout:5/292: write d2/d25/f2b [23809,65779] 0 2024-09-19T09:41:38.685 INFO:tasks.workunit.client.0.smithi042.stdout:5/293: dread - d2/db/d3c/f54 zero size 2024-09-19T09:41:38.686 INFO:tasks.workunit.client.0.smithi042.stdout:7/343: dwrite d0/d14/d3a/f3f [0,4194304] 0 2024-09-19T09:41:38.686 INFO:tasks.workunit.client.0.smithi042.stdout:1/379: dwrite d4/d15/d19/f9 [0,4194304] 0 2024-09-19T09:41:38.686 INFO:tasks.workunit.client.0.smithi042.stdout:2/344: dwrite d7/dd/d14/f25 [0,4194304] 0 2024-09-19T09:41:38.687 INFO:tasks.workunit.client.0.smithi042.stdout:5/294: mknod d2/d25/c61 0 2024-09-19T09:41:38.687 INFO:tasks.workunit.client.0.smithi042.stdout:2/345: mkdir d7/dd/d14/d35/d4c/d70 0 2024-09-19T09:41:38.689 INFO:tasks.workunit.client.0.smithi042.stdout:7/344: mknod d0/d56/c6f 0 2024-09-19T09:41:38.691 INFO:tasks.workunit.client.0.smithi042.stdout:7/345: mknod d0/d14/d5d/c70 0 2024-09-19T09:41:38.691 INFO:tasks.workunit.client.0.smithi042.stdout:7/346: dread - d0/d40/f6c zero size 2024-09-19T09:41:38.693 INFO:tasks.workunit.client.0.smithi042.stdout:5/295: write d2/d4/fa [3746868,20981] 0 2024-09-19T09:41:38.693 INFO:tasks.workunit.client.0.smithi042.stdout:5/296: chown d2/db/d3c/c59 215 1 2024-09-19T09:41:38.693 INFO:tasks.workunit.client.0.smithi042.stdout:5/297: truncate d2/d25/d4d/f24 474389 0 2024-09-19T09:41:38.695 INFO:tasks.workunit.client.0.smithi042.stdout:5/298: rename d2/d25/f40 to d2/d4/d20/f62 0 2024-09-19T09:41:38.697 INFO:tasks.workunit.client.0.smithi042.stdout:5/299: unlink d2/d4/d2e/d57/c3a 0 2024-09-19T09:41:38.698 INFO:tasks.workunit.client.0.smithi042.stdout:2/346: write d7/fe [4113411,5702] 0 2024-09-19T09:41:38.698 INFO:tasks.workunit.client.0.smithi042.stdout:8/357: dwrite d1/f9 [0,4194304] 0 2024-09-19T09:41:38.698 INFO:tasks.workunit.client.0.smithi042.stdout:5/300: creat d2/d25/d37/f63 x:0 0 0 2024-09-19T09:41:38.699 INFO:tasks.workunit.client.0.smithi042.stdout:8/358: mknod d1/c68 0 2024-09-19T09:41:38.699 INFO:tasks.workunit.client.0.smithi042.stdout:8/359: fdatasync d1/da/f2f 0 2024-09-19T09:41:38.701 INFO:tasks.workunit.client.0.smithi042.stdout:1/380: dread d4/d15/d44/f71 [4194304,4194304] 0 2024-09-19T09:41:38.701 INFO:tasks.workunit.client.0.smithi042.stdout:4/374: dwrite d0/d1b/f40 [0,4194304] 0 2024-09-19T09:41:38.701 INFO:tasks.workunit.client.0.smithi042.stdout:5/301: mkdir d2/d4/d64 0 2024-09-19T09:41:38.702 INFO:tasks.workunit.client.0.smithi042.stdout:5/302: readlink d2/l26 0 2024-09-19T09:41:38.703 INFO:tasks.workunit.client.0.smithi042.stdout:1/381: creat d4/d15/d19/d42/d51/f81 x:0 0 0 2024-09-19T09:41:38.703 INFO:tasks.workunit.client.0.smithi042.stdout:1/382: chown d4/d15/d44 1754803818 1 2024-09-19T09:41:38.704 INFO:tasks.workunit.client.0.smithi042.stdout:1/383: chown d4/d12/l6c 44140 1 2024-09-19T09:41:38.704 INFO:tasks.workunit.client.0.smithi042.stdout:1/384: dread - d4/d1e/d25/d35/f72 zero size 2024-09-19T09:41:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:38 smithi042 ceph-mon[31223]: pgmap v406: 97 pgs: 97 active+clean; 207 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 19 MiB/s wr, 833 op/s 2024-09-19T09:41:38.706 INFO:tasks.workunit.client.0.smithi042.stdout:4/375: mkdir d0/d1b/d1c/d61/d7f 0 2024-09-19T09:41:38.708 INFO:tasks.workunit.client.0.smithi042.stdout:5/303: rename d2/db/d3c/f54 to d2/d4/d2e/d5d/f65 0 2024-09-19T09:41:38.713 INFO:tasks.workunit.client.0.smithi042.stdout:4/376: getdents d0/d1b/d1c/d6a 0 2024-09-19T09:41:38.716 INFO:tasks.workunit.client.0.smithi042.stdout:7/347: dwrite d0/f27 [0,4194304] 0 2024-09-19T09:41:38.716 INFO:tasks.workunit.client.0.smithi042.stdout:7/348: write d0/d56/f66 [809801,100588] 0 2024-09-19T09:41:38.720 INFO:tasks.workunit.client.0.smithi042.stdout:1/385: rename d4/d1e/d25/d35/d3c/d76 to d4/d15/d19/d45/d82 0 2024-09-19T09:41:38.721 INFO:tasks.workunit.client.0.smithi042.stdout:4/377: unlink d0/d1b/d1c/c52 0 2024-09-19T09:41:38.721 INFO:tasks.workunit.client.0.smithi042.stdout:5/304: read d2/d25/d4d/f1d [3751438,38953] 0 2024-09-19T09:41:38.723 INFO:tasks.workunit.client.0.smithi042.stdout:5/305: dread d2/db/f10 [4194304,4194304] 0 2024-09-19T09:41:38.724 INFO:tasks.workunit.client.0.smithi042.stdout:7/349: rename d0/d3d/f61 to d0/d3d/d55/f71 0 2024-09-19T09:41:38.726 INFO:tasks.workunit.client.0.smithi042.stdout:1/386: link d4/d15/d44/l6b d4/d15/d19/d45/l83 0 2024-09-19T09:41:38.726 INFO:tasks.workunit.client.0.smithi042.stdout:1/387: dread - d4/d4e/f57 zero size 2024-09-19T09:41:38.727 INFO:tasks.workunit.client.0.smithi042.stdout:4/378: creat d0/d1b/d56/f80 x:0 0 0 2024-09-19T09:41:38.727 INFO:tasks.workunit.client.0.smithi042.stdout:4/379: stat d0/d1b/d1c/d2e/d44/l5f 0 2024-09-19T09:41:38.728 INFO:tasks.workunit.client.0.smithi042.stdout:5/306: symlink d2/d4/d2e/d5d/l66 0 2024-09-19T09:41:38.729 INFO:tasks.workunit.client.0.smithi042.stdout:7/350: mkdir d0/d3d/d55/d72 0 2024-09-19T09:41:38.730 INFO:tasks.workunit.client.0.smithi042.stdout:1/388: rename d4/d15/d19/d45/l83 to d4/d15/d19/d42/l84 0 2024-09-19T09:41:38.730 INFO:tasks.workunit.client.0.smithi042.stdout:1/389: chown d4/d12/c1b 8969952 1 2024-09-19T09:41:38.731 INFO:tasks.workunit.client.0.smithi042.stdout:1/390: mkdir d4/d15/d61/d85 0 2024-09-19T09:41:38.733 INFO:tasks.workunit.client.0.smithi042.stdout:4/380: write d0/d1b/d1c/d2e/d3b/f47 [468072,61162] 0 2024-09-19T09:41:38.735 INFO:tasks.workunit.client.0.smithi042.stdout:5/307: read d2/db/d3c/f3f [4162644,39833] 0 2024-09-19T09:41:38.736 INFO:tasks.workunit.client.0.smithi042.stdout:4/381: rmdir d0/d67 39 2024-09-19T09:41:38.738 INFO:tasks.workunit.client.0.smithi042.stdout:5/308: creat d2/d4/f67 x:0 0 0 2024-09-19T09:41:38.739 INFO:tasks.workunit.client.0.smithi042.stdout:4/382: mknod d0/d1b/d1c/d2e/d3f/d6b/c81 0 2024-09-19T09:41:38.739 INFO:tasks.workunit.client.0.smithi042.stdout:4/383: chown d0/fb 13 1 2024-09-19T09:41:38.739 INFO:tasks.workunit.client.0.smithi042.stdout:4/384: chown d0/d1b/d1c/d2e/d3f 0 1 2024-09-19T09:41:38.739 INFO:tasks.workunit.client.0.smithi042.stdout:4/385: rename d0/d1b to d0/d1b/d69/d82 22 2024-09-19T09:41:38.740 INFO:tasks.workunit.client.0.smithi042.stdout:3/368: sync 2024-09-19T09:41:38.740 INFO:tasks.workunit.client.0.smithi042.stdout:0/332: sync 2024-09-19T09:41:38.740 INFO:tasks.workunit.client.0.smithi042.stdout:4/386: mkdir d0/d1b/d1c/d61/d7f/d83 0 2024-09-19T09:41:38.741 INFO:tasks.workunit.client.0.smithi042.stdout:5/309: mknod d2/db/c68 0 2024-09-19T09:41:38.741 INFO:tasks.workunit.client.0.smithi042.stdout:5/310: stat d2/d4/d2e/d5d 0 2024-09-19T09:41:38.743 INFO:tasks.workunit.client.0.smithi042.stdout:4/387: symlink d0/d1b/d1c/d61/d7f/d83/l84 0 2024-09-19T09:41:38.743 INFO:tasks.workunit.client.0.smithi042.stdout:4/388: readlink d0/d1b/d1c/l21 0 2024-09-19T09:41:38.745 INFO:tasks.workunit.client.0.smithi042.stdout:3/369: dread d4/d8/f36 [0,4194304] 0 2024-09-19T09:41:38.751 INFO:tasks.workunit.client.0.smithi042.stdout:1/391: dwrite d4/f7b [0,4194304] 0 2024-09-19T09:41:38.752 INFO:tasks.workunit.client.0.smithi042.stdout:1/392: mknod d4/d12/c86 0 2024-09-19T09:41:38.753 INFO:tasks.workunit.client.0.smithi042.stdout:0/333: write d2/d10/d1d/f2b [2973728,14964] 0 2024-09-19T09:41:38.753 INFO:tasks.workunit.client.0.smithi042.stdout:1/393: write d4/d1e/d25/d35/f5a [395848,91111] 0 2024-09-19T09:41:38.753 INFO:tasks.workunit.client.0.smithi042.stdout:1/394: write d4/d1e/d25/d35/f75 [426782,117856] 0 2024-09-19T09:41:38.755 INFO:tasks.workunit.client.0.smithi042.stdout:1/395: rmdir d4/d29 39 2024-09-19T09:41:38.757 INFO:tasks.workunit.client.0.smithi042.stdout:0/334: mknod d2/d10/d1d/c67 0 2024-09-19T09:41:38.757 INFO:tasks.workunit.client.0.smithi042.stdout:0/335: chown d2/d10/d12/d16 0 1 2024-09-19T09:41:38.758 INFO:tasks.workunit.client.0.smithi042.stdout:1/396: creat d4/d15/d19/f87 x:0 0 0 2024-09-19T09:41:38.759 INFO:tasks.workunit.client.0.smithi042.stdout:4/389: dread d0/d1b/f23 [0,4194304] 0 2024-09-19T09:41:38.761 INFO:tasks.workunit.client.0.smithi042.stdout:4/390: rename d0/d1b/c34 to d0/d67/c85 0 2024-09-19T09:41:38.762 INFO:tasks.workunit.client.0.smithi042.stdout:4/391: mkdir d0/d1b/d56/d86 0 2024-09-19T09:41:38.762 INFO:tasks.workunit.client.0.smithi042.stdout:4/392: dread - d0/f6c zero size 2024-09-19T09:41:38.762 INFO:tasks.workunit.client.0.smithi042.stdout:4/393: stat d0/d1b/f41 0 2024-09-19T09:41:38.763 INFO:tasks.workunit.client.0.smithi042.stdout:4/394: mkdir d0/d28/d87 0 2024-09-19T09:41:38.765 INFO:tasks.workunit.client.0.smithi042.stdout:5/311: dwrite d2/db/f2f [0,4194304] 0 2024-09-19T09:41:38.766 INFO:tasks.workunit.client.0.smithi042.stdout:0/336: write d2/d10/d12/d2e/d32/f39 [3673804,117896] 0 2024-09-19T09:41:38.792 INFO:tasks.workunit.client.0.smithi042.stdout:5/312: dwrite d2/d4/d2e/d57/f1f [0,4194304] 0 2024-09-19T09:41:38.794 INFO:tasks.workunit.client.0.smithi042.stdout:5/313: link d2/db/l13 d2/d4/d20/d60/l69 0 2024-09-19T09:41:38.794 INFO:tasks.workunit.client.0.smithi042.stdout:1/397: dwrite d4/d1e/d25/d35/d3c/f5c [0,4194304] 0 2024-09-19T09:41:38.795 INFO:tasks.workunit.client.0.smithi042.stdout:5/314: dread d2/d4/d20/f45 [0,4194304] 0 2024-09-19T09:41:38.801 INFO:tasks.workunit.client.0.smithi042.stdout:4/395: dwrite d0/d1b/d1c/f1f [0,4194304] 0 2024-09-19T09:41:38.801 INFO:tasks.workunit.client.0.smithi042.stdout:4/396: write d0/d1b/f26 [619807,61748] 0 2024-09-19T09:41:38.805 INFO:tasks.workunit.client.0.smithi042.stdout:0/337: dwrite d2/d10/f1b [0,4194304] 0 2024-09-19T09:41:38.807 INFO:tasks.workunit.client.0.smithi042.stdout:0/338: link d2/d10/d12/d19/c4d d2/d10/d12/d2e/d32/d64/c68 0 2024-09-19T09:41:38.808 INFO:tasks.workunit.client.0.smithi042.stdout:0/339: creat d2/d10/d12/d19/f69 x:0 0 0 2024-09-19T09:41:38.810 INFO:tasks.workunit.client.0.smithi042.stdout:0/340: creat d2/d10/d12/d16/d57/f6a x:0 0 0 2024-09-19T09:41:38.810 INFO:tasks.workunit.client.0.smithi042.stdout:0/341: chown d2/d10/d12/d2e/d32/c60 537180 1 2024-09-19T09:41:38.810 INFO:tasks.workunit.client.0.smithi042.stdout:5/315: write d2/d4/d20/d31/f32 [1783147,21163] 0 2024-09-19T09:41:38.811 INFO:tasks.workunit.client.0.smithi042.stdout:0/342: mkdir d2/d10/d6b 0 2024-09-19T09:41:38.812 INFO:tasks.workunit.client.0.smithi042.stdout:5/316: mkdir d2/d4/d64/d6a 0 2024-09-19T09:41:38.812 INFO:tasks.workunit.client.0.smithi042.stdout:1/398: dwrite d4/d15/f21 [0,4194304] 0 2024-09-19T09:41:38.813 INFO:tasks.workunit.client.0.smithi042.stdout:5/317: mknod d2/d4/d64/d6a/c6b 0 2024-09-19T09:41:38.815 INFO:tasks.workunit.client.0.smithi042.stdout:0/343: dread d2/fb [0,4194304] 0 2024-09-19T09:41:38.815 INFO:tasks.workunit.client.0.smithi042.stdout:0/344: readlink d2/d10/d12/d16/d18/d52/l5d 0 2024-09-19T09:41:38.815 INFO:tasks.workunit.client.0.smithi042.stdout:1/399: rename d4/d1e/l4c to d4/d1e/d25/d35/l88 0 2024-09-19T09:41:38.815 INFO:tasks.workunit.client.0.smithi042.stdout:1/400: readlink d4/d15/d19/d42/d51/l78 0 2024-09-19T09:41:38.815 INFO:tasks.workunit.client.0.smithi042.stdout:1/401: write d4/d1e/d25/d35/d3c/f43 [4713019,47014] 0 2024-09-19T09:41:38.816 INFO:tasks.workunit.client.0.smithi042.stdout:0/345: creat d2/d10/d1e/f6c x:0 0 0 2024-09-19T09:41:38.816 INFO:tasks.workunit.client.0.smithi042.stdout:0/346: fdatasync d2/d10/d1d/f59 0 2024-09-19T09:41:38.816 INFO:tasks.workunit.client.0.smithi042.stdout:1/402: mkdir d4/d15/d19/d45/d82/d89 0 2024-09-19T09:41:38.816 INFO:tasks.workunit.client.0.smithi042.stdout:1/403: read - d4/d4e/f57 zero size 2024-09-19T09:41:38.817 INFO:tasks.workunit.client.0.smithi042.stdout:5/318: mknod d2/db/c6c 0 2024-09-19T09:41:38.818 INFO:tasks.workunit.client.0.smithi042.stdout:0/347: mkdir d2/d10/d12/d19/d6d 0 2024-09-19T09:41:38.819 INFO:tasks.workunit.client.0.smithi042.stdout:1/404: rmdir d4/d15/d61 39 2024-09-19T09:41:38.821 INFO:tasks.workunit.client.0.smithi042.stdout:8/360: sync 2024-09-19T09:41:38.821 INFO:tasks.workunit.client.0.smithi042.stdout:6/355: sync 2024-09-19T09:41:38.821 INFO:tasks.workunit.client.0.smithi042.stdout:9/279: sync 2024-09-19T09:41:38.821 INFO:tasks.workunit.client.0.smithi042.stdout:9/280: read - d8/d1d/f4b zero size 2024-09-19T09:41:38.821 INFO:tasks.workunit.client.0.smithi042.stdout:0/348: creat d2/d10/d12/d19/f6e x:0 0 0 2024-09-19T09:41:38.821 INFO:tasks.workunit.client.0.smithi042.stdout:9/281: write d8/d1d/d28/f4f [399934,101434] 0 2024-09-19T09:41:38.821 INFO:tasks.workunit.client.0.smithi042.stdout:9/282: fdatasync d8/da/d19/f2b 0 2024-09-19T09:41:38.821 INFO:tasks.workunit.client.0.smithi042.stdout:9/283: readlink d8/d32/l41 0 2024-09-19T09:41:38.821 INFO:tasks.workunit.client.0.smithi042.stdout:2/347: sync 2024-09-19T09:41:38.822 INFO:tasks.workunit.client.0.smithi042.stdout:4/397: dwrite d0/d1b/f41 [0,4194304] 0 2024-09-19T09:41:38.822 INFO:tasks.workunit.client.0.smithi042.stdout:6/356: unlink d1/d20/d32/l33 0 2024-09-19T09:41:38.822 INFO:tasks.workunit.client.0.smithi042.stdout:2/348: link d7/dd/d14/d35/d45/c51 d7/dd/d14/c71 0 2024-09-19T09:41:38.822 INFO:tasks.workunit.client.0.smithi042.stdout:2/349: stat d7/dd/d14/f49 0 2024-09-19T09:41:38.823 INFO:tasks.workunit.client.0.smithi042.stdout:0/349: dread d2/d10/d12/d16/d18/d52/f55 [0,4194304] 0 2024-09-19T09:41:38.825 INFO:tasks.workunit.client.0.smithi042.stdout:4/398: symlink d0/d1b/d1c/d2e/d3f/l88 0 2024-09-19T09:41:38.825 INFO:tasks.workunit.client.0.smithi042.stdout:2/350: dread d7/dd/d14/f31 [0,4194304] 0 2024-09-19T09:41:38.826 INFO:tasks.workunit.client.0.smithi042.stdout:5/319: read d2/d4/d2e/d57/f1f [578798,16849] 0 2024-09-19T09:41:38.826 INFO:tasks.workunit.client.0.smithi042.stdout:5/320: read - d2/d4/d2e/d5d/f65 zero size 2024-09-19T09:41:38.826 INFO:tasks.workunit.client.0.smithi042.stdout:5/321: chown d2/d4/d2e/f4c 27 1 2024-09-19T09:41:38.826 INFO:tasks.workunit.client.0.smithi042.stdout:5/322: chown d2/d4/d2e/d57/c3b 8139969 1 2024-09-19T09:41:38.826 INFO:tasks.workunit.client.0.smithi042.stdout:6/357: mkdir d1/d20/d60 0 2024-09-19T09:41:38.826 INFO:tasks.workunit.client.0.smithi042.stdout:5/323: write d2/d25/d4d/f1a [1530797,485] 0 2024-09-19T09:41:38.826 INFO:tasks.workunit.client.0.smithi042.stdout:2/351: rmdir d7/dd/d22/d43 39 2024-09-19T09:41:38.827 INFO:tasks.workunit.client.0.smithi042.stdout:2/352: rmdir d7/dd/d22/d30/d66 39 2024-09-19T09:41:38.827 INFO:tasks.workunit.client.0.smithi042.stdout:2/353: read - d7/dd/d22/d43/f52 zero size 2024-09-19T09:41:38.827 INFO:tasks.workunit.client.0.smithi042.stdout:2/354: fdatasync d7/dd/d22/d30/f34 0 2024-09-19T09:41:38.828 INFO:tasks.workunit.client.0.smithi042.stdout:0/350: creat d2/d10/d1e/f6f x:0 0 0 2024-09-19T09:41:38.828 INFO:tasks.workunit.client.0.smithi042.stdout:2/355: rename d7/l26 to d7/dd/d22/d30/l72 0 2024-09-19T09:41:38.829 INFO:tasks.workunit.client.0.smithi042.stdout:2/356: dread d7/f4b [0,4194304] 0 2024-09-19T09:41:38.831 INFO:tasks.workunit.client.0.smithi042.stdout:2/357: creat d7/dd/f73 x:0 0 0 2024-09-19T09:41:38.831 INFO:tasks.workunit.client.0.smithi042.stdout:6/358: creat d1/de/d5d/f61 x:0 0 0 2024-09-19T09:41:38.831 INFO:tasks.workunit.client.0.smithi042.stdout:9/284: write d8/d1d/f1f [3628416,99343] 0 2024-09-19T09:41:38.831 INFO:tasks.workunit.client.0.smithi042.stdout:6/359: truncate d1/de/d5d/f61 1039333 0 2024-09-19T09:41:38.831 INFO:tasks.workunit.client.0.smithi042.stdout:2/358: write d7/dd/d22/f4a [1391508,92769] 0 2024-09-19T09:41:38.832 INFO:tasks.workunit.client.0.smithi042.stdout:9/285: creat d8/da/d19/f56 x:0 0 0 2024-09-19T09:41:38.833 INFO:tasks.workunit.client.0.smithi042.stdout:6/360: creat d1/d20/f62 x:0 0 0 2024-09-19T09:41:38.834 INFO:tasks.workunit.client.0.smithi042.stdout:9/286: creat d8/f57 x:0 0 0 2024-09-19T09:41:38.834 INFO:tasks.workunit.client.0.smithi042.stdout:9/287: readlink d8/d32/l3c 0 2024-09-19T09:41:38.836 INFO:tasks.workunit.client.0.smithi042.stdout:6/361: link d1/de/d12/l1b d1/de/d12/d1c/l63 0 2024-09-19T09:41:38.837 INFO:tasks.workunit.client.0.smithi042.stdout:0/351: write d2/fb [5099560,16824] 0 2024-09-19T09:41:38.837 INFO:tasks.workunit.client.0.smithi042.stdout:9/288: truncate d8/f3d 3454212 0 2024-09-19T09:41:38.838 INFO:tasks.workunit.client.0.smithi042.stdout:6/362: creat d1/d20/d32/d46/f64 x:0 0 0 2024-09-19T09:41:38.839 INFO:tasks.workunit.client.0.smithi042.stdout:9/289: creat d8/d32/f58 x:0 0 0 2024-09-19T09:41:38.840 INFO:tasks.workunit.client.0.smithi042.stdout:6/363: creat d1/de/d12/d1c/d4f/f65 x:0 0 0 2024-09-19T09:41:38.841 INFO:tasks.workunit.client.0.smithi042.stdout:6/364: truncate d1/d20/f56 794514 0 2024-09-19T09:41:38.842 INFO:tasks.workunit.client.0.smithi042.stdout:0/352: rename d2/d10/d12/f40 to d2/d10/d12/d2e/f70 0 2024-09-19T09:41:38.844 INFO:tasks.workunit.client.0.smithi042.stdout:9/290: unlink d8/f57 0 2024-09-19T09:41:38.845 INFO:tasks.workunit.client.0.smithi042.stdout:6/365: creat d1/de/d12/d1c/d4f/f66 x:0 0 0 2024-09-19T09:41:38.845 INFO:tasks.workunit.client.0.smithi042.stdout:6/366: chown d1/d2e/c40 91607653 1 2024-09-19T09:41:38.846 INFO:tasks.workunit.client.0.smithi042.stdout:0/353: mknod d2/d10/d12/d2e/d32/d64/c71 0 2024-09-19T09:41:38.848 INFO:tasks.workunit.client.0.smithi042.stdout:0/354: creat d2/d10/d12/d2e/d32/f72 x:0 0 0 2024-09-19T09:41:38.848 INFO:tasks.workunit.client.0.smithi042.stdout:0/355: truncate d2/d10/d12/d16/d51/f56 3142686 0 2024-09-19T09:41:38.848 INFO:tasks.workunit.client.0.smithi042.stdout:0/356: creat d2/d10/d12/d16/d57/f73 x:0 0 0 2024-09-19T09:41:38.849 INFO:tasks.workunit.client.0.smithi042.stdout:0/357: creat d2/d10/d1d/d34/f74 x:0 0 0 2024-09-19T09:41:38.850 INFO:tasks.workunit.client.0.smithi042.stdout:0/358: symlink d2/l75 0 2024-09-19T09:41:38.850 INFO:tasks.workunit.client.0.smithi042.stdout:0/359: write d2/d10/d1e/f6f [808069,78810] 0 2024-09-19T09:41:38.850 INFO:tasks.workunit.client.0.smithi042.stdout:0/360: write d2/d10/d12/d2e/f4c [1328293,74421] 0 2024-09-19T09:41:38.853 INFO:tasks.workunit.client.0.smithi042.stdout:6/367: dread d1/de/f28 [0,4194304] 0 2024-09-19T09:41:38.853 INFO:tasks.workunit.client.0.smithi042.stdout:6/368: stat d1/d20/f62 0 2024-09-19T09:41:38.854 INFO:tasks.workunit.client.0.smithi042.stdout:6/369: symlink d1/d20/d45/l67 0 2024-09-19T09:41:38.859 INFO:tasks.workunit.client.0.smithi042.stdout:7/351: sync 2024-09-19T09:41:38.860 INFO:tasks.workunit.client.0.smithi042.stdout:6/370: dread d1/f24 [0,4194304] 0 2024-09-19T09:41:38.863 INFO:tasks.workunit.client.0.smithi042.stdout:1/405: dwrite d4/d15/d19/fc [0,4194304] 0 2024-09-19T09:41:38.863 INFO:tasks.workunit.client.0.smithi042.stdout:2/359: dwrite d7/dd/f15 [0,4194304] 0 2024-09-19T09:41:38.863 INFO:tasks.workunit.client.0.smithi042.stdout:2/360: readlink d7/dd/l20 0 2024-09-19T09:41:38.864 INFO:tasks.workunit.client.0.smithi042.stdout:2/361: truncate d7/dd/d1f/d3f/f69 859702 0 2024-09-19T09:41:38.864 INFO:tasks.workunit.client.0.smithi042.stdout:8/361: dwrite d1/da/dd/f49 [0,4194304] 0 2024-09-19T09:41:38.870 INFO:tasks.workunit.client.0.smithi042.stdout:2/362: rename d7/f10 to d7/dd/d14/d35/d4c/d61/f74 0 2024-09-19T09:41:38.870 INFO:tasks.workunit.client.0.smithi042.stdout:2/363: chown d7/dd/d14/d35/d4c/c67 2886567 1 2024-09-19T09:41:38.875 INFO:tasks.workunit.client.0.smithi042.stdout:8/362: mkdir d1/da/dd/d69 0 2024-09-19T09:41:38.876 INFO:tasks.workunit.client.0.smithi042.stdout:8/363: symlink d1/l6a 0 2024-09-19T09:41:38.878 INFO:tasks.workunit.client.0.smithi042.stdout:8/364: creat d1/da/d32/d41/d55/f6b x:0 0 0 2024-09-19T09:41:38.883 INFO:tasks.workunit.client.0.smithi042.stdout:0/361: getdents d2/d10/d12/d16/d57 0 2024-09-19T09:41:38.883 INFO:tasks.workunit.client.0.smithi042.stdout:0/362: chown d2/d10/d12/d16/d57/f73 74651 1 2024-09-19T09:41:38.885 INFO:tasks.workunit.client.0.smithi042.stdout:0/363: creat d2/d10/d12/d16/d51/f76 x:0 0 0 2024-09-19T09:41:38.887 INFO:tasks.workunit.client.0.smithi042.stdout:0/364: creat d2/d10/d6b/f77 x:0 0 0 2024-09-19T09:41:38.890 INFO:tasks.workunit.client.0.smithi042.stdout:0/365: unlink d2/d10/d12/d2e/d32/f39 0 2024-09-19T09:41:38.890 INFO:tasks.workunit.client.0.smithi042.stdout:6/371: dwrite d1/de/f35 [0,4194304] 0 2024-09-19T09:41:38.890 INFO:tasks.workunit.client.0.smithi042.stdout:6/372: dread - d1/d20/d32/f5a zero size 2024-09-19T09:41:38.890 INFO:tasks.workunit.client.0.smithi042.stdout:6/373: dread - d1/d20/d32/f5a zero size 2024-09-19T09:41:38.890 INFO:tasks.workunit.client.0.smithi042.stdout:6/374: chown d1/d20/d45 92964 1 2024-09-19T09:41:38.891 INFO:tasks.workunit.client.0.smithi042.stdout:0/366: truncate d2/d10/d12/d2e/f70 3962500 0 2024-09-19T09:41:38.894 INFO:tasks.workunit.client.0.smithi042.stdout:6/375: truncate d1/d20/d32/f58 3948757 0 2024-09-19T09:41:38.894 INFO:tasks.workunit.client.0.smithi042.stdout:7/352: dwrite d0/d40/f4f [0,4194304] 0 2024-09-19T09:41:38.894 INFO:tasks.workunit.client.0.smithi042.stdout:0/367: mkdir d2/d10/d12/d16/d57/d78 0 2024-09-19T09:41:38.896 INFO:tasks.workunit.client.0.smithi042.stdout:6/376: rmdir d1/d20/d60 0 2024-09-19T09:41:38.897 INFO:tasks.workunit.client.0.smithi042.stdout:2/364: dwrite d7/dd/f40 [0,4194304] 0 2024-09-19T09:41:38.897 INFO:tasks.workunit.client.0.smithi042.stdout:7/353: rmdir d0/d14/d44/d47 39 2024-09-19T09:41:38.897 INFO:tasks.workunit.client.0.smithi042.stdout:3/370: sync 2024-09-19T09:41:38.897 INFO:tasks.workunit.client.0.smithi042.stdout:6/377: symlink d1/de/d12/d22/d34/l68 0 2024-09-19T09:41:38.897 INFO:tasks.workunit.client.0.smithi042.stdout:6/378: truncate d1/d20/f62 223329 0 2024-09-19T09:41:38.899 INFO:tasks.workunit.client.0.smithi042.stdout:3/371: unlink d4/d8/d9/dc/d26/f47 0 2024-09-19T09:41:38.900 INFO:tasks.workunit.client.0.smithi042.stdout:1/406: dwrite f1 [4194304,4194304] 0 2024-09-19T09:41:38.902 INFO:tasks.workunit.client.0.smithi042.stdout:3/372: truncate d4/d8/f1c 5552923 0 2024-09-19T09:41:38.902 INFO:tasks.workunit.client.0.smithi042.stdout:3/373: fdatasync d4/d8/f19 0 2024-09-19T09:41:38.904 INFO:tasks.workunit.client.0.smithi042.stdout:3/374: unlink d4/d8/d9/l16 0 2024-09-19T09:41:38.905 INFO:tasks.workunit.client.0.smithi042.stdout:0/368: write d2/d10/d1d/f25 [1215476,112784] 0 2024-09-19T09:41:38.905 INFO:tasks.workunit.client.0.smithi042.stdout:3/375: symlink d4/d8/d9/d12/d48/l79 0 2024-09-19T09:41:38.906 INFO:tasks.workunit.client.0.smithi042.stdout:2/365: symlink d7/dd/d22/d30/d66/l75 0 2024-09-19T09:41:38.906 INFO:tasks.workunit.client.0.smithi042.stdout:3/376: fdatasync d4/d8/d9/f1e 0 2024-09-19T09:41:38.906 INFO:tasks.workunit.client.0.smithi042.stdout:8/365: dwrite d1/da/dd/f5c [0,4194304] 0 2024-09-19T09:41:38.906 INFO:tasks.workunit.client.0.smithi042.stdout:8/366: chown d1/da/f5f 1 1 2024-09-19T09:41:38.907 INFO:tasks.workunit.client.0.smithi042.stdout:2/366: rmdir d7/dd/d48 39 2024-09-19T09:41:38.907 INFO:tasks.workunit.client.0.smithi042.stdout:2/367: chown d7/l3d 47 1 2024-09-19T09:41:38.907 INFO:tasks.workunit.client.0.smithi042.stdout:2/368: fdatasync d7/f6a 0 2024-09-19T09:41:38.907 INFO:tasks.workunit.client.0.smithi042.stdout:2/369: chown d7/dd/d22/d30 0 1 2024-09-19T09:41:38.907 INFO:tasks.workunit.client.0.smithi042.stdout:2/370: fdatasync d7/dd/f59 0 2024-09-19T09:41:38.907 INFO:tasks.workunit.client.0.smithi042.stdout:0/369: mknod d2/d10/d12/d19/d5a/c79 0 2024-09-19T09:41:38.907 INFO:tasks.workunit.client.0.smithi042.stdout:0/370: chown d2/d10/d1d/d34/f4a 204942 1 2024-09-19T09:41:38.908 INFO:tasks.workunit.client.0.smithi042.stdout:3/377: creat d4/d8/d9/d12/f7a x:0 0 0 2024-09-19T09:41:38.913 INFO:tasks.workunit.client.0.smithi042.stdout:8/367: creat d1/da/d32/d3d/f6c x:0 0 0 2024-09-19T09:41:38.916 INFO:tasks.workunit.client.0.smithi042.stdout:3/378: creat d4/d8/d4c/f7b x:0 0 0 2024-09-19T09:41:38.916 INFO:tasks.workunit.client.0.smithi042.stdout:3/379: dread - d4/d8/d9/d12/f6c zero size 2024-09-19T09:41:38.919 INFO:tasks.workunit.client.0.smithi042.stdout:6/379: dwrite d1/de/d12/d22/f2a [0,4194304] 0 2024-09-19T09:41:38.920 INFO:tasks.workunit.client.0.smithi042.stdout:2/371: unlink f2 0 2024-09-19T09:41:38.920 INFO:tasks.workunit.client.0.smithi042.stdout:2/372: chown d7/f9 6816667 1 2024-09-19T09:41:38.920 INFO:tasks.workunit.client.0.smithi042.stdout:6/380: read d1/d20/f62 [207897,46330] 0 2024-09-19T09:41:38.921 INFO:tasks.workunit.client.0.smithi042.stdout:0/371: truncate d2/d10/f1b 3374644 0 2024-09-19T09:41:38.921 INFO:tasks.workunit.client.0.smithi042.stdout:0/372: write d2/d10/d1e/f6f [919292,92205] 0 2024-09-19T09:41:38.922 INFO:tasks.workunit.client.0.smithi042.stdout:0/373: readlink d2/d10/d12/d16/d18/d52/l5d 0 2024-09-19T09:41:38.922 INFO:tasks.workunit.client.0.smithi042.stdout:0/374: write d2/d10/d12/d2e/f46 [4347508,79545] 0 2024-09-19T09:41:38.924 INFO:tasks.workunit.client.0.smithi042.stdout:0/375: symlink d2/d10/l7a 0 2024-09-19T09:41:38.924 INFO:tasks.workunit.client.0.smithi042.stdout:2/373: dread d7/dd/f16 [0,4194304] 0 2024-09-19T09:41:38.924 INFO:tasks.workunit.client.0.smithi042.stdout:2/374: fdatasync d7/dd/d14/f25 0 2024-09-19T09:41:38.924 INFO:tasks.workunit.client.0.smithi042.stdout:0/376: readlink d2/d10/d12/d24/l61 0 2024-09-19T09:41:38.924 INFO:tasks.workunit.client.0.smithi042.stdout:0/377: chown d2/d10/d12/d16 486 1 2024-09-19T09:41:38.925 INFO:tasks.workunit.client.0.smithi042.stdout:2/375: truncate d7/dd/f16 209410 0 2024-09-19T09:41:38.926 INFO:tasks.workunit.client.0.smithi042.stdout:0/378: mknod d2/d10/d12/d24/d5b/c7b 0 2024-09-19T09:41:38.927 INFO:tasks.workunit.client.0.smithi042.stdout:0/379: chown d2/d10/l26 749 1 2024-09-19T09:41:38.927 INFO:tasks.workunit.client.0.smithi042.stdout:0/380: chown d2/d10/d12/d2e/d32/d64/l65 33964 1 2024-09-19T09:41:38.927 INFO:tasks.workunit.client.0.smithi042.stdout:0/381: truncate d2/d10/d12/d19/f69 630526 0 2024-09-19T09:41:38.927 INFO:tasks.workunit.client.0.smithi042.stdout:1/407: dwrite d4/d15/d19/d42/d51/f81 [0,4194304] 0 2024-09-19T09:41:38.929 INFO:tasks.workunit.client.0.smithi042.stdout:0/382: mknod d2/d10/d12/d16/d57/c7c 0 2024-09-19T09:41:38.929 INFO:tasks.workunit.client.0.smithi042.stdout:0/383: dread - d2/d10/d12/d16/d51/f76 zero size 2024-09-19T09:41:38.942 INFO:tasks.workunit.client.0.smithi042.stdout:1/408: dread d4/d15/d19/f1a [0,4194304] 0 2024-09-19T09:41:38.943 INFO:tasks.workunit.client.0.smithi042.stdout:1/409: fdatasync d4/d1e/d25/d35/f72 0 2024-09-19T09:41:38.943 INFO:tasks.workunit.client.0.smithi042.stdout:1/410: fdatasync d4/d1e/d25/f46 0 2024-09-19T09:41:38.943 INFO:tasks.workunit.client.0.smithi042.stdout:1/411: mknod d4/d29/c8a 0 2024-09-19T09:41:38.944 INFO:tasks.workunit.client.0.smithi042.stdout:1/412: chown d4/d15/l3d 19113 1 2024-09-19T09:41:38.944 INFO:tasks.workunit.client.0.smithi042.stdout:6/381: dwrite d1/de/d12/f19 [0,4194304] 0 2024-09-19T09:41:38.944 INFO:tasks.workunit.client.0.smithi042.stdout:6/382: chown d1/de/d54 0 1 2024-09-19T09:41:38.944 INFO:tasks.workunit.client.0.smithi042.stdout:1/413: write d4/d4e/f55 [453307,111686] 0 2024-09-19T09:41:38.944 INFO:tasks.workunit.client.0.smithi042.stdout:1/414: chown d4/d15/d2e/l7d 2781 1 2024-09-19T09:41:38.949 INFO:tasks.workunit.client.0.smithi042.stdout:1/415: dread d4/d12/f2d [0,4194304] 0 2024-09-19T09:41:38.949 INFO:tasks.workunit.client.0.smithi042.stdout:1/416: rmdir d4/d15/d19/d42 39 2024-09-19T09:41:38.955 INFO:tasks.workunit.client.0.smithi042.stdout:1/417: dread d4/d15/d19/f9 [0,4194304] 0 2024-09-19T09:41:38.956 INFO:tasks.workunit.client.0.smithi042.stdout:1/418: mknod d4/d15/d19/d45/d82/d89/c8b 0 2024-09-19T09:41:38.956 INFO:tasks.workunit.client.0.smithi042.stdout:1/419: dread - d4/d1e/d25/d35/f72 zero size 2024-09-19T09:41:38.959 INFO:tasks.workunit.client.0.smithi042.stdout:3/380: dwrite d4/d8/d9/d1b/d4f/f70 [0,4194304] 0 2024-09-19T09:41:38.960 INFO:tasks.workunit.client.0.smithi042.stdout:8/368: dwrite d1/da/dd/f16 [0,4194304] 0 2024-09-19T09:41:38.960 INFO:tasks.workunit.client.0.smithi042.stdout:8/369: chown d1/da/d32/d41/d55 489774043 1 2024-09-19T09:41:38.960 INFO:tasks.workunit.client.0.smithi042.stdout:2/376: dwrite d7/dd/d14/d35/d4c/d61/f74 [0,4194304] 0 2024-09-19T09:41:38.960 INFO:tasks.workunit.client.0.smithi042.stdout:2/377: write d7/dd/f6e [1011133,10191] 0 2024-09-19T09:41:38.960 INFO:tasks.workunit.client.0.smithi042.stdout:3/381: mknod d4/d8/d9/dc/c7c 0 2024-09-19T09:41:38.962 INFO:tasks.workunit.client.0.smithi042.stdout:8/370: creat d1/da/dd/d69/f6d x:0 0 0 2024-09-19T09:41:38.962 INFO:tasks.workunit.client.0.smithi042.stdout:2/378: link d7/dd/d1f/d3f/f5c d7/dd/d14/d35/d4c/f76 0 2024-09-19T09:41:38.962 INFO:tasks.workunit.client.0.smithi042.stdout:2/379: truncate d7/dd/f16 1186105 0 2024-09-19T09:41:38.963 INFO:tasks.workunit.client.0.smithi042.stdout:8/371: rmdir d1/da 39 2024-09-19T09:41:38.963 INFO:tasks.workunit.client.0.smithi042.stdout:8/372: chown d1/da/d32/d3d/f44 25 1 2024-09-19T09:41:38.963 INFO:tasks.workunit.client.0.smithi042.stdout:8/373: fdatasync d1/da/d14/f1a 0 2024-09-19T09:41:38.963 INFO:tasks.workunit.client.0.smithi042.stdout:8/374: write d1/da/d32/f54 [948656,47747] 0 2024-09-19T09:41:38.963 INFO:tasks.workunit.client.0.smithi042.stdout:1/420: dread d4/d15/d19/fc [0,4194304] 0 2024-09-19T09:41:38.963 INFO:tasks.workunit.client.0.smithi042.stdout:1/421: chown d4/d15/d19/ff 28195 1 2024-09-19T09:41:38.964 INFO:tasks.workunit.client.0.smithi042.stdout:8/375: write d1/da/d3f/f50 [396672,105330] 0 2024-09-19T09:41:38.964 INFO:tasks.workunit.client.0.smithi042.stdout:1/422: dread d4/d1e/d25/d35/d3c/f59 [0,4194304] 0 2024-09-19T09:41:38.964 INFO:tasks.workunit.client.0.smithi042.stdout:1/423: fsync d4/d1e/d25/d35/f5a 0 2024-09-19T09:41:38.964 INFO:tasks.workunit.client.0.smithi042.stdout:8/376: stat d1/c34 0 2024-09-19T09:41:38.965 INFO:tasks.workunit.client.0.smithi042.stdout:1/424: creat d4/d15/d2e/f8c x:0 0 0 2024-09-19T09:41:38.965 INFO:tasks.workunit.client.0.smithi042.stdout:4/399: sync 2024-09-19T09:41:38.966 INFO:tasks.workunit.client.0.smithi042.stdout:9/291: sync 2024-09-19T09:41:38.966 INFO:tasks.workunit.client.0.smithi042.stdout:5/324: sync 2024-09-19T09:41:38.966 INFO:tasks.workunit.client.0.smithi042.stdout:9/292: getdents d8/db 0 2024-09-19T09:41:38.966 INFO:tasks.workunit.client.0.smithi042.stdout:8/377: dread - d1/da/dd/f3a zero size 2024-09-19T09:41:38.966 INFO:tasks.workunit.client.0.smithi042.stdout:8/378: truncate d1/d2e/f60 709906 0 2024-09-19T09:41:38.966 INFO:tasks.workunit.client.0.smithi042.stdout:8/379: write d1/f26 [5091869,92265] 0 2024-09-19T09:41:38.967 INFO:tasks.workunit.client.0.smithi042.stdout:4/400: truncate d0/fe 3630058 0 2024-09-19T09:41:38.967 INFO:tasks.workunit.client.0.smithi042.stdout:4/401: chown d0/d1b/f2b 3525890 1 2024-09-19T09:41:38.967 INFO:tasks.workunit.client.0.smithi042.stdout:5/325: getdents d2/d4/d20 0 2024-09-19T09:41:38.968 INFO:tasks.workunit.client.0.smithi042.stdout:8/380: rename d1/l6a to d1/da/d32/d41/l6e 0 2024-09-19T09:41:38.968 INFO:tasks.workunit.client.0.smithi042.stdout:4/402: creat d0/d1b/d1c/d61/d7f/f89 x:0 0 0 2024-09-19T09:41:38.969 INFO:tasks.workunit.client.0.smithi042.stdout:5/326: mknod d2/db/d3c/c6d 0 2024-09-19T09:41:38.970 INFO:tasks.workunit.client.0.smithi042.stdout:8/381: creat d1/da/d3f/f6f x:0 0 0 2024-09-19T09:41:38.971 INFO:tasks.workunit.client.0.smithi042.stdout:4/403: creat d0/d1b/d1c/d61/d7f/f8a x:0 0 0 2024-09-19T09:41:38.972 INFO:tasks.workunit.client.0.smithi042.stdout:4/404: readlink d0/d28/d36/l3e 0 2024-09-19T09:41:38.973 INFO:tasks.workunit.client.0.smithi042.stdout:5/327: link d2/db/f30 d2/db/d3c/f6e 0 2024-09-19T09:41:38.974 INFO:tasks.workunit.client.0.smithi042.stdout:8/382: truncate d1/f9 3451032 0 2024-09-19T09:41:38.974 INFO:tasks.workunit.client.0.smithi042.stdout:4/405: truncate d0/f16 2155707 0 2024-09-19T09:41:38.974 INFO:tasks.workunit.client.0.smithi042.stdout:4/406: readlink d0/d1b/l33 0 2024-09-19T09:41:38.975 INFO:tasks.workunit.client.0.smithi042.stdout:5/328: symlink d2/d4/d2e/d5d/l6f 0 2024-09-19T09:41:38.978 INFO:tasks.workunit.client.0.smithi042.stdout:8/383: rename d1/da/d32/d41/f4e to d1/da/dd/f70 0 2024-09-19T09:41:38.979 INFO:tasks.workunit.client.0.smithi042.stdout:5/329: mknod d2/db/c70 0 2024-09-19T09:41:38.979 INFO:tasks.workunit.client.0.smithi042.stdout:5/330: chown d2/d25/c61 58222 1 2024-09-19T09:41:38.983 INFO:tasks.workunit.client.0.smithi042.stdout:5/331: rename d2/db/d3c/l58 to d2/d4/d20/d60/l71 0 2024-09-19T09:41:38.984 INFO:tasks.workunit.client.0.smithi042.stdout:8/384: symlink d1/da/d14/l71 0 2024-09-19T09:41:38.986 INFO:tasks.workunit.client.0.smithi042.stdout:4/407: dread d0/d1b/f1e [0,4194304] 0 2024-09-19T09:41:38.988 INFO:tasks.workunit.client.0.smithi042.stdout:4/408: mknod d0/d1b/d1c/d2e/d44/c8b 0 2024-09-19T09:41:38.988 INFO:tasks.workunit.client.0.smithi042.stdout:4/409: readlink d0/d1b/d1c/l78 0 2024-09-19T09:41:38.990 INFO:tasks.workunit.client.0.smithi042.stdout:4/410: creat d0/d1b/d56/d86/f8c x:0 0 0 2024-09-19T09:41:38.990 INFO:tasks.workunit.client.0.smithi042.stdout:4/411: readlink d0/d1b/d1c/d2e/d3f/d6e/l77 0 2024-09-19T09:41:38.991 INFO:tasks.workunit.client.0.smithi042.stdout:4/412: getdents d0/d1b/d1c/d61/d7f 0 2024-09-19T09:41:38.993 INFO:tasks.workunit.client.0.smithi042.stdout:2/380: dwrite d7/dd/d22/d30/f34 [0,4194304] 0 2024-09-19T09:41:38.993 INFO:tasks.workunit.client.0.smithi042.stdout:2/381: write d7/dd/d22/f4a [710804,20348] 0 2024-09-19T09:41:38.993 INFO:tasks.workunit.client.0.smithi042.stdout:4/413: dread - d0/f71 zero size 2024-09-19T09:41:38.996 INFO:tasks.workunit.client.0.smithi042.stdout:2/382: mknod d7/dd/d22/d30/c77 0 2024-09-19T09:41:38.996 INFO:tasks.workunit.client.0.smithi042.stdout:2/383: fsync d7/dd/d1f/f21 0 2024-09-19T09:41:38.996 INFO:tasks.workunit.client.0.smithi042.stdout:2/384: write d7/dd/d1f/d3f/f69 [1665157,22174] 0 2024-09-19T09:41:38.996 INFO:tasks.workunit.client.0.smithi042.stdout:2/385: write d7/dd/d14/f1d [1072004,31846] 0 2024-09-19T09:41:38.996 INFO:tasks.workunit.client.0.smithi042.stdout:5/332: rename d2/d4/d2e/d5d to d2/d4/d20/d60/d72 0 2024-09-19T09:41:38.996 INFO:tasks.workunit.client.0.smithi042.stdout:1/425: dwrite d4/f47 [0,4194304] 0 2024-09-19T09:41:38.997 INFO:tasks.workunit.client.0.smithi042.stdout:1/426: write d4/d1e/d25/d35/d3c/f59 [87999,76416] 0 2024-09-19T09:41:38.998 INFO:tasks.workunit.client.0.smithi042.stdout:3/382: dwrite d4/f74 [0,4194304] 0 2024-09-19T09:41:38.998 INFO:tasks.workunit.client.0.smithi042.stdout:2/386: rename d7/dd/f6e to d7/dd/d1f/d3f/f78 0 2024-09-19T09:41:39.000 INFO:tasks.workunit.client.0.smithi042.stdout:2/387: mkdir d7/dd/d14/d35/d45/d5e/d79 0 2024-09-19T09:41:39.000 INFO:tasks.workunit.client.0.smithi042.stdout:5/333: creat d2/d4/d64/d6a/f73 x:0 0 0 2024-09-19T09:41:39.001 INFO:tasks.workunit.client.0.smithi042.stdout:9/293: dwrite d8/da/f10 [0,4194304] 0 2024-09-19T09:41:39.001 INFO:tasks.workunit.client.0.smithi042.stdout:2/388: creat d7/dd/d14/d35/d4c/d70/f7a x:0 0 0 2024-09-19T09:41:39.002 INFO:tasks.workunit.client.0.smithi042.stdout:1/427: mkdir d4/d12/d8d 0 2024-09-19T09:41:39.004 INFO:tasks.workunit.client.0.smithi042.stdout:2/389: link d7/dd/f12 d7/dd/d14/d35/d45/f7b 0 2024-09-19T09:41:39.007 INFO:tasks.workunit.client.0.smithi042.stdout:8/385: dwrite d1/da/d3f/f50 [0,4194304] 0 2024-09-19T09:41:39.007 INFO:tasks.workunit.client.0.smithi042.stdout:8/386: truncate d1/da/f5f 183407 0 2024-09-19T09:41:39.007 INFO:tasks.workunit.client.0.smithi042.stdout:8/387: fsync d1/f26 0 2024-09-19T09:41:39.007 INFO:tasks.workunit.client.0.smithi042.stdout:5/334: mknod d2/db/d42/c74 0 2024-09-19T09:41:39.016 INFO:tasks.workunit.client.0.smithi042.stdout:3/383: dwrite d4/d8/d9/dc/d26/d35/f44 [0,4194304] 0 2024-09-19T09:41:39.016 INFO:tasks.workunit.client.0.smithi042.stdout:3/384: write d4/d8/d9/d1b/f63 [3699979,120308] 0 2024-09-19T09:41:39.016 INFO:tasks.workunit.client.0.smithi042.stdout:3/385: chown d4/d2a/d76 1713506440 1 2024-09-19T09:41:39.016 INFO:tasks.workunit.client.0.smithi042.stdout:1/428: creat d4/d1e/f8e x:0 0 0 2024-09-19T09:41:39.017 INFO:tasks.workunit.client.0.smithi042.stdout:9/294: unlink d8/f2c 0 2024-09-19T09:41:39.018 INFO:tasks.workunit.client.0.smithi042.stdout:1/429: mknod d4/d15/d19/d42/d51/d79/c8f 0 2024-09-19T09:41:39.019 INFO:tasks.workunit.client.0.smithi042.stdout:1/430: write d4/f22 [449602,26771] 0 2024-09-19T09:41:39.020 INFO:tasks.workunit.client.0.smithi042.stdout:9/295: unlink d8/da/d19/f2a 0 2024-09-19T09:41:39.020 INFO:tasks.workunit.client.0.smithi042.stdout:1/431: truncate d4/f13 1977028 0 2024-09-19T09:41:39.021 INFO:tasks.workunit.client.0.smithi042.stdout:1/432: chown d4/d1e/d25/d35/c58 228976 1 2024-09-19T09:41:39.021 INFO:tasks.workunit.client.0.smithi042.stdout:9/296: getdents d8/d1d 0 2024-09-19T09:41:39.021 INFO:tasks.workunit.client.0.smithi042.stdout:9/297: fdatasync d8/f3d 0 2024-09-19T09:41:39.021 INFO:tasks.workunit.client.0.smithi042.stdout:9/298: write d8/da/f50 [563343,89337] 0 2024-09-19T09:41:39.022 INFO:tasks.workunit.client.0.smithi042.stdout:1/433: symlink d4/d1d/d20/d7f/l90 0 2024-09-19T09:41:39.024 INFO:tasks.workunit.client.0.smithi042.stdout:7/354: sync 2024-09-19T09:41:39.024 INFO:tasks.workunit.client.0.smithi042.stdout:7/355: getdents d0/d14/d3a 0 2024-09-19T09:41:39.026 INFO:tasks.workunit.client.0.smithi042.stdout:7/356: mknod d0/d14/d5d/c73 0 2024-09-19T09:41:39.026 INFO:tasks.workunit.client.0.smithi042.stdout:7/357: truncate d0/f23 757636 0 2024-09-19T09:41:39.027 INFO:tasks.workunit.client.0.smithi042.stdout:8/388: dwrite d1/da/d32/d41/d55/f6b [0,4194304] 0 2024-09-19T09:41:39.027 INFO:tasks.workunit.client.0.smithi042.stdout:8/389: chown d1/da/d14/l19 767824 1 2024-09-19T09:41:39.028 INFO:tasks.workunit.client.0.smithi042.stdout:1/434: read d4/d15/d44/f71 [5845121,77704] 0 2024-09-19T09:41:39.028 INFO:tasks.workunit.client.0.smithi042.stdout:1/435: write d4/d15/d2e/f8c [841824,33530] 0 2024-09-19T09:41:39.028 INFO:tasks.workunit.client.0.smithi042.stdout:7/358: creat d0/d3d/d55/f74 x:0 0 0 2024-09-19T09:41:39.028 INFO:tasks.workunit.client.0.smithi042.stdout:1/436: fsync d4/d15/f17 0 2024-09-19T09:41:39.028 INFO:tasks.workunit.client.0.smithi042.stdout:1/437: fsync d4/d15/f21 0 2024-09-19T09:41:39.028 INFO:tasks.workunit.client.0.smithi042.stdout:7/359: write d0/d40/f39 [7978,126014] 0 2024-09-19T09:41:39.033 INFO:tasks.workunit.client.0.smithi042.stdout:7/360: mknod d0/d3d/d55/c75 0 2024-09-19T09:41:39.034 INFO:tasks.workunit.client.0.smithi042.stdout:7/361: mknod d0/d3d/c76 0 2024-09-19T09:41:39.036 INFO:tasks.workunit.client.0.smithi042.stdout:1/438: rename d4/d1d/d20 to d4/d12/d8d/d91 0 2024-09-19T09:41:39.037 INFO:tasks.workunit.client.0.smithi042.stdout:1/439: unlink d4/d15/d19/ff 0 2024-09-19T09:41:39.037 INFO:tasks.workunit.client.0.smithi042.stdout:1/440: write d4/d29/f4a [770700,78294] 0 2024-09-19T09:41:39.039 INFO:tasks.workunit.client.0.smithi042.stdout:1/441: rename d4/d15/l53 to d4/d29/d3e/l92 0 2024-09-19T09:41:39.040 INFO:tasks.workunit.client.0.smithi042.stdout:1/442: dread d4/d29/f38 [0,4194304] 0 2024-09-19T09:41:39.047 INFO:tasks.workunit.client.0.smithi042.stdout:1/443: write d4/d1e/d25/d35/f75 [228500,109604] 0 2024-09-19T09:41:39.047 INFO:tasks.workunit.client.0.smithi042.stdout:1/444: write d4/f10 [7031029,91007] 0 2024-09-19T09:41:39.047 INFO:tasks.workunit.client.0.smithi042.stdout:1/445: dread - d4/d1e/d25/d35/f72 zero size 2024-09-19T09:41:39.051 INFO:tasks.workunit.client.0.smithi042.stdout:5/335: dwrite d2/d4/d2e/d57/f23 [0,4194304] 0 2024-09-19T09:41:39.052 INFO:tasks.workunit.client.0.smithi042.stdout:5/336: mkdir d2/d4/d20/d60/d72/d75 0 2024-09-19T09:41:39.053 INFO:tasks.workunit.client.0.smithi042.stdout:9/299: dwrite d8/da/d19/f1b [0,4194304] 0 2024-09-19T09:41:39.054 INFO:tasks.workunit.client.0.smithi042.stdout:9/300: readlink d8/da/d19/d1c/l23 0 2024-09-19T09:41:39.054 INFO:tasks.workunit.client.0.smithi042.stdout:9/301: mknod d8/db/d31/d39/c59 0 2024-09-19T09:41:39.067 INFO:tasks.workunit.client.0.smithi042.stdout:3/386: dwrite d4/d8/d4c/f71 [0,4194304] 0 2024-09-19T09:41:39.070 INFO:tasks.workunit.client.0.smithi042.stdout:3/387: mkdir d4/d8/d9/d39/d4b/d7d 0 2024-09-19T09:41:39.072 INFO:tasks.workunit.client.0.smithi042.stdout:3/388: creat d4/d8/d9/d39/d4b/f7e x:0 0 0 2024-09-19T09:41:39.072 INFO:tasks.workunit.client.0.smithi042.stdout:3/389: readlink l3 0 2024-09-19T09:41:39.072 INFO:tasks.workunit.client.0.smithi042.stdout:3/390: chown d4/d8/f36 149 1 2024-09-19T09:41:39.073 INFO:tasks.workunit.client.0.smithi042.stdout:3/391: creat d4/d8/d9/dc/d26/d5c/f7f x:0 0 0 2024-09-19T09:41:39.077 INFO:tasks.workunit.client.0.smithi042.stdout:7/362: dwrite d0/f1a [0,4194304] 0 2024-09-19T09:41:39.077 INFO:tasks.workunit.client.0.smithi042.stdout:7/363: dread - d0/d3d/d55/f71 zero size 2024-09-19T09:41:39.077 INFO:tasks.workunit.client.0.smithi042.stdout:7/364: chown d0/d14/d3c/c51 2 1 2024-09-19T09:41:39.078 INFO:tasks.workunit.client.0.smithi042.stdout:7/365: mknod d0/d3d/d55/c77 0 2024-09-19T09:41:39.079 INFO:tasks.workunit.client.0.smithi042.stdout:7/366: readlink d0/d40/l48 0 2024-09-19T09:41:39.080 INFO:tasks.workunit.client.0.smithi042.stdout:7/367: unlink d0/c2c 0 2024-09-19T09:41:39.080 INFO:tasks.workunit.client.0.smithi042.stdout:7/368: fsync d0/d40/f39 0 2024-09-19T09:41:39.082 INFO:tasks.workunit.client.0.smithi042.stdout:7/369: mkdir d0/d3d/d55/d78 0 2024-09-19T09:41:39.086 INFO:tasks.workunit.client.0.smithi042.stdout:7/370: creat d0/d14/d44/f79 x:0 0 0 2024-09-19T09:41:39.086 INFO:tasks.workunit.client.0.smithi042.stdout:7/371: fsync d0/f38 0 2024-09-19T09:41:39.086 INFO:tasks.workunit.client.0.smithi042.stdout:7/372: stat d0/d14/f2a 0 2024-09-19T09:41:39.086 INFO:tasks.workunit.client.0.smithi042.stdout:7/373: read - d0/d3d/d55/f71 zero size 2024-09-19T09:41:39.087 INFO:tasks.workunit.client.0.smithi042.stdout:8/390: dwrite d1/da/d32/f54 [0,4194304] 0 2024-09-19T09:41:39.087 INFO:tasks.workunit.client.0.smithi042.stdout:7/374: mknod d0/d3d/d55/d72/c7a 0 2024-09-19T09:41:39.087 INFO:tasks.workunit.client.0.smithi042.stdout:7/375: write d0/d3d/f5a [868910,35952] 0 2024-09-19T09:41:39.089 INFO:tasks.workunit.client.0.smithi042.stdout:8/391: mkdir d1/d72 0 2024-09-19T09:41:39.090 INFO:tasks.workunit.client.0.smithi042.stdout:9/302: dwrite d8/f3d [0,4194304] 0 2024-09-19T09:41:39.091 INFO:tasks.workunit.client.0.smithi042.stdout:7/376: rename d0/c9 to d0/d14/c7b 0 2024-09-19T09:41:39.093 INFO:tasks.workunit.client.0.smithi042.stdout:9/303: creat d8/da/d51/f5a x:0 0 0 2024-09-19T09:41:39.094 INFO:tasks.workunit.client.0.smithi042.stdout:9/304: creat d8/da/d19/d1c/d4a/f5b x:0 0 0 2024-09-19T09:41:39.095 INFO:tasks.workunit.client.0.smithi042.stdout:9/305: mknod d8/da/c5c 0 2024-09-19T09:41:39.095 INFO:tasks.workunit.client.0.smithi042.stdout:9/306: write d8/d1d/f4b [123808,125046] 0 2024-09-19T09:41:39.098 INFO:tasks.workunit.client.0.smithi042.stdout:5/337: dwrite d2/d4/f67 [0,4194304] 0 2024-09-19T09:41:39.101 INFO:tasks.workunit.client.0.smithi042.stdout:1/446: dwrite d4/f22 [0,4194304] 0 2024-09-19T09:41:39.106 INFO:tasks.workunit.client.0.smithi042.stdout:9/307: getdents d8/da 0 2024-09-19T09:41:39.108 INFO:tasks.workunit.client.0.smithi042.stdout:3/392: dwrite d4/d8/d9/dc/f59 [0,4194304] 0 2024-09-19T09:41:39.108 INFO:tasks.workunit.client.0.smithi042.stdout:7/377: dread d0/d14/d3a/f3e [0,4194304] 0 2024-09-19T09:41:39.108 INFO:tasks.workunit.client.0.smithi042.stdout:3/393: fsync d4/d2a/f4e 0 2024-09-19T09:41:39.111 INFO:tasks.workunit.client.0.smithi042.stdout:8/392: dwrite d1/da/f21 [4194304,4194304] 0 2024-09-19T09:41:39.111 INFO:tasks.workunit.client.0.smithi042.stdout:9/308: symlink d8/da/d19/d1c/d4a/l5d 0 2024-09-19T09:41:39.111 INFO:tasks.workunit.client.0.smithi042.stdout:9/309: write d8/d1d/f1f [4833683,100532] 0 2024-09-19T09:41:39.111 INFO:tasks.workunit.client.0.smithi042.stdout:9/310: dread - d8/d32/f58 zero size 2024-09-19T09:41:39.111 INFO:tasks.workunit.client.0.smithi042.stdout:9/311: write d8/db/f26 [1199664,24879] 0 2024-09-19T09:41:39.112 INFO:tasks.workunit.client.0.smithi042.stdout:7/378: creat d0/f7c x:0 0 0 2024-09-19T09:41:39.113 INFO:tasks.workunit.client.0.smithi042.stdout:3/394: creat d4/d8/d9/d39/d4b/f80 x:0 0 0 2024-09-19T09:41:39.114 INFO:tasks.workunit.client.0.smithi042.stdout:3/395: chown d4/d8/d9/d39 690 1 2024-09-19T09:41:39.114 INFO:tasks.workunit.client.0.smithi042.stdout:3/396: write d4/d8/d9/d12/f6c [178432,11044] 0 2024-09-19T09:41:39.115 INFO:tasks.workunit.client.0.smithi042.stdout:8/393: rmdir d1/da/d32/d3d 39 2024-09-19T09:41:39.115 INFO:tasks.workunit.client.0.smithi042.stdout:8/394: fsync d1/da/dd/f3a 0 2024-09-19T09:41:39.115 INFO:tasks.workunit.client.0.smithi042.stdout:8/395: dread - d1/da/d32/d3d/f6c zero size 2024-09-19T09:41:39.116 INFO:tasks.workunit.client.0.smithi042.stdout:9/312: creat d8/da/d19/d1c/f5e x:0 0 0 2024-09-19T09:41:39.117 INFO:tasks.workunit.client.0.smithi042.stdout:3/397: creat d4/d8/d4c/f81 x:0 0 0 2024-09-19T09:41:39.118 INFO:tasks.workunit.client.0.smithi042.stdout:1/447: dwrite d4/d15/d19/fc [0,4194304] 0 2024-09-19T09:41:39.119 INFO:tasks.workunit.client.0.smithi042.stdout:7/379: dread d0/f35 [0,4194304] 0 2024-09-19T09:41:39.119 INFO:tasks.workunit.client.0.smithi042.stdout:7/380: write d0/f35 [3289028,88115] 0 2024-09-19T09:41:39.125 INFO:tasks.workunit.client.0.smithi042.stdout:8/396: link d1/f9 d1/da/dd/d69/f73 0 2024-09-19T09:41:39.125 INFO:tasks.workunit.client.0.smithi042.stdout:5/338: truncate d2/d4/f67 892154 0 2024-09-19T09:41:39.125 INFO:tasks.workunit.client.0.smithi042.stdout:8/397: dread - d1/da/dd/f3a zero size 2024-09-19T09:41:39.125 INFO:tasks.workunit.client.0.smithi042.stdout:0/384: sync 2024-09-19T09:41:39.125 INFO:tasks.workunit.client.0.smithi042.stdout:1/448: write d4/f7b [953695,87325] 0 2024-09-19T09:41:39.126 INFO:tasks.workunit.client.0.smithi042.stdout:1/449: write d4/d1e/d25/f33 [895600,114949] 0 2024-09-19T09:41:39.126 INFO:tasks.workunit.client.0.smithi042.stdout:1/450: readlink d4/d12/d8d/d91/d7f/l90 0 2024-09-19T09:41:39.126 INFO:tasks.workunit.client.0.smithi042.stdout:7/381: rmdir d0/d40 39 2024-09-19T09:41:39.126 INFO:tasks.workunit.client.0.smithi042.stdout:1/451: write d4/d4e/f55 [46081,105191] 0 2024-09-19T09:41:39.127 INFO:tasks.workunit.client.0.smithi042.stdout:7/382: symlink d0/d56/d5c/l7d 0 2024-09-19T09:41:39.127 INFO:tasks.workunit.client.0.smithi042.stdout:6/383: sync 2024-09-19T09:41:39.128 INFO:tasks.workunit.client.0.smithi042.stdout:0/385: truncate d2/d10/d12/f31 535024 0 2024-09-19T09:41:39.130 INFO:tasks.workunit.client.0.smithi042.stdout:6/384: rmdir d1/de/d5d 39 2024-09-19T09:41:39.130 INFO:tasks.workunit.client.0.smithi042.stdout:7/383: creat d0/d14/d3a/f7e x:0 0 0 2024-09-19T09:41:39.130 INFO:tasks.workunit.client.0.smithi042.stdout:0/386: getdents d2/d10/d12/d19 0 2024-09-19T09:41:39.130 INFO:tasks.workunit.client.0.smithi042.stdout:0/387: chown d2/d10/d12/d19/c3d 116 1 2024-09-19T09:41:39.131 INFO:tasks.workunit.client.0.smithi042.stdout:6/385: mkdir d1/d20/d69 0 2024-09-19T09:41:39.131 INFO:tasks.workunit.client.0.smithi042.stdout:6/386: chown d1/d20/f56 304 1 2024-09-19T09:41:39.133 INFO:tasks.workunit.client.0.smithi042.stdout:6/387: rename d1/d20/d32 to d1/d20/d6a 0 2024-09-19T09:41:39.134 INFO:tasks.workunit.client.0.smithi042.stdout:5/339: write d2/d4/d2e/d57/f35 [738396,113352] 0 2024-09-19T09:41:39.134 INFO:tasks.workunit.client.0.smithi042.stdout:7/384: write d0/f59 [812502,32339] 0 2024-09-19T09:41:39.134 INFO:tasks.workunit.client.0.smithi042.stdout:1/452: dread d4/f22 [0,4194304] 0 2024-09-19T09:41:39.135 INFO:tasks.workunit.client.0.smithi042.stdout:5/340: creat d2/d4/d20/d31/f76 x:0 0 0 2024-09-19T09:41:39.138 INFO:tasks.workunit.client.0.smithi042.stdout:8/398: dread d1/da/dd/f5c [0,4194304] 0 2024-09-19T09:41:39.138 INFO:tasks.workunit.client.0.smithi042.stdout:8/399: read - d1/da/dd/d69/f6d zero size 2024-09-19T09:41:39.144 INFO:tasks.workunit.client.0.smithi042.stdout:5/341: dread d2/d4/d2e/d57/f1f [0,4194304] 0 2024-09-19T09:41:39.145 INFO:tasks.workunit.client.0.smithi042.stdout:0/388: dread d2/f1c [4194304,4194304] 0 2024-09-19T09:41:39.145 INFO:tasks.workunit.client.0.smithi042.stdout:0/389: stat d2/d10/d12/d2e/f70 0 2024-09-19T09:41:39.145 INFO:tasks.workunit.client.0.smithi042.stdout:1/453: link d4/d1e/d25/f46 d4/d15/d19/d45/f93 0 2024-09-19T09:41:39.146 INFO:tasks.workunit.client.0.smithi042.stdout:1/454: readlink d4/d12/l2c 0 2024-09-19T09:41:39.146 INFO:tasks.workunit.client.0.smithi042.stdout:7/385: unlink d0/d3d/f5a 0 2024-09-19T09:41:39.146 INFO:tasks.workunit.client.0.smithi042.stdout:1/455: creat d4/f94 x:0 0 0 2024-09-19T09:41:39.151 INFO:tasks.workunit.client.0.smithi042.stdout:5/342: dread d2/db/fe [0,4194304] 0 2024-09-19T09:41:39.155 INFO:tasks.workunit.client.0.smithi042.stdout:5/343: dread d2/f1e [0,4194304] 0 2024-09-19T09:41:39.155 INFO:tasks.workunit.client.0.smithi042.stdout:5/344: chown d2/d25/d4d/l19 29310978 1 2024-09-19T09:41:39.155 INFO:tasks.workunit.client.0.smithi042.stdout:3/398: dwrite d4/d8/d9/dc/d26/d5c/f7f [0,4194304] 0 2024-09-19T09:41:39.156 INFO:tasks.workunit.client.0.smithi042.stdout:1/456: dread d4/d1e/d25/f46 [0,4194304] 0 2024-09-19T09:41:39.156 INFO:tasks.workunit.client.0.smithi042.stdout:1/457: write d4/d15/f17 [2586750,31881] 0 2024-09-19T09:41:39.157 INFO:tasks.workunit.client.0.smithi042.stdout:6/388: dwrite d1/de/d12/d22/f25 [0,4194304] 0 2024-09-19T09:41:39.158 INFO:tasks.workunit.client.0.smithi042.stdout:3/399: unlink d4/d8/d9/d1b/c6f 0 2024-09-19T09:41:39.158 INFO:tasks.workunit.client.0.smithi042.stdout:7/386: write d0/f6 [5186251,22495] 0 2024-09-19T09:41:39.159 INFO:tasks.workunit.client.0.smithi042.stdout:6/389: symlink d1/de/d54/l6b 0 2024-09-19T09:41:39.159 INFO:tasks.workunit.client.0.smithi042.stdout:3/400: getdents d4/d8/d9/d1b/d4f 0 2024-09-19T09:41:39.161 INFO:tasks.workunit.client.0.smithi042.stdout:7/387: creat d0/d3d/d55/d78/f7f x:0 0 0 2024-09-19T09:41:39.163 INFO:tasks.workunit.client.0.smithi042.stdout:6/390: rename d1/d20/d6a/f58 to d1/d20/d45/d4a/f6c 0 2024-09-19T09:41:39.163 INFO:tasks.workunit.client.0.smithi042.stdout:8/400: dwrite d1/da/dd/d69/f6d [0,4194304] 0 2024-09-19T09:41:39.163 INFO:tasks.workunit.client.0.smithi042.stdout:8/401: dread - d1/da/d32/d3d/f6c zero size 2024-09-19T09:41:39.164 INFO:tasks.workunit.client.0.smithi042.stdout:7/388: link d0/d3d/f4b d0/d14/d3a/f80 0 2024-09-19T09:41:39.165 INFO:tasks.workunit.client.0.smithi042.stdout:2/390: sync 2024-09-19T09:41:39.165 INFO:tasks.workunit.client.0.smithi042.stdout:7/389: write d0/d3d/d55/d78/f7f [929111,92793] 0 2024-09-19T09:41:39.165 INFO:tasks.workunit.client.0.smithi042.stdout:4/414: sync 2024-09-19T09:41:39.165 INFO:tasks.workunit.client.0.smithi042.stdout:3/401: rename d4/d8/d9/d12 to d4/d8/d9/dc/d26/d5c/d82 0 2024-09-19T09:41:39.166 INFO:tasks.workunit.client.0.smithi042.stdout:1/458: dread d4/d15/d2e/f37 [0,4194304] 0 2024-09-19T09:41:39.167 INFO:tasks.workunit.client.0.smithi042.stdout:2/391: dread d7/dd/d14/f31 [0,4194304] 0 2024-09-19T09:41:39.167 INFO:tasks.workunit.client.0.smithi042.stdout:2/392: readlink d7/l50 0 2024-09-19T09:41:39.168 INFO:tasks.workunit.client.0.smithi042.stdout:7/390: creat d0/d14/d3a/f81 x:0 0 0 2024-09-19T09:41:39.169 INFO:tasks.workunit.client.0.smithi042.stdout:5/345: dread d2/d25/d4d/f1d [0,4194304] 0 2024-09-19T09:41:39.169 INFO:tasks.workunit.client.0.smithi042.stdout:5/346: write d2/d25/d37/f63 [127020,130942] 0 2024-09-19T09:41:39.169 INFO:tasks.workunit.client.0.smithi042.stdout:4/415: rename d0/d1b/d1c/d61/d7f/f89 to d0/d28/d87/f8d 0 2024-09-19T09:41:39.170 INFO:tasks.workunit.client.0.smithi042.stdout:3/402: getdents d4/d8/d9/dc 0 2024-09-19T09:41:39.170 INFO:tasks.workunit.client.0.smithi042.stdout:1/459: symlink d4/l95 0 2024-09-19T09:41:39.172 INFO:tasks.workunit.client.0.smithi042.stdout:2/393: rename d7/dd/d14/c2c to d7/dd/d14/d35/d4e/d63/c7c 0 2024-09-19T09:41:39.172 INFO:tasks.workunit.client.0.smithi042.stdout:8/402: mkdir d1/da/dd/d74 0 2024-09-19T09:41:39.172 INFO:tasks.workunit.client.0.smithi042.stdout:8/403: truncate d1/da/f5f 972053 0 2024-09-19T09:41:39.172 INFO:tasks.workunit.client.0.smithi042.stdout:2/394: creat d7/dd/d14/d35/f7d x:0 0 0 2024-09-19T09:41:39.173 INFO:tasks.workunit.client.0.smithi042.stdout:0/390: dwrite d2/d10/d12/d16/d18/d52/f55 [0,4194304] 0 2024-09-19T09:41:39.173 INFO:tasks.workunit.client.0.smithi042.stdout:0/391: dread - d2/d10/d1e/f6c zero size 2024-09-19T09:41:39.174 INFO:tasks.workunit.client.0.smithi042.stdout:5/347: symlink d2/db/d3c/l77 0 2024-09-19T09:41:39.174 INFO:tasks.workunit.client.0.smithi042.stdout:5/348: read d2/f1b [4110465,53098] 0 2024-09-19T09:41:39.174 INFO:tasks.workunit.client.0.smithi042.stdout:5/349: chown d2/d4/d2e/d57/l14 10 1 2024-09-19T09:41:39.174 INFO:tasks.workunit.client.0.smithi042.stdout:5/350: readlink d2/d25/d37/l4f 0 2024-09-19T09:41:39.174 INFO:tasks.workunit.client.0.smithi042.stdout:2/395: symlink d7/dd/d22/d30/d66/l7e 0 2024-09-19T09:41:39.175 INFO:tasks.workunit.client.0.smithi042.stdout:4/416: creat d0/d67/f8e x:0 0 0 2024-09-19T09:41:39.175 INFO:tasks.workunit.client.0.smithi042.stdout:2/396: creat d7/dd/d14/f7f x:0 0 0 2024-09-19T09:41:39.176 INFO:tasks.workunit.client.0.smithi042.stdout:1/460: symlink d4/d15/d2e/l96 0 2024-09-19T09:41:39.176 INFO:tasks.workunit.client.0.smithi042.stdout:2/397: rename d7/f1c to d7/dd/d14/d35/d4e/f80 0 2024-09-19T09:41:39.176 INFO:tasks.workunit.client.0.smithi042.stdout:2/398: read d7/dd/d14/d35/d4e/f80 [3154030,33763] 0 2024-09-19T09:41:39.177 INFO:tasks.workunit.client.0.smithi042.stdout:8/404: creat d1/da/d32/d41/f75 x:0 0 0 2024-09-19T09:41:39.177 INFO:tasks.workunit.client.0.smithi042.stdout:2/399: creat d7/dd/d14/d35/d4e/d63/f81 x:0 0 0 2024-09-19T09:41:39.178 INFO:tasks.workunit.client.0.smithi042.stdout:2/400: getdents d7/dd/d22/d30 0 2024-09-19T09:41:39.179 INFO:tasks.workunit.client.0.smithi042.stdout:2/401: write d7/dd/d14/f25 [2796907,18161] 0 2024-09-19T09:41:39.180 INFO:tasks.workunit.client.0.smithi042.stdout:4/417: truncate d0/d1b/d1c/d2e/d3f/d5a/f5b 4030162 0 2024-09-19T09:41:39.180 INFO:tasks.workunit.client.0.smithi042.stdout:4/418: fsync d0/d1b/d1c/d2e/d3b/f48 0 2024-09-19T09:41:39.181 INFO:tasks.workunit.client.0.smithi042.stdout:2/402: mknod d7/dd/d14/c82 0 2024-09-19T09:41:39.186 INFO:tasks.workunit.client.0.smithi042.stdout:4/419: truncate d0/d1b/d1c/d2e/d3b/f47 3118643 0 2024-09-19T09:41:39.189 INFO:tasks.workunit.client.0.smithi042.stdout:6/391: dwrite d1/f5e [0,4194304] 0 2024-09-19T09:41:39.189 INFO:tasks.workunit.client.0.smithi042.stdout:6/392: write d1/de/d12/d22/d34/d3f/f5c [982916,84380] 0 2024-09-19T09:41:39.194 INFO:tasks.workunit.client.0.smithi042.stdout:6/393: rmdir d1/de/d12/d1c/d4f 39 2024-09-19T09:41:39.195 INFO:tasks.workunit.client.0.smithi042.stdout:4/420: dread d0/d1b/d1c/f55 [0,4194304] 0 2024-09-19T09:41:39.196 INFO:tasks.workunit.client.0.smithi042.stdout:1/461: write f1 [2989400,56785] 0 2024-09-19T09:41:39.197 INFO:tasks.workunit.client.0.smithi042.stdout:4/421: mkdir d0/d1b/d1c/d2e/d3f/d6b/d8f 0 2024-09-19T09:41:39.197 INFO:tasks.workunit.client.0.smithi042.stdout:4/422: fdatasync d0/d1b/f32 0 2024-09-19T09:41:39.198 INFO:tasks.workunit.client.0.smithi042.stdout:1/462: creat d4/d1e/d25/d35/f97 x:0 0 0 2024-09-19T09:41:39.199 INFO:tasks.workunit.client.0.smithi042.stdout:4/423: creat d0/d1b/f90 x:0 0 0 2024-09-19T09:41:39.201 INFO:tasks.workunit.client.0.smithi042.stdout:1/463: rename d4/d15/d19/fc to d4/d1e/d25/d35/f98 0 2024-09-19T09:41:39.202 INFO:tasks.workunit.client.0.smithi042.stdout:4/424: mkdir d0/d28/d36/d91 0 2024-09-19T09:41:39.203 INFO:tasks.workunit.client.0.smithi042.stdout:1/464: write d4/d1d/f2b [1091153,53369] 0 2024-09-19T09:41:39.203 INFO:tasks.workunit.client.0.smithi042.stdout:1/465: write d4/d29/f4a [673175,84907] 0 2024-09-19T09:41:39.203 INFO:tasks.workunit.client.0.smithi042.stdout:1/466: chown d4/d15/d19/d42/d5b/l6f 13578866 1 2024-09-19T09:41:39.203 INFO:tasks.workunit.client.0.smithi042.stdout:1/467: write d4/d1e/d25/f28 [3289597,51118] 0 2024-09-19T09:41:39.204 INFO:tasks.workunit.client.0.smithi042.stdout:4/425: creat d0/f92 x:0 0 0 2024-09-19T09:41:39.204 INFO:tasks.workunit.client.0.smithi042.stdout:4/426: stat d0/d1b/d1c/d2e/d3f/d6b/d8f 0 2024-09-19T09:41:39.205 INFO:tasks.workunit.client.0.smithi042.stdout:4/427: getdents d0/d1b/d1c/d2e/d44 0 2024-09-19T09:41:39.205 INFO:tasks.workunit.client.0.smithi042.stdout:4/428: readlink d0/d1b/d1c/d2e/d44/l72 0 2024-09-19T09:41:39.205 INFO:tasks.workunit.client.0.smithi042.stdout:4/429: symlink d0/d28/d70/l93 0 2024-09-19T09:41:39.205 INFO:tasks.workunit.client.0.smithi042.stdout:7/391: dwrite d0/d40/f65 [0,4194304] 0 2024-09-19T09:41:39.206 INFO:tasks.workunit.client.0.smithi042.stdout:4/430: mkdir d0/d1b/d1c/d94 0 2024-09-19T09:41:39.206 INFO:tasks.workunit.client.0.smithi042.stdout:3/403: dwrite d4/d8/d9/d39/d4b/f7e [0,4194304] 0 2024-09-19T09:41:39.207 INFO:tasks.workunit.client.0.smithi042.stdout:7/392: creat d0/f82 x:0 0 0 2024-09-19T09:41:39.207 INFO:tasks.workunit.client.0.smithi042.stdout:7/393: stat d0/d14/d3a/f80 0 2024-09-19T09:41:39.207 INFO:tasks.workunit.client.0.smithi042.stdout:7/394: chown d0/c2f 16966 1 2024-09-19T09:41:39.208 INFO:tasks.workunit.client.0.smithi042.stdout:4/431: mkdir d0/d1b/d1c/d2e/d3b/d95 0 2024-09-19T09:41:39.209 INFO:tasks.workunit.client.0.smithi042.stdout:3/404: mknod d4/d78/c83 0 2024-09-19T09:41:39.210 INFO:tasks.workunit.client.0.smithi042.stdout:7/395: creat d0/d14/f83 x:0 0 0 2024-09-19T09:41:39.211 INFO:tasks.workunit.client.0.smithi042.stdout:4/432: mkdir d0/d67/d96 0 2024-09-19T09:41:39.212 INFO:tasks.workunit.client.0.smithi042.stdout:3/405: truncate d4/d8/d9/dc/d26/d5c/f7f 757464 0 2024-09-19T09:41:39.212 INFO:tasks.workunit.client.0.smithi042.stdout:3/406: readlink d4/d8/d9/d1b/d4f/l66 0 2024-09-19T09:41:39.212 INFO:tasks.workunit.client.0.smithi042.stdout:3/407: readlink d4/d8/d9/d1b/d4f/l66 0 2024-09-19T09:41:39.213 INFO:tasks.workunit.client.0.smithi042.stdout:7/396: mknod d0/d56/d5c/c84 0 2024-09-19T09:41:39.213 INFO:tasks.workunit.client.0.smithi042.stdout:0/392: dwrite d2/d10/d12/d16/d18/d52/f55 [0,4194304] 0 2024-09-19T09:41:39.214 INFO:tasks.workunit.client.0.smithi042.stdout:4/433: mknod d0/d1b/c97 0 2024-09-19T09:41:39.215 INFO:tasks.workunit.client.0.smithi042.stdout:7/397: mkdir d0/d3d/d85 0 2024-09-19T09:41:39.217 INFO:tasks.workunit.client.0.smithi042.stdout:8/405: dwrite d1/da/f5a [0,4194304] 0 2024-09-19T09:41:39.217 INFO:tasks.workunit.client.0.smithi042.stdout:7/398: creat d0/d3d/d55/d72/f86 x:0 0 0 2024-09-19T09:41:39.222 INFO:tasks.workunit.client.0.smithi042.stdout:3/408: write d4/f74 [1248638,35431] 0 2024-09-19T09:41:39.222 INFO:tasks.workunit.client.0.smithi042.stdout:3/409: read - d4/d8/d9/dc/d26/d5c/d82/d48/f5a zero size 2024-09-19T09:41:39.222 INFO:tasks.workunit.client.0.smithi042.stdout:3/410: fdatasync d4/d8/d9/dc/d26/d5c/d82/f1a 0 2024-09-19T09:41:39.222 INFO:tasks.workunit.client.0.smithi042.stdout:3/411: chown d4/d8/d9/dc/d26/d5c/d82/d48/f5a 195 1 2024-09-19T09:41:39.222 INFO:tasks.workunit.client.0.smithi042.stdout:3/412: readlink d4/d8/d9/dc/d26/d5c/d82/l4a 0 2024-09-19T09:41:39.222 INFO:tasks.workunit.client.0.smithi042.stdout:3/413: write d4/d8/d9/dc/d26/d5c/d82/f6c [1004581,31874] 0 2024-09-19T09:41:39.223 INFO:tasks.workunit.client.0.smithi042.stdout:8/406: unlink d1/da/c30 0 2024-09-19T09:41:39.224 INFO:tasks.workunit.client.0.smithi042.stdout:3/414: mknod d4/d8/d9/dc/d26/d5c/c84 0 2024-09-19T09:41:39.225 INFO:tasks.workunit.client.0.smithi042.stdout:8/407: mknod d1/c76 0 2024-09-19T09:41:39.227 INFO:tasks.workunit.client.0.smithi042.stdout:1/468: dwrite d4/d15/d19/d42/d51/f81 [4194304,4194304] 0 2024-09-19T09:41:39.227 INFO:tasks.workunit.client.0.smithi042.stdout:3/415: mknod d4/d2a/c85 0 2024-09-19T09:41:39.227 INFO:tasks.workunit.client.0.smithi042.stdout:3/416: truncate d4/d8/d9/f56 4987474 0 2024-09-19T09:41:39.231 INFO:tasks.workunit.client.0.smithi042.stdout:3/417: rename d4/d8/d9/dc/d26/d5c/f7f to d4/d2a/f86 0 2024-09-19T09:41:39.234 INFO:tasks.workunit.client.0.smithi042.stdout:8/408: write d1/d2e/f51 [3070080,123059] 0 2024-09-19T09:41:39.234 INFO:tasks.workunit.client.0.smithi042.stdout:8/409: fsync d1/da/d32/d41/f75 0 2024-09-19T09:41:39.235 INFO:tasks.workunit.client.0.smithi042.stdout:8/410: unlink d1/da/f33 0 2024-09-19T09:41:39.235 INFO:tasks.workunit.client.0.smithi042.stdout:1/469: dread d4/f10 [0,4194304] 0 2024-09-19T09:41:39.236 INFO:tasks.workunit.client.0.smithi042.stdout:7/399: dwrite d0/d3d/f4a [0,4194304] 0 2024-09-19T09:41:39.238 INFO:tasks.workunit.client.0.smithi042.stdout:8/411: symlink d1/da/d32/d41/l77 0 2024-09-19T09:41:39.238 INFO:tasks.workunit.client.0.smithi042.stdout:8/412: stat d1/c34 0 2024-09-19T09:41:39.238 INFO:tasks.workunit.client.0.smithi042.stdout:1/470: mkdir d4/d12/d8d/d91/d7f/d99 0 2024-09-19T09:41:39.240 INFO:tasks.workunit.client.0.smithi042.stdout:7/400: mkdir d0/d3d/d55/d87 0 2024-09-19T09:41:39.242 INFO:tasks.workunit.client.0.smithi042.stdout:7/401: unlink d0/d56/d5c/f6d 0 2024-09-19T09:41:39.244 INFO:tasks.workunit.client.0.smithi042.stdout:7/402: link d0/f1a d0/d56/f88 0 2024-09-19T09:41:39.244 INFO:tasks.workunit.client.0.smithi042.stdout:7/403: fsync d0/f27 0 2024-09-19T09:41:39.244 INFO:tasks.workunit.client.0.smithi042.stdout:1/471: write d4/f13 [1671585,56062] 0 2024-09-19T09:41:39.245 INFO:tasks.workunit.client.0.smithi042.stdout:7/404: creat d0/d56/d5c/f89 x:0 0 0 2024-09-19T09:41:39.245 INFO:tasks.workunit.client.0.smithi042.stdout:7/405: chown d0/d3d/l6a 184521246 1 2024-09-19T09:41:39.247 INFO:tasks.workunit.client.0.smithi042.stdout:1/472: symlink d4/l9a 0 2024-09-19T09:41:39.249 INFO:tasks.workunit.client.0.smithi042.stdout:1/473: unlink d4/d15/d2e/c66 0 2024-09-19T09:41:39.254 INFO:tasks.workunit.client.0.smithi042.stdout:7/406: dread d0/f17 [0,4194304] 0 2024-09-19T09:41:39.255 INFO:tasks.workunit.client.0.smithi042.stdout:3/418: dwrite d4/f34 [0,4194304] 0 2024-09-19T09:41:39.262 INFO:tasks.workunit.client.0.smithi042.stdout:9/313: sync 2024-09-19T09:41:39.263 INFO:tasks.workunit.client.0.smithi042.stdout:9/314: symlink d8/da/d19/d1c/d4a/l5f 0 2024-09-19T09:41:39.263 INFO:tasks.workunit.client.0.smithi042.stdout:9/315: chown d8/da 0 1 2024-09-19T09:41:39.263 INFO:tasks.workunit.client.0.smithi042.stdout:9/316: truncate f1 3337909 0 2024-09-19T09:41:39.270 INFO:tasks.workunit.client.0.smithi042.stdout:8/413: dwrite d1/da/f21 [0,4194304] 0 2024-09-19T09:41:39.275 INFO:tasks.workunit.client.0.smithi042.stdout:1/474: dwrite d4/d1e/d25/f28 [0,4194304] 0 2024-09-19T09:41:39.277 INFO:tasks.workunit.client.0.smithi042.stdout:1/475: rename d4/d15/d19/d45/f93 to d4/d12/d8d/f9b 0 2024-09-19T09:41:39.287 INFO:tasks.workunit.client.0.smithi042.stdout:7/407: dwrite d0/d3d/d55/d78/f7f [0,4194304] 0 2024-09-19T09:41:39.290 INFO:tasks.workunit.client.0.smithi042.stdout:9/317: dwrite d8/da/f10 [0,4194304] 0 2024-09-19T09:41:39.291 INFO:tasks.workunit.client.0.smithi042.stdout:7/408: creat d0/d14/d3a/f8a x:0 0 0 2024-09-19T09:41:39.291 INFO:tasks.workunit.client.0.smithi042.stdout:7/409: write d0/d14/f83 [756735,123944] 0 2024-09-19T09:41:39.291 INFO:tasks.workunit.client.0.smithi042.stdout:8/414: dwrite d1/da/d32/d3d/d58/f5d [0,4194304] 0 2024-09-19T09:41:39.292 INFO:tasks.workunit.client.0.smithi042.stdout:9/318: rename d8/db/d31/l3e to d8/db/d31/d39/l60 0 2024-09-19T09:41:39.292 INFO:tasks.workunit.client.0.smithi042.stdout:9/319: chown d8/da/d19/d1c/l36 331912 1 2024-09-19T09:41:39.293 INFO:tasks.workunit.client.0.smithi042.stdout:7/410: creat d0/d3d/d85/f8b x:0 0 0 2024-09-19T09:41:39.295 INFO:tasks.workunit.client.0.smithi042.stdout:1/476: dwrite d4/d1e/d25/d35/d3c/f59 [0,4194304] 0 2024-09-19T09:41:39.295 INFO:tasks.workunit.client.0.smithi042.stdout:1/477: chown d4/d15/d19 2113729176 1 2024-09-19T09:41:39.295 INFO:tasks.workunit.client.0.smithi042.stdout:8/415: mknod d1/da/d32/d41/c78 0 2024-09-19T09:41:39.296 INFO:tasks.workunit.client.0.smithi042.stdout:9/320: creat d8/db/f61 x:0 0 0 2024-09-19T09:41:39.296 INFO:tasks.workunit.client.0.smithi042.stdout:9/321: readlink d8/da/d19/d1c/l36 0 2024-09-19T09:41:39.296 INFO:tasks.workunit.client.0.smithi042.stdout:7/411: getdents d0/d40 0 2024-09-19T09:41:39.298 INFO:tasks.workunit.client.0.smithi042.stdout:1/478: creat d4/d15/d19/d42/f9c x:0 0 0 2024-09-19T09:41:39.299 INFO:tasks.workunit.client.0.smithi042.stdout:7/412: rmdir d0/d3d/d55/d78 39 2024-09-19T09:41:39.299 INFO:tasks.workunit.client.0.smithi042.stdout:7/413: chown d0/l37 33719239 1 2024-09-19T09:41:39.301 INFO:tasks.workunit.client.0.smithi042.stdout:9/322: dread d8/d1d/f1f [0,4194304] 0 2024-09-19T09:41:39.301 INFO:tasks.workunit.client.0.smithi042.stdout:1/479: unlink d4/d15/d2e/c32 0 2024-09-19T09:41:39.302 INFO:tasks.workunit.client.0.smithi042.stdout:1/480: write d4/d1e/d25/d35/d3c/f43 [4416158,64055] 0 2024-09-19T09:41:39.302 INFO:tasks.workunit.client.0.smithi042.stdout:8/416: write d1/f26 [981421,104627] 0 2024-09-19T09:41:39.304 INFO:tasks.workunit.client.0.smithi042.stdout:1/481: link d4/d15/d19/d42/l84 d4/d12/d8d/l9d 0 2024-09-19T09:41:39.306 INFO:tasks.workunit.client.0.smithi042.stdout:8/417: rmdir d1/da 39 2024-09-19T09:41:39.306 INFO:tasks.workunit.client.0.smithi042.stdout:8/418: write d1/da/dd/f49 [5154425,30760] 0 2024-09-19T09:41:39.314 INFO:tasks.workunit.client.0.smithi042.stdout:9/323: dread d8/f3d [0,4194304] 0 2024-09-19T09:41:39.325 INFO:tasks.workunit.client.0.smithi042.stdout:8/419: dwrite d1/da/f5f [0,4194304] 0 2024-09-19T09:41:39.329 INFO:tasks.workunit.client.0.smithi042.stdout:1/482: dwrite d4/d15/d19/f9 [0,4194304] 0 2024-09-19T09:41:39.330 INFO:tasks.workunit.client.0.smithi042.stdout:1/483: truncate d4/f7b 2626186 0 2024-09-19T09:41:39.332 INFO:tasks.workunit.client.0.smithi042.stdout:1/484: mkdir d4/d15/d9e 0 2024-09-19T09:41:39.332 INFO:tasks.workunit.client.0.smithi042.stdout:5/351: sync 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:4/434: sync 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:2/403: sync 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:0/393: sync 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:4/435: chown d0/d1b/d1c/d2e/l30 133671947 1 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:2/404: chown d7/f9 0 1 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:4/436: chown d0/d1b/d69/c73 102897843 1 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:4/437: truncate d0/d1b/d1c/d2e/f50 760868 0 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:0/394: read d2/d10/f15 [381932,92063] 0 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:5/352: write d2/d25/d4d/f24 [1475486,46913] 0 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:6/394: sync 2024-09-19T09:41:39.333 INFO:tasks.workunit.client.0.smithi042.stdout:2/405: dread d7/f4b [0,4194304] 0 2024-09-19T09:41:39.336 INFO:tasks.workunit.client.0.smithi042.stdout:1/485: unlink d4/d1e/d25/f28 0 2024-09-19T09:41:39.336 INFO:tasks.workunit.client.0.smithi042.stdout:4/438: getdents d0/d1b/d56 0 2024-09-19T09:41:39.336 INFO:tasks.workunit.client.0.smithi042.stdout:0/395: symlink d2/d10/d12/d24/l7d 0 2024-09-19T09:41:39.338 INFO:tasks.workunit.client.0.smithi042.stdout:1/486: creat d4/d12/d8d/d91/d7f/d99/f9f x:0 0 0 2024-09-19T09:41:39.339 INFO:tasks.workunit.client.0.smithi042.stdout:5/353: dread d2/d25/d4d/f24 [0,4194304] 0 2024-09-19T09:41:39.339 INFO:tasks.workunit.client.0.smithi042.stdout:5/354: fdatasync d2/d4/f15 0 2024-09-19T09:41:39.339 INFO:tasks.workunit.client.0.smithi042.stdout:5/355: chown d2/d4/d20/d60 109518017 1 2024-09-19T09:41:39.339 INFO:tasks.workunit.client.0.smithi042.stdout:1/487: mknod d4/d15/d19/d45/d82/d89/ca0 0 2024-09-19T09:41:39.340 INFO:tasks.workunit.client.0.smithi042.stdout:5/356: creat d2/d4/f78 x:0 0 0 2024-09-19T09:41:39.341 INFO:tasks.workunit.client.0.smithi042.stdout:1/488: rmdir d4/d15/d2e/d69 0 2024-09-19T09:41:39.341 INFO:tasks.workunit.client.0.smithi042.stdout:1/489: read - d4/d4e/f57 zero size 2024-09-19T09:41:39.342 INFO:tasks.workunit.client.0.smithi042.stdout:5/357: creat d2/d4/d20/f79 x:0 0 0 2024-09-19T09:41:39.343 INFO:tasks.workunit.client.0.smithi042.stdout:2/406: write d7/dd/d14/d35/d4e/f65 [95024,10241] 0 2024-09-19T09:41:39.343 INFO:tasks.workunit.client.0.smithi042.stdout:1/490: truncate d4/d1e/d25/f46 3706800 0 2024-09-19T09:41:39.345 INFO:tasks.workunit.client.0.smithi042.stdout:1/491: getdents d4/d15/d61 0 2024-09-19T09:41:39.345 INFO:tasks.workunit.client.0.smithi042.stdout:1/492: readlink d4/d1e/d25/d35/l88 0 2024-09-19T09:41:39.345 INFO:tasks.workunit.client.0.smithi042.stdout:1/493: write d4/d15/d19/fe [355843,26387] 0 2024-09-19T09:41:39.345 INFO:tasks.workunit.client.0.smithi042.stdout:2/407: symlink d7/dd/d14/d35/d45/l83 0 2024-09-19T09:41:39.346 INFO:tasks.workunit.client.0.smithi042.stdout:5/358: write d2/d4/f15 [635629,31188] 0 2024-09-19T09:41:39.347 INFO:tasks.workunit.client.0.smithi042.stdout:1/494: rename d4/d12/d8d/l9d to d4/d15/d19/d42/la1 0 2024-09-19T09:41:39.347 INFO:tasks.workunit.client.0.smithi042.stdout:2/408: dread d7/dd/d22/f24 [0,4194304] 0 2024-09-19T09:41:39.347 INFO:tasks.workunit.client.0.smithi042.stdout:2/409: stat d7/dd/c13 0 2024-09-19T09:41:39.348 INFO:tasks.workunit.client.0.smithi042.stdout:1/495: rmdir d4/d1e/d25/d35/d3c 39 2024-09-19T09:41:39.349 INFO:tasks.workunit.client.0.smithi042.stdout:2/410: creat d7/dd/d14/f84 x:0 0 0 2024-09-19T09:41:39.351 INFO:tasks.workunit.client.0.smithi042.stdout:2/411: creat d7/dd/d14/d35/d45/d5e/f85 x:0 0 0 2024-09-19T09:41:39.351 INFO:tasks.workunit.client.0.smithi042.stdout:1/496: dread d4/d15/d19/d45/f52 [0,4194304] 0 2024-09-19T09:41:39.353 INFO:tasks.workunit.client.0.smithi042.stdout:1/497: creat d4/fa2 x:0 0 0 2024-09-19T09:41:39.353 INFO:tasks.workunit.client.0.smithi042.stdout:1/498: chown d4/d29/f38 629178 1 2024-09-19T09:41:39.359 INFO:tasks.workunit.client.0.smithi042.stdout:0/396: dwrite d2/d10/d12/d19/f69 [0,4194304] 0 2024-09-19T09:41:39.359 INFO:tasks.workunit.client.0.smithi042.stdout:0/397: readlink d2/d10/d1d/l66 0 2024-09-19T09:41:39.361 INFO:tasks.workunit.client.0.smithi042.stdout:0/398: mknod d2/d10/d12/d2e/c7e 0 2024-09-19T09:41:39.363 INFO:tasks.workunit.client.0.smithi042.stdout:0/399: symlink d2/d10/d1d/d34/l7f 0 2024-09-19T09:41:39.363 INFO:tasks.workunit.client.0.smithi042.stdout:8/420: dwrite d1/da/d32/d41/f57 [0,4194304] 0 2024-09-19T09:41:39.364 INFO:tasks.workunit.client.0.smithi042.stdout:2/412: dread d7/dd/d14/f56 [0,4194304] 0 2024-09-19T09:41:39.364 INFO:tasks.workunit.client.0.smithi042.stdout:8/421: write d1/d2e/f60 [1326985,113227] 0 2024-09-19T09:41:39.365 INFO:tasks.workunit.client.0.smithi042.stdout:0/400: link d2/fb d2/f80 0 2024-09-19T09:41:39.367 INFO:tasks.workunit.client.0.smithi042.stdout:1/499: dread d4/d15/d19/d42/d51/f81 [4194304,4194304] 0 2024-09-19T09:41:39.368 INFO:tasks.workunit.client.0.smithi042.stdout:8/422: link d1/f9 d1/d72/f79 0 2024-09-19T09:41:39.368 INFO:tasks.workunit.client.0.smithi042.stdout:0/401: getdents d2/d10/d1e 0 2024-09-19T09:41:39.368 INFO:tasks.workunit.client.0.smithi042.stdout:0/402: dread - d2/d10/d12/d24/f42 zero size 2024-09-19T09:41:39.368 INFO:tasks.workunit.client.0.smithi042.stdout:0/403: write d2/d10/d12/d16/d18/d52/f55 [5085244,70507] 0 2024-09-19T09:41:39.369 INFO:tasks.workunit.client.0.smithi042.stdout:0/404: fdatasync d2/d10/d1d/f59 0 2024-09-19T09:41:39.369 INFO:tasks.workunit.client.0.smithi042.stdout:1/500: dread d4/d15/d2e/f8c [0,4194304] 0 2024-09-19T09:41:39.369 INFO:tasks.workunit.client.0.smithi042.stdout:1/501: readlink d4/d1e/d25/l48 0 2024-09-19T09:41:39.369 INFO:tasks.workunit.client.0.smithi042.stdout:6/395: dwrite d1/d2e/f57 [0,4194304] 0 2024-09-19T09:41:39.370 INFO:tasks.workunit.client.0.smithi042.stdout:4/439: dwrite d0/d1b/d1c/f55 [0,4194304] 0 2024-09-19T09:41:39.377 INFO:tasks.workunit.client.0.smithi042.stdout:5/359: dwrite d2/d4/d2e/d57/f1f [4194304,4194304] 0 2024-09-19T09:41:39.377 INFO:tasks.workunit.client.0.smithi042.stdout:8/423: mknod d1/da/d32/d41/c7a 0 2024-09-19T09:41:39.377 INFO:tasks.workunit.client.0.smithi042.stdout:1/502: creat d4/d1e/d25/d35/d3c/fa3 x:0 0 0 2024-09-19T09:41:39.377 INFO:tasks.workunit.client.0.smithi042.stdout:8/424: readlink d1/da/dd/l65 0 2024-09-19T09:41:39.378 INFO:tasks.workunit.client.0.smithi042.stdout:1/503: fsync d4/f7b 0 2024-09-19T09:41:39.378 INFO:tasks.workunit.client.0.smithi042.stdout:2/413: rmdir d7 39 2024-09-19T09:41:39.379 INFO:tasks.workunit.client.0.smithi042.stdout:2/414: creat d7/dd/d22/f86 x:0 0 0 2024-09-19T09:41:39.380 INFO:tasks.workunit.client.0.smithi042.stdout:2/415: readlink d7/dd/d22/d30/d66/l7e 0 2024-09-19T09:41:39.380 INFO:tasks.workunit.client.0.smithi042.stdout:2/416: readlink d7/l11 0 2024-09-19T09:41:39.380 INFO:tasks.workunit.client.0.smithi042.stdout:8/425: getdents d1/da/dd 0 2024-09-19T09:41:39.380 INFO:tasks.workunit.client.0.smithi042.stdout:8/426: stat d1/da/dd/f5c 0 2024-09-19T09:41:39.380 INFO:tasks.workunit.client.0.smithi042.stdout:1/504: getdents d4/d15/d19/d45/d82/d89 0 2024-09-19T09:41:39.381 INFO:tasks.workunit.client.0.smithi042.stdout:2/417: mkdir d7/dd/d14/d35/d4c/d61/d87 0 2024-09-19T09:41:39.382 INFO:tasks.workunit.client.0.smithi042.stdout:2/418: mkdir d7/dd/d14/d35/d6b/d88 0 2024-09-19T09:41:39.384 INFO:tasks.workunit.client.0.smithi042.stdout:2/419: write d7/dd/f59 [44332,85946] 0 2024-09-19T09:41:39.384 INFO:tasks.workunit.client.0.smithi042.stdout:2/420: dread - d7/f6a zero size 2024-09-19T09:41:39.385 INFO:tasks.workunit.client.0.smithi042.stdout:8/427: rmdir d1/da/d32/d46 0 2024-09-19T09:41:39.388 INFO:tasks.workunit.client.0.smithi042.stdout:5/360: write d2/db/f10 [3116661,68569] 0 2024-09-19T09:41:39.390 INFO:tasks.workunit.client.0.smithi042.stdout:5/361: symlink d2/d4/d64/d6a/l7a 0 2024-09-19T09:41:39.391 INFO:tasks.workunit.client.0.smithi042.stdout:5/362: mknod d2/d4/d64/c7b 0 2024-09-19T09:41:39.392 INFO:tasks.workunit.client.0.smithi042.stdout:5/363: mknod d2/db/d42/c7c 0 2024-09-19T09:41:39.395 INFO:tasks.workunit.client.0.smithi042.stdout:1/505: dread d4/d1e/d25/d35/d3c/f59 [0,4194304] 0 2024-09-19T09:41:39.395 INFO:tasks.workunit.client.0.smithi042.stdout:5/364: rename d2/db/d3c/f53 to d2/db/f7d 0 2024-09-19T09:41:39.395 INFO:tasks.workunit.client.0.smithi042.stdout:5/365: read d2/db/d3c/f3f [2024498,5701] 0 2024-09-19T09:41:39.395 INFO:tasks.workunit.client.0.smithi042.stdout:5/366: chown d2/d25/d4d 1275216956 1 2024-09-19T09:41:39.397 INFO:tasks.workunit.client.0.smithi042.stdout:1/506: creat d4/d15/d2e/fa4 x:0 0 0 2024-09-19T09:41:39.397 INFO:tasks.workunit.client.0.smithi042.stdout:1/507: dread - d4/d1e/d25/d35/f97 zero size 2024-09-19T09:41:39.397 INFO:tasks.workunit.client.0.smithi042.stdout:1/508: read d4/d15/d19/f1a [2709450,43746] 0 2024-09-19T09:41:39.398 INFO:tasks.workunit.client.0.smithi042.stdout:5/367: symlink d2/l7e 0 2024-09-19T09:41:39.399 INFO:tasks.workunit.client.0.smithi042.stdout:6/396: dwrite d1/de/d12/d22/d34/d3f/f50 [0,4194304] 0 2024-09-19T09:41:39.399 INFO:tasks.workunit.client.0.smithi042.stdout:6/397: write d1/de/f2d [1172471,128617] 0 2024-09-19T09:41:39.399 INFO:tasks.workunit.client.0.smithi042.stdout:6/398: write d1/de/d12/d1c/d4f/f65 [811491,108254] 0 2024-09-19T09:41:39.399 INFO:tasks.workunit.client.0.smithi042.stdout:6/399: truncate d1/de/d12/d1c/d4f/f65 1375267 0 2024-09-19T09:41:39.399 INFO:tasks.workunit.client.0.smithi042.stdout:4/440: dwrite d0/f19 [0,4194304] 0 2024-09-19T09:41:39.399 INFO:tasks.workunit.client.0.smithi042.stdout:0/405: dwrite d2/d10/d12/d24/f29 [0,4194304] 0 2024-09-19T09:41:39.400 INFO:tasks.workunit.client.0.smithi042.stdout:1/509: link d4/f22 d4/fa5 0 2024-09-19T09:41:39.402 INFO:tasks.workunit.client.0.smithi042.stdout:6/400: mknod d1/d20/d45/d4a/c6d 0 2024-09-19T09:41:39.409 INFO:tasks.workunit.client.0.smithi042.stdout:5/368: getdents d2/db 0 2024-09-19T09:41:39.409 INFO:tasks.workunit.client.0.smithi042.stdout:8/428: dwrite d1/da/d32/f64 [0,4194304] 0 2024-09-19T09:41:39.409 INFO:tasks.workunit.client.0.smithi042.stdout:8/429: dread - d1/da/d32/d41/f75 zero size 2024-09-19T09:41:39.409 INFO:tasks.workunit.client.0.smithi042.stdout:8/430: getdents d1/da/dd/d74 0 2024-09-19T09:41:39.409 INFO:tasks.workunit.client.0.smithi042.stdout:8/431: dread - d1/da/dd/f3a zero size 2024-09-19T09:41:39.410 INFO:tasks.workunit.client.0.smithi042.stdout:5/369: dread d2/d4/d20/f45 [0,4194304] 0 2024-09-19T09:41:39.412 INFO:tasks.workunit.client.0.smithi042.stdout:4/441: symlink d0/d28/d87/l98 0 2024-09-19T09:41:39.413 INFO:tasks.workunit.client.0.smithi042.stdout:4/442: chown d0/fc 7 1 2024-09-19T09:41:39.413 INFO:tasks.workunit.client.0.smithi042.stdout:2/421: dwrite d7/dd/d22/d30/f60 [0,4194304] 0 2024-09-19T09:41:39.414 INFO:tasks.workunit.client.0.smithi042.stdout:2/422: truncate d7/f4b 169906 0 2024-09-19T09:41:39.414 INFO:tasks.workunit.client.0.smithi042.stdout:1/510: creat d4/d29/d3e/fa6 x:0 0 0 2024-09-19T09:41:39.415 INFO:tasks.workunit.client.0.smithi042.stdout:8/432: dread d1/da/dd/f49 [4194304,4194304] 0 2024-09-19T09:41:39.415 INFO:tasks.workunit.client.0.smithi042.stdout:8/433: write d1/da/dd/d69/f6d [4576143,114173] 0 2024-09-19T09:41:39.415 INFO:tasks.workunit.client.0.smithi042.stdout:5/370: getdents d2/d4/d20/d60/d72 0 2024-09-19T09:41:39.416 INFO:tasks.workunit.client.0.smithi042.stdout:5/371: getdents d2/d4/d20/d60/d72 0 2024-09-19T09:41:39.416 INFO:tasks.workunit.client.0.smithi042.stdout:4/443: dread d0/d1b/f2b [0,4194304] 0 2024-09-19T09:41:39.417 INFO:tasks.workunit.client.0.smithi042.stdout:8/434: dread d1/da/f13 [0,4194304] 0 2024-09-19T09:41:39.417 INFO:tasks.workunit.client.0.smithi042.stdout:8/435: truncate d1/da/dd/f5c 4299307 0 2024-09-19T09:41:39.419 INFO:tasks.workunit.client.0.smithi042.stdout:5/372: unlink d2/db/d42/c52 0 2024-09-19T09:41:39.420 INFO:tasks.workunit.client.0.smithi042.stdout:4/444: getdents d0/d1b/d69 0 2024-09-19T09:41:39.421 INFO:tasks.workunit.client.0.smithi042.stdout:5/373: mknod d2/d4/d20/c7f 0 2024-09-19T09:41:39.422 INFO:tasks.workunit.client.0.smithi042.stdout:4/445: creat d0/d1b/d1c/d61/d7f/d83/f99 x:0 0 0 2024-09-19T09:41:39.423 INFO:tasks.workunit.client.0.smithi042.stdout:4/446: fdatasync d0/d1b/d1c/d2e/d3b/f3c 0 2024-09-19T09:41:39.423 INFO:tasks.workunit.client.0.smithi042.stdout:4/447: creat d0/d1b/d1c/d2e/f9a x:0 0 0 2024-09-19T09:41:39.424 INFO:tasks.workunit.client.0.smithi042.stdout:2/423: truncate f6 5646201 0 2024-09-19T09:41:39.425 INFO:tasks.workunit.client.0.smithi042.stdout:2/424: creat d7/dd/f89 x:0 0 0 2024-09-19T09:41:39.426 INFO:tasks.workunit.client.0.smithi042.stdout:3/419: sync 2024-09-19T09:41:39.428 INFO:tasks.workunit.client.0.smithi042.stdout:2/425: creat d7/dd/d14/d35/d4c/d61/f8a x:0 0 0 2024-09-19T09:41:39.428 INFO:tasks.workunit.client.0.smithi042.stdout:4/448: rename d0/d1b/d1c/d2e/d3b/f48 to d0/d1b/d56/d86/f9b 0 2024-09-19T09:41:39.428 INFO:tasks.workunit.client.0.smithi042.stdout:4/449: write d0/d1b/f6f [278653,130463] 0 2024-09-19T09:41:39.428 INFO:tasks.workunit.client.0.smithi042.stdout:4/450: write d0/f4 [1327420,82912] 0 2024-09-19T09:41:39.428 INFO:tasks.workunit.client.0.smithi042.stdout:6/401: dwrite d1/d20/d6a/d46/f49 [0,4194304] 0 2024-09-19T09:41:39.429 INFO:tasks.workunit.client.0.smithi042.stdout:0/406: dwrite d2/d10/d12/d16/f5e [0,4194304] 0 2024-09-19T09:41:39.429 INFO:tasks.workunit.client.0.smithi042.stdout:7/414: sync 2024-09-19T09:41:39.429 INFO:tasks.workunit.client.0.smithi042.stdout:9/324: sync 2024-09-19T09:41:39.429 INFO:tasks.workunit.client.0.smithi042.stdout:3/420: mknod d4/d8/d9/c87 0 2024-09-19T09:41:39.430 INFO:tasks.workunit.client.0.smithi042.stdout:8/436: dread d1/da/d32/f54 [0,4194304] 0 2024-09-19T09:41:39.431 INFO:tasks.workunit.client.0.smithi042.stdout:9/325: dread d8/d1d/d28/f4f [0,4194304] 0 2024-09-19T09:41:39.431 INFO:tasks.workunit.client.0.smithi042.stdout:7/415: unlink d0/d40/f39 0 2024-09-19T09:41:39.433 INFO:tasks.workunit.client.0.smithi042.stdout:8/437: link d1/da/dd/f49 d1/da/d32/d3d/d59/f7b 0 2024-09-19T09:41:39.434 INFO:tasks.workunit.client.0.smithi042.stdout:6/402: dread d1/d20/f27 [0,4194304] 0 2024-09-19T09:41:39.434 INFO:tasks.workunit.client.0.smithi042.stdout:6/403: chown d1/fc 4149 1 2024-09-19T09:41:39.435 INFO:tasks.workunit.client.0.smithi042.stdout:9/326: rename d8/d1d/f4b to d8/da/d19/d1c/d4a/f62 0 2024-09-19T09:41:39.436 INFO:tasks.workunit.client.0.smithi042.stdout:7/416: creat d0/d3d/d55/d72/f8c x:0 0 0 2024-09-19T09:41:39.437 INFO:tasks.workunit.client.0.smithi042.stdout:8/438: write d1/f26 [4510436,23452] 0 2024-09-19T09:41:39.437 INFO:tasks.workunit.client.0.smithi042.stdout:8/439: dread - d1/da/dd/f3a zero size 2024-09-19T09:41:39.439 INFO:tasks.workunit.client.0.smithi042.stdout:6/404: creat d1/de/d12/d1c/d5f/f6e x:0 0 0 2024-09-19T09:41:39.439 INFO:tasks.workunit.client.0.smithi042.stdout:6/405: read - d1/de/d12/d1c/d3a/f4d zero size 2024-09-19T09:41:39.439 INFO:tasks.workunit.client.0.smithi042.stdout:6/406: chown d1/c8 188165306 1 2024-09-19T09:41:39.440 INFO:tasks.workunit.client.0.smithi042.stdout:0/407: dread d2/d10/d12/d24/f29 [0,4194304] 0 2024-09-19T09:41:39.441 INFO:tasks.workunit.client.0.smithi042.stdout:8/440: symlink d1/da/d32/d3d/d58/l7c 0 2024-09-19T09:41:39.441 INFO:tasks.workunit.client.0.smithi042.stdout:3/421: write d4/d8/d4c/f71 [2863307,96954] 0 2024-09-19T09:41:39.444 INFO:tasks.workunit.client.0.smithi042.stdout:6/407: rename d1/d20/d45 to d1/de/d12/d22/d34/d6f 0 2024-09-19T09:41:39.445 INFO:tasks.workunit.client.0.smithi042.stdout:8/441: symlink d1/da/dd/l7d 0 2024-09-19T09:41:39.446 INFO:tasks.workunit.client.0.smithi042.stdout:3/422: mknod d4/d8/d9/d39/d4b/d7d/c88 0 2024-09-19T09:41:39.447 INFO:tasks.workunit.client.0.smithi042.stdout:8/442: dread d1/da/f13 [0,4194304] 0 2024-09-19T09:41:39.447 INFO:tasks.workunit.client.0.smithi042.stdout:6/408: mknod d1/de/d12/c70 0 2024-09-19T09:41:39.448 INFO:tasks.workunit.client.0.smithi042.stdout:0/408: mknod d2/d10/d1d/c81 0 2024-09-19T09:41:39.448 INFO:tasks.workunit.client.0.smithi042.stdout:3/423: truncate d4/d8/f19 4922056 0 2024-09-19T09:41:39.449 INFO:tasks.workunit.client.0.smithi042.stdout:5/374: dwrite d2/d25/f2b [0,4194304] 0 2024-09-19T09:41:39.449 INFO:tasks.workunit.client.0.smithi042.stdout:8/443: creat d1/da/dd/d74/f7e x:0 0 0 2024-09-19T09:41:39.450 INFO:tasks.workunit.client.0.smithi042.stdout:6/409: mknod d1/de/d12/d22/d34/c71 0 2024-09-19T09:41:39.452 INFO:tasks.workunit.client.0.smithi042.stdout:0/409: mkdir d2/d10/d12/d24/d82 0 2024-09-19T09:41:39.452 INFO:tasks.workunit.client.0.smithi042.stdout:3/424: rmdir d4/d78 39 2024-09-19T09:41:39.452 INFO:tasks.workunit.client.0.smithi042.stdout:3/425: fsync d4/d8/d9/d39/d4b/f54 0 2024-09-19T09:41:39.452 INFO:tasks.workunit.client.0.smithi042.stdout:3/426: readlink d4/d8/d9/l30 0 2024-09-19T09:41:39.452 INFO:tasks.workunit.client.0.smithi042.stdout:3/427: truncate d4/d2a/f75 43873 0 2024-09-19T09:41:39.452 INFO:tasks.workunit.client.0.smithi042.stdout:2/426: dwrite d7/dd/d14/d35/d4c/d61/f74 [0,4194304] 0 2024-09-19T09:41:39.452 INFO:tasks.workunit.client.0.smithi042.stdout:2/427: chown d7/l58 2006042 1 2024-09-19T09:41:39.453 INFO:tasks.workunit.client.0.smithi042.stdout:2/428: creat d7/dd/d22/d30/f8b x:0 0 0 2024-09-19T09:41:39.454 INFO:tasks.workunit.client.0.smithi042.stdout:5/375: creat d2/d25/f80 x:0 0 0 2024-09-19T09:41:39.456 INFO:tasks.workunit.client.0.smithi042.stdout:8/444: truncate d1/da/d32/f54 3294028 0 2024-09-19T09:41:39.457 INFO:tasks.workunit.client.0.smithi042.stdout:0/410: truncate d2/d10/d12/d2e/f46 2950260 0 2024-09-19T09:41:39.459 INFO:tasks.workunit.client.0.smithi042.stdout:5/376: symlink d2/db/l81 0 2024-09-19T09:41:39.460 INFO:tasks.workunit.client.0.smithi042.stdout:0/411: creat d2/d10/d12/d2e/d32/f83 x:0 0 0 2024-09-19T09:41:39.461 INFO:tasks.workunit.client.0.smithi042.stdout:0/412: stat d2/d10/d12/d16/d18/d52/c63 0 2024-09-19T09:41:39.461 INFO:tasks.workunit.client.0.smithi042.stdout:5/377: read d2/d4/d20/f45 [124378,128285] 0 2024-09-19T09:41:39.470 INFO:tasks.workunit.client.0.smithi042.stdout:5/378: write d2/d25/f2b [1177429,42445] 0 2024-09-19T09:41:39.470 INFO:tasks.workunit.client.0.smithi042.stdout:0/413: dread d2/d10/f1b [0,4194304] 0 2024-09-19T09:41:39.470 INFO:tasks.workunit.client.0.smithi042.stdout:0/414: fdatasync d2/f54 0 2024-09-19T09:41:39.471 INFO:tasks.workunit.client.0.smithi042.stdout:5/379: rename d2/d4/d64/c7b to d2/db/d3c/c82 0 2024-09-19T09:41:39.471 INFO:tasks.workunit.client.0.smithi042.stdout:5/380: truncate d2/d25/d4d/f1d 5032872 0 2024-09-19T09:41:39.472 INFO:tasks.workunit.client.0.smithi042.stdout:5/381: rename d2/db/f30 to d2/d4/d64/d6a/f83 0 2024-09-19T09:41:39.473 INFO:tasks.workunit.client.0.smithi042.stdout:5/382: creat d2/d4/d20/d60/d72/f84 x:0 0 0 2024-09-19T09:41:39.474 INFO:tasks.workunit.client.0.smithi042.stdout:5/383: rename d2/d4/d20/f79 to d2/d4/d64/d6a/f85 0 2024-09-19T09:41:39.475 INFO:tasks.workunit.client.0.smithi042.stdout:5/384: mkdir d2/db/d3c/d86 0 2024-09-19T09:41:39.476 INFO:tasks.workunit.client.0.smithi042.stdout:4/451: dwrite d0/f15 [4194304,4194304] 0 2024-09-19T09:41:39.476 INFO:tasks.workunit.client.0.smithi042.stdout:5/385: mknod d2/db/d42/c87 0 2024-09-19T09:41:39.476 INFO:tasks.workunit.client.0.smithi042.stdout:5/386: fdatasync d2/f1e 0 2024-09-19T09:41:39.476 INFO:tasks.workunit.client.0.smithi042.stdout:2/429: dread f6 [0,4194304] 0 2024-09-19T09:41:39.477 INFO:tasks.workunit.client.0.smithi042.stdout:2/430: symlink d7/dd/d22/l8c 0 2024-09-19T09:41:39.477 INFO:tasks.workunit.client.0.smithi042.stdout:4/452: mknod d0/d28/d36/c9c 0 2024-09-19T09:41:39.478 INFO:tasks.workunit.client.0.smithi042.stdout:8/445: dread d1/da/f5f [0,4194304] 0 2024-09-19T09:41:39.478 INFO:tasks.workunit.client.0.smithi042.stdout:4/453: mknod d0/d1b/d1c/c9d 0 2024-09-19T09:41:39.479 INFO:tasks.workunit.client.0.smithi042.stdout:8/446: symlink d1/da/dd/d74/l7f 0 2024-09-19T09:41:39.482 INFO:tasks.workunit.client.0.smithi042.stdout:2/431: read f6 [5599024,55772] 0 2024-09-19T09:41:39.482 INFO:tasks.workunit.client.0.smithi042.stdout:2/432: chown d7/l11 340 1 2024-09-19T09:41:39.482 INFO:tasks.workunit.client.0.smithi042.stdout:2/433: fdatasync f6 0 2024-09-19T09:41:39.487 INFO:tasks.workunit.client.0.smithi042.stdout:8/447: dread d1/da/dd/f70 [0,4194304] 0 2024-09-19T09:41:39.489 INFO:tasks.workunit.client.0.smithi042.stdout:8/448: creat d1/da/d32/d3d/d59/f80 x:0 0 0 2024-09-19T09:41:39.489 INFO:tasks.workunit.client.0.smithi042.stdout:8/449: write d1/da/d3f/f50 [4872703,19054] 0 2024-09-19T09:41:39.489 INFO:tasks.workunit.client.0.smithi042.stdout:0/415: dread d2/fe [0,4194304] 0 2024-09-19T09:41:39.490 INFO:tasks.workunit.client.0.smithi042.stdout:9/327: dwrite d8/f24 [0,4194304] 0 2024-09-19T09:41:39.490 INFO:tasks.workunit.client.0.smithi042.stdout:0/416: chown d2/d10/d1e/f6f 2722 1 2024-09-19T09:41:39.490 INFO:tasks.workunit.client.0.smithi042.stdout:6/410: dwrite d1/de/d12/d1c/d4f/f65 [0,4194304] 0 2024-09-19T09:41:39.491 INFO:tasks.workunit.client.0.smithi042.stdout:7/417: dwrite d0/d40/f6c [0,4194304] 0 2024-09-19T09:41:39.491 INFO:tasks.workunit.client.0.smithi042.stdout:3/428: dwrite d4/f74 [0,4194304] 0 2024-09-19T09:41:39.492 INFO:tasks.workunit.client.0.smithi042.stdout:8/450: symlink d1/da/d32/d41/d55/l81 0 2024-09-19T09:41:39.492 INFO:tasks.workunit.client.0.smithi042.stdout:9/328: unlink d8/da/d19/d1c/d21/f44 0 2024-09-19T09:41:39.496 INFO:tasks.workunit.client.0.smithi042.stdout:7/418: symlink d0/d14/d3c/l8d 0 2024-09-19T09:41:39.496 INFO:tasks.workunit.client.0.smithi042.stdout:7/419: truncate d0/d3d/d55/f71 720017 0 2024-09-19T09:41:39.496 INFO:tasks.workunit.client.0.smithi042.stdout:7/420: write d0/d14/d44/f79 [988990,29208] 0 2024-09-19T09:41:39.497 INFO:tasks.workunit.client.0.smithi042.stdout:3/429: symlink d4/d8/d9/dc/d26/d5c/d82/l89 0 2024-09-19T09:41:39.497 INFO:tasks.workunit.client.0.smithi042.stdout:3/430: chown d4/d8/d9/dc/d26/d35/f44 27 1 2024-09-19T09:41:39.497 INFO:tasks.workunit.client.0.smithi042.stdout:7/421: read d0/d56/f66 [89746,99589] 0 2024-09-19T09:41:39.498 INFO:tasks.workunit.client.0.smithi042.stdout:8/451: creat d1/da/d32/d3d/d58/f82 x:0 0 0 2024-09-19T09:41:39.503 INFO:tasks.workunit.client.0.smithi042.stdout:6/411: dread d1/f18 [4194304,4194304] 0 2024-09-19T09:41:39.504 INFO:tasks.workunit.client.0.smithi042.stdout:7/422: unlink d0/d14/d3c/l4c 0 2024-09-19T09:41:39.507 INFO:tasks.workunit.client.0.smithi042.stdout:8/452: unlink d1/f26 0 2024-09-19T09:41:39.507 INFO:tasks.workunit.client.0.smithi042.stdout:5/387: dwrite d2/db/d3c/f3f [0,4194304] 0 2024-09-19T09:41:39.509 INFO:tasks.workunit.client.0.smithi042.stdout:6/412: mknod d1/d20/d69/c72 0 2024-09-19T09:41:39.510 INFO:tasks.workunit.client.0.smithi042.stdout:7/423: read d0/d3d/f4b [1031601,59649] 0 2024-09-19T09:41:39.512 INFO:tasks.workunit.client.0.smithi042.stdout:8/453: symlink d1/da/dd/l83 0 2024-09-19T09:41:39.512 INFO:tasks.workunit.client.0.smithi042.stdout:5/388: getdents d2/d25 0 2024-09-19T09:41:39.514 INFO:tasks.workunit.client.0.smithi042.stdout:7/424: mknod d0/d14/d3a/c8e 0 2024-09-19T09:41:39.514 INFO:tasks.workunit.client.0.smithi042.stdout:7/425: chown d0/d40/f4f 17 1 2024-09-19T09:41:39.514 INFO:tasks.workunit.client.0.smithi042.stdout:7/426: read - d0/d3d/d55/d72/f86 zero size 2024-09-19T09:41:39.514 INFO:tasks.workunit.client.0.smithi042.stdout:7/427: chown d0/d3d/d55/l57 47590 1 2024-09-19T09:41:39.515 INFO:tasks.workunit.client.0.smithi042.stdout:8/454: mkdir d1/da/d32/d3d/d58/d84 0 2024-09-19T09:41:39.517 INFO:tasks.workunit.client.0.smithi042.stdout:5/389: creat d2/db/d3c/d86/f88 x:0 0 0 2024-09-19T09:41:39.517 INFO:tasks.workunit.client.0.smithi042.stdout:5/390: truncate d2/d4/d64/d6a/f83 2987890 0 2024-09-19T09:41:39.518 INFO:tasks.workunit.client.0.smithi042.stdout:7/428: truncate d0/d56/f88 2357500 0 2024-09-19T09:41:39.520 INFO:tasks.workunit.client.0.smithi042.stdout:8/455: rmdir d1/da/d32/d3d/d58/d84 0 2024-09-19T09:41:39.520 INFO:tasks.workunit.client.0.smithi042.stdout:8/456: truncate d1/da/d14/f17 649044 0 2024-09-19T09:41:39.521 INFO:tasks.workunit.client.0.smithi042.stdout:8/457: write d1/da/d14/f17 [388104,19429] 0 2024-09-19T09:41:39.523 INFO:tasks.workunit.client.0.smithi042.stdout:2/434: dwrite d7/dd/d22/f86 [0,4194304] 0 2024-09-19T09:41:39.523 INFO:tasks.workunit.client.0.smithi042.stdout:2/435: write d7/dd/f89 [323955,16196] 0 2024-09-19T09:41:39.523 INFO:tasks.workunit.client.0.smithi042.stdout:0/417: dwrite d2/d10/d12/d19/f6e [0,4194304] 0 2024-09-19T09:41:39.523 INFO:tasks.workunit.client.0.smithi042.stdout:9/329: dwrite d8/db/f61 [0,4194304] 0 2024-09-19T09:41:39.523 INFO:tasks.workunit.client.0.smithi042.stdout:3/431: dwrite d4/d8/d9/dc/f2b [0,4194304] 0 2024-09-19T09:41:39.525 INFO:tasks.workunit.client.0.smithi042.stdout:0/418: mknod d2/d10/d12/d19/d6d/c84 0 2024-09-19T09:41:39.525 INFO:tasks.workunit.client.0.smithi042.stdout:0/419: dread - d2/d10/d1d/d34/f74 zero size 2024-09-19T09:41:39.525 INFO:tasks.workunit.client.0.smithi042.stdout:0/420: chown d2/d10/d12/d16/d57/c7c 2068 1 2024-09-19T09:41:39.526 INFO:tasks.workunit.client.0.smithi042.stdout:7/429: dread d0/d3d/d55/d78/f7f [0,4194304] 0 2024-09-19T09:41:39.528 INFO:tasks.workunit.client.0.smithi042.stdout:6/413: read d1/f5e [1938161,65475] 0 2024-09-19T09:41:39.528 INFO:tasks.workunit.client.0.smithi042.stdout:6/414: write d1/d20/f62 [152900,118054] 0 2024-09-19T09:41:39.529 INFO:tasks.workunit.client.0.smithi042.stdout:0/421: getdents d2/d10/d1d/d34 0 2024-09-19T09:41:39.530 INFO:tasks.workunit.client.0.smithi042.stdout:7/430: getdents d0/d14/d44/d47 0 2024-09-19T09:41:39.530 INFO:tasks.workunit.client.0.smithi042.stdout:3/432: dread d4/d8/d4c/f71 [0,4194304] 0 2024-09-19T09:41:39.531 INFO:tasks.workunit.client.0.smithi042.stdout:9/330: link d8/c9 d8/da/d19/d1c/d21/c63 0 2024-09-19T09:41:39.531 INFO:tasks.workunit.client.0.smithi042.stdout:9/331: chown d8/da/c46 26374 1 2024-09-19T09:41:39.532 INFO:tasks.workunit.client.0.smithi042.stdout:6/415: creat d1/de/d12/d22/d34/f73 x:0 0 0 2024-09-19T09:41:39.533 INFO:tasks.workunit.client.0.smithi042.stdout:8/458: write d1/da/dd/f5c [3883610,25170] 0 2024-09-19T09:41:39.534 INFO:tasks.workunit.client.0.smithi042.stdout:0/422: mkdir d2/d10/d12/d19/d5a/d85 0 2024-09-19T09:41:39.534 INFO:tasks.workunit.client.0.smithi042.stdout:0/423: stat d2/f54 0 2024-09-19T09:41:39.536 INFO:tasks.workunit.client.0.smithi042.stdout:3/433: mknod d4/d8/d9/d39/d4b/c8a 0 2024-09-19T09:41:39.536 INFO:tasks.workunit.client.0.smithi042.stdout:3/434: fsync d4/d8/d9/d39/d4b/f7e 0 2024-09-19T09:41:39.536 INFO:tasks.workunit.client.0.smithi042.stdout:3/435: stat d4/d8/d9/d39/d4b/f80 0 2024-09-19T09:41:39.536 INFO:tasks.workunit.client.0.smithi042.stdout:3/436: stat d4/d8/d9/c5e 0 2024-09-19T09:41:39.537 INFO:tasks.workunit.client.0.smithi042.stdout:9/332: rename d8/d1d/d28/f4f to d8/db/d31/f64 0 2024-09-19T09:41:39.538 INFO:tasks.workunit.client.0.smithi042.stdout:5/391: dwrite d2/d25/d4d/f1a [0,4194304] 0 2024-09-19T09:41:39.539 INFO:tasks.workunit.client.0.smithi042.stdout:6/416: unlink d1/d20/d69/c72 0 2024-09-19T09:41:39.541 INFO:tasks.workunit.client.0.smithi042.stdout:0/424: dread d2/d10/d1d/f30 [0,4194304] 0 2024-09-19T09:41:39.543 INFO:tasks.workunit.client.0.smithi042.stdout:0/425: dread d2/d10/d12/f31 [0,4194304] 0 2024-09-19T09:41:39.543 INFO:tasks.workunit.client.0.smithi042.stdout:0/426: dread - d2/f54 zero size 2024-09-19T09:41:39.544 INFO:tasks.workunit.client.0.smithi042.stdout:3/437: mkdir d4/d8/d9/dc/d26/d8b 0 2024-09-19T09:41:39.545 INFO:tasks.workunit.client.0.smithi042.stdout:9/333: truncate d8/db/f26 780351 0 2024-09-19T09:41:39.548 INFO:tasks.workunit.client.0.smithi042.stdout:2/436: truncate f6 5322166 0 2024-09-19T09:41:39.548 INFO:tasks.workunit.client.0.smithi042.stdout:2/437: truncate d7/dd/d14/d35/d4c/d61/f8a 371441 0 2024-09-19T09:41:39.549 INFO:tasks.workunit.client.0.smithi042.stdout:2/438: creat d7/dd/f8d x:0 0 0 2024-09-19T09:41:39.549 INFO:tasks.workunit.client.0.smithi042.stdout:5/392: creat d2/d4/d20/f89 x:0 0 0 2024-09-19T09:41:39.550 INFO:tasks.workunit.client.0.smithi042.stdout:6/417: mknod d1/de/d54/c74 0 2024-09-19T09:41:39.550 INFO:tasks.workunit.client.0.smithi042.stdout:6/418: chown d1/de/d12/d22/d34/d6f/d4a 358 1 2024-09-19T09:41:39.550 INFO:tasks.workunit.client.0.smithi042.stdout:6/419: readlink d1/d20/l43 0 2024-09-19T09:41:39.551 INFO:tasks.workunit.client.0.smithi042.stdout:0/427: getdents d2/d10/d12/d24/d5b 0 2024-09-19T09:41:39.552 INFO:tasks.workunit.client.0.smithi042.stdout:3/438: mkdir d4/d8/d9/dc/d26/d5c/d82/d8c 0 2024-09-19T09:41:39.554 INFO:tasks.workunit.client.0.smithi042.stdout:8/459: dwrite d1/da/f2f [0,4194304] 0 2024-09-19T09:41:39.554 INFO:tasks.workunit.client.0.smithi042.stdout:8/460: readlink d1/da/l23 0 2024-09-19T09:41:39.554 INFO:tasks.workunit.client.0.smithi042.stdout:9/334: creat d8/db/d31/d39/f65 x:0 0 0 2024-09-19T09:41:39.556 INFO:tasks.workunit.client.0.smithi042.stdout:6/420: link d1/d20/f56 d1/de/d12/d1c/d3a/f75 0 2024-09-19T09:41:39.557 INFO:tasks.workunit.client.0.smithi042.stdout:2/439: write d7/dd/d1f/d3f/f5c [1922926,3746] 0 2024-09-19T09:41:39.558 INFO:tasks.workunit.client.0.smithi042.stdout:0/428: rename d2/d10/f1b to d2/d10/d1d/d34/f86 0 2024-09-19T09:41:39.558 INFO:tasks.workunit.client.0.smithi042.stdout:0/429: write d2/f1c [7810570,12242] 0 2024-09-19T09:41:39.559 INFO:tasks.workunit.client.0.smithi042.stdout:2/440: link d7/dd/c13 d7/c8e 0 2024-09-19T09:41:39.559 INFO:tasks.workunit.client.0.smithi042.stdout:3/439: creat d4/d2a/d76/f8d x:0 0 0 2024-09-19T09:41:39.560 INFO:tasks.workunit.client.0.smithi042.stdout:8/461: creat d1/da/d14/f85 x:0 0 0 2024-09-19T09:41:39.560 INFO:tasks.workunit.client.0.smithi042.stdout:8/462: fsync d1/da/dd/f70 0 2024-09-19T09:41:39.560 INFO:tasks.workunit.client.0.smithi042.stdout:8/463: truncate d1/da/f13 735543 0 2024-09-19T09:41:39.561 INFO:tasks.workunit.client.0.smithi042.stdout:9/335: rename d8/d1d/c2e to d8/db/d31/c66 0 2024-09-19T09:41:39.562 INFO:tasks.workunit.client.0.smithi042.stdout:0/430: symlink d2/d10/d12/d16/d18/l87 0 2024-09-19T09:41:39.563 INFO:tasks.workunit.client.0.smithi042.stdout:8/464: mknod d1/c86 0 2024-09-19T09:41:39.571 INFO:tasks.workunit.client.0.smithi042.stdout:0/431: dread d2/d10/d12/d16/d51/f56 [0,4194304] 0 2024-09-19T09:41:39.572 INFO:tasks.workunit.client.0.smithi042.stdout:0/432: fdatasync d2/d10/d12/d16/d18/f47 0 2024-09-19T09:41:39.573 INFO:tasks.workunit.client.0.smithi042.stdout:9/336: write d8/db/f22 [1458021,75621] 0 2024-09-19T09:41:39.575 INFO:tasks.workunit.client.0.smithi042.stdout:9/337: rename d8/da/d19/d1c/d4a to d8/da/d19/d1c/d21/d67 0 2024-09-19T09:41:39.576 INFO:tasks.workunit.client.0.smithi042.stdout:3/440: read d4/d8/d9/f56 [3780672,109781] 0 2024-09-19T09:41:39.576 INFO:tasks.workunit.client.0.smithi042.stdout:3/441: truncate d4/d2a/f75 417388 0 2024-09-19T09:41:39.577 INFO:tasks.workunit.client.0.smithi042.stdout:5/393: dwrite d2/d4/d20/f45 [0,4194304] 0 2024-09-19T09:41:39.578 INFO:tasks.workunit.client.0.smithi042.stdout:8/465: write d1/da/dd/f49 [3302964,130474] 0 2024-09-19T09:41:39.579 INFO:tasks.workunit.client.0.smithi042.stdout:2/441: dwrite d7/fe [4194304,4194304] 0 2024-09-19T09:41:39.582 INFO:tasks.workunit.client.0.smithi042.stdout:9/338: rename d8/d32/l3c to d8/db/d31/d39/l68 0 2024-09-19T09:41:39.582 INFO:tasks.workunit.client.0.smithi042.stdout:2/442: rename d7/dd to d7/dd/d48/d8f 22 2024-09-19T09:41:39.582 INFO:tasks.workunit.client.0.smithi042.stdout:5/394: mkdir d2/d4/d8a 0 2024-09-19T09:41:39.582 INFO:tasks.workunit.client.0.smithi042.stdout:6/421: dwrite d1/de/f2d [0,4194304] 0 2024-09-19T09:41:39.584 INFO:tasks.workunit.client.0.smithi042.stdout:8/466: mkdir d1/da/d32/d87 0 2024-09-19T09:41:39.585 INFO:tasks.workunit.client.0.smithi042.stdout:5/395: truncate d2/f1e 79449 0 2024-09-19T09:41:39.585 INFO:tasks.workunit.client.0.smithi042.stdout:1/511: sync 2024-09-19T09:41:39.585 INFO:tasks.workunit.client.0.smithi042.stdout:6/422: truncate d1/d20/f27 624535 0 2024-09-19T09:41:39.585 INFO:tasks.workunit.client.0.smithi042.stdout:0/433: dread d2/d10/d12/d19/f6e [0,4194304] 0 2024-09-19T09:41:39.587 INFO:tasks.workunit.client.0.smithi042.stdout:8/467: creat d1/da/dd/f88 x:0 0 0 2024-09-19T09:41:39.588 INFO:tasks.workunit.client.0.smithi042.stdout:8/468: truncate d1/da/d32/d3d/d59/f80 696686 0 2024-09-19T09:41:39.588 INFO:tasks.workunit.client.0.smithi042.stdout:8/469: chown d1/da/d32/d41/d55 1095703 1 2024-09-19T09:41:39.588 INFO:tasks.workunit.client.0.smithi042.stdout:9/339: truncate d8/f1a 3480608 0 2024-09-19T09:41:39.591 INFO:tasks.workunit.client.0.smithi042.stdout:5/396: link d2/d25/c5c d2/d4/d20/d60/c8b 0 2024-09-19T09:41:39.594 INFO:tasks.workunit.client.0.smithi042.stdout:1/512: dread d4/d15/d19/d42/d51/f81 [0,4194304] 0 2024-09-19T09:41:39.595 INFO:tasks.workunit.client.0.smithi042.stdout:8/470: symlink d1/da/d3f/l89 0 2024-09-19T09:41:39.595 INFO:tasks.workunit.client.0.smithi042.stdout:8/471: fdatasync d1/d72/f79 0 2024-09-19T09:41:39.596 INFO:tasks.workunit.client.0.smithi042.stdout:5/397: mknod d2/d4/d20/d60/c8c 0 2024-09-19T09:41:39.596 INFO:tasks.workunit.client.0.smithi042.stdout:5/398: write d2/d4/d20/f89 [280976,31908] 0 2024-09-19T09:41:39.597 INFO:tasks.workunit.client.0.smithi042.stdout:6/423: dread d1/f24 [0,4194304] 0 2024-09-19T09:41:39.597 INFO:tasks.workunit.client.0.smithi042.stdout:6/424: chown d1/de/d12 98930058 1 2024-09-19T09:41:39.598 INFO:tasks.workunit.client.0.smithi042.stdout:1/513: dread d4/d15/d19/d42/d51/f81 [0,4194304] 0 2024-09-19T09:41:39.598 INFO:tasks.workunit.client.0.smithi042.stdout:0/434: unlink d2/d10/d12/c1f 0 2024-09-19T09:41:39.599 INFO:tasks.workunit.client.0.smithi042.stdout:0/435: truncate d2/d10/d12/d16/d18/f22 277284 0 2024-09-19T09:41:39.599 INFO:tasks.workunit.client.0.smithi042.stdout:6/425: read d1/de/d5d/f61 [311898,98063] 0 2024-09-19T09:41:39.600 INFO:tasks.workunit.client.0.smithi042.stdout:5/399: creat d2/d4/d20/d60/d72/f8d x:0 0 0 2024-09-19T09:41:39.601 INFO:tasks.workunit.client.0.smithi042.stdout:6/426: mkdir d1/de/d76 0 2024-09-19T09:41:39.602 INFO:tasks.workunit.client.0.smithi042.stdout:6/427: write d1/d2e/f31 [720647,772] 0 2024-09-19T09:41:39.602 INFO:tasks.workunit.client.0.smithi042.stdout:6/428: fsync d1/d20/d6a/f5a 0 2024-09-19T09:41:39.602 INFO:tasks.workunit.client.0.smithi042.stdout:6/429: write d1/d20/f56 [838053,10428] 0 2024-09-19T09:41:39.602 INFO:tasks.workunit.client.0.smithi042.stdout:6/430: fdatasync d1/de/d12/d22/f25 0 2024-09-19T09:41:39.602 INFO:tasks.workunit.client.0.smithi042.stdout:6/431: chown d1/d20/f56 209375 1 2024-09-19T09:41:39.602 INFO:tasks.workunit.client.0.smithi042.stdout:0/436: symlink d2/d10/d1d/l88 0 2024-09-19T09:41:39.604 INFO:tasks.workunit.client.0.smithi042.stdout:8/472: dread d1/d72/f79 [0,4194304] 0 2024-09-19T09:41:39.604 INFO:tasks.workunit.client.0.smithi042.stdout:3/442: dwrite d4/d8/d9/d39/d4b/f80 [0,4194304] 0 2024-09-19T09:41:39.604 INFO:tasks.workunit.client.0.smithi042.stdout:0/437: mkdir d2/d10/d1d/d34/d89 0 2024-09-19T09:41:39.605 INFO:tasks.workunit.client.0.smithi042.stdout:2/443: dwrite d7/dd/f40 [4194304,4194304] 0 2024-09-19T09:41:39.607 INFO:tasks.workunit.client.0.smithi042.stdout:2/444: creat d7/dd/d22/d30/f90 x:0 0 0 2024-09-19T09:41:39.609 INFO:tasks.workunit.client.0.smithi042.stdout:9/340: dwrite d8/d1d/d28/f43 [0,4194304] 0 2024-09-19T09:41:39.610 INFO:tasks.workunit.client.0.smithi042.stdout:3/443: symlink d4/d8/d9/dc/d26/l8e 0 2024-09-19T09:41:39.610 INFO:tasks.workunit.client.0.smithi042.stdout:3/444: chown d4/d8/d9 863 1 2024-09-19T09:41:39.612 INFO:tasks.workunit.client.0.smithi042.stdout:0/438: mkdir d2/d10/d12/d16/d18/d8a 0 2024-09-19T09:41:39.613 INFO:tasks.workunit.client.0.smithi042.stdout:5/400: dread d2/d25/d4d/f1d [0,4194304] 0 2024-09-19T09:41:39.613 INFO:tasks.workunit.client.0.smithi042.stdout:2/445: write d7/dd/f12 [1774,1762] 0 2024-09-19T09:41:39.615 INFO:tasks.workunit.client.0.smithi042.stdout:2/446: mknod d7/dd/d14/d35/d4e/c91 0 2024-09-19T09:41:39.616 INFO:tasks.workunit.client.0.smithi042.stdout:2/447: write d7/dd/f16 [237912,22496] 0 2024-09-19T09:41:39.617 INFO:tasks.workunit.client.0.smithi042.stdout:2/448: creat d7/dd/d22/d30/d66/f92 x:0 0 0 2024-09-19T09:41:39.623 INFO:tasks.workunit.client.0.smithi042.stdout:2/449: write d7/dd/d22/d30/f60 [191665,71465] 0 2024-09-19T09:41:39.624 INFO:tasks.workunit.client.0.smithi042.stdout:9/341: creat d8/d32/f69 x:0 0 0 2024-09-19T09:41:39.625 INFO:tasks.workunit.client.0.smithi042.stdout:3/445: mkdir d4/d8/d9/dc/d26/d6d/d8f 0 2024-09-19T09:41:39.626 INFO:tasks.workunit.client.0.smithi042.stdout:0/439: symlink d2/d10/d1e/l8b 0 2024-09-19T09:41:39.628 INFO:tasks.workunit.client.0.smithi042.stdout:5/401: mkdir d2/d8e 0 2024-09-19T09:41:39.628 INFO:tasks.workunit.client.0.smithi042.stdout:5/402: chown d2/db/c4b 44118 1 2024-09-19T09:41:39.628 INFO:tasks.workunit.client.0.smithi042.stdout:8/473: dwrite d1/da/d32/f64 [0,4194304] 0 2024-09-19T09:41:39.633 INFO:tasks.workunit.client.0.smithi042.stdout:5/403: rename d2/d4/d20/d60/l71 to d2/d4/d64/l8f 0 2024-09-19T09:41:39.633 INFO:tasks.workunit.client.0.smithi042.stdout:4/454: sync 2024-09-19T09:41:39.633 INFO:tasks.workunit.client.0.smithi042.stdout:4/455: chown d0/d1b/d1c/d2e/d44/l5f 6 1 2024-09-19T09:41:39.633 INFO:tasks.workunit.client.0.smithi042.stdout:4/456: chown d0/f14 47 1 2024-09-19T09:41:39.633 INFO:tasks.workunit.client.0.smithi042.stdout:4/457: stat d0/d28/d36/c9c 0 2024-09-19T09:41:39.633 INFO:tasks.workunit.client.0.smithi042.stdout:4/458: fdatasync d0/d1b/d1c/d2e/d3f/d5a/f5b 0 2024-09-19T09:41:39.633 INFO:tasks.workunit.client.0.smithi042.stdout:4/459: rename d0/d1b/d1c to d0/d1b/d1c/d2e/d3f/d5a/d9e 22 2024-09-19T09:41:39.634 INFO:tasks.workunit.client.0.smithi042.stdout:9/342: link d8/c45 d8/da/d19/c6a 0 2024-09-19T09:41:39.634 INFO:tasks.workunit.client.0.smithi042.stdout:9/343: stat d8/d32/l40 0 2024-09-19T09:41:39.636 INFO:tasks.workunit.client.0.smithi042.stdout:0/440: mknod d2/d10/d1d/c8c 0 2024-09-19T09:41:39.636 INFO:tasks.workunit.client.0.smithi042.stdout:0/441: getdents d2/d10/d12/d16/d18/d8a 0 2024-09-19T09:41:39.636 INFO:tasks.workunit.client.0.smithi042.stdout:0/442: stat d2/d10/d12/d2e/d32/d64/c68 0 2024-09-19T09:41:39.636 INFO:tasks.workunit.client.0.smithi042.stdout:5/404: symlink d2/d4/d20/d60/d72/d75/l90 0 2024-09-19T09:41:39.636 INFO:tasks.workunit.client.0.smithi042.stdout:5/405: write d2/d4/d20/f62 [3290934,11573] 0 2024-09-19T09:41:39.638 INFO:tasks.workunit.client.0.smithi042.stdout:9/344: rename d8/db/d31/d39/f65 to d8/da/d19/f6b 0 2024-09-19T09:41:39.638 INFO:tasks.workunit.client.0.smithi042.stdout:0/443: unlink d2/fb 0 2024-09-19T09:41:39.639 INFO:tasks.workunit.client.0.smithi042.stdout:5/406: getdents d2/db/d3c/d86 0 2024-09-19T09:41:39.640 INFO:tasks.workunit.client.0.smithi042.stdout:9/345: mknod d8/db/c6c 0 2024-09-19T09:41:39.641 INFO:tasks.workunit.client.0.smithi042.stdout:5/407: symlink d2/l91 0 2024-09-19T09:41:39.642 INFO:tasks.workunit.client.0.smithi042.stdout:5/408: link d2/d4/f15 d2/d25/d4d/f92 0 2024-09-19T09:41:39.644 INFO:tasks.workunit.client.0.smithi042.stdout:5/409: mknod d2/c93 0 2024-09-19T09:41:39.647 INFO:tasks.workunit.client.0.smithi042.stdout:1/514: dwrite d4/d15/d19/f16 [4194304,4194304] 0 2024-09-19T09:41:39.649 INFO:tasks.workunit.client.0.smithi042.stdout:1/515: creat d4/d15/d61/fa7 x:0 0 0 2024-09-19T09:41:39.651 INFO:tasks.workunit.client.0.smithi042.stdout:5/410: write d2/d4/f67 [475527,29273] 0 2024-09-19T09:41:39.655 INFO:tasks.workunit.client.0.smithi042.stdout:5/411: unlink d2/d4/d20/d31/f76 0 2024-09-19T09:41:39.655 INFO:tasks.workunit.client.0.smithi042.stdout:5/412: dread - d2/d4/d20/d60/d72/f8d zero size 2024-09-19T09:41:39.657 INFO:tasks.workunit.client.0.smithi042.stdout:0/444: dread d2/d10/d1d/d34/f4a [0,4194304] 0 2024-09-19T09:41:39.657 INFO:tasks.workunit.client.0.smithi042.stdout:0/445: truncate d2/d10/d12/d2e/d32/f72 668294 0 2024-09-19T09:41:39.657 INFO:tasks.workunit.client.0.smithi042.stdout:9/346: dwrite d8/da/d19/d1c/d21/d67/f62 [0,4194304] 0 2024-09-19T09:41:39.657 INFO:tasks.workunit.client.0.smithi042.stdout:0/446: read d2/d10/d1d/d34/f4a [192577,67206] 0 2024-09-19T09:41:39.657 INFO:tasks.workunit.client.0.smithi042.stdout:5/413: creat d2/db/d3c/f94 x:0 0 0 2024-09-19T09:41:39.661 INFO:tasks.workunit.client.0.smithi042.stdout:1/516: dread d4/d15/d19/fe [4194304,4194304] 0 2024-09-19T09:41:39.661 INFO:tasks.workunit.client.0.smithi042.stdout:1/517: write d4/fa2 [670046,35803] 0 2024-09-19T09:41:39.661 INFO:tasks.workunit.client.0.smithi042.stdout:2/450: dwrite d7/dd/d14/d35/d4e/d63/f81 [0,4194304] 0 2024-09-19T09:41:39.662 INFO:tasks.workunit.client.0.smithi042.stdout:0/447: rmdir d2/d10/d12/d2e/d32 39 2024-09-19T09:41:39.663 INFO:tasks.workunit.client.0.smithi042.stdout:9/347: mknod d8/da/d51/c6d 0 2024-09-19T09:41:39.663 INFO:tasks.workunit.client.0.smithi042.stdout:9/348: fsync d8/d1d/d28/f2d 0 2024-09-19T09:41:39.663 INFO:tasks.workunit.client.0.smithi042.stdout:9/349: readlink d8/da/d19/l29 0 2024-09-19T09:41:39.664 INFO:tasks.workunit.client.0.smithi042.stdout:3/446: dwrite d4/d8/d9/dc/f59 [0,4194304] 0 2024-09-19T09:41:39.665 INFO:tasks.workunit.client.0.smithi042.stdout:5/414: creat d2/f95 x:0 0 0 2024-09-19T09:41:39.666 INFO:tasks.workunit.client.0.smithi042.stdout:1/518: mknod d4/d1e/d25/ca8 0 2024-09-19T09:41:39.666 INFO:tasks.workunit.client.0.smithi042.stdout:1/519: fsync d4/d15/d2e/f37 0 2024-09-19T09:41:39.666 INFO:tasks.workunit.client.0.smithi042.stdout:1/520: fdatasync d4/d15/d2e/f8c 0 2024-09-19T09:41:39.666 INFO:tasks.workunit.client.0.smithi042.stdout:8/474: dwrite d1/da/dd/f88 [0,4194304] 0 2024-09-19T09:41:39.669 INFO:tasks.workunit.client.0.smithi042.stdout:4/460: dwrite d0/f19 [0,4194304] 0 2024-09-19T09:41:39.671 INFO:tasks.workunit.client.0.smithi042.stdout:9/350: unlink d8/db/d31/d39/c59 0 2024-09-19T09:41:39.671 INFO:tasks.workunit.client.0.smithi042.stdout:9/351: stat d8/db/l27 0 2024-09-19T09:41:39.671 INFO:tasks.workunit.client.0.smithi042.stdout:0/448: dread d2/d10/d12/d2e/f46 [0,4194304] 0 2024-09-19T09:41:39.672 INFO:tasks.workunit.client.0.smithi042.stdout:0/449: read d2/d10/d12/d2e/f70 [3331434,80502] 0 2024-09-19T09:41:39.673 INFO:tasks.workunit.client.0.smithi042.stdout:3/447: mknod d4/d8/d4c/d6b/c90 0 2024-09-19T09:41:39.676 INFO:tasks.workunit.client.0.smithi042.stdout:8/475: rmdir d1/da/d32/d41 39 2024-09-19T09:41:39.676 INFO:tasks.workunit.client.0.smithi042.stdout:8/476: dread - d1/da/dd/f3a zero size 2024-09-19T09:41:39.677 INFO:tasks.workunit.client.0.smithi042.stdout:1/521: dread d4/d12/f2d [0,4194304] 0 2024-09-19T09:41:39.677 INFO:tasks.workunit.client.0.smithi042.stdout:1/522: fsync d4/d4e/f57 0 2024-09-19T09:41:39.677 INFO:tasks.workunit.client.0.smithi042.stdout:4/461: symlink d0/d28/d87/l9f 0 2024-09-19T09:41:39.678 INFO:tasks.workunit.client.0.smithi042.stdout:8/477: getdents d1/da/d32/d3d/d59 0 2024-09-19T09:41:39.678 INFO:tasks.workunit.client.0.smithi042.stdout:8/478: write d1/da/d3f/f67 [875819,40122] 0 2024-09-19T09:41:39.678 INFO:tasks.workunit.client.0.smithi042.stdout:8/479: write d1/da/f63 [608556,7302] 0 2024-09-19T09:41:39.679 INFO:tasks.workunit.client.0.smithi042.stdout:8/480: fsync d1/da/dd/f5c 0 2024-09-19T09:41:39.679 INFO:tasks.workunit.client.0.smithi042.stdout:8/481: chown d1/da/d14/l61 1013 1 2024-09-19T09:41:39.680 INFO:tasks.workunit.client.0.smithi042.stdout:8/482: creat d1/da/dd/f8a x:0 0 0 2024-09-19T09:41:39.680 INFO:tasks.workunit.client.0.smithi042.stdout:8/483: chown d1/d2e/f60 3 1 2024-09-19T09:41:39.683 INFO:tasks.workunit.client.0.smithi042.stdout:7/431: sync 2024-09-19T09:41:39.684 INFO:tasks.workunit.client.0.smithi042.stdout:3/448: read d4/d8/d9/dc/f59 [1571758,90622] 0 2024-09-19T09:41:39.686 INFO:tasks.workunit.client.0.smithi042.stdout:3/449: mknod d4/d8/d9/dc/d26/d5c/d82/d48/c91 0 2024-09-19T09:41:39.687 INFO:tasks.workunit.client.0.smithi042.stdout:4/462: write d0/d1b/d1c/f25 [7588443,93705] 0 2024-09-19T09:41:39.689 INFO:tasks.workunit.client.0.smithi042.stdout:0/450: write d2/d10/d12/d16/d51/f56 [700625,74666] 0 2024-09-19T09:41:39.690 INFO:tasks.workunit.client.0.smithi042.stdout:3/450: dread d4/d8/f19 [4194304,4194304] 0 2024-09-19T09:41:39.690 INFO:tasks.workunit.client.0.smithi042.stdout:7/432: write d0/d14/f83 [134874,7313] 0 2024-09-19T09:41:39.690 INFO:tasks.workunit.client.0.smithi042.stdout:7/433: fdatasync d0/d40/f4f 0 2024-09-19T09:41:39.691 INFO:tasks.workunit.client.0.smithi042.stdout:0/451: symlink d2/d10/d12/d16/d18/d8a/l8d 0 2024-09-19T09:41:39.691 INFO:tasks.workunit.client.0.smithi042.stdout:5/415: dwrite d2/db/d3c/f3f [4194304,4194304] 0 2024-09-19T09:41:39.692 INFO:tasks.workunit.client.0.smithi042.stdout:5/416: chown d2/d4/l16 83 1 2024-09-19T09:41:39.692 INFO:tasks.workunit.client.0.smithi042.stdout:7/434: read d0/fb [38563,67185] 0 2024-09-19T09:41:39.692 INFO:tasks.workunit.client.0.smithi042.stdout:7/435: chown d0/d56 2 1 2024-09-19T09:41:39.692 INFO:tasks.workunit.client.0.smithi042.stdout:3/451: creat d4/f92 x:0 0 0 2024-09-19T09:41:39.693 INFO:tasks.workunit.client.0.smithi042.stdout:0/452: rename d2/d10/d12/d2e to d2/d8e 0 2024-09-19T09:41:39.693 INFO:tasks.workunit.client.0.smithi042.stdout:5/417: mknod d2/d4/d64/d6a/c96 0 2024-09-19T09:41:39.694 INFO:tasks.workunit.client.0.smithi042.stdout:9/352: dwrite f1 [0,4194304] 0 2024-09-19T09:41:39.694 INFO:tasks.workunit.client.0.smithi042.stdout:9/353: dread - d8/d32/f69 zero size 2024-09-19T09:41:39.695 INFO:tasks.workunit.client.0.smithi042.stdout:3/452: creat d4/d8/d9/dc/d26/d5c/d82/f93 x:0 0 0 2024-09-19T09:41:39.695 INFO:tasks.workunit.client.0.smithi042.stdout:3/453: chown d4/d8/c50 309833 1 2024-09-19T09:41:39.695 INFO:tasks.workunit.client.0.smithi042.stdout:3/454: fsync d4/d8/d9/dc/d26/d5c/d82/f6c 0 2024-09-19T09:41:39.695 INFO:tasks.workunit.client.0.smithi042.stdout:0/453: getdents d2/d10/d12/d19/d5a 0 2024-09-19T09:41:39.696 INFO:tasks.workunit.client.0.smithi042.stdout:5/418: link d2/d4/d2e/f4e d2/d25/f97 0 2024-09-19T09:41:39.697 INFO:tasks.workunit.client.0.smithi042.stdout:9/354: rmdir d8/da/d19/d1c/d21/d67 39 2024-09-19T09:41:39.699 INFO:tasks.workunit.client.0.smithi042.stdout:0/454: mkdir d2/d10/d12/d19/d5a/d8f 0 2024-09-19T09:41:39.701 INFO:tasks.workunit.client.0.smithi042.stdout:9/355: creat d8/db/d31/d39/f6e x:0 0 0 2024-09-19T09:41:39.705 INFO:tasks.workunit.client.0.smithi042.stdout:1/523: dwrite d4/fa5 [4194304,4194304] 0 2024-09-19T09:41:39.705 INFO:tasks.workunit.client.0.smithi042.stdout:8/484: dwrite d1/da/d32/d3d/d59/f80 [0,4194304] 0 2024-09-19T09:41:39.705 INFO:tasks.workunit.client.0.smithi042.stdout:8/485: truncate d1/da/d3f/f6f 172660 0 2024-09-19T09:41:39.708 INFO:tasks.workunit.client.0.smithi042.stdout:9/356: rename d8/db/f22 to d8/f6f 0 2024-09-19T09:41:39.708 INFO:tasks.workunit.client.0.smithi042.stdout:9/357: write d8/db/d31/f64 [411665,101429] 0 2024-09-19T09:41:39.708 INFO:tasks.workunit.client.0.smithi042.stdout:4/463: dread d0/f14 [0,4194304] 0 2024-09-19T09:41:39.708 INFO:tasks.workunit.client.0.smithi042.stdout:8/486: link d1/l66 d1/da/d32/d41/d55/l8b 0 2024-09-19T09:41:39.709 INFO:tasks.workunit.client.0.smithi042.stdout:9/358: mkdir d8/da/d70 0 2024-09-19T09:41:39.712 INFO:tasks.workunit.client.0.smithi042.stdout:4/464: rename d0/d1b/d1c/d94 to d0/d1b/d1c/d2e/d3f/d6e/da0 0 2024-09-19T09:41:39.714 INFO:tasks.workunit.client.0.smithi042.stdout:7/436: dwrite d0/d14/d44/f54 [0,4194304] 0 2024-09-19T09:41:39.716 INFO:tasks.workunit.client.0.smithi042.stdout:8/487: write d1/f9 [573756,57672] 0 2024-09-19T09:41:39.716 INFO:tasks.workunit.client.0.smithi042.stdout:9/359: rename d8/da/l30 to d8/da/d19/l71 0 2024-09-19T09:41:39.718 INFO:tasks.workunit.client.0.smithi042.stdout:4/465: mkdir d0/d28/d87/da1 0 2024-09-19T09:41:39.718 INFO:tasks.workunit.client.0.smithi042.stdout:3/455: dwrite d4/d8/d9/dc/f2b [0,4194304] 0 2024-09-19T09:41:39.722 INFO:tasks.workunit.client.0.smithi042.stdout:8/488: dread d1/da/f12 [0,4194304] 0 2024-09-19T09:41:39.724 INFO:tasks.workunit.client.0.smithi042.stdout:7/437: creat d0/d14/d5d/f8f x:0 0 0 2024-09-19T09:41:39.724 INFO:tasks.workunit.client.0.smithi042.stdout:1/524: dwrite d4/d29/f38 [0,4194304] 0 2024-09-19T09:41:39.725 INFO:tasks.workunit.client.0.smithi042.stdout:5/419: dwrite d2/f7 [0,4194304] 0 2024-09-19T09:41:39.726 INFO:tasks.workunit.client.0.smithi042.stdout:8/489: rename d1/da/d32/d41/l77 to d1/da/d3f/l8c 0 2024-09-19T09:41:39.727 INFO:tasks.workunit.client.0.smithi042.stdout:7/438: symlink d0/d40/l90 0 2024-09-19T09:41:39.727 INFO:tasks.workunit.client.0.smithi042.stdout:7/439: write d0/d3d/d55/d72/f86 [117892,69906] 0 2024-09-19T09:41:39.728 INFO:tasks.workunit.client.0.smithi042.stdout:1/525: creat d4/d1d/fa9 x:0 0 0 2024-09-19T09:41:39.729 INFO:tasks.workunit.client.0.smithi042.stdout:9/360: write f5 [1306682,119856] 0 2024-09-19T09:41:39.730 INFO:tasks.workunit.client.0.smithi042.stdout:8/490: symlink d1/da/d32/d41/l8d 0 2024-09-19T09:41:39.730 INFO:tasks.workunit.client.0.smithi042.stdout:8/491: read d1/da/f12 [3154094,60027] 0 2024-09-19T09:41:39.731 INFO:tasks.workunit.client.0.smithi042.stdout:7/440: creat d0/d3d/d55/d78/f91 x:0 0 0 2024-09-19T09:41:39.731 INFO:tasks.workunit.client.0.smithi042.stdout:7/441: chown d0/d14/d3a/f7e 14989 1 2024-09-19T09:41:39.731 INFO:tasks.workunit.client.0.smithi042.stdout:7/442: fsync d0/d14/d3a/f3f 0 2024-09-19T09:41:39.733 INFO:tasks.workunit.client.0.smithi042.stdout:3/456: dread d4/d8/f36 [4194304,4194304] 0 2024-09-19T09:41:39.733 INFO:tasks.workunit.client.0.smithi042.stdout:1/526: link d4/d1e/d25/d35/d3c/f59 d4/d12/faa 0 2024-09-19T09:41:39.735 INFO:tasks.workunit.client.0.smithi042.stdout:9/361: mkdir d8/da/d51/d72 0 2024-09-19T09:41:39.735 INFO:tasks.workunit.client.0.smithi042.stdout:9/362: write d8/db/f34 [1000085,109655] 0 2024-09-19T09:41:39.735 INFO:tasks.workunit.client.0.smithi042.stdout:9/363: rename d8 to d8/da/d51/d73 22 2024-09-19T09:41:39.736 INFO:tasks.workunit.client.0.smithi042.stdout:3/457: creat d4/d8/d9/dc/d26/d5c/f94 x:0 0 0 2024-09-19T09:41:39.736 INFO:tasks.workunit.client.0.smithi042.stdout:3/458: write d4/f92 [172045,42929] 0 2024-09-19T09:41:39.736 INFO:tasks.workunit.client.0.smithi042.stdout:3/459: fdatasync d4/d8/d9/dc/f59 0 2024-09-19T09:41:39.737 INFO:tasks.workunit.client.0.smithi042.stdout:1/527: creat d4/d15/d61/d85/fab x:0 0 0 2024-09-19T09:41:39.737 INFO:tasks.workunit.client.0.smithi042.stdout:1/528: fdatasync d4/fa5 0 2024-09-19T09:41:39.739 INFO:tasks.workunit.client.0.smithi042.stdout:3/460: mknod d4/d8/d9/dc/d26/d8b/c95 0 2024-09-19T09:41:39.742 INFO:tasks.workunit.client.0.smithi042.stdout:3/461: write d4/d8/d9/f56 [4441205,129344] 0 2024-09-19T09:41:39.745 INFO:tasks.workunit.client.0.smithi042.stdout:4/466: dwrite d0/d1b/d1c/d2e/f76 [0,4194304] 0 2024-09-19T09:41:39.749 INFO:tasks.workunit.client.0.smithi042.stdout:8/492: dread d1/da/d32/f64 [0,4194304] 0 2024-09-19T09:41:39.749 INFO:tasks.workunit.client.0.smithi042.stdout:4/467: link d0/c1a d0/d1b/d56/d86/ca2 0 2024-09-19T09:41:39.749 INFO:tasks.workunit.client.0.smithi042.stdout:4/468: truncate d0/d1b/d1c/d61/d7f/d83/f99 142514 0 2024-09-19T09:41:39.749 INFO:tasks.workunit.client.0.smithi042.stdout:4/469: fsync d0/d1b/d1c/f4f 0 2024-09-19T09:41:39.750 INFO:tasks.workunit.client.0.smithi042.stdout:8/493: mkdir d1/da/dd/d8e 0 2024-09-19T09:41:39.751 INFO:tasks.workunit.client.0.smithi042.stdout:3/462: dread d4/d8/d9/dc/f59 [0,4194304] 0 2024-09-19T09:41:39.751 INFO:tasks.workunit.client.0.smithi042.stdout:4/470: mknod d0/d1b/d1c/d2e/d44/ca3 0 2024-09-19T09:41:39.752 INFO:tasks.workunit.client.0.smithi042.stdout:3/463: truncate d4/d8/d9/d1b/f63 5337571 0 2024-09-19T09:41:39.752 INFO:tasks.workunit.client.0.smithi042.stdout:3/464: stat d4/d8/f19 0 2024-09-19T09:41:39.752 INFO:tasks.workunit.client.0.smithi042.stdout:8/494: link d1/c34 d1/da/dd/d8e/c8f 0 2024-09-19T09:41:39.753 INFO:tasks.workunit.client.0.smithi042.stdout:4/471: mknod d0/d1b/d1c/d61/d7f/ca4 0 2024-09-19T09:41:39.753 INFO:tasks.workunit.client.0.smithi042.stdout:3/465: truncate d4/d8/d9/d1b/d4f/f70 1535901 0 2024-09-19T09:41:39.756 INFO:tasks.workunit.client.0.smithi042.stdout:4/472: creat d0/d1b/d1c/d61/d7f/d83/fa5 x:0 0 0 2024-09-19T09:41:39.757 INFO:tasks.workunit.client.0.smithi042.stdout:3/466: mknod d4/d8/d9/dc/c96 0 2024-09-19T09:41:39.759 INFO:tasks.workunit.client.0.smithi042.stdout:4/473: truncate d0/d1b/d1c/f25 2395344 0 2024-09-19T09:41:39.759 INFO:tasks.workunit.client.0.smithi042.stdout:4/474: chown d0/d1b/d1c/d2e/d3f/d6b/d8f 31 1 2024-09-19T09:41:39.759 INFO:tasks.workunit.client.0.smithi042.stdout:4/475: write d0/d1b/d1c/d2e/f50 [1225674,124514] 0 2024-09-19T09:41:39.760 INFO:tasks.workunit.client.0.smithi042.stdout:3/467: getdents d4/d8/d9/d1b 0 2024-09-19T09:41:39.760 INFO:tasks.workunit.client.0.smithi042.stdout:3/468: dread - d4/d8/d9/dc/d26/d5c/f94 zero size 2024-09-19T09:41:39.760 INFO:tasks.workunit.client.0.smithi042.stdout:3/469: chown d4/d8/d4c/f5f 1842280 1 2024-09-19T09:41:39.760 INFO:tasks.workunit.client.0.smithi042.stdout:1/529: dwrite d4/d1e/d25/d35/d3c/f59 [0,4194304] 0 2024-09-19T09:41:39.761 INFO:tasks.workunit.client.0.smithi042.stdout:4/476: truncate d0/d1b/f2a 915435 0 2024-09-19T09:41:39.762 INFO:tasks.workunit.client.0.smithi042.stdout:3/470: mknod d4/d8/d9/d39/c97 0 2024-09-19T09:41:39.762 INFO:tasks.workunit.client.0.smithi042.stdout:3/471: chown d4/d8/d9/d1b/l5b 120431 1 2024-09-19T09:41:39.763 INFO:tasks.workunit.client.0.smithi042.stdout:3/472: write d4/d8/d9/dc/d26/d5c/d82/f1a [238264,39276] 0 2024-09-19T09:41:39.764 INFO:tasks.workunit.client.0.smithi042.stdout:1/530: symlink d4/d4e/lac 0 2024-09-19T09:41:39.764 INFO:tasks.workunit.client.0.smithi042.stdout:1/531: write d4/d29/d3e/fa6 [1042847,127076] 0 2024-09-19T09:41:39.765 INFO:tasks.workunit.client.0.smithi042.stdout:8/495: dwrite d1/da/dd/d74/f7e [0,4194304] 0 2024-09-19T09:41:39.765 INFO:tasks.workunit.client.0.smithi042.stdout:3/473: unlink d4/d2a/f75 0 2024-09-19T09:41:39.768 INFO:tasks.workunit.client.0.smithi042.stdout:1/532: mknod d4/d15/d19/d42/d51/d79/cad 0 2024-09-19T09:41:39.770 INFO:tasks.workunit.client.0.smithi042.stdout:4/477: write d0/d1b/f41 [3050177,85653] 0 2024-09-19T09:41:39.770 INFO:tasks.workunit.client.0.smithi042.stdout:4/478: write d0/d67/f8e [542790,75367] 0 2024-09-19T09:41:39.772 INFO:tasks.workunit.client.0.smithi042.stdout:3/474: link d4/d2a/c37 d4/d8/d9/dc/c98 0 2024-09-19T09:41:39.772 INFO:tasks.workunit.client.0.smithi042.stdout:3/475: chown d4/l18 2001 1 2024-09-19T09:41:39.772 INFO:tasks.workunit.client.0.smithi042.stdout:3/476: fdatasync d4/d8/f36 0 2024-09-19T09:41:39.772 INFO:tasks.workunit.client.0.smithi042.stdout:3/477: chown d4/d8/d9/d39/d4b/d7d/c88 8814868 1 2024-09-19T09:41:39.773 INFO:tasks.workunit.client.0.smithi042.stdout:7/443: dwrite d0/d14/d3a/f3e [0,4194304] 0 2024-09-19T09:41:39.773 INFO:tasks.workunit.client.0.smithi042.stdout:9/364: dwrite d8/da/d19/d1c/d21/d67/f5b [0,4194304] 0 2024-09-19T09:41:39.774 INFO:tasks.workunit.client.0.smithi042.stdout:5/420: dwrite d2/d4/f56 [0,4194304] 0 2024-09-19T09:41:39.774 INFO:tasks.workunit.client.0.smithi042.stdout:5/421: readlink d2/d4/d20/d60/l69 0 2024-09-19T09:41:39.778 INFO:tasks.workunit.client.0.smithi042.stdout:3/478: rmdir d4/d8/d9 39 2024-09-19T09:41:39.778 INFO:tasks.workunit.client.0.smithi042.stdout:3/479: dread - d4/d8/d9/dc/f6e zero size 2024-09-19T09:41:39.778 INFO:tasks.workunit.client.0.smithi042.stdout:3/480: readlink d4/d8/d9/dc/l38 0 2024-09-19T09:41:39.778 INFO:tasks.workunit.client.0.smithi042.stdout:4/479: dread d0/d1b/d1c/d2e/d3b/f53 [0,4194304] 0 2024-09-19T09:41:39.784 INFO:tasks.workunit.client.0.smithi042.stdout:4/480: dread d0/d1b/f1e [0,4194304] 0 2024-09-19T09:41:39.784 INFO:tasks.workunit.client.0.smithi042.stdout:9/365: mknod d8/da/d51/d72/c74 0 2024-09-19T09:41:39.784 INFO:tasks.workunit.client.0.smithi042.stdout:5/422: write d2/db/f2f [2976845,50573] 0 2024-09-19T09:41:39.784 INFO:tasks.workunit.client.0.smithi042.stdout:5/423: chown d2/d4/d20/f38 1806072 1 2024-09-19T09:41:39.790 INFO:tasks.workunit.client.0.smithi042.stdout:1/533: dwrite d4/d29/d3e/f3b [0,4194304] 0 2024-09-19T09:41:39.790 INFO:tasks.workunit.client.0.smithi042.stdout:7/444: dwrite d0/f17 [0,4194304] 0 2024-09-19T09:41:39.791 INFO:tasks.workunit.client.0.smithi042.stdout:3/481: creat d4/d8/d9/dc/d26/d8b/f99 x:0 0 0 2024-09-19T09:41:39.794 INFO:tasks.workunit.client.0.smithi042.stdout:5/424: dread d2/db/d3c/f3f [4194304,4194304] 0 2024-09-19T09:41:39.794 INFO:tasks.workunit.client.0.smithi042.stdout:5/425: write d2/f95 [1047925,76683] 0 2024-09-19T09:41:39.795 INFO:tasks.workunit.client.0.smithi042.stdout:9/366: stat d8/c18 0 2024-09-19T09:41:39.795 INFO:tasks.workunit.client.0.smithi042.stdout:4/481: truncate d0/d1b/d1c/d2e/d3b/f53 1392824 0 2024-09-19T09:41:39.795 INFO:tasks.workunit.client.0.smithi042.stdout:9/367: chown d8/da/f10 49 1 2024-09-19T09:41:39.795 INFO:tasks.workunit.client.0.smithi042.stdout:4/482: read - d0/d1b/d56/d86/f8c zero size 2024-09-19T09:41:39.795 INFO:tasks.workunit.client.0.smithi042.stdout:4/483: stat d0/d1b/d1c/d2e/d44/l72 0 2024-09-19T09:41:39.795 INFO:tasks.workunit.client.0.smithi042.stdout:4/484: write d0/d1b/f26 [634837,45852] 0 2024-09-19T09:41:39.795 INFO:tasks.workunit.client.0.smithi042.stdout:7/445: getdents d0 0 2024-09-19T09:41:39.796 INFO:tasks.workunit.client.0.smithi042.stdout:3/482: link d4/d8/d9/dc/d26/f32 d4/d8/f9a 0 2024-09-19T09:41:39.797 INFO:tasks.workunit.client.0.smithi042.stdout:5/426: symlink d2/db/d42/l98 0 2024-09-19T09:41:39.798 INFO:tasks.workunit.client.0.smithi042.stdout:9/368: creat d8/db/d31/f75 x:0 0 0 2024-09-19T09:41:39.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/485: symlink d0/d1b/d1c/d2e/d3b/d95/la6 0 2024-09-19T09:41:39.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/486: stat d0/d1b/d1c/l78 0 2024-09-19T09:41:39.800 INFO:tasks.workunit.client.0.smithi042.stdout:9/369: write d8/db/f34 [148507,112043] 0 2024-09-19T09:41:39.800 INFO:tasks.workunit.client.0.smithi042.stdout:7/446: mkdir d0/d3d/d92 0 2024-09-19T09:41:39.801 INFO:tasks.workunit.client.0.smithi042.stdout:3/483: creat d4/d8/d9/dc/f9b x:0 0 0 2024-09-19T09:41:39.801 INFO:tasks.workunit.client.0.smithi042.stdout:3/484: write d4/d8/d9/dc/f6e [428527,84459] 0 2024-09-19T09:41:39.802 INFO:tasks.workunit.client.0.smithi042.stdout:5/427: symlink d2/db/d42/l99 0 2024-09-19T09:41:39.803 INFO:tasks.workunit.client.0.smithi042.stdout:2/451: sync 2024-09-19T09:41:39.803 INFO:tasks.workunit.client.0.smithi042.stdout:0/455: sync 2024-09-19T09:41:39.803 INFO:tasks.workunit.client.0.smithi042.stdout:6/432: sync 2024-09-19T09:41:39.805 INFO:tasks.workunit.client.0.smithi042.stdout:2/452: rename d7/dd/d14/d35/d45/d5e/c2f to d7/dd/d1f/c93 0 2024-09-19T09:41:39.805 INFO:tasks.workunit.client.0.smithi042.stdout:2/453: stat d7/dd/d22/f24 0 2024-09-19T09:41:39.807 INFO:tasks.workunit.client.0.smithi042.stdout:1/534: dwrite d4/d4e/f55 [0,4194304] 0 2024-09-19T09:41:39.808 INFO:tasks.workunit.client.0.smithi042.stdout:9/370: dread d8/db/f34 [0,4194304] 0 2024-09-19T09:41:39.808 INFO:tasks.workunit.client.0.smithi042.stdout:9/371: stat d8/d1d/d28/c37 0 2024-09-19T09:41:39.808 INFO:tasks.workunit.client.0.smithi042.stdout:9/372: write d8/d1d/d28/f43 [5113761,72385] 0 2024-09-19T09:41:39.808 INFO:tasks.workunit.client.0.smithi042.stdout:0/456: link d2/d10/d12/d16/d18/c1a d2/d10/d12/d16/d18/c90 0 2024-09-19T09:41:39.810 INFO:tasks.workunit.client.0.smithi042.stdout:1/535: mkdir d4/d15/d19/dae 0 2024-09-19T09:41:39.811 INFO:tasks.workunit.client.0.smithi042.stdout:7/447: read d0/d14/f4e [254948,35775] 0 2024-09-19T09:41:39.811 INFO:tasks.workunit.client.0.smithi042.stdout:7/448: write d0/d3d/f4b [2659570,6012] 0 2024-09-19T09:41:39.811 INFO:tasks.workunit.client.0.smithi042.stdout:7/449: read - d0/d3d/d55/d72/f8c zero size 2024-09-19T09:41:39.811 INFO:tasks.workunit.client.0.smithi042.stdout:7/450: read d0/d56/f66 [91975,62335] 0 2024-09-19T09:41:39.812 INFO:tasks.workunit.client.0.smithi042.stdout:9/373: truncate f1 4175342 0 2024-09-19T09:41:39.812 INFO:tasks.workunit.client.0.smithi042.stdout:9/374: chown d8/f11 3419860 1 2024-09-19T09:41:39.812 INFO:tasks.workunit.client.0.smithi042.stdout:0/457: getdents d2/d10/d1d 0 2024-09-19T09:41:39.813 INFO:tasks.workunit.client.0.smithi042.stdout:1/536: rmdir d4/d15/d19/d42/d51 39 2024-09-19T09:41:39.815 INFO:tasks.workunit.client.0.smithi042.stdout:0/458: unlink d2/d10/d12/d19/d6d/c84 0 2024-09-19T09:41:39.815 INFO:tasks.workunit.client.0.smithi042.stdout:0/459: write d2/d8e/f4c [1773534,5692] 0 2024-09-19T09:41:39.816 INFO:tasks.workunit.client.0.smithi042.stdout:0/460: truncate f0 4549588 0 2024-09-19T09:41:39.819 INFO:tasks.workunit.client.0.smithi042.stdout:7/451: write d0/d40/f6c [2770573,35592] 0 2024-09-19T09:41:39.821 INFO:tasks.workunit.client.0.smithi042.stdout:7/452: mknod d0/d3d/d55/c93 0 2024-09-19T09:41:39.822 INFO:tasks.workunit.client.0.smithi042.stdout:9/375: write d8/d1d/d28/f2d [442844,37328] 0 2024-09-19T09:41:39.822 INFO:tasks.workunit.client.0.smithi042.stdout:9/376: rename d8 to d8/d32/d76 22 2024-09-19T09:41:39.823 INFO:tasks.workunit.client.0.smithi042.stdout:0/461: dread d2/d10/d12/f31 [0,4194304] 0 2024-09-19T09:41:39.826 INFO:tasks.workunit.client.0.smithi042.stdout:2/454: write d7/dd/d14/d35/d4e/d63/f81 [1298451,126994] 0 2024-09-19T09:41:39.828 INFO:tasks.workunit.client.0.smithi042.stdout:2/455: link d7/dd/f15 d7/dd/d22/d43/f94 0 2024-09-19T09:41:39.829 INFO:tasks.workunit.client.0.smithi042.stdout:7/453: getdents d0/d3d/d55 0 2024-09-19T09:41:39.829 INFO:tasks.workunit.client.0.smithi042.stdout:7/454: fsync d0/fa 0 2024-09-19T09:41:39.829 INFO:tasks.workunit.client.0.smithi042.stdout:9/377: dread d8/da/d19/d1c/d21/d67/f62 [0,4194304] 0 2024-09-19T09:41:39.830 INFO:tasks.workunit.client.0.smithi042.stdout:9/378: getdents d8/da/d19/d1c/d21 0 2024-09-19T09:41:39.832 INFO:tasks.workunit.client.0.smithi042.stdout:9/379: unlink d8/da/l52 0 2024-09-19T09:41:39.835 INFO:tasks.workunit.client.0.smithi042.stdout:2/456: write d7/dd/f47 [1285657,33802] 0 2024-09-19T09:41:39.836 INFO:tasks.workunit.client.0.smithi042.stdout:2/457: getdents d7/dd/d14/d35/d4c/d70 0 2024-09-19T09:41:39.837 INFO:tasks.workunit.client.0.smithi042.stdout:2/458: creat d7/dd/d14/d35/d6b/d88/f95 x:0 0 0 2024-09-19T09:41:39.837 INFO:tasks.workunit.client.0.smithi042.stdout:2/459: readlink d7/dd/d14/d35/d4e/l54 0 2024-09-19T09:41:39.842 INFO:tasks.workunit.client.0.smithi042.stdout:4/487: dwrite d0/d1b/d56/d86/f9b [0,4194304] 0 2024-09-19T09:41:39.842 INFO:tasks.workunit.client.0.smithi042.stdout:6/433: dwrite d1/d20/f27 [0,4194304] 0 2024-09-19T09:41:39.843 INFO:tasks.workunit.client.0.smithi042.stdout:3/485: dwrite d4/d8/d9/dc/d26/d5c/d82/f29 [4194304,4194304] 0 2024-09-19T09:41:39.843 INFO:tasks.workunit.client.0.smithi042.stdout:1/537: dwrite d4/d15/d19/d45/f4d [0,4194304] 0 2024-09-19T09:41:39.845 INFO:tasks.workunit.client.0.smithi042.stdout:4/488: symlink d0/d1b/d1c/d2e/la7 0 2024-09-19T09:41:39.848 INFO:tasks.workunit.client.0.smithi042.stdout:6/434: creat d1/de/d12/d1c/f77 x:0 0 0 2024-09-19T09:41:39.848 INFO:tasks.workunit.client.0.smithi042.stdout:6/435: dread - d1/de/d12/d1c/d5f/f6e zero size 2024-09-19T09:41:39.849 INFO:tasks.workunit.client.0.smithi042.stdout:3/486: mkdir d4/d8/d9/d1b/d4f/d9c 0 2024-09-19T09:41:39.850 INFO:tasks.workunit.client.0.smithi042.stdout:9/380: dwrite d8/d1d/f1f [0,4194304] 0 2024-09-19T09:41:39.850 INFO:tasks.workunit.client.0.smithi042.stdout:9/381: fsync d8/f3d 0 2024-09-19T09:41:39.850 INFO:tasks.workunit.client.0.smithi042.stdout:9/382: write d8/f6f [2047617,93494] 0 2024-09-19T09:41:39.850 INFO:tasks.workunit.client.0.smithi042.stdout:9/383: readlink d8/db/d31/d39/l60 0 2024-09-19T09:41:39.850 INFO:tasks.workunit.client.0.smithi042.stdout:9/384: fdatasync d8/d1d/f1f 0 2024-09-19T09:41:39.851 INFO:tasks.workunit.client.0.smithi042.stdout:6/436: creat d1/de/d12/d22/d34/d6f/d4a/f78 x:0 0 0 2024-09-19T09:41:39.851 INFO:tasks.workunit.client.0.smithi042.stdout:7/455: dwrite d0/d3d/f4a [0,4194304] 0 2024-09-19T09:41:39.851 INFO:tasks.workunit.client.0.smithi042.stdout:7/456: write d0/d56/f62 [3013066,25695] 0 2024-09-19T09:41:39.851 INFO:tasks.workunit.client.0.smithi042.stdout:3/487: mkdir d4/d78/d9d 0 2024-09-19T09:41:39.853 INFO:tasks.workunit.client.0.smithi042.stdout:9/385: rename d8/da/d19/d1c/d21/d67/l5f to d8/da/l77 0 2024-09-19T09:41:39.853 INFO:tasks.workunit.client.0.smithi042.stdout:9/386: chown d8/da/f10 1164466 1 2024-09-19T09:41:39.854 INFO:tasks.workunit.client.0.smithi042.stdout:6/437: mknod d1/de/d5d/c79 0 2024-09-19T09:41:39.854 INFO:tasks.workunit.client.0.smithi042.stdout:6/438: chown d1/de/d54/l6b 14295875 1 2024-09-19T09:41:39.854 INFO:tasks.workunit.client.0.smithi042.stdout:6/439: chown d1/de/d12/d22/d34/d3f/f50 168730 1 2024-09-19T09:41:39.854 INFO:tasks.workunit.client.0.smithi042.stdout:6/440: chown d1/de/d12/d22/d34/f73 260124 1 2024-09-19T09:41:39.854 INFO:tasks.workunit.client.0.smithi042.stdout:4/489: write d0/d1b/d1c/d2e/f76 [1175283,31140] 0 2024-09-19T09:41:39.855 INFO:tasks.workunit.client.0.smithi042.stdout:7/457: mknod d0/d56/c94 0 2024-09-19T09:41:39.855 INFO:tasks.workunit.client.0.smithi042.stdout:7/458: chown d0/d14/c7b 130 1 2024-09-19T09:41:39.855 INFO:tasks.workunit.client.0.smithi042.stdout:7/459: fsync d0/f33 0 2024-09-19T09:41:39.856 INFO:tasks.workunit.client.0.smithi042.stdout:9/387: link d8/da/d19/d1c/c4d d8/da/d19/d1c/d21/c78 0 2024-09-19T09:41:39.857 INFO:tasks.workunit.client.0.smithi042.stdout:6/441: rename d1/d20/d6a/d46/f49 to d1/de/d76/f7a 0 2024-09-19T09:41:39.858 INFO:tasks.workunit.client.0.smithi042.stdout:6/442: chown d1/de/d54 96423 1 2024-09-19T09:41:39.858 INFO:tasks.workunit.client.0.smithi042.stdout:4/490: truncate d0/d1b/f32 3961243 0 2024-09-19T09:41:39.859 INFO:tasks.workunit.client.0.smithi042.stdout:7/460: creat d0/d3d/d92/f95 x:0 0 0 2024-09-19T09:41:39.861 INFO:tasks.workunit.client.0.smithi042.stdout:7/461: dread d0/d3d/d55/d72/f86 [0,4194304] 0 2024-09-19T09:41:39.861 INFO:tasks.workunit.client.0.smithi042.stdout:9/388: unlink d8/db/l13 0 2024-09-19T09:41:39.861 INFO:tasks.workunit.client.0.smithi042.stdout:2/460: dwrite d7/dd/d22/d43/f52 [0,4194304] 0 2024-09-19T09:41:39.861 INFO:tasks.workunit.client.0.smithi042.stdout:2/461: chown d7/l6d 4490123 1 2024-09-19T09:41:39.862 INFO:tasks.workunit.client.0.smithi042.stdout:6/443: symlink d1/d20/d6a/d46/l7b 0 2024-09-19T09:41:39.864 INFO:tasks.workunit.client.0.smithi042.stdout:4/491: creat d0/d67/d96/fa8 x:0 0 0 2024-09-19T09:41:39.864 INFO:tasks.workunit.client.0.smithi042.stdout:4/492: dread - d0/d28/d87/f8d zero size 2024-09-19T09:41:39.865 INFO:tasks.workunit.client.0.smithi042.stdout:7/462: mkdir d0/d3d/d55/d78/d96 0 2024-09-19T09:41:39.867 INFO:tasks.workunit.client.0.smithi042.stdout:9/389: symlink d8/d32/l79 0 2024-09-19T09:41:39.868 INFO:tasks.workunit.client.0.smithi042.stdout:4/493: unlink d0/d1b/d56/d86/f8c 0 2024-09-19T09:41:39.870 INFO:tasks.workunit.client.0.smithi042.stdout:9/390: creat d8/da/d70/f7a x:0 0 0 2024-09-19T09:41:39.870 INFO:tasks.workunit.client.0.smithi042.stdout:9/391: dread - d8/d32/f58 zero size 2024-09-19T09:41:39.872 INFO:tasks.workunit.client.0.smithi042.stdout:4/494: getdents d0/d1b/d1c/d2e/d44 0 2024-09-19T09:41:39.872 INFO:tasks.workunit.client.0.smithi042.stdout:4/495: chown d0/d28/d36/c65 413909 1 2024-09-19T09:41:39.872 INFO:tasks.workunit.client.0.smithi042.stdout:4/496: fdatasync d0/d1b/d1c/d2e/d3b/f7d 0 2024-09-19T09:41:39.872 INFO:tasks.workunit.client.0.smithi042.stdout:4/497: write d0/d1b/d1c/d2e/f76 [1124650,26462] 0 2024-09-19T09:41:39.872 INFO:tasks.workunit.client.0.smithi042.stdout:1/538: dwrite d4/d15/d19/f87 [0,4194304] 0 2024-09-19T09:41:39.872 INFO:tasks.workunit.client.0.smithi042.stdout:9/392: dread d8/da/f50 [0,4194304] 0 2024-09-19T09:41:39.872 INFO:tasks.workunit.client.0.smithi042.stdout:3/488: dwrite d4/f34 [0,4194304] 0 2024-09-19T09:41:39.874 INFO:tasks.workunit.client.0.smithi042.stdout:4/498: getdents d0/d28 0 2024-09-19T09:41:39.874 INFO:tasks.workunit.client.0.smithi042.stdout:4/499: dread - d0/d1b/d1c/d61/d7f/f8a zero size 2024-09-19T09:41:39.874 INFO:tasks.workunit.client.0.smithi042.stdout:4/500: stat d0/d1b/d1c/d2e/d44/l72 0 2024-09-19T09:41:39.877 INFO:tasks.workunit.client.0.smithi042.stdout:1/539: link d4/l6a d4/d1e/d25/d35/laf 0 2024-09-19T09:41:39.878 INFO:tasks.workunit.client.0.smithi042.stdout:9/393: mkdir d8/da/d19/d1c/d21/d67/d7b 0 2024-09-19T09:41:39.878 INFO:tasks.workunit.client.0.smithi042.stdout:9/394: dread - d8/da/d19/f6b zero size 2024-09-19T09:41:39.883 INFO:tasks.workunit.client.0.smithi042.stdout:3/489: creat d4/d2a/f9e x:0 0 0 2024-09-19T09:41:39.885 INFO:tasks.workunit.client.0.smithi042.stdout:1/540: rename d4/d12/d8d/d91/c64 to d4/d15/d19/d45/d82/cb0 0 2024-09-19T09:41:39.893 INFO:tasks.workunit.client.0.smithi042.stdout:7/463: dwrite d0/d3d/f4b [0,4194304] 0 2024-09-19T09:41:39.894 INFO:tasks.workunit.client.0.smithi042.stdout:2/462: dwrite d7/dd/d1f/d3f/f6c [0,4194304] 0 2024-09-19T09:41:39.894 INFO:tasks.workunit.client.0.smithi042.stdout:3/490: dread d4/d8/f9a [0,4194304] 0 2024-09-19T09:41:39.894 INFO:tasks.workunit.client.0.smithi042.stdout:6/444: dwrite d1/de/d12/d22/d34/f3d [4194304,4194304] 0 2024-09-19T09:41:39.895 INFO:tasks.workunit.client.0.smithi042.stdout:7/464: creat d0/d56/d5c/f97 x:0 0 0 2024-09-19T09:41:39.895 INFO:tasks.workunit.client.0.smithi042.stdout:7/465: fdatasync d0/d3d/d55/f71 0 2024-09-19T09:41:39.895 INFO:tasks.workunit.client.0.smithi042.stdout:9/395: dwrite d8/d1d/d28/f43 [0,4194304] 0 2024-09-19T09:41:39.896 INFO:tasks.workunit.client.0.smithi042.stdout:2/463: dread d7/dd/f59 [0,4194304] 0 2024-09-19T09:41:39.897 INFO:tasks.workunit.client.0.smithi042.stdout:2/464: mkdir d7/dd/d48/d96 0 2024-09-19T09:41:39.897 INFO:tasks.workunit.client.0.smithi042.stdout:6/445: creat d1/de/d12/d22/d34/d6f/f7c x:0 0 0 2024-09-19T09:41:39.897 INFO:tasks.workunit.client.0.smithi042.stdout:6/446: write d1/f52 [1019791,114047] 0 2024-09-19T09:41:39.898 INFO:tasks.workunit.client.0.smithi042.stdout:2/465: getdents d7/dd 0 2024-09-19T09:41:39.898 INFO:tasks.workunit.client.0.smithi042.stdout:7/466: link d0/d14/l64 d0/d40/l98 0 2024-09-19T09:41:39.898 INFO:tasks.workunit.client.0.smithi042.stdout:7/467: fdatasync d0/d56/d5c/f63 0 2024-09-19T09:41:39.900 INFO:tasks.workunit.client.0.smithi042.stdout:3/491: dread d4/d2a/f86 [0,4194304] 0 2024-09-19T09:41:39.900 INFO:tasks.workunit.client.0.smithi042.stdout:3/492: chown d4/d8/d9/l1d 0 1 2024-09-19T09:41:39.900 INFO:tasks.workunit.client.0.smithi042.stdout:9/396: creat d8/da/d19/f7c x:0 0 0 2024-09-19T09:41:39.901 INFO:tasks.workunit.client.0.smithi042.stdout:6/447: rename d1/de/d12/d1c/c26 to d1/de/d12/d22/d34/d6f/c7d 0 2024-09-19T09:41:39.903 INFO:tasks.workunit.client.0.smithi042.stdout:7/468: mkdir d0/d3d/d85/d99 0 2024-09-19T09:41:39.904 INFO:tasks.workunit.client.0.smithi042.stdout:2/466: dread d7/dd/d14/f1d [0,4194304] 0 2024-09-19T09:41:39.910 INFO:tasks.workunit.client.0.smithi042.stdout:1/541: dwrite d4/d15/d44/f71 [0,4194304] 0 2024-09-19T09:41:39.910 INFO:tasks.workunit.client.0.smithi042.stdout:9/397: write d8/f24 [261949,44674] 0 2024-09-19T09:41:39.915 INFO:tasks.workunit.client.0.smithi042.stdout:7/469: dread d0/d14/d3a/f3e [0,4194304] 0 2024-09-19T09:41:39.919 INFO:tasks.workunit.client.0.smithi042.stdout:7/470: rename d0/d56/d5c/c84 to d0/d3d/d55/d78/c9a 0 2024-09-19T09:41:39.919 INFO:tasks.workunit.client.0.smithi042.stdout:7/471: truncate d0/d14/d3a/f81 886909 0 2024-09-19T09:41:39.920 INFO:tasks.workunit.client.0.smithi042.stdout:7/472: mkdir d0/d3d/d55/d72/d9b 0 2024-09-19T09:41:39.922 INFO:tasks.workunit.client.0.smithi042.stdout:3/493: dwrite d4/d8/f72 [0,4194304] 0 2024-09-19T09:41:39.922 INFO:tasks.workunit.client.0.smithi042.stdout:3/494: write d4/d8/d4c/f7b [350510,122683] 0 2024-09-19T09:41:39.923 INFO:tasks.workunit.client.0.smithi042.stdout:9/398: dread d8/db/f61 [0,4194304] 0 2024-09-19T09:41:39.926 INFO:tasks.workunit.client.0.smithi042.stdout:3/495: read d4/d8/d9/dc/d26/f32 [2790353,31134] 0 2024-09-19T09:41:39.926 INFO:tasks.workunit.client.0.smithi042.stdout:3/496: write d4/d2a/f86 [998511,71586] 0 2024-09-19T09:41:39.927 INFO:tasks.workunit.client.0.smithi042.stdout:1/542: dwrite d4/d1e/f1f [0,4194304] 0 2024-09-19T09:41:39.930 INFO:tasks.workunit.client.0.smithi042.stdout:3/497: unlink d4/d8/d9/dc/d26/d5c/d82/f93 0 2024-09-19T09:41:39.930 INFO:tasks.workunit.client.0.smithi042.stdout:3/498: write d4/d8/d4c/f81 [347264,2209] 0 2024-09-19T09:41:39.931 INFO:tasks.workunit.client.0.smithi042.stdout:2/467: dwrite d7/dd/d22/d30/f60 [0,4194304] 0 2024-09-19T09:41:39.933 INFO:tasks.workunit.client.0.smithi042.stdout:1/543: rename d4/d1e/c30 to d4/d1e/d25/d35/cb1 0 2024-09-19T09:41:39.935 INFO:tasks.workunit.client.0.smithi042.stdout:2/468: truncate d7/dd/d48/f5a 198951 0 2024-09-19T09:41:39.935 INFO:tasks.workunit.client.0.smithi042.stdout:2/469: stat d7/dd/l2e 0 2024-09-19T09:41:39.935 INFO:tasks.workunit.client.0.smithi042.stdout:3/499: getdents d4/d8/d4c/d6b 0 2024-09-19T09:41:39.935 INFO:tasks.workunit.client.0.smithi042.stdout:3/500: chown d4/d8/d9/c60 3044 1 2024-09-19T09:41:39.936 INFO:tasks.workunit.client.0.smithi042.stdout:9/399: write d8/da/f10 [3489975,114658] 0 2024-09-19T09:41:39.936 INFO:tasks.workunit.client.0.smithi042.stdout:1/544: creat d4/d1d/fb2 x:0 0 0 2024-09-19T09:41:39.936 INFO:tasks.workunit.client.0.smithi042.stdout:2/470: rename d7/dd/d14/f49 to d7/dd/d14/d35/d4e/f97 0 2024-09-19T09:41:39.936 INFO:tasks.workunit.client.0.smithi042.stdout:1/545: write d4/d1e/d25/f33 [1231399,53334] 0 2024-09-19T09:41:39.937 INFO:tasks.workunit.client.0.smithi042.stdout:2/471: rename d7/dd/d14/d35/d45/f7b to d7/f98 0 2024-09-19T09:41:39.937 INFO:tasks.workunit.client.0.smithi042.stdout:2/472: truncate d7/dd/d14/d35/d4c/d70/f7a 616465 0 2024-09-19T09:41:39.937 INFO:tasks.workunit.client.0.smithi042.stdout:2/473: chown d7/dd/c13 185118 1 2024-09-19T09:41:39.937 INFO:tasks.workunit.client.0.smithi042.stdout:9/400: getdents d8/d32 0 2024-09-19T09:41:39.938 INFO:tasks.workunit.client.0.smithi042.stdout:1/546: unlink d4/d15/d19/d45/c60 0 2024-09-19T09:41:39.941 INFO:tasks.workunit.client.0.smithi042.stdout:7/473: dwrite d0/d14/f4e [0,4194304] 0 2024-09-19T09:41:39.942 INFO:tasks.workunit.client.0.smithi042.stdout:3/501: dread d4/d8/f33 [0,4194304] 0 2024-09-19T09:41:39.944 INFO:tasks.workunit.client.0.smithi042.stdout:2/474: dread d7/dd/d14/d35/d4c/f76 [0,4194304] 0 2024-09-19T09:41:39.944 INFO:tasks.workunit.client.0.smithi042.stdout:2/475: write d7/dd/f47 [1990920,97746] 0 2024-09-19T09:41:39.944 INFO:tasks.workunit.client.0.smithi042.stdout:2/476: dread - d7/dd/d14/d35/f7d zero size 2024-09-19T09:41:39.945 INFO:tasks.workunit.client.0.smithi042.stdout:7/474: mknod d0/d3d/d85/d99/c9c 0 2024-09-19T09:41:39.945 INFO:tasks.workunit.client.0.smithi042.stdout:3/502: mkdir d4/d8/d9/dc/d26/d5c/d82/d8c/d9f 0 2024-09-19T09:41:39.946 INFO:tasks.workunit.client.0.smithi042.stdout:2/477: creat d7/dd/d22/d43/f99 x:0 0 0 2024-09-19T09:41:39.948 INFO:tasks.workunit.client.0.smithi042.stdout:2/478: creat d7/dd/d14/d35/d4e/d63/f9a x:0 0 0 2024-09-19T09:41:39.948 INFO:tasks.workunit.client.0.smithi042.stdout:2/479: write d7/dd/d1f/d3f/f6c [385515,81350] 0 2024-09-19T09:41:39.948 INFO:tasks.workunit.client.0.smithi042.stdout:2/480: write d7/dd/d22/d30/f4d [968170,58457] 0 2024-09-19T09:41:39.948 INFO:tasks.workunit.client.0.smithi042.stdout:2/481: write d7/dd/d14/f7f [834611,70574] 0 2024-09-19T09:41:39.950 INFO:tasks.workunit.client.0.smithi042.stdout:2/482: rmdir d7/dd/d14/d35/d45 39 2024-09-19T09:41:39.950 INFO:tasks.workunit.client.0.smithi042.stdout:2/483: chown d7/f4b 1717 1 2024-09-19T09:41:39.951 INFO:tasks.workunit.client.0.smithi042.stdout:2/484: mkdir d7/d9b 0 2024-09-19T09:41:39.952 INFO:tasks.workunit.client.0.smithi042.stdout:3/503: dread d4/f52 [0,4194304] 0 2024-09-19T09:41:39.956 INFO:tasks.workunit.client.0.smithi042.stdout:8/496: sync 2024-09-19T09:41:39.957 INFO:tasks.workunit.client.0.smithi042.stdout:5/428: sync 2024-09-19T09:41:39.960 INFO:tasks.workunit.client.0.smithi042.stdout:5/429: mknod d2/d4/d20/d60/d72/d75/c9a 0 2024-09-19T09:41:39.960 INFO:tasks.workunit.client.0.smithi042.stdout:5/430: truncate d2/d4/d20/d60/d72/f8d 110644 0 2024-09-19T09:41:39.960 INFO:tasks.workunit.client.0.smithi042.stdout:8/497: symlink d1/da/l90 0 2024-09-19T09:41:39.960 INFO:tasks.workunit.client.0.smithi042.stdout:5/431: mknod d2/db/d3c/d86/c9b 0 2024-09-19T09:41:39.961 INFO:tasks.workunit.client.0.smithi042.stdout:5/432: write d2/d4/d2e/f4c [656569,38748] 0 2024-09-19T09:41:39.961 INFO:tasks.workunit.client.0.smithi042.stdout:8/498: getdents d1/d72 0 2024-09-19T09:41:39.962 INFO:tasks.workunit.client.0.smithi042.stdout:5/433: getdents d2/d25 0 2024-09-19T09:41:39.963 INFO:tasks.workunit.client.0.smithi042.stdout:5/434: creat d2/d4/d20/d60/d72/f9c x:0 0 0 2024-09-19T09:41:39.964 INFO:tasks.workunit.client.0.smithi042.stdout:5/435: chown d2/d4/d2e/d57/c3b 7363 1 2024-09-19T09:41:39.964 INFO:tasks.workunit.client.0.smithi042.stdout:5/436: write d2/d4/f78 [94276,40729] 0 2024-09-19T09:41:39.965 INFO:tasks.workunit.client.0.smithi042.stdout:5/437: symlink d2/d4/d20/l9d 0 2024-09-19T09:41:39.967 INFO:tasks.workunit.client.0.smithi042.stdout:5/438: mknod d2/d4/d20/d60/d72/c9e 0 2024-09-19T09:41:39.969 INFO:tasks.workunit.client.0.smithi042.stdout:5/439: creat d2/d25/f9f x:0 0 0 2024-09-19T09:41:39.972 INFO:tasks.workunit.client.0.smithi042.stdout:9/401: dwrite d8/da/f50 [0,4194304] 0 2024-09-19T09:41:39.972 INFO:tasks.workunit.client.0.smithi042.stdout:9/402: write d8/da/d19/f6b [67152,4024] 0 2024-09-19T09:41:39.972 INFO:tasks.workunit.client.0.smithi042.stdout:1/547: dwrite d4/d15/d19/f87 [0,4194304] 0 2024-09-19T09:41:39.972 INFO:tasks.workunit.client.0.smithi042.stdout:5/440: rename d2/d4/d20/d60/d72/f8d to d2/db/d3c/fa0 0 2024-09-19T09:41:39.974 INFO:tasks.workunit.client.0.smithi042.stdout:9/403: mknod d8/db/d31/c7d 0 2024-09-19T09:41:39.975 INFO:tasks.workunit.client.0.smithi042.stdout:1/548: symlink d4/d15/d19/d45/d82/lb3 0 2024-09-19T09:41:39.976 INFO:tasks.workunit.client.0.smithi042.stdout:5/441: rmdir d2/d25/d4d 39 2024-09-19T09:41:39.976 INFO:tasks.workunit.client.0.smithi042.stdout:5/442: write d2/d4/d2e/f4e [143634,48763] 0 2024-09-19T09:41:39.977 INFO:tasks.workunit.client.0.smithi042.stdout:5/443: symlink d2/d4/la1 0 2024-09-19T09:41:39.978 INFO:tasks.workunit.client.0.smithi042.stdout:5/444: mknod d2/d4/d20/d31/ca2 0 2024-09-19T09:41:39.979 INFO:tasks.workunit.client.0.smithi042.stdout:5/445: rename d2/d4/d2e/d57/l14 to d2/d25/d4d/la3 0 2024-09-19T09:41:39.981 INFO:tasks.workunit.client.0.smithi042.stdout:1/549: read d4/f14 [2984494,74646] 0 2024-09-19T09:41:39.981 INFO:tasks.workunit.client.0.smithi042.stdout:1/550: fsync d4/f47 0 2024-09-19T09:41:39.981 INFO:tasks.workunit.client.0.smithi042.stdout:1/551: fdatasync d4/d12/f2d 0 2024-09-19T09:41:39.981 INFO:tasks.workunit.client.0.smithi042.stdout:1/552: chown d4/d15/d61 23733268 1 2024-09-19T09:41:39.982 INFO:tasks.workunit.client.0.smithi042.stdout:1/553: truncate d4/d15/d19/f9 3452452 0 2024-09-19T09:41:39.982 INFO:tasks.workunit.client.0.smithi042.stdout:1/554: fdatasync d4/d1e/d25/d35/f97 0 2024-09-19T09:41:39.984 INFO:tasks.workunit.client.0.smithi042.stdout:5/446: dread d2/d4/f15 [0,4194304] 0 2024-09-19T09:41:39.984 INFO:tasks.workunit.client.0.smithi042.stdout:5/447: chown d2/d4/d20/c21 143 1 2024-09-19T09:41:39.985 INFO:tasks.workunit.client.0.smithi042.stdout:5/448: mkdir d2/d4/d20/da4 0 2024-09-19T09:41:39.986 INFO:tasks.workunit.client.0.smithi042.stdout:7/475: dwrite d0/d56/f66 [0,4194304] 0 2024-09-19T09:41:39.993 INFO:tasks.workunit.client.0.smithi042.stdout:9/404: write f5 [7865553,35326] 0 2024-09-19T09:41:39.994 INFO:tasks.workunit.client.0.smithi042.stdout:9/405: fsync d8/db/f61 0 2024-09-19T09:41:39.994 INFO:tasks.workunit.client.0.smithi042.stdout:3/504: dwrite d4/d8/d9/dc/d26/d5c/d82/f7a [0,4194304] 0 2024-09-19T09:41:39.995 INFO:tasks.workunit.client.0.smithi042.stdout:3/505: write d4/d8/d9/dc/d26/d5c/d82/f6c [1892660,29966] 0 2024-09-19T09:41:39.995 INFO:tasks.workunit.client.0.smithi042.stdout:2/485: dwrite d7/dd/d22/f4a [0,4194304] 0 2024-09-19T09:41:39.995 INFO:tasks.workunit.client.0.smithi042.stdout:2/486: write d7/f4b [860906,68629] 0 2024-09-19T09:41:39.995 INFO:tasks.workunit.client.0.smithi042.stdout:9/406: rmdir d8/d1d 39 2024-09-19T09:41:39.997 INFO:tasks.workunit.client.0.smithi042.stdout:3/506: creat d4/d8/d9/dc/d26/d5c/d82/d48/fa0 x:0 0 0 2024-09-19T09:41:40.003 INFO:tasks.workunit.client.0.smithi042.stdout:8/499: dwrite d1/da/d32/d3d/d59/f7b [0,4194304] 0 2024-09-19T09:41:40.004 INFO:tasks.workunit.client.0.smithi042.stdout:8/500: dread d1/da/d3f/f5e [0,4194304] 0 2024-09-19T09:41:40.010 INFO:tasks.workunit.client.0.smithi042.stdout:1/555: dwrite d4/fa2 [0,4194304] 0 2024-09-19T09:41:40.010 INFO:tasks.workunit.client.0.smithi042.stdout:1/556: fdatasync d4/d12/f2d 0 2024-09-19T09:41:40.010 INFO:tasks.workunit.client.0.smithi042.stdout:1/557: fsync d4/f13 0 2024-09-19T09:41:40.010 INFO:tasks.workunit.client.0.smithi042.stdout:1/558: fdatasync d4/d1e/d25/f33 0 2024-09-19T09:41:40.010 INFO:tasks.workunit.client.0.smithi042.stdout:1/559: chown d4/d12/d8d/d91/d7f/l90 361 1 2024-09-19T09:41:40.012 INFO:tasks.workunit.client.0.smithi042.stdout:3/507: getdents d4/d8/d9/dc/d26/d5c/d82/d48 0 2024-09-19T09:41:40.016 INFO:tasks.workunit.client.0.smithi042.stdout:1/560: rename d4/d1e/d25/d35/c58 to d4/d1d/cb4 0 2024-09-19T09:41:40.016 INFO:tasks.workunit.client.0.smithi042.stdout:1/561: write d4/d1d/f2b [971807,28596] 0 2024-09-19T09:41:40.016 INFO:tasks.workunit.client.0.smithi042.stdout:1/562: write d4/d15/d19/f1a [856838,77057] 0 2024-09-19T09:41:40.016 INFO:tasks.workunit.client.0.smithi042.stdout:7/476: dwrite d0/f82 [0,4194304] 0 2024-09-19T09:41:40.017 INFO:tasks.workunit.client.0.smithi042.stdout:3/508: mknod d4/d8/d9/dc/d26/d8b/ca1 0 2024-09-19T09:41:40.017 INFO:tasks.workunit.client.0.smithi042.stdout:3/509: stat d4/d8/d9/dc/d26 0 2024-09-19T09:41:40.018 INFO:tasks.workunit.client.0.smithi042.stdout:1/563: mkdir d4/d15/d19/d42/d51/db5 0 2024-09-19T09:41:40.018 INFO:tasks.workunit.client.0.smithi042.stdout:1/564: readlink d4/d1e/d25/d35/laf 0 2024-09-19T09:41:40.018 INFO:tasks.workunit.client.0.smithi042.stdout:8/501: read d1/da/d32/d3d/d59/f7b [64871,111663] 0 2024-09-19T09:41:40.019 INFO:tasks.workunit.client.0.smithi042.stdout:3/510: dread d4/d8/f33 [0,4194304] 0 2024-09-19T09:41:40.019 INFO:tasks.workunit.client.0.smithi042.stdout:3/511: write d4/d8/f33 [532408,82569] 0 2024-09-19T09:41:40.020 INFO:tasks.workunit.client.0.smithi042.stdout:7/477: truncate d0/d14/d3a/f3f 356843 0 2024-09-19T09:41:40.020 INFO:tasks.workunit.client.0.smithi042.stdout:7/478: fsync d0/d3d/f4b 0 2024-09-19T09:41:40.020 INFO:tasks.workunit.client.0.smithi042.stdout:7/479: readlink d0/d14/l64 0 2024-09-19T09:41:40.020 INFO:tasks.workunit.client.0.smithi042.stdout:7/480: write d0/d3d/d55/f74 [164750,16060] 0 2024-09-19T09:41:40.021 INFO:tasks.workunit.client.0.smithi042.stdout:1/565: rename d4/d1e/d25/d35/d3c/f5c to d4/d15/d9e/fb6 0 2024-09-19T09:41:40.021 INFO:tasks.workunit.client.0.smithi042.stdout:1/566: truncate d4/d15/d61/d85/fab 938463 0 2024-09-19T09:41:40.022 INFO:tasks.workunit.client.0.smithi042.stdout:8/502: rename d1/d72/f79 to d1/d72/f91 0 2024-09-19T09:41:40.022 INFO:tasks.workunit.client.0.smithi042.stdout:8/503: stat d1/da/f2f 0 2024-09-19T09:41:40.022 INFO:tasks.workunit.client.0.smithi042.stdout:0/462: sync 2024-09-19T09:41:40.022 INFO:tasks.workunit.client.0.smithi042.stdout:4/501: sync 2024-09-19T09:41:40.023 INFO:tasks.workunit.client.0.smithi042.stdout:0/463: dread d2/d10/d12/d16/d18/f22 [0,4194304] 0 2024-09-19T09:41:40.023 INFO:tasks.workunit.client.0.smithi042.stdout:3/512: link c1 d4/d8/d4c/ca2 0 2024-09-19T09:41:40.025 INFO:tasks.workunit.client.0.smithi042.stdout:7/481: rename d0/d14/d5d to d0/d40/d9d 0 2024-09-19T09:41:40.025 INFO:tasks.workunit.client.0.smithi042.stdout:7/482: stat d0/f5 0 2024-09-19T09:41:40.026 INFO:tasks.workunit.client.0.smithi042.stdout:0/464: mknod d2/d10/c91 0 2024-09-19T09:41:40.026 INFO:tasks.workunit.client.0.smithi042.stdout:0/465: write d2/d10/d1e/f6f [1812037,116918] 0 2024-09-19T09:41:40.027 INFO:tasks.workunit.client.0.smithi042.stdout:3/513: symlink d4/la3 0 2024-09-19T09:41:40.029 INFO:tasks.workunit.client.0.smithi042.stdout:7/483: mknod d0/d3d/d55/c9e 0 2024-09-19T09:41:40.030 INFO:tasks.workunit.client.0.smithi042.stdout:0/466: link d2/d10/d12/d16/d57/c7c d2/d10/d12/d16/c92 0 2024-09-19T09:41:40.030 INFO:tasks.workunit.client.0.smithi042.stdout:0/467: fsync d2/d10/d12/d24/f42 0 2024-09-19T09:41:40.031 INFO:tasks.workunit.client.0.smithi042.stdout:7/484: mkdir d0/d14/d9f 0 2024-09-19T09:41:40.031 INFO:tasks.workunit.client.0.smithi042.stdout:7/485: readlink d0/lc 0 2024-09-19T09:41:40.034 INFO:tasks.workunit.client.0.smithi042.stdout:1/567: rename d4/d1e/d25/d35 to d4/d15/d2e/db7 0 2024-09-19T09:41:40.034 INFO:tasks.workunit.client.0.smithi042.stdout:1/568: fdatasync d4/d15/d19/f9 0 2024-09-19T09:41:40.036 INFO:tasks.workunit.client.0.smithi042.stdout:3/514: rename d4/d2a/f86 to d4/d8/d9/dc/fa4 0 2024-09-19T09:41:40.037 INFO:tasks.workunit.client.0.smithi042.stdout:3/515: dread d4/f92 [0,4194304] 0 2024-09-19T09:41:40.037 INFO:tasks.workunit.client.0.smithi042.stdout:3/516: chown d4/d8/d9/d1b/f63 60312936 1 2024-09-19T09:41:40.039 INFO:tasks.workunit.client.0.smithi042.stdout:8/504: dwrite d1/da/f63 [0,4194304] 0 2024-09-19T09:41:40.042 INFO:tasks.workunit.client.0.smithi042.stdout:7/486: rename d0/d3d/d55/d78 to d0/d14/d44/d47/da0 0 2024-09-19T09:41:40.046 INFO:tasks.workunit.client.0.smithi042.stdout:3/517: rename d4/d2a/d76 to d4/d8/d9/dc/d26/d5c/d82/d48/da5 0 2024-09-19T09:41:40.048 INFO:tasks.workunit.client.0.smithi042.stdout:8/505: dread d1/da/dd/d74/f7e [0,4194304] 0 2024-09-19T09:41:40.049 INFO:tasks.workunit.client.0.smithi042.stdout:8/506: read d1/f9 [1797399,87542] 0 2024-09-19T09:41:40.049 INFO:tasks.workunit.client.0.smithi042.stdout:8/507: mkdir d1/da/d32/d92 0 2024-09-19T09:41:40.049 INFO:tasks.workunit.client.0.smithi042.stdout:8/508: dread - d1/da/dd/f8a zero size 2024-09-19T09:41:40.049 INFO:tasks.workunit.client.0.smithi042.stdout:8/509: creat d1/da/d32/d87/f93 x:0 0 0 2024-09-19T09:41:40.049 INFO:tasks.workunit.client.0.smithi042.stdout:8/510: rmdir d1/da/d32/d3d 39 2024-09-19T09:41:40.050 INFO:tasks.workunit.client.0.smithi042.stdout:8/511: mknod d1/da/d32/d3d/d59/c94 0 2024-09-19T09:41:40.052 INFO:tasks.workunit.client.0.smithi042.stdout:0/468: dwrite d2/d8e/f70 [0,4194304] 0 2024-09-19T09:41:40.052 INFO:tasks.workunit.client.0.smithi042.stdout:0/469: chown d2/d10/d12/d19/f6e 1112 1 2024-09-19T09:41:40.052 INFO:tasks.workunit.client.0.smithi042.stdout:0/470: write d2/d10/d1e/f6f [2689193,120623] 0 2024-09-19T09:41:40.053 INFO:tasks.workunit.client.0.smithi042.stdout:0/471: stat d2/f1c 0 2024-09-19T09:41:40.053 INFO:tasks.workunit.client.0.smithi042.stdout:4/502: dwrite d0/d1b/d1c/d2e/f9a [0,4194304] 0 2024-09-19T09:41:40.057 INFO:tasks.workunit.client.0.smithi042.stdout:3/518: write d4/d8/d9/dc/d26/d35/f44 [1909988,49927] 0 2024-09-19T09:41:40.057 INFO:tasks.workunit.client.0.smithi042.stdout:4/503: creat d0/d28/fa9 x:0 0 0 2024-09-19T09:41:40.057 INFO:tasks.workunit.client.0.smithi042.stdout:3/519: readlink d4/d8/d9/l1f 0 2024-09-19T09:41:40.059 INFO:tasks.workunit.client.0.smithi042.stdout:3/520: symlink d4/d8/d9/dc/d26/d35/la6 0 2024-09-19T09:41:40.059 INFO:tasks.workunit.client.0.smithi042.stdout:3/521: write d4/d8/d9/dc/d26/f32 [1041743,64135] 0 2024-09-19T09:41:40.059 INFO:tasks.workunit.client.0.smithi042.stdout:3/522: fdatasync d4/d8/d9/dc/d26/d8b/f99 0 2024-09-19T09:41:40.060 INFO:tasks.workunit.client.0.smithi042.stdout:4/504: creat d0/d28/d87/da1/faa x:0 0 0 2024-09-19T09:41:40.060 INFO:tasks.workunit.client.0.smithi042.stdout:4/505: write d0/d1b/d1c/d2e/d3b/f47 [2851371,53844] 0 2024-09-19T09:41:40.062 INFO:tasks.workunit.client.0.smithi042.stdout:4/506: rmdir d0/d67/d96 39 2024-09-19T09:41:40.063 INFO:tasks.workunit.client.0.smithi042.stdout:7/487: dwrite d0/d3d/d85/f8b [0,4194304] 0 2024-09-19T09:41:40.063 INFO:tasks.workunit.client.0.smithi042.stdout:6/448: sync 2024-09-19T09:41:40.065 INFO:tasks.workunit.client.0.smithi042.stdout:0/472: dread d2/d8e/f70 [0,4194304] 0 2024-09-19T09:41:40.065 INFO:tasks.workunit.client.0.smithi042.stdout:0/473: dread - d2/f54 zero size 2024-09-19T09:41:40.065 INFO:tasks.workunit.client.0.smithi042.stdout:7/488: getdents d0/d3d/d85/d99 0 2024-09-19T09:41:40.066 INFO:tasks.workunit.client.0.smithi042.stdout:6/449: creat d1/de/d54/f7e x:0 0 0 2024-09-19T09:41:40.066 INFO:tasks.workunit.client.0.smithi042.stdout:6/450: truncate d1/de/d12/d1c/d5f/f6e 29710 0 2024-09-19T09:41:40.066 INFO:tasks.workunit.client.0.smithi042.stdout:6/451: read - d1/de/d12/d22/d34/d6f/f7c zero size 2024-09-19T09:41:40.066 INFO:tasks.workunit.client.0.smithi042.stdout:6/452: chown d1/de/d76 1826826 1 2024-09-19T09:41:40.066 INFO:tasks.workunit.client.0.smithi042.stdout:6/453: chown d1/de/d12/d22/d34/d3f/f5c 13387306 1 2024-09-19T09:41:40.067 INFO:tasks.workunit.client.0.smithi042.stdout:0/474: rename d2/d10/d12/d16/d18/l87 to d2/d10/d12/d24/d5b/l93 0 2024-09-19T09:41:40.069 INFO:tasks.workunit.client.0.smithi042.stdout:0/475: creat d2/d10/d12/d16/d57/d78/f94 x:0 0 0 2024-09-19T09:41:40.070 INFO:tasks.workunit.client.0.smithi042.stdout:0/476: mknod d2/d10/d1d/d34/d89/c95 0 2024-09-19T09:41:40.070 INFO:tasks.workunit.client.0.smithi042.stdout:0/477: dread - d2/d10/d1d/f59 zero size 2024-09-19T09:41:40.071 INFO:tasks.workunit.client.0.smithi042.stdout:0/478: readlink d2/d10/d1d/d34/l4b 0 2024-09-19T09:41:40.071 INFO:tasks.workunit.client.0.smithi042.stdout:0/479: fdatasync d2/d10/d12/d19/f69 0 2024-09-19T09:41:40.071 INFO:tasks.workunit.client.0.smithi042.stdout:0/480: chown d2/d10/c91 73021 1 2024-09-19T09:41:40.072 INFO:tasks.workunit.client.0.smithi042.stdout:0/481: truncate d2/d10/d1d/d34/f4a 3897838 0 2024-09-19T09:41:40.072 INFO:tasks.workunit.client.0.smithi042.stdout:0/482: fdatasync d2/d10/d1d/f59 0 2024-09-19T09:41:40.074 INFO:tasks.workunit.client.0.smithi042.stdout:0/483: getdents d2 0 2024-09-19T09:41:40.075 INFO:tasks.workunit.client.0.smithi042.stdout:0/484: chown d2/d10/d1e/c44 20359 1 2024-09-19T09:41:40.075 INFO:tasks.workunit.client.0.smithi042.stdout:0/485: fsync d2/f54 0 2024-09-19T09:41:40.075 INFO:tasks.workunit.client.0.smithi042.stdout:0/486: chown d2/d10/d1e/f6c 17696362 1 2024-09-19T09:41:40.075 INFO:tasks.workunit.client.0.smithi042.stdout:0/487: write d2/d10/d12/d16/d57/d78/f94 [326828,84291] 0 2024-09-19T09:41:40.076 INFO:tasks.workunit.client.0.smithi042.stdout:0/488: symlink d2/d10/d1d/d34/d89/l96 0 2024-09-19T09:41:40.076 INFO:tasks.workunit.client.0.smithi042.stdout:0/489: fdatasync d2/d10/d12/d16/d57/f73 0 2024-09-19T09:41:40.076 INFO:tasks.workunit.client.0.smithi042.stdout:0/490: truncate d2/d10/d1d/d34/f86 4021524 0 2024-09-19T09:41:40.077 INFO:tasks.workunit.client.0.smithi042.stdout:0/491: creat d2/d10/d12/d16/d18/d52/f97 x:0 0 0 2024-09-19T09:41:40.077 INFO:tasks.workunit.client.0.smithi042.stdout:6/454: dread d1/de/d76/f7a [0,4194304] 0 2024-09-19T09:41:40.079 INFO:tasks.workunit.client.0.smithi042.stdout:6/455: rmdir d1/de/d76 39 2024-09-19T09:41:40.081 INFO:tasks.workunit.client.0.smithi042.stdout:0/492: rmdir d2/d10/d12/d19/d6d 0 2024-09-19T09:41:40.085 INFO:tasks.workunit.client.0.smithi042.stdout:6/456: dread d1/fc [0,4194304] 0 2024-09-19T09:41:40.085 INFO:tasks.workunit.client.0.smithi042.stdout:6/457: fdatasync d1/d20/d6a/d46/f64 0 2024-09-19T09:41:40.087 INFO:tasks.workunit.client.0.smithi042.stdout:6/458: unlink d1/d20/d6a/d46/l53 0 2024-09-19T09:41:40.088 INFO:tasks.workunit.client.0.smithi042.stdout:6/459: mknod d1/d20/d69/c7f 0 2024-09-19T09:41:40.088 INFO:tasks.workunit.client.0.smithi042.stdout:3/523: dwrite d4/d8/d9/dc/d26/d5c/d82/f29 [4194304,4194304] 0 2024-09-19T09:41:40.089 INFO:tasks.workunit.client.0.smithi042.stdout:0/493: dread d2/fe [0,4194304] 0 2024-09-19T09:41:40.090 INFO:tasks.workunit.client.0.smithi042.stdout:6/460: rename d1/f24 to d1/de/d12/d22/f80 0 2024-09-19T09:41:40.092 INFO:tasks.workunit.client.0.smithi042.stdout:7/489: dwrite d0/d14/d44/d47/da0/f7f [0,4194304] 0 2024-09-19T09:41:40.092 INFO:tasks.workunit.client.0.smithi042.stdout:4/507: dwrite d0/d1b/f2b [0,4194304] 0 2024-09-19T09:41:40.093 INFO:tasks.workunit.client.0.smithi042.stdout:8/512: dwrite d1/da/d32/d3d/d58/f82 [0,4194304] 0 2024-09-19T09:41:40.094 INFO:tasks.workunit.client.0.smithi042.stdout:7/490: rename d0/d14/d44/d47/da0 to d0/d3d/d92/da1 0 2024-09-19T09:41:40.094 INFO:tasks.workunit.client.0.smithi042.stdout:7/491: readlink d0/d3d/l4d 0 2024-09-19T09:41:40.099 INFO:tasks.workunit.client.0.smithi042.stdout:6/461: dread d1/de/d12/d22/f2a [0,4194304] 0 2024-09-19T09:41:40.106 INFO:tasks.workunit.client.0.smithi042.stdout:6/462: mkdir d1/de/d54/d81 0 2024-09-19T09:41:40.106 INFO:tasks.workunit.client.0.smithi042.stdout:4/508: mknod d0/cab 0 2024-09-19T09:41:40.107 INFO:tasks.workunit.client.0.smithi042.stdout:6/463: creat d1/de/d12/d22/d34/d6f/d4a/f82 x:0 0 0 2024-09-19T09:41:40.109 INFO:tasks.workunit.client.0.smithi042.stdout:6/464: unlink d1/de/d12/d1c/f37 0 2024-09-19T09:41:40.110 INFO:tasks.workunit.client.0.smithi042.stdout:6/465: creat d1/de/d12/d22/d34/d6f/d4a/f83 x:0 0 0 2024-09-19T09:41:40.111 INFO:tasks.workunit.client.0.smithi042.stdout:9/407: sync 2024-09-19T09:41:40.111 INFO:tasks.workunit.client.0.smithi042.stdout:2/487: sync 2024-09-19T09:41:40.112 INFO:tasks.workunit.client.0.smithi042.stdout:5/449: sync 2024-09-19T09:41:40.112 INFO:tasks.workunit.client.0.smithi042.stdout:2/488: chown d7/c8e 35357596 1 2024-09-19T09:41:40.112 INFO:tasks.workunit.client.0.smithi042.stdout:2/489: chown d7/dd/d14/f7f 0 1 2024-09-19T09:41:40.112 INFO:tasks.workunit.client.0.smithi042.stdout:1/569: sync 2024-09-19T09:41:40.112 INFO:tasks.workunit.client.0.smithi042.stdout:5/450: write d2/d4/d2e/f4c [1179209,78770] 0 2024-09-19T09:41:40.112 INFO:tasks.workunit.client.0.smithi042.stdout:6/466: creat d1/d20/d69/f84 x:0 0 0 2024-09-19T09:41:40.113 INFO:tasks.workunit.client.0.smithi042.stdout:2/490: rename d7/dd/d22/d43 to d7/dd/d14/d35/d4e/d9c 0 2024-09-19T09:41:40.113 INFO:tasks.workunit.client.0.smithi042.stdout:1/570: creat d4/d15/d9e/fb8 x:0 0 0 2024-09-19T09:41:40.113 INFO:tasks.workunit.client.0.smithi042.stdout:5/451: symlink d2/db/d3c/la5 0 2024-09-19T09:41:40.113 INFO:tasks.workunit.client.0.smithi042.stdout:5/452: readlink d2/d25/d4d/la3 0 2024-09-19T09:41:40.114 INFO:tasks.workunit.client.0.smithi042.stdout:6/467: mknod d1/de/d12/d22/c85 0 2024-09-19T09:41:40.114 INFO:tasks.workunit.client.0.smithi042.stdout:6/468: truncate d1/de/d12/d22/d34/f73 753873 0 2024-09-19T09:41:40.115 INFO:tasks.workunit.client.0.smithi042.stdout:6/469: chown d1/de/d12/d1c/d3a/f75 29862749 1 2024-09-19T09:41:40.115 INFO:tasks.workunit.client.0.smithi042.stdout:6/470: chown d1/d20 1 1 2024-09-19T09:41:40.115 INFO:tasks.workunit.client.0.smithi042.stdout:6/471: dread - d1/de/d12/d1c/d4f/f66 zero size 2024-09-19T09:41:40.115 INFO:tasks.workunit.client.0.smithi042.stdout:9/408: dread d8/d1d/d28/f2d [0,4194304] 0 2024-09-19T09:41:40.116 INFO:tasks.workunit.client.0.smithi042.stdout:2/491: creat d7/dd/d14/d35/d4e/f9d x:0 0 0 2024-09-19T09:41:40.116 INFO:tasks.workunit.client.0.smithi042.stdout:2/492: write d7/dd/d48/f5a [810185,24151] 0 2024-09-19T09:41:40.116 INFO:tasks.workunit.client.0.smithi042.stdout:1/571: mkdir d4/d12/db9 0 2024-09-19T09:41:40.116 INFO:tasks.workunit.client.0.smithi042.stdout:1/572: chown d4/d15/d44/l6b 122395098 1 2024-09-19T09:41:40.116 INFO:tasks.workunit.client.0.smithi042.stdout:1/573: dread - d4/d1d/fa9 zero size 2024-09-19T09:41:40.116 INFO:tasks.workunit.client.0.smithi042.stdout:5/453: creat d2/d4/d20/d60/d72/fa6 x:0 0 0 2024-09-19T09:41:40.117 INFO:tasks.workunit.client.0.smithi042.stdout:2/493: symlink d7/dd/d14/d35/d4e/d63/l9e 0 2024-09-19T09:41:40.117 INFO:tasks.workunit.client.0.smithi042.stdout:6/472: rmdir d1/de/d12/d22/d34/d3f 39 2024-09-19T09:41:40.117 INFO:tasks.workunit.client.0.smithi042.stdout:6/473: fdatasync d1/de/f2d 0 2024-09-19T09:41:40.118 INFO:tasks.workunit.client.0.smithi042.stdout:9/409: getdents d8/da/d19/d1c/d21/d67 0 2024-09-19T09:41:40.118 INFO:tasks.workunit.client.0.smithi042.stdout:9/410: read d8/f6f [4088301,105868] 0 2024-09-19T09:41:40.120 INFO:tasks.workunit.client.0.smithi042.stdout:5/454: rename d2/d4/d2e/d57 to d2/d4/d64/da7 0 2024-09-19T09:41:40.121 INFO:tasks.workunit.client.0.smithi042.stdout:6/474: creat d1/d20/d69/f86 x:0 0 0 2024-09-19T09:41:40.123 INFO:tasks.workunit.client.0.smithi042.stdout:9/411: creat d8/db/f7e x:0 0 0 2024-09-19T09:41:40.136 INFO:tasks.workunit.client.0.smithi042.stdout:3/524: dwrite f0 [0,4194304] 0 2024-09-19T09:41:40.137 INFO:tasks.workunit.client.0.smithi042.stdout:3/525: write d4/d8/d9/dc/d26/f27 [1130863,13562] 0 2024-09-19T09:41:40.139 INFO:tasks.workunit.client.0.smithi042.stdout:4/509: dwrite d0/d1b/d1c/d2e/f76 [0,4194304] 0 2024-09-19T09:41:40.142 INFO:tasks.workunit.client.0.smithi042.stdout:0/494: dwrite d2/d8e/f70 [0,4194304] 0 2024-09-19T09:41:40.145 INFO:tasks.workunit.client.0.smithi042.stdout:0/495: link d2/d10/d12/d24/f42 d2/d10/d1e/f98 0 2024-09-19T09:41:40.145 INFO:tasks.workunit.client.0.smithi042.stdout:0/496: fsync d2/d10/d12/d16/f5e 0 2024-09-19T09:41:40.148 INFO:tasks.workunit.client.0.smithi042.stdout:0/497: mkdir d2/d10/d12/d16/d57/d99 0 2024-09-19T09:41:40.148 INFO:tasks.workunit.client.0.smithi042.stdout:0/498: getdents d2/d8e/d32 0 2024-09-19T09:41:40.148 INFO:tasks.workunit.client.0.smithi042.stdout:0/499: chown d2/d8e/d32/f72 14352 1 2024-09-19T09:41:40.148 INFO:tasks.workunit.client.0.smithi042.stdout:0/500: chown d2/d10/d12/d24/f42 667206 1 2024-09-19T09:41:40.150 INFO:tasks.workunit.client.0.smithi042.stdout:9/412: dread d8/f3d [0,4194304] 0 2024-09-19T09:41:40.150 INFO:tasks.workunit.client.0.smithi042.stdout:9/413: write f1 [5086186,81652] 0 2024-09-19T09:41:40.150 INFO:tasks.workunit.client.0.smithi042.stdout:8/513: dwrite d1/da/d32/d3d/d58/f5d [0,4194304] 0 2024-09-19T09:41:40.151 INFO:tasks.workunit.client.0.smithi042.stdout:9/414: rename d8/da/d51 to d8/da/d19/d1c/d21/d7f 0 2024-09-19T09:41:40.153 INFO:tasks.workunit.client.0.smithi042.stdout:8/514: mkdir d1/da/d32/d3d/d95 0 2024-09-19T09:41:40.153 INFO:tasks.workunit.client.0.smithi042.stdout:8/515: symlink d1/da/d32/d87/l96 0 2024-09-19T09:41:40.154 INFO:tasks.workunit.client.0.smithi042.stdout:4/510: write d0/d1b/d1c/d2e/d44/f46 [1375709,129532] 0 2024-09-19T09:41:40.154 INFO:tasks.workunit.client.0.smithi042.stdout:8/516: truncate d1/da/dd/f49 4140303 0 2024-09-19T09:41:40.155 INFO:tasks.workunit.client.0.smithi042.stdout:4/511: creat d0/d28/fac x:0 0 0 2024-09-19T09:41:40.156 INFO:tasks.workunit.client.0.smithi042.stdout:8/517: link d1/d2e/f4a d1/da/d32/d3d/d58/f97 0 2024-09-19T09:41:40.156 INFO:tasks.workunit.client.0.smithi042.stdout:4/512: mknod d0/d1b/d1c/d2e/cad 0 2024-09-19T09:41:40.157 INFO:tasks.workunit.client.0.smithi042.stdout:4/513: write d0/d1b/d1c/f2c [1318756,69809] 0 2024-09-19T09:41:40.158 INFO:tasks.workunit.client.0.smithi042.stdout:4/514: link d0/f19 d0/d28/fae 0 2024-09-19T09:41:40.159 INFO:tasks.workunit.client.0.smithi042.stdout:4/515: creat d0/d1b/d1c/d61/d7f/d83/faf x:0 0 0 2024-09-19T09:41:40.159 INFO:tasks.workunit.client.0.smithi042.stdout:4/516: rmdir d0/d1b/d1c/d2e/d44 39 2024-09-19T09:41:40.161 INFO:tasks.workunit.client.0.smithi042.stdout:4/517: creat d0/d1b/d1c/d2e/d3f/d5a/fb0 x:0 0 0 2024-09-19T09:41:40.161 INFO:tasks.workunit.client.0.smithi042.stdout:4/518: mkdir d0/d1b/d1c/d2e/d3b/d95/db1 0 2024-09-19T09:41:40.165 INFO:tasks.workunit.client.0.smithi042.stdout:2/494: dwrite d7/dd/f8d [0,4194304] 0 2024-09-19T09:41:40.165 INFO:tasks.workunit.client.0.smithi042.stdout:2/495: chown d7/dd/d14/d35/d4e/d9c/f99 31255 1 2024-09-19T09:41:40.166 INFO:tasks.workunit.client.0.smithi042.stdout:2/496: truncate d7/dd/d14/d35/d4e/f80 861534 0 2024-09-19T09:41:40.168 INFO:tasks.workunit.client.0.smithi042.stdout:2/497: creat d7/dd/d14/d35/d45/d5e/d79/f9f x:0 0 0 2024-09-19T09:41:40.169 INFO:tasks.workunit.client.0.smithi042.stdout:8/518: dread d1/da/dd/f70 [0,4194304] 0 2024-09-19T09:41:40.170 INFO:tasks.workunit.client.0.smithi042.stdout:3/526: dwrite d4/d2a/f4e [0,4194304] 0 2024-09-19T09:41:40.170 INFO:tasks.workunit.client.0.smithi042.stdout:6/475: dwrite d1/de/d76/f7a [0,4194304] 0 2024-09-19T09:41:40.173 INFO:tasks.workunit.client.0.smithi042.stdout:0/501: dwrite d2/d10/d12/d16/f5e [0,4194304] 0 2024-09-19T09:41:40.173 INFO:tasks.workunit.client.0.smithi042.stdout:0/502: dread - d2/d8e/d32/f83 zero size 2024-09-19T09:41:40.177 INFO:tasks.workunit.client.0.smithi042.stdout:1/574: dwrite d4/d15/d9e/fb8 [0,4194304] 0 2024-09-19T09:41:40.177 INFO:tasks.workunit.client.0.smithi042.stdout:5/455: dwrite d2/d4/d64/d6a/f83 [0,4194304] 0 2024-09-19T09:41:40.180 INFO:tasks.workunit.client.0.smithi042.stdout:1/575: creat d4/d12/d8d/d91/d7f/fba x:0 0 0 2024-09-19T09:41:40.180 INFO:tasks.workunit.client.0.smithi042.stdout:1/576: chown d4/d15/d2e/l96 12 1 2024-09-19T09:41:40.180 INFO:tasks.workunit.client.0.smithi042.stdout:1/577: read - d4/d15/d2e/db7/d3c/fa3 zero size 2024-09-19T09:41:40.180 INFO:tasks.workunit.client.0.smithi042.stdout:1/578: truncate d4/f7b 1345992 0 2024-09-19T09:41:40.180 INFO:tasks.workunit.client.0.smithi042.stdout:1/579: readlink d4/d15/d19/d45/l5f 0 2024-09-19T09:41:40.180 INFO:tasks.workunit.client.0.smithi042.stdout:1/580: readlink d4/l6a 0 2024-09-19T09:41:40.182 INFO:tasks.workunit.client.0.smithi042.stdout:9/415: dwrite f5 [4194304,4194304] 0 2024-09-19T09:41:40.182 INFO:tasks.workunit.client.0.smithi042.stdout:9/416: rename d8 to d8/da/d19/d80 22 2024-09-19T09:41:40.182 INFO:tasks.workunit.client.0.smithi042.stdout:9/417: write d8/db/f26 [772515,23261] 0 2024-09-19T09:41:40.182 INFO:tasks.workunit.client.0.smithi042.stdout:2/498: write f6 [5403114,45796] 0 2024-09-19T09:41:40.182 INFO:tasks.workunit.client.0.smithi042.stdout:1/581: truncate d4/d15/d2e/db7/d3c/f43 2775327 0 2024-09-19T09:41:40.182 INFO:tasks.workunit.client.0.smithi042.stdout:2/499: chown d7/dd/d14/d35/d45/l83 4111232 1 2024-09-19T09:41:40.182 INFO:tasks.workunit.client.0.smithi042.stdout:2/500: fdatasync d7/dd/f16 0 2024-09-19T09:41:40.184 INFO:tasks.workunit.client.0.smithi042.stdout:4/519: dwrite d0/d1b/f26 [0,4194304] 0 2024-09-19T09:41:40.184 INFO:tasks.workunit.client.0.smithi042.stdout:4/520: dread - d0/d28/d87/da1/faa zero size 2024-09-19T09:41:40.184 INFO:tasks.workunit.client.0.smithi042.stdout:2/501: link d7/dd/d22/d30/d66/l75 d7/dd/d14/d35/d45/d5e/d79/la0 0 2024-09-19T09:41:40.186 INFO:tasks.workunit.client.0.smithi042.stdout:2/502: dread d7/f98 [0,4194304] 0 2024-09-19T09:41:40.188 INFO:tasks.workunit.client.0.smithi042.stdout:1/582: symlink d4/d12/d8d/d91/d7f/lbb 0 2024-09-19T09:41:40.188 INFO:tasks.workunit.client.0.smithi042.stdout:1/583: fsync d4/d15/d61/fa7 0 2024-09-19T09:41:40.193 INFO:tasks.workunit.client.0.smithi042.stdout:2/503: dread d7/dd/d1f/d3f/f69 [0,4194304] 0 2024-09-19T09:41:40.193 INFO:tasks.workunit.client.0.smithi042.stdout:1/584: creat d4/d12/d8d/d91/fbc x:0 0 0 2024-09-19T09:41:40.193 INFO:tasks.workunit.client.0.smithi042.stdout:1/585: read d4/d1d/f2b [753035,28770] 0 2024-09-19T09:41:40.194 INFO:tasks.workunit.client.0.smithi042.stdout:1/586: dread - d4/d12/d8d/d91/d7f/fba zero size 2024-09-19T09:41:40.194 INFO:tasks.workunit.client.0.smithi042.stdout:1/587: rmdir d4/d15/d19/d45/d82/d89 39 2024-09-19T09:41:40.196 INFO:tasks.workunit.client.0.smithi042.stdout:3/527: dwrite d4/d8/d9/dc/d26/d5c/d82/f1a [0,4194304] 0 2024-09-19T09:41:40.196 INFO:tasks.workunit.client.0.smithi042.stdout:3/528: chown f0 3 1 2024-09-19T09:41:40.196 INFO:tasks.workunit.client.0.smithi042.stdout:1/588: rename d4/d15/d2e/db7/laf to d4/d15/d61/lbd 0 2024-09-19T09:41:40.196 INFO:tasks.workunit.client.0.smithi042.stdout:1/589: dread - d4/d12/d8d/d91/d7f/fba zero size 2024-09-19T09:41:40.198 INFO:tasks.workunit.client.0.smithi042.stdout:2/504: dread d7/dd/d14/d35/d4c/f76 [0,4194304] 0 2024-09-19T09:41:40.198 INFO:tasks.workunit.client.0.smithi042.stdout:2/505: write d7/dd/d22/d30/f34 [5231958,81150] 0 2024-09-19T09:41:40.199 INFO:tasks.workunit.client.0.smithi042.stdout:3/529: rename d4/d8/d9/dc/d26/d5c/d82/f6c to d4/d78/d9d/fa7 0 2024-09-19T09:41:40.200 INFO:tasks.workunit.client.0.smithi042.stdout:1/590: mknod d4/d15/d19/d42/d51/cbe 0 2024-09-19T09:41:40.200 INFO:tasks.workunit.client.0.smithi042.stdout:4/521: write d0/d1b/d1c/d2e/f9a [1552682,20481] 0 2024-09-19T09:41:40.201 INFO:tasks.workunit.client.0.smithi042.stdout:1/591: read d4/d15/d2e/f8c [694909,76668] 0 2024-09-19T09:41:40.202 INFO:tasks.workunit.client.0.smithi042.stdout:4/522: mkdir d0/db2 0 2024-09-19T09:41:40.202 INFO:tasks.workunit.client.0.smithi042.stdout:4/523: fdatasync d0/d1b/d1c/d61/d7f/d83/f99 0 2024-09-19T09:41:40.204 INFO:tasks.workunit.client.0.smithi042.stdout:4/524: rename d0/d1b/d1c/f4f to d0/d28/d36/fb3 0 2024-09-19T09:41:40.204 INFO:tasks.workunit.client.0.smithi042.stdout:4/525: chown d0/db2 900647725 1 2024-09-19T09:41:40.204 INFO:tasks.workunit.client.0.smithi042.stdout:7/492: sync 2024-09-19T09:41:40.205 INFO:tasks.workunit.client.0.smithi042.stdout:4/526: creat d0/d1b/d1c/fb4 x:0 0 0 2024-09-19T09:41:40.208 INFO:tasks.workunit.client.0.smithi042.stdout:4/527: creat d0/d1b/d1c/d2e/d3f/d6b/fb5 x:0 0 0 2024-09-19T09:41:40.208 INFO:tasks.workunit.client.0.smithi042.stdout:2/506: dread d7/dd/d22/f4a [0,4194304] 0 2024-09-19T09:41:40.209 INFO:tasks.workunit.client.0.smithi042.stdout:2/507: fdatasync d7/f9 0 2024-09-19T09:41:40.210 INFO:tasks.workunit.client.0.smithi042.stdout:4/528: dread d0/d1b/d1c/d2e/d3b/f53 [0,4194304] 0 2024-09-19T09:41:40.211 INFO:tasks.workunit.client.0.smithi042.stdout:2/508: creat d7/dd/d14/d35/d45/d5e/d79/fa1 x:0 0 0 2024-09-19T09:41:40.211 INFO:tasks.workunit.client.0.smithi042.stdout:2/509: chown d7/dd/d14/c3b 10 1 2024-09-19T09:41:40.211 INFO:tasks.workunit.client.0.smithi042.stdout:2/510: fsync d7/fe 0 2024-09-19T09:41:40.211 INFO:tasks.workunit.client.0.smithi042.stdout:3/530: dread d4/d8/d4c/f71 [0,4194304] 0 2024-09-19T09:41:40.211 INFO:tasks.workunit.client.0.smithi042.stdout:3/531: chown d4/d8/d4c/f7b 0 1 2024-09-19T09:41:40.212 INFO:tasks.workunit.client.0.smithi042.stdout:4/529: symlink d0/d67/d96/lb6 0 2024-09-19T09:41:40.212 INFO:tasks.workunit.client.0.smithi042.stdout:2/511: creat d7/dd/d14/d35/d4c/d61/fa2 x:0 0 0 2024-09-19T09:41:40.212 INFO:tasks.workunit.client.0.smithi042.stdout:2/512: readlink d7/dd/d14/d35/d4e/l54 0 2024-09-19T09:41:40.212 INFO:tasks.workunit.client.0.smithi042.stdout:2/513: chown d7/dd/d14/f25 490860197 1 2024-09-19T09:41:40.213 INFO:tasks.workunit.client.0.smithi042.stdout:3/532: symlink d4/d8/d9/dc/d26/la8 0 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:3/533: stat d4/d8/d9/dc/d26/d5c/d82/f29 0 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:3/534: truncate d4/d8/d9/dc/d26/f27 2689159 0 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:3/535: truncate d4/d2a/f9e 725959 0 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:3/536: stat d4/d8/d9/dc/f9b 0 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:3/537: chown d4/d8/d9/dc/d26/d5c/d82/d48/f5a 378 1 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:4/530: symlink d0/d1b/d1c/d2e/d3b/d95/lb7 0 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:4/531: fdatasync d0/f16 0 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:5/456: dwrite d2/d4/d64/da7/f23 [4194304,4194304] 0 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:5/457: write d2/db/d3c/f6e [4319176,34647] 0 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:9/418: dwrite d8/d32/f58 [0,4194304] 0 2024-09-19T09:41:40.214 INFO:tasks.workunit.client.0.smithi042.stdout:2/514: creat d7/dd/d14/d35/d4c/fa3 x:0 0 0 2024-09-19T09:41:40.215 INFO:tasks.workunit.client.0.smithi042.stdout:4/532: mkdir d0/d1b/d1c/db8 0 2024-09-19T09:41:40.218 INFO:tasks.workunit.client.0.smithi042.stdout:5/458: rename d2/d4/d20/c7f to d2/d4/ca8 0 2024-09-19T09:41:40.218 INFO:tasks.workunit.client.0.smithi042.stdout:2/515: dread d7/dd/d22/f4a [0,4194304] 0 2024-09-19T09:41:40.221 INFO:tasks.workunit.client.0.smithi042.stdout:9/419: creat d8/db/d31/d39/f81 x:0 0 0 2024-09-19T09:41:40.221 INFO:tasks.workunit.client.0.smithi042.stdout:1/592: dwrite d4/d15/d19/d42/f73 [0,4194304] 0 2024-09-19T09:41:40.222 INFO:tasks.workunit.client.0.smithi042.stdout:4/533: unlink d0/d1b/d1c/d61/c62 0 2024-09-19T09:41:40.222 INFO:tasks.workunit.client.0.smithi042.stdout:4/534: chown d0/d28/d87/da1/faa 3 1 2024-09-19T09:41:40.222 INFO:tasks.workunit.client.0.smithi042.stdout:4/535: chown d0/f5 15583008 1 2024-09-19T09:41:40.222 INFO:tasks.workunit.client.0.smithi042.stdout:4/536: read d0/d1b/d1c/d2e/f9a [3834582,129170] 0 2024-09-19T09:41:40.222 INFO:tasks.workunit.client.0.smithi042.stdout:4/537: stat d0/d1b/d1c/d2e/cad 0 2024-09-19T09:41:40.222 INFO:tasks.workunit.client.0.smithi042.stdout:4/538: dread - d0/d28/d87/da1/faa zero size 2024-09-19T09:41:40.223 INFO:tasks.workunit.client.0.smithi042.stdout:5/459: link d2/d4/d20/d60/d72/d75/l90 d2/d4/d64/da7/la9 0 2024-09-19T09:41:40.224 INFO:tasks.workunit.client.0.smithi042.stdout:5/460: dread d2/d4/f78 [0,4194304] 0 2024-09-19T09:41:40.226 INFO:tasks.workunit.client.0.smithi042.stdout:2/516: symlink d7/dd/d14/d35/d4c/d61/la4 0 2024-09-19T09:41:40.227 INFO:tasks.workunit.client.0.smithi042.stdout:1/593: unlink d4/d12/l6c 0 2024-09-19T09:41:40.228 INFO:tasks.workunit.client.0.smithi042.stdout:2/517: creat d7/dd/d48/d96/fa5 x:0 0 0 2024-09-19T09:41:40.228 INFO:tasks.workunit.client.0.smithi042.stdout:9/420: mknod d8/da/d19/d1c/d21/d7f/c82 0 2024-09-19T09:41:40.228 INFO:tasks.workunit.client.0.smithi042.stdout:9/421: dread - d8/db/d31/d39/f6e zero size 2024-09-19T09:41:40.228 INFO:tasks.workunit.client.0.smithi042.stdout:2/518: mkdir d7/dd/d14/d35/d4c/d61/d87/da6 0 2024-09-19T09:41:40.229 INFO:tasks.workunit.client.0.smithi042.stdout:5/461: creat d2/d4/d64/da7/faa x:0 0 0 2024-09-19T09:41:40.230 INFO:tasks.workunit.client.0.smithi042.stdout:2/519: creat d7/dd/d48/fa7 x:0 0 0 2024-09-19T09:41:40.230 INFO:tasks.workunit.client.0.smithi042.stdout:1/594: link d4/d29/d3e/l92 d4/d15/d9e/lbf 0 2024-09-19T09:41:40.230 INFO:tasks.workunit.client.0.smithi042.stdout:1/595: chown d4/d15/d19/d45/f4d 3834242 1 2024-09-19T09:41:40.230 INFO:tasks.workunit.client.0.smithi042.stdout:2/520: mkdir d7/dd/d14/d35/d6b/d88/da8 0 2024-09-19T09:41:40.231 INFO:tasks.workunit.client.0.smithi042.stdout:9/422: unlink d8/db/f34 0 2024-09-19T09:41:40.232 INFO:tasks.workunit.client.0.smithi042.stdout:1/596: rmdir d4/d15/d61/d85 39 2024-09-19T09:41:40.233 INFO:tasks.workunit.client.0.smithi042.stdout:4/539: dread d0/d28/fae [0,4194304] 0 2024-09-19T09:41:40.233 INFO:tasks.workunit.client.0.smithi042.stdout:9/423: truncate d8/da/f10 1281933 0 2024-09-19T09:41:40.233 INFO:tasks.workunit.client.0.smithi042.stdout:4/540: readlink d0/d1b/d1c/d2e/l30 0 2024-09-19T09:41:40.234 INFO:tasks.workunit.client.0.smithi042.stdout:4/541: rmdir d0/d1b/d1c/d2e/d3f 39 2024-09-19T09:41:40.234 INFO:tasks.workunit.client.0.smithi042.stdout:4/542: chown d0/d1b/c97 3115130 1 2024-09-19T09:41:40.234 INFO:tasks.workunit.client.0.smithi042.stdout:3/538: dwrite d4/d8/d9/dc/fa4 [0,4194304] 0 2024-09-19T09:41:40.235 INFO:tasks.workunit.client.0.smithi042.stdout:4/543: unlink d0/d28/d36/fb3 0 2024-09-19T09:41:40.237 INFO:tasks.workunit.client.0.smithi042.stdout:3/539: truncate d4/d8/f36 1578810 0 2024-09-19T09:41:40.237 INFO:tasks.workunit.client.0.smithi042.stdout:4/544: unlink d0/d1b/d56/d86/f9b 0 2024-09-19T09:41:40.239 INFO:tasks.workunit.client.0.smithi042.stdout:3/540: creat d4/d8/d9/d1b/d4f/fa9 x:0 0 0 2024-09-19T09:41:40.239 INFO:tasks.workunit.client.0.smithi042.stdout:3/541: dread - d4/d8/d9/dc/f9b zero size 2024-09-19T09:41:40.239 INFO:tasks.workunit.client.0.smithi042.stdout:3/542: dread - d4/d8/d9/d1b/d4f/f77 zero size 2024-09-19T09:41:40.240 INFO:tasks.workunit.client.0.smithi042.stdout:4/545: creat d0/d1b/d1c/d2e/d3f/d6e/da0/fb9 x:0 0 0 2024-09-19T09:41:40.242 INFO:tasks.workunit.client.0.smithi042.stdout:3/543: mknod d4/d8/d9/d1b/d4f/d9c/caa 0 2024-09-19T09:41:40.243 INFO:tasks.workunit.client.0.smithi042.stdout:4/546: mkdir d0/d1b/d1c/d2e/d3b/d95/db1/dba 0 2024-09-19T09:41:40.243 INFO:tasks.workunit.client.0.smithi042.stdout:2/521: read d7/dd/d14/f25 [6327107,31708] 0 2024-09-19T09:41:40.243 INFO:tasks.workunit.client.0.smithi042.stdout:2/522: truncate d7/dd/f16 1345523 0 2024-09-19T09:41:40.244 INFO:tasks.workunit.client.0.smithi042.stdout:4/547: truncate d0/d1b/d1c/d2e/f50 1149788 0 2024-09-19T09:41:40.244 INFO:tasks.workunit.client.0.smithi042.stdout:4/548: mknod d0/d1b/d1c/d2e/d3b/cbb 0 2024-09-19T09:41:40.246 INFO:tasks.workunit.client.0.smithi042.stdout:4/549: mknod d0/d1b/d1c/d2e/d3f/d5a/cbc 0 2024-09-19T09:41:40.246 INFO:tasks.workunit.client.0.smithi042.stdout:4/550: fsync d0/f92 0 2024-09-19T09:41:40.247 INFO:tasks.workunit.client.0.smithi042.stdout:2/523: unlink d7/dd/f89 0 2024-09-19T09:41:40.248 INFO:tasks.workunit.client.0.smithi042.stdout:4/551: mkdir d0/d1b/d1c/d2e/d3b/d95/db1/dba/dbd 0 2024-09-19T09:41:40.252 INFO:tasks.workunit.client.0.smithi042.stdout:4/552: creat d0/d1b/d1c/d2e/d3b/d95/db1/fbe x:0 0 0 2024-09-19T09:41:40.252 INFO:tasks.workunit.client.0.smithi042.stdout:4/553: write d0/d1b/f6f [1154700,94597] 0 2024-09-19T09:41:40.252 INFO:tasks.workunit.client.0.smithi042.stdout:5/462: dwrite d2/d25/d4d/f92 [0,4194304] 0 2024-09-19T09:41:40.253 INFO:tasks.workunit.client.0.smithi042.stdout:9/424: dwrite d8/da/d19/d1c/f5e [0,4194304] 0 2024-09-19T09:41:40.253 INFO:tasks.workunit.client.0.smithi042.stdout:9/425: chown d8/da/d19/d1c/d21/d7f/d72/c74 38996 1 2024-09-19T09:41:40.255 INFO:tasks.workunit.client.0.smithi042.stdout:5/463: dread d2/d4/d20/f89 [0,4194304] 0 2024-09-19T09:41:40.257 INFO:tasks.workunit.client.0.smithi042.stdout:5/464: rename d2/d25/d4d to d2/d4/d64/dab 0 2024-09-19T09:41:40.260 INFO:tasks.workunit.client.0.smithi042.stdout:3/544: dwrite d4/f92 [0,4194304] 0 2024-09-19T09:41:40.264 INFO:tasks.workunit.client.0.smithi042.stdout:3/545: link d4/d8/d4c/f71 d4/d8/d9/dc/d26/d5c/fab 0 2024-09-19T09:41:40.270 INFO:tasks.workunit.client.0.smithi042.stdout:3/546: dread d4/d8/f1c [0,4194304] 0 2024-09-19T09:41:40.271 INFO:tasks.workunit.client.0.smithi042.stdout:3/547: truncate d4/d8/d4c/f81 258500 0 2024-09-19T09:41:40.273 INFO:tasks.workunit.client.0.smithi042.stdout:3/548: mknod d4/d8/d9/d39/d4b/cac 0 2024-09-19T09:41:40.274 INFO:tasks.workunit.client.0.smithi042.stdout:3/549: creat d4/d8/d9/dc/d26/d5c/d82/d48/fad x:0 0 0 2024-09-19T09:41:40.292 INFO:tasks.workunit.client.0.smithi042.stdout:9/426: dwrite d8/da/d70/f7a [0,4194304] 0 2024-09-19T09:41:40.292 INFO:tasks.workunit.client.0.smithi042.stdout:9/427: write d8/db/f26 [1150836,87846] 0 2024-09-19T09:41:40.292 INFO:tasks.workunit.client.0.smithi042.stdout:5/465: dwrite d2/db/d3c/f6e [0,4194304] 0 2024-09-19T09:41:40.292 INFO:tasks.workunit.client.0.smithi042.stdout:4/554: dwrite d0/d1b/d1c/d2e/d3b/f47 [0,4194304] 0 2024-09-19T09:41:40.295 INFO:tasks.workunit.client.0.smithi042.stdout:5/466: rename d2/db/d3c/la5 to d2/d4/d20/d60/lac 0 2024-09-19T09:41:40.296 INFO:tasks.workunit.client.0.smithi042.stdout:4/555: rmdir d0/db2 0 2024-09-19T09:41:40.296 INFO:tasks.workunit.client.0.smithi042.stdout:4/556: fsync d0/f4 0 2024-09-19T09:41:40.296 INFO:tasks.workunit.client.0.smithi042.stdout:4/557: getdents d0/d28/d36/d91 0 2024-09-19T09:41:40.296 INFO:tasks.workunit.client.0.smithi042.stdout:4/558: truncate d0/d1b/d1c/f59 694804 0 2024-09-19T09:41:40.297 INFO:tasks.workunit.client.0.smithi042.stdout:5/467: creat d2/fad x:0 0 0 2024-09-19T09:41:40.298 INFO:tasks.workunit.client.0.smithi042.stdout:4/559: creat d0/d1b/d1c/db8/fbf x:0 0 0 2024-09-19T09:41:40.300 INFO:tasks.workunit.client.0.smithi042.stdout:5/468: unlink d2/f95 0 2024-09-19T09:41:40.301 INFO:tasks.workunit.client.0.smithi042.stdout:4/560: mkdir d0/d1b/d69/dc0 0 2024-09-19T09:41:40.301 INFO:tasks.workunit.client.0.smithi042.stdout:5/469: link d2/d4/d64/dab/f47 d2/d4/d2e/fae 0 2024-09-19T09:41:40.303 INFO:tasks.workunit.client.0.smithi042.stdout:4/561: mkdir d0/d1b/d1c/d2e/d44/dc1 0 2024-09-19T09:41:40.304 INFO:tasks.workunit.client.0.smithi042.stdout:5/470: creat d2/db/faf x:0 0 0 2024-09-19T09:41:40.305 INFO:tasks.workunit.client.0.smithi042.stdout:5/471: chown d2/d25/c61 2326 1 2024-09-19T09:41:40.305 INFO:tasks.workunit.client.0.smithi042.stdout:5/472: dread - d2/d25/f80 zero size 2024-09-19T09:41:40.305 INFO:tasks.workunit.client.0.smithi042.stdout:4/562: mknod d0/d1b/d1c/d2e/d3f/d5a/cc2 0 2024-09-19T09:41:40.306 INFO:tasks.workunit.client.0.smithi042.stdout:5/473: getdents d2/db/d3c 0 2024-09-19T09:41:40.308 INFO:tasks.workunit.client.0.smithi042.stdout:5/474: dread d2/d4/d20/f89 [0,4194304] 0 2024-09-19T09:41:40.308 INFO:tasks.workunit.client.0.smithi042.stdout:5/475: fdatasync d2/d4/d64/dab/f1d 0 2024-09-19T09:41:40.312 INFO:tasks.workunit.client.0.smithi042.stdout:9/428: dwrite d8/da/d19/f2b [0,4194304] 0 2024-09-19T09:41:40.329 INFO:tasks.workunit.client.0.smithi042.stdout:4/563: dwrite d0/fb [0,4194304] 0 2024-09-19T09:41:40.329 INFO:tasks.workunit.client.0.smithi042.stdout:4/564: fdatasync d0/d1b/d1c/f1f 0 2024-09-19T09:41:40.330 INFO:tasks.workunit.client.0.smithi042.stdout:5/476: dwrite d2/db/d3c/d86/f88 [0,4194304] 0 2024-09-19T09:41:40.333 INFO:tasks.workunit.client.0.smithi042.stdout:5/477: mkdir d2/d4/d20/d60/db0 0 2024-09-19T09:41:40.333 INFO:tasks.workunit.client.0.smithi042.stdout:5/478: dread - d2/d25/f9f zero size 2024-09-19T09:41:40.334 INFO:tasks.workunit.client.0.smithi042.stdout:0/503: sync 2024-09-19T09:41:40.334 INFO:tasks.workunit.client.0.smithi042.stdout:8/519: sync 2024-09-19T09:41:40.334 INFO:tasks.workunit.client.0.smithi042.stdout:6/476: sync 2024-09-19T09:41:40.334 INFO:tasks.workunit.client.0.smithi042.stdout:8/520: truncate d1/da/f12 3886245 0 2024-09-19T09:41:40.335 INFO:tasks.workunit.client.0.smithi042.stdout:5/479: dread d2/d4/d20/f38 [0,4194304] 0 2024-09-19T09:41:40.335 INFO:tasks.workunit.client.0.smithi042.stdout:5/480: fdatasync d2/d4/f78 0 2024-09-19T09:41:40.335 INFO:tasks.workunit.client.0.smithi042.stdout:0/504: mknod d2/d10/d1e/c9a 0 2024-09-19T09:41:40.336 INFO:tasks.workunit.client.0.smithi042.stdout:6/477: creat d1/de/d54/f87 x:0 0 0 2024-09-19T09:41:40.342 INFO:tasks.workunit.client.0.smithi042.stdout:5/481: read d2/d4/d64/dab/f92 [659028,478] 0 2024-09-19T09:41:40.343 INFO:tasks.workunit.client.0.smithi042.stdout:5/482: readlink d2/db/d42/l98 0 2024-09-19T09:41:40.343 INFO:tasks.workunit.client.0.smithi042.stdout:9/429: dwrite d8/da/d19/d1c/d21/d7f/f5a [0,4194304] 0 2024-09-19T09:41:40.343 INFO:tasks.workunit.client.0.smithi042.stdout:5/483: truncate d2/d4/d64/da7/f1f 2082504 0 2024-09-19T09:41:40.345 INFO:tasks.workunit.client.0.smithi042.stdout:4/565: dread d0/d1b/f32 [0,4194304] 0 2024-09-19T09:41:40.346 INFO:tasks.workunit.client.0.smithi042.stdout:4/566: creat d0/d1b/d1c/db8/fc3 x:0 0 0 2024-09-19T09:41:40.350 INFO:tasks.workunit.client.0.smithi042.stdout:4/567: mkdir d0/d1b/d1c/d2e/dc4 0 2024-09-19T09:41:40.352 INFO:tasks.workunit.client.0.smithi042.stdout:4/568: rename d0/d1b/d1c/d2e/d3f/f4e to d0/d1b/d1c/d2e/d3f/d6e/da0/fc5 0 2024-09-19T09:41:40.354 INFO:tasks.workunit.client.0.smithi042.stdout:4/569: dread d0/d1b/d1c/f2c [0,4194304] 0 2024-09-19T09:41:40.355 INFO:tasks.workunit.client.0.smithi042.stdout:4/570: creat d0/d1b/d1c/d61/d7f/d83/fc6 x:0 0 0 2024-09-19T09:41:40.355 INFO:tasks.workunit.client.0.smithi042.stdout:4/571: fdatasync d0/d1b/f1e 0 2024-09-19T09:41:40.356 INFO:tasks.workunit.client.0.smithi042.stdout:5/484: dread d2/db/d3c/d86/f88 [0,4194304] 0 2024-09-19T09:41:40.357 INFO:tasks.workunit.client.0.smithi042.stdout:4/572: link d0/d1b/c97 d0/d28/d87/cc7 0 2024-09-19T09:41:40.358 INFO:tasks.workunit.client.0.smithi042.stdout:4/573: mkdir d0/d1b/d1c/d61/dc8 0 2024-09-19T09:41:40.381 INFO:tasks.workunit.client.0.smithi042.stdout:0/505: dwrite d2/d10/d1d/f2b [4194304,4194304] 0 2024-09-19T09:41:40.387 INFO:tasks.workunit.client.0.smithi042.stdout:8/521: dwrite d1/da/d3f/f50 [0,4194304] 0 2024-09-19T09:41:40.387 INFO:tasks.workunit.client.0.smithi042.stdout:6/478: dwrite d1/de/d12/d22/d34/d6f/d4a/f83 [0,4194304] 0 2024-09-19T09:41:40.387 INFO:tasks.workunit.client.0.smithi042.stdout:5/485: dwrite d2/d4/f67 [0,4194304] 0 2024-09-19T09:41:40.390 INFO:tasks.workunit.client.0.smithi042.stdout:8/522: creat d1/da/d3f/f98 x:0 0 0 2024-09-19T09:41:40.390 INFO:tasks.workunit.client.0.smithi042.stdout:6/479: getdents d1/d20/d69 0 2024-09-19T09:41:40.391 INFO:tasks.workunit.client.0.smithi042.stdout:7/493: sync 2024-09-19T09:41:40.392 INFO:tasks.workunit.client.0.smithi042.stdout:5/486: creat d2/fb1 x:0 0 0 2024-09-19T09:41:40.392 INFO:tasks.workunit.client.0.smithi042.stdout:5/487: write d2/d4/d20/d60/d72/fa6 [528780,41731] 0 2024-09-19T09:41:40.393 INFO:tasks.workunit.client.0.smithi042.stdout:8/523: mkdir d1/da/d32/d41/d55/d99 0 2024-09-19T09:41:40.393 INFO:tasks.workunit.client.0.smithi042.stdout:6/480: creat d1/de/d12/d1c/f88 x:0 0 0 2024-09-19T09:41:40.393 INFO:tasks.workunit.client.0.smithi042.stdout:6/481: chown d1/f18 0 1 2024-09-19T09:41:40.394 INFO:tasks.workunit.client.0.smithi042.stdout:0/506: write d2/d10/d1d/d34/f4a [207449,2729] 0 2024-09-19T09:41:40.395 INFO:tasks.workunit.client.0.smithi042.stdout:7/494: link d0/d3d/c76 d0/d14/d44/d47/ca2 0 2024-09-19T09:41:40.395 INFO:tasks.workunit.client.0.smithi042.stdout:5/488: mknod d2/d4/d20/cb2 0 2024-09-19T09:41:40.396 INFO:tasks.workunit.client.0.smithi042.stdout:6/482: mknod d1/c89 0 2024-09-19T09:41:40.397 INFO:tasks.workunit.client.0.smithi042.stdout:0/507: creat d2/d10/d12/d16/f9b x:0 0 0 2024-09-19T09:41:40.398 INFO:tasks.workunit.client.0.smithi042.stdout:8/524: dread d1/da/d32/d3d/d59/f7b [0,4194304] 0 2024-09-19T09:41:40.398 INFO:tasks.workunit.client.0.smithi042.stdout:8/525: chown d1/d72 5 1 2024-09-19T09:41:40.399 INFO:tasks.workunit.client.0.smithi042.stdout:7/495: rmdir d0/d3d/d92/da1/d96 0 2024-09-19T09:41:40.399 INFO:tasks.workunit.client.0.smithi042.stdout:5/489: mknod d2/db/cb3 0 2024-09-19T09:41:40.399 INFO:tasks.workunit.client.0.smithi042.stdout:6/483: mknod d1/de/d12/d22/c8a 0 2024-09-19T09:41:40.400 INFO:tasks.workunit.client.0.smithi042.stdout:7/496: creat d0/d40/d9d/fa3 x:0 0 0 2024-09-19T09:41:40.404 INFO:tasks.workunit.client.0.smithi042.stdout:8/526: dread d1/da/dd/f88 [0,4194304] 0 2024-09-19T09:41:40.405 INFO:tasks.workunit.client.0.smithi042.stdout:8/527: symlink d1/da/d32/d92/l9a 0 2024-09-19T09:41:40.406 INFO:tasks.workunit.client.0.smithi042.stdout:8/528: mknod d1/da/dd/d8e/c9b 0 2024-09-19T09:41:40.407 INFO:tasks.workunit.client.0.smithi042.stdout:8/529: readlink d1/da/d32/d87/l96 0 2024-09-19T09:41:40.407 INFO:tasks.workunit.client.0.smithi042.stdout:5/490: dread d2/db/d3c/f6e [0,4194304] 0 2024-09-19T09:41:40.407 INFO:tasks.workunit.client.0.smithi042.stdout:5/491: dread - d2/fad zero size 2024-09-19T09:41:40.407 INFO:tasks.workunit.client.0.smithi042.stdout:5/492: write d2/fb1 [319568,9714] 0 2024-09-19T09:41:40.407 INFO:tasks.workunit.client.0.smithi042.stdout:8/530: rmdir d1/da/d32/d87 39 2024-09-19T09:41:40.417 INFO:tasks.workunit.client.0.smithi042.stdout:7/497: read d0/f1a [317063,116264] 0 2024-09-19T09:41:40.419 INFO:tasks.workunit.client.0.smithi042.stdout:7/498: creat d0/d3d/d92/fa4 x:0 0 0 2024-09-19T09:41:40.423 INFO:tasks.workunit.client.0.smithi042.stdout:0/508: dwrite d2/d10/d12/d24/f42 [0,4194304] 0 2024-09-19T09:41:40.425 INFO:tasks.workunit.client.0.smithi042.stdout:0/509: symlink d2/d10/d12/d19/d5a/l9c 0 2024-09-19T09:41:40.426 INFO:tasks.workunit.client.0.smithi042.stdout:0/510: truncate d2/d10/d1e/f6c 138309 0 2024-09-19T09:41:40.426 INFO:tasks.workunit.client.0.smithi042.stdout:5/493: dwrite d2/db/f7d [0,4194304] 0 2024-09-19T09:41:40.427 INFO:tasks.workunit.client.0.smithi042.stdout:6/484: dwrite d1/d2e/f30 [0,4194304] 0 2024-09-19T09:41:40.428 INFO:tasks.workunit.client.0.smithi042.stdout:5/494: unlink d2/d4/d2e/fae 0 2024-09-19T09:41:40.429 INFO:tasks.workunit.client.0.smithi042.stdout:6/485: mknod d1/de/d12/d22/d34/c8b 0 2024-09-19T09:41:40.429 INFO:tasks.workunit.client.0.smithi042.stdout:6/486: write d1/d2e/f31 [1445858,39052] 0 2024-09-19T09:41:40.429 INFO:tasks.workunit.client.0.smithi042.stdout:5/495: mkdir d2/d4/d64/da7/db4 0 2024-09-19T09:41:40.430 INFO:tasks.workunit.client.0.smithi042.stdout:6/487: truncate d1/fc 2521344 0 2024-09-19T09:41:40.431 INFO:tasks.workunit.client.0.smithi042.stdout:6/488: creat d1/d20/f8c x:0 0 0 2024-09-19T09:41:40.433 INFO:tasks.workunit.client.0.smithi042.stdout:7/499: dwrite d0/f23 [0,4194304] 0 2024-09-19T09:41:40.434 INFO:tasks.workunit.client.0.smithi042.stdout:8/531: dwrite d1/da/d32/d41/f57 [4194304,4194304] 0 2024-09-19T09:41:40.439 INFO:tasks.workunit.client.0.smithi042.stdout:7/500: rmdir d0/d56 39 2024-09-19T09:41:40.439 INFO:tasks.workunit.client.0.smithi042.stdout:7/501: truncate d0/d14/f83 1329218 0 2024-09-19T09:41:40.439 INFO:tasks.workunit.client.0.smithi042.stdout:7/502: stat d0/c67 0 2024-09-19T09:41:40.441 INFO:tasks.workunit.client.0.smithi042.stdout:0/511: rename d2/d10/d12/d19 to d2/d10/d12/d16/d18/d8a/d9d 0 2024-09-19T09:41:40.441 INFO:tasks.workunit.client.0.smithi042.stdout:0/512: dread - d2/d10/d1d/f59 zero size 2024-09-19T09:41:40.441 INFO:tasks.workunit.client.0.smithi042.stdout:0/513: truncate d2/d10/d12/d16/d51/f76 788027 0 2024-09-19T09:41:40.445 INFO:tasks.workunit.client.0.smithi042.stdout:8/532: rmdir d1/da/dd/d8e 39 2024-09-19T09:41:40.445 INFO:tasks.workunit.client.0.smithi042.stdout:8/533: stat d1/da/d14/c3c 0 2024-09-19T09:41:40.445 INFO:tasks.workunit.client.0.smithi042.stdout:7/503: symlink d0/la5 0 2024-09-19T09:41:40.446 INFO:tasks.workunit.client.0.smithi042.stdout:0/514: rmdir d2/d10/d1d 39 2024-09-19T09:41:40.447 INFO:tasks.workunit.client.0.smithi042.stdout:7/504: dread d0/d3d/d55/d72/f86 [0,4194304] 0 2024-09-19T09:41:40.449 INFO:tasks.workunit.client.0.smithi042.stdout:0/515: link d2/d10/d12/d16/d18/l45 d2/d10/d1d/l9e 0 2024-09-19T09:41:40.449 INFO:tasks.workunit.client.0.smithi042.stdout:0/516: truncate d2/d10/d6b/f77 308164 0 2024-09-19T09:41:40.449 INFO:tasks.workunit.client.0.smithi042.stdout:7/505: getdents d0/d3d/d92 0 2024-09-19T09:41:40.451 INFO:tasks.workunit.client.0.smithi042.stdout:8/534: symlink d1/da/d14/l9c 0 2024-09-19T09:41:40.452 INFO:tasks.workunit.client.0.smithi042.stdout:0/517: mkdir d2/d10/d12/d16/d18/d8a/d9d/d5a/d8f/d9f 0 2024-09-19T09:41:40.452 INFO:tasks.workunit.client.0.smithi042.stdout:6/489: dwrite d1/de/d12/d22/d34/d6f/d4a/f82 [0,4194304] 0 2024-09-19T09:41:40.453 INFO:tasks.workunit.client.0.smithi042.stdout:7/506: unlink d0/f6 0 2024-09-19T09:41:40.455 INFO:tasks.workunit.client.0.smithi042.stdout:0/518: unlink d2/d10/d1d/d34/l7f 0 2024-09-19T09:41:40.455 INFO:tasks.workunit.client.0.smithi042.stdout:5/496: dwrite d2/d4/d64/da7/f23 [0,4194304] 0 2024-09-19T09:41:40.455 INFO:tasks.workunit.client.0.smithi042.stdout:0/519: write d2/d8e/d32/f72 [622233,68444] 0 2024-09-19T09:41:40.456 INFO:tasks.workunit.client.0.smithi042.stdout:5/497: write d2/d4/d20/f38 [213690,23227] 0 2024-09-19T09:41:40.458 INFO:tasks.workunit.client.0.smithi042.stdout:6/490: creat d1/f8d x:0 0 0 2024-09-19T09:41:40.458 INFO:tasks.workunit.client.0.smithi042.stdout:7/507: creat d0/d3d/d85/fa6 x:0 0 0 2024-09-19T09:41:40.458 INFO:tasks.workunit.client.0.smithi042.stdout:6/491: fdatasync d1/f18 0 2024-09-19T09:41:40.459 INFO:tasks.workunit.client.0.smithi042.stdout:8/535: read d1/da/d32/d3d/d58/f5d [3002113,51457] 0 2024-09-19T09:41:40.460 INFO:tasks.workunit.client.0.smithi042.stdout:0/520: dread d2/d10/d1d/d34/f86 [0,4194304] 0 2024-09-19T09:41:40.460 INFO:tasks.workunit.client.0.smithi042.stdout:2/524: sync 2024-09-19T09:41:40.460 INFO:tasks.workunit.client.0.smithi042.stdout:1/597: sync 2024-09-19T09:41:40.460 INFO:tasks.workunit.client.0.smithi042.stdout:3/550: sync 2024-09-19T09:41:40.460 INFO:tasks.workunit.client.0.smithi042.stdout:3/551: fdatasync d4/f52 0 2024-09-19T09:41:40.461 INFO:tasks.workunit.client.0.smithi042.stdout:2/525: symlink d7/dd/d14/d35/d6b/d88/la9 0 2024-09-19T09:41:40.461 INFO:tasks.workunit.client.0.smithi042.stdout:7/508: creat d0/d14/fa7 x:0 0 0 2024-09-19T09:41:40.462 INFO:tasks.workunit.client.0.smithi042.stdout:2/526: link d7/dd/d22/d30/c77 d7/dd/d14/d35/d4e/d9c/caa 0 2024-09-19T09:41:40.463 INFO:tasks.workunit.client.0.smithi042.stdout:8/536: dread d1/da/dd/d74/f7e [0,4194304] 0 2024-09-19T09:41:40.463 INFO:tasks.workunit.client.0.smithi042.stdout:8/537: fsync d1/d2e/f51 0 2024-09-19T09:41:40.463 INFO:tasks.workunit.client.0.smithi042.stdout:1/598: creat d4/d4e/fc0 x:0 0 0 2024-09-19T09:41:40.463 INFO:tasks.workunit.client.0.smithi042.stdout:1/599: fsync d4/d15/d9e/fb6 0 2024-09-19T09:41:40.465 INFO:tasks.workunit.client.0.smithi042.stdout:3/552: rename d4/d8/d9/d39/d4b/f7e to d4/d8/d9/dc/d26/d5c/fae 0 2024-09-19T09:41:40.467 INFO:tasks.workunit.client.0.smithi042.stdout:0/521: mkdir d2/d10/d12/d16/d18/d8a/d9d/d5a/d85/da0 0 2024-09-19T09:41:40.467 INFO:tasks.workunit.client.0.smithi042.stdout:0/522: chown d2/d10/d12/f31 131606 1 2024-09-19T09:41:40.468 INFO:tasks.workunit.client.0.smithi042.stdout:6/492: write d1/de/d12/f19 [29313,73167] 0 2024-09-19T09:41:40.470 INFO:tasks.workunit.client.0.smithi042.stdout:8/538: link d1/da/d32/d41/l8d d1/da/d32/d3d/d95/l9d 0 2024-09-19T09:41:40.472 INFO:tasks.workunit.client.0.smithi042.stdout:7/509: rename d0/d14/l2e to d0/d3d/d92/la8 0 2024-09-19T09:41:40.472 INFO:tasks.workunit.client.0.smithi042.stdout:7/510: write d0/fa [511961,111195] 0 2024-09-19T09:41:40.473 INFO:tasks.workunit.client.0.smithi042.stdout:0/523: mkdir d2/d10/da1 0 2024-09-19T09:41:40.474 INFO:tasks.workunit.client.0.smithi042.stdout:3/553: dread d4/d8/f72 [0,4194304] 0 2024-09-19T09:41:40.475 INFO:tasks.workunit.client.0.smithi042.stdout:6/493: creat d1/de/d54/f8e x:0 0 0 2024-09-19T09:41:40.475 INFO:tasks.workunit.client.0.smithi042.stdout:6/494: truncate d1/de/d12/d22/f2a 4417720 0 2024-09-19T09:41:40.475 INFO:tasks.workunit.client.0.smithi042.stdout:6/495: fsync d1/de/d54/f87 0 2024-09-19T09:41:40.476 INFO:tasks.workunit.client.0.smithi042.stdout:8/539: truncate d1/da/d32/f64 1328172 0 2024-09-19T09:41:40.476 INFO:tasks.workunit.client.0.smithi042.stdout:4/574: sync 2024-09-19T09:41:40.476 INFO:tasks.workunit.client.0.smithi042.stdout:9/430: sync 2024-09-19T09:41:40.477 INFO:tasks.workunit.client.0.smithi042.stdout:1/600: rename d4/f10 to d4/d15/d2e/fc1 0 2024-09-19T09:41:40.478 INFO:tasks.workunit.client.0.smithi042.stdout:7/511: mkdir d0/d56/da9 0 2024-09-19T09:41:40.479 INFO:tasks.workunit.client.0.smithi042.stdout:2/527: dwrite d7/dd/d14/d35/d6b/d88/f95 [0,4194304] 0 2024-09-19T09:41:40.479 INFO:tasks.workunit.client.0.smithi042.stdout:0/524: creat d2/d10/d12/d16/d18/d8a/d9d/d5a/d85/fa2 x:0 0 0 2024-09-19T09:41:40.480 INFO:tasks.workunit.client.0.smithi042.stdout:2/528: creat d7/dd/d48/fab x:0 0 0 2024-09-19T09:41:40.481 INFO:tasks.workunit.client.0.smithi042.stdout:3/554: creat d4/d8/d9/d1b/d4f/faf x:0 0 0 2024-09-19T09:41:40.483 INFO:tasks.workunit.client.0.smithi042.stdout:8/540: creat d1/da/dd/d74/f9e x:0 0 0 2024-09-19T09:41:40.484 INFO:tasks.workunit.client.0.smithi042.stdout:9/431: creat d8/db/d31/d39/f83 x:0 0 0 2024-09-19T09:41:40.484 INFO:tasks.workunit.client.0.smithi042.stdout:9/432: chown d8/da/d19/d1c/d21/c63 530282109 1 2024-09-19T09:41:40.485 INFO:tasks.workunit.client.0.smithi042.stdout:2/529: unlink d7/dd/d14/d35/d4e/d9c/f52 0 2024-09-19T09:41:40.485 INFO:tasks.workunit.client.0.smithi042.stdout:2/530: write d7/dd/d14/d35/d4c/d61/fa2 [467688,26629] 0 2024-09-19T09:41:40.486 INFO:tasks.workunit.client.0.smithi042.stdout:4/575: link d0/d1b/d1c/d2e/d3f/d5a/f75 d0/d1b/d1c/d2e/d3b/d95/fc9 0 2024-09-19T09:41:40.486 INFO:tasks.workunit.client.0.smithi042.stdout:2/531: unlink d7/dd/f16 0 2024-09-19T09:41:40.486 INFO:tasks.workunit.client.0.smithi042.stdout:2/532: rmdir d7/dd/d14/d35/d6b 39 2024-09-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi042.stdout:2/533: creat d7/dd/d14/d35/d6b/d88/da8/fac x:0 0 0 2024-09-19T09:41:40.488 INFO:tasks.workunit.client.0.smithi042.stdout:1/601: rename d4/d12/d8d/d91/fbc to d4/d29/fc2 0 2024-09-19T09:41:40.488 INFO:tasks.workunit.client.0.smithi042.stdout:2/534: mknod d7/dd/cad 0 2024-09-19T09:41:40.489 INFO:tasks.workunit.client.0.smithi042.stdout:7/512: mkdir d0/d56/da9/daa 0 2024-09-19T09:41:40.489 INFO:tasks.workunit.client.0.smithi042.stdout:7/513: write d0/d3d/d55/f74 [1020383,70664] 0 2024-09-19T09:41:40.490 INFO:tasks.workunit.client.0.smithi042.stdout:0/525: rmdir d2/d10/d12/d16/d18/d8a/d9d 39 2024-09-19T09:41:40.492 INFO:tasks.workunit.client.0.smithi042.stdout:3/555: creat d4/d8/d9/dc/d26/d35/fb0 x:0 0 0 2024-09-19T09:41:40.495 INFO:tasks.workunit.client.0.smithi042.stdout:6/496: dwrite d1/de/d12/d22/d34/f73 [0,4194304] 0 2024-09-19T09:41:40.498 INFO:tasks.workunit.client.0.smithi042.stdout:7/514: write d0/d14/d44/f54 [3255231,98136] 0 2024-09-19T09:41:40.498 INFO:tasks.workunit.client.0.smithi042.stdout:7/515: write d0/d56/f88 [2946341,99574] 0 2024-09-19T09:41:40.501 INFO:tasks.workunit.client.0.smithi042.stdout:9/433: dread d8/d32/f48 [0,4194304] 0 2024-09-19T09:41:40.501 INFO:tasks.workunit.client.0.smithi042.stdout:9/434: fdatasync f1 0 2024-09-19T09:41:40.507 INFO:tasks.workunit.client.0.smithi042.stdout:2/535: dread d7/dd/d14/f56 [0,4194304] 0 2024-09-19T09:41:40.507 INFO:tasks.workunit.client.0.smithi042.stdout:2/536: readlink d7/l3d 0 2024-09-19T09:41:40.518 INFO:tasks.workunit.client.0.smithi042.stdout:6/497: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:41:40.518 INFO:tasks.workunit.client.0.smithi042.stdout:6/498: write d1/d20/f62 [121123,81266] 0 2024-09-19T09:41:40.519 INFO:tasks.workunit.client.0.smithi042.stdout:8/541: mknod d1/da/dd/c9f 0 2024-09-19T09:41:40.519 INFO:tasks.workunit.client.0.smithi042.stdout:6/499: read d1/de/d12/d1c/d3a/f47 [336362,117945] 0 2024-09-19T09:41:40.525 INFO:tasks.workunit.client.0.smithi042.stdout:0/526: unlink d2/d10/d12/d16/d57/d78/f94 0 2024-09-19T09:41:40.526 INFO:tasks.workunit.client.0.smithi042.stdout:6/500: dread d1/de/d12/d22/f25 [0,4194304] 0 2024-09-19T09:41:40.526 INFO:tasks.workunit.client.0.smithi042.stdout:6/501: fsync d1/f18 0 2024-09-19T09:41:40.526 INFO:tasks.workunit.client.0.smithi042.stdout:6/502: stat d1/de/d12/d22/d34/f3d 0 2024-09-19T09:41:40.526 INFO:tasks.workunit.client.0.smithi042.stdout:6/503: write d1/de/d12/d1c/f77 [892816,98897] 0 2024-09-19T09:41:40.527 INFO:tasks.workunit.client.0.smithi042.stdout:0/527: read d2/d10/d12/d16/d18/f22 [254245,68468] 0 2024-09-19T09:41:40.527 INFO:tasks.workunit.client.0.smithi042.stdout:0/528: chown d2/d10/d1e/l8b 101792995 1 2024-09-19T09:41:40.527 INFO:tasks.workunit.client.0.smithi042.stdout:0/529: write d2/d10/d12/f31 [1027036,32873] 0 2024-09-19T09:41:40.527 INFO:tasks.workunit.client.0.smithi042.stdout:6/504: write d1/de/d12/d22/d34/d3f/f5c [948810,125100] 0 2024-09-19T09:41:40.529 INFO:tasks.workunit.client.0.smithi042.stdout:3/556: unlink d4/d8/d9/dc/d26/f32 0 2024-09-19T09:41:40.537 INFO:tasks.workunit.client.0.smithi042.stdout:9/435: link d8/da/d19/f7c d8/da/d19/d1c/d21/f84 0 2024-09-19T09:41:40.537 INFO:tasks.workunit.client.0.smithi042.stdout:7/516: dwrite d0/f59 [0,4194304] 0 2024-09-19T09:41:40.537 INFO:tasks.workunit.client.0.smithi042.stdout:7/517: chown d0/d56/c6f 6443419 1 2024-09-19T09:41:40.541 INFO:tasks.workunit.client.0.smithi042.stdout:1/602: dwrite d4/d15/d2e/db7/d3c/f43 [0,4194304] 0 2024-09-19T09:41:40.548 INFO:tasks.workunit.client.0.smithi042.stdout:7/518: write d0/f59 [87787,53671] 0 2024-09-19T09:41:40.548 INFO:tasks.workunit.client.0.smithi042.stdout:7/519: chown d0/f17 135193134 1 2024-09-19T09:41:40.548 INFO:tasks.workunit.client.0.smithi042.stdout:7/520: stat d0/d3d/d85/d99/c9c 0 2024-09-19T09:41:40.562 INFO:tasks.workunit.client.0.smithi042.stdout:9/436: dwrite d8/da/d70/f7a [0,4194304] 0 2024-09-19T09:41:40.567 INFO:tasks.workunit.client.0.smithi042.stdout:4/576: rename d0/f4 to d0/d28/d87/da1/fca 0 2024-09-19T09:41:40.569 INFO:tasks.workunit.client.0.smithi042.stdout:2/537: rename d7/dd/d22/f4a to d7/dd/d14/d35/d4e/d9c/fae 0 2024-09-19T09:41:40.570 INFO:tasks.workunit.client.0.smithi042.stdout:2/538: mknod d7/dd/d14/d35/d6b/d88/da8/caf 0 2024-09-19T09:41:40.570 INFO:tasks.workunit.client.0.smithi042.stdout:2/539: chown d7/dd/d1f/d3f/f78 15 1 2024-09-19T09:41:40.578 INFO:tasks.workunit.client.0.smithi042.stdout:8/542: link d1/da/d32/d41/l4d d1/da/d32/d41/d55/la0 0 2024-09-19T09:41:40.578 INFO:tasks.workunit.client.0.smithi042.stdout:8/543: write d1/da/dd/f49 [852822,71024] 0 2024-09-19T09:41:40.581 INFO:tasks.workunit.client.0.smithi042.stdout:0/530: mknod d2/d8e/d32/ca3 0 2024-09-19T09:41:40.584 INFO:tasks.workunit.client.0.smithi042.stdout:6/505: getdents d1/de 0 2024-09-19T09:41:40.588 INFO:tasks.workunit.client.0.smithi042.stdout:3/557: mkdir d4/d78/db1 0 2024-09-19T09:41:40.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:40 smithi171 ceph-mon[35803]: pgmap v407: 97 pgs: 97 active+clean; 369 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 53 MiB/s wr, 854 op/s 2024-09-19T09:41:40.609 INFO:tasks.workunit.client.0.smithi042.stdout:7/521: mknod d0/d14/d44/cab 0 2024-09-19T09:41:40.609 INFO:tasks.workunit.client.0.smithi042.stdout:7/522: truncate d0/d14/f6b 271879 0 2024-09-19T09:41:40.609 INFO:tasks.workunit.client.0.smithi042.stdout:5/498: sync 2024-09-19T09:41:40.610 INFO:tasks.workunit.client.0.smithi042.stdout:9/437: getdents d8 0 2024-09-19T09:41:40.611 INFO:tasks.workunit.client.0.smithi042.stdout:4/577: symlink d0/d1b/d56/lcb 0 2024-09-19T09:41:40.611 INFO:tasks.workunit.client.0.smithi042.stdout:4/578: truncate d0/d1b/d1c/d2e/d3b/d95/fc9 262038 0 2024-09-19T09:41:40.613 INFO:tasks.workunit.client.0.smithi042.stdout:8/544: unlink d1/da/d32/d3d/d58/f97 0 2024-09-19T09:41:40.613 INFO:tasks.workunit.client.0.smithi042.stdout:8/545: fsync d1/da/dd/f3a 0 2024-09-19T09:41:40.616 INFO:tasks.workunit.client.0.smithi042.stdout:7/523: dread d0/d56/f66 [0,4194304] 0 2024-09-19T09:41:40.617 INFO:tasks.workunit.client.0.smithi042.stdout:6/506: rename d1/de/d12/d22/d34/d6f/f7c to d1/de/d12/d22/d34/f8f 0 2024-09-19T09:41:40.617 INFO:tasks.workunit.client.0.smithi042.stdout:6/507: stat d1/d20/d6a/f5a 0 2024-09-19T09:41:40.617 INFO:tasks.workunit.client.0.smithi042.stdout:3/558: creat d4/d8/fb2 x:0 0 0 2024-09-19T09:41:40.618 INFO:tasks.workunit.client.0.smithi042.stdout:4/579: dread d0/d1b/d1c/d2e/d3b/f47 [0,4194304] 0 2024-09-19T09:41:40.618 INFO:tasks.workunit.client.0.smithi042.stdout:4/580: write d0/d1b/d1c/d2e/d3f/d5a/fb0 [863386,55693] 0 2024-09-19T09:41:40.619 INFO:tasks.workunit.client.0.smithi042.stdout:1/603: creat d4/d12/d8d/d91/d7f/d99/fc3 x:0 0 0 2024-09-19T09:41:40.621 INFO:tasks.workunit.client.0.smithi042.stdout:9/438: mknod d8/db/d31/c85 0 2024-09-19T09:41:40.623 INFO:tasks.workunit.client.0.smithi042.stdout:0/531: mkdir d2/d10/d12/da4 0 2024-09-19T09:41:40.623 INFO:tasks.workunit.client.0.smithi042.stdout:0/532: chown d2/d8e/l48 7 1 2024-09-19T09:41:40.624 INFO:tasks.workunit.client.0.smithi042.stdout:7/524: truncate d0/d3d/d92/da1/f7f 3101918 0 2024-09-19T09:41:40.626 INFO:tasks.workunit.client.0.smithi042.stdout:6/508: rename d1/d2e to d1/d20/d6a/d90 0 2024-09-19T09:41:40.626 INFO:tasks.workunit.client.0.smithi042.stdout:6/509: truncate d1/d20/f8c 616836 0 2024-09-19T09:41:40.626 INFO:tasks.workunit.client.0.smithi042.stdout:6/510: write d1/de/d12/d1c/d3a/f75 [1676336,123880] 0 2024-09-19T09:41:40.628 INFO:tasks.workunit.client.0.smithi042.stdout:4/581: creat d0/d28/d36/fcc x:0 0 0 2024-09-19T09:41:40.629 INFO:tasks.workunit.client.0.smithi042.stdout:4/582: fdatasync d0/d1b/d1c/db8/fbf 0 2024-09-19T09:41:40.630 INFO:tasks.workunit.client.0.smithi042.stdout:1/604: truncate d4/d15/d19/fe 3137581 0 2024-09-19T09:41:40.633 INFO:tasks.workunit.client.0.smithi042.stdout:7/525: rename d0/d40/l48 to d0/d40/lac 0 2024-09-19T09:41:40.634 INFO:tasks.workunit.client.0.smithi042.stdout:4/583: dread d0/fc [0,4194304] 0 2024-09-19T09:41:40.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:40 smithi136 ceph-mon[34840]: pgmap v407: 97 pgs: 97 active+clean; 369 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 53 MiB/s wr, 854 op/s 2024-09-19T09:41:40.635 INFO:tasks.workunit.client.0.smithi042.stdout:3/559: creat d4/d8/d9/dc/d26/d6d/d8f/fb3 x:0 0 0 2024-09-19T09:41:40.636 INFO:tasks.workunit.client.0.smithi042.stdout:7/526: symlink d0/d14/d44/d47/lad 0 2024-09-19T09:41:40.642 INFO:tasks.workunit.client.0.smithi042.stdout:4/584: mknod d0/d1b/d1c/d61/dc8/ccd 0 2024-09-19T09:41:40.642 INFO:tasks.workunit.client.0.smithi042.stdout:4/585: write d0/d1b/f90 [588521,87266] 0 2024-09-19T09:41:40.643 INFO:tasks.workunit.client.0.smithi042.stdout:7/527: dread d0/d14/d3a/f6e [0,4194304] 0 2024-09-19T09:41:40.644 INFO:tasks.workunit.client.0.smithi042.stdout:3/560: creat d4/d8/d9/dc/d26/d5c/d82/d48/da5/fb4 x:0 0 0 2024-09-19T09:41:40.644 INFO:tasks.workunit.client.0.smithi042.stdout:3/561: dread - d4/d8/fb2 zero size 2024-09-19T09:41:40.644 INFO:tasks.workunit.client.0.smithi042.stdout:3/562: truncate d4/f52 2276779 0 2024-09-19T09:41:40.652 INFO:tasks.workunit.client.0.smithi042.stdout:5/499: readlink d2/d4/d64/da7/la9 0 2024-09-19T09:41:40.657 INFO:tasks.workunit.client.0.smithi042.stdout:3/563: mkdir d4/d8/d9/dc/d26/db5 0 2024-09-19T09:41:40.660 INFO:tasks.workunit.client.0.smithi042.stdout:3/564: creat d4/d8/d9/dc/d26/d5c/d82/d8c/d9f/fb6 x:0 0 0 2024-09-19T09:41:40.660 INFO:tasks.workunit.client.0.smithi042.stdout:3/565: chown d4/d8/d9/c87 3 1 2024-09-19T09:41:40.661 INFO:tasks.workunit.client.0.smithi042.stdout:8/546: write d1/da/d14/f17 [208919,104374] 0 2024-09-19T09:41:40.662 INFO:tasks.workunit.client.0.smithi042.stdout:3/566: rmdir d4/d8/d9/d39/d4b/d7d 39 2024-09-19T09:41:40.663 INFO:tasks.workunit.client.0.smithi042.stdout:8/547: mknod d1/da/d32/d41/ca1 0 2024-09-19T09:41:40.665 INFO:tasks.workunit.client.0.smithi042.stdout:8/548: write d1/da/d3f/f67 [510574,115510] 0 2024-09-19T09:41:40.665 INFO:tasks.workunit.client.0.smithi042.stdout:8/549: write d1/da/d32/d3d/f6c [593116,86465] 0 2024-09-19T09:41:40.670 INFO:tasks.workunit.client.0.smithi042.stdout:3/567: write d4/d8/d9/d39/d4b/f80 [886748,94761] 0 2024-09-19T09:41:40.676 INFO:tasks.workunit.client.0.smithi042.stdout:5/500: dwrite d2/d4/d64/da7/f35 [0,4194304] 0 2024-09-19T09:41:40.677 INFO:tasks.workunit.client.0.smithi042.stdout:5/501: fsync d2/d4/d64/da7/f1f 0 2024-09-19T09:41:40.678 INFO:tasks.workunit.client.0.smithi042.stdout:5/502: fsync d2/d4/d64/dab/f47 0 2024-09-19T09:41:40.679 INFO:tasks.workunit.client.0.smithi042.stdout:5/503: truncate d2/f1b 3400866 0 2024-09-19T09:41:40.681 INFO:tasks.workunit.client.0.smithi042.stdout:5/504: link d2/d25/d37/l4f d2/d4/d20/lb5 0 2024-09-19T09:41:40.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:40 smithi042 ceph-mon[31223]: pgmap v407: 97 pgs: 97 active+clean; 369 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 53 MiB/s wr, 854 op/s 2024-09-19T09:41:40.715 INFO:tasks.workunit.client.0.smithi042.stdout:5/505: creat d2/d4/d64/d6a/fb6 x:0 0 0 2024-09-19T09:41:40.715 INFO:tasks.workunit.client.0.smithi042.stdout:8/550: dwrite d1/da/dd/f5c [0,4194304] 0 2024-09-19T09:41:40.715 INFO:tasks.workunit.client.0.smithi042.stdout:8/551: fdatasync d1/da/f12 0 2024-09-19T09:41:40.715 INFO:tasks.workunit.client.0.smithi042.stdout:8/552: chown d1/da/f5a 52266 1 2024-09-19T09:41:40.716 INFO:tasks.workunit.client.0.smithi042.stdout:0/533: rename d2/d10/d12/d16/d18 to d2/d8e/d32/d64/da5 0 2024-09-19T09:41:40.716 INFO:tasks.workunit.client.0.smithi042.stdout:5/506: mknod d2/db/d3c/d86/cb7 0 2024-09-19T09:41:40.716 INFO:tasks.workunit.client.0.smithi042.stdout:5/507: chown d2/d4/d20/d60/d72/d75/l90 53594 1 2024-09-19T09:41:40.717 INFO:tasks.workunit.client.0.smithi042.stdout:4/586: dwrite d0/d28/d87/da1/fca [0,4194304] 0 2024-09-19T09:41:40.717 INFO:tasks.workunit.client.0.smithi042.stdout:3/568: dwrite d4/d8/d9/d39/d4b/f68 [0,4194304] 0 2024-09-19T09:41:40.717 INFO:tasks.workunit.client.0.smithi042.stdout:3/569: chown d4/d8/d9/d1b/d4f/d9c/caa 312595572 1 2024-09-19T09:41:40.717 INFO:tasks.workunit.client.0.smithi042.stdout:4/587: write d0/d67/f8e [1481166,10182] 0 2024-09-19T09:41:40.717 INFO:tasks.workunit.client.0.smithi042.stdout:8/553: symlink d1/da/d32/d41/d55/la2 0 2024-09-19T09:41:40.719 INFO:tasks.workunit.client.0.smithi042.stdout:6/511: rename d1/d20/f62 to d1/d20/d6a/d90/f91 0 2024-09-19T09:41:40.719 INFO:tasks.workunit.client.0.smithi042.stdout:6/512: chown d1/l14 49 1 2024-09-19T09:41:40.719 INFO:tasks.workunit.client.0.smithi042.stdout:6/513: write d1/de/d12/d1c/d5f/f6e [565764,58061] 0 2024-09-19T09:41:40.721 INFO:tasks.workunit.client.0.smithi042.stdout:5/508: link d2/d4/d2e/c43 d2/d25/cb8 0 2024-09-19T09:41:40.721 INFO:tasks.workunit.client.0.smithi042.stdout:5/509: chown d2/db/l81 97 1 2024-09-19T09:41:40.722 INFO:tasks.workunit.client.0.smithi042.stdout:4/588: write d0/d1b/d1c/f55 [1831410,29841] 0 2024-09-19T09:41:40.722 INFO:tasks.workunit.client.0.smithi042.stdout:4/589: chown d0/d28/fae 19 1 2024-09-19T09:41:40.722 INFO:tasks.workunit.client.0.smithi042.stdout:4/590: readlink d0/d1b/d1c/d2e/d3b/d95/lb7 0 2024-09-19T09:41:40.723 INFO:tasks.workunit.client.0.smithi042.stdout:0/534: mkdir d2/d8e/d32/d64/da5/d8a/d9d/d5a/d85/da6 0 2024-09-19T09:41:40.726 INFO:tasks.workunit.client.0.smithi042.stdout:3/570: creat d4/d8/d9/dc/d26/d35/fb7 x:0 0 0 2024-09-19T09:41:40.727 INFO:tasks.workunit.client.0.smithi042.stdout:8/554: rmdir d1/da/dd 39 2024-09-19T09:41:40.727 INFO:tasks.workunit.client.0.smithi042.stdout:8/555: write d1/da/d32/d3d/d59/f7b [1547863,120096] 0 2024-09-19T09:41:40.728 INFO:tasks.workunit.client.0.smithi042.stdout:1/605: rename d4/d12/l2c to d4/d1d/lc4 0 2024-09-19T09:41:40.731 INFO:tasks.workunit.client.0.smithi042.stdout:6/514: truncate d1/de/d12/f19 324867 0 2024-09-19T09:41:40.732 INFO:tasks.workunit.client.0.smithi042.stdout:5/510: symlink d2/d4/d20/d60/db0/lb9 0 2024-09-19T09:41:40.732 INFO:tasks.workunit.client.0.smithi042.stdout:5/511: chown d2/db/cb3 79 1 2024-09-19T09:41:40.733 INFO:tasks.workunit.client.0.smithi042.stdout:5/512: write d2/d4/d64/da7/faa [28673,55815] 0 2024-09-19T09:41:40.733 INFO:tasks.workunit.client.0.smithi042.stdout:0/535: getdents d2/d8e/d32/d64/da5/d8a/d9d/d5a 0 2024-09-19T09:41:40.734 INFO:tasks.workunit.client.0.smithi042.stdout:8/556: creat d1/da/dd/fa3 x:0 0 0 2024-09-19T09:41:40.735 INFO:tasks.workunit.client.0.smithi042.stdout:5/513: rmdir d2/d4/d20/d60/db0 39 2024-09-19T09:41:40.744 INFO:tasks.workunit.client.0.smithi042.stdout:5/514: dread d2/d4/d64/da7/f35 [0,4194304] 0 2024-09-19T09:41:40.745 INFO:tasks.workunit.client.0.smithi042.stdout:5/515: stat d2/db/c4b 0 2024-09-19T09:41:40.745 INFO:tasks.workunit.client.0.smithi042.stdout:6/515: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:40.745 INFO:tasks.workunit.client.0.smithi042.stdout:6/516: chown d1/d20/d6a/d46 31 1 2024-09-19T09:41:40.747 INFO:tasks.workunit.client.0.smithi042.stdout:5/516: rename d2/d4/c18 to d2/d4/cba 0 2024-09-19T09:41:40.750 INFO:tasks.workunit.client.0.smithi042.stdout:5/517: unlink d2/d4/d20/d31/ca2 0 2024-09-19T09:41:40.751 INFO:tasks.workunit.client.0.smithi042.stdout:5/518: mkdir d2/d4/d20/d60/d72/dbb 0 2024-09-19T09:41:40.752 INFO:tasks.workunit.client.0.smithi042.stdout:5/519: stat d2/d4/ca8 0 2024-09-19T09:41:40.753 INFO:tasks.workunit.client.0.smithi042.stdout:5/520: mknod d2/d25/d37/cbc 0 2024-09-19T09:41:40.756 INFO:tasks.workunit.client.0.smithi042.stdout:3/571: dwrite d4/d8/d9/dc/fa4 [0,4194304] 0 2024-09-19T09:41:40.757 INFO:tasks.workunit.client.0.smithi042.stdout:4/591: dwrite d0/f71 [0,4194304] 0 2024-09-19T09:41:40.762 INFO:tasks.workunit.client.0.smithi042.stdout:4/592: symlink d0/d1b/d1c/d2e/d44/lce 0 2024-09-19T09:41:40.762 INFO:tasks.workunit.client.0.smithi042.stdout:4/593: dread - d0/d1b/d56/f80 zero size 2024-09-19T09:41:40.763 INFO:tasks.workunit.client.0.smithi042.stdout:1/606: rename d4/d15/d2e/db7/f5a to d4/d1e/fc5 0 2024-09-19T09:41:40.764 INFO:tasks.workunit.client.0.smithi042.stdout:0/536: rename d2/d10/d1d/f30 to d2/d10/da1/fa7 0 2024-09-19T09:41:40.767 INFO:tasks.workunit.client.0.smithi042.stdout:5/521: link d2/db/f7d d2/d4/d64/d6a/fbd 0 2024-09-19T09:41:40.767 INFO:tasks.workunit.client.0.smithi042.stdout:8/557: rename d1/da/dd/d69 to d1/da/d32/d41/d55/d99/da4 0 2024-09-19T09:41:40.769 INFO:tasks.workunit.client.0.smithi042.stdout:0/537: symlink d2/d8e/d32/d64/da5/d8a/d9d/d5a/d85/da0/la8 0 2024-09-19T09:41:40.771 INFO:tasks.workunit.client.0.smithi042.stdout:6/517: rename d1/de/d12/d1c to d1/d20/d6a/d46/d92 0 2024-09-19T09:41:40.771 INFO:tasks.workunit.client.0.smithi042.stdout:6/518: write d1/f8d [196085,63132] 0 2024-09-19T09:41:40.771 INFO:tasks.workunit.client.0.smithi042.stdout:4/594: write d0/fe [2092500,19937] 0 2024-09-19T09:41:40.772 INFO:tasks.workunit.client.0.smithi042.stdout:0/538: symlink d2/d10/d12/d16/la9 0 2024-09-19T09:41:40.772 INFO:tasks.workunit.client.0.smithi042.stdout:0/539: write d2/d10/d6b/f77 [1216586,121721] 0 2024-09-19T09:41:40.773 INFO:tasks.workunit.client.0.smithi042.stdout:0/540: stat d2/d8e/d32/d64/da5 0 2024-09-19T09:41:40.773 INFO:tasks.workunit.client.0.smithi042.stdout:0/541: chown d2/d10/d1d/d34/c36 795985076 1 2024-09-19T09:41:40.773 INFO:tasks.workunit.client.0.smithi042.stdout:0/542: chown d2/d10/d1d/d34/d89/c95 112811685 1 2024-09-19T09:41:40.773 INFO:tasks.workunit.client.0.smithi042.stdout:0/543: chown d2/d8e/d32/d64/da5/d52/f55 0 1 2024-09-19T09:41:40.773 INFO:tasks.workunit.client.0.smithi042.stdout:6/519: getdents d1/de/d12/d22/d34/d3f 0 2024-09-19T09:41:40.778 INFO:tasks.workunit.client.0.smithi042.stdout:6/520: mkdir d1/de/d12/d22/d34/d6f/d93 0 2024-09-19T09:41:40.779 INFO:tasks.workunit.client.0.smithi042.stdout:6/521: getdents d1/d20/d6a/d46/d92 0 2024-09-19T09:41:40.779 INFO:tasks.workunit.client.0.smithi042.stdout:6/522: fdatasync d1/d20/d6a/d90/f91 0 2024-09-19T09:41:40.781 INFO:tasks.workunit.client.0.smithi042.stdout:0/544: symlink d2/d10/d12/d24/laa 0 2024-09-19T09:41:40.781 INFO:tasks.workunit.client.0.smithi042.stdout:6/523: mkdir d1/d20/d6a/d46/d94 0 2024-09-19T09:41:40.781 INFO:tasks.workunit.client.0.smithi042.stdout:6/524: readlink d1/de/d12/d22/d34/d6f/l67 0 2024-09-19T09:41:40.784 INFO:tasks.workunit.client.0.smithi042.stdout:0/545: creat d2/d8e/d32/d64/da5/d8a/d9d/d5a/d85/da0/fab x:0 0 0 2024-09-19T09:41:40.786 INFO:tasks.workunit.client.0.smithi042.stdout:6/525: read d1/d20/d6a/d46/d92/f77 [129207,28147] 0 2024-09-19T09:41:40.786 INFO:tasks.workunit.client.0.smithi042.stdout:3/572: dwrite d4/d2a/f9e [0,4194304] 0 2024-09-19T09:41:40.787 INFO:tasks.workunit.client.0.smithi042.stdout:0/546: rename d2/d10/d1d/c8c to d2/d8e/d32/d64/da5/d8a/d9d/d5a/d85/cac 0 2024-09-19T09:41:40.789 INFO:tasks.workunit.client.0.smithi042.stdout:6/526: rename d1/d20/d6a/d46/d94 to d1/d20/d6a/d46/d95 0 2024-09-19T09:41:40.791 INFO:tasks.workunit.client.0.smithi042.stdout:4/595: dread d0/d1b/f2b [0,4194304] 0 2024-09-19T09:41:40.791 INFO:tasks.workunit.client.0.smithi042.stdout:3/573: creat d4/d8/d9/d1b/fb8 x:0 0 0 2024-09-19T09:41:40.792 INFO:tasks.workunit.client.0.smithi042.stdout:6/527: creat d1/de/d12/d22/d34/d3f/f96 x:0 0 0 2024-09-19T09:41:40.793 INFO:tasks.workunit.client.0.smithi042.stdout:4/596: mkdir d0/d1b/d56/d86/dcf 0 2024-09-19T09:41:40.797 INFO:tasks.workunit.client.0.smithi042.stdout:4/597: symlink d0/d67/ld0 0 2024-09-19T09:41:40.797 INFO:tasks.workunit.client.0.smithi042.stdout:3/574: mkdir d4/d8/d4c/d6b/db9 0 2024-09-19T09:41:40.798 INFO:tasks.workunit.client.0.smithi042.stdout:3/575: chown d4/d8/d9/dc/d26/la8 499 1 2024-09-19T09:41:40.799 INFO:tasks.workunit.client.0.smithi042.stdout:0/547: dread d2/d10/d1d/f2b [0,4194304] 0 2024-09-19T09:41:40.801 INFO:tasks.workunit.client.0.smithi042.stdout:0/548: creat d2/d8e/d32/d64/da5/d52/fad x:0 0 0 2024-09-19T09:41:40.803 INFO:tasks.workunit.client.0.smithi042.stdout:0/549: unlink d2/d8e/d32/d64/da5/d8a/d9d/c23 0 2024-09-19T09:41:40.807 INFO:tasks.workunit.client.0.smithi042.stdout:6/528: dread d1/f6 [0,4194304] 0 2024-09-19T09:41:40.807 INFO:tasks.workunit.client.0.smithi042.stdout:6/529: chown d1/d20/d6a/f5a 4597 1 2024-09-19T09:41:40.807 INFO:tasks.workunit.client.0.smithi042.stdout:6/530: fsync d1/de/d12/d22/d34/d6f/d4a/f82 0 2024-09-19T09:41:40.808 INFO:tasks.workunit.client.0.smithi042.stdout:1/607: dwrite d4/d15/d2e/db7/d3c/f43 [0,4194304] 0 2024-09-19T09:41:40.808 INFO:tasks.workunit.client.0.smithi042.stdout:6/531: mknod d1/d20/d6a/d46/d92/d3a/c97 0 2024-09-19T09:41:40.808 INFO:tasks.workunit.client.0.smithi042.stdout:8/558: dwrite d1/da/d3f/f50 [0,4194304] 0 2024-09-19T09:41:40.808 INFO:tasks.workunit.client.0.smithi042.stdout:5/522: dwrite d2/db/f7d [0,4194304] 0 2024-09-19T09:41:40.809 INFO:tasks.workunit.client.0.smithi042.stdout:1/608: symlink d4/d15/d19/d45/lc6 0 2024-09-19T09:41:40.809 INFO:tasks.workunit.client.0.smithi042.stdout:1/609: fsync d4/d12/d8d/d91/d7f/d99/fc3 0 2024-09-19T09:41:40.809 INFO:tasks.workunit.client.0.smithi042.stdout:8/559: rmdir d1/da/dd/d8e 39 2024-09-19T09:41:40.809 INFO:tasks.workunit.client.0.smithi042.stdout:1/610: fsync d4/d1e/d25/f33 0 2024-09-19T09:41:40.812 INFO:tasks.workunit.client.0.smithi042.stdout:8/560: link d1/da/d32/d92/l9a d1/da/d32/d92/la5 0 2024-09-19T09:41:40.812 INFO:tasks.workunit.client.0.smithi042.stdout:8/561: mknod d1/da/d32/d3d/ca6 0 2024-09-19T09:41:40.817 INFO:tasks.workunit.client.0.smithi042.stdout:3/576: dwrite d4/d8/d9/dc/f2b [0,4194304] 0 2024-09-19T09:41:40.817 INFO:tasks.workunit.client.0.smithi042.stdout:3/577: chown d4/c24 122419460 1 2024-09-19T09:41:40.817 INFO:tasks.workunit.client.0.smithi042.stdout:3/578: chown d4/d8/d9/dc/d26 1 1 2024-09-19T09:41:40.817 INFO:tasks.workunit.client.0.smithi042.stdout:3/579: write d4/d8/d9/dc/d26/d8b/f99 [61221,92041] 0 2024-09-19T09:41:40.824 INFO:tasks.workunit.client.0.smithi042.stdout:3/580: dread d4/d8/f20 [0,4194304] 0 2024-09-19T09:41:40.827 INFO:tasks.workunit.client.0.smithi042.stdout:3/581: rename d4/d8/d4c/f7b to d4/d8/d9/dc/d26/d6d/d8f/fba 0 2024-09-19T09:41:40.829 INFO:tasks.workunit.client.0.smithi042.stdout:3/582: creat d4/d8/d9/d1b/d4f/d9c/fbb x:0 0 0 2024-09-19T09:41:40.830 INFO:tasks.workunit.client.0.smithi042.stdout:3/583: truncate d4/d8/d9/dc/d26/d5c/d82/d48/f5a 358093 0 2024-09-19T09:41:40.830 INFO:tasks.workunit.client.0.smithi042.stdout:3/584: truncate d4/d8/d9/dc/d26/d5c/d82/d8c/d9f/fb6 251224 0 2024-09-19T09:41:40.836 INFO:tasks.workunit.client.0.smithi042.stdout:5/523: dwrite d2/f7 [4194304,4194304] 0 2024-09-19T09:41:40.836 INFO:tasks.workunit.client.0.smithi042.stdout:1/611: dwrite d4/d15/d19/d42/f9c [0,4194304] 0 2024-09-19T09:41:40.836 INFO:tasks.workunit.client.0.smithi042.stdout:8/562: dwrite d1/da/f21 [4194304,4194304] 0 2024-09-19T09:41:40.837 INFO:tasks.workunit.client.0.smithi042.stdout:8/563: stat d1/da/dd/f8a 0 2024-09-19T09:41:40.838 INFO:tasks.workunit.client.0.smithi042.stdout:8/564: mknod d1/da/d32/d3d/d59/ca7 0 2024-09-19T09:41:40.840 INFO:tasks.workunit.client.0.smithi042.stdout:5/524: dread d2/d4/d64/da7/f35 [0,4194304] 0 2024-09-19T09:41:40.840 INFO:tasks.workunit.client.0.smithi042.stdout:5/525: write d2/d4/d64/da7/f35 [4986611,21982] 0 2024-09-19T09:41:40.840 INFO:tasks.workunit.client.0.smithi042.stdout:5/526: write d2/d4/d64/d6a/f85 [701936,96906] 0 2024-09-19T09:41:40.843 INFO:tasks.workunit.client.0.smithi042.stdout:1/612: dread d4/d29/f38 [0,4194304] 0 2024-09-19T09:41:40.844 INFO:tasks.workunit.client.0.smithi042.stdout:8/565: rename d1/da/d32 to d1/da8 0 2024-09-19T09:41:40.845 INFO:tasks.workunit.client.0.smithi042.stdout:1/613: link d4/d15/d19/f87 d4/d15/d61/fc7 0 2024-09-19T09:41:40.846 INFO:tasks.workunit.client.0.smithi042.stdout:5/527: dread d2/db/d3c/f6e [0,4194304] 0 2024-09-19T09:41:40.846 INFO:tasks.workunit.client.0.smithi042.stdout:5/528: write d2/d4/d20/d60/d72/fa6 [1159942,55495] 0 2024-09-19T09:41:40.846 INFO:tasks.workunit.client.0.smithi042.stdout:5/529: fdatasync d2/d4/f78 0 2024-09-19T09:41:40.846 INFO:tasks.workunit.client.0.smithi042.stdout:8/566: unlink d1/c4c 0 2024-09-19T09:41:40.847 INFO:tasks.workunit.client.0.smithi042.stdout:8/567: chown d1/d2e/f60 16 1 2024-09-19T09:41:40.847 INFO:tasks.workunit.client.0.smithi042.stdout:1/614: truncate d4/d29/d3e/fa6 1373809 0 2024-09-19T09:41:40.847 INFO:tasks.workunit.client.0.smithi042.stdout:8/568: getdents d1/da8/d3d/d95 0 2024-09-19T09:41:40.847 INFO:tasks.workunit.client.0.smithi042.stdout:3/585: dwrite d4/d78/d9d/fa7 [0,4194304] 0 2024-09-19T09:41:40.852 INFO:tasks.workunit.client.0.smithi042.stdout:8/569: unlink d1/c40 0 2024-09-19T09:41:40.854 INFO:tasks.workunit.client.0.smithi042.stdout:8/570: symlink d1/da8/d3d/d59/la9 0 2024-09-19T09:41:40.854 INFO:tasks.workunit.client.0.smithi042.stdout:8/571: chown d1/da8/d41/d55/d99 522524419 1 2024-09-19T09:41:40.854 INFO:tasks.workunit.client.0.smithi042.stdout:8/572: readlink d1/da/d3f/l8c 0 2024-09-19T09:41:40.855 INFO:tasks.workunit.client.0.smithi042.stdout:8/573: creat d1/da8/d3d/d58/faa x:0 0 0 2024-09-19T09:41:40.856 INFO:tasks.workunit.client.0.smithi042.stdout:8/574: chown d1/da/f21 101548670 1 2024-09-19T09:41:40.856 INFO:tasks.workunit.client.0.smithi042.stdout:8/575: readlink d1/da8/d3d/d59/la9 0 2024-09-19T09:41:40.856 INFO:tasks.workunit.client.0.smithi042.stdout:8/576: dread - d1/da/dd/fa3 zero size 2024-09-19T09:41:40.857 INFO:tasks.workunit.client.0.smithi042.stdout:8/577: dread d1/da/f13 [0,4194304] 0 2024-09-19T09:41:40.858 INFO:tasks.workunit.client.0.smithi042.stdout:8/578: getdents d1/da8/d41/d55/d99 0 2024-09-19T09:41:40.859 INFO:tasks.workunit.client.0.smithi042.stdout:8/579: creat d1/da8/d3d/d58/fab x:0 0 0 2024-09-19T09:41:40.859 INFO:tasks.workunit.client.0.smithi042.stdout:8/580: read d1/da/d3f/f5e [169406,105674] 0 2024-09-19T09:41:40.859 INFO:tasks.workunit.client.0.smithi042.stdout:8/581: chown d1/da8/d41/c7a 78016 1 2024-09-19T09:41:40.859 INFO:tasks.workunit.client.0.smithi042.stdout:8/582: write d1/da/dd/f3a [980398,61180] 0 2024-09-19T09:41:40.860 INFO:tasks.workunit.client.0.smithi042.stdout:8/583: truncate d1/da/f5a 3816891 0 2024-09-19T09:41:40.864 INFO:tasks.workunit.client.0.smithi042.stdout:5/530: dwrite d2/d4/d20/d60/d72/fa6 [0,4194304] 0 2024-09-19T09:41:40.864 INFO:tasks.workunit.client.0.smithi042.stdout:5/531: stat d2/d4/d20/d60/d72/c9e 0 2024-09-19T09:41:40.883 INFO:tasks.workunit.client.0.smithi042.stdout:8/584: dwrite d1/da/dd/f16 [4194304,4194304] 0 2024-09-19T09:41:40.884 INFO:tasks.workunit.client.0.smithi042.stdout:1/615: dwrite d4/d15/d19/d42/d51/f81 [4194304,4194304] 0 2024-09-19T09:41:40.884 INFO:tasks.workunit.client.0.smithi042.stdout:8/585: fsync d1/da8/d3d/d59/f80 0 2024-09-19T09:41:40.884 INFO:tasks.workunit.client.0.smithi042.stdout:1/616: fdatasync d4/d29/fc2 0 2024-09-19T09:41:40.884 INFO:tasks.workunit.client.0.smithi042.stdout:8/586: chown d1/da/dd/l83 15455659 1 2024-09-19T09:41:40.884 INFO:tasks.workunit.client.0.smithi042.stdout:3/586: dwrite d4/d8/d9/d1b/f63 [4194304,4194304] 0 2024-09-19T09:41:40.888 INFO:tasks.workunit.client.0.smithi042.stdout:5/532: dwrite d2/db/d3c/f94 [0,4194304] 0 2024-09-19T09:41:40.888 INFO:tasks.workunit.client.0.smithi042.stdout:8/587: mkdir d1/da/dd/dac 0 2024-09-19T09:41:40.890 INFO:tasks.workunit.client.0.smithi042.stdout:5/533: mknod d2/d25/d37/cbe 0 2024-09-19T09:41:40.892 INFO:tasks.workunit.client.0.smithi042.stdout:3/587: dread d4/d2a/f9e [0,4194304] 0 2024-09-19T09:41:40.893 INFO:tasks.workunit.client.0.smithi042.stdout:3/588: write d4/d8/d9/dc/d26/f27 [3234758,69620] 0 2024-09-19T09:41:40.894 INFO:tasks.workunit.client.0.smithi042.stdout:3/589: truncate d4/d8/f72 207912 0 2024-09-19T09:41:40.896 INFO:tasks.workunit.client.0.smithi042.stdout:3/590: rename d4/d8/d9/dc/d26/d5c/d82/l42 to d4/d8/d9/d1b/d4f/lbc 0 2024-09-19T09:41:40.899 INFO:tasks.workunit.client.0.smithi042.stdout:3/591: link d4/d8/d9/dc/d26/d5c/d82/d48/da5/f8d d4/d8/fbd 0 2024-09-19T09:41:40.899 INFO:tasks.workunit.client.0.smithi042.stdout:3/592: dread - d4/d8/d9/dc/d26/d35/fb7 zero size 2024-09-19T09:41:40.900 INFO:tasks.workunit.client.0.smithi042.stdout:3/593: write d4/d8/d9/d1b/d4f/faf [75693,89078] 0 2024-09-19T09:41:40.902 INFO:tasks.workunit.client.0.smithi042.stdout:5/534: link d2/d4/d64/dab/l22 d2/d4/lbf 0 2024-09-19T09:41:40.906 INFO:tasks.workunit.client.0.smithi042.stdout:1/617: dwrite d4/d15/d2e/db7/f72 [0,4194304] 0 2024-09-19T09:41:40.910 INFO:tasks.workunit.client.0.smithi042.stdout:5/535: write d2/d4/d20/d60/d72/fa6 [2588134,119458] 0 2024-09-19T09:41:40.913 INFO:tasks.workunit.client.0.smithi042.stdout:8/588: dwrite d1/da8/d41/d55/f6b [0,4194304] 0 2024-09-19T09:41:40.913 INFO:tasks.workunit.client.0.smithi042.stdout:8/589: dread - d1/da8/d3d/f44 zero size 2024-09-19T09:41:40.916 INFO:tasks.workunit.client.0.smithi042.stdout:8/590: symlink d1/da/dd/d74/lad 0 2024-09-19T09:41:40.916 INFO:tasks.workunit.client.0.smithi042.stdout:8/591: chown d1/da8/d41/d55/d99 4848 1 2024-09-19T09:41:40.916 INFO:tasks.workunit.client.0.smithi042.stdout:8/592: fsync d1/da/f12 0 2024-09-19T09:41:40.919 INFO:tasks.workunit.client.0.smithi042.stdout:8/593: dread d1/d2e/f51 [0,4194304] 0 2024-09-19T09:41:40.919 INFO:tasks.workunit.client.0.smithi042.stdout:8/594: stat d1/da/d3f/f98 0 2024-09-19T09:41:40.920 INFO:tasks.workunit.client.0.smithi042.stdout:8/595: symlink d1/da8/d41/d55/d99/lae 0 2024-09-19T09:41:40.921 INFO:tasks.workunit.client.0.smithi042.stdout:3/594: dwrite d4/d8/d9/dc/d26/d5c/d82/d8c/d9f/fb6 [0,4194304] 0 2024-09-19T09:41:40.922 INFO:tasks.workunit.client.0.smithi042.stdout:8/596: truncate d1/d2e/f4a 925288 0 2024-09-19T09:41:40.923 INFO:tasks.workunit.client.0.smithi042.stdout:8/597: getdents d1/da8/d41/d55/d99/da4 0 2024-09-19T09:41:40.924 INFO:tasks.workunit.client.0.smithi042.stdout:1/618: rmdir d4/d1e 39 2024-09-19T09:41:40.926 INFO:tasks.workunit.client.0.smithi042.stdout:1/619: rename d4/d15/d19/d42/d51/cbe to d4/d15/d19/d42/d51/d79/cc8 0 2024-09-19T09:41:40.926 INFO:tasks.workunit.client.0.smithi042.stdout:1/620: fdatasync d4/d15/d2e/db7/f98 0 2024-09-19T09:41:40.926 INFO:tasks.workunit.client.0.smithi042.stdout:1/621: chown d4/l95 1564453 1 2024-09-19T09:41:40.927 INFO:tasks.workunit.client.0.smithi042.stdout:1/622: mkdir d4/d15/d61/d85/dc9 0 2024-09-19T09:41:40.928 INFO:tasks.workunit.client.0.smithi042.stdout:1/623: mkdir d4/d12/d8d/dca 0 2024-09-19T09:41:40.929 INFO:tasks.workunit.client.0.smithi042.stdout:5/536: dwrite d2/d25/d37/f63 [0,4194304] 0 2024-09-19T09:41:40.929 INFO:tasks.workunit.client.0.smithi042.stdout:1/624: dread d4/d29/f4a [4194304,4194304] 0 2024-09-19T09:41:40.929 INFO:tasks.workunit.client.0.smithi042.stdout:1/625: write d4/d15/d2e/db7/d3c/fa3 [844193,94800] 0 2024-09-19T09:41:40.929 INFO:tasks.workunit.client.0.smithi042.stdout:1/626: truncate d4/d15/d2e/db7/f72 4891229 0 2024-09-19T09:41:40.931 INFO:tasks.workunit.client.0.smithi042.stdout:5/537: mkdir d2/d4/d20/dc0 0 2024-09-19T09:41:40.931 INFO:tasks.workunit.client.0.smithi042.stdout:5/538: write d2/d4/d20/f38 [291725,125909] 0 2024-09-19T09:41:40.934 INFO:tasks.workunit.client.0.smithi042.stdout:1/627: truncate d4/d15/d19/f9 838516 0 2024-09-19T09:41:40.941 INFO:tasks.workunit.client.0.smithi042.stdout:3/595: dwrite d4/d8/d9/dc/f59 [0,4194304] 0 2024-09-19T09:41:40.944 INFO:tasks.workunit.client.0.smithi042.stdout:3/596: link d4/d8/d9/dc/d26/d8b/ca1 d4/d8/d9/dc/d26/d5c/d82/d48/cbe 0 2024-09-19T09:41:40.945 INFO:tasks.workunit.client.0.smithi042.stdout:8/598: dwrite d1/da/f5a [0,4194304] 0 2024-09-19T09:41:40.946 INFO:tasks.workunit.client.0.smithi042.stdout:8/599: creat d1/da8/d3d/faf x:0 0 0 2024-09-19T09:41:40.947 INFO:tasks.workunit.client.0.smithi042.stdout:8/600: mknod d1/da/dd/d8e/cb0 0 2024-09-19T09:41:40.948 INFO:tasks.workunit.client.0.smithi042.stdout:8/601: readlink d1/da/d3f/l89 0 2024-09-19T09:41:40.948 INFO:tasks.workunit.client.0.smithi042.stdout:8/602: dread - d1/da/dd/f8a zero size 2024-09-19T09:41:40.949 INFO:tasks.workunit.client.0.smithi042.stdout:3/597: rename d4/d8/d9/dc/d26 to d4/d8/d9/dc/dbf 0 2024-09-19T09:41:40.950 INFO:tasks.workunit.client.0.smithi042.stdout:5/539: dwrite d2/db/f2f [4194304,4194304] 0 2024-09-19T09:41:40.950 INFO:tasks.workunit.client.0.smithi042.stdout:3/598: link d4/d8/d9/dc/dbf/d5c/d82/d48/fa0 d4/d8/d9/d39/fc0 0 2024-09-19T09:41:40.951 INFO:tasks.workunit.client.0.smithi042.stdout:3/599: write d4/d8/d9/dc/dbf/d5c/d82/d48/f5a [1056260,34779] 0 2024-09-19T09:41:40.951 INFO:tasks.workunit.client.0.smithi042.stdout:5/540: rename d2/c93 to d2/d8e/cc1 0 2024-09-19T09:41:40.952 INFO:tasks.workunit.client.0.smithi042.stdout:3/600: creat d4/d78/fc1 x:0 0 0 2024-09-19T09:41:40.952 INFO:tasks.workunit.client.0.smithi042.stdout:3/601: write d4/d8/d9/dc/dbf/d5c/f94 [111871,12631] 0 2024-09-19T09:41:40.953 INFO:tasks.workunit.client.0.smithi042.stdout:3/602: stat d4/d8/d9/dc/dbf/d5c/fae 0 2024-09-19T09:41:40.953 INFO:tasks.workunit.client.0.smithi042.stdout:8/603: dread d1/da/f5f [0,4194304] 0 2024-09-19T09:41:40.953 INFO:tasks.workunit.client.0.smithi042.stdout:8/604: chown d1/da8/d3d/d95 525903532 1 2024-09-19T09:41:40.953 INFO:tasks.workunit.client.0.smithi042.stdout:5/541: mkdir d2/d25/d37/dc2 0 2024-09-19T09:41:40.953 INFO:tasks.workunit.client.0.smithi042.stdout:5/542: chown d2/d4/d64 11630 1 2024-09-19T09:41:40.954 INFO:tasks.workunit.client.0.smithi042.stdout:8/605: mkdir d1/da8/db1 0 2024-09-19T09:41:40.954 INFO:tasks.workunit.client.0.smithi042.stdout:8/606: read d1/da/dd/f3a [66600,99167] 0 2024-09-19T09:41:40.954 INFO:tasks.workunit.client.0.smithi042.stdout:8/607: write d1/d2e/f4a [1758186,22316] 0 2024-09-19T09:41:40.955 INFO:tasks.workunit.client.0.smithi042.stdout:3/603: link d4/f34 d4/d8/d9/dc/dbf/d6d/d8f/fc2 0 2024-09-19T09:41:40.957 INFO:tasks.workunit.client.0.smithi042.stdout:5/543: rmdir d2/d4/d20/d60/d72/dbb 0 2024-09-19T09:41:40.957 INFO:tasks.workunit.client.0.smithi042.stdout:5/544: chown d2/d4/f56 16806 1 2024-09-19T09:41:40.957 INFO:tasks.workunit.client.0.smithi042.stdout:5/545: chown d2/d4/d64/da7/db4 216 1 2024-09-19T09:41:40.958 INFO:tasks.workunit.client.0.smithi042.stdout:5/546: write d2/d4/f15 [3686539,98569] 0 2024-09-19T09:41:40.958 INFO:tasks.workunit.client.0.smithi042.stdout:8/608: truncate d1/da/dd/d74/f7e 1790590 0 2024-09-19T09:41:40.959 INFO:tasks.workunit.client.0.smithi042.stdout:1/628: dwrite d4/d1d/fb2 [0,4194304] 0 2024-09-19T09:41:40.960 INFO:tasks.workunit.client.0.smithi042.stdout:5/547: mkdir d2/d4/d20/d60/d72/d75/dc3 0 2024-09-19T09:41:40.960 INFO:tasks.workunit.client.0.smithi042.stdout:5/548: write d2/d4/f15 [4287678,77938] 0 2024-09-19T09:41:40.961 INFO:tasks.workunit.client.0.smithi042.stdout:8/609: rename d1/da8/d87 to d1/db2 0 2024-09-19T09:41:40.961 INFO:tasks.workunit.client.0.smithi042.stdout:3/604: truncate d4/d8/f33 274413 0 2024-09-19T09:41:40.965 INFO:tasks.workunit.client.0.smithi042.stdout:5/549: mknod d2/d4/d64/da7/cc4 0 2024-09-19T09:41:40.965 INFO:tasks.workunit.client.0.smithi042.stdout:8/610: link d1/da/dd/l7d d1/d2e/lb3 0 2024-09-19T09:41:40.965 INFO:tasks.workunit.client.0.smithi042.stdout:8/611: fsync d1/da/d3f/f98 0 2024-09-19T09:41:40.976 INFO:tasks.workunit.client.0.smithi042.stdout:3/605: write d4/d8/d9/d1b/f63 [6999588,48808] 0 2024-09-19T09:41:40.977 INFO:tasks.workunit.client.0.smithi042.stdout:3/606: mkdir d4/d8/d9/dc/dbf/d5c/d82/d48/dc3 0 2024-09-19T09:41:40.986 INFO:tasks.workunit.client.0.smithi042.stdout:1/629: dwrite d4/d15/d2e/db7/f72 [0,4194304] 0 2024-09-19T09:41:40.989 INFO:tasks.workunit.client.0.smithi042.stdout:3/607: dread d4/d8/f19 [0,4194304] 0 2024-09-19T09:41:40.991 INFO:tasks.workunit.client.0.smithi042.stdout:3/608: creat d4/d8/d9/dc/dbf/d5c/d82/d8c/fc4 x:0 0 0 2024-09-19T09:41:40.992 INFO:tasks.workunit.client.0.smithi042.stdout:3/609: truncate d4/d8/d9/dc/dbf/d5c/d82/f7a 4012497 0 2024-09-19T09:41:40.992 INFO:tasks.workunit.client.0.smithi042.stdout:3/610: fsync d4/d8/d9/d1b/d4f/d9c/fbb 0 2024-09-19T09:41:40.993 INFO:tasks.workunit.client.0.smithi042.stdout:3/611: mknod d4/d8/d9/d39/d4b/d7d/cc5 0 2024-09-19T09:41:41.002 INFO:tasks.workunit.client.0.smithi042.stdout:5/550: dwrite d2/d4/d64/dab/f1a [4194304,4194304] 0 2024-09-19T09:41:41.002 INFO:tasks.workunit.client.0.smithi042.stdout:8/612: dwrite d1/da/f21 [4194304,4194304] 0 2024-09-19T09:41:41.003 INFO:tasks.workunit.client.0.smithi042.stdout:8/613: rmdir d1/da8/d41/d55 39 2024-09-19T09:41:41.004 INFO:tasks.workunit.client.0.smithi042.stdout:8/614: chown d1/da8/d41/d55/f6b 6058 1 2024-09-19T09:41:41.004 INFO:tasks.workunit.client.0.smithi042.stdout:8/615: truncate d1/da/dd/f8a 568328 0 2024-09-19T09:41:41.004 INFO:tasks.workunit.client.0.smithi042.stdout:8/616: fsync d1/da/f12 0 2024-09-19T09:41:41.004 INFO:tasks.workunit.client.0.smithi042.stdout:8/617: write d1/da8/d3d/d58/f5d [4925046,99209] 0 2024-09-19T09:41:41.004 INFO:tasks.workunit.client.0.smithi042.stdout:5/551: creat d2/d4/d64/dab/fc5 x:0 0 0 2024-09-19T09:41:41.005 INFO:tasks.workunit.client.0.smithi042.stdout:8/618: mknod d1/db2/cb4 0 2024-09-19T09:41:41.006 INFO:tasks.workunit.client.0.smithi042.stdout:5/552: mkdir d2/d25/dc6 0 2024-09-19T09:41:41.007 INFO:tasks.workunit.client.0.smithi042.stdout:8/619: unlink d1/da/f13 0 2024-09-19T09:41:41.008 INFO:tasks.workunit.client.0.smithi042.stdout:5/553: mknod d2/d4/d8a/cc7 0 2024-09-19T09:41:41.009 INFO:tasks.workunit.client.0.smithi042.stdout:8/620: truncate d1/da/f12 1390908 0 2024-09-19T09:41:41.009 INFO:tasks.workunit.client.0.smithi042.stdout:1/630: rename d4/d15/d19/cd to d4/d1e/ccb 0 2024-09-19T09:41:41.009 INFO:tasks.workunit.client.0.smithi042.stdout:5/554: symlink d2/db/d3c/lc8 0 2024-09-19T09:41:41.010 INFO:tasks.workunit.client.0.smithi042.stdout:1/631: truncate d4/fa5 7078449 0 2024-09-19T09:41:41.010 INFO:tasks.workunit.client.0.smithi042.stdout:1/632: truncate d4/d12/d8d/d91/d7f/d99/fc3 631950 0 2024-09-19T09:41:41.013 INFO:tasks.workunit.client.0.smithi042.stdout:1/633: symlink d4/d15/d19/d45/d82/d89/lcc 0 2024-09-19T09:41:41.015 INFO:tasks.workunit.client.0.smithi042.stdout:1/634: creat d4/d12/d8d/d91/fcd x:0 0 0 2024-09-19T09:41:41.017 INFO:tasks.workunit.client.0.smithi042.stdout:1/635: mknod d4/d15/d19/d42/d51/cce 0 2024-09-19T09:41:41.017 INFO:tasks.workunit.client.0.smithi042.stdout:1/636: chown d4/d15/l3d 11820584 1 2024-09-19T09:41:41.018 INFO:tasks.workunit.client.0.smithi042.stdout:1/637: creat d4/d29/fcf x:0 0 0 2024-09-19T09:41:41.018 INFO:tasks.workunit.client.0.smithi042.stdout:5/555: dread d2/d4/d64/da7/f23 [4194304,4194304] 0 2024-09-19T09:41:41.020 INFO:tasks.workunit.client.0.smithi042.stdout:1/638: mkdir d4/d15/d19/d42/d51/db5/dd0 0 2024-09-19T09:41:41.021 INFO:tasks.workunit.client.0.smithi042.stdout:5/556: link d2/d4/f78 d2/d4/d20/fc9 0 2024-09-19T09:41:41.023 INFO:tasks.workunit.client.0.smithi042.stdout:1/639: creat d4/fd1 x:0 0 0 2024-09-19T09:41:41.023 INFO:tasks.workunit.client.0.smithi042.stdout:1/640: creat d4/d15/d19/d42/d51/d79/fd2 x:0 0 0 2024-09-19T09:41:41.024 INFO:tasks.workunit.client.0.smithi042.stdout:1/641: creat d4/d15/d2e/db7/d3c/fd3 x:0 0 0 2024-09-19T09:41:41.025 INFO:tasks.workunit.client.0.smithi042.stdout:1/642: mkdir d4/d12/d8d/dca/dd4 0 2024-09-19T09:41:41.026 INFO:tasks.workunit.client.0.smithi042.stdout:3/612: dwrite d4/d8/d9/dc/dbf/d5c/d82/f7a [0,4194304] 0 2024-09-19T09:41:41.028 INFO:tasks.workunit.client.0.smithi042.stdout:3/613: link d4/d8/d9/dc/f6e d4/fc6 0 2024-09-19T09:41:41.030 INFO:tasks.workunit.client.0.smithi042.stdout:3/614: creat d4/d8/d9/dc/dbf/d5c/fc7 x:0 0 0 2024-09-19T09:41:41.030 INFO:tasks.workunit.client.0.smithi042.stdout:3/615: write d4/d8/d9/dc/dbf/d6d/d8f/fb3 [932358,83975] 0 2024-09-19T09:41:41.030 INFO:tasks.workunit.client.0.smithi042.stdout:3/616: fdatasync d4/d8/d9/dc/dbf/d35/fb7 0 2024-09-19T09:41:41.031 INFO:tasks.workunit.client.0.smithi042.stdout:5/557: write d2/d4/f67 [2527728,11121] 0 2024-09-19T09:41:41.031 INFO:tasks.workunit.client.0.smithi042.stdout:5/558: truncate d2/d4/d20/d60/d72/f84 890676 0 2024-09-19T09:41:41.031 INFO:tasks.workunit.client.0.smithi042.stdout:5/559: write d2/db/f10 [2774626,45473] 0 2024-09-19T09:41:41.034 INFO:tasks.workunit.client.0.smithi042.stdout:5/560: rmdir d2/db/d3c 39 2024-09-19T09:41:41.036 INFO:tasks.workunit.client.0.smithi042.stdout:8/621: dwrite d1/da8/f54 [0,4194304] 0 2024-09-19T09:41:41.049 INFO:tasks.workunit.client.0.smithi042.stdout:1/643: dwrite d4/d15/d61/fa7 [0,4194304] 0 2024-09-19T09:41:41.049 INFO:tasks.workunit.client.0.smithi042.stdout:1/644: write d4/d12/faa [4390633,114089] 0 2024-09-19T09:41:41.051 INFO:tasks.workunit.client.0.smithi042.stdout:1/645: mkdir d4/d15/d2e/db7/d3c/dd5 0 2024-09-19T09:41:41.063 INFO:tasks.workunit.client.0.smithi042.stdout:8/622: dwrite d1/da/dd/d74/f9e [0,4194304] 0 2024-09-19T09:41:41.063 INFO:tasks.workunit.client.0.smithi042.stdout:8/623: fdatasync d1/da/d3f/f50 0 2024-09-19T09:41:41.063 INFO:tasks.workunit.client.0.smithi042.stdout:3/617: dwrite d4/d8/d9/dc/fa4 [0,4194304] 0 2024-09-19T09:41:41.065 INFO:tasks.workunit.client.0.smithi042.stdout:3/618: creat d4/d8/d9/d1b/fc8 x:0 0 0 2024-09-19T09:41:41.067 INFO:tasks.workunit.client.0.smithi042.stdout:3/619: rename d4/d8/d9/d1b/d4f/f70 to d4/d8/d9/dc/dbf/d6d/d8f/fc9 0 2024-09-19T09:41:41.068 INFO:tasks.workunit.client.0.smithi042.stdout:3/620: creat d4/d8/d9/dc/dbf/d35/fca x:0 0 0 2024-09-19T09:41:41.069 INFO:tasks.workunit.client.0.smithi042.stdout:3/621: truncate d4/d8/d9/d39/d4b/f80 1305024 0 2024-09-19T09:41:41.075 INFO:tasks.workunit.client.0.smithi042.stdout:1/646: dwrite d4/d15/d2e/db7/d3c/f59 [0,4194304] 0 2024-09-19T09:41:41.075 INFO:tasks.workunit.client.0.smithi042.stdout:1/647: truncate d4/d15/d2e/fa4 168080 0 2024-09-19T09:41:41.075 INFO:tasks.workunit.client.0.smithi042.stdout:1/648: fdatasync d4/fa2 0 2024-09-19T09:41:41.075 INFO:tasks.workunit.client.0.smithi042.stdout:1/649: fsync d4/d15/d19/f16 0 2024-09-19T09:41:41.080 INFO:tasks.workunit.client.0.smithi042.stdout:3/622: dread d4/d8/d9/dc/dbf/d5c/fae [0,4194304] 0 2024-09-19T09:41:41.085 INFO:tasks.workunit.client.0.smithi042.stdout:8/624: dwrite d1/da8/d3d/d59/f7b [4194304,4194304] 0 2024-09-19T09:41:41.085 INFO:tasks.workunit.client.0.smithi042.stdout:8/625: stat d1/da8/d41/c7a 0 2024-09-19T09:41:41.085 INFO:tasks.workunit.client.0.smithi042.stdout:8/626: chown d1/da8/d3d/d59/c94 196 1 2024-09-19T09:41:41.099 INFO:tasks.workunit.client.0.smithi042.stdout:8/627: write d1/da8/f54 [1599989,96293] 0 2024-09-19T09:41:41.104 INFO:tasks.workunit.client.0.smithi042.stdout:1/650: dwrite d4/d15/d19/d42/d51/f81 [0,4194304] 0 2024-09-19T09:41:41.111 INFO:tasks.workunit.client.0.smithi042.stdout:3/623: dwrite d4/d8/d9/dc/dbf/d5c/d82/d8c/d9f/fb6 [0,4194304] 0 2024-09-19T09:41:41.111 INFO:tasks.workunit.client.0.smithi042.stdout:3/624: fsync d4/d8/d9/dc/f59 0 2024-09-19T09:41:41.112 INFO:tasks.workunit.client.0.smithi042.stdout:3/625: mkdir d4/d8/d4c/d6b/db9/dcb 0 2024-09-19T09:41:41.116 INFO:tasks.workunit.client.0.smithi042.stdout:8/628: dwrite d1/da/dd/f16 [0,4194304] 0 2024-09-19T09:41:41.116 INFO:tasks.workunit.client.0.smithi042.stdout:8/629: getdents d1/da8/d3d/d95 0 2024-09-19T09:41:41.121 INFO:tasks.workunit.client.0.smithi042.stdout:1/651: dwrite d4/f13 [0,4194304] 0 2024-09-19T09:41:41.121 INFO:tasks.workunit.client.0.smithi042.stdout:1/652: write d4/f47 [4548596,86950] 0 2024-09-19T09:41:41.133 INFO:tasks.workunit.client.0.smithi042.stdout:8/630: dwrite d1/da/dd/fa3 [0,4194304] 0 2024-09-19T09:41:41.135 INFO:tasks.workunit.client.0.smithi042.stdout:8/631: dread d1/da/d3f/f67 [0,4194304] 0 2024-09-19T09:41:41.137 INFO:tasks.workunit.client.0.smithi042.stdout:8/632: rename d1/da/f12 to d1/da8/d41/fb5 0 2024-09-19T09:41:41.139 INFO:tasks.workunit.client.0.smithi042.stdout:8/633: creat d1/da8/fb6 x:0 0 0 2024-09-19T09:41:41.142 INFO:tasks.workunit.client.0.smithi042.stdout:1/653: dwrite d4/fa5 [0,4194304] 0 2024-09-19T09:41:41.155 INFO:tasks.workunit.client.0.smithi042.stdout:8/634: dwrite d1/da8/d3d/d58/fab [0,4194304] 0 2024-09-19T09:41:41.158 INFO:tasks.workunit.client.0.smithi042.stdout:8/635: read d1/d2e/f60 [308772,108055] 0 2024-09-19T09:41:41.159 INFO:tasks.workunit.client.0.smithi042.stdout:8/636: mkdir d1/da/dd/d8e/db7 0 2024-09-19T09:41:41.160 INFO:tasks.workunit.client.0.smithi042.stdout:8/637: rename d1/da8/d41/d55/la0 to d1/da/dd/d8e/lb8 0 2024-09-19T09:41:41.163 INFO:tasks.workunit.client.0.smithi042.stdout:1/654: dwrite d4/d15/d44/f71 [0,4194304] 0 2024-09-19T09:41:41.164 INFO:tasks.workunit.client.0.smithi042.stdout:1/655: symlink d4/d1d/ld6 0 2024-09-19T09:41:41.166 INFO:tasks.workunit.client.0.smithi042.stdout:1/656: write d4/d29/d3e/fa6 [161841,108916] 0 2024-09-19T09:41:41.167 INFO:tasks.workunit.client.0.smithi042.stdout:1/657: creat d4/d15/d61/d85/dc9/fd7 x:0 0 0 2024-09-19T09:41:41.176 INFO:tasks.workunit.client.0.smithi042.stdout:8/638: dwrite d1/da/f5a [0,4194304] 0 2024-09-19T09:41:41.177 INFO:tasks.workunit.client.0.smithi042.stdout:8/639: symlink d1/db2/lb9 0 2024-09-19T09:41:41.178 INFO:tasks.workunit.client.0.smithi042.stdout:8/640: creat d1/d2e/fba x:0 0 0 2024-09-19T09:41:41.179 INFO:tasks.workunit.client.0.smithi042.stdout:8/641: creat d1/da/dd/fbb x:0 0 0 2024-09-19T09:41:41.203 INFO:tasks.workunit.client.0.smithi042.stdout:8/642: dwrite d1/da8/f54 [0,4194304] 0 2024-09-19T09:41:41.221 INFO:tasks.workunit.client.0.smithi042.stdout:8/643: dwrite d1/da8/d41/d55/d99/da4/f73 [0,4194304] 0 2024-09-19T09:41:41.222 INFO:tasks.workunit.client.0.smithi042.stdout:8/644: unlink d1/da8/d41/c78 0 2024-09-19T09:41:41.223 INFO:tasks.workunit.client.0.smithi042.stdout:8/645: mkdir d1/da/dd/d74/dbc 0 2024-09-19T09:41:41.223 INFO:tasks.workunit.client.0.smithi042.stdout:8/646: fsync d1/da8/d3d/d59/f7b 0 2024-09-19T09:41:41.223 INFO:tasks.workunit.client.0.smithi042.stdout:8/647: read - d1/da8/d3d/f44 zero size 2024-09-19T09:41:41.223 INFO:tasks.workunit.client.0.smithi042.stdout:8/648: getdents d1/da8/d3d/d95 0 2024-09-19T09:41:41.224 INFO:tasks.workunit.client.0.smithi042.stdout:8/649: creat d1/da/d3f/fbd x:0 0 0 2024-09-19T09:41:41.224 INFO:tasks.workunit.client.0.smithi042.stdout:8/650: chown d1/c22 373668343 1 2024-09-19T09:41:41.224 INFO:tasks.workunit.client.0.smithi042.stdout:8/651: write d1/da8/f64 [2248161,13692] 0 2024-09-19T09:41:41.225 INFO:tasks.workunit.client.0.smithi042.stdout:8/652: creat d1/da/dd/fbe x:0 0 0 2024-09-19T09:41:41.226 INFO:tasks.workunit.client.0.smithi042.stdout:8/653: symlink d1/da8/d3d/lbf 0 2024-09-19T09:41:41.431 INFO:tasks.workunit.client.0.smithi042.stdout:1/658: sync 2024-09-19T09:41:41.431 INFO:tasks.workunit.client.0.smithi042.stdout:8/654: sync 2024-09-19T09:41:41.431 INFO:tasks.workunit.client.0.smithi042.stdout:4/598: sync 2024-09-19T09:41:41.431 INFO:tasks.workunit.client.0.smithi042.stdout:7/528: sync 2024-09-19T09:41:41.431 INFO:tasks.workunit.client.0.smithi042.stdout:0/550: sync 2024-09-19T09:41:41.431 INFO:tasks.workunit.client.0.smithi042.stdout:0/551: stat d2/d10 0 2024-09-19T09:41:41.431 INFO:tasks.workunit.client.0.smithi042.stdout:9/439: sync 2024-09-19T09:41:41.432 INFO:tasks.workunit.client.0.smithi042.stdout:2/540: sync 2024-09-19T09:41:41.432 INFO:tasks.workunit.client.0.smithi042.stdout:5/561: sync 2024-09-19T09:41:41.432 INFO:tasks.workunit.client.0.smithi042.stdout:3/626: sync 2024-09-19T09:41:41.432 INFO:tasks.workunit.client.0.smithi042.stdout:6/532: sync 2024-09-19T09:41:41.432 INFO:tasks.workunit.client.0.smithi042.stdout:0/552: unlink d2/d8e/d32/ca3 0 2024-09-19T09:41:41.432 INFO:tasks.workunit.client.0.smithi042.stdout:0/553: readlink d2/d10/l37 0 2024-09-19T09:41:41.432 INFO:tasks.workunit.client.0.smithi042.stdout:0/554: fsync d2/d10/d12/d16/f9b 0 2024-09-19T09:41:41.434 INFO:tasks.workunit.client.0.smithi042.stdout:7/529: link d0/d3d/l6a d0/d3d/d55/d87/lae 0 2024-09-19T09:41:41.437 INFO:tasks.workunit.client.0.smithi042.stdout:4/599: rename d0/d1b/d1c/l78 to d0/d1b/d56/d86/ld1 0 2024-09-19T09:41:41.437 INFO:tasks.workunit.client.0.smithi042.stdout:8/655: creat d1/da/dd/d74/dbc/fc0 x:0 0 0 2024-09-19T09:41:41.437 INFO:tasks.workunit.client.0.smithi042.stdout:9/440: link d8/da/d19/d1c/d21/c35 d8/d1d/c86 0 2024-09-19T09:41:41.438 INFO:tasks.workunit.client.0.smithi042.stdout:9/441: chown d8/da/d19/d1c/d21/c35 3 1 2024-09-19T09:41:41.438 INFO:tasks.workunit.client.0.smithi042.stdout:9/442: fsync d8/da/d19/f2b 0 2024-09-19T09:41:41.438 INFO:tasks.workunit.client.0.smithi042.stdout:5/562: creat d2/db/d42/fca x:0 0 0 2024-09-19T09:41:41.438 INFO:tasks.workunit.client.0.smithi042.stdout:5/563: readlink d2/l7e 0 2024-09-19T09:41:41.440 INFO:tasks.workunit.client.0.smithi042.stdout:6/533: mkdir d1/de/d12/d22/d34/d6f/d4a/d98 0 2024-09-19T09:41:41.440 INFO:tasks.workunit.client.0.smithi042.stdout:3/627: dread d4/d8/d9/dc/dbf/d35/f44 [0,4194304] 0 2024-09-19T09:41:41.440 INFO:tasks.workunit.client.0.smithi042.stdout:7/530: stat d0/d14/d3c/c53 0 2024-09-19T09:41:41.441 INFO:tasks.workunit.client.0.smithi042.stdout:6/534: write d1/d20/d6a/d46/d92/d3a/f75 [113220,74646] 0 2024-09-19T09:41:41.441 INFO:tasks.workunit.client.0.smithi042.stdout:4/600: unlink d0/d1b/d1c/d2e/d3f/c60 0 2024-09-19T09:41:41.441 INFO:tasks.workunit.client.0.smithi042.stdout:9/443: mkdir d8/db/d31/d39/d87 0 2024-09-19T09:41:41.442 INFO:tasks.workunit.client.0.smithi042.stdout:2/541: write d7/dd/d14/d35/d4e/d63/f81 [2395417,109855] 0 2024-09-19T09:41:41.443 INFO:tasks.workunit.client.0.smithi042.stdout:5/564: rename d2/d4/ca8 to d2/d25/d37/dc2/ccb 0 2024-09-19T09:41:41.443 INFO:tasks.workunit.client.0.smithi042.stdout:6/535: mkdir d1/de/d76/d99 0 2024-09-19T09:41:41.444 INFO:tasks.workunit.client.0.smithi042.stdout:9/444: getdents d8/da/d70 0 2024-09-19T09:41:41.446 INFO:tasks.workunit.client.0.smithi042.stdout:6/536: mkdir d1/de/d12/d9a 0 2024-09-19T09:41:41.446 INFO:tasks.workunit.client.0.smithi042.stdout:6/537: stat d1/de/f28 0 2024-09-19T09:41:41.446 INFO:tasks.workunit.client.0.smithi042.stdout:9/445: unlink d8/da/d19/d1c/d21/d7f/c6d 0 2024-09-19T09:41:41.447 INFO:tasks.workunit.client.0.smithi042.stdout:2/542: mknod d7/dd/d48/d96/cb0 0 2024-09-19T09:41:41.448 INFO:tasks.workunit.client.0.smithi042.stdout:2/543: fsync d7/f98 0 2024-09-19T09:41:41.448 INFO:tasks.workunit.client.0.smithi042.stdout:2/544: stat d7/dd/d22/l8c 0 2024-09-19T09:41:41.450 INFO:tasks.workunit.client.0.smithi042.stdout:8/656: dread d1/da/dd/f88 [0,4194304] 0 2024-09-19T09:41:41.452 INFO:tasks.workunit.client.0.smithi042.stdout:8/657: mkdir d1/d2e/dc1 0 2024-09-19T09:41:41.460 INFO:tasks.workunit.client.0.smithi042.stdout:1/659: dwrite d4/d15/d9e/fb6 [0,4194304] 0 2024-09-19T09:41:41.464 INFO:tasks.workunit.client.0.smithi042.stdout:1/660: creat d4/d15/d19/d45/d82/fd8 x:0 0 0 2024-09-19T09:41:41.470 INFO:tasks.workunit.client.0.smithi042.stdout:7/531: dwrite d0/f1a [0,4194304] 0 2024-09-19T09:41:41.473 INFO:tasks.workunit.client.0.smithi042.stdout:0/555: dwrite d2/d8e/d32/f72 [0,4194304] 0 2024-09-19T09:41:41.473 INFO:tasks.workunit.client.0.smithi042.stdout:0/556: dread - d2/d8e/d32/d64/da5/d8a/d9d/d5a/d85/da0/fab zero size 2024-09-19T09:41:41.474 INFO:tasks.workunit.client.0.smithi042.stdout:0/557: chown d2/c50 3319366 1 2024-09-19T09:41:41.474 INFO:tasks.workunit.client.0.smithi042.stdout:0/558: chown d2/d8e/d32/d64/c71 94 1 2024-09-19T09:41:41.477 INFO:tasks.workunit.client.0.smithi042.stdout:7/532: dread d0/fb [0,4194304] 0 2024-09-19T09:41:41.485 INFO:tasks.workunit.client.0.smithi042.stdout:3/628: dwrite d4/f73 [0,4194304] 0 2024-09-19T09:41:41.487 INFO:tasks.workunit.client.0.smithi042.stdout:4/601: dwrite d0/d1b/d1c/d2e/d3b/f47 [4194304,4194304] 0 2024-09-19T09:41:41.488 INFO:tasks.workunit.client.0.smithi042.stdout:3/629: creat d4/d8/d4c/d6b/db9/fcc x:0 0 0 2024-09-19T09:41:41.488 INFO:tasks.workunit.client.0.smithi042.stdout:3/630: fdatasync d4/d8/d4c/f81 0 2024-09-19T09:41:41.488 INFO:tasks.workunit.client.0.smithi042.stdout:4/602: read - d0/d28/d87/da1/faa zero size 2024-09-19T09:41:41.489 INFO:tasks.workunit.client.0.smithi042.stdout:3/631: mkdir d4/d8/d9/dc/dbf/d6d/d8f/dcd 0 2024-09-19T09:41:41.492 INFO:tasks.workunit.client.0.smithi042.stdout:8/658: dwrite d1/da/f63 [0,4194304] 0 2024-09-19T09:41:41.492 INFO:tasks.workunit.client.0.smithi042.stdout:6/538: dwrite d1/de/d12/d22/f25 [0,4194304] 0 2024-09-19T09:41:41.492 INFO:tasks.workunit.client.0.smithi042.stdout:6/539: readlink d1/d20/d6a/d46/d92/l63 0 2024-09-19T09:41:41.492 INFO:tasks.workunit.client.0.smithi042.stdout:6/540: chown d1/de/d12/l1b 805936 1 2024-09-19T09:41:41.492 INFO:tasks.workunit.client.0.smithi042.stdout:6/541: fdatasync d1/de/d12/d22/f2a 0 2024-09-19T09:41:41.492 INFO:tasks.workunit.client.0.smithi042.stdout:6/542: chown d1/d20/f27 34 1 2024-09-19T09:41:41.492 INFO:tasks.workunit.client.0.smithi042.stdout:6/543: fdatasync d1/d20/d6a/d46/d92/d3a/f42 0 2024-09-19T09:41:41.493 INFO:tasks.workunit.client.0.smithi042.stdout:8/659: mkdir d1/da8/d41/d55/d99/da4/dc2 0 2024-09-19T09:41:41.493 INFO:tasks.workunit.client.0.smithi042.stdout:8/660: chown d1/da8/d3d/ca6 1538 1 2024-09-19T09:41:41.494 INFO:tasks.workunit.client.0.smithi042.stdout:6/544: creat d1/d20/d6a/d46/d92/d4f/f9b x:0 0 0 2024-09-19T09:41:41.494 INFO:tasks.workunit.client.0.smithi042.stdout:8/661: getdents d1/da8/d41/d55/d99 0 2024-09-19T09:41:41.495 INFO:tasks.workunit.client.0.smithi042.stdout:6/545: creat d1/de/d76/f9c x:0 0 0 2024-09-19T09:41:41.495 INFO:tasks.workunit.client.0.smithi042.stdout:8/662: creat d1/da8/d3d/d58/fc3 x:0 0 0 2024-09-19T09:41:41.496 INFO:tasks.workunit.client.0.smithi042.stdout:6/546: mknod d1/d20/c9d 0 2024-09-19T09:41:41.496 INFO:tasks.workunit.client.0.smithi042.stdout:9/446: dwrite d8/f6f [0,4194304] 0 2024-09-19T09:41:41.497 INFO:tasks.workunit.client.0.smithi042.stdout:8/663: mkdir d1/da8/d41/d55/dc4 0 2024-09-19T09:41:41.497 INFO:tasks.workunit.client.0.smithi042.stdout:8/664: fsync d1/d2e/f4a 0 2024-09-19T09:41:41.499 INFO:tasks.workunit.client.0.smithi042.stdout:6/547: creat d1/de/d12/d22/d34/d3f/f9e x:0 0 0 2024-09-19T09:41:41.499 INFO:tasks.workunit.client.0.smithi042.stdout:6/548: write d1/d20/f56 [2635972,91796] 0 2024-09-19T09:41:41.500 INFO:tasks.workunit.client.0.smithi042.stdout:2/545: dwrite d7/dd/d22/f32 [8388608,4194304] 0 2024-09-19T09:41:41.500 INFO:tasks.workunit.client.0.smithi042.stdout:1/661: dwrite d4/d15/d19/f1a [0,4194304] 0 2024-09-19T09:41:41.500 INFO:tasks.workunit.client.0.smithi042.stdout:1/662: write d4/d15/d2e/f8c [263540,62012] 0 2024-09-19T09:41:41.500 INFO:tasks.workunit.client.0.smithi042.stdout:7/533: dwrite d0/d14/f6b [0,4194304] 0 2024-09-19T09:41:41.502 INFO:tasks.workunit.client.0.smithi042.stdout:6/549: mknod d1/de/d12/d22/d34/d6f/d93/c9f 0 2024-09-19T09:41:41.503 INFO:tasks.workunit.client.0.smithi042.stdout:2/546: fsync d7/dd/d22/d30/f90 0 2024-09-19T09:41:41.504 INFO:tasks.workunit.client.0.smithi042.stdout:9/447: dread d8/d32/f58 [0,4194304] 0 2024-09-19T09:41:41.504 INFO:tasks.workunit.client.0.smithi042.stdout:9/448: truncate d8/f24 4593392 0 2024-09-19T09:41:41.504 INFO:tasks.workunit.client.0.smithi042.stdout:9/449: dread - d8/da/d19/f56 zero size 2024-09-19T09:41:41.507 INFO:tasks.workunit.client.0.smithi042.stdout:1/663: creat d4/d1d/fd9 x:0 0 0 2024-09-19T09:41:41.513 INFO:tasks.workunit.client.0.smithi042.stdout:4/603: dwrite d0/d1b/d1c/db8/fc3 [0,4194304] 0 2024-09-19T09:41:41.514 INFO:tasks.workunit.client.0.smithi042.stdout:5/565: rename d2/d4/d64/dab/l22 to d2/d4/d20/d60/db0/lcc 0 2024-09-19T09:41:41.518 INFO:tasks.workunit.client.0.smithi042.stdout:4/604: unlink d0/d28/d87/cc7 0 2024-09-19T09:41:41.519 INFO:tasks.workunit.client.0.smithi042.stdout:3/632: rename d4/d8/f20 to d4/d8/d4c/d6b/fce 0 2024-09-19T09:41:41.520 INFO:tasks.workunit.client.0.smithi042.stdout:5/566: creat d2/d4/d2e/fcd x:0 0 0 2024-09-19T09:41:41.522 INFO:tasks.workunit.client.0.smithi042.stdout:4/605: mknod d0/d1b/d1c/d2e/dc4/cd2 0 2024-09-19T09:41:41.524 INFO:tasks.workunit.client.0.smithi042.stdout:8/665: rename d1/d2e/fba to d1/da8/d41/d55/fc5 0 2024-09-19T09:41:41.525 INFO:tasks.workunit.client.0.smithi042.stdout:7/534: dwrite d0/f1a [0,4194304] 0 2024-09-19T09:41:41.526 INFO:tasks.workunit.client.0.smithi042.stdout:2/547: dwrite d7/f4b [0,4194304] 0 2024-09-19T09:41:41.526 INFO:tasks.workunit.client.0.smithi042.stdout:3/633: symlink d4/d8/d9/dc/dbf/d5c/lcf 0 2024-09-19T09:41:41.526 INFO:tasks.workunit.client.0.smithi042.stdout:3/634: fsync d4/d8/f19 0 2024-09-19T09:41:41.527 INFO:tasks.workunit.client.0.smithi042.stdout:3/635: fdatasync d4/d2a/f4e 0 2024-09-19T09:41:41.527 INFO:tasks.workunit.client.0.smithi042.stdout:5/567: link d2/d4/d20/l9d d2/d4/d20/d31/lce 0 2024-09-19T09:41:41.529 INFO:tasks.workunit.client.0.smithi042.stdout:9/450: dwrite d8/da/d19/d1c/d21/d7f/f5a [0,4194304] 0 2024-09-19T09:41:41.530 INFO:tasks.workunit.client.0.smithi042.stdout:6/550: rename d1/d20/d6a/d46/d92/d3a/c97 to d1/de/d12/d22/d34/ca0 0 2024-09-19T09:41:41.530 INFO:tasks.workunit.client.0.smithi042.stdout:0/559: link d2/d10/d12/d24/d5b/c7b d2/d8e/d32/d64/da5/d8a/d9d/d5a/d85/cae 0 2024-09-19T09:41:41.531 INFO:tasks.workunit.client.0.smithi042.stdout:8/666: truncate d1/f9 3323991 0 2024-09-19T09:41:41.532 INFO:tasks.workunit.client.0.smithi042.stdout:6/551: dread d1/d20/d6a/d46/d92/d3a/f47 [0,4194304] 0 2024-09-19T09:41:41.532 INFO:tasks.workunit.client.0.smithi042.stdout:6/552: chown d1/d20/d6a/d46/d92/f88 35665072 1 2024-09-19T09:41:41.532 INFO:tasks.workunit.client.0.smithi042.stdout:4/606: creat d0/d1b/d1c/d2e/d3f/d6b/fd3 x:0 0 0 2024-09-19T09:41:41.533 INFO:tasks.workunit.client.0.smithi042.stdout:7/535: link d0/f5 d0/d14/d44/d47/faf 0 2024-09-19T09:41:41.533 INFO:tasks.workunit.client.0.smithi042.stdout:7/536: write d0/f1a [5027654,88191] 0 2024-09-19T09:41:41.541 INFO:tasks.workunit.client.0.smithi042.stdout:6/553: write d1/de/d12/d22/d34/d6f/d4a/f55 [2197917,87240] 0 2024-09-19T09:41:41.544 INFO:tasks.workunit.client.0.smithi042.stdout:3/636: getdents d4/d8/d9/dc 0 2024-09-19T09:41:41.545 INFO:tasks.workunit.client.0.smithi042.stdout:5/568: symlink d2/d4/d20/d60/db0/lcf 0 2024-09-19T09:41:41.545 INFO:tasks.workunit.client.0.smithi042.stdout:5/569: readlink d2/db/d42/l99 0 2024-09-19T09:41:41.546 INFO:tasks.workunit.client.0.smithi042.stdout:5/570: chown d2/d4/d64/dab/f47 163391143 1 2024-09-19T09:41:41.547 INFO:tasks.workunit.client.0.smithi042.stdout:9/451: mkdir d8/da/d19/d1c/d21/d67/d88 0 2024-09-19T09:41:41.548 INFO:tasks.workunit.client.0.smithi042.stdout:0/560: mknod d2/d8e/d32/d64/da5/d8a/d9d/d5a/d8f/caf 0 2024-09-19T09:41:41.548 INFO:tasks.workunit.client.0.smithi042.stdout:0/561: dread - d2/d10/d12/d16/f9b zero size 2024-09-19T09:41:41.548 INFO:tasks.workunit.client.0.smithi042.stdout:8/667: symlink d1/da8/d3d/d58/lc6 0 2024-09-19T09:41:41.549 INFO:tasks.workunit.client.0.smithi042.stdout:4/607: truncate d0/d1b/f1e 287702 0 2024-09-19T09:41:41.551 INFO:tasks.workunit.client.0.smithi042.stdout:6/554: creat d1/de/d54/fa1 x:0 0 0 2024-09-19T09:41:41.552 INFO:tasks.workunit.client.0.smithi042.stdout:2/548: creat d7/dd/d14/d35/d4e/d9c/fb1 x:0 0 0 2024-09-19T09:41:41.553 INFO:tasks.workunit.client.0.smithi042.stdout:5/571: truncate d2/db/d3c/f94 1792020 0 2024-09-19T09:41:41.553 INFO:tasks.workunit.client.0.smithi042.stdout:5/572: write d2/d4/d2e/f4e [699050,29586] 0 2024-09-19T09:41:41.553 INFO:tasks.workunit.client.0.smithi042.stdout:5/573: stat d2 0 2024-09-19T09:41:41.553 INFO:tasks.workunit.client.0.smithi042.stdout:9/452: mkdir d8/da/d89 0 2024-09-19T09:41:41.553 INFO:tasks.workunit.client.0.smithi042.stdout:9/453: dread - d8/da/d19/d1c/d21/f84 zero size 2024-09-19T09:41:41.554 INFO:tasks.workunit.client.0.smithi042.stdout:0/562: link d2/d8e/f70 d2/d10/d6b/fb0 0 2024-09-19T09:41:41.556 INFO:tasks.workunit.client.0.smithi042.stdout:6/555: symlink d1/de/la2 0 2024-09-19T09:41:41.557 INFO:tasks.workunit.client.0.smithi042.stdout:5/574: creat d2/d4/d20/d60/db0/fd0 x:0 0 0 2024-09-19T09:41:41.557 INFO:tasks.workunit.client.0.smithi042.stdout:5/575: write d2/d4/d20/d60/d72/f65 [284238,32269] 0 2024-09-19T09:41:41.557 INFO:tasks.workunit.client.0.smithi042.stdout:5/576: write d2/d4/d64/da7/faa [424449,121901] 0 2024-09-19T09:41:41.558 INFO:tasks.workunit.client.0.smithi042.stdout:9/454: truncate d8/db/f61 2989233 0 2024-09-19T09:41:41.559 INFO:tasks.workunit.client.0.smithi042.stdout:6/556: mknod d1/d20/d6a/d46/ca3 0 2024-09-19T09:41:41.561 INFO:tasks.workunit.client.0.smithi042.stdout:5/577: creat d2/d4/d20/d60/d72/fd1 x:0 0 0 2024-09-19T09:41:41.563 INFO:tasks.workunit.client.0.smithi042.stdout:9/455: unlink d8/da/d19/f56 0 2024-09-19T09:41:41.565 INFO:tasks.workunit.client.0.smithi042.stdout:6/557: creat d1/de/d12/d22/d34/d6f/d4a/d98/fa4 x:0 0 0 2024-09-19T09:41:41.565 INFO:tasks.workunit.client.0.smithi042.stdout:6/558: chown d1/d20/d6a/d46/d92/c21 104013204 1 2024-09-19T09:41:41.565 INFO:tasks.workunit.client.0.smithi042.stdout:6/559: getdents d1/de/d12/d9a 0 2024-09-19T09:41:41.566 INFO:tasks.workunit.client.0.smithi042.stdout:6/560: write d1/d20/d6a/d90/f91 [72489,15951] 0 2024-09-19T09:41:41.566 INFO:tasks.workunit.client.0.smithi042.stdout:6/561: write d1/d20/d6a/d46/d92/f77 [1179381,88399] 0 2024-09-19T09:41:41.567 INFO:tasks.workunit.client.0.smithi042.stdout:5/578: creat d2/d4/d20/d60/d72/fd2 x:0 0 0 2024-09-19T09:41:41.567 INFO:tasks.workunit.client.0.smithi042.stdout:5/579: write d2/db/f10 [5884161,75196] 0 2024-09-19T09:41:41.568 INFO:tasks.workunit.client.0.smithi042.stdout:2/549: chown d7/dd/d22/c29 0 1 2024-09-19T09:41:41.570 INFO:tasks.workunit.client.0.smithi042.stdout:5/580: unlink d2/db/d3c/d86/cb7 0 2024-09-19T09:41:41.573 INFO:tasks.workunit.client.0.smithi042.stdout:5/581: unlink d2/d4/d20/d60/db0/lcf 0 2024-09-19T09:41:41.573 INFO:tasks.workunit.client.0.smithi042.stdout:9/456: write d8/d1d/d28/f2d [4692855,59846] 0 2024-09-19T09:41:41.573 INFO:tasks.workunit.client.0.smithi042.stdout:5/582: write d2/d4/d64/dab/f1d [5799274,87369] 0 2024-09-19T09:41:41.574 INFO:tasks.workunit.client.0.smithi042.stdout:2/550: mknod d7/dd/d14/d35/d4c/cb2 0 2024-09-19T09:41:41.574 INFO:tasks.workunit.client.0.smithi042.stdout:2/551: chown d7/dd/d14/d35/d4c/d61 520 1 2024-09-19T09:41:41.575 INFO:tasks.workunit.client.0.smithi042.stdout:5/583: rmdir d2/d4/d64/da7 39 2024-09-19T09:41:41.575 INFO:tasks.workunit.client.0.smithi042.stdout:5/584: write d2/d4/d20/d60/db0/fd0 [44561,56990] 0 2024-09-19T09:41:41.576 INFO:tasks.workunit.client.0.smithi042.stdout:5/585: truncate d2/d4/d20/d60/d72/fa6 825301 0 2024-09-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi042.stdout:2/552: getdents d7/dd/d1f/d3f 0 2024-09-19T09:41:41.578 INFO:tasks.workunit.client.0.smithi042.stdout:3/637: dwrite d4/d8/d4c/f5f [0,4194304] 0 2024-09-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi042.stdout:0/563: dwrite d2/d10/f15 [4194304,4194304] 0 2024-09-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi042.stdout:0/564: write d2/d8e/d32/d64/da5/f22 [344239,82649] 0 2024-09-19T09:41:41.580 INFO:tasks.workunit.client.0.smithi042.stdout:8/668: write d1/da/d14/f2b [1279710,100961] 0 2024-09-19T09:41:41.580 INFO:tasks.workunit.client.0.smithi042.stdout:4/608: dwrite d0/d1b/d1c/f59 [0,4194304] 0 2024-09-19T09:41:41.581 INFO:tasks.workunit.client.0.smithi042.stdout:8/669: truncate d1/da/d14/f1a 3604817 0 2024-09-19T09:41:41.581 INFO:tasks.workunit.client.0.smithi042.stdout:8/670: fdatasync d1/da/d3f/f50 0 2024-09-19T09:41:41.582 INFO:tasks.workunit.client.0.smithi042.stdout:0/565: symlink d2/d8e/d32/d64/da5/d8a/d9d/d5a/d8f/lb1 0 2024-09-19T09:41:41.583 INFO:tasks.workunit.client.0.smithi042.stdout:9/457: dread d8/da/d70/f7a [0,4194304] 0 2024-09-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi042.stdout:5/586: dread d2/db/fe [0,4194304] 0 2024-09-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi042.stdout:4/609: mknod d0/d1b/d69/dc0/cd4 0 2024-09-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi042.stdout:3/638: write d4/d8/d9/dc/dbf/d5c/d82/f1a [3018060,16648] 0 2024-09-19T09:41:41.587 INFO:tasks.workunit.client.0.smithi042.stdout:8/671: getdents d1/da8/d3d/d59 0 2024-09-19T09:41:41.588 INFO:tasks.workunit.client.0.smithi042.stdout:6/562: dwrite d1/de/d12/d22/d34/d3f/f9e [0,4194304] 0 2024-09-19T09:41:41.590 INFO:tasks.workunit.client.0.smithi042.stdout:5/587: read d2/db/d3c/d86/f88 [2392660,51064] 0 2024-09-19T09:41:41.590 INFO:tasks.workunit.client.0.smithi042.stdout:4/610: creat d0/d1b/d1c/d2e/d3f/d6b/fd5 x:0 0 0 2024-09-19T09:41:41.590 INFO:tasks.workunit.client.0.smithi042.stdout:4/611: readlink d0/d1b/d1c/d2e/d3f/d6e/l77 0 2024-09-19T09:41:41.592 INFO:tasks.workunit.client.0.smithi042.stdout:0/566: mkdir d2/d10/d1e/db2 0 2024-09-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi042.stdout:9/458: rmdir d8/da/d19/d1c/d21/d7f 39 2024-09-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi042.stdout:8/672: dread d1/d2e/f60 [0,4194304] 0 2024-09-19T09:41:41.602 INFO:tasks.workunit.client.0.smithi042.stdout:0/567: dread f0 [0,4194304] 0 2024-09-19T09:41:41.602 INFO:tasks.workunit.client.0.smithi042.stdout:5/588: symlink d2/d25/dc6/ld3 0 2024-09-19T09:41:41.602 INFO:tasks.workunit.client.0.smithi042.stdout:0/568: dread d2/d10/d12/d16/d51/f76 [0,4194304] 0 2024-09-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi042.stdout:0/569: truncate d2/d10/d1d/f59 733331 0 2024-09-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi042.stdout:2/553: unlink d7/dd/d14/d35/d4c/d61/f74 0 2024-09-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi042.stdout:9/459: unlink d8/d1d/d28/c37 0 2024-09-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi042.stdout:8/673: mkdir d1/da8/d92/dc7 0 2024-09-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi042.stdout:9/460: dread d8/da/f10 [0,4194304] 0 2024-09-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi042.stdout:3/639: dwrite d4/d8/d9/dc/f9b [0,4194304] 0 2024-09-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi042.stdout:6/563: dwrite d1/de/d54/f8e [0,4194304] 0 2024-09-19T09:41:41.613 INFO:tasks.workunit.client.0.smithi042.stdout:5/589: rename d2/d4/d20/f89 to d2/db/d42/fd4 0 2024-09-19T09:41:41.614 INFO:tasks.workunit.client.0.smithi042.stdout:8/674: truncate d1/da/f63 3126005 0 2024-09-19T09:41:41.614 INFO:tasks.workunit.client.0.smithi042.stdout:8/675: stat d1/da8/d41/d55/d99/lae 0 2024-09-19T09:41:41.615 INFO:tasks.workunit.client.0.smithi042.stdout:9/461: link d8/db/d31/d39/f81 d8/da/d19/d1c/d21/d7f/f8a 0 2024-09-19T09:41:41.615 INFO:tasks.workunit.client.0.smithi042.stdout:9/462: readlink d8/db/l12 0 2024-09-19T09:41:41.616 INFO:tasks.workunit.client.0.smithi042.stdout:3/640: write d4/d8/f36 [2201895,24603] 0 2024-09-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi042.stdout:8/676: mkdir d1/da/dd/d74/dbc/dc8 0 2024-09-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi042.stdout:3/641: creat d4/d8/d9/dc/dbf/d6d/fd0 x:0 0 0 2024-09-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi042.stdout:2/554: dwrite d7/dd/d1f/d3f/f78 [0,4194304] 0 2024-09-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi042.stdout:8/677: symlink d1/da/dd/lc9 0 2024-09-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi042.stdout:8/678: stat d1/da/d3f/fbd 0 2024-09-19T09:41:41.626 INFO:tasks.workunit.client.0.smithi042.stdout:2/555: chown d7/l50 176 1 2024-09-19T09:41:41.626 INFO:tasks.workunit.client.0.smithi042.stdout:9/463: dread f5 [4194304,4194304] 0 2024-09-19T09:41:41.626 INFO:tasks.workunit.client.0.smithi042.stdout:6/564: write d1/d20/f38 [2714118,20360] 0 2024-09-19T09:41:41.626 INFO:tasks.workunit.client.0.smithi042.stdout:8/679: mknod d1/da8/d41/d55/cca 0 2024-09-19T09:41:41.627 INFO:tasks.workunit.client.0.smithi042.stdout:2/556: truncate d7/f6a 1034929 0 2024-09-19T09:41:41.628 INFO:tasks.workunit.client.0.smithi042.stdout:9/464: truncate d8/f1a 851477 0 2024-09-19T09:41:41.628 INFO:tasks.workunit.client.0.smithi042.stdout:9/465: truncate d8/da/d19/f7c 111717 0 2024-09-19T09:41:41.630 INFO:tasks.workunit.client.0.smithi042.stdout:6/565: rename d1/d20/d6a/d46/d92/d4f/f65 to d1/de/d54/fa5 0 2024-09-19T09:41:41.630 INFO:tasks.workunit.client.0.smithi042.stdout:6/566: chown d1/d20/d6a/d46/d92/d4f/f66 18528 1 2024-09-19T09:41:41.631 INFO:tasks.workunit.client.0.smithi042.stdout:8/680: getdents d1/da/dd/d74/dbc 0 2024-09-19T09:41:41.632 INFO:tasks.workunit.client.0.smithi042.stdout:8/681: chown d1/da/d14/l19 750687 1 2024-09-19T09:41:41.633 INFO:tasks.workunit.client.0.smithi042.stdout:8/682: truncate d1/da8/d41/d55/d99/da4/f6d 5327478 0 2024-09-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi042.stdout:8/683: rmdir d1/da8/d41/d55/dc4 0 2024-09-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi042.stdout:8/684: readlink d1/da8/d41/l6e 0 2024-09-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi042.stdout:6/567: dread d1/d20/d6a/d46/d92/d3a/f75 [0,4194304] 0 2024-09-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi042.stdout:8/685: unlink d1/d2e/f4a 0 2024-09-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi042.stdout:6/568: write d1/d20/d6a/d46/d92/d3a/f75 [2421619,8166] 0 2024-09-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi042.stdout:5/590: dwrite d2/d25/f9f [0,4194304] 0 2024-09-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi042.stdout:5/591: write d2/d4/d64/d6a/fb6 [871078,83941] 0 2024-09-19T09:41:41.651 INFO:tasks.workunit.client.0.smithi042.stdout:8/686: read d1/da/f2f [1001042,3501] 0 2024-09-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi042.stdout:2/557: dwrite d7/dd/f40 [4194304,4194304] 0 2024-09-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi042.stdout:5/592: dwrite d2/d4/d64/d6a/f83 [4194304,4194304] 0 2024-09-19T09:41:41.664 INFO:tasks.workunit.client.0.smithi042.stdout:5/593: creat d2/d4/fd5 x:0 0 0 2024-09-19T09:41:41.665 INFO:tasks.workunit.client.0.smithi042.stdout:5/594: symlink d2/d8e/ld6 0 2024-09-19T09:41:41.666 INFO:tasks.workunit.client.0.smithi042.stdout:5/595: creat d2/d4/d2e/fd7 x:0 0 0 2024-09-19T09:41:41.668 INFO:tasks.workunit.client.0.smithi042.stdout:5/596: mkdir d2/d4/d64/da7/db4/dd8 0 2024-09-19T09:41:41.669 INFO:tasks.workunit.client.0.smithi042.stdout:5/597: creat d2/d4/d20/d60/d72/d75/fd9 x:0 0 0 2024-09-19T09:41:41.670 INFO:tasks.workunit.client.0.smithi042.stdout:5/598: unlink d2/d4/d20/f38 0 2024-09-19T09:41:41.670 INFO:tasks.workunit.client.0.smithi042.stdout:5/599: write d2/db/d3c/fa0 [568810,128995] 0 2024-09-19T09:41:41.671 INFO:tasks.workunit.client.0.smithi042.stdout:5/600: getdents d2/db 0 2024-09-19T09:41:41.671 INFO:tasks.workunit.client.0.smithi042.stdout:5/601: write d2/d4/d2e/f4e [1776192,61144] 0 2024-09-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi042.stdout:5/602: dread d2/db/f10 [0,4194304] 0 2024-09-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi042.stdout:6/569: dwrite d1/d20/d6a/d90/f57 [0,4194304] 0 2024-09-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi042.stdout:3/642: dwrite f0 [0,4194304] 0 2024-09-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi042.stdout:6/570: link d1/de/d12/d22/c44 d1/d20/d6a/d46/d92/d5f/ca6 0 2024-09-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi042.stdout:6/571: fdatasync d1/d20/f56 0 2024-09-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi042.stdout:9/466: dwrite d8/da/f50 [0,4194304] 0 2024-09-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi042.stdout:6/572: mkdir d1/de/da7 0 2024-09-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi042.stdout:2/558: dwrite d7/dd/d48/fa7 [0,4194304] 0 2024-09-19T09:41:41.687 INFO:tasks.workunit.client.0.smithi042.stdout:2/559: creat d7/dd/d14/d35/d45/d5e/fb3 x:0 0 0 2024-09-19T09:41:41.687 INFO:tasks.workunit.client.0.smithi042.stdout:2/560: chown d7/dd/d22/d30/f34 1221137 1 2024-09-19T09:41:41.689 INFO:tasks.workunit.client.0.smithi042.stdout:2/561: rmdir d7/dd/d22/d30/d66 39 2024-09-19T09:41:41.689 INFO:tasks.workunit.client.0.smithi042.stdout:2/562: readlink d7/dd/d22/d30/d66/l75 0 2024-09-19T09:41:41.689 INFO:tasks.workunit.client.0.smithi042.stdout:5/603: write d2/d4/f56 [267833,58915] 0 2024-09-19T09:41:41.689 INFO:tasks.workunit.client.0.smithi042.stdout:2/563: fdatasync d7/dd/d22/f86 0 2024-09-19T09:41:41.693 INFO:tasks.workunit.client.0.smithi042.stdout:5/604: mkdir d2/d4/d64/da7/dda 0 2024-09-19T09:41:41.693 INFO:tasks.workunit.client.0.smithi042.stdout:5/605: chown d2/f1e 232806873 1 2024-09-19T09:41:41.694 INFO:tasks.workunit.client.0.smithi042.stdout:2/564: symlink d7/dd/d22/lb4 0 2024-09-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi042.stdout:6/573: dwrite d1/f6 [4194304,4194304] 0 2024-09-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi042.stdout:6/574: stat d1/d20/d6a/d90 0 2024-09-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi042.stdout:6/575: chown d1/d20/d6a/d46/f64 1 1 2024-09-19T09:41:41.705 INFO:tasks.workunit.client.0.smithi042.stdout:2/565: dread d7/dd/d14/f56 [0,4194304] 0 2024-09-19T09:41:41.706 INFO:tasks.workunit.client.0.smithi042.stdout:6/576: rename d1/de/d12/l1f to d1/la8 0 2024-09-19T09:41:41.706 INFO:tasks.workunit.client.0.smithi042.stdout:6/577: readlink d1/la8 0 2024-09-19T09:41:41.710 INFO:tasks.workunit.client.0.smithi042.stdout:6/578: rename d1/d20/f8c to d1/d20/d6a/d46/d92/d5f/fa9 0 2024-09-19T09:41:41.710 INFO:tasks.workunit.client.0.smithi042.stdout:6/579: stat d1/de/d12/d22/d34/d6f/d4a/c6d 0 2024-09-19T09:41:41.710 INFO:tasks.workunit.client.0.smithi042.stdout:6/580: write d1/de/d54/f87 [968044,129253] 0 2024-09-19T09:41:41.710 INFO:tasks.workunit.client.0.smithi042.stdout:6/581: write d1/f8d [1095931,110244] 0 2024-09-19T09:41:41.710 INFO:tasks.workunit.client.0.smithi042.stdout:2/566: creat d7/d9b/fb5 x:0 0 0 2024-09-19T09:41:41.712 INFO:tasks.workunit.client.0.smithi042.stdout:6/582: link d1/d20/d6a/d90/f31 d1/de/d12/d22/d34/d6f/d4a/faa 0 2024-09-19T09:41:41.712 INFO:tasks.workunit.client.0.smithi042.stdout:6/583: truncate d1/de/d12/d22/d34/d3f/f96 148162 0 2024-09-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi042.stdout:6/584: creat d1/d20/d6a/fab x:0 0 0 2024-09-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi042.stdout:5/606: dwrite d2/d4/d64/d6a/fbd [0,4194304] 0 2024-09-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi042.stdout:5/607: chown d2/db/d42/c74 6056 1 2024-09-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi042.stdout:6/585: symlink d1/de/d54/d81/lac 0 2024-09-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi042.stdout:5/608: symlink d2/d4/d64/da7/dda/ldb 0 2024-09-19T09:41:41.729 INFO:tasks.workunit.client.0.smithi042.stdout:6/586: dwrite d1/de/d12/d22/f2a [0,4194304] 0 2024-09-19T09:41:41.730 INFO:tasks.workunit.client.0.smithi042.stdout:6/587: fsync d1/d20/d6a/f5a 0 2024-09-19T09:41:41.732 INFO:tasks.workunit.client.0.smithi042.stdout:2/567: rename d7/dd/f73 to d7/dd/d14/d35/d45/d5e/d79/fb6 0 2024-09-19T09:41:41.734 INFO:tasks.workunit.client.0.smithi042.stdout:5/609: rename c1 to d2/d25/d37/dc2/cdc 0 2024-09-19T09:41:41.735 INFO:tasks.workunit.client.0.smithi042.stdout:5/610: mknod d2/d4/cdd 0 2024-09-19T09:41:41.736 INFO:tasks.workunit.client.0.smithi042.stdout:5/611: mkdir d2/d4/d20/da4/dde 0 2024-09-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi042.stdout:7/537: sync 2024-09-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi042.stdout:1/664: sync 2024-09-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi042.stdout:2/568: write d7/dd/f8d [1436140,40469] 0 2024-09-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi042.stdout:7/538: truncate d0/d14/f6b 2599836 0 2024-09-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi042.stdout:1/665: rename d4/d1d to d4/d15/d19/d42/d51/db5/dda 0 2024-09-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi042.stdout:7/539: mkdir d0/d3d/db0 0 2024-09-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi042.stdout:1/666: symlink d4/d15/d2e/ldb 0 2024-09-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi042.stdout:6/588: dwrite d1/d20/d6a/d90/f57 [0,4194304] 0 2024-09-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi042.stdout:6/589: truncate d1/d20/d6a/d46/d92/d4f/f9b 309786 0 2024-09-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi042.stdout:6/590: readlink d1/l14 0 2024-09-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi042.stdout:2/569: read d7/dd/d14/d35/d6b/d88/f95 [3917635,105979] 0 2024-09-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi042.stdout:2/570: truncate d7/dd/f59 952678 0 2024-09-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi042.stdout:6/591: read d1/de/d12/d22/d34/d6f/d4a/faa [1211369,10194] 0 2024-09-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi042.stdout:5/612: link d2/db/d3c/d86/f88 d2/d4/d64/d6a/fdf 0 2024-09-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi042.stdout:5/613: read d2/d4/fa [3515516,73805] 0 2024-09-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi042.stdout:6/592: unlink d1/de/d54/fa5 0 2024-09-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi042.stdout:6/593: readlink d1/de/la2 0 2024-09-19T09:41:41.760 INFO:tasks.workunit.client.0.smithi042.stdout:6/594: dread d1/de/d12/d22/d34/d3f/f5c [0,4194304] 0 2024-09-19T09:41:41.761 INFO:tasks.workunit.client.0.smithi042.stdout:6/595: symlink d1/de/d12/d22/d34/d6f/lad 0 2024-09-19T09:41:41.771 INFO:tasks.workunit.client.0.smithi042.stdout:7/540: dwrite d0/d14/f4e [0,4194304] 0 2024-09-19T09:41:41.771 INFO:tasks.workunit.client.0.smithi042.stdout:7/541: write d0/d14/f83 [1393641,57846] 0 2024-09-19T09:41:41.771 INFO:tasks.workunit.client.0.smithi042.stdout:2/571: dwrite d7/dd/f37 [0,4194304] 0 2024-09-19T09:41:41.772 INFO:tasks.workunit.client.0.smithi042.stdout:5/614: link d2/d4/la1 d2/d4/d64/da7/le0 0 2024-09-19T09:41:41.773 INFO:tasks.workunit.client.0.smithi042.stdout:2/572: creat d7/dd/d22/fb7 x:0 0 0 2024-09-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi042.stdout:2/573: chown d7/dd/d14 21458873 1 2024-09-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi042.stdout:2/574: mknod d7/dd/d48/cb8 0 2024-09-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi042.stdout:7/542: dread d0/d3d/d55/f74 [0,4194304] 0 2024-09-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi042.stdout:7/543: fsync d0/d3d/d55/f5f 0 2024-09-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi042.stdout:7/544: chown d0/f27 491 1 2024-09-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi042.stdout:7/545: dread - d0/d3d/d92/da1/f91 zero size 2024-09-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi042.stdout:7/546: link d0/d14/d44/cab d0/d3d/d85/cb1 0 2024-09-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi042.stdout:7/547: dread - d0/d14/d3a/f7e zero size 2024-09-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi042.stdout:6/596: dwrite d1/de/d12/d22/d34/d3f/f9e [4194304,4194304] 0 2024-09-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi042.stdout:1/667: rename d4/d29/d3e to d4/d12/d8d/d91/d7f/d99/ddc 0 2024-09-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi042.stdout:1/668: truncate d4/d4e/fc0 239727 0 2024-09-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi042.stdout:1/669: chown d4/d15/d19/d45/lc6 0 1 2024-09-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi042.stdout:6/597: mknod d1/d20/d69/cae 0 2024-09-19T09:41:41.788 INFO:tasks.workunit.client.0.smithi042.stdout:1/670: creat d4/d12/db9/fdd x:0 0 0 2024-09-19T09:41:41.789 INFO:tasks.workunit.client.0.smithi042.stdout:6/598: creat d1/de/d12/d9a/faf x:0 0 0 2024-09-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi042.stdout:6/599: dread - d1/d20/d6a/d46/d92/d3a/f4d zero size 2024-09-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi042.stdout:1/671: mknod d4/cde 0 2024-09-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi042.stdout:1/672: chown d4/d15/d2e/ldb 55168 1 2024-09-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi042.stdout:2/575: dread d7/dd/d14/d35/d4e/d9c/f94 [0,4194304] 0 2024-09-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi042.stdout:6/600: creat d1/d20/d6a/fb0 x:0 0 0 2024-09-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi042.stdout:2/576: getdents d7/dd/d14/d35/d4c 0 2024-09-19T09:41:41.792 INFO:tasks.workunit.client.0.smithi042.stdout:7/548: dread d0/d40/f4f [0,4194304] 0 2024-09-19T09:41:41.793 INFO:tasks.workunit.client.0.smithi042.stdout:7/549: symlink d0/d3d/d92/lb2 0 2024-09-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi042.stdout:7/550: rmdir d0/d56/da9/daa 0 2024-09-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi042.stdout:2/577: unlink d7/fe 0 2024-09-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi042.stdout:4/612: sync 2024-09-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi042.stdout:2/578: write d7/dd/d48/fab [908990,9190] 0 2024-09-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi042.stdout:2/579: read - d7/dd/d14/d35/f7d zero size 2024-09-19T09:41:41.798 INFO:tasks.workunit.client.0.smithi042.stdout:5/615: dwrite d2/d4/d20/d60/d72/f9c [0,4194304] 0 2024-09-19T09:41:41.798 INFO:tasks.workunit.client.0.smithi042.stdout:5/616: truncate d2/d4/d20/fc9 1168870 0 2024-09-19T09:41:41.798 INFO:tasks.workunit.client.0.smithi042.stdout:4/613: rmdir d0/d1b/d1c/d2e/d3f/d6e/da0 39 2024-09-19T09:41:41.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/614: stat d0/d1b/f23 0 2024-09-19T09:41:41.801 INFO:tasks.workunit.client.0.smithi042.stdout:2/580: mkdir d7/d9b/db9 0 2024-09-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi042.stdout:4/615: dread d0/d1b/d1c/f25 [0,4194304] 0 2024-09-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi042.stdout:4/616: truncate d0/d1b/d1c/f25 2209974 0 2024-09-19T09:41:41.810 INFO:tasks.workunit.client.0.smithi042.stdout:4/617: mknod d0/d1b/d1c/d2e/d3b/cd6 0 2024-09-19T09:41:41.815 INFO:tasks.workunit.client.0.smithi042.stdout:1/673: dwrite d4/f22 [0,4194304] 0 2024-09-19T09:41:41.815 INFO:tasks.workunit.client.0.smithi042.stdout:1/674: chown d4/l9a 14736659 1 2024-09-19T09:41:41.816 INFO:tasks.workunit.client.0.smithi042.stdout:1/675: fdatasync d4/d12/d8d/d91/d7f/d99/fc3 0 2024-09-19T09:41:41.816 INFO:tasks.workunit.client.0.smithi042.stdout:3/643: sync 2024-09-19T09:41:41.816 INFO:tasks.workunit.client.0.smithi042.stdout:0/570: sync 2024-09-19T09:41:41.816 INFO:tasks.workunit.client.0.smithi042.stdout:9/467: sync 2024-09-19T09:41:41.816 INFO:tasks.workunit.client.0.smithi042.stdout:0/571: chown d2/d8e 255964917 1 2024-09-19T09:41:41.816 INFO:tasks.workunit.client.0.smithi042.stdout:8/687: sync 2024-09-19T09:41:41.816 INFO:tasks.workunit.client.0.smithi042.stdout:5/617: dread d2/d4/d64/d6a/fb6 [0,4194304] 0 2024-09-19T09:41:41.817 INFO:tasks.workunit.client.0.smithi042.stdout:1/676: getdents d4/d15/d2e/db7 0 2024-09-19T09:41:41.817 INFO:tasks.workunit.client.0.smithi042.stdout:1/677: chown d4/d15/d19/d45/f4d 5 1 2024-09-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi042.stdout:3/644: link d4/d8/d9/dc/dbf/d5c/d82/d48/fa0 d4/d8/d9/d1b/fd1 0 2024-09-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi042.stdout:3/645: stat f0 0 2024-09-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi042.stdout:3/646: chown d4/d8/d9/dc/dbf/d6d/d8f/fba 137 1 2024-09-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi042.stdout:3/647: chown d4/d8/d9/d1b/d4f/lbc 13071 1 2024-09-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi042.stdout:5/618: dread d2/d4/d64/dab/f1d [4194304,4194304] 0 2024-09-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi042.stdout:3/648: creat d4/d8/d4c/fd2 x:0 0 0 2024-09-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi042.stdout:3/649: mknod d4/d8/d9/d1b/d4f/d9c/cd3 0 2024-09-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi042.stdout:3/650: creat d4/d8/d9/dc/dbf/d5c/d82/d8c/d9f/fd4 x:0 0 0 2024-09-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi042.stdout:6/601: dwrite d1/de/d12/d22/d34/d6f/d4a/faa [0,4194304] 0 2024-09-19T09:41:41.828 INFO:tasks.workunit.client.0.smithi042.stdout:9/468: write d8/d32/f48 [1619441,40462] 0 2024-09-19T09:41:41.828 INFO:tasks.workunit.client.0.smithi042.stdout:3/651: mkdir d4/d8/d9/d1b/dd5 0 2024-09-19T09:41:41.829 INFO:tasks.workunit.client.0.smithi042.stdout:7/551: dwrite d0/d3d/f4a [0,4194304] 0 2024-09-19T09:41:41.829 INFO:tasks.workunit.client.0.smithi042.stdout:3/652: symlink d4/d8/d9/dc/dbf/d5c/ld6 0 2024-09-19T09:41:41.830 INFO:tasks.workunit.client.0.smithi042.stdout:2/581: dwrite d7/dd/d14/f1d [0,4194304] 0 2024-09-19T09:41:41.832 INFO:tasks.workunit.client.0.smithi042.stdout:3/653: symlink d4/d78/ld7 0 2024-09-19T09:41:41.832 INFO:tasks.workunit.client.0.smithi042.stdout:3/654: write d4/d78/fc1 [180922,102998] 0 2024-09-19T09:41:41.835 INFO:tasks.workunit.client.0.smithi042.stdout:3/655: link d4/d8/d9/dc/dbf/d6d/d8f/fc2 d4/d8/d9/d1b/dd5/fd8 0 2024-09-19T09:41:41.835 INFO:tasks.workunit.client.0.smithi042.stdout:4/618: dwrite d0/f71 [4194304,4194304] 0 2024-09-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi042.stdout:4/619: mknod d0/d28/d36/d91/cd7 0 2024-09-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi042.stdout:4/620: mkdir d0/d1b/dd8 0 2024-09-19T09:41:41.850 INFO:tasks.workunit.client.0.smithi042.stdout:0/572: dwrite d2/d10/d6b/fb0 [0,4194304] 0 2024-09-19T09:41:41.850 INFO:tasks.workunit.client.0.smithi042.stdout:0/573: fdatasync d2/d8e/d32/d64/da5/f22 0 2024-09-19T09:41:41.857 INFO:tasks.workunit.client.0.smithi042.stdout:5/619: dwrite d2/d4/d20/d31/f32 [0,4194304] 0 2024-09-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi042.stdout:5/620: write d2/d4/d20/f62 [313609,83217] 0 2024-09-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi042.stdout:5/621: getdents d2/d4/d20/dc0 0 2024-09-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi042.stdout:5/622: write d2/d4/d64/da7/faa [365701,67502] 0 2024-09-19T09:41:41.868 INFO:tasks.workunit.client.0.smithi042.stdout:3/656: dwrite d4/d8/d9/d1b/d4f/faf [0,4194304] 0 2024-09-19T09:41:41.869 INFO:tasks.workunit.client.0.smithi042.stdout:6/602: dwrite d1/de/f35 [0,4194304] 0 2024-09-19T09:41:41.869 INFO:tasks.workunit.client.0.smithi042.stdout:4/621: dwrite d0/d28/fa9 [0,4194304] 0 2024-09-19T09:41:41.870 INFO:tasks.workunit.client.0.smithi042.stdout:3/657: unlink d4/d8/d9/dc/dbf/d5c/c84 0 2024-09-19T09:41:41.872 INFO:tasks.workunit.client.0.smithi042.stdout:4/622: fdatasync d0/d1b/d1c/d2e/d3f/d6e/da0/fc5 0 2024-09-19T09:41:41.874 INFO:tasks.workunit.client.0.smithi042.stdout:3/658: truncate d4/d78/d9d/fa7 4150574 0 2024-09-19T09:41:41.875 INFO:tasks.workunit.client.0.smithi042.stdout:5/623: write d2/d25/d37/f63 [3677098,13466] 0 2024-09-19T09:41:41.876 INFO:tasks.workunit.client.0.smithi042.stdout:5/624: chown d2/db/d3c/c59 250333 1 2024-09-19T09:41:41.876 INFO:tasks.workunit.client.0.smithi042.stdout:5/625: chown d2/d4/d64/dab/l19 4594 1 2024-09-19T09:41:41.876 INFO:tasks.workunit.client.0.smithi042.stdout:5/626: getdents d2/d4/d20/d60/db0 0 2024-09-19T09:41:41.889 INFO:tasks.workunit.client.0.smithi042.stdout:5/627: dread d2/d25/d37/f63 [0,4194304] 0 2024-09-19T09:41:41.889 INFO:tasks.workunit.client.0.smithi042.stdout:6/603: dwrite d1/d20/d6a/d46/d92/f77 [0,4194304] 0 2024-09-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi042.stdout:1/678: dwrite d4/d15/d19/d45/d82/fd8 [0,4194304] 0 2024-09-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi042.stdout:2/582: dwrite d7/dd/d48/fab [0,4194304] 0 2024-09-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi042.stdout:6/604: symlink d1/de/d12/d9a/lb1 0 2024-09-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi042.stdout:1/679: getdents d4/d15/d19/d42/d5b 0 2024-09-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi042.stdout:3/659: dwrite d4/d8/fb2 [0,4194304] 0 2024-09-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi042.stdout:4/623: dwrite d0/d1b/d1c/f25 [0,4194304] 0 2024-09-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi042.stdout:2/583: link d7/dd/f15 d7/dd/d48/d96/fba 0 2024-09-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi042.stdout:1/680: dread d4/f14 [0,4194304] 0 2024-09-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi042.stdout:3/660: mknod d4/d8/d9/d39/d4b/d7d/cd9 0 2024-09-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi042.stdout:2/584: stat d7/dd/d22/d30/c77 0 2024-09-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi042.stdout:2/585: write d7/dd/d14/d35/d45/d5e/d79/fb6 [368838,37041] 0 2024-09-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi042.stdout:4/624: dread d0/f5 [0,4194304] 0 2024-09-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi042.stdout:4/625: chown d0/f71 1056640806 1 2024-09-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi042.stdout:4/626: creat d0/d1b/d1c/d2e/d3f/fd9 x:0 0 0 2024-09-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi042.stdout:2/586: symlink d7/lbb 0 2024-09-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi042.stdout:4/627: rmdir d0/d1b/d56 39 2024-09-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi042.stdout:4/628: chown d0/f4d 174053 1 2024-09-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi042.stdout:4/629: dread - d0/d1b/d1c/d2e/d3b/d95/db1/fbe zero size 2024-09-19T09:41:41.909 INFO:tasks.workunit.client.0.smithi042.stdout:2/587: symlink d7/dd/d22/d30/lbc 0 2024-09-19T09:41:41.910 INFO:tasks.workunit.client.0.smithi042.stdout:5/628: dwrite d2/d4/f56 [0,4194304] 0 2024-09-19T09:41:41.911 INFO:tasks.workunit.client.0.smithi042.stdout:2/588: rename d7/dd/d22/d30/f90 to d7/dd/d14/d35/d4e/d9c/fbd 0 2024-09-19T09:41:41.914 INFO:tasks.workunit.client.0.smithi042.stdout:2/589: creat d7/dd/fbe x:0 0 0 2024-09-19T09:41:41.914 INFO:tasks.workunit.client.0.smithi042.stdout:2/590: truncate d7/dd/d14/d35/f7d 258235 0 2024-09-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi042.stdout:8/688: sync 2024-09-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi042.stdout:8/689: readlink d1/da/dd/d8e/lb8 0 2024-09-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi042.stdout:8/690: chown d1/da/dd/d8e/lb8 189 1 2024-09-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi042.stdout:1/681: dwrite d4/d15/d2e/db7/d3c/fa3 [0,4194304] 0 2024-09-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi042.stdout:8/691: mkdir d1/da8/db1/dcb 0 2024-09-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi042.stdout:8/692: chown d1/da8/d41/d55/d99/da4/f73 11772970 1 2024-09-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi042.stdout:8/693: getdents d1/da/dd 0 2024-09-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi042.stdout:3/661: dwrite d4/d8/d9/d1b/d4f/f77 [0,4194304] 0 2024-09-19T09:41:41.924 INFO:tasks.workunit.client.0.smithi042.stdout:8/694: rename d1/da8/l4f to d1/d72/lcc 0 2024-09-19T09:41:41.924 INFO:tasks.workunit.client.0.smithi042.stdout:8/695: chown d1/da8/d3d/faf 70 1 2024-09-19T09:41:41.925 INFO:tasks.workunit.client.0.smithi042.stdout:1/682: dread d4/d15/d2e/db7/f72 [0,4194304] 0 2024-09-19T09:41:41.925 INFO:tasks.workunit.client.0.smithi042.stdout:8/696: getdents d1/da8/d92 0 2024-09-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi042.stdout:8/697: fsync d1/da/d14/f17 0 2024-09-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi042.stdout:8/698: unlink d1/da8/fb6 0 2024-09-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi042.stdout:8/699: mkdir d1/da/dcd 0 2024-09-19T09:41:41.931 INFO:tasks.workunit.client.0.smithi042.stdout:8/700: rmdir d1/d2e/dc1 0 2024-09-19T09:41:41.941 INFO:tasks.workunit.client.0.smithi042.stdout:1/683: write d4/d15/d19/d45/d82/fd8 [730097,93574] 0 2024-09-19T09:41:41.941 INFO:tasks.workunit.client.0.smithi042.stdout:1/684: write d4/d15/d2e/db7/f75 [261713,17656] 0 2024-09-19T09:41:41.942 INFO:tasks.workunit.client.0.smithi042.stdout:1/685: mknod d4/d15/d19/d42/d5b/cdf 0 2024-09-19T09:41:41.951 INFO:tasks.workunit.client.0.smithi042.stdout:5/629: dwrite d2/d4/d20/d60/d72/fd1 [0,4194304] 0 2024-09-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi042.stdout:8/701: dwrite d1/da/dd/f3a [0,4194304] 0 2024-09-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi042.stdout:3/662: dwrite d4/d8/d9/d39/d4b/f68 [0,4194304] 0 2024-09-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi042.stdout:2/591: dwrite d7/dd/d48/f5a [0,4194304] 0 2024-09-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi042.stdout:1/686: dwrite d4/f94 [0,4194304] 0 2024-09-19T09:41:41.967 INFO:tasks.workunit.client.0.smithi042.stdout:5/630: dwrite d2/d4/d64/d6a/f83 [4194304,4194304] 0 2024-09-19T09:41:41.968 INFO:tasks.workunit.client.0.smithi042.stdout:5/631: fsync d2/d4/d20/d31/f32 0 2024-09-19T09:41:41.968 INFO:tasks.workunit.client.0.smithi042.stdout:8/702: truncate d1/da8/d3d/d58/f82 321508 0 2024-09-19T09:41:41.968 INFO:tasks.workunit.client.0.smithi042.stdout:2/592: mkdir d7/dd/d14/d35/d4c/d61/d87/dbf 0 2024-09-19T09:41:41.970 INFO:tasks.workunit.client.0.smithi042.stdout:1/687: creat d4/d29/fe0 x:0 0 0 2024-09-19T09:41:41.970 INFO:tasks.workunit.client.0.smithi042.stdout:1/688: chown d4/d15/d19/d42/d51/d79/cc8 3 1 2024-09-19T09:41:41.973 INFO:tasks.workunit.client.0.smithi042.stdout:5/632: creat d2/fe1 x:0 0 0 2024-09-19T09:41:41.974 INFO:tasks.workunit.client.0.smithi042.stdout:8/703: mknod d1/da8/d3d/d95/cce 0 2024-09-19T09:41:41.975 INFO:tasks.workunit.client.0.smithi042.stdout:2/593: write d7/dd/d14/f25 [9963,85398] 0 2024-09-19T09:41:41.975 INFO:tasks.workunit.client.0.smithi042.stdout:8/704: chown d1/da/d14/f85 7022 1 2024-09-19T09:41:41.977 INFO:tasks.workunit.client.0.smithi042.stdout:5/633: mkdir d2/d4/d20/da4/de2 0 2024-09-19T09:41:41.977 INFO:tasks.workunit.client.0.smithi042.stdout:5/634: readlink d2/d4/d20/d31/lce 0 2024-09-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi042.stdout:2/594: mknod d7/dd/d14/cc0 0 2024-09-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi042.stdout:2/595: chown d7/dd/d48/fab 56335 1 2024-09-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi042.stdout:2/596: write d7/dd/d14/d35/d6b/d88/da8/fac [522938,76719] 0 2024-09-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi042.stdout:5/635: mkdir d2/de3 0 2024-09-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi042.stdout:2/597: rmdir d7/dd/d14 39 2024-09-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi042.stdout:5/636: read d2/d4/d64/d6a/fb6 [630381,125209] 0 2024-09-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi042.stdout:9/469: sync 2024-09-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi042.stdout:3/663: dwrite d4/d8/d9/f1e [0,4194304] 0 2024-09-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi042.stdout:2/598: creat d7/dd/d48/fc1 x:0 0 0 2024-09-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi042.stdout:8/705: write d1/da8/f54 [3981106,42246] 0 2024-09-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi042.stdout:8/706: truncate d1/da8/d3d/d58/fc3 643371 0 2024-09-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi042.stdout:8/707: write d1/da8/d41/fb5 [1218803,110946] 0 2024-09-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi042.stdout:9/470: rename d8/da/c5c to d8/db/d31/d39/d87/c8b 0 2024-09-19T09:41:41.988 INFO:tasks.workunit.client.0.smithi042.stdout:3/664: creat d4/d8/d9/d39/d4b/fda x:0 0 0 2024-09-19T09:41:41.988 INFO:tasks.workunit.client.0.smithi042.stdout:3/665: truncate d4/d8/d4c/f71 4314756 0 2024-09-19T09:41:41.991 INFO:tasks.workunit.client.0.smithi042.stdout:9/471: rename d8/da/d19/d1c/f5e to d8/da/f8c 0 2024-09-19T09:41:41.992 INFO:tasks.workunit.client.0.smithi042.stdout:3/666: getdents d4/d8/d9/d39 0 2024-09-19T09:41:41.993 INFO:tasks.workunit.client.0.smithi042.stdout:2/599: link d7/dd/d1f/f21 d7/dd/d14/d35/d4c/d61/d87/da6/fc2 0 2024-09-19T09:41:41.994 INFO:tasks.workunit.client.0.smithi042.stdout:0/574: sync 2024-09-19T09:41:41.994 INFO:tasks.workunit.client.0.smithi042.stdout:1/689: rmdir d4/d15/d19/d45/d82/d89 39 2024-09-19T09:41:41.994 INFO:tasks.workunit.client.0.smithi042.stdout:1/690: truncate f1 3623712 0 2024-09-19T09:41:41.994 INFO:tasks.workunit.client.0.smithi042.stdout:7/552: sync 2024-09-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi042.stdout:3/667: creat d4/d8/d9/dc/dbf/d6d/d8f/dcd/fdb x:0 0 0 2024-09-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi042.stdout:0/575: mkdir d2/d10/d12/d16/d57/d78/db3 0 2024-09-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi042.stdout:0/576: fdatasync d2/d10/d1e/f6f 0 2024-09-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi042.stdout:3/668: dread d4/d8/d9/dc/dbf/d5c/d82/f1a [0,4194304] 0 2024-09-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi042.stdout:1/691: dread d4/f22 [4194304,4194304] 0 2024-09-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi042.stdout:0/577: write d2/d10/d12/f31 [579420,101453] 0 2024-09-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi042.stdout:9/472: unlink d8/da/f8c 0 2024-09-19T09:41:42.003 INFO:tasks.workunit.client.0.smithi042.stdout:9/473: creat d8/da/f8d x:0 0 0 2024-09-19T09:41:42.004 INFO:tasks.workunit.client.0.smithi042.stdout:0/578: unlink d2/d10/d12/d24/f29 0 2024-09-19T09:41:42.006 INFO:tasks.workunit.client.0.smithi042.stdout:9/474: mkdir d8/da/d89/d8e 0 2024-09-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi042.stdout:9/475: mknod d8/d32/c8f 0 2024-09-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi042.stdout:5/637: dwrite d2/db/d3c/fa0 [0,4194304] 0 2024-09-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi042.stdout:9/476: truncate d8/f6f 1084309 0 2024-09-19T09:41:42.022 INFO:tasks.workunit.client.0.smithi042.stdout:8/708: dwrite d1/da8/d41/d55/fc5 [0,4194304] 0 2024-09-19T09:41:42.024 INFO:tasks.workunit.client.0.smithi042.stdout:8/709: creat d1/fcf x:0 0 0 2024-09-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi042.stdout:2/600: dwrite d7/dd/d14/d35/d4e/f97 [0,4194304] 0 2024-09-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi042.stdout:2/601: write d7/dd/d14/d35/d4c/d70/f7a [51148,99973] 0 2024-09-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi042.stdout:2/602: fsync d7/dd/d14/d35/d6b/d88/da8/fac 0 2024-09-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi042.stdout:7/553: dwrite d0/d14/f2a [0,4194304] 0 2024-09-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi042.stdout:7/554: readlink d0/d40/l98 0 2024-09-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi042.stdout:7/555: chown d0/d3d/d85/d99/c9c 63542197 1 2024-09-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi042.stdout:9/477: dwrite d8/db/d31/f64 [0,4194304] 0 2024-09-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi042.stdout:9/478: fsync d8/f3d 0 2024-09-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi042.stdout:2/603: mkdir d7/dd/d14/d35/d4c/d61/d87/dc3 0 2024-09-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi042.stdout:2/604: chown d7/dd/d14/d35/d45/d5e/d79/fb6 4057279 1 2024-09-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi042.stdout:0/579: dwrite d2/d8e/d32/d64/da5/f47 [0,4194304] 0 2024-09-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi042.stdout:7/556: rename d0/d14/d44/f79 to d0/d56/da9/fb3 0 2024-09-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi042.stdout:7/557: read d0/d14/d44/d47/faf [6464071,77451] 0 2024-09-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi042.stdout:7/558: fdatasync d0/d3d/d92/da1/f7f 0 2024-09-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi042.stdout:0/580: creat d2/d8e/d32/d64/fb4 x:0 0 0 2024-09-19T09:41:42.038 INFO:tasks.workunit.client.0.smithi042.stdout:2/605: mknod d7/dd/d14/d35/d4c/d61/d87/dbf/cc4 0 2024-09-19T09:41:42.039 INFO:tasks.workunit.client.0.smithi042.stdout:7/559: getdents d0/d14 0 2024-09-19T09:41:42.040 INFO:tasks.workunit.client.0.smithi042.stdout:8/710: dread d1/da/f5a [0,4194304] 0 2024-09-19T09:41:42.040 INFO:tasks.workunit.client.0.smithi042.stdout:8/711: chown d1/da/dd/f3a 561006581 1 2024-09-19T09:41:42.040 INFO:tasks.workunit.client.0.smithi042.stdout:8/712: chown d1/da/dd/f88 1 1 2024-09-19T09:41:42.041 INFO:tasks.workunit.client.0.smithi042.stdout:0/581: mkdir d2/d8e/d32/d64/da5/d8a/d9d/d5a/d8f/db5 0 2024-09-19T09:41:42.041 INFO:tasks.workunit.client.0.smithi042.stdout:0/582: write d2/d10/d1e/f6c [1003139,88850] 0 2024-09-19T09:41:42.042 INFO:tasks.workunit.client.0.smithi042.stdout:0/583: write d2/d8e/d32/d64/da5/f22 [1265660,27502] 0 2024-09-19T09:41:42.042 INFO:tasks.workunit.client.0.smithi042.stdout:2/606: mkdir d7/dd/d14/d35/d4c/d61/d87/dbf/dc5 0 2024-09-19T09:41:42.043 INFO:tasks.workunit.client.0.smithi042.stdout:7/560: symlink d0/d14/d3c/lb4 0 2024-09-19T09:41:42.043 INFO:tasks.workunit.client.0.smithi042.stdout:7/561: read - d0/d3d/d92/f95 zero size 2024-09-19T09:41:42.044 INFO:tasks.workunit.client.0.smithi042.stdout:8/713: unlink d1/da8/d3d/lbf 0 2024-09-19T09:41:42.044 INFO:tasks.workunit.client.0.smithi042.stdout:7/562: read d0/f36 [386211,2247] 0 2024-09-19T09:41:42.045 INFO:tasks.workunit.client.0.smithi042.stdout:2/607: mkdir d7/dd/d14/d35/d4c/d61/d87/dc6 0 2024-09-19T09:41:42.046 INFO:tasks.workunit.client.0.smithi042.stdout:7/563: unlink d0/d14/d3a/f81 0 2024-09-19T09:41:42.049 INFO:tasks.workunit.client.0.smithi042.stdout:4/630: sync 2024-09-19T09:41:42.049 INFO:tasks.workunit.client.0.smithi042.stdout:6/605: sync 2024-09-19T09:41:42.050 INFO:tasks.workunit.client.0.smithi042.stdout:4/631: readlink d0/d28/d87/l98 0 2024-09-19T09:41:42.052 INFO:tasks.workunit.client.0.smithi042.stdout:6/606: rename d1/de/d12/d22 to d1/de/d76/d99/db2 0 2024-09-19T09:41:42.052 INFO:tasks.workunit.client.0.smithi042.stdout:6/607: dread - d1/d20/d6a/fb0 zero size 2024-09-19T09:41:42.053 INFO:tasks.workunit.client.0.smithi042.stdout:4/632: mknod d0/d1b/d1c/d2e/d44/cda 0 2024-09-19T09:41:42.056 INFO:tasks.workunit.client.0.smithi042.stdout:4/633: getdents d0/d1b/d69/dc0 0 2024-09-19T09:41:42.063 INFO:tasks.workunit.client.0.smithi042.stdout:9/479: dwrite d8/da/f50 [4194304,4194304] 0 2024-09-19T09:41:42.063 INFO:tasks.workunit.client.0.smithi042.stdout:9/480: chown d8/d32/f48 8265161 1 2024-09-19T09:41:42.063 INFO:tasks.workunit.client.0.smithi042.stdout:9/481: chown d8/da/c46 1053489386 1 2024-09-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi042.stdout:0/584: dwrite d2/d10/d1e/f98 [0,4194304] 0 2024-09-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi042.stdout:4/634: write d0/d28/fa9 [2373780,45045] 0 2024-09-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi042.stdout:4/635: write d0/d1b/d1c/d2e/d3b/f7d [390090,125200] 0 2024-09-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi042.stdout:0/585: truncate d2/d8e/d32/d64/da5/f22 222209 0 2024-09-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi042.stdout:4/636: unlink d0/d1b/d1c/d2e/d44/f46 0 2024-09-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi042.stdout:4/637: link d0/d1b/d1c/d2e/f9a d0/d1b/d1c/fdb 0 2024-09-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi042.stdout:4/638: write d0/d28/d87/f8d [54825,73375] 0 2024-09-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi042.stdout:6/608: dwrite d1/de/d54/fa1 [0,4194304] 0 2024-09-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi042.stdout:6/609: chown d1/la8 730818452 1 2024-09-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi042.stdout:6/610: write d1/d20/d6a/d46/d92/d3a/f4d [1003818,124591] 0 2024-09-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi042.stdout:4/639: chown d0/d1b/d56/d86 19394 1 2024-09-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi042.stdout:0/586: unlink d2/d8e/d32/d64/da5/c1a 0 2024-09-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi042.stdout:4/640: creat d0/d1b/d1c/d2e/d3b/fdc x:0 0 0 2024-09-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi042.stdout:4/641: write d0/d28/d87/da1/faa [377046,99008] 0 2024-09-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi042.stdout:4/642: fdatasync d0/d1b/d1c/d2e/d3b/f47 0 2024-09-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi042.stdout:0/587: chown d2/d8e/d32/d64/da5/d52/f55 13634772 1 2024-09-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi042.stdout:0/588: link d2/d8e/d32/d64/da5/d8a/d9d/d5a/l9c d2/d10/d12/d16/lb6 0 2024-09-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi042.stdout:6/611: dwrite d1/d20/d6a/fb0 [0,4194304] 0 2024-09-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi042.stdout:6/612: write d1/d20/d6a/d46/f64 [1009264,68357] 0 2024-09-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi042.stdout:9/482: dwrite d8/da/d19/f6b [0,4194304] 0 2024-09-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi042.stdout:9/483: mknod d8/c90 0 2024-09-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi042.stdout:9/484: dread - d8/db/d31/d39/f81 zero size 2024-09-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi042.stdout:6/613: mknod d1/de/d76/d99/db2/cb3 0 2024-09-19T09:41:42.094 INFO:tasks.workunit.client.0.smithi042.stdout:9/485: link d8/da/d19/d1c/d21/d7f/c82 d8/db/d31/d39/c91 0 2024-09-19T09:41:42.095 INFO:tasks.workunit.client.0.smithi042.stdout:6/614: truncate d1/d20/f27 3765454 0 2024-09-19T09:41:42.095 INFO:tasks.workunit.client.0.smithi042.stdout:6/615: read d1/d20/d6a/d46/d92/d5f/fa9 [413946,96208] 0 2024-09-19T09:41:42.095 INFO:tasks.workunit.client.0.smithi042.stdout:6/616: chown d1/de/d76/d99/db2/f80 2763 1 2024-09-19T09:41:42.096 INFO:tasks.workunit.client.0.smithi042.stdout:0/589: dwrite d2/d8e/d32/d64/da5/d52/f97 [0,4194304] 0 2024-09-19T09:41:42.101 INFO:tasks.workunit.client.0.smithi042.stdout:9/486: dread d8/d1d/d28/f43 [0,4194304] 0 2024-09-19T09:41:42.101 INFO:tasks.workunit.client.0.smithi042.stdout:9/487: creat d8/da/d70/f92 x:0 0 0 2024-09-19T09:41:42.101 INFO:tasks.workunit.client.0.smithi042.stdout:9/488: chown d8/da/d19/f7c 23 1 2024-09-19T09:41:42.101 INFO:tasks.workunit.client.0.smithi042.stdout:9/489: write d8/db/d31/d39/f81 [969607,15765] 0 2024-09-19T09:41:42.103 INFO:tasks.workunit.client.0.smithi042.stdout:9/490: write d8/f15 [367213,10724] 0 2024-09-19T09:41:42.104 INFO:tasks.workunit.client.0.smithi042.stdout:9/491: mknod d8/da/d19/d1c/d21/d67/c93 0 2024-09-19T09:41:42.105 INFO:tasks.workunit.client.0.smithi042.stdout:9/492: write d8/db/d31/f75 [877884,13707] 0 2024-09-19T09:41:42.105 INFO:tasks.workunit.client.0.smithi042.stdout:6/617: dread d1/d20/d6a/d90/f57 [0,4194304] 0 2024-09-19T09:41:42.106 INFO:tasks.workunit.client.0.smithi042.stdout:6/618: chown d1/de/d76 3 1 2024-09-19T09:41:42.106 INFO:tasks.workunit.client.0.smithi042.stdout:6/619: write d1/de/d12/f19 [280235,96132] 0 2024-09-19T09:41:42.106 INFO:tasks.workunit.client.0.smithi042.stdout:6/620: creat d1/de/d54/fb4 x:0 0 0 2024-09-19T09:41:42.107 INFO:tasks.workunit.client.0.smithi042.stdout:6/621: chown d1/de/d76/d99/db2/d34/d6f/l67 1524337 1 2024-09-19T09:41:42.108 INFO:tasks.workunit.client.0.smithi042.stdout:6/622: getdents d1/de/d76/d99/db2/d34/d6f/d4a/d98 0 2024-09-19T09:41:42.108 INFO:tasks.workunit.client.0.smithi042.stdout:6/623: stat d1/d20/d6a/d46/ca3 0 2024-09-19T09:41:42.109 INFO:tasks.workunit.client.0.smithi042.stdout:0/590: dread d2/d10/d1d/d34/f4a [0,4194304] 0 2024-09-19T09:41:42.109 INFO:tasks.workunit.client.0.smithi042.stdout:0/591: dread - d2/d10/d1d/d34/f74 zero size 2024-09-19T09:41:42.110 INFO:tasks.workunit.client.0.smithi042.stdout:6/624: rename d1/d20/d6a/d46/d92/d5f to d1/de/d76/d99/db2/d34/d6f/d93/db5 0 2024-09-19T09:41:42.111 INFO:tasks.workunit.client.0.smithi042.stdout:0/592: mknod d2/d10/d12/d16/d57/d99/cb7 0 2024-09-19T09:41:42.113 INFO:tasks.workunit.client.0.smithi042.stdout:6/625: fsync d1/de/d76/d99/db2/f2a 0 2024-09-19T09:41:42.113 INFO:tasks.workunit.client.0.smithi042.stdout:6/626: write d1/de/d76/d99/db2/d34/d6f/d4a/f83 [4470647,106624] 0 2024-09-19T09:41:42.114 INFO:tasks.workunit.client.0.smithi042.stdout:0/593: truncate d2/d10/d1d/d34/f4a 1492143 0 2024-09-19T09:41:42.116 INFO:tasks.workunit.client.0.smithi042.stdout:6/627: rename d1/d20/d6a/d90/f30 to d1/de/d54/d81/fb6 0 2024-09-19T09:41:42.133 INFO:tasks.workunit.client.0.smithi042.stdout:9/493: dwrite d8/d32/f58 [0,4194304] 0 2024-09-19T09:41:42.134 INFO:tasks.workunit.client.0.smithi042.stdout:9/494: symlink d8/db/d31/d39/d87/l94 0 2024-09-19T09:41:42.135 INFO:tasks.workunit.client.0.smithi042.stdout:0/594: dwrite d2/d10/d12/d16/d51/f56 [0,4194304] 0 2024-09-19T09:41:42.135 INFO:tasks.workunit.client.0.smithi042.stdout:0/595: write d2/d10/d1d/f2b [1438985,64346] 0 2024-09-19T09:41:42.136 INFO:tasks.workunit.client.0.smithi042.stdout:9/495: write d8/da/d19/d1c/d21/d7f/f8a [893286,130425] 0 2024-09-19T09:41:42.136 INFO:tasks.workunit.client.0.smithi042.stdout:0/596: mknod d2/d10/d12/cb8 0 2024-09-19T09:41:42.137 INFO:tasks.workunit.client.0.smithi042.stdout:0/597: write d2/d8e/d32/f83 [791552,128611] 0 2024-09-19T09:41:42.137 INFO:tasks.workunit.client.0.smithi042.stdout:9/496: rmdir d8/da/d19/d1c 39 2024-09-19T09:41:42.138 INFO:tasks.workunit.client.0.smithi042.stdout:0/598: rename d2/d10/c91 to d2/d10/d6b/cb9 0 2024-09-19T09:41:42.138 INFO:tasks.workunit.client.0.smithi042.stdout:6/628: dwrite d1/de/d54/f8e [0,4194304] 0 2024-09-19T09:41:42.139 INFO:tasks.workunit.client.0.smithi042.stdout:9/497: link d8/db/d31/c7d d8/da/d19/d1c/d21/d7f/c95 0 2024-09-19T09:41:42.139 INFO:tasks.workunit.client.0.smithi042.stdout:9/498: fdatasync d8/da/d19/f6b 0 2024-09-19T09:41:42.139 INFO:tasks.workunit.client.0.smithi042.stdout:9/499: write d8/f15 [139748,117754] 0 2024-09-19T09:41:42.139 INFO:tasks.workunit.client.0.smithi042.stdout:9/500: write d8/da/f10 [1247095,126103] 0 2024-09-19T09:41:42.140 INFO:tasks.workunit.client.0.smithi042.stdout:0/599: rmdir d2/d8e 39 2024-09-19T09:41:42.140 INFO:tasks.workunit.client.0.smithi042.stdout:9/501: write d8/db/d31/f75 [230901,121527] 0 2024-09-19T09:41:42.142 INFO:tasks.workunit.client.0.smithi042.stdout:6/629: symlink d1/de/d76/d99/db2/d34/d6f/d4a/d98/lb7 0 2024-09-19T09:41:42.142 INFO:tasks.workunit.client.0.smithi042.stdout:6/630: read - d1/de/d76/d99/db2/d34/f8f zero size 2024-09-19T09:41:42.142 INFO:tasks.workunit.client.0.smithi042.stdout:6/631: stat d1/de/f35 0 2024-09-19T09:41:42.143 INFO:tasks.workunit.client.0.smithi042.stdout:0/600: link d2/d8e/l58 d2/d10/da1/lba 0 2024-09-19T09:41:42.144 INFO:tasks.workunit.client.0.smithi042.stdout:9/502: rename d8/f24 to d8/da/d19/d1c/d21/f96 0 2024-09-19T09:41:42.145 INFO:tasks.workunit.client.0.smithi042.stdout:9/503: fsync d8/da/d70/f92 0 2024-09-19T09:41:42.145 INFO:tasks.workunit.client.0.smithi042.stdout:9/504: chown d8/db/l12 187 1 2024-09-19T09:41:42.145 INFO:tasks.workunit.client.0.smithi042.stdout:9/505: write d8/d1d/d28/f43 [5727267,39379] 0 2024-09-19T09:41:42.146 INFO:tasks.workunit.client.0.smithi042.stdout:6/632: getdents d1/d20 0 2024-09-19T09:41:42.146 INFO:tasks.workunit.client.0.smithi042.stdout:6/633: fsync d1/de/d76/d99/db2/d34/d6f/d4a/f78 0 2024-09-19T09:41:42.146 INFO:tasks.workunit.client.0.smithi042.stdout:6/634: chown d1/de/d76/d99/db2/d34/d6f/d4a 4 1 2024-09-19T09:41:42.146 INFO:tasks.workunit.client.0.smithi042.stdout:0/601: stat d2/d10/d12/d16/c92 0 2024-09-19T09:41:42.146 INFO:tasks.workunit.client.0.smithi042.stdout:0/602: truncate d2/d10/d1d/d34/f74 995075 0 2024-09-19T09:41:42.147 INFO:tasks.workunit.client.0.smithi042.stdout:0/603: creat d2/d10/fbb x:0 0 0 2024-09-19T09:41:42.147 INFO:tasks.workunit.client.0.smithi042.stdout:0/604: write d2/d10/d12/d16/f9b [619712,38281] 0 2024-09-19T09:41:42.148 INFO:tasks.workunit.client.0.smithi042.stdout:0/605: getdents d2/d10/d12/d16 0 2024-09-19T09:41:42.149 INFO:tasks.workunit.client.0.smithi042.stdout:0/606: write d2/d10/d1e/f6f [1577551,79261] 0 2024-09-19T09:41:42.150 INFO:tasks.workunit.client.0.smithi042.stdout:0/607: mkdir d2/d10/d12/d16/d57/d78/db3/dbc 0 2024-09-19T09:41:42.150 INFO:tasks.workunit.client.0.smithi042.stdout:0/608: truncate d2/d8e/d32/d64/fb4 868819 0 2024-09-19T09:41:42.151 INFO:tasks.workunit.client.0.smithi042.stdout:0/609: write d2/d8e/d32/d64/da5/f47 [4564388,121022] 0 2024-09-19T09:41:42.153 INFO:tasks.workunit.client.0.smithi042.stdout:5/638: sync 2024-09-19T09:41:42.153 INFO:tasks.workunit.client.0.smithi042.stdout:3/669: sync 2024-09-19T09:41:42.153 INFO:tasks.workunit.client.0.smithi042.stdout:2/608: sync 2024-09-19T09:41:42.153 INFO:tasks.workunit.client.0.smithi042.stdout:9/506: write d8/da/f1e [1119567,83552] 0 2024-09-19T09:41:42.153 INFO:tasks.workunit.client.0.smithi042.stdout:7/564: sync 2024-09-19T09:41:42.153 INFO:tasks.workunit.client.0.smithi042.stdout:8/714: sync 2024-09-19T09:41:42.153 INFO:tasks.workunit.client.0.smithi042.stdout:9/507: fdatasync d8/f1a 0 2024-09-19T09:41:42.154 INFO:tasks.workunit.client.0.smithi042.stdout:7/565: dread - d0/d14/d3a/f7e zero size 2024-09-19T09:41:42.154 INFO:tasks.workunit.client.0.smithi042.stdout:2/609: truncate d7/dd/d14/d35/d4c/fa3 54598 0 2024-09-19T09:41:42.154 INFO:tasks.workunit.client.0.smithi042.stdout:1/692: sync 2024-09-19T09:41:42.154 INFO:tasks.workunit.client.0.smithi042.stdout:9/508: stat d8/da/f50 0 2024-09-19T09:41:42.154 INFO:tasks.workunit.client.0.smithi042.stdout:9/509: chown d8/da/d19/l29 439076 1 2024-09-19T09:41:42.154 INFO:tasks.workunit.client.0.smithi042.stdout:7/566: write d0/f59 [280418,125483] 0 2024-09-19T09:41:42.154 INFO:tasks.workunit.client.0.smithi042.stdout:4/643: sync 2024-09-19T09:41:42.155 INFO:tasks.workunit.client.0.smithi042.stdout:2/610: write d7/dd/d14/d35/d45/d5e/d79/fa1 [883995,84810] 0 2024-09-19T09:41:42.155 INFO:tasks.workunit.client.0.smithi042.stdout:2/611: write d7/dd/f37 [5065547,49941] 0 2024-09-19T09:41:42.157 INFO:tasks.workunit.client.0.smithi042.stdout:5/639: rename d2/d4/d20/lb5 to d2/d4/d8a/le4 0 2024-09-19T09:41:42.157 INFO:tasks.workunit.client.0.smithi042.stdout:5/640: stat d2/d4/d20/d60/c8b 0 2024-09-19T09:41:42.157 INFO:tasks.workunit.client.0.smithi042.stdout:8/715: symlink d1/da8/db1/dcb/ld0 0 2024-09-19T09:41:42.159 INFO:tasks.workunit.client.0.smithi042.stdout:0/610: dread d2/d8e/f46 [0,4194304] 0 2024-09-19T09:41:42.159 INFO:tasks.workunit.client.0.smithi042.stdout:0/611: chown d2/d10/d12/d16/lb6 2139081703 1 2024-09-19T09:41:42.163 INFO:tasks.workunit.client.0.smithi042.stdout:1/693: write d4/d15/d2e/db7/f98 [3625283,111018] 0 2024-09-19T09:41:42.163 INFO:tasks.workunit.client.0.smithi042.stdout:1/694: stat d4/cde 0 2024-09-19T09:41:42.164 INFO:tasks.workunit.client.0.smithi042.stdout:1/695: write d4/d1e/fc5 [168387,116941] 0 2024-09-19T09:41:42.164 INFO:tasks.workunit.client.0.smithi042.stdout:9/510: creat d8/db/d31/f97 x:0 0 0 2024-09-19T09:41:42.164 INFO:tasks.workunit.client.0.smithi042.stdout:7/567: mkdir d0/d40/d9d/db5 0 2024-09-19T09:41:42.165 INFO:tasks.workunit.client.0.smithi042.stdout:0/612: unlink d2/d8e/d32/d64/da5/d8a/d9d/f6e 0 2024-09-19T09:41:42.165 INFO:tasks.workunit.client.0.smithi042.stdout:0/613: readlink d2/d10/d1d/l9e 0 2024-09-19T09:41:42.166 INFO:tasks.workunit.client.0.smithi042.stdout:2/612: write d7/dd/d48/fa7 [1021376,84615] 0 2024-09-19T09:41:42.167 INFO:tasks.workunit.client.0.smithi042.stdout:7/568: truncate d0/d56/f66 2791078 0 2024-09-19T09:41:42.169 INFO:tasks.workunit.client.0.smithi042.stdout:5/641: write d2/d4/d64/d6a/f83 [4720673,41156] 0 2024-09-19T09:41:42.171 INFO:tasks.workunit.client.0.smithi042.stdout:6/635: dwrite d1/de/d54/fb4 [0,4194304] 0 2024-09-19T09:41:42.171 INFO:tasks.workunit.client.0.smithi042.stdout:6/636: chown d1/d20/d69/f86 1670688971 1 2024-09-19T09:41:42.171 INFO:tasks.workunit.client.0.smithi042.stdout:9/511: fsync d8/da/d19/d1c/d21/d7f/f8a 0 2024-09-19T09:41:42.171 INFO:tasks.workunit.client.0.smithi042.stdout:9/512: write d8/da/d19/d1c/d21/d7f/f8a [1609375,30744] 0 2024-09-19T09:41:42.171 INFO:tasks.workunit.client.0.smithi042.stdout:7/569: dread d0/d56/f88 [4194304,4194304] 0 2024-09-19T09:41:42.171 INFO:tasks.workunit.client.0.smithi042.stdout:5/642: creat d2/d4/d64/da7/db4/dd8/fe5 x:0 0 0 2024-09-19T09:41:42.173 INFO:tasks.workunit.client.0.smithi042.stdout:6/637: link d1/de/d76/d99/db2/d34/d3f/f9e d1/de/d76/d99/db2/d34/d6f/d4a/d98/fb8 0 2024-09-19T09:41:42.175 INFO:tasks.workunit.client.0.smithi042.stdout:9/513: unlink d8/d32/l79 0 2024-09-19T09:41:42.177 INFO:tasks.workunit.client.0.smithi042.stdout:7/570: mkdir d0/d3d/d55/d72/db6 0 2024-09-19T09:41:42.177 INFO:tasks.workunit.client.0.smithi042.stdout:7/571: dread - d0/d40/d9d/f8f zero size 2024-09-19T09:41:42.177 INFO:tasks.workunit.client.0.smithi042.stdout:7/572: chown d0/c52 13 1 2024-09-19T09:41:42.177 INFO:tasks.workunit.client.0.smithi042.stdout:7/573: fdatasync d0/d14/f83 0 2024-09-19T09:41:42.177 INFO:tasks.workunit.client.0.smithi042.stdout:9/514: rmdir d8/db/d31/d39 39 2024-09-19T09:41:42.178 INFO:tasks.workunit.client.0.smithi042.stdout:7/574: creat d0/d3d/d85/d99/fb7 x:0 0 0 2024-09-19T09:41:42.179 INFO:tasks.workunit.client.0.smithi042.stdout:4/644: dwrite d0/d1b/d1c/d2e/d3f/d5a/fb0 [0,4194304] 0 2024-09-19T09:41:42.179 INFO:tasks.workunit.client.0.smithi042.stdout:1/696: write d4/f47 [509359,65420] 0 2024-09-19T09:41:42.181 INFO:tasks.workunit.client.0.smithi042.stdout:6/638: dread d1/de/d54/fa1 [0,4194304] 0 2024-09-19T09:41:42.182 INFO:tasks.workunit.client.0.smithi042.stdout:1/697: getdents d4/d15/d19/d42/d51/d79 0 2024-09-19T09:41:42.183 INFO:tasks.workunit.client.0.smithi042.stdout:4/645: rmdir d0 39 2024-09-19T09:41:42.183 INFO:tasks.workunit.client.0.smithi042.stdout:3/670: dwrite d4/d8/d9/d39/d4b/f68 [0,4194304] 0 2024-09-19T09:41:42.183 INFO:tasks.workunit.client.0.smithi042.stdout:7/575: dread d0/d14/f83 [0,4194304] 0 2024-09-19T09:41:42.183 INFO:tasks.workunit.client.0.smithi042.stdout:7/576: dread - d0/d3d/d85/d99/fb7 zero size 2024-09-19T09:41:42.184 INFO:tasks.workunit.client.0.smithi042.stdout:1/698: creat d4/d15/d19/d45/d82/d89/fe1 x:0 0 0 2024-09-19T09:41:42.184 INFO:tasks.workunit.client.0.smithi042.stdout:6/639: dread d1/d20/f56 [0,4194304] 0 2024-09-19T09:41:42.184 INFO:tasks.workunit.client.0.smithi042.stdout:4/646: creat d0/d1b/dd8/fdd x:0 0 0 2024-09-19T09:41:42.184 INFO:tasks.workunit.client.0.smithi042.stdout:4/647: dread - d0/d1b/d1c/fb4 zero size 2024-09-19T09:41:42.185 INFO:tasks.workunit.client.0.smithi042.stdout:4/648: chown d0/l3a 17790 1 2024-09-19T09:41:42.185 INFO:tasks.workunit.client.0.smithi042.stdout:9/515: dread d8/d32/f58 [0,4194304] 0 2024-09-19T09:41:42.187 INFO:tasks.workunit.client.0.smithi042.stdout:3/671: creat d4/d8/d9/dc/dbf/d5c/d82/d48/fdc x:0 0 0 2024-09-19T09:41:42.187 INFO:tasks.workunit.client.0.smithi042.stdout:3/672: write d4/d8/d9/dc/dbf/d6d/d8f/dcd/fdb [303699,53448] 0 2024-09-19T09:41:42.187 INFO:tasks.workunit.client.0.smithi042.stdout:3/673: write d4/d8/d9/d1b/d4f/d9c/fbb [793967,45066] 0 2024-09-19T09:41:42.188 INFO:tasks.workunit.client.0.smithi042.stdout:1/699: rmdir d4/d15/d19/d42/d51/db5 39 2024-09-19T09:41:42.188 INFO:tasks.workunit.client.0.smithi042.stdout:1/700: fdatasync d4/d15/d2e/db7/f72 0 2024-09-19T09:41:42.189 INFO:tasks.workunit.client.0.smithi042.stdout:7/577: dread d0/f38 [0,4194304] 0 2024-09-19T09:41:42.190 INFO:tasks.workunit.client.0.smithi042.stdout:6/640: link d1/de/d76/d99/db2/d34/d6f/c7d d1/de/d12/cb9 0 2024-09-19T09:41:42.190 INFO:tasks.workunit.client.0.smithi042.stdout:6/641: readlink d1/d20/d6a/d46/d92/l2b 0 2024-09-19T09:41:42.191 INFO:tasks.workunit.client.0.smithi042.stdout:8/716: dwrite d1/da8/d3d/f6c [0,4194304] 0 2024-09-19T09:41:42.191 INFO:tasks.workunit.client.0.smithi042.stdout:0/614: dwrite d2/d8e/f4c [0,4194304] 0 2024-09-19T09:41:42.191 INFO:tasks.workunit.client.0.smithi042.stdout:9/516: symlink d8/d1d/d28/l98 0 2024-09-19T09:41:42.193 INFO:tasks.workunit.client.0.smithi042.stdout:3/674: creat d4/d8/d9/dc/dbf/fdd x:0 0 0 2024-09-19T09:41:42.195 INFO:tasks.workunit.client.0.smithi042.stdout:1/701: write d4/d15/d19/d45/f4d [337550,56307] 0 2024-09-19T09:41:42.196 INFO:tasks.workunit.client.0.smithi042.stdout:1/702: chown d4/d15/d2e/db7/f98 18596 1 2024-09-19T09:41:42.197 INFO:tasks.workunit.client.0.smithi042.stdout:4/649: dread d0/f71 [0,4194304] 0 2024-09-19T09:41:42.197 INFO:tasks.workunit.client.0.smithi042.stdout:4/650: write d0/f92 [110578,113275] 0 2024-09-19T09:41:42.197 INFO:tasks.workunit.client.0.smithi042.stdout:0/615: fdatasync d2/d8e/d32/f83 0 2024-09-19T09:41:42.198 INFO:tasks.workunit.client.0.smithi042.stdout:7/578: creat d0/d3d/d85/d99/fb8 x:0 0 0 2024-09-19T09:41:42.198 INFO:tasks.workunit.client.0.smithi042.stdout:6/642: creat d1/de/d54/d81/fba x:0 0 0 2024-09-19T09:41:42.203 INFO:tasks.workunit.client.0.smithi042.stdout:0/616: mkdir d2/d10/d12/d24/dbd 0 2024-09-19T09:41:42.204 INFO:tasks.workunit.client.0.smithi042.stdout:8/717: mkdir d1/da8/d3d/d58/dd1 0 2024-09-19T09:41:42.205 INFO:tasks.workunit.client.0.smithi042.stdout:3/675: symlink d4/d8/d9/d1b/d4f/d9c/lde 0 2024-09-19T09:41:42.206 INFO:tasks.workunit.client.0.smithi042.stdout:4/651: creat d0/d28/d87/fde x:0 0 0 2024-09-19T09:41:42.209 INFO:tasks.workunit.client.0.smithi042.stdout:7/579: unlink d0/d3d/l4d 0 2024-09-19T09:41:42.209 INFO:tasks.workunit.client.0.smithi042.stdout:7/580: stat d0/d14/c69 0 2024-09-19T09:41:42.209 INFO:tasks.workunit.client.0.smithi042.stdout:4/652: dread d0/d1b/d1c/d2e/f50 [0,4194304] 0 2024-09-19T09:41:42.209 INFO:tasks.workunit.client.0.smithi042.stdout:4/653: read - d0/d1b/d1c/d2e/d3f/fd9 zero size 2024-09-19T09:41:42.209 INFO:tasks.workunit.client.0.smithi042.stdout:9/517: dwrite d8/f1a [0,4194304] 0 2024-09-19T09:41:42.211 INFO:tasks.workunit.client.0.smithi042.stdout:6/643: unlink d1/de/d54/d81/fba 0 2024-09-19T09:41:42.213 INFO:tasks.workunit.client.0.smithi042.stdout:8/718: dread d1/da8/d41/d55/fc5 [0,4194304] 0 2024-09-19T09:41:42.215 INFO:tasks.workunit.client.0.smithi042.stdout:0/617: mknod d2/d8e/d32/d64/da5/d8a/cbe 0 2024-09-19T09:41:42.224 INFO:tasks.workunit.client.0.smithi042.stdout:7/581: dwrite d0/d14/d3a/f8a [0,4194304] 0 2024-09-19T09:41:42.224 INFO:tasks.workunit.client.0.smithi042.stdout:7/582: fdatasync d0/d56/d5c/f97 0 2024-09-19T09:41:42.225 INFO:tasks.workunit.client.0.smithi042.stdout:2/613: rename d7/dd/d14/d35/d6b to d7/dd/d14/d35/d4c/d61/d87/dbf/dc7 0 2024-09-19T09:41:42.232 INFO:tasks.workunit.client.0.smithi042.stdout:3/676: mknod d4/d8/d9/dc/dbf/d5c/d82/cdf 0 2024-09-19T09:41:42.232 INFO:tasks.workunit.client.0.smithi042.stdout:3/677: write d4/d8/d9/dc/dbf/d5c/d82/d48/fad [452037,4968] 0 2024-09-19T09:41:42.234 INFO:tasks.workunit.client.0.smithi042.stdout:9/518: symlink d8/db/l99 0 2024-09-19T09:41:42.234 INFO:tasks.workunit.client.0.smithi042.stdout:9/519: fsync d8/da/d19/d1c/d21/d7f/f5a 0 2024-09-19T09:41:42.234 INFO:tasks.workunit.client.0.smithi042.stdout:9/520: chown d8/da 20640864 1 2024-09-19T09:41:42.234 INFO:tasks.workunit.client.0.smithi042.stdout:6/644: truncate d1/de/d54/fa1 3416593 0 2024-09-19T09:41:42.235 INFO:tasks.workunit.client.0.smithi042.stdout:6/645: chown d1/l51 2 1 2024-09-19T09:41:42.237 INFO:tasks.workunit.client.0.smithi042.stdout:0/618: dwrite d2/d8e/d32/d64/da5/f47 [0,4194304] 0 2024-09-19T09:41:42.239 INFO:tasks.workunit.client.0.smithi042.stdout:2/614: mknod d7/dd/d14/d35/d4c/cc8 0 2024-09-19T09:41:42.240 INFO:tasks.workunit.client.0.smithi042.stdout:4/654: dread d0/d1b/f32 [0,4194304] 0 2024-09-19T09:41:42.241 INFO:tasks.workunit.client.0.smithi042.stdout:8/719: read d1/d2e/f51 [1820990,84219] 0 2024-09-19T09:41:42.243 INFO:tasks.workunit.client.0.smithi042.stdout:2/615: rmdir d7/dd/d14/d35/d4c/d61/d87 39 2024-09-19T09:41:42.245 INFO:tasks.workunit.client.0.smithi042.stdout:8/720: write d1/da/dd/f88 [2805969,105062] 0 2024-09-19T09:41:42.246 INFO:tasks.workunit.client.0.smithi042.stdout:2/616: creat d7/dd/d22/d30/d66/fc9 x:0 0 0 2024-09-19T09:41:42.247 INFO:tasks.workunit.client.0.smithi042.stdout:2/617: mknod d7/dd/d14/d35/d4e/d63/cca 0 2024-09-19T09:41:42.247 INFO:tasks.workunit.client.0.smithi042.stdout:2/618: chown d7/dd/d22/d30/f34 15515 1 2024-09-19T09:41:42.247 INFO:tasks.workunit.client.0.smithi042.stdout:2/619: link d7/dd/d22/f32 d7/dd/d14/d35/d4c/fcb 0 2024-09-19T09:41:42.250 INFO:tasks.workunit.client.0.smithi042.stdout:7/583: dwrite d0/d14/d3a/f3e [0,4194304] 0 2024-09-19T09:41:42.250 INFO:tasks.workunit.client.0.smithi042.stdout:2/620: rmdir d7/dd/d14/d35/d4c/d61/d87/dbf/dc5 0 2024-09-19T09:41:42.250 INFO:tasks.workunit.client.0.smithi042.stdout:2/621: chown d7/dd/d48/d96/cb0 1 1 2024-09-19T09:41:42.250 INFO:tasks.workunit.client.0.smithi042.stdout:2/622: write d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/f95 [2650847,24404] 0 2024-09-19T09:41:42.251 INFO:tasks.workunit.client.0.smithi042.stdout:2/623: symlink d7/dd/d14/d35/d4c/d61/d87/dbf/lcc 0 2024-09-19T09:41:42.252 INFO:tasks.workunit.client.0.smithi042.stdout:4/655: dread d0/d1b/f41 [0,4194304] 0 2024-09-19T09:41:42.260 INFO:tasks.workunit.client.0.smithi042.stdout:0/619: dwrite d2/d8e/d32/d64/da5/d52/f55 [0,4194304] 0 2024-09-19T09:41:42.260 INFO:tasks.workunit.client.0.smithi042.stdout:2/624: write d7/dd/d22/d30/f34 [3260122,98433] 0 2024-09-19T09:41:42.260 INFO:tasks.workunit.client.0.smithi042.stdout:2/625: fdatasync d7/dd/d48/fab 0 2024-09-19T09:41:42.260 INFO:tasks.workunit.client.0.smithi042.stdout:2/626: chown d7/dd/d1f/d3f/f69 61 1 2024-09-19T09:41:42.261 INFO:tasks.workunit.client.0.smithi042.stdout:2/627: symlink d7/dd/d14/d35/d4c/d70/lcd 0 2024-09-19T09:41:42.261 INFO:tasks.workunit.client.0.smithi042.stdout:2/628: dread - d7/dd/d14/d35/d4e/d9c/f99 zero size 2024-09-19T09:41:42.261 INFO:tasks.workunit.client.0.smithi042.stdout:2/629: read - d7/dd/d14/d35/d4e/d9c/fb1 zero size 2024-09-19T09:41:42.263 INFO:tasks.workunit.client.0.smithi042.stdout:2/630: creat d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/da8/fce x:0 0 0 2024-09-19T09:41:42.263 INFO:tasks.workunit.client.0.smithi042.stdout:0/620: unlink d2/d10/d12/d24/l61 0 2024-09-19T09:41:42.263 INFO:tasks.workunit.client.0.smithi042.stdout:0/621: chown d2/d8e/d32/d64/da5/d8a/d9d/l5c 1040125 1 2024-09-19T09:41:42.265 INFO:tasks.workunit.client.0.smithi042.stdout:2/631: dread d7/f98 [0,4194304] 0 2024-09-19T09:41:42.265 INFO:tasks.workunit.client.0.smithi042.stdout:2/632: write d7/dd/d14/d35/d4c/fcb [437302,15223] 0 2024-09-19T09:41:42.267 INFO:tasks.workunit.client.0.smithi042.stdout:2/633: mknod d7/dd/d22/ccf 0 2024-09-19T09:41:42.276 INFO:tasks.workunit.client.0.smithi042.stdout:8/721: dwrite d1/da8/d41/f57 [8388608,4194304] 0 2024-09-19T09:41:42.279 INFO:tasks.workunit.client.0.smithi042.stdout:4/656: dwrite d0/d28/fa9 [0,4194304] 0 2024-09-19T09:41:42.281 INFO:tasks.workunit.client.0.smithi042.stdout:5/643: rename d2/db/d42 to d2/d4/d64/da7/dda/de6 0 2024-09-19T09:41:42.281 INFO:tasks.workunit.client.0.smithi042.stdout:5/644: chown d2/d4/d64/da7 164525 1 2024-09-19T09:41:42.281 INFO:tasks.workunit.client.0.smithi042.stdout:4/657: symlink d0/d1b/d1c/d2e/d3b/d95/db1/dba/dbd/ldf 0 2024-09-19T09:41:42.283 INFO:tasks.workunit.client.0.smithi042.stdout:3/678: rename d4/d8/d9/d39/d4b/f68 to d4/d8/d9/d39/d4b/d7d/fe0 0 2024-09-19T09:41:42.284 INFO:tasks.workunit.client.0.smithi042.stdout:5/645: truncate d2/d4/d20/d60/d72/fd1 959602 0 2024-09-19T09:41:42.284 INFO:tasks.workunit.client.0.smithi042.stdout:5/646: chown d2/d25/d37/f63 1143763 1 2024-09-19T09:41:42.285 INFO:tasks.workunit.client.0.smithi042.stdout:2/634: dwrite d7/f9 [0,4194304] 0 2024-09-19T09:41:42.285 INFO:tasks.workunit.client.0.smithi042.stdout:4/658: creat d0/d1b/d1c/d2e/d3f/d6b/fe0 x:0 0 0 2024-09-19T09:41:42.285 INFO:tasks.workunit.client.0.smithi042.stdout:9/521: rename d8/db/f7e to d8/da/d19/d1c/d21/d7f/f9a 0 2024-09-19T09:41:42.286 INFO:tasks.workunit.client.0.smithi042.stdout:3/679: creat d4/d8/d9/dc/fe1 x:0 0 0 2024-09-19T09:41:42.289 INFO:tasks.workunit.client.0.smithi042.stdout:5/647: rmdir d2/d4/d20/d60 39 2024-09-19T09:41:42.290 INFO:tasks.workunit.client.0.smithi042.stdout:4/659: mkdir d0/d1b/d56/de1 0 2024-09-19T09:41:42.290 INFO:tasks.workunit.client.0.smithi042.stdout:8/722: dwrite d1/da8/d3d/d58/faa [0,4194304] 0 2024-09-19T09:41:42.293 INFO:tasks.workunit.client.0.smithi042.stdout:7/584: rename d0/d3d/l45 to d0/d14/d3c/lb9 0 2024-09-19T09:41:42.293 INFO:tasks.workunit.client.0.smithi042.stdout:7/585: truncate d0/d3d/d55/d72/f8c 549352 0 2024-09-19T09:41:42.293 INFO:tasks.workunit.client.0.smithi042.stdout:9/522: symlink d8/d32/l9b 0 2024-09-19T09:41:42.294 INFO:tasks.workunit.client.0.smithi042.stdout:2/635: rmdir d7/dd/d14/d35/d4e 39 2024-09-19T09:41:42.294 INFO:tasks.workunit.client.0.smithi042.stdout:2/636: readlink d7/dd/l20 0 2024-09-19T09:41:42.295 INFO:tasks.workunit.client.0.smithi042.stdout:5/648: creat d2/d4/fe7 x:0 0 0 2024-09-19T09:41:42.302 INFO:tasks.workunit.client.0.smithi042.stdout:0/622: rename d2/d8e/d32/d64/da5/d52/fad to d2/d8e/d32/d64/da5/d8a/d9d/d5a/d8f/db5/fbf 0 2024-09-19T09:41:42.302 INFO:tasks.workunit.client.0.smithi042.stdout:0/623: fsync d2/d10/d12/f31 0 2024-09-19T09:41:42.303 INFO:tasks.workunit.client.0.smithi042.stdout:7/586: mknod d0/d14/d3c/cba 0 2024-09-19T09:41:42.303 INFO:tasks.workunit.client.0.smithi042.stdout:2/637: write d7/dd/d14/d35/d4e/f65 [2929598,18013] 0 2024-09-19T09:41:42.304 INFO:tasks.workunit.client.0.smithi042.stdout:2/638: fdatasync d7/dd/d14/d35/d4c/d61/fa2 0 2024-09-19T09:41:42.304 INFO:tasks.workunit.client.0.smithi042.stdout:3/680: dread d4/d8/f9a [0,4194304] 0 2024-09-19T09:41:42.305 INFO:tasks.workunit.client.0.smithi042.stdout:2/639: dread d7/f6a [0,4194304] 0 2024-09-19T09:41:42.305 INFO:tasks.workunit.client.0.smithi042.stdout:2/640: stat d7/dd/d14/d35/d4e/d9c/caa 0 2024-09-19T09:41:42.305 INFO:tasks.workunit.client.0.smithi042.stdout:0/624: rmdir d2/d10/d12/d16/d57/d78/db3 39 2024-09-19T09:41:42.305 INFO:tasks.workunit.client.0.smithi042.stdout:7/587: mkdir d0/d3d/d55/d72/db6/dbb 0 2024-09-19T09:41:42.306 INFO:tasks.workunit.client.0.smithi042.stdout:2/641: write d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/da8/fac [286581,119963] 0 2024-09-19T09:41:42.307 INFO:tasks.workunit.client.0.smithi042.stdout:7/588: mknod d0/d3d/d85/d99/cbc 0 2024-09-19T09:41:42.307 INFO:tasks.workunit.client.0.smithi042.stdout:7/589: chown d0/d14 535621 1 2024-09-19T09:41:42.308 INFO:tasks.workunit.client.0.smithi042.stdout:7/590: rmdir d0 39 2024-09-19T09:41:42.308 INFO:tasks.workunit.client.0.smithi042.stdout:7/591: chown d0/d3d/d92/f95 13090169 1 2024-09-19T09:41:42.308 INFO:tasks.workunit.client.0.smithi042.stdout:7/592: dread - d0/d3d/d85/fa6 zero size 2024-09-19T09:41:42.308 INFO:tasks.workunit.client.0.smithi042.stdout:0/625: mkdir d2/d10/d12/d24/dc0 0 2024-09-19T09:41:42.309 INFO:tasks.workunit.client.0.smithi042.stdout:7/593: rename d0/d3d/d55/l57 to d0/d3d/d55/d72/lbd 0 2024-09-19T09:41:42.310 INFO:tasks.workunit.client.0.smithi042.stdout:7/594: creat d0/fbe x:0 0 0 2024-09-19T09:41:42.316 INFO:tasks.workunit.client.0.smithi042.stdout:4/660: dwrite d0/f19 [4194304,4194304] 0 2024-09-19T09:41:42.316 INFO:tasks.workunit.client.0.smithi042.stdout:4/661: chown d0/d1b/d56/lcb 220663 1 2024-09-19T09:41:42.317 INFO:tasks.workunit.client.0.smithi042.stdout:9/523: dwrite d8/d1d/d28/f43 [0,4194304] 0 2024-09-19T09:41:42.317 INFO:tasks.workunit.client.0.smithi042.stdout:8/723: dwrite d1/da/f5a [0,4194304] 0 2024-09-19T09:41:42.318 INFO:tasks.workunit.client.0.smithi042.stdout:4/662: creat d0/d1b/d1c/d61/d7f/fe2 x:0 0 0 2024-09-19T09:41:42.318 INFO:tasks.workunit.client.0.smithi042.stdout:4/663: write d0/d1b/d1c/d2e/d3f/d6b/fd5 [771977,44605] 0 2024-09-19T09:41:42.321 INFO:tasks.workunit.client.0.smithi042.stdout:2/642: dread d7/dd/d14/f1d [0,4194304] 0 2024-09-19T09:41:42.321 INFO:tasks.workunit.client.0.smithi042.stdout:0/626: dread d2/d8e/d32/d64/da5/d52/f55 [0,4194304] 0 2024-09-19T09:41:42.321 INFO:tasks.workunit.client.0.smithi042.stdout:0/627: write d2/d8e/d32/d64/da5/d8a/d9d/d5a/d8f/db5/fbf [672289,113419] 0 2024-09-19T09:41:42.322 INFO:tasks.workunit.client.0.smithi042.stdout:8/724: dread d1/da8/d41/fb5 [0,4194304] 0 2024-09-19T09:41:42.322 INFO:tasks.workunit.client.0.smithi042.stdout:8/725: chown d1/da 15 1 2024-09-19T09:41:42.322 INFO:tasks.workunit.client.0.smithi042.stdout:8/726: chown d1/da/dd/f49 625 1 2024-09-19T09:41:42.322 INFO:tasks.workunit.client.0.smithi042.stdout:4/664: creat d0/d1b/d1c/d61/d7f/fe3 x:0 0 0 2024-09-19T09:41:42.323 INFO:tasks.workunit.client.0.smithi042.stdout:2/643: symlink d7/dd/d48/d96/ld0 0 2024-09-19T09:41:42.325 INFO:tasks.workunit.client.0.smithi042.stdout:8/727: symlink d1/db2/ld2 0 2024-09-19T09:41:42.325 INFO:tasks.workunit.client.0.smithi042.stdout:9/524: dread d8/f11 [4194304,4194304] 0 2024-09-19T09:41:42.327 INFO:tasks.workunit.client.0.smithi042.stdout:2/644: link d7/dd/d48/d96/fa5 d7/dd/d14/d35/d4c/d61/d87/fd1 0 2024-09-19T09:41:42.327 INFO:tasks.workunit.client.0.smithi042.stdout:2/645: write d7/dd/d14/d35/d4c/d61/f8a [1212459,99987] 0 2024-09-19T09:41:42.327 INFO:tasks.workunit.client.0.smithi042.stdout:2/646: write d7/dd/d14/d35/d4e/d9c/f99 [897751,122716] 0 2024-09-19T09:41:42.327 INFO:tasks.workunit.client.0.smithi042.stdout:8/728: truncate d1/da/dd/f5c 2399889 0 2024-09-19T09:41:42.329 INFO:tasks.workunit.client.0.smithi042.stdout:9/525: truncate d8/d1d/f1f 1445411 0 2024-09-19T09:41:42.329 INFO:tasks.workunit.client.0.smithi042.stdout:1/703: sync 2024-09-19T09:41:42.329 INFO:tasks.workunit.client.0.smithi042.stdout:8/729: rmdir d1/da/d3f 39 2024-09-19T09:41:42.332 INFO:tasks.workunit.client.0.smithi042.stdout:9/526: rename d8/d1d/d28/l98 to d8/d1d/d28/l9c 0 2024-09-19T09:41:42.334 INFO:tasks.workunit.client.0.smithi042.stdout:1/704: rename d4/d15/d19/d42/d51/db5/dda/l80 to d4/d15/le2 0 2024-09-19T09:41:42.334 INFO:tasks.workunit.client.0.smithi042.stdout:1/705: chown d4/d12/d8d/d91/d7f/lbb 304993 1 2024-09-19T09:41:42.335 INFO:tasks.workunit.client.0.smithi042.stdout:8/730: unlink d1/da8/d41/d55/l81 0 2024-09-19T09:41:42.336 INFO:tasks.workunit.client.0.smithi042.stdout:1/706: mkdir d4/d12/d8d/de3 0 2024-09-19T09:41:42.337 INFO:tasks.workunit.client.0.smithi042.stdout:8/731: symlink d1/da8/d3d/d95/ld3 0 2024-09-19T09:41:42.337 INFO:tasks.workunit.client.0.smithi042.stdout:8/732: dread - d1/da/d3f/f98 zero size 2024-09-19T09:41:42.338 INFO:tasks.workunit.client.0.smithi042.stdout:1/707: symlink d4/d12/le4 0 2024-09-19T09:41:42.338 INFO:tasks.workunit.client.0.smithi042.stdout:1/708: write d4/d15/d19/fe [3862294,85640] 0 2024-09-19T09:41:42.338 INFO:tasks.workunit.client.0.smithi042.stdout:1/709: write d4/d15/d2e/fa4 [284293,79672] 0 2024-09-19T09:41:42.339 INFO:tasks.workunit.client.0.smithi042.stdout:8/733: creat d1/db2/fd4 x:0 0 0 2024-09-19T09:41:42.340 INFO:tasks.workunit.client.0.smithi042.stdout:2/647: dread d7/dd/d14/d35/d4e/f97 [0,4194304] 0 2024-09-19T09:41:42.341 INFO:tasks.workunit.client.0.smithi042.stdout:4/665: dread d0/d1b/d1c/f25 [0,4194304] 0 2024-09-19T09:41:42.341 INFO:tasks.workunit.client.0.smithi042.stdout:0/628: write d2/fe [226345,95837] 0 2024-09-19T09:41:42.341 INFO:tasks.workunit.client.0.smithi042.stdout:4/666: chown d0/d1b/d1c/d2e/d44/c8b 60639083 1 2024-09-19T09:41:42.342 INFO:tasks.workunit.client.0.smithi042.stdout:8/734: rename d1/da/dd/c9f to d1/da/dd/dac/cd5 0 2024-09-19T09:41:42.342 INFO:tasks.workunit.client.0.smithi042.stdout:8/735: fdatasync d1/da/d14/f17 0 2024-09-19T09:41:42.342 INFO:tasks.workunit.client.0.smithi042.stdout:8/736: getdents d1/da/dd/d74/dbc/dc8 0 2024-09-19T09:41:42.343 INFO:tasks.workunit.client.0.smithi042.stdout:1/710: dread d4/f7b [0,4194304] 0 2024-09-19T09:41:42.344 INFO:tasks.workunit.client.0.smithi042.stdout:4/667: creat d0/d1b/d1c/db8/fe4 x:0 0 0 2024-09-19T09:41:42.344 INFO:tasks.workunit.client.0.smithi042.stdout:3/681: dwrite d4/d8/d9/dc/dbf/d5c/f94 [0,4194304] 0 2024-09-19T09:41:42.344 INFO:tasks.workunit.client.0.smithi042.stdout:5/649: dwrite d2/db/faf [0,4194304] 0 2024-09-19T09:41:42.344 INFO:tasks.workunit.client.0.smithi042.stdout:7/595: dwrite d0/f1a [0,4194304] 0 2024-09-19T09:41:42.344 INFO:tasks.workunit.client.0.smithi042.stdout:7/596: fdatasync d0/d3d/f4a 0 2024-09-19T09:41:42.345 INFO:tasks.workunit.client.0.smithi042.stdout:0/629: creat d2/d8e/d32/d64/da5/d8a/d9d/d5a/d85/da6/fc1 x:0 0 0 2024-09-19T09:41:42.346 INFO:tasks.workunit.client.0.smithi042.stdout:8/737: creat d1/da8/db1/dcb/fd6 x:0 0 0 2024-09-19T09:41:42.349 INFO:tasks.workunit.client.0.smithi042.stdout:7/597: fsync d0/fbe 0 2024-09-19T09:41:42.350 INFO:tasks.workunit.client.0.smithi042.stdout:4/668: symlink d0/d1b/d1c/d2e/d3b/d95/db1/dba/dbd/le5 0 2024-09-19T09:41:42.350 INFO:tasks.workunit.client.0.smithi042.stdout:4/669: read - d0/d1b/d1c/d2e/d3b/fdc zero size 2024-09-19T09:41:42.352 INFO:tasks.workunit.client.0.smithi042.stdout:1/711: dread d4/d1e/f1f [0,4194304] 0 2024-09-19T09:41:42.354 INFO:tasks.workunit.client.0.smithi042.stdout:9/527: dwrite d8/db/d31/f97 [0,4194304] 0 2024-09-19T09:41:42.354 INFO:tasks.workunit.client.0.smithi042.stdout:0/630: write d2/d10/d6b/f77 [771097,17247] 0 2024-09-19T09:41:42.364 INFO:tasks.workunit.client.0.smithi042.stdout:8/738: mkdir d1/d2e/dd7 0 2024-09-19T09:41:42.365 INFO:tasks.workunit.client.0.smithi042.stdout:7/598: creat d0/fbf x:0 0 0 2024-09-19T09:41:42.367 INFO:tasks.workunit.client.0.smithi042.stdout:2/648: dwrite d7/dd/d14/d35/d45/d5e/d79/fb6 [0,4194304] 0 2024-09-19T09:41:42.367 INFO:tasks.workunit.client.0.smithi042.stdout:1/712: unlink d4/d12/faa 0 2024-09-19T09:41:42.369 INFO:tasks.workunit.client.0.smithi042.stdout:3/682: dwrite d4/d8/d9/dc/dbf/d5c/d82/d48/da5/fb4 [0,4194304] 0 2024-09-19T09:41:42.369 INFO:tasks.workunit.client.0.smithi042.stdout:3/683: write d4/d8/d9/dc/dbf/d5c/d82/f1a [1648632,57072] 0 2024-09-19T09:41:42.372 INFO:tasks.workunit.client.0.smithi042.stdout:2/649: truncate d7/dd/d14/d35/d45/d5e/f39 1305062 0 2024-09-19T09:41:42.372 INFO:tasks.workunit.client.0.smithi042.stdout:7/599: dread d0/f23 [0,4194304] 0 2024-09-19T09:41:42.375 INFO:tasks.workunit.client.0.smithi042.stdout:7/600: mknod d0/d3d/db0/cc0 0 2024-09-19T09:41:42.380 INFO:tasks.workunit.client.0.smithi042.stdout:5/650: write d2/db/f7d [442634,108764] 0 2024-09-19T09:41:42.380 INFO:tasks.workunit.client.0.smithi042.stdout:0/631: dwrite d2/d10/d1e/f6c [0,4194304] 0 2024-09-19T09:41:42.380 INFO:tasks.workunit.client.0.smithi042.stdout:5/651: write d2/d4/fe7 [351409,122851] 0 2024-09-19T09:41:42.380 INFO:tasks.workunit.client.0.smithi042.stdout:5/652: chown d2/d4/d20/da4/de2 8847 1 2024-09-19T09:41:42.380 INFO:tasks.workunit.client.0.smithi042.stdout:0/632: write d2/d8e/d32/d64/da5/d8a/d9d/d5a/d8f/db5/fbf [1386034,21327] 0 2024-09-19T09:41:42.383 INFO:tasks.workunit.client.0.smithi042.stdout:5/653: truncate d2/db/f10 742066 0 2024-09-19T09:41:42.384 INFO:tasks.workunit.client.0.smithi042.stdout:5/654: mkdir d2/d4/de8 0 2024-09-19T09:41:42.384 INFO:tasks.workunit.client.0.smithi042.stdout:5/655: getdents d2/de3 0 2024-09-19T09:41:42.384 INFO:tasks.workunit.client.0.smithi042.stdout:5/656: fsync d2/d4/d64/da7/dda/de6/fd4 0 2024-09-19T09:41:42.386 INFO:tasks.workunit.client.0.smithi042.stdout:9/528: dwrite d8/d1d/f3f [0,4194304] 0 2024-09-19T09:41:42.387 INFO:tasks.workunit.client.0.smithi042.stdout:9/529: creat d8/d1d/d28/f9d x:0 0 0 2024-09-19T09:41:42.392 INFO:tasks.workunit.client.0.smithi042.stdout:9/530: creat d8/da/d19/d1c/f9e x:0 0 0 2024-09-19T09:41:42.393 INFO:tasks.workunit.client.0.smithi042.stdout:4/670: dwrite d0/d1b/d1c/fdb [0,4194304] 0 2024-09-19T09:41:42.393 INFO:tasks.workunit.client.0.smithi042.stdout:4/671: chown d0/d1b/d1c/d2e/d44/cda 9 1 2024-09-19T09:41:42.396 INFO:tasks.workunit.client.0.smithi042.stdout:4/672: mkdir d0/d1b/d1c/d2e/d3b/d95/db1/dba/dbd/de6 0 2024-09-19T09:41:42.397 INFO:tasks.workunit.client.0.smithi042.stdout:6/646: sync 2024-09-19T09:41:42.399 INFO:tasks.workunit.client.0.smithi042.stdout:6/647: creat d1/fbb x:0 0 0 2024-09-19T09:41:42.404 INFO:tasks.workunit.client.0.smithi042.stdout:2/650: link d7/dd/d22/c29 d7/dd/d14/d35/d4c/d70/cd2 0 2024-09-19T09:41:42.404 INFO:tasks.workunit.client.0.smithi042.stdout:2/651: chown d7/dd/d48/fa7 152056307 1 2024-09-19T09:41:42.405 INFO:tasks.workunit.client.0.smithi042.stdout:2/652: truncate d7/dd/d14/f7f 152240 0 2024-09-19T09:41:42.406 INFO:tasks.workunit.client.0.smithi042.stdout:2/653: write d7/dd/d22/f24 [802539,96924] 0 2024-09-19T09:41:42.408 INFO:tasks.workunit.client.0.smithi042.stdout:2/654: link d7/dd/d22/ccf d7/d9b/db9/cd3 0 2024-09-19T09:41:42.409 INFO:tasks.workunit.client.0.smithi042.stdout:5/657: dwrite d2/d4/fe7 [0,4194304] 0 2024-09-19T09:41:42.410 INFO:tasks.workunit.client.0.smithi042.stdout:2/655: creat d7/dd/d14/d35/d4c/d61/d87/dbf/fd4 x:0 0 0 2024-09-19T09:41:42.411 INFO:tasks.workunit.client.0.smithi042.stdout:6/648: dread d1/de/d76/d99/db2/d34/d6f/d4a/f83 [0,4194304] 0 2024-09-19T09:41:42.411 INFO:tasks.workunit.client.0.smithi042.stdout:6/649: fsync d1/d20/d6a/d46/d92/d4f/f66 0 2024-09-19T09:41:42.411 INFO:tasks.workunit.client.0.smithi042.stdout:2/656: mknod d7/dd/d22/d30/cd5 0 2024-09-19T09:41:42.412 INFO:tasks.workunit.client.0.smithi042.stdout:2/657: mkdir d7/dd/d14/d35/d4e/d63/dd6 0 2024-09-19T09:41:42.416 INFO:tasks.workunit.client.0.smithi042.stdout:3/684: dwrite d4/d8/d9/d39/d4b/d7d/fe0 [0,4194304] 0 2024-09-19T09:41:42.416 INFO:tasks.workunit.client.0.smithi042.stdout:3/685: truncate d4/d8/d4c/f81 817625 0 2024-09-19T09:41:42.418 INFO:tasks.workunit.client.0.smithi042.stdout:3/686: rename d4/d8/d9/dc/dbf/d6d/d8f/fb3 to d4/d8/d9/dc/dbf/d5c/d82/fe2 0 2024-09-19T09:41:42.418 INFO:tasks.workunit.client.0.smithi042.stdout:8/739: dwrite d1/d2e/f60 [0,4194304] 0 2024-09-19T09:41:42.419 INFO:tasks.workunit.client.0.smithi042.stdout:7/601: dwrite d0/d3d/d92/da1/f91 [0,4194304] 0 2024-09-19T09:41:42.419 INFO:tasks.workunit.client.0.smithi042.stdout:1/713: dwrite d4/d1e/d25/f33 [0,4194304] 0 2024-09-19T09:41:42.421 INFO:tasks.workunit.client.0.smithi042.stdout:3/687: creat d4/d8/d4c/fe3 x:0 0 0 2024-09-19T09:41:42.421 INFO:tasks.workunit.client.0.smithi042.stdout:3/688: truncate d4/d8/d9/d1b/d4f/f77 4571293 0 2024-09-19T09:41:42.421 INFO:tasks.workunit.client.0.smithi042.stdout:3/689: write d4/d8/d9/dc/dbf/d5c/d82/d48/fdc [878744,116842] 0 2024-09-19T09:41:42.424 INFO:tasks.workunit.client.0.smithi042.stdout:8/740: creat d1/da/d3f/fd8 x:0 0 0 2024-09-19T09:41:42.424 INFO:tasks.workunit.client.0.smithi042.stdout:8/741: truncate d1/da/d14/f1a 3645067 0 2024-09-19T09:41:42.424 INFO:tasks.workunit.client.0.smithi042.stdout:8/742: chown d1/da8/f54 5 1 2024-09-19T09:41:42.425 INFO:tasks.workunit.client.0.smithi042.stdout:4/673: dread d0/d1b/d1c/d2e/d3f/d6b/fd5 [0,4194304] 0 2024-09-19T09:41:42.425 INFO:tasks.workunit.client.0.smithi042.stdout:4/674: stat d0/f6c 0 2024-09-19T09:41:42.425 INFO:tasks.workunit.client.0.smithi042.stdout:4/675: write d0/d1b/d1c/fb4 [893946,45004] 0 2024-09-19T09:41:42.425 INFO:tasks.workunit.client.0.smithi042.stdout:4/676: dread - d0/d1b/d1c/d61/d7f/d83/faf zero size 2024-09-19T09:41:42.425 INFO:tasks.workunit.client.0.smithi042.stdout:4/677: truncate d0/d1b/d1c/d2e/d3f/fd9 758097 0 2024-09-19T09:41:42.429 INFO:tasks.workunit.client.0.smithi042.stdout:8/743: dread d1/da/d3f/f67 [0,4194304] 0 2024-09-19T09:41:42.430 INFO:tasks.workunit.client.0.smithi042.stdout:4/678: dread d0/d1b/d1c/d2e/d3b/f53 [0,4194304] 0 2024-09-19T09:41:42.430 INFO:tasks.workunit.client.0.smithi042.stdout:4/679: chown d0/d1b/d1c/d2e/l31 93663 1 2024-09-19T09:41:42.431 INFO:tasks.workunit.client.0.smithi042.stdout:5/658: dwrite d2/f1e [0,4194304] 0 2024-09-19T09:41:42.431 INFO:tasks.workunit.client.0.smithi042.stdout:2/658: write d7/dd/d48/f5a [3339716,85297] 0 2024-09-19T09:41:42.431 INFO:tasks.workunit.client.0.smithi042.stdout:0/633: dwrite d2/d10/d1e/f6f [0,4194304] 0 2024-09-19T09:41:42.431 INFO:tasks.workunit.client.0.smithi042.stdout:5/659: getdents d2/d4/d20/dc0 0 2024-09-19T09:41:42.431 INFO:tasks.workunit.client.0.smithi042.stdout:5/660: fsync d2/d4/d20/d60/d72/fd1 0 2024-09-19T09:41:42.434 INFO:tasks.workunit.client.0.smithi042.stdout:2/659: creat d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/fd7 x:0 0 0 2024-09-19T09:41:42.435 INFO:tasks.workunit.client.0.smithi042.stdout:1/714: truncate d4/f22 3935326 0 2024-09-19T09:41:42.435 INFO:tasks.workunit.client.0.smithi042.stdout:1/715: readlink d4/d15/le2 0 2024-09-19T09:41:42.437 INFO:tasks.workunit.client.0.smithi042.stdout:3/690: rmdir d4/d8/d9/dc/dbf/d35 39 2024-09-19T09:41:42.437 INFO:tasks.workunit.client.0.smithi042.stdout:3/691: chown d4/d8/d4c 873 1 2024-09-19T09:41:42.438 INFO:tasks.workunit.client.0.smithi042.stdout:6/650: dwrite d1/d20/d6a/d90/f3b [0,4194304] 0 2024-09-19T09:41:42.439 INFO:tasks.workunit.client.0.smithi042.stdout:8/744: symlink d1/db2/ld9 0 2024-09-19T09:41:42.443 INFO:tasks.workunit.client.0.smithi042.stdout:3/692: write d4/d8/d4c/d6b/fce [1691731,21968] 0 2024-09-19T09:41:42.443 INFO:tasks.workunit.client.0.smithi042.stdout:3/693: write d4/d8/d9/d1b/d4f/fa9 [647511,130016] 0 2024-09-19T09:41:42.443 INFO:tasks.workunit.client.0.smithi042.stdout:3/694: chown d4/d8/d9/d39/d4b 888422 1 2024-09-19T09:41:42.445 INFO:tasks.workunit.client.0.smithi042.stdout:0/634: truncate d2/d8e/d32/d64/da5/f47 1925794 0 2024-09-19T09:41:42.445 INFO:tasks.workunit.client.0.smithi042.stdout:0/635: truncate d2/d10/d1d/f59 1219783 0 2024-09-19T09:41:42.445 INFO:tasks.workunit.client.0.smithi042.stdout:5/661: mknod d2/db/d3c/d86/ce9 0 2024-09-19T09:41:42.447 INFO:tasks.workunit.client.0.smithi042.stdout:1/716: rename d4/d15/d19/f16 to d4/d12/d8d/fe5 0 2024-09-19T09:41:42.448 INFO:tasks.workunit.client.0.smithi042.stdout:4/680: dwrite d0/d1b/d1c/d61/d7f/fe2 [0,4194304] 0 2024-09-19T09:41:42.448 INFO:tasks.workunit.client.0.smithi042.stdout:3/695: dread d4/d8/d9/d1b/d4f/fa9 [0,4194304] 0 2024-09-19T09:41:42.449 INFO:tasks.workunit.client.0.smithi042.stdout:8/745: creat d1/da/dd/d74/fda x:0 0 0 2024-09-19T09:41:42.450 INFO:tasks.workunit.client.0.smithi042.stdout:6/651: dread d1/d20/d6a/d46/d92/f77 [0,4194304] 0 2024-09-19T09:41:42.450 INFO:tasks.workunit.client.0.smithi042.stdout:6/652: fsync d1/de/d76/d99/db2/d34/d6f/d4a/d98/fb8 0 2024-09-19T09:41:42.450 INFO:tasks.workunit.client.0.smithi042.stdout:0/636: getdents d2/d8e 0 2024-09-19T09:41:42.451 INFO:tasks.workunit.client.0.smithi042.stdout:1/717: mknod d4/d15/d19/ce6 0 2024-09-19T09:41:42.453 INFO:tasks.workunit.client.0.smithi042.stdout:1/718: write d4/d15/f17 [1144818,41572] 0 2024-09-19T09:41:42.453 INFO:tasks.workunit.client.0.smithi042.stdout:1/719: dread - d4/d15/d19/d42/d51/db5/dda/fa9 zero size 2024-09-19T09:41:42.454 INFO:tasks.workunit.client.0.smithi042.stdout:2/660: dwrite d7/dd/d1f/f21 [0,4194304] 0 2024-09-19T09:41:42.454 INFO:tasks.workunit.client.0.smithi042.stdout:2/661: write d7/dd/d1f/d3f/f69 [1681199,78033] 0 2024-09-19T09:41:42.455 INFO:tasks.workunit.client.0.smithi042.stdout:3/696: link d4/d8/f36 d4/d8/d9/d39/d4b/d7d/fe4 0 2024-09-19T09:41:42.456 INFO:tasks.workunit.client.0.smithi042.stdout:4/681: symlink d0/d1b/d1c/d6a/le7 0 2024-09-19T09:41:42.457 INFO:tasks.workunit.client.0.smithi042.stdout:6/653: symlink d1/d20/d6a/d46/d95/lbc 0 2024-09-19T09:41:42.459 INFO:tasks.workunit.client.0.smithi042.stdout:0/637: unlink d2/d10/d1e/l8b 0 2024-09-19T09:41:42.461 INFO:tasks.workunit.client.0.smithi042.stdout:1/720: mknod d4/d15/d19/d42/d51/db5/dd0/ce7 0 2024-09-19T09:41:42.467 INFO:tasks.workunit.client.0.smithi042.stdout:2/662: creat d7/dd/d14/d35/d4c/d61/d87/dc6/fd8 x:0 0 0 2024-09-19T09:41:42.468 INFO:tasks.workunit.client.0.smithi042.stdout:3/697: getdents d4/d8/d9/dc 0 2024-09-19T09:41:42.468 INFO:tasks.workunit.client.0.smithi042.stdout:3/698: write d4/d8/d9/d39/d4b/f80 [1188932,114968] 0 2024-09-19T09:41:42.469 INFO:tasks.workunit.client.0.smithi042.stdout:3/699: readlink d4/d8/d9/l28 0 2024-09-19T09:41:42.471 INFO:tasks.workunit.client.0.smithi042.stdout:6/654: rename d1/c9 to d1/d20/cbd 0 2024-09-19T09:41:42.472 INFO:tasks.workunit.client.0.smithi042.stdout:0/638: symlink d2/d8e/lc2 0 2024-09-19T09:41:42.472 INFO:tasks.workunit.client.0.smithi042.stdout:4/682: dwrite d0/d67/f8e [0,4194304] 0 2024-09-19T09:41:42.473 INFO:tasks.workunit.client.0.smithi042.stdout:1/721: truncate d4/d15/d9e/fb6 1579058 0 2024-09-19T09:41:42.474 INFO:tasks.workunit.client.0.smithi042.stdout:4/683: creat d0/d1b/d1c/d2e/d3f/d6b/d8f/fe8 x:0 0 0 2024-09-19T09:41:42.474 INFO:tasks.workunit.client.0.smithi042.stdout:4/684: write d0/d28/d87/da1/faa [609670,80039] 0 2024-09-19T09:41:42.476 INFO:tasks.workunit.client.0.smithi042.stdout:2/663: link d7/d9b/fb5 d7/dd/d14/d35/d4e/d63/dd6/fd9 0 2024-09-19T09:41:42.477 INFO:tasks.workunit.client.0.smithi042.stdout:2/664: write d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/da8/fac [816166,35447] 0 2024-09-19T09:41:42.477 INFO:tasks.workunit.client.0.smithi042.stdout:3/700: creat d4/d8/fe5 x:0 0 0 2024-09-19T09:41:42.479 INFO:tasks.workunit.client.0.smithi042.stdout:0/639: creat d2/d8e/d32/d64/da5/d8a/d9d/fc3 x:0 0 0 2024-09-19T09:41:42.479 INFO:tasks.workunit.client.0.smithi042.stdout:0/640: chown d2/d10/d12/d24/d5b 39924570 1 2024-09-19T09:41:42.480 INFO:tasks.workunit.client.0.smithi042.stdout:6/655: dread d1/d20/d6a/d90/f3b [0,4194304] 0 2024-09-19T09:41:42.482 INFO:tasks.workunit.client.0.smithi042.stdout:1/722: mkdir d4/d15/d61/d85/dc9/de8 0 2024-09-19T09:41:42.482 INFO:tasks.workunit.client.0.smithi042.stdout:1/723: dread - d4/d15/d19/d45/d82/d89/fe1 zero size 2024-09-19T09:41:42.482 INFO:tasks.workunit.client.0.smithi042.stdout:1/724: read d4/d15/d19/d45/f4d [1477049,61942] 0 2024-09-19T09:41:42.482 INFO:tasks.workunit.client.0.smithi042.stdout:0/641: mknod d2/d10/d12/d16/d57/d78/db3/cc4 0 2024-09-19T09:41:42.483 INFO:tasks.workunit.client.0.smithi042.stdout:6/656: mkdir d1/de/d76/d99/db2/d34/d6f/dbe 0 2024-09-19T09:41:42.486 INFO:tasks.workunit.client.0.smithi042.stdout:0/642: creat d2/d8e/d32/d64/da5/d8a/d9d/d5a/d8f/d9f/fc5 x:0 0 0 2024-09-19T09:41:42.487 INFO:tasks.workunit.client.0.smithi042.stdout:1/725: rmdir d4/d15/d2e/db7 39 2024-09-19T09:41:42.491 INFO:tasks.workunit.client.0.smithi042.stdout:1/726: link d4/d15/f21 d4/d15/d2e/db7/d3c/fe9 0 2024-09-19T09:41:42.492 INFO:tasks.workunit.client.0.smithi042.stdout:1/727: rmdir d4/d15/d19/d42/d5b 39 2024-09-19T09:41:42.495 INFO:tasks.workunit.client.0.smithi042.stdout:8/746: dwrite d1/d2e/f51 [0,4194304] 0 2024-09-19T09:41:42.495 INFO:tasks.workunit.client.0.smithi042.stdout:8/747: readlink d1/l3 0 2024-09-19T09:41:42.496 INFO:tasks.workunit.client.0.smithi042.stdout:3/701: write d4/d8/d9/dc/dbf/d6d/d8f/fc2 [1758394,29371] 0 2024-09-19T09:41:42.496 INFO:tasks.workunit.client.0.smithi042.stdout:3/702: dread - d4/d8/d4c/fe3 zero size 2024-09-19T09:41:42.497 INFO:tasks.workunit.client.0.smithi042.stdout:6/657: dread d1/d20/d6a/d46/f64 [0,4194304] 0 2024-09-19T09:41:42.497 INFO:tasks.workunit.client.0.smithi042.stdout:6/658: chown d1/de/d76/d99/db2/d34/d6f/dbe 1 1 2024-09-19T09:41:42.503 INFO:tasks.workunit.client.0.smithi042.stdout:4/685: dwrite d0/d1b/d1c/f51 [0,4194304] 0 2024-09-19T09:41:42.503 INFO:tasks.workunit.client.0.smithi042.stdout:2/665: dwrite d7/d9b/fb5 [0,4194304] 0 2024-09-19T09:41:42.503 INFO:tasks.workunit.client.0.smithi042.stdout:2/666: stat d7/dd/d14/d35/d4c/d61/d87/dbf 0 2024-09-19T09:41:42.503 INFO:tasks.workunit.client.0.smithi042.stdout:4/686: write d0/f15 [1797220,130219] 0 2024-09-19T09:41:42.505 INFO:tasks.workunit.client.0.smithi042.stdout:4/687: dread d0/d1b/d1c/d2e/d3b/f53 [0,4194304] 0 2024-09-19T09:41:42.505 INFO:tasks.workunit.client.0.smithi042.stdout:6/659: write d1/de/d76/d99/db2/f2a [717536,41435] 0 2024-09-19T09:41:42.505 INFO:tasks.workunit.client.0.smithi042.stdout:2/667: dread d7/dd/d22/d30/f4d [0,4194304] 0 2024-09-19T09:41:42.506 INFO:tasks.workunit.client.0.smithi042.stdout:8/748: dread d1/da/d3f/f50 [0,4194304] 0 2024-09-19T09:41:42.509 INFO:tasks.workunit.client.0.smithi042.stdout:8/749: symlink d1/da/dcd/ldb 0 2024-09-19T09:41:42.509 INFO:tasks.workunit.client.0.smithi042.stdout:8/750: truncate d1/da8/d3d/d58/fab 4000095 0 2024-09-19T09:41:42.510 INFO:tasks.workunit.client.0.smithi042.stdout:8/751: mkdir d1/ddc 0 2024-09-19T09:41:42.517 INFO:tasks.workunit.client.0.smithi042.stdout:8/752: dread d1/da/dd/f16 [4194304,4194304] 0 2024-09-19T09:41:42.519 INFO:tasks.workunit.client.0.smithi042.stdout:8/753: unlink d1/da/dd/d8e/cb0 0 2024-09-19T09:41:42.519 INFO:tasks.workunit.client.0.smithi042.stdout:8/754: creat d1/ddc/fdd x:0 0 0 2024-09-19T09:41:42.520 INFO:tasks.workunit.client.0.smithi042.stdout:3/703: dwrite d4/d8/d9/dc/f6e [0,4194304] 0 2024-09-19T09:41:42.520 INFO:tasks.workunit.client.0.smithi042.stdout:1/728: dwrite d4/d15/d9e/fb8 [0,4194304] 0 2024-09-19T09:41:42.520 INFO:tasks.workunit.client.0.smithi042.stdout:6/660: dread d1/d20/d6a/d90/f31 [0,4194304] 0 2024-09-19T09:41:42.520 INFO:tasks.workunit.client.0.smithi042.stdout:8/755: mknod d1/d72/cde 0 2024-09-19T09:41:42.522 INFO:tasks.workunit.client.0.smithi042.stdout:1/729: getdents d4/d15/d19/d42/d5b 0 2024-09-19T09:41:42.523 INFO:tasks.workunit.client.0.smithi042.stdout:6/661: mknod d1/de/da7/cbf 0 2024-09-19T09:41:42.523 INFO:tasks.workunit.client.0.smithi042.stdout:6/662: readlink d1/d20/d6a/d46/d92/l2b 0 2024-09-19T09:41:42.524 INFO:tasks.workunit.client.0.smithi042.stdout:8/756: creat d1/da8/d41/fdf x:0 0 0 2024-09-19T09:41:42.525 INFO:tasks.workunit.client.0.smithi042.stdout:1/730: unlink d4/d15/d19/d45/d82/fd8 0 2024-09-19T09:41:42.525 INFO:tasks.workunit.client.0.smithi042.stdout:1/731: rmdir d4/d15/d19/d42/d5b 39 2024-09-19T09:41:42.526 INFO:tasks.workunit.client.0.smithi042.stdout:1/732: mknod d4/cea 0 2024-09-19T09:41:42.527 INFO:tasks.workunit.client.0.smithi042.stdout:3/704: dread d4/d2a/f4e [0,4194304] 0 2024-09-19T09:41:42.528 INFO:tasks.workunit.client.0.smithi042.stdout:3/705: mkdir d4/d8/d9/dc/dbf/d5c/d82/d48/da5/de6 0 2024-09-19T09:41:42.529 INFO:tasks.workunit.client.0.smithi042.stdout:3/706: creat d4/d8/d9/d1b/d4f/fe7 x:0 0 0 2024-09-19T09:41:42.529 INFO:tasks.workunit.client.0.smithi042.stdout:3/707: read d4/d8/f36 [986381,45887] 0 2024-09-19T09:41:42.529 INFO:tasks.workunit.client.0.smithi042.stdout:3/708: fsync d4/d8/d9/dc/f6e 0 2024-09-19T09:41:42.530 INFO:tasks.workunit.client.0.smithi042.stdout:3/709: creat d4/d78/d9d/fe8 x:0 0 0 2024-09-19T09:41:42.530 INFO:tasks.workunit.client.0.smithi042.stdout:3/710: fdatasync d4/d8/f19 0 2024-09-19T09:41:42.530 INFO:tasks.workunit.client.0.smithi042.stdout:2/668: dwrite d7/dd/d14/d35/f7d [0,4194304] 0 2024-09-19T09:41:42.530 INFO:tasks.workunit.client.0.smithi042.stdout:3/711: creat d4/d8/d9/dc/dbf/d5c/d82/fe9 x:0 0 0 2024-09-19T09:41:42.533 INFO:tasks.workunit.client.0.smithi042.stdout:2/669: getdents d7/dd/d14/d35/d4c/d70 0 2024-09-19T09:41:42.535 INFO:tasks.workunit.client.0.smithi042.stdout:2/670: creat d7/dd/d14/d35/d4e/d9c/fda x:0 0 0 2024-09-19T09:41:42.535 INFO:tasks.workunit.client.0.smithi042.stdout:2/671: fsync d7/dd/d14/d35/d45/d5e/d79/fa1 0 2024-09-19T09:41:42.535 INFO:tasks.workunit.client.0.smithi042.stdout:2/672: write d7/dd/d14/d35/d4c/fa3 [1098739,32957] 0 2024-09-19T09:41:42.535 INFO:tasks.workunit.client.0.smithi042.stdout:3/712: dread d4/f52 [0,4194304] 0 2024-09-19T09:41:42.536 INFO:tasks.workunit.client.0.smithi042.stdout:3/713: chown d4/d8/d9/dc/dbf/d5c/d82/d8c/d9f/fb6 68028244 1 2024-09-19T09:41:42.536 INFO:tasks.workunit.client.0.smithi042.stdout:3/714: dread - d4/d8/fbd zero size 2024-09-19T09:41:42.536 INFO:tasks.workunit.client.0.smithi042.stdout:3/715: chown d4/d8/d9/l1f 23 1 2024-09-19T09:41:42.536 INFO:tasks.workunit.client.0.smithi042.stdout:2/673: getdents d7/dd 0 2024-09-19T09:41:42.536 INFO:tasks.workunit.client.0.smithi042.stdout:2/674: read d7/dd/d14/d35/d4c/f76 [3992042,8481] 0 2024-09-19T09:41:42.536 INFO:tasks.workunit.client.0.smithi042.stdout:2/675: write d7/dd/f37 [5945707,53317] 0 2024-09-19T09:41:42.537 INFO:tasks.workunit.client.0.smithi042.stdout:2/676: chown d7/dd/d14/d35/d4c/d70 119 1 2024-09-19T09:41:42.537 INFO:tasks.workunit.client.0.smithi042.stdout:2/677: write d7/dd/d22/fb7 [101411,45052] 0 2024-09-19T09:41:42.545 INFO:tasks.workunit.client.0.smithi042.stdout:1/733: dwrite d4/d15/f21 [0,4194304] 0 2024-09-19T09:41:42.545 INFO:tasks.workunit.client.0.smithi042.stdout:1/734: readlink d4/d4e/l5e 0 2024-09-19T09:41:42.545 INFO:tasks.workunit.client.0.smithi042.stdout:6/663: dread d1/de/f35 [0,4194304] 0 2024-09-19T09:41:42.546 INFO:tasks.workunit.client.0.smithi042.stdout:1/735: creat d4/d12/d8d/d91/feb x:0 0 0 2024-09-19T09:41:42.547 INFO:tasks.workunit.client.0.smithi042.stdout:6/664: creat d1/de/d76/d99/db2/d34/d6f/d93/fc0 x:0 0 0 2024-09-19T09:41:42.549 INFO:tasks.workunit.client.0.smithi042.stdout:1/736: rename d4/d15/d19/d42/d51/db5/dda/fd9 to d4/d15/d19/fec 0 2024-09-19T09:41:42.561 INFO:tasks.workunit.client.0.smithi042.stdout:8/757: dwrite d1/da/dd/f49 [4194304,4194304] 0 2024-09-19T09:41:42.561 INFO:tasks.workunit.client.0.smithi042.stdout:2/678: dwrite d7/dd/d14/d35/d4c/d61/fa2 [0,4194304] 0 2024-09-19T09:41:42.562 INFO:tasks.workunit.client.0.smithi042.stdout:3/716: dwrite d4/d78/d9d/fe8 [0,4194304] 0 2024-09-19T09:41:42.563 INFO:tasks.workunit.client.0.smithi042.stdout:2/679: truncate d7/dd/d14/d35/d4c/f76 1718469 0 2024-09-19T09:41:42.566 INFO:tasks.workunit.client.0.smithi042.stdout:3/717: dread d4/d8/d9/d1b/d4f/d9c/fbb [0,4194304] 0 2024-09-19T09:41:42.571 INFO:tasks.workunit.client.0.smithi042.stdout:6/665: dwrite d1/f18 [8388608,4194304] 0 2024-09-19T09:41:42.571 INFO:tasks.workunit.client.0.smithi042.stdout:3/718: dread d4/d8/d4c/d6b/fce [0,4194304] 0 2024-09-19T09:41:42.572 INFO:tasks.workunit.client.0.smithi042.stdout:1/737: dwrite d4/d12/d8d/d91/d7f/d99/ddc/fa6 [0,4194304] 0 2024-09-19T09:41:42.572 INFO:tasks.workunit.client.0.smithi042.stdout:1/738: dread - d4/d15/d61/d85/dc9/fd7 zero size 2024-09-19T09:41:42.574 INFO:tasks.workunit.client.0.smithi042.stdout:6/666: creat d1/d20/d6a/d46/fc1 x:0 0 0 2024-09-19T09:41:42.576 INFO:tasks.workunit.client.0.smithi042.stdout:3/719: rename d4/c25 to d4/cea 0 2024-09-19T09:41:42.576 INFO:tasks.workunit.client.0.smithi042.stdout:2/680: dread d7/dd/d14/d35/d4e/d63/f81 [0,4194304] 0 2024-09-19T09:41:42.576 INFO:tasks.workunit.client.0.smithi042.stdout:2/681: stat d7/dd/d14/d35/d4c/d61/d87/dbf/fd4 0 2024-09-19T09:41:42.578 INFO:tasks.workunit.client.0.smithi042.stdout:1/739: mkdir d4/d15/d2e/db7/d3c/dd5/ded 0 2024-09-19T09:41:42.578 INFO:tasks.workunit.client.0.smithi042.stdout:1/740: fsync d4/d12/d8d/d91/d7f/d99/fc3 0 2024-09-19T09:41:42.578 INFO:tasks.workunit.client.0.smithi042.stdout:1/741: write d4/d12/d8d/d91/feb [413687,29702] 0 2024-09-19T09:41:42.578 INFO:tasks.workunit.client.0.smithi042.stdout:6/667: getdents d1/de/d76/d99/db2/d34/d6f/d4a/d98 0 2024-09-19T09:41:42.579 INFO:tasks.workunit.client.0.smithi042.stdout:3/720: mkdir d4/d8/d4c/d6b/db9/dcb/deb 0 2024-09-19T09:41:42.580 INFO:tasks.workunit.client.0.smithi042.stdout:1/742: dread d4/d1e/fc5 [0,4194304] 0 2024-09-19T09:41:42.582 INFO:tasks.workunit.client.0.smithi042.stdout:6/668: mkdir d1/de/da7/dc2 0 2024-09-19T09:41:42.582 INFO:tasks.workunit.client.0.smithi042.stdout:8/758: dwrite d1/da8/d3d/f6c [0,4194304] 0 2024-09-19T09:41:42.583 INFO:tasks.workunit.client.0.smithi042.stdout:2/682: dread d7/dd/d14/d35/d4c/d61/fa2 [0,4194304] 0 2024-09-19T09:41:42.583 INFO:tasks.workunit.client.0.smithi042.stdout:3/721: creat d4/d8/fec x:0 0 0 2024-09-19T09:41:42.584 INFO:tasks.workunit.client.0.smithi042.stdout:6/669: creat d1/de/d76/d99/db2/d34/d6f/d4a/fc3 x:0 0 0 2024-09-19T09:41:42.587 INFO:tasks.workunit.client.0.smithi042.stdout:6/670: creat d1/de/d76/d99/db2/d34/d6f/fc4 x:0 0 0 2024-09-19T09:41:42.587 INFO:tasks.workunit.client.0.smithi042.stdout:1/743: readlink d4/d12/d8d/d91/d7f/d99/ddc/l92 0 2024-09-19T09:41:42.587 INFO:tasks.workunit.client.0.smithi042.stdout:1/744: write d4/d4e/fc0 [1134423,121248] 0 2024-09-19T09:41:42.589 INFO:tasks.workunit.client.0.smithi042.stdout:1/745: getdents d4/d15/d2e 0 2024-09-19T09:41:42.593 INFO:tasks.workunit.client.0.smithi042.stdout:6/671: dread d1/f18 [8388608,4194304] 0 2024-09-19T09:41:42.593 INFO:tasks.workunit.client.0.smithi042.stdout:6/672: fsync d1/d20/d69/f86 0 2024-09-19T09:41:42.596 INFO:tasks.workunit.client.0.smithi042.stdout:6/673: truncate d1/de/d76/d99/db2/d34/d3f/f96 64143 0 2024-09-19T09:41:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:42 smithi171 ceph-mon[35803]: pgmap v408: 97 pgs: 97 active+clean; 891 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s rd, 142 MiB/s wr, 991 op/s 2024-09-19T09:41:42.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:42 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:42.598 INFO:tasks.workunit.client.0.smithi042.stdout:1/746: write d4/d15/d2e/db7/d3c/f59 [2720819,122074] 0 2024-09-19T09:41:42.598 INFO:tasks.workunit.client.0.smithi042.stdout:1/747: fdatasync f1 0 2024-09-19T09:41:42.598 INFO:tasks.workunit.client.0.smithi042.stdout:1/748: fsync d4/d15/d19/d45/f4d 0 2024-09-19T09:41:42.598 INFO:tasks.workunit.client.0.smithi042.stdout:6/674: getdents d1/de/d12 0 2024-09-19T09:41:42.600 INFO:tasks.workunit.client.0.smithi042.stdout:6/675: mknod d1/de/d76/d99/db2/d34/d6f/d93/cc5 0 2024-09-19T09:41:42.600 INFO:tasks.workunit.client.0.smithi042.stdout:8/759: write d1/da/dd/d74/f9e [344768,128916] 0 2024-09-19T09:41:42.600 INFO:tasks.workunit.client.0.smithi042.stdout:8/760: dread - d1/da/dd/d74/dbc/fc0 zero size 2024-09-19T09:41:42.601 INFO:tasks.workunit.client.0.smithi042.stdout:6/676: mkdir d1/d20/dc6 0 2024-09-19T09:41:42.602 INFO:tasks.workunit.client.0.smithi042.stdout:8/761: link d1/da8/d3d/d59/la9 d1/da8/d41/d55/d99/le0 0 2024-09-19T09:41:42.603 INFO:tasks.workunit.client.0.smithi042.stdout:6/677: mknod d1/d20/dc6/cc7 0 2024-09-19T09:41:42.604 INFO:tasks.workunit.client.0.smithi042.stdout:6/678: mkdir d1/d20/d6a/d90/dc8 0 2024-09-19T09:41:42.605 INFO:tasks.workunit.client.0.smithi042.stdout:3/722: dwrite d4/d8/d9/dc/dbf/d5c/d82/d48/fa0 [0,4194304] 0 2024-09-19T09:41:42.605 INFO:tasks.workunit.client.0.smithi042.stdout:3/723: chown d4/d8/d9/dc/dbf/d5c/d82/d48/da5/de6 706696 1 2024-09-19T09:41:42.606 INFO:tasks.workunit.client.0.smithi042.stdout:3/724: mknod d4/d8/d9/dc/dbf/d5c/d82/d48/dc3/ced 0 2024-09-19T09:41:42.607 INFO:tasks.workunit.client.0.smithi042.stdout:3/725: chown d4/d8/d9/dc/dbf/d35/fb7 222078833 1 2024-09-19T09:41:42.607 INFO:tasks.workunit.client.0.smithi042.stdout:3/726: dread - d4/d8/d9/d39/d4b/fda zero size 2024-09-19T09:41:42.607 INFO:tasks.workunit.client.0.smithi042.stdout:2/683: dwrite d7/f6a [0,4194304] 0 2024-09-19T09:41:42.608 INFO:tasks.workunit.client.0.smithi042.stdout:2/684: fsync d7/dd/d14/d35/d4e/d9c/fae 0 2024-09-19T09:41:42.608 INFO:tasks.workunit.client.0.smithi042.stdout:2/685: truncate d7/dd/f8d 4955407 0 2024-09-19T09:41:42.613 INFO:tasks.workunit.client.0.smithi042.stdout:6/679: write d1/de/f2d [2609599,115274] 0 2024-09-19T09:41:42.617 INFO:tasks.workunit.client.0.smithi042.stdout:8/762: read d1/da8/d41/d55/d99/da4/f6d [736107,30828] 0 2024-09-19T09:41:42.617 INFO:tasks.workunit.client.0.smithi042.stdout:6/680: creat d1/de/d12/fc9 x:0 0 0 2024-09-19T09:41:42.617 INFO:tasks.workunit.client.0.smithi042.stdout:6/681: fdatasync d1/de/d76/d99/db2/d34/d6f/d93/fc0 0 2024-09-19T09:41:42.617 INFO:tasks.workunit.client.0.smithi042.stdout:6/682: chown d1/de/d54/c74 238 1 2024-09-19T09:41:42.618 INFO:tasks.workunit.client.0.smithi042.stdout:2/686: mknod d7/dd/d1f/cdb 0 2024-09-19T09:41:42.618 INFO:tasks.workunit.client.0.smithi042.stdout:1/749: rename d4/d15/d2e/db7/f75 to d4/d1e/d25/fee 0 2024-09-19T09:41:42.619 INFO:tasks.workunit.client.0.smithi042.stdout:1/750: readlink d4/d4e/lac 0 2024-09-19T09:41:42.621 INFO:tasks.workunit.client.0.smithi042.stdout:8/763: rename d1/da/dd/d8e/db7 to d1/da8/de1 0 2024-09-19T09:41:42.621 INFO:tasks.workunit.client.0.smithi042.stdout:8/764: chown d1/d2e/c36 1 1 2024-09-19T09:41:42.623 INFO:tasks.workunit.client.0.smithi042.stdout:2/687: rename d7/dd/d14/cc0 to d7/dd/d14/d35/d4e/d9c/cdc 0 2024-09-19T09:41:42.625 INFO:tasks.workunit.client.0.smithi042.stdout:8/765: rename d1/l66 to d1/da8/d3d/le2 0 2024-09-19T09:41:42.626 INFO:tasks.workunit.client.0.smithi042.stdout:3/727: dwrite d4/d78/d9d/fe8 [0,4194304] 0 2024-09-19T09:41:42.626 INFO:tasks.workunit.client.0.smithi042.stdout:2/688: mkdir d7/dd/d14/d35/d4c/d61/d87/dc6/ddd 0 2024-09-19T09:41:42.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:42 smithi136 ceph-mon[34840]: pgmap v408: 97 pgs: 97 active+clean; 891 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s rd, 142 MiB/s wr, 991 op/s 2024-09-19T09:41:42.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:42 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:42.637 INFO:tasks.workunit.client.0.smithi042.stdout:8/766: dread d1/da/d3f/f50 [0,4194304] 0 2024-09-19T09:41:42.637 INFO:tasks.workunit.client.0.smithi042.stdout:8/767: write d1/da/dd/d74/dbc/fc0 [145660,91251] 0 2024-09-19T09:41:42.637 INFO:tasks.workunit.client.0.smithi042.stdout:8/768: fdatasync d1/da8/d41/d55/d99/da4/f6d 0 2024-09-19T09:41:42.639 INFO:tasks.workunit.client.0.smithi042.stdout:3/728: write d4/d8/d9/f1e [2670437,59876] 0 2024-09-19T09:41:42.639 INFO:tasks.workunit.client.0.smithi042.stdout:6/683: dwrite d1/de/d12/f19 [0,4194304] 0 2024-09-19T09:41:42.641 INFO:tasks.workunit.client.0.smithi042.stdout:3/729: mkdir d4/d8/d4c/d6b/db9/dee 0 2024-09-19T09:41:42.642 INFO:tasks.workunit.client.0.smithi042.stdout:6/684: mknod d1/de/d76/d99/db2/d34/d6f/d4a/cca 0 2024-09-19T09:41:42.643 INFO:tasks.workunit.client.0.smithi042.stdout:6/685: mkdir d1/de/d54/dcb 0 2024-09-19T09:41:42.644 INFO:tasks.workunit.client.0.smithi042.stdout:3/730: dread d4/d8/d9/dc/dbf/d5c/d82/d48/fdc [0,4194304] 0 2024-09-19T09:41:42.645 INFO:tasks.workunit.client.0.smithi042.stdout:6/686: rename d1/de/f28 to d1/de/d76/d99/db2/d34/d6f/fcc 0 2024-09-19T09:41:42.646 INFO:tasks.workunit.client.0.smithi042.stdout:6/687: write d1/de/d76/d99/db2/d34/d6f/d93/db5/fa9 [1162299,32215] 0 2024-09-19T09:41:42.646 INFO:tasks.workunit.client.0.smithi042.stdout:6/688: getdents d1/de/da7/dc2 0 2024-09-19T09:41:42.646 INFO:tasks.workunit.client.0.smithi042.stdout:1/751: dwrite d4/d1e/d25/f46 [4194304,4194304] 0 2024-09-19T09:41:42.646 INFO:tasks.workunit.client.0.smithi042.stdout:3/731: creat d4/d8/d9/dc/dbf/d5c/d82/d48/dc3/fef x:0 0 0 2024-09-19T09:41:42.647 INFO:tasks.workunit.client.0.smithi042.stdout:6/689: creat d1/d20/d6a/fcd x:0 0 0 2024-09-19T09:41:42.648 INFO:tasks.workunit.client.0.smithi042.stdout:8/769: dread d1/da/d14/f2b [0,4194304] 0 2024-09-19T09:41:42.648 INFO:tasks.workunit.client.0.smithi042.stdout:3/732: mknod d4/d8/d9/dc/dbf/d5c/d82/d48/dc3/cf0 0 2024-09-19T09:41:42.648 INFO:tasks.workunit.client.0.smithi042.stdout:1/752: creat d4/d1e/fef x:0 0 0 2024-09-19T09:41:42.650 INFO:tasks.workunit.client.0.smithi042.stdout:2/689: dwrite d7/dd/f59 [0,4194304] 0 2024-09-19T09:41:42.650 INFO:tasks.workunit.client.0.smithi042.stdout:2/690: write d7/dd/d48/d96/fba [1871704,112760] 0 2024-09-19T09:41:42.653 INFO:tasks.workunit.client.0.smithi042.stdout:2/691: creat d7/dd/d14/d35/d4e/d9c/fde x:0 0 0 2024-09-19T09:41:42.653 INFO:tasks.workunit.client.0.smithi042.stdout:2/692: chown d7/dd/d14/d35 28828 1 2024-09-19T09:41:42.654 INFO:tasks.workunit.client.0.smithi042.stdout:1/753: unlink d4/d1e/d25/l48 0 2024-09-19T09:41:42.655 INFO:tasks.workunit.client.0.smithi042.stdout:2/693: creat d7/dd/d1f/d3f/fdf x:0 0 0 2024-09-19T09:41:42.667 INFO:tasks.workunit.client.0.smithi042.stdout:6/690: dwrite d1/d20/d6a/d46/d92/d4f/f66 [0,4194304] 0 2024-09-19T09:41:42.668 INFO:tasks.workunit.client.0.smithi042.stdout:3/733: dwrite d4/d2a/f4e [0,4194304] 0 2024-09-19T09:41:42.669 INFO:tasks.workunit.client.0.smithi042.stdout:3/734: truncate d4/d8/d9/dc/dbf/d5c/d82/d48/dc3/fef 896941 0 2024-09-19T09:41:42.670 INFO:tasks.workunit.client.0.smithi042.stdout:3/735: creat d4/d8/d9/dc/dbf/d5c/d82/d8c/d9f/ff1 x:0 0 0 2024-09-19T09:41:42.671 INFO:tasks.workunit.client.0.smithi042.stdout:3/736: stat d4/d8/d9/dc/dbf/d5c/d82/d48/dc3 0 2024-09-19T09:41:42.677 INFO:tasks.workunit.client.0.smithi042.stdout:1/754: rename d4/d1e/d25/f33 to d4/d15/d19/d42/d51/ff0 0 2024-09-19T09:41:42.678 INFO:tasks.workunit.client.0.smithi042.stdout:2/694: rename d7/dd/d1f/f21 to d7/dd/fe0 0 2024-09-19T09:41:42.679 INFO:tasks.workunit.client.0.smithi042.stdout:1/755: creat d4/d1e/ff1 x:0 0 0 2024-09-19T09:41:42.680 INFO:tasks.workunit.client.0.smithi042.stdout:2/695: mknod d7/dd/d14/d35/d45/d5e/ce1 0 2024-09-19T09:41:42.687 INFO:tasks.workunit.client.0.smithi042.stdout:1/756: dread d4/fa5 [0,4194304] 0 2024-09-19T09:41:42.690 INFO:tasks.workunit.client.0.smithi042.stdout:6/691: dwrite d1/de/d54/d81/fb6 [0,4194304] 0 2024-09-19T09:41:42.690 INFO:tasks.workunit.client.0.smithi042.stdout:6/692: read d1/de/d76/d99/db2/d34/d6f/d4a/f55 [3512193,88836] 0 2024-09-19T09:41:42.699 INFO:tasks.workunit.client.0.smithi042.stdout:6/693: dread d1/de/d76/d99/db2/d34/d6f/d4a/f83 [0,4194304] 0 2024-09-19T09:41:42.700 INFO:tasks.workunit.client.0.smithi042.stdout:1/757: dread d4/f13 [0,4194304] 0 2024-09-19T09:41:42.702 INFO:tasks.workunit.client.0.smithi042.stdout:3/737: dwrite d4/d2a/f9e [0,4194304] 0 2024-09-19T09:41:42.703 INFO:tasks.workunit.client.0.smithi042.stdout:3/738: symlink d4/d8/d9/dc/dbf/d6d/d8f/dcd/lf2 0 2024-09-19T09:41:42.704 INFO:tasks.workunit.client.0.smithi042.stdout:2/696: dwrite d7/dd/d1f/d3f/f6c [0,4194304] 0 2024-09-19T09:41:42.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:42 smithi042 ceph-mon[31223]: pgmap v408: 97 pgs: 97 active+clean; 891 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s rd, 142 MiB/s wr, 991 op/s 2024-09-19T09:41:42.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:42 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:42.713 INFO:tasks.workunit.client.0.smithi042.stdout:2/697: creat d7/dd/d22/d30/d66/fe2 x:0 0 0 2024-09-19T09:41:42.713 INFO:tasks.workunit.client.0.smithi042.stdout:6/694: dread d1/d20/f38 [0,4194304] 0 2024-09-19T09:41:42.713 INFO:tasks.workunit.client.0.smithi042.stdout:2/698: rename d7/dd/d14/d35/d4c/d61/d87/dc6/ddd to d7/dd/de3 0 2024-09-19T09:41:42.714 INFO:tasks.workunit.client.0.smithi042.stdout:6/695: link d1/de/d76/d99/db2/c85 d1/d20/d6a/d90/cce 0 2024-09-19T09:41:42.715 INFO:tasks.workunit.client.0.smithi042.stdout:6/696: creat d1/de/d5d/fcf x:0 0 0 2024-09-19T09:41:42.724 INFO:tasks.workunit.client.0.smithi042.stdout:1/758: dwrite d4/d29/fe0 [0,4194304] 0 2024-09-19T09:41:42.726 INFO:tasks.workunit.client.0.smithi042.stdout:1/759: truncate d4/d15/f21 3297019 0 2024-09-19T09:41:42.726 INFO:tasks.workunit.client.0.smithi042.stdout:1/760: readlink d4/d15/d61/lbd 0 2024-09-19T09:41:42.726 INFO:tasks.workunit.client.0.smithi042.stdout:1/761: chown d4 0 1 2024-09-19T09:41:42.726 INFO:tasks.workunit.client.0.smithi042.stdout:1/762: write d4/d15/d19/d42/f9c [4868437,84315] 0 2024-09-19T09:41:42.726 INFO:tasks.workunit.client.0.smithi042.stdout:1/763: chown d4/d15/d2e/db7/d3c/dd5 5849 1 2024-09-19T09:41:42.727 INFO:tasks.workunit.client.0.smithi042.stdout:1/764: write d4/d1e/fc5 [337272,15033] 0 2024-09-19T09:41:42.728 INFO:tasks.workunit.client.0.smithi042.stdout:1/765: rename d4/d15/le2 to d4/d15/d61/d85/lf2 0 2024-09-19T09:41:42.730 INFO:tasks.workunit.client.0.smithi042.stdout:3/739: dwrite d4/d8/d9/dc/dbf/d5c/fc7 [0,4194304] 0 2024-09-19T09:41:42.733 INFO:tasks.workunit.client.0.smithi042.stdout:3/740: fsync d4/d8/f1c 0 2024-09-19T09:41:42.734 INFO:tasks.workunit.client.0.smithi042.stdout:3/741: unlink d4/d8/d9/dc/dbf/d35/la6 0 2024-09-19T09:41:42.735 INFO:tasks.workunit.client.0.smithi042.stdout:3/742: truncate d4/d8/f36 1792885 0 2024-09-19T09:41:42.735 INFO:tasks.workunit.client.0.smithi042.stdout:3/743: truncate d4/d8/d9/dc/dbf/f27 1185283 0 2024-09-19T09:41:42.737 INFO:tasks.workunit.client.0.smithi042.stdout:3/744: mkdir d4/d8/d9/dc/dbf/d5c/d82/d48/dc3/df3 0 2024-09-19T09:41:42.737 INFO:tasks.workunit.client.0.smithi042.stdout:3/745: write d4/d8/d9/dc/dbf/d35/fb7 [607738,44449] 0 2024-09-19T09:41:42.741 INFO:tasks.workunit.client.0.smithi042.stdout:2/699: dwrite d7/dd/f8d [0,4194304] 0 2024-09-19T09:41:42.742 INFO:tasks.workunit.client.0.smithi042.stdout:6/697: dwrite d1/d20/f38 [0,4194304] 0 2024-09-19T09:41:42.742 INFO:tasks.workunit.client.0.smithi042.stdout:6/698: read - d1/de/d76/d99/db2/d34/d6f/fc4 zero size 2024-09-19T09:41:42.742 INFO:tasks.workunit.client.0.smithi042.stdout:2/700: dread d7/dd/d22/fb7 [0,4194304] 0 2024-09-19T09:41:42.742 INFO:tasks.workunit.client.0.smithi042.stdout:2/701: write d7/dd/d48/fc1 [485198,62414] 0 2024-09-19T09:41:42.742 INFO:tasks.workunit.client.0.smithi042.stdout:2/702: dread - d7/dd/d14/d35/d45/d5e/fb3 zero size 2024-09-19T09:41:42.743 INFO:tasks.workunit.client.0.smithi042.stdout:6/699: creat d1/de/d5d/fd0 x:0 0 0 2024-09-19T09:41:42.743 INFO:tasks.workunit.client.0.smithi042.stdout:6/700: readlink d1/d20/d6a/d46/d95/lbc 0 2024-09-19T09:41:42.744 INFO:tasks.workunit.client.0.smithi042.stdout:2/703: mknod d7/dd/d22/d30/d66/ce4 0 2024-09-19T09:41:42.746 INFO:tasks.workunit.client.0.smithi042.stdout:2/704: creat d7/dd/d14/d35/d4c/d61/d87/dc3/fe5 x:0 0 0 2024-09-19T09:41:42.747 INFO:tasks.workunit.client.0.smithi042.stdout:2/705: readlink d7/l6d 0 2024-09-19T09:41:42.747 INFO:tasks.workunit.client.0.smithi042.stdout:2/706: write d7/dd/d14/d35/d4e/d9c/fbd [451921,112752] 0 2024-09-19T09:41:42.747 INFO:tasks.workunit.client.0.smithi042.stdout:2/707: chown d7/d9b/db9/cd3 11840912 1 2024-09-19T09:41:42.748 INFO:tasks.workunit.client.0.smithi042.stdout:2/708: unlink d7/dd/fbe 0 2024-09-19T09:41:42.749 INFO:tasks.workunit.client.0.smithi042.stdout:2/709: creat d7/dd/d14/d35/d4c/d61/d87/fe6 x:0 0 0 2024-09-19T09:41:42.749 INFO:tasks.workunit.client.0.smithi042.stdout:2/710: chown d7/dd/d14 18313281 1 2024-09-19T09:41:42.749 INFO:tasks.workunit.client.0.smithi042.stdout:2/711: chown d7/dd/d1f/d3f/f69 0 1 2024-09-19T09:41:42.750 INFO:tasks.workunit.client.0.smithi042.stdout:6/701: dread d1/f8d [0,4194304] 0 2024-09-19T09:41:42.750 INFO:tasks.workunit.client.0.smithi042.stdout:2/712: mknod d7/dd/ce7 0 2024-09-19T09:41:42.752 INFO:tasks.workunit.client.0.smithi042.stdout:6/702: truncate d1/de/d54/f8e 323991 0 2024-09-19T09:41:42.752 INFO:tasks.workunit.client.0.smithi042.stdout:6/703: chown d1/de/d76/d99/db2/d34/c71 480986 1 2024-09-19T09:41:42.753 INFO:tasks.workunit.client.0.smithi042.stdout:2/713: rename d7/dd/d14/f84 to d7/dd/d22/d30/d66/fe8 0 2024-09-19T09:41:42.754 INFO:tasks.workunit.client.0.smithi042.stdout:2/714: chown d7/dd/d22/d30/c77 0 1 2024-09-19T09:41:42.754 INFO:tasks.workunit.client.0.smithi042.stdout:2/715: chown d7/f98 402193985 1 2024-09-19T09:41:42.756 INFO:tasks.workunit.client.0.smithi042.stdout:2/716: rename d7/dd/d14/c3b to d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/ce9 0 2024-09-19T09:41:42.758 INFO:tasks.workunit.client.0.smithi042.stdout:6/704: link d1/f5e d1/de/d76/d99/db2/fd1 0 2024-09-19T09:41:42.760 INFO:tasks.workunit.client.0.smithi042.stdout:6/705: creat d1/de/d76/d99/db2/fd2 x:0 0 0 2024-09-19T09:41:42.761 INFO:tasks.workunit.client.0.smithi042.stdout:2/717: mknod d7/cea 0 2024-09-19T09:41:42.765 INFO:tasks.workunit.client.0.smithi042.stdout:1/766: dwrite d4/d4e/f57 [0,4194304] 0 2024-09-19T09:41:42.765 INFO:tasks.workunit.client.0.smithi042.stdout:1/767: chown d4/d15/d19/d42/d51/cce 247543674 1 2024-09-19T09:41:42.765 INFO:tasks.workunit.client.0.smithi042.stdout:3/746: dwrite d4/d8/f19 [4194304,4194304] 0 2024-09-19T09:41:42.769 INFO:tasks.workunit.client.0.smithi042.stdout:2/718: mkdir d7/dd/d14/d35/d4c/d61/deb 0 2024-09-19T09:41:42.775 INFO:tasks.workunit.client.0.smithi042.stdout:1/768: symlink d4/d12/d8d/d91/d7f/d99/lf3 0 2024-09-19T09:41:42.775 INFO:tasks.workunit.client.0.smithi042.stdout:3/747: dread d4/d8/d9/dc/dbf/d5c/d82/f7a [0,4194304] 0 2024-09-19T09:41:42.775 INFO:tasks.workunit.client.0.smithi042.stdout:3/748: dread - d4/d8/d9/d1b/fb8 zero size 2024-09-19T09:41:42.775 INFO:tasks.workunit.client.0.smithi042.stdout:3/749: fdatasync d4/d8/d9/dc/dbf/d5c/d82/fe2 0 2024-09-19T09:41:42.777 INFO:tasks.workunit.client.0.smithi042.stdout:1/769: rename d4/d15/d19/d45/f52 to d4/d15/d19/d42/d51/ff4 0 2024-09-19T09:41:42.779 INFO:tasks.workunit.client.0.smithi042.stdout:1/770: unlink d4/d15/d19/d45/d82/d89/lcc 0 2024-09-19T09:41:42.781 INFO:tasks.workunit.client.0.smithi042.stdout:1/771: mkdir d4/d15/d61/d85/dc9/de8/df5 0 2024-09-19T09:41:42.783 INFO:tasks.workunit.client.0.smithi042.stdout:3/750: write d4/d8/f1c [2309528,108219] 0 2024-09-19T09:41:42.784 INFO:tasks.workunit.client.0.smithi042.stdout:3/751: creat d4/d8/d9/ff4 x:0 0 0 2024-09-19T09:41:42.785 INFO:tasks.workunit.client.0.smithi042.stdout:3/752: mknod d4/d8/d9/dc/dbf/d35/cf5 0 2024-09-19T09:41:42.785 INFO:tasks.workunit.client.0.smithi042.stdout:3/753: dread - d4/d8/d9/dc/fe1 zero size 2024-09-19T09:41:42.787 INFO:tasks.workunit.client.0.smithi042.stdout:1/772: dread d4/d1e/f1f [0,4194304] 0 2024-09-19T09:41:42.787 INFO:tasks.workunit.client.0.smithi042.stdout:1/773: chown d4/fd1 18887441 1 2024-09-19T09:41:42.787 INFO:tasks.workunit.client.0.smithi042.stdout:1/774: chown d4/fa2 929498788 1 2024-09-19T09:41:42.787 INFO:tasks.workunit.client.0.smithi042.stdout:1/775: read d4/d15/d19/d45/f4d [979838,120232] 0 2024-09-19T09:41:42.788 INFO:tasks.workunit.client.0.smithi042.stdout:6/706: dwrite d1/d20/d6a/d46/d92/d3a/f75 [0,4194304] 0 2024-09-19T09:41:42.790 INFO:tasks.workunit.client.0.smithi042.stdout:2/719: dwrite d7/dd/f12 [0,4194304] 0 2024-09-19T09:41:42.790 INFO:tasks.workunit.client.0.smithi042.stdout:2/720: write d7/dd/d14/d35/d4c/d61/d87/fd1 [140225,11579] 0 2024-09-19T09:41:42.790 INFO:tasks.workunit.client.0.smithi042.stdout:6/707: rename d1/de/d76/d99/db2/d34/d6f/d4a/d98/lb7 to d1/de/d76/d99/db2/d34/d6f/dbe/ld3 0 2024-09-19T09:41:42.790 INFO:tasks.workunit.client.0.smithi042.stdout:6/708: readlink d1/d20/d6a/d46/d95/lbc 0 2024-09-19T09:41:42.792 INFO:tasks.workunit.client.0.smithi042.stdout:1/776: dread d4/d15/d2e/db7/d3c/f59 [0,4194304] 0 2024-09-19T09:41:42.793 INFO:tasks.workunit.client.0.smithi042.stdout:1/777: symlink d4/d12/d8d/dca/dd4/lf6 0 2024-09-19T09:41:42.793 INFO:tasks.workunit.client.0.smithi042.stdout:1/778: write d4/d12/d8d/d91/fcd [20719,98715] 0 2024-09-19T09:41:42.798 INFO:tasks.workunit.client.0.smithi042.stdout:1/779: getdents d4/d15/d61/d85/dc9/de8 0 2024-09-19T09:41:42.801 INFO:tasks.workunit.client.0.smithi042.stdout:3/754: dwrite d4/d8/d9/d39/fc0 [0,4194304] 0 2024-09-19T09:41:42.802 INFO:tasks.workunit.client.0.smithi042.stdout:1/780: link d4/d15/d2e/f8c d4/d15/d19/d42/d51/db5/ff7 0 2024-09-19T09:41:42.803 INFO:tasks.workunit.client.0.smithi042.stdout:3/755: creat d4/d8/d4c/d6b/db9/dcb/deb/ff6 x:0 0 0 2024-09-19T09:41:42.807 INFO:tasks.workunit.client.0.smithi042.stdout:1/781: link d4/d1e/d25/l2a d4/d1e/lf8 0 2024-09-19T09:41:42.812 INFO:tasks.workunit.client.0.smithi042.stdout:6/709: dwrite d1/de/d76/d99/db2/d34/f8f [0,4194304] 0 2024-09-19T09:41:42.812 INFO:tasks.workunit.client.0.smithi042.stdout:6/710: chown d1/de/d5d/f61 16900758 1 2024-09-19T09:41:42.812 INFO:tasks.workunit.client.0.smithi042.stdout:6/711: dread - d1/d20/d6a/f5a zero size 2024-09-19T09:41:42.812 INFO:tasks.workunit.client.0.smithi042.stdout:3/756: write d4/d8/d9/dc/fa4 [972400,109233] 0 2024-09-19T09:41:42.813 INFO:tasks.workunit.client.0.smithi042.stdout:3/757: rmdir d4/d8/d9/dc/dbf/d35 39 2024-09-19T09:41:42.814 INFO:tasks.workunit.client.0.smithi042.stdout:3/758: creat d4/d8/d4c/d6b/db9/dcb/deb/ff7 x:0 0 0 2024-09-19T09:41:42.816 INFO:tasks.workunit.client.0.smithi042.stdout:3/759: mkdir d4/d8/d9/d39/df8 0 2024-09-19T09:41:42.816 INFO:tasks.workunit.client.0.smithi042.stdout:3/760: chown d4/d8/d9/dc/dbf/d5c/d82/f7a 174367292 1 2024-09-19T09:41:42.817 INFO:tasks.workunit.client.0.smithi042.stdout:3/761: creat d4/d8/d9/dc/dbf/d5c/ff9 x:0 0 0 2024-09-19T09:41:42.818 INFO:tasks.workunit.client.0.smithi042.stdout:3/762: symlink d4/d8/d9/dc/dbf/d8b/lfa 0 2024-09-19T09:41:42.820 INFO:tasks.workunit.client.0.smithi042.stdout:3/763: creat d4/d8/d9/d39/ffb x:0 0 0 2024-09-19T09:41:42.821 INFO:tasks.workunit.client.0.smithi042.stdout:4/688: sync 2024-09-19T09:41:42.821 INFO:tasks.workunit.client.0.smithi042.stdout:8/770: sync 2024-09-19T09:41:42.821 INFO:tasks.workunit.client.0.smithi042.stdout:9/531: sync 2024-09-19T09:41:42.821 INFO:tasks.workunit.client.0.smithi042.stdout:5/662: sync 2024-09-19T09:41:42.821 INFO:tasks.workunit.client.0.smithi042.stdout:7/602: sync 2024-09-19T09:41:42.821 INFO:tasks.workunit.client.0.smithi042.stdout:0/643: sync 2024-09-19T09:41:42.821 INFO:tasks.workunit.client.0.smithi042.stdout:8/771: fdatasync d1/da/f2f 0 2024-09-19T09:41:42.821 INFO:tasks.workunit.client.0.smithi042.stdout:9/532: fdatasync d8/f11 0 2024-09-19T09:41:42.821 INFO:tasks.workunit.client.0.smithi042.stdout:8/772: dread - d1/da/d14/f85 zero size 2024-09-19T09:41:42.822 INFO:tasks.workunit.client.0.smithi042.stdout:5/663: stat d2/db/d3c/c82 0 2024-09-19T09:41:42.822 INFO:tasks.workunit.client.0.smithi042.stdout:8/773: chown d1/da8/d41/l8d 2171 1 2024-09-19T09:41:42.822 INFO:tasks.workunit.client.0.smithi042.stdout:9/533: write d8/da/f10 [758767,64840] 0 2024-09-19T09:41:42.823 INFO:tasks.workunit.client.0.smithi042.stdout:4/689: truncate d0/d1b/d1c/d6a/f7c 404627 0 2024-09-19T09:41:42.823 INFO:tasks.workunit.client.0.smithi042.stdout:4/690: fdatasync d0/d1b/d1c/d2e/d3f/d6b/d8f/fe8 0 2024-09-19T09:41:42.823 INFO:tasks.workunit.client.0.smithi042.stdout:1/782: link d4/d12/d8d/d91/feb d4/d12/d8d/d91/d7f/d99/ddc/ff9 0 2024-09-19T09:41:42.823 INFO:tasks.workunit.client.0.smithi042.stdout:7/603: truncate d0/f38 1933010 0 2024-09-19T09:41:42.823 INFO:tasks.workunit.client.0.smithi042.stdout:5/664: truncate d2/d4/d64/dab/f24 1299607 0 2024-09-19T09:41:42.823 INFO:tasks.workunit.client.0.smithi042.stdout:8/774: creat d1/da8/d3d/d58/fe3 x:0 0 0 2024-09-19T09:41:42.824 INFO:tasks.workunit.client.0.smithi042.stdout:4/691: mknod d0/d1b/d1c/d2e/d3b/d95/db1/ce9 0 2024-09-19T09:41:42.824 INFO:tasks.workunit.client.0.smithi042.stdout:4/692: fsync d0/d1b/d1c/d2e/d3f/d5a/f5b 0 2024-09-19T09:41:42.824 INFO:tasks.workunit.client.0.smithi042.stdout:4/693: dread - d0/d1b/dd8/fdd zero size 2024-09-19T09:41:42.824 INFO:tasks.workunit.client.0.smithi042.stdout:4/694: write d0/d1b/d1c/d6a/f7c [353726,32012] 0 2024-09-19T09:41:42.824 INFO:tasks.workunit.client.0.smithi042.stdout:1/783: creat d4/d15/d2e/db7/d3c/dd5/ded/ffa x:0 0 0 2024-09-19T09:41:42.826 INFO:tasks.workunit.client.0.smithi042.stdout:5/665: unlink d2/c46 0 2024-09-19T09:41:42.827 INFO:tasks.workunit.client.0.smithi042.stdout:4/695: mknod d0/d1b/d69/dc0/cea 0 2024-09-19T09:41:42.827 INFO:tasks.workunit.client.0.smithi042.stdout:4/696: dread - d0/d1b/d1c/d61/d7f/d83/fc6 zero size 2024-09-19T09:41:42.827 INFO:tasks.workunit.client.0.smithi042.stdout:5/666: rmdir d2/d25/dc6 39 2024-09-19T09:41:42.831 INFO:tasks.workunit.client.0.smithi042.stdout:1/784: read d4/d4e/fc0 [584757,92336] 0 2024-09-19T09:41:42.834 INFO:tasks.workunit.client.0.smithi042.stdout:3/764: write d4/d8/d9/d39/fc0 [3585878,42439] 0 2024-09-19T09:41:42.834 INFO:tasks.workunit.client.0.smithi042.stdout:3/765: getdents d4/d8/d4c/d6b/db9/dee 0 2024-09-19T09:41:42.834 INFO:tasks.workunit.client.0.smithi042.stdout:3/766: write d4/d8/d9/d1b/fb8 [70344,114173] 0 2024-09-19T09:41:42.834 INFO:tasks.workunit.client.0.smithi042.stdout:3/767: write d4/d8/d9/dc/dbf/d6d/d8f/fc2 [3503996,49303] 0 2024-09-19T09:41:42.834 INFO:tasks.workunit.client.0.smithi042.stdout:3/768: readlink d4/la3 0 2024-09-19T09:41:42.835 INFO:tasks.workunit.client.0.smithi042.stdout:4/697: dread d0/fc [0,4194304] 0 2024-09-19T09:41:42.839 INFO:tasks.workunit.client.0.smithi042.stdout:6/712: dwrite d1/de/d76/d99/db2/d34/f3d [0,4194304] 0 2024-09-19T09:41:42.840 INFO:tasks.workunit.client.0.smithi042.stdout:6/713: truncate d1/de/d54/f87 1874514 0 2024-09-19T09:41:42.841 INFO:tasks.workunit.client.0.smithi042.stdout:4/698: creat d0/d1b/d1c/d2e/d3b/feb x:0 0 0 2024-09-19T09:41:42.843 INFO:tasks.workunit.client.0.smithi042.stdout:6/714: creat d1/de/d76/d99/db2/d34/d6f/d4a/d98/fd4 x:0 0 0 2024-09-19T09:41:42.843 INFO:tasks.workunit.client.0.smithi042.stdout:0/644: dwrite d2/d10/d6b/fb0 [0,4194304] 0 2024-09-19T09:41:42.846 INFO:tasks.workunit.client.0.smithi042.stdout:0/645: creat d2/d10/d12/d16/d57/d99/fc6 x:0 0 0 2024-09-19T09:41:42.846 INFO:tasks.workunit.client.0.smithi042.stdout:0/646: fdatasync d2/d8e/f46 0 2024-09-19T09:41:42.848 INFO:tasks.workunit.client.0.smithi042.stdout:6/715: link d1/de/d76/d99/db2/f25 d1/de/d76/d99/db2/d34/d6f/d4a/d98/fd5 0 2024-09-19T09:41:42.849 INFO:tasks.workunit.client.0.smithi042.stdout:0/647: mknod d2/d10/d12/d16/d57/d78/db3/dbc/cc7 0 2024-09-19T09:41:42.852 INFO:tasks.workunit.client.0.smithi042.stdout:9/534: dwrite d8/d1d/d28/f9d [0,4194304] 0 2024-09-19T09:41:42.855 INFO:tasks.workunit.client.0.smithi042.stdout:9/535: creat d8/da/d19/d1c/d21/d67/d7b/f9f x:0 0 0 2024-09-19T09:41:42.867 INFO:tasks.workunit.client.0.smithi042.stdout:8/775: dwrite d1/da/d14/f17 [0,4194304] 0 2024-09-19T09:41:42.869 INFO:tasks.workunit.client.0.smithi042.stdout:8/776: creat d1/da8/d3d/d58/dd1/fe4 x:0 0 0 2024-09-19T09:41:42.870 INFO:tasks.workunit.client.0.smithi042.stdout:8/777: stat d1/da/d14/c29 0 2024-09-19T09:41:42.872 INFO:tasks.workunit.client.0.smithi042.stdout:5/667: dwrite d2/db/d3c/f3f [8388608,4194304] 0 2024-09-19T09:41:42.872 INFO:tasks.workunit.client.0.smithi042.stdout:5/668: stat d2/d4/d8a 0 2024-09-19T09:41:42.872 INFO:tasks.workunit.client.0.smithi042.stdout:5/669: stat d2/db/d3c/f6e 0 2024-09-19T09:41:42.874 INFO:tasks.workunit.client.0.smithi042.stdout:5/670: mkdir d2/d4/d20/d60/dea 0 2024-09-19T09:41:42.874 INFO:tasks.workunit.client.0.smithi042.stdout:5/671: write d2/d4/f15 [12283,3550] 0 2024-09-19T09:41:42.875 INFO:tasks.workunit.client.0.smithi042.stdout:7/604: dwrite d0/d3d/f4b [0,4194304] 0 2024-09-19T09:41:42.876 INFO:tasks.workunit.client.0.smithi042.stdout:7/605: symlink d0/d3d/d55/lc1 0 2024-09-19T09:41:42.877 INFO:tasks.workunit.client.0.smithi042.stdout:5/672: write d2/d4/d64/da7/f35 [1677584,94095] 0 2024-09-19T09:41:42.877 INFO:tasks.workunit.client.0.smithi042.stdout:4/699: dwrite d0/d28/fae [0,4194304] 0 2024-09-19T09:41:42.878 INFO:tasks.workunit.client.0.smithi042.stdout:7/606: creat d0/d3d/d55/d72/fc2 x:0 0 0 2024-09-19T09:41:42.879 INFO:tasks.workunit.client.0.smithi042.stdout:5/673: mknod d2/d25/d37/dc2/ceb 0 2024-09-19T09:41:42.880 INFO:tasks.workunit.client.0.smithi042.stdout:3/769: dwrite d4/d8/d9/d1b/d4f/fe7 [0,4194304] 0 2024-09-19T09:41:42.881 INFO:tasks.workunit.client.0.smithi042.stdout:4/700: mkdir d0/d28/d87/dec 0 2024-09-19T09:41:42.881 INFO:tasks.workunit.client.0.smithi042.stdout:4/701: chown d0/d1b/d1c/d2e/d3b/d95/db1/dba/dbd/le5 148 1 2024-09-19T09:41:42.881 INFO:tasks.workunit.client.0.smithi042.stdout:4/702: getdents d0/d1b/d56/de1 0 2024-09-19T09:41:42.882 INFO:tasks.workunit.client.0.smithi042.stdout:1/785: dwrite d4/d15/d2e/db7/f72 [0,4194304] 0 2024-09-19T09:41:42.885 INFO:tasks.workunit.client.0.smithi042.stdout:3/770: mkdir d4/d8/d4c/d6b/dfc 0 2024-09-19T09:41:42.885 INFO:tasks.workunit.client.0.smithi042.stdout:3/771: stat d4/d8/d9/d39/df8 0 2024-09-19T09:41:42.885 INFO:tasks.workunit.client.0.smithi042.stdout:6/716: dwrite d1/de/d76/d99/db2/d34/f3d [4194304,4194304] 0 2024-09-19T09:41:42.886 INFO:tasks.workunit.client.0.smithi042.stdout:4/703: creat d0/d1b/d1c/d2e/d44/fed x:0 0 0 2024-09-19T09:41:42.888 INFO:tasks.workunit.client.0.smithi042.stdout:5/674: rename d2/d4/d64/da7/dda/de6/c74 to d2/de3/cec 0 2024-09-19T09:41:42.890 INFO:tasks.workunit.client.0.smithi042.stdout:1/786: symlink d4/d1e/lfb 0 2024-09-19T09:41:42.890 INFO:tasks.workunit.client.0.smithi042.stdout:8/778: dwrite d1/da/d3f/f6f [0,4194304] 0 2024-09-19T09:41:42.891 INFO:tasks.workunit.client.0.smithi042.stdout:3/772: unlink d4/d8/f1c 0 2024-09-19T09:41:42.892 INFO:tasks.workunit.client.0.smithi042.stdout:6/717: link d1/d20/d6a/fcd d1/d20/d6a/d46/d92/d3a/fd6 0 2024-09-19T09:41:42.893 INFO:tasks.workunit.client.0.smithi042.stdout:7/607: dwrite d0/d3d/d92/f95 [0,4194304] 0 2024-09-19T09:41:42.901 INFO:tasks.workunit.client.0.smithi042.stdout:8/779: symlink d1/da8/d3d/d58/dd1/le5 0 2024-09-19T09:41:42.902 INFO:tasks.workunit.client.0.smithi042.stdout:3/773: link d4/f34 d4/d8/d4c/d6b/dfc/ffd 0 2024-09-19T09:41:42.904 INFO:tasks.workunit.client.0.smithi042.stdout:4/704: dwrite d0/d1b/d1c/d2e/d3f/d5a/fb0 [0,4194304] 0 2024-09-19T09:41:42.905 INFO:tasks.workunit.client.0.smithi042.stdout:4/705: fsync d0/d67/d96/fa8 0 2024-09-19T09:41:42.905 INFO:tasks.workunit.client.0.smithi042.stdout:6/718: truncate d1/de/d76/d99/db2/d34/d3f/f5c 785709 0 2024-09-19T09:41:42.908 INFO:tasks.workunit.client.0.smithi042.stdout:8/780: mknod d1/da8/db1/dcb/ce6 0 2024-09-19T09:41:42.910 INFO:tasks.workunit.client.0.smithi042.stdout:5/675: rename d2/db/f7d to d2/d25/d37/dc2/fed 0 2024-09-19T09:41:42.910 INFO:tasks.workunit.client.0.smithi042.stdout:7/608: dwrite d0/d3d/d55/d72/f86 [0,4194304] 0 2024-09-19T09:41:42.910 INFO:tasks.workunit.client.0.smithi042.stdout:7/609: read d0/f33 [1768973,108611] 0 2024-09-19T09:41:42.914 INFO:tasks.workunit.client.0.smithi042.stdout:3/774: mknod d4/d8/d4c/d6b/dfc/cfe 0 2024-09-19T09:41:42.915 INFO:tasks.workunit.client.0.smithi042.stdout:4/706: mknod d0/d1b/d69/dc0/cee 0 2024-09-19T09:41:42.915 INFO:tasks.workunit.client.0.smithi042.stdout:4/707: chown d0/d1b/d1c/d61/d7f/fe2 13157 1 2024-09-19T09:41:42.915 INFO:tasks.workunit.client.0.smithi042.stdout:4/708: dread - d0/d1b/d1c/d61/d7f/fe3 zero size 2024-09-19T09:41:42.915 INFO:tasks.workunit.client.0.smithi042.stdout:4/709: stat d0/d1b/d1c/d2e/d3b 0 2024-09-19T09:41:42.916 INFO:tasks.workunit.client.0.smithi042.stdout:8/781: getdents d1/da 0 2024-09-19T09:41:42.917 INFO:tasks.workunit.client.0.smithi042.stdout:8/782: chown d1/l25 42 1 2024-09-19T09:41:42.920 INFO:tasks.workunit.client.0.smithi042.stdout:5/676: creat d2/d25/d37/fee x:0 0 0 2024-09-19T09:41:42.921 INFO:tasks.workunit.client.0.smithi042.stdout:2/721: sync 2024-09-19T09:41:42.923 INFO:tasks.workunit.client.0.smithi042.stdout:4/710: mknod d0/d1b/d1c/cef 0 2024-09-19T09:41:42.924 INFO:tasks.workunit.client.0.smithi042.stdout:6/719: symlink d1/de/d76/d99/db2/ld7 0 2024-09-19T09:41:42.924 INFO:tasks.workunit.client.0.smithi042.stdout:7/610: dwrite d0/d3d/d92/fa4 [0,4194304] 0 2024-09-19T09:41:42.925 INFO:tasks.workunit.client.0.smithi042.stdout:8/783: mknod d1/da8/d3d/d58/ce7 0 2024-09-19T09:41:42.927 INFO:tasks.workunit.client.0.smithi042.stdout:5/677: mkdir d2/def 0 2024-09-19T09:41:42.927 INFO:tasks.workunit.client.0.smithi042.stdout:5/678: fsync d2/db/d3c/f94 0 2024-09-19T09:41:42.928 INFO:tasks.workunit.client.0.smithi042.stdout:3/775: mkdir d4/d8/dff 0 2024-09-19T09:41:42.929 INFO:tasks.workunit.client.0.smithi042.stdout:4/711: mknod d0/d1b/d1c/cf0 0 2024-09-19T09:41:42.929 INFO:tasks.workunit.client.0.smithi042.stdout:4/712: write d0/d1b/d1c/f2c [818457,2058] 0 2024-09-19T09:41:42.930 INFO:tasks.workunit.client.0.smithi042.stdout:5/679: dread d2/d4/d64/d6a/f85 [0,4194304] 0 2024-09-19T09:41:42.930 INFO:tasks.workunit.client.0.smithi042.stdout:5/680: chown d2/d25/f9f 276 1 2024-09-19T09:41:42.930 INFO:tasks.workunit.client.0.smithi042.stdout:5/681: truncate d2/d25/d37/fee 646081 0 2024-09-19T09:41:42.931 INFO:tasks.workunit.client.0.smithi042.stdout:8/784: mkdir d1/d72/de8 0 2024-09-19T09:41:42.931 INFO:tasks.workunit.client.0.smithi042.stdout:2/722: write d7/f6a [3021707,73492] 0 2024-09-19T09:41:42.937 INFO:tasks.workunit.client.0.smithi042.stdout:5/682: write d2/db/d3c/f94 [1589289,104837] 0 2024-09-19T09:41:42.939 INFO:tasks.workunit.client.0.smithi042.stdout:5/683: link d2/d25/cb8 d2/de3/cf0 0 2024-09-19T09:41:42.939 INFO:tasks.workunit.client.0.smithi042.stdout:5/684: chown d2/d4/d64/dab/f47 7553299 1 2024-09-19T09:41:42.940 INFO:tasks.workunit.client.0.smithi042.stdout:4/713: dread d0/d1b/d1c/d2e/d3f/d5a/f5b [4194304,4194304] 0 2024-09-19T09:41:42.940 INFO:tasks.workunit.client.0.smithi042.stdout:4/714: chown d0/d1b/d1c/f51 226386 1 2024-09-19T09:41:42.941 INFO:tasks.workunit.client.0.smithi042.stdout:5/685: truncate d2/d25/f9f 3573049 0 2024-09-19T09:41:42.942 INFO:tasks.workunit.client.0.smithi042.stdout:4/715: creat d0/d1b/d1c/d2e/d3f/ff1 x:0 0 0 2024-09-19T09:41:42.942 INFO:tasks.workunit.client.0.smithi042.stdout:5/686: unlink d2/d4/d20/d60/c8c 0 2024-09-19T09:41:42.943 INFO:tasks.workunit.client.0.smithi042.stdout:5/687: getdents d2/db/d3c 0 2024-09-19T09:41:42.943 INFO:tasks.workunit.client.0.smithi042.stdout:5/688: dread - d2/d4/d20/d60/d72/fd2 zero size 2024-09-19T09:41:42.944 INFO:tasks.workunit.client.0.smithi042.stdout:5/689: chown d2/db/c6c 32672 1 2024-09-19T09:41:42.944 INFO:tasks.workunit.client.0.smithi042.stdout:4/716: symlink d0/d1b/d1c/d6a/lf2 0 2024-09-19T09:41:42.946 INFO:tasks.workunit.client.0.smithi042.stdout:4/717: mkdir d0/d28/d70/df3 0 2024-09-19T09:41:42.946 INFO:tasks.workunit.client.0.smithi042.stdout:4/718: readlink d0/l3a 0 2024-09-19T09:41:42.949 INFO:tasks.workunit.client.0.smithi042.stdout:5/690: dread d2/db/f2f [0,4194304] 0 2024-09-19T09:41:42.949 INFO:tasks.workunit.client.0.smithi042.stdout:5/691: chown d2/d4/d20/c21 50913509 1 2024-09-19T09:41:42.963 INFO:tasks.workunit.client.0.smithi042.stdout:0/648: sync 2024-09-19T09:41:42.963 INFO:tasks.workunit.client.0.smithi042.stdout:1/787: rename d4/d1e/d25/f46 to d4/d15/d19/d42/d51/db5/dd0/ffc 0 2024-09-19T09:41:42.963 INFO:tasks.workunit.client.0.smithi042.stdout:1/788: chown d4/d15/d61/fc7 0 1 2024-09-19T09:41:42.963 INFO:tasks.workunit.client.0.smithi042.stdout:1/789: truncate d4/d15/d2e/fc1 7392346 0 2024-09-19T09:41:42.963 INFO:tasks.workunit.client.0.smithi042.stdout:0/649: write d2/d10/da1/fa7 [8935156,76493] 0 2024-09-19T09:41:42.963 INFO:tasks.workunit.client.0.smithi042.stdout:0/650: readlink d2/d10/l41 0 2024-09-19T09:41:42.965 INFO:tasks.workunit.client.0.smithi042.stdout:6/720: rename d1/de/d54/l6b to d1/de/ld8 0 2024-09-19T09:41:42.966 INFO:tasks.workunit.client.0.smithi042.stdout:1/790: creat d4/d15/d19/d42/d51/db5/dd0/ffd x:0 0 0 2024-09-19T09:41:42.967 INFO:tasks.workunit.client.0.smithi042.stdout:0/651: creat d2/d10/d12/d16/d57/d78/db3/fc8 x:0 0 0 2024-09-19T09:41:42.969 INFO:tasks.workunit.client.0.smithi042.stdout:0/652: creat d2/d10/d12/d24/d5b/fc9 x:0 0 0 2024-09-19T09:41:42.969 INFO:tasks.workunit.client.0.smithi042.stdout:8/785: dwrite d1/da/dd/fbe [0,4194304] 0 2024-09-19T09:41:42.969 INFO:tasks.workunit.client.0.smithi042.stdout:8/786: chown d1/da8/d3d 240184 1 2024-09-19T09:41:42.970 INFO:tasks.workunit.client.0.smithi042.stdout:3/776: rename d4/d8/d9/dc/dbf/d5c/d82/fe9 to d4/d8/d9/dc/dbf/d5c/d82/d48/da5/f100 0 2024-09-19T09:41:42.974 INFO:tasks.workunit.client.0.smithi042.stdout:1/791: link d4/d12/d8d/d91/d7f/fba d4/d15/d9e/ffe 0 2024-09-19T09:41:42.974 INFO:tasks.workunit.client.0.smithi042.stdout:2/723: dwrite d7/dd/d14/d35/d4e/f9d [0,4194304] 0 2024-09-19T09:41:42.976 INFO:tasks.workunit.client.0.smithi042.stdout:5/692: dwrite d2/d4/d20/f62 [0,4194304] 0 2024-09-19T09:41:42.976 INFO:tasks.workunit.client.0.smithi042.stdout:5/693: write d2/d4/f67 [5091485,110339] 0 2024-09-19T09:41:42.976 INFO:tasks.workunit.client.0.smithi042.stdout:5/694: chown d2/d4/d2e/l33 0 1 2024-09-19T09:41:42.979 INFO:tasks.workunit.client.0.smithi042.stdout:6/721: rename d1/de/d76/d99/db2/c85 to d1/de/d76/d99/db2/cd9 0 2024-09-19T09:41:42.980 INFO:tasks.workunit.client.0.smithi042.stdout:0/653: getdents d2/d10/d1d/d34/d89 0 2024-09-19T09:41:42.982 INFO:tasks.workunit.client.0.smithi042.stdout:4/719: rename d0/d67/ld0 to d0/d1b/d1c/d2e/lf4 0 2024-09-19T09:41:42.982 INFO:tasks.workunit.client.0.smithi042.stdout:4/720: write d0/d1b/d1c/d2e/d3b/f3c [1213964,111355] 0 2024-09-19T09:41:42.986 INFO:tasks.workunit.client.0.smithi042.stdout:2/724: mkdir d7/dd/d14/dec 0 2024-09-19T09:41:42.987 INFO:tasks.workunit.client.0.smithi042.stdout:1/792: mknod d4/d1e/cff 0 2024-09-19T09:41:42.987 INFO:tasks.workunit.client.0.smithi042.stdout:1/793: readlink d4/d15/d19/l3f 0 2024-09-19T09:41:42.988 INFO:tasks.workunit.client.0.smithi042.stdout:3/777: dwrite d4/d8/f33 [0,4194304] 0 2024-09-19T09:41:42.988 INFO:tasks.workunit.client.0.smithi042.stdout:5/695: creat d2/d4/d20/d60/db0/ff1 x:0 0 0 2024-09-19T09:41:42.989 INFO:tasks.workunit.client.0.smithi042.stdout:8/787: rename d1/da8/d41/d55/la2 to d1/da/dd/d74/dbc/le9 0 2024-09-19T09:41:42.990 INFO:tasks.workunit.client.0.smithi042.stdout:4/721: mknod d0/d28/d70/df3/cf5 0 2024-09-19T09:41:42.991 INFO:tasks.workunit.client.0.smithi042.stdout:2/725: symlink d7/dd/d22/d30/d66/led 0 2024-09-19T09:41:42.991 INFO:tasks.workunit.client.0.smithi042.stdout:2/726: chown d7 3 1 2024-09-19T09:41:42.992 INFO:tasks.workunit.client.0.smithi042.stdout:1/794: creat d4/d15/d19/d45/f100 x:0 0 0 2024-09-19T09:41:42.994 INFO:tasks.workunit.client.0.smithi042.stdout:8/788: dread d1/da8/d41/d55/d99/da4/f6d [0,4194304] 0 2024-09-19T09:41:42.997 INFO:tasks.workunit.client.0.smithi042.stdout:6/722: rename d1/d20/d69 to d1/de/d54/dda 0 2024-09-19T09:41:42.998 INFO:tasks.workunit.client.0.smithi042.stdout:1/795: creat d4/d1e/f101 x:0 0 0 2024-09-19T09:41:42.999 INFO:tasks.workunit.client.0.smithi042.stdout:4/722: dread d0/d1b/d1c/d2e/d3f/d5a/fb0 [0,4194304] 0 2024-09-19T09:41:42.999 INFO:tasks.workunit.client.0.smithi042.stdout:4/723: stat d0/d1b/d1c/d2e/d44/cda 0 2024-09-19T09:41:42.999 INFO:tasks.workunit.client.0.smithi042.stdout:2/727: creat d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/fee x:0 0 0 2024-09-19T09:41:42.999 INFO:tasks.workunit.client.0.smithi042.stdout:2/728: fsync d7/dd/d22/d30/d66/fe2 0 2024-09-19T09:41:42.999 INFO:tasks.workunit.client.0.smithi042.stdout:9/536: sync 2024-09-19T09:41:43.000 INFO:tasks.workunit.client.0.smithi042.stdout:4/724: dread d0/d1b/d1c/d6a/f7c [0,4194304] 0 2024-09-19T09:41:43.001 INFO:tasks.workunit.client.0.smithi042.stdout:3/778: mkdir d4/d8/d101 0 2024-09-19T09:41:43.002 INFO:tasks.workunit.client.0.smithi042.stdout:0/654: dwrite d2/d8e/d32/d64/da5/d8a/d9d/d5a/d85/da6/fc1 [0,4194304] 0 2024-09-19T09:41:43.002 INFO:tasks.workunit.client.0.smithi042.stdout:0/655: chown d2/d10/d12/d24/dbd 4 1 2024-09-19T09:41:43.002 INFO:tasks.workunit.client.0.smithi042.stdout:8/789: symlink d1/da/dd/d74/dbc/dc8/lea 0 2024-09-19T09:41:43.004 INFO:tasks.workunit.client.0.smithi042.stdout:6/723: rename d1/d20/d6a/d46/f64 to d1/d20/dc6/fdb 0 2024-09-19T09:41:43.004 INFO:tasks.workunit.client.0.smithi042.stdout:9/537: mknod d8/da/d89/d8e/ca0 0 2024-09-19T09:41:43.006 INFO:tasks.workunit.client.0.smithi042.stdout:5/696: unlink d2/db/d3c/d86/f88 0 2024-09-19T09:41:43.007 INFO:tasks.workunit.client.0.smithi042.stdout:4/725: creat d0/d1b/d1c/d2e/d3f/d5a/ff6 x:0 0 0 2024-09-19T09:41:43.009 INFO:tasks.workunit.client.0.smithi042.stdout:0/656: mkdir d2/d8e/d32/d64/da5/d8a/d9d/dca 0 2024-09-19T09:41:43.009 INFO:tasks.workunit.client.0.smithi042.stdout:0/657: fdatasync d2/d10/f15 0 2024-09-19T09:41:43.009 INFO:tasks.workunit.client.0.smithi042.stdout:8/790: creat d1/da8/d41/feb x:0 0 0 2024-09-19T09:41:43.010 INFO:tasks.workunit.client.0.smithi042.stdout:0/658: creat d2/d10/d12/d24/d5b/fcb x:0 0 0 2024-09-19T09:41:43.011 INFO:tasks.workunit.client.0.smithi042.stdout:6/724: symlink d1/de/d54/ldc 0 2024-09-19T09:41:43.013 INFO:tasks.workunit.client.0.smithi042.stdout:9/538: truncate d8/db/f26 182447 0 2024-09-19T09:41:43.015 INFO:tasks.workunit.client.0.smithi042.stdout:4/726: truncate d0/d1b/d1c/d2e/d3b/f47 4745751 0 2024-09-19T09:41:43.020 INFO:tasks.workunit.client.0.smithi042.stdout:3/779: dwrite d4/d8/d9/d39/d4b/fda [0,4194304] 0 2024-09-19T09:41:43.020 INFO:tasks.workunit.client.0.smithi042.stdout:3/780: fsync d4/d8/d9/dc/fe1 0 2024-09-19T09:41:43.022 INFO:tasks.workunit.client.0.smithi042.stdout:8/791: dread d1/da/f21 [0,4194304] 0 2024-09-19T09:41:43.024 INFO:tasks.workunit.client.0.smithi042.stdout:9/539: dread d8/da/d19/d1c/d21/d7f/f5a [0,4194304] 0 2024-09-19T09:41:43.024 INFO:tasks.workunit.client.0.smithi042.stdout:9/540: chown d8/da/d19/d1c/d21/d67/c93 238314 1 2024-09-19T09:41:43.024 INFO:tasks.workunit.client.0.smithi042.stdout:9/541: truncate d8/d32/f69 863352 0 2024-09-19T09:41:43.025 INFO:tasks.workunit.client.0.smithi042.stdout:6/725: creat d1/d20/d6a/d90/fdd x:0 0 0 2024-09-19T09:41:43.031 INFO:tasks.workunit.client.0.smithi042.stdout:9/542: read d8/da/f50 [651991,72913] 0 2024-09-19T09:41:43.031 INFO:tasks.workunit.client.0.smithi042.stdout:9/543: stat d8/db/c3b 0 2024-09-19T09:41:43.031 INFO:tasks.workunit.client.0.smithi042.stdout:9/544: chown d8/da/d89 1962469813 1 2024-09-19T09:41:43.032 INFO:tasks.workunit.client.0.smithi042.stdout:3/781: link d4/d78/d9d/fa7 d4/d8/d4c/d6b/f102 0 2024-09-19T09:41:43.032 INFO:tasks.workunit.client.0.smithi042.stdout:3/782: dread - d4/d8/d9/dc/dbf/fdd zero size 2024-09-19T09:41:43.035 INFO:tasks.workunit.client.0.smithi042.stdout:6/726: creat d1/de/d12/d9a/fde x:0 0 0 2024-09-19T09:41:43.035 INFO:tasks.workunit.client.0.smithi042.stdout:6/727: chown d1/de/d76/d99/db2/d34/d6f/d4a/d98/fd5 265 1 2024-09-19T09:41:43.035 INFO:tasks.workunit.client.0.smithi042.stdout:6/728: read d1/de/d76/d99/db2/fd1 [3776855,124237] 0 2024-09-19T09:41:43.035 INFO:tasks.workunit.client.0.smithi042.stdout:6/729: readlink d1/de/la2 0 2024-09-19T09:41:43.036 INFO:tasks.workunit.client.0.smithi042.stdout:9/545: rmdir d8/da/d19/d1c/d21 39 2024-09-19T09:41:43.040 INFO:tasks.workunit.client.0.smithi042.stdout:3/783: dread d4/d8/d9/dc/dbf/d5c/f94 [0,4194304] 0 2024-09-19T09:41:43.040 INFO:tasks.workunit.client.0.smithi042.stdout:9/546: dread d8/da/d19/f7c [0,4194304] 0 2024-09-19T09:41:43.040 INFO:tasks.workunit.client.0.smithi042.stdout:8/792: truncate d1/da8/f64 614380 0 2024-09-19T09:41:43.041 INFO:tasks.workunit.client.0.smithi042.stdout:8/793: rmdir d1/da/dd 39 2024-09-19T09:41:43.041 INFO:tasks.workunit.client.0.smithi042.stdout:8/794: truncate d1/da8/d3d/f44 605659 0 2024-09-19T09:41:43.042 INFO:tasks.workunit.client.0.smithi042.stdout:9/547: write d8/da/d19/d1c/d21/d7f/f8a [1353502,49992] 0 2024-09-19T09:41:43.042 INFO:tasks.workunit.client.0.smithi042.stdout:9/548: truncate d8/da/d19/f2b 5115015 0 2024-09-19T09:41:43.042 INFO:tasks.workunit.client.0.smithi042.stdout:8/795: creat d1/da8/d41/d55/d99/da4/dc2/fec x:0 0 0 2024-09-19T09:41:43.043 INFO:tasks.workunit.client.0.smithi042.stdout:8/796: chown d1/da/dd/d74/f9e 112547780 1 2024-09-19T09:41:43.043 INFO:tasks.workunit.client.0.smithi042.stdout:8/797: stat d1/da8/d41/ca1 0 2024-09-19T09:41:43.043 INFO:tasks.workunit.client.0.smithi042.stdout:8/798: chown d1/l62 15359251 1 2024-09-19T09:41:43.044 INFO:tasks.workunit.client.0.smithi042.stdout:8/799: creat d1/d72/de8/fed x:0 0 0 2024-09-19T09:41:43.045 INFO:tasks.workunit.client.0.smithi042.stdout:8/800: mknod d1/da/dd/d74/dbc/dc8/cee 0 2024-09-19T09:41:43.045 INFO:tasks.workunit.client.0.smithi042.stdout:6/730: write d1/de/d76/d99/db2/d34/d6f/d4a/f6c [3323481,58244] 0 2024-09-19T09:41:43.048 INFO:tasks.workunit.client.0.smithi042.stdout:8/801: creat d1/da8/d41/d55/d99/da4/dc2/fef x:0 0 0 2024-09-19T09:41:43.048 INFO:tasks.workunit.client.0.smithi042.stdout:8/802: readlink d1/d72/lcc 0 2024-09-19T09:41:43.050 INFO:tasks.workunit.client.0.smithi042.stdout:6/731: creat d1/d20/d6a/fdf x:0 0 0 2024-09-19T09:41:43.050 INFO:tasks.workunit.client.0.smithi042.stdout:6/732: chown d1/f6 8608185 1 2024-09-19T09:41:43.050 INFO:tasks.workunit.client.0.smithi042.stdout:6/733: fdatasync d1/de/d12/f19 0 2024-09-19T09:41:43.050 INFO:tasks.workunit.client.0.smithi042.stdout:8/803: rmdir d1/da/dcd 39 2024-09-19T09:41:43.052 INFO:tasks.workunit.client.0.smithi042.stdout:8/804: dread d1/da/dd/d74/dbc/fc0 [0,4194304] 0 2024-09-19T09:41:43.053 INFO:tasks.workunit.client.0.smithi042.stdout:1/796: rename d4/d12/d8d/d91/d7f/d99/ddc/f3b to d4/d29/f102 0 2024-09-19T09:41:43.054 INFO:tasks.workunit.client.0.smithi042.stdout:8/805: creat d1/ddc/ff0 x:0 0 0 2024-09-19T09:41:43.055 INFO:tasks.workunit.client.0.smithi042.stdout:7/611: sync 2024-09-19T09:41:43.055 INFO:tasks.workunit.client.0.smithi042.stdout:7/612: fdatasync d0/f38 0 2024-09-19T09:41:43.057 INFO:tasks.workunit.client.0.smithi042.stdout:2/729: rename d7/dd/d48/fa7 to d7/dd/d14/d35/d4c/d61/d87/da6/fef 0 2024-09-19T09:41:43.057 INFO:tasks.workunit.client.0.smithi042.stdout:1/797: dread d4/d15/d2e/db7/d3c/f59 [0,4194304] 0 2024-09-19T09:41:43.058 INFO:tasks.workunit.client.0.smithi042.stdout:7/613: creat d0/d56/da9/fc3 x:0 0 0 2024-09-19T09:41:43.059 INFO:tasks.workunit.client.0.smithi042.stdout:3/784: dwrite d4/f92 [0,4194304] 0 2024-09-19T09:41:43.059 INFO:tasks.workunit.client.0.smithi042.stdout:3/785: fsync d4/d8/d9/dc/dbf/d5c/d82/d48/da5/fb4 0 2024-09-19T09:41:43.059 INFO:tasks.workunit.client.0.smithi042.stdout:0/659: rename d2/d10/d1d/d34/f74 to d2/d8e/d32/d64/da5/d8a/d9d/d5a/d85/fcc 0 2024-09-19T09:41:43.060 INFO:tasks.workunit.client.0.smithi042.stdout:1/798: write d4/f22 [798492,74817] 0 2024-09-19T09:41:43.060 INFO:tasks.workunit.client.0.smithi042.stdout:2/730: symlink d7/dd/d14/d35/d4c/d61/d87/dc3/lf0 0 2024-09-19T09:41:43.060 INFO:tasks.workunit.client.0.smithi042.stdout:7/614: truncate d0/d14/d44/d47/faf 5120969 0 2024-09-19T09:41:43.061 INFO:tasks.workunit.client.0.smithi042.stdout:6/734: dread d1/de/d12/f19 [0,4194304] 0 2024-09-19T09:41:43.061 INFO:tasks.workunit.client.0.smithi042.stdout:3/786: creat d4/d8/d9/dc/dbf/d5c/d82/f103 x:0 0 0 2024-09-19T09:41:43.063 INFO:tasks.workunit.client.0.smithi042.stdout:4/727: rename d0/d28/d70/df3 to d0/d28/d87/dec/df7 0 2024-09-19T09:41:43.064 INFO:tasks.workunit.client.0.smithi042.stdout:0/660: mknod d2/d10/d1d/d34/d89/ccd 0 2024-09-19T09:41:43.067 INFO:tasks.workunit.client.0.smithi042.stdout:1/799: symlink d4/d12/d8d/dca/dd4/l103 0 2024-09-19T09:41:43.067 INFO:tasks.workunit.client.0.smithi042.stdout:1/800: fsync d4/d4e/f57 0 2024-09-19T09:41:43.067 INFO:tasks.workunit.client.0.smithi042.stdout:1/801: write d4/d15/d19/d42/d51/db5/ff7 [1751813,10422] 0 2024-09-19T09:41:43.067 INFO:tasks.workunit.client.0.smithi042.stdout:1/802: chown d4/d12/d8d/fe5 7145444 1 2024-09-19T09:41:43.067 INFO:tasks.workunit.client.0.smithi042.stdout:1/803: truncate d4/d15/d2e/db7/f97 286560 0 2024-09-19T09:41:43.068 INFO:tasks.workunit.client.0.smithi042.stdout:2/731: mknod d7/dd/d22/d30/d66/cf1 0 2024-09-19T09:41:43.069 INFO:tasks.workunit.client.0.smithi042.stdout:1/804: dread d4/f7b [0,4194304] 0 2024-09-19T09:41:43.070 INFO:tasks.workunit.client.0.smithi042.stdout:6/735: mknod d1/de/d12/d9a/ce0 0 2024-09-19T09:41:43.070 INFO:tasks.workunit.client.0.smithi042.stdout:6/736: fdatasync d1/de/d5d/fd0 0 2024-09-19T09:41:43.072 INFO:tasks.workunit.client.0.smithi042.stdout:0/661: symlink d2/d10/d1e/db2/lce 0 2024-09-19T09:41:43.073 INFO:tasks.workunit.client.0.smithi042.stdout:2/732: mknod d7/dd/cf2 0 2024-09-19T09:41:43.080 INFO:tasks.workunit.client.0.smithi042.stdout:8/806: dwrite d1/da/d3f/f50 [0,4194304] 0 2024-09-19T09:41:43.080 INFO:tasks.workunit.client.0.smithi042.stdout:8/807: truncate d1/ddc/fdd 526498 0 2024-09-19T09:41:43.080 INFO:tasks.workunit.client.0.smithi042.stdout:9/549: dwrite d8/da/d19/d1c/f9e [0,4194304] 0 2024-09-19T09:41:43.081 INFO:tasks.workunit.client.0.smithi042.stdout:6/737: dread d1/d20/d6a/d46/d92/d3a/f75 [0,4194304] 0 2024-09-19T09:41:43.081 INFO:tasks.workunit.client.0.smithi042.stdout:3/787: read d4/d8/d9/dc/f9b [3671367,115832] 0 2024-09-19T09:41:43.081 INFO:tasks.workunit.client.0.smithi042.stdout:6/738: truncate d1/f8d 2054647 0 2024-09-19T09:41:43.081 INFO:tasks.workunit.client.0.smithi042.stdout:8/808: creat d1/da8/d41/ff1 x:0 0 0 2024-09-19T09:41:43.081 INFO:tasks.workunit.client.0.smithi042.stdout:8/809: chown d1/da/dd/d74/f7e 1952 1 2024-09-19T09:41:43.081 INFO:tasks.workunit.client.0.smithi042.stdout:7/615: write d0/f27 [1518949,112768] 0 2024-09-19T09:41:43.083 INFO:tasks.workunit.client.0.smithi042.stdout:3/788: rename d4/d2a to d4/d8/d9/dc/dbf/d5c/d82/d8c/d104 0 2024-09-19T09:41:43.085 INFO:tasks.workunit.client.0.smithi042.stdout:6/739: creat d1/de/d76/d99/db2/d34/fe1 x:0 0 0 2024-09-19T09:41:43.085 INFO:tasks.workunit.client.0.smithi042.stdout:1/805: dread d4/d15/d2e/db7/d3c/f43 [0,4194304] 0 2024-09-19T09:41:43.085 INFO:tasks.workunit.client.0.smithi042.stdout:1/806: getdents d4/d15/d2e 0 2024-09-19T09:41:43.085 INFO:tasks.workunit.client.0.smithi042.stdout:7/616: unlink d0/d56/c60 0 2024-09-19T09:41:43.085 INFO:tasks.workunit.client.0.smithi042.stdout:7/617: read - d0/d40/d9d/fa3 zero size 2024-09-19T09:41:43.086 INFO:tasks.workunit.client.0.smithi042.stdout:7/618: dread d0/d3d/d55/f71 [0,4194304] 0 2024-09-19T09:41:43.087 INFO:tasks.workunit.client.0.smithi042.stdout:7/619: chown d0/d40/l98 7532889 1 2024-09-19T09:41:43.087 INFO:tasks.workunit.client.0.smithi042.stdout:6/740: rmdir d1/d20/d6a/d90/dc8 0 2024-09-19T09:41:43.087 INFO:tasks.workunit.client.0.smithi042.stdout:6/741: truncate d1/de/d5d/f61 1271256 0 2024-09-19T09:41:43.088 INFO:tasks.workunit.client.0.smithi042.stdout:8/810: rename d1/c76 to d1/da/dd/dac/cf2 0 2024-09-19T09:41:43.088 INFO:tasks.workunit.client.0.smithi042.stdout:7/620: dread d0/f1a [4194304,4194304] 0 2024-09-19T09:41:43.093 INFO:tasks.workunit.client.0.smithi042.stdout:0/662: dwrite d2/d10/fbb [0,4194304] 0 2024-09-19T09:41:43.093 INFO:tasks.workunit.client.0.smithi042.stdout:9/550: write d8/d1d/d28/f9d [2284395,104519] 0 2024-09-19T09:41:43.093 INFO:tasks.workunit.client.0.smithi042.stdout:0/663: read d2/fe [1651242,59832] 0 2024-09-19T09:41:43.094 INFO:tasks.workunit.client.0.smithi042.stdout:1/807: truncate d4/d15/d19/d42/d51/ff4 262950 0 2024-09-19T09:41:43.094 INFO:tasks.workunit.client.0.smithi042.stdout:6/742: creat d1/d20/d6a/d90/fe2 x:0 0 0 2024-09-19T09:41:43.095 INFO:tasks.workunit.client.0.smithi042.stdout:7/621: mkdir d0/d14/d3a/dc4 0 2024-09-19T09:41:43.095 INFO:tasks.workunit.client.0.smithi042.stdout:7/622: fdatasync d0/f36 0 2024-09-19T09:41:43.095 INFO:tasks.workunit.client.0.smithi042.stdout:7/623: readlink d0/d3d/d55/d72/lbd 0 2024-09-19T09:41:43.097 INFO:tasks.workunit.client.0.smithi042.stdout:9/551: dread d8/d1d/f1f [0,4194304] 0 2024-09-19T09:41:43.097 INFO:tasks.workunit.client.0.smithi042.stdout:9/552: write d8/da/f50 [8389480,52427] 0 2024-09-19T09:41:43.097 INFO:tasks.workunit.client.0.smithi042.stdout:4/728: dwrite d0/d1b/d1c/f59 [0,4194304] 0 2024-09-19T09:41:43.101 INFO:tasks.workunit.client.0.smithi042.stdout:4/729: rmdir d0/d1b/d1c/d2e/d3f/d6b/d8f 39 2024-09-19T09:41:43.108 INFO:tasks.workunit.client.0.smithi042.stdout:0/664: creat d2/d10/d12/fcf x:0 0 0 2024-09-19T09:41:43.228 INFO:tasks.workunit.client.0.smithi042.stdout:9/553: symlink d8/d1d/d28/la1 0 2024-09-19T09:41:43.228 INFO:tasks.workunit.client.0.smithi042.stdout:9/554: creat d8/da/d19/d1c/d21/d67/d7b/fa2 x:0 0 0 2024-09-19T09:41:43.228 INFO:tasks.workunit.client.0.smithi042.stdout:9/555: getdents d8/da/d19/d1c/d21 0 2024-09-19T09:41:43.228 INFO:tasks.workunit.client.0.smithi042.stdout:9/556: truncate d8/da/d19/d1c/d21/f96 774994 0 2024-09-19T09:41:43.228 INFO:tasks.workunit.client.0.smithi042.stdout:9/557: unlink d8/d32/f48 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:9/558: chown d8/db/d31/c85 24151 1 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:9/559: mknod d8/da/d19/d1c/d21/d67/d88/ca3 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:9/560: getdents d8/db/d31/d39 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:3/789: dwrite d4/d8/d4c/f5f [0,4194304] 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:9/561: write d8/f1a [1470612,71809] 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:3/790: mknod d4/d8/d9/dc/dbf/d35/c105 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:6/743: dwrite d1/d20/d6a/d46/d92/d3a/f42 [0,4194304] 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:1/808: dwrite d4/d15/d44/f71 [4194304,4194304] 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:1/809: chown d4/d1e/cff 537 1 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:9/562: read d8/db/f61 [575637,114193] 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:5/697: sync 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:5/698: mknod d2/d4/d20/d60/db0/cf2 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:5/699: write d2/d4/d64/da7/dda/de6/fca [974377,32135] 0 2024-09-19T09:41:43.229 INFO:tasks.workunit.client.0.smithi042.stdout:3/791: dwrite d4/d8/d9/d1b/fd1 [0,4194304] 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:3/792: mknod d4/d8/d4c/d6b/db9/c106 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:3/793: mkdir d4/d8/d9/dc/dbf/d107 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:3/794: stat d4/d8/d9/d1b/fd1 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:3/795: creat d4/d8/d9/d1b/f108 x:0 0 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:0/665: rename d2/d8e/d32/d64 to d2/d10/d12/d16/d57/d99/dd0 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:6/744: dwrite d1/d20/d6a/d90/fdd [0,4194304] 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:9/563: rename d8/da/d19/d1c/d21/d67/f62 to d8/d1d/d28/fa4 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:0/666: unlink d2/d8e/f70 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:1/810: link d4/d15/d19/d42/d51/d79/cad d4/d1e/c104 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:9/564: mkdir d8/da/d19/d1c/da5 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:9/565: dread d8/da/d19/d1c/d21/f84 [0,4194304] 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:9/566: readlink d8/db/d31/d39/l60 0 2024-09-19T09:41:43.230 INFO:tasks.workunit.client.0.smithi042.stdout:0/667: unlink d2/d10/d12/d16/d51/f76 0 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:0/668: write d2/d10/d12/d16/d57/d99/fc6 [258881,56209] 0 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:3/796: dwrite d4/d8/d9/dc/dbf/d5c/d82/d48/f5a [0,4194304] 0 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:3/797: rmdir d4/d8/d9/dc/dbf/d5c 39 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:0/669: write d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da6/fc1 [1644995,90243] 0 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:0/670: creat d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/db5/fd1 x:0 0 0 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:0/671: chown d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/db5 592 1 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:0/672: rmdir d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d 39 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:0/673: truncate d2/d8e/d32/f72 749350 0 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:0/674: creat d2/d10/fd2 x:0 0 0 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:3/798: dread d4/d8/f33 [0,4194304] 0 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:0/675: creat d2/d10/d12/d24/d5b/fd3 x:0 0 0 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:3/799: creat d4/d8/dff/f109 x:0 0 0 2024-09-19T09:41:43.231 INFO:tasks.workunit.client.0.smithi042.stdout:3/800: chown d4/d8/d9/c5e 29 1 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:9/567: dwrite d8/d1d/d28/fa4 [0,4194304] 0 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:1/811: dwrite d4/d15/d19/d42/f9c [4194304,4194304] 0 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:8/811: sync 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:2/733: sync 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:5/700: rename d2/d25/d37/f63 to d2/d4/d64/d6a/ff3 0 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:8/812: truncate d1/da8/d41/ff1 328994 0 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:2/734: dread - d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/fd7 zero size 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:8/813: write d1/db2/fd4 [325966,105102] 0 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:5/701: creat d2/d4/d20/ff4 x:0 0 0 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:1/812: mkdir d4/d15/d2e/d105 0 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:1/813: read - d4/d1e/ff1 zero size 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:1/814: readlink d4/l9a 0 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:0/676: read d2/d10/d12/d16/d57/d99/dd0/da5/f47 [898202,93101] 0 2024-09-19T09:41:43.232 INFO:tasks.workunit.client.0.smithi042.stdout:5/702: unlink d2/d4/d20/d60/c8b 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:5/703: fsync d2/d4/d64/d6a/fbd 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:2/735: rename d7/dd/d14/d35/d4e/d63/f81 to d7/dd/d14/d35/d45/ff3 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:2/736: chown d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/fee 11155 1 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:0/677: mknod d2/d10/d12/d16/d57/d99/dd0/da5/d8a/cd4 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:1/815: rename d4/d4e to d4/d12/d8d/d91/d106 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:0/678: dread d2/d10/d12/d16/f9b [0,4194304] 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:0/679: chown d2/d10/d1d/c67 8 1 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:0/680: chown d2/d8e/f46 6310 1 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:2/737: unlink d7/l11 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:5/704: dread d2/d4/d2e/f4c [0,4194304] 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:5/705: write d2/d4/d20/d60/d72/f84 [1755013,62748] 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:0/681: truncate d2/d10/d1d/f59 53567 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:5/706: truncate d2/d4/d64/d6a/fb6 469292 0 2024-09-19T09:41:43.233 INFO:tasks.workunit.client.0.smithi042.stdout:2/738: mknod d7/dd/d14/d35/cf4 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:2/739: truncate d7/f4b 4869537 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:0/682: mknod d2/d10/d12/d24/dbd/cd5 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:0/683: unlink d2/d8e/d32/f72 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:0/684: write d2/d10/d12/f31 [1276803,108683] 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:0/685: write d2/d10/d1e/f6c [5015832,122021] 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:2/740: creat d7/dd/d14/d35/ff5 x:0 0 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:5/707: stat d2/d4/d64/da7/dda/de6 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:0/686: rename d2/d10/da1/fa7 to d2/d10/d12/d16/d57/d99/dd0/da5/d8a/fd6 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:3/801: dwrite d4/d8/d9/d1b/fc8 [0,4194304] 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:3/802: fdatasync d4/d8/d9/d1b/f108 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:2/741: dread d7/dd/f37 [0,4194304] 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:5/708: truncate d2/d4/fa 2942032 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:3/803: symlink d4/d8/d9/dc/dbf/l10a 0 2024-09-19T09:41:43.234 INFO:tasks.workunit.client.0.smithi042.stdout:3/804: creat d4/d8/d9/dc/dbf/d6d/d8f/dcd/f10b x:0 0 0 2024-09-19T09:41:43.235 INFO:tasks.workunit.client.0.smithi042.stdout:3/805: truncate d4/d8/fb2 437026 0 2024-09-19T09:41:43.235 INFO:tasks.workunit.client.0.smithi042.stdout:9/568: dwrite d8/da/d19/d1c/d21/d67/d7b/f9f [0,4194304] 0 2024-09-19T09:41:43.235 INFO:tasks.workunit.client.0.smithi042.stdout:1/816: dwrite d4/d15/d19/fec [0,4194304] 0 2024-09-19T09:41:43.235 INFO:tasks.workunit.client.0.smithi042.stdout:2/742: dread d7/dd/d14/d35/d4c/f76 [0,4194304] 0 2024-09-19T09:41:43.235 INFO:tasks.workunit.client.0.smithi042.stdout:9/569: symlink d8/da/d70/la6 0 2024-09-19T09:41:43.235 INFO:tasks.workunit.client.0.smithi042.stdout:8/814: dwrite d1/db2/f93 [0,4194304] 0 2024-09-19T09:41:43.235 INFO:tasks.workunit.client.0.smithi042.stdout:1/817: creat d4/d15/d61/d85/dc9/f107 x:0 0 0 2024-09-19T09:41:43.236 INFO:tasks.workunit.client.0.smithi042.stdout:2/743: truncate d7/dd/d48/d96/fba 594056 0 2024-09-19T09:41:43.236 INFO:tasks.workunit.client.0.smithi042.stdout:9/570: mkdir d8/da/d89/da7 0 2024-09-19T09:41:43.236 INFO:tasks.workunit.client.0.smithi042.stdout:9/571: fsync f5 0 2024-09-19T09:41:43.237 INFO:tasks.workunit.client.0.smithi042.stdout:0/687: dread d2/d10/d6b/fb0 [0,4194304] 0 2024-09-19T09:41:43.239 INFO:tasks.workunit.client.0.smithi042.stdout:9/572: mknod d8/da/d19/ca8 0 2024-09-19T09:41:43.239 INFO:tasks.workunit.client.0.smithi042.stdout:9/573: stat d8/da/d19/d1c/d21/d67/d7b 0 2024-09-19T09:41:43.242 INFO:tasks.workunit.client.0.smithi042.stdout:0/688: creat d2/d10/d12/d16/d51/fd7 x:0 0 0 2024-09-19T09:41:43.244 INFO:tasks.workunit.client.0.smithi042.stdout:2/744: mknod d7/dd/d1f/cf6 0 2024-09-19T09:41:43.244 INFO:tasks.workunit.client.0.smithi042.stdout:2/745: fdatasync d7/dd/d14/d35/d4c/d70/f7a 0 2024-09-19T09:41:43.245 INFO:tasks.workunit.client.0.smithi042.stdout:9/574: truncate d8/d1d/d28/f2d 5665985 0 2024-09-19T09:41:43.245 INFO:tasks.workunit.client.0.smithi042.stdout:2/746: dread d7/dd/d14/f7f [0,4194304] 0 2024-09-19T09:41:43.246 INFO:tasks.workunit.client.0.smithi042.stdout:0/689: symlink d2/d10/ld8 0 2024-09-19T09:41:43.247 INFO:tasks.workunit.client.0.smithi042.stdout:0/690: readlink d2/d10/l7a 0 2024-09-19T09:41:43.247 INFO:tasks.workunit.client.0.smithi042.stdout:0/691: stat d2/d8e/l58 0 2024-09-19T09:41:43.248 INFO:tasks.workunit.client.0.smithi042.stdout:5/709: dwrite d2/db/d3c/f94 [0,4194304] 0 2024-09-19T09:41:43.248 INFO:tasks.workunit.client.0.smithi042.stdout:5/710: chown d2/db/c68 118702 1 2024-09-19T09:41:43.248 INFO:tasks.workunit.client.0.smithi042.stdout:9/575: mknod d8/da/d89/da7/ca9 0 2024-09-19T09:41:43.248 INFO:tasks.workunit.client.0.smithi042.stdout:5/711: getdents d2/d4/d64/da7/db4/dd8 0 2024-09-19T09:41:43.248 INFO:tasks.workunit.client.0.smithi042.stdout:5/712: write d2/d4/d20/d60/d72/d75/fd9 [693471,27195] 0 2024-09-19T09:41:43.248 INFO:tasks.workunit.client.0.smithi042.stdout:9/576: read d8/da/d19/f7c [17455,28112] 0 2024-09-19T09:41:43.248 INFO:tasks.workunit.client.0.smithi042.stdout:5/713: readlink d2/d25/d37/l4f 0 2024-09-19T09:41:43.248 INFO:tasks.workunit.client.0.smithi042.stdout:2/747: creat d7/dd/d22/d30/d66/ff7 x:0 0 0 2024-09-19T09:41:43.249 INFO:tasks.workunit.client.0.smithi042.stdout:5/714: creat d2/d4/d20/ff5 x:0 0 0 2024-09-19T09:41:43.250 INFO:tasks.workunit.client.0.smithi042.stdout:7/624: sync 2024-09-19T09:41:43.250 INFO:tasks.workunit.client.0.smithi042.stdout:4/730: sync 2024-09-19T09:41:43.251 INFO:tasks.workunit.client.0.smithi042.stdout:2/748: creat d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/ff8 x:0 0 0 2024-09-19T09:41:43.251 INFO:tasks.workunit.client.0.smithi042.stdout:2/749: fsync d7/dd/d14/d35/d4c/d70/f7a 0 2024-09-19T09:41:43.251 INFO:tasks.workunit.client.0.smithi042.stdout:2/750: stat d7/dd/d14/d35/d4c/cb2 0 2024-09-19T09:41:43.251 INFO:tasks.workunit.client.0.smithi042.stdout:1/818: dwrite d4/d29/f102 [0,4194304] 0 2024-09-19T09:41:43.251 INFO:tasks.workunit.client.0.smithi042.stdout:1/819: chown d4/d12/d8d/d91/d7f/d99 401997 1 2024-09-19T09:41:43.252 INFO:tasks.workunit.client.0.smithi042.stdout:2/751: truncate d7/dd/d14/d35/d45/d5e/d79/fa1 400453 0 2024-09-19T09:41:43.254 INFO:tasks.workunit.client.0.smithi042.stdout:9/577: creat d8/db/d31/d39/faa x:0 0 0 2024-09-19T09:41:43.254 INFO:tasks.workunit.client.0.smithi042.stdout:9/578: fsync d8/da/d19/d1c/d21/d67/f5b 0 2024-09-19T09:41:43.254 INFO:tasks.workunit.client.0.smithi042.stdout:8/815: dwrite d1/da8/d41/d55/d99/da4/f6d [0,4194304] 0 2024-09-19T09:41:43.256 INFO:tasks.workunit.client.0.smithi042.stdout:2/752: link d7/dd/f12 d7/dd/d14/dec/ff9 0 2024-09-19T09:41:43.257 INFO:tasks.workunit.client.0.smithi042.stdout:7/625: creat d0/d14/d44/fc5 x:0 0 0 2024-09-19T09:41:43.258 INFO:tasks.workunit.client.0.smithi042.stdout:9/579: creat d8/da/d19/d1c/d21/d7f/d72/fab x:0 0 0 2024-09-19T09:41:43.262 INFO:tasks.workunit.client.0.smithi042.stdout:4/731: write d0/d1b/d1c/d61/d7f/fe2 [1971535,32389] 0 2024-09-19T09:41:43.262 INFO:tasks.workunit.client.0.smithi042.stdout:4/732: truncate d0/d1b/d1c/fb4 1735195 0 2024-09-19T09:41:43.263 INFO:tasks.workunit.client.0.smithi042.stdout:8/816: mkdir d1/db2/df3 0 2024-09-19T09:41:43.264 INFO:tasks.workunit.client.0.smithi042.stdout:2/753: mkdir d7/dd/d1f/d3f/dfa 0 2024-09-19T09:41:43.264 INFO:tasks.workunit.client.0.smithi042.stdout:7/626: read d0/d40/f4f [2985833,112781] 0 2024-09-19T09:41:43.264 INFO:tasks.workunit.client.0.smithi042.stdout:9/580: dread d8/da/f50 [0,4194304] 0 2024-09-19T09:41:43.265 INFO:tasks.workunit.client.0.smithi042.stdout:4/733: truncate d0/f71 6418972 0 2024-09-19T09:41:43.267 INFO:tasks.workunit.client.0.smithi042.stdout:8/817: creat d1/da8/db1/dcb/ff4 x:0 0 0 2024-09-19T09:41:43.267 INFO:tasks.workunit.client.0.smithi042.stdout:8/818: write d1/da/dd/d74/f9e [275762,129636] 0 2024-09-19T09:41:43.267 INFO:tasks.workunit.client.0.smithi042.stdout:8/819: fdatasync d1/da8/db1/dcb/ff4 0 2024-09-19T09:41:43.270 INFO:tasks.workunit.client.0.smithi042.stdout:8/820: link d1/da/d3f/fd8 d1/d2e/ff5 0 2024-09-19T09:41:43.271 INFO:tasks.workunit.client.0.smithi042.stdout:8/821: truncate d1/da8/d41/d55/d99/da4/dc2/fef 500919 0 2024-09-19T09:41:43.271 INFO:tasks.workunit.client.0.smithi042.stdout:9/581: dread d8/db/d31/f97 [0,4194304] 0 2024-09-19T09:41:43.271 INFO:tasks.workunit.client.0.smithi042.stdout:0/692: dwrite d2/d10/d12/d16/f9b [0,4194304] 0 2024-09-19T09:41:43.272 INFO:tasks.workunit.client.0.smithi042.stdout:5/715: dwrite d2/d4/d20/d60/d72/fa6 [0,4194304] 0 2024-09-19T09:41:43.272 INFO:tasks.workunit.client.0.smithi042.stdout:4/734: dread d0/d1b/d1c/d61/d7f/fe2 [0,4194304] 0 2024-09-19T09:41:43.272 INFO:tasks.workunit.client.0.smithi042.stdout:4/735: dread - d0/d1b/d1c/d2e/d3f/d6b/fe0 zero size 2024-09-19T09:41:43.273 INFO:tasks.workunit.client.0.smithi042.stdout:6/745: sync 2024-09-19T09:41:43.274 INFO:tasks.workunit.client.0.smithi042.stdout:7/627: link d0/d14/d3a/c8e d0/d40/d9d/db5/cc6 0 2024-09-19T09:41:43.278 INFO:tasks.workunit.client.0.smithi042.stdout:9/582: link d8/da/d19/l71 d8/da/d19/lac 0 2024-09-19T09:41:43.278 INFO:tasks.workunit.client.0.smithi042.stdout:8/822: write d1/da/dd/f5c [787498,51929] 0 2024-09-19T09:41:43.278 INFO:tasks.workunit.client.0.smithi042.stdout:8/823: truncate d1/da/dd/fbb 624380 0 2024-09-19T09:41:43.279 INFO:tasks.workunit.client.0.smithi042.stdout:8/824: readlink d1/da/d14/l61 0 2024-09-19T09:41:43.279 INFO:tasks.workunit.client.0.smithi042.stdout:8/825: chown d1/da/d3f/f98 3 1 2024-09-19T09:41:43.281 INFO:tasks.workunit.client.0.smithi042.stdout:4/736: chown d0/d1b/f6f 227 1 2024-09-19T09:41:43.281 INFO:tasks.workunit.client.0.smithi042.stdout:6/746: mknod d1/de/da7/ce3 0 2024-09-19T09:41:43.281 INFO:tasks.workunit.client.0.smithi042.stdout:6/747: dread - d1/de/d12/d9a/faf zero size 2024-09-19T09:41:43.285 INFO:tasks.workunit.client.0.smithi042.stdout:4/737: symlink d0/d1b/d1c/d2e/d3b/d95/db1/dba/lf8 0 2024-09-19T09:41:43.288 INFO:tasks.workunit.client.0.smithi042.stdout:4/738: dread d0/d1b/d1c/f2c [0,4194304] 0 2024-09-19T09:41:43.289 INFO:tasks.workunit.client.0.smithi042.stdout:2/754: rmdir d7/dd/d14/d35/d45/d5e/d79 39 2024-09-19T09:41:43.291 INFO:tasks.workunit.client.0.smithi042.stdout:4/739: mkdir d0/d28/d36/df9 0 2024-09-19T09:41:43.292 INFO:tasks.workunit.client.0.smithi042.stdout:4/740: mkdir d0/d1b/dd8/dfa 0 2024-09-19T09:41:43.296 INFO:tasks.workunit.client.0.smithi042.stdout:0/693: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da0/fab [0,4194304] 0 2024-09-19T09:41:43.309 INFO:tasks.workunit.client.0.smithi042.stdout:5/716: rename d2/d4/d64/da7/f1f to d2/d25/d37/dc2/ff6 0 2024-09-19T09:41:43.311 INFO:tasks.workunit.client.0.smithi042.stdout:4/741: rename d0/d1b/f2f to d0/ffb 0 2024-09-19T09:41:43.312 INFO:tasks.workunit.client.0.smithi042.stdout:6/748: dwrite d1/de/d76/d99/db2/d34/d3f/f5c [0,4194304] 0 2024-09-19T09:41:43.312 INFO:tasks.workunit.client.0.smithi042.stdout:9/583: dwrite d8/db/d31/d39/f81 [0,4194304] 0 2024-09-19T09:41:43.312 INFO:tasks.workunit.client.0.smithi042.stdout:2/755: dwrite d7/dd/d14/d35/d4c/d61/f8a [0,4194304] 0 2024-09-19T09:41:43.313 INFO:tasks.workunit.client.0.smithi042.stdout:4/742: link d0/d1b/d69/dc0/cd4 d0/d1b/d1c/d2e/d3b/d95/db1/dba/dbd/cfc 0 2024-09-19T09:41:43.313 INFO:tasks.workunit.client.0.smithi042.stdout:4/743: fdatasync d0/d1b/d1c/d2e/f9a 0 2024-09-19T09:41:43.317 INFO:tasks.workunit.client.0.smithi042.stdout:9/584: mkdir d8/db/d31/d39/d87/dad 0 2024-09-19T09:41:43.319 INFO:tasks.workunit.client.0.smithi042.stdout:2/756: creat d7/dd/d14/dec/ffb x:0 0 0 2024-09-19T09:41:43.321 INFO:tasks.workunit.client.0.smithi042.stdout:4/744: getdents d0/d1b/d1c/d2e/d3f/d6e 0 2024-09-19T09:41:43.321 INFO:tasks.workunit.client.0.smithi042.stdout:4/745: dread - d0/d1b/d1c/d2e/d3b/feb zero size 2024-09-19T09:41:43.322 INFO:tasks.workunit.client.0.smithi042.stdout:2/757: mknod d7/dd/d14/d35/d4c/d61/d87/dbf/cfc 0 2024-09-19T09:41:43.324 INFO:tasks.workunit.client.0.smithi042.stdout:4/746: creat d0/d1b/d1c/d2e/ffd x:0 0 0 2024-09-19T09:41:43.325 INFO:tasks.workunit.client.0.smithi042.stdout:2/758: mkdir d7/dd/d14/dec/dfd 0 2024-09-19T09:41:43.328 INFO:tasks.workunit.client.0.smithi042.stdout:2/759: write d7/dd/d14/d35/d45/d5e/d79/f9f [419788,129372] 0 2024-09-19T09:41:43.328 INFO:tasks.workunit.client.0.smithi042.stdout:2/760: creat d7/dd/d14/d35/d4c/d61/d87/dc6/ffe x:0 0 0 2024-09-19T09:41:43.328 INFO:tasks.workunit.client.0.smithi042.stdout:2/761: dread - d7/dd/d14/d35/d4c/d61/d87/dc6/fd8 zero size 2024-09-19T09:41:43.330 INFO:tasks.workunit.client.0.smithi042.stdout:4/747: dread d0/f19 [4194304,4194304] 0 2024-09-19T09:41:43.333 INFO:tasks.workunit.client.0.smithi042.stdout:4/748: dread d0/f16 [0,4194304] 0 2024-09-19T09:41:43.333 INFO:tasks.workunit.client.0.smithi042.stdout:5/717: dwrite d2/d4/d64/d6a/f85 [0,4194304] 0 2024-09-19T09:41:43.333 INFO:tasks.workunit.client.0.smithi042.stdout:2/762: dread d7/dd/d14/d35/d4e/f97 [0,4194304] 0 2024-09-19T09:41:43.333 INFO:tasks.workunit.client.0.smithi042.stdout:2/763: fdatasync d7/dd/d22/f24 0 2024-09-19T09:41:43.334 INFO:tasks.workunit.client.0.smithi042.stdout:6/749: dwrite d1/de/d76/d99/db2/d34/d6f/d4a/d98/fb8 [0,4194304] 0 2024-09-19T09:41:43.334 INFO:tasks.workunit.client.0.smithi042.stdout:6/750: truncate d1/de/d54/f7e 331092 0 2024-09-19T09:41:43.335 INFO:tasks.workunit.client.0.smithi042.stdout:4/749: link d0/d1b/d1c/d61/d7f/ca4 d0/d1b/d56/d86/dcf/cfe 0 2024-09-19T09:41:43.336 INFO:tasks.workunit.client.0.smithi042.stdout:5/718: rename d2/d4/d20/d60/d72/fa6 to d2/d25/d37/dc2/ff7 0 2024-09-19T09:41:43.336 INFO:tasks.workunit.client.0.smithi042.stdout:5/719: fsync d2/db/d3c/f6e 0 2024-09-19T09:41:43.337 INFO:tasks.workunit.client.0.smithi042.stdout:4/750: rmdir d0/d1b/d1c/db8 39 2024-09-19T09:41:43.337 INFO:tasks.workunit.client.0.smithi042.stdout:5/720: rmdir d2/d4/d8a 39 2024-09-19T09:41:43.338 INFO:tasks.workunit.client.0.smithi042.stdout:2/764: mknod d7/dd/d14/d35/d45/cff 0 2024-09-19T09:41:43.340 INFO:tasks.workunit.client.0.smithi042.stdout:4/751: rename d0/fc to d0/d1b/d1c/d61/d7f/fff 0 2024-09-19T09:41:43.340 INFO:tasks.workunit.client.0.smithi042.stdout:6/751: dread d1/de/d76/d99/db2/d34/d3f/f9e [0,4194304] 0 2024-09-19T09:41:43.341 INFO:tasks.workunit.client.0.smithi042.stdout:9/585: dwrite d8/d1d/d28/f9d [0,4194304] 0 2024-09-19T09:41:43.341 INFO:tasks.workunit.client.0.smithi042.stdout:9/586: chown d8/da/d19/c6a 134 1 2024-09-19T09:41:43.341 INFO:tasks.workunit.client.0.smithi042.stdout:5/721: truncate d2/d25/f2b 2838403 0 2024-09-19T09:41:43.342 INFO:tasks.workunit.client.0.smithi042.stdout:4/752: dread d0/d28/d36/f66 [0,4194304] 0 2024-09-19T09:41:43.352 INFO:tasks.workunit.client.0.smithi042.stdout:2/765: write d7/dd/d14/d35/d4e/f9d [2078119,103885] 0 2024-09-19T09:41:43.356 INFO:tasks.workunit.client.0.smithi042.stdout:2/766: rename d7/dd/d48/d96/ld0 to d7/dd/d14/d35/d4c/d61/l100 0 2024-09-19T09:41:43.360 INFO:tasks.workunit.client.0.smithi042.stdout:9/587: dread d8/da/d19/d1c/d21/d67/d7b/f9f [0,4194304] 0 2024-09-19T09:41:43.362 INFO:tasks.workunit.client.0.smithi042.stdout:9/588: mkdir d8/da/d89/d8e/dae 0 2024-09-19T09:41:43.362 INFO:tasks.workunit.client.0.smithi042.stdout:9/589: fsync d8/d32/f58 0 2024-09-19T09:41:43.362 INFO:tasks.workunit.client.0.smithi042.stdout:4/753: dwrite d0/d1b/d1c/d2e/d3b/d95/db1/fbe [0,4194304] 0 2024-09-19T09:41:43.362 INFO:tasks.workunit.client.0.smithi042.stdout:9/590: creat d8/d1d/faf x:0 0 0 2024-09-19T09:41:43.365 INFO:tasks.workunit.client.0.smithi042.stdout:4/754: rmdir d0/d1b/d56/d86 39 2024-09-19T09:41:43.365 INFO:tasks.workunit.client.0.smithi042.stdout:4/755: write d0/d67/d96/fa8 [957296,68229] 0 2024-09-19T09:41:43.366 INFO:tasks.workunit.client.0.smithi042.stdout:6/752: dwrite d1/d20/d6a/d90/fdd [4194304,4194304] 0 2024-09-19T09:41:43.367 INFO:tasks.workunit.client.0.smithi042.stdout:4/756: creat d0/d1b/d69/dc0/f100 x:0 0 0 2024-09-19T09:41:43.367 INFO:tasks.workunit.client.0.smithi042.stdout:4/757: readlink d0/d1b/d1c/d2e/d3f/d6e/l74 0 2024-09-19T09:41:43.367 INFO:tasks.workunit.client.0.smithi042.stdout:4/758: chown d0/d1b/d69/dc0/cea 1013 1 2024-09-19T09:41:43.371 INFO:tasks.workunit.client.0.smithi042.stdout:9/591: write d8/da/d19/d1c/d21/d7f/f8a [709870,86284] 0 2024-09-19T09:41:43.371 INFO:tasks.workunit.client.0.smithi042.stdout:9/592: chown d8/da/d19/d1c/d21/d7f/d72/c74 75508 1 2024-09-19T09:41:43.372 INFO:tasks.workunit.client.0.smithi042.stdout:6/753: mknod d1/de/d5d/ce4 0 2024-09-19T09:41:43.373 INFO:tasks.workunit.client.0.smithi042.stdout:2/767: dwrite d7/dd/d14/d35/d4e/d9c/fbd [0,4194304] 0 2024-09-19T09:41:43.374 INFO:tasks.workunit.client.0.smithi042.stdout:9/593: creat d8/db/d31/d39/d87/dad/fb0 x:0 0 0 2024-09-19T09:41:43.374 INFO:tasks.workunit.client.0.smithi042.stdout:9/594: chown d8/db/d31/d39/f6e 0 1 2024-09-19T09:41:43.377 INFO:tasks.workunit.client.0.smithi042.stdout:2/768: rmdir d7/dd/d22/d30 39 2024-09-19T09:41:43.377 INFO:tasks.workunit.client.0.smithi042.stdout:2/769: write d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/f95 [1885233,36071] 0 2024-09-19T09:41:43.379 INFO:tasks.workunit.client.0.smithi042.stdout:2/770: rmdir d7/dd/d14/d35/d4e 39 2024-09-19T09:41:43.379 INFO:tasks.workunit.client.0.smithi042.stdout:2/771: fdatasync d7/dd/d22/fb7 0 2024-09-19T09:41:43.379 INFO:tasks.workunit.client.0.smithi042.stdout:9/595: write d8/da/d19/d1c/d21/d67/d7b/f9f [1488725,45244] 0 2024-09-19T09:41:43.381 INFO:tasks.workunit.client.0.smithi042.stdout:2/772: mknod d7/dd/d14/d35/d4c/d61/d87/dbf/c101 0 2024-09-19T09:41:43.382 INFO:tasks.workunit.client.0.smithi042.stdout:6/754: write d1/de/d76/f7a [775198,36881] 0 2024-09-19T09:41:43.392 INFO:tasks.workunit.client.0.smithi042.stdout:3/806: sync 2024-09-19T09:41:43.392 INFO:tasks.workunit.client.0.smithi042.stdout:3/807: read - d4/d8/d9/dc/fe1 zero size 2024-09-19T09:41:43.403 INFO:tasks.workunit.client.0.smithi042.stdout:3/808: dread d4/d8/d9/dc/dbf/d35/f44 [0,4194304] 0 2024-09-19T09:41:43.403 INFO:tasks.workunit.client.0.smithi042.stdout:3/809: chown d4/d8/d9/dc/dbf/d5c/d82/d8c/d104/c3a 3560 1 2024-09-19T09:41:43.403 INFO:tasks.workunit.client.0.smithi042.stdout:3/810: truncate d4/d78/d9d/fa7 4362448 0 2024-09-19T09:41:43.403 INFO:tasks.workunit.client.0.smithi042.stdout:3/811: dread - d4/d8/d9/dc/dbf/fdd zero size 2024-09-19T09:41:43.403 INFO:tasks.workunit.client.0.smithi042.stdout:2/773: rename d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/da8 to d7/dd/d1f/d3f/dfa/d102 0 2024-09-19T09:41:43.403 INFO:tasks.workunit.client.0.smithi042.stdout:2/774: dread - d7/dd/d14/d35/ff5 zero size 2024-09-19T09:41:43.404 INFO:tasks.workunit.client.0.smithi042.stdout:6/755: dwrite d1/de/d54/fb4 [4194304,4194304] 0 2024-09-19T09:41:43.405 INFO:tasks.workunit.client.0.smithi042.stdout:9/596: dwrite d8/f6f [0,4194304] 0 2024-09-19T09:41:43.407 INFO:tasks.workunit.client.0.smithi042.stdout:6/756: link d1/de/d76/d99/db2/d34/d6f/d93/c9f d1/de/d12/d9a/ce5 0 2024-09-19T09:41:43.408 INFO:tasks.workunit.client.0.smithi042.stdout:6/757: mknod d1/de/d76/d99/db2/d34/d6f/ce6 0 2024-09-19T09:41:43.408 INFO:tasks.workunit.client.0.smithi042.stdout:6/758: stat d1/de/d76/d99/db2/d34/d6f 0 2024-09-19T09:41:43.408 INFO:tasks.workunit.client.0.smithi042.stdout:3/812: write d4/d8/d9/dc/dbf/d5c/d82/f7a [71960,104642] 0 2024-09-19T09:41:43.412 INFO:tasks.workunit.client.0.smithi042.stdout:2/775: dread d7/dd/d14/d35/d4c/fa3 [0,4194304] 0 2024-09-19T09:41:43.413 INFO:tasks.workunit.client.0.smithi042.stdout:3/813: dread d4/d8/d9/f1e [0,4194304] 0 2024-09-19T09:41:43.416 INFO:tasks.workunit.client.0.smithi042.stdout:3/814: creat d4/d8/d9/dc/dbf/d6d/d8f/f10c x:0 0 0 2024-09-19T09:41:43.418 INFO:tasks.workunit.client.0.smithi042.stdout:3/815: creat d4/d8/d9/d39/df8/f10d x:0 0 0 2024-09-19T09:41:43.419 INFO:tasks.workunit.client.0.smithi042.stdout:3/816: mknod d4/d8/d9/d1b/c10e 0 2024-09-19T09:41:43.419 INFO:tasks.workunit.client.0.smithi042.stdout:3/817: stat d4/d78/fc1 0 2024-09-19T09:41:43.419 INFO:tasks.workunit.client.0.smithi042.stdout:3/818: write d4/d8/d9/d39/ffb [12515,18973] 0 2024-09-19T09:41:43.421 INFO:tasks.workunit.client.0.smithi042.stdout:2/776: write d7/dd/d14/f31 [259283,97907] 0 2024-09-19T09:41:43.427 INFO:tasks.workunit.client.0.smithi042.stdout:2/777: symlink d7/dd/d14/d35/d45/l103 0 2024-09-19T09:41:43.428 INFO:tasks.workunit.client.0.smithi042.stdout:9/597: dwrite d8/db/d31/f64 [0,4194304] 0 2024-09-19T09:41:43.429 INFO:tasks.workunit.client.0.smithi042.stdout:6/759: dwrite d1/d20/d6a/f5a [0,4194304] 0 2024-09-19T09:41:43.431 INFO:tasks.workunit.client.0.smithi042.stdout:9/598: mkdir d8/db/db1 0 2024-09-19T09:41:43.435 INFO:tasks.workunit.client.0.smithi042.stdout:9/599: mkdir d8/d1d/db2 0 2024-09-19T09:41:43.435 INFO:tasks.workunit.client.0.smithi042.stdout:9/600: dread - d8/db/d31/d39/f83 zero size 2024-09-19T09:41:43.442 INFO:tasks.workunit.client.0.smithi042.stdout:3/819: dwrite d4/d8/d9/dc/dbf/d6d/d8f/fc2 [0,4194304] 0 2024-09-19T09:41:43.442 INFO:tasks.workunit.client.0.smithi042.stdout:2/778: dread d7/dd/d14/d35/d4e/f80 [0,4194304] 0 2024-09-19T09:41:43.443 INFO:tasks.workunit.client.0.smithi042.stdout:3/820: symlink d4/d8/d4c/l10f 0 2024-09-19T09:41:43.445 INFO:tasks.workunit.client.0.smithi042.stdout:2/779: rename d7/dd/d14/d35/d4e/d9c/f94 to d7/dd/d14/d35/d4e/d63/f104 0 2024-09-19T09:41:43.445 INFO:tasks.workunit.client.0.smithi042.stdout:2/780: truncate d7/dd/d22/d30/d66/ff7 157279 0 2024-09-19T09:41:43.447 INFO:tasks.workunit.client.0.smithi042.stdout:2/781: symlink d7/dd/d1f/d3f/l105 0 2024-09-19T09:41:43.449 INFO:tasks.workunit.client.0.smithi042.stdout:6/760: dwrite d1/de/d54/f8e [0,4194304] 0 2024-09-19T09:41:43.450 INFO:tasks.workunit.client.0.smithi042.stdout:1/820: sync 2024-09-19T09:41:43.452 INFO:tasks.workunit.client.0.smithi042.stdout:6/761: rename d1/f6 to d1/de/da7/dc2/fe7 0 2024-09-19T09:41:43.452 INFO:tasks.workunit.client.0.smithi042.stdout:6/762: write d1/d20/d6a/d90/f31 [4767132,57770] 0 2024-09-19T09:41:43.452 INFO:tasks.workunit.client.0.smithi042.stdout:6/763: write d1/de/d12/d9a/fde [545586,73809] 0 2024-09-19T09:41:43.452 INFO:tasks.workunit.client.0.smithi042.stdout:6/764: chown d1/de/d12/c70 240 1 2024-09-19T09:41:43.454 INFO:tasks.workunit.client.0.smithi042.stdout:1/821: link d4/d15/c26 d4/d15/d44/c108 0 2024-09-19T09:41:43.454 INFO:tasks.workunit.client.0.smithi042.stdout:1/822: dread - d4/d1e/f101 zero size 2024-09-19T09:41:43.456 INFO:tasks.workunit.client.0.smithi042.stdout:6/765: creat d1/de/d76/d99/db2/d34/d6f/dbe/fe8 x:0 0 0 2024-09-19T09:41:43.457 INFO:tasks.workunit.client.0.smithi042.stdout:1/823: creat d4/d15/d19/dae/f109 x:0 0 0 2024-09-19T09:41:43.460 INFO:tasks.workunit.client.0.smithi042.stdout:1/824: symlink d4/d15/d19/d45/d82/l10a 0 2024-09-19T09:41:43.460 INFO:tasks.workunit.client.0.smithi042.stdout:1/825: dread - d4/d15/d61/d85/dc9/f107 zero size 2024-09-19T09:41:43.461 INFO:tasks.workunit.client.0.smithi042.stdout:9/601: dwrite d8/db/f26 [0,4194304] 0 2024-09-19T09:41:43.461 INFO:tasks.workunit.client.0.smithi042.stdout:1/826: mknod d4/d1e/d25/c10b 0 2024-09-19T09:41:43.461 INFO:tasks.workunit.client.0.smithi042.stdout:1/827: stat d4/d12/d8d/dca/dd4 0 2024-09-19T09:41:43.464 INFO:tasks.workunit.client.0.smithi042.stdout:9/602: mknod d8/da/d89/d8e/cb3 0 2024-09-19T09:41:43.464 INFO:tasks.workunit.client.0.smithi042.stdout:1/828: getdents d4/d15/d19/d42 0 2024-09-19T09:41:43.466 INFO:tasks.workunit.client.0.smithi042.stdout:3/821: dwrite d4/d8/d9/dc/dbf/d5c/fae [0,4194304] 0 2024-09-19T09:41:43.470 INFO:tasks.workunit.client.0.smithi042.stdout:3/822: truncate d4/d8/d4c/d6b/fce 2983935 0 2024-09-19T09:41:43.470 INFO:tasks.workunit.client.0.smithi042.stdout:1/829: dread d4/d15/d2e/db7/f98 [0,4194304] 0 2024-09-19T09:41:43.470 INFO:tasks.workunit.client.0.smithi042.stdout:1/830: write d4/d15/d2e/db7/f97 [447875,124704] 0 2024-09-19T09:41:43.471 INFO:tasks.workunit.client.0.smithi042.stdout:3/823: getdents d4/d8/d4c/d6b/dfc 0 2024-09-19T09:41:43.473 INFO:tasks.workunit.client.0.smithi042.stdout:9/603: dread d8/d1d/f3f [0,4194304] 0 2024-09-19T09:41:43.473 INFO:tasks.workunit.client.0.smithi042.stdout:9/604: dread - d8/db/d31/d39/f6e zero size 2024-09-19T09:41:43.473 INFO:tasks.workunit.client.0.smithi042.stdout:6/766: dwrite d1/d20/d6a/fb0 [0,4194304] 0 2024-09-19T09:41:43.477 INFO:tasks.workunit.client.0.smithi042.stdout:7/628: sync 2024-09-19T09:41:43.483 INFO:tasks.workunit.client.0.smithi042.stdout:1/831: read d4/d12/d8d/d91/d7f/d99/ddc/fa6 [427963,7058] 0 2024-09-19T09:41:43.484 INFO:tasks.workunit.client.0.smithi042.stdout:9/605: write d8/d1d/d28/fa4 [1223197,126387] 0 2024-09-19T09:41:43.485 INFO:tasks.workunit.client.0.smithi042.stdout:9/606: fdatasync d8/db/d31/d39/f81 0 2024-09-19T09:41:43.485 INFO:tasks.workunit.client.0.smithi042.stdout:9/607: chown d8/da/d19/d1c/d21/d67/c93 24068265 1 2024-09-19T09:41:43.488 INFO:tasks.workunit.client.0.smithi042.stdout:1/832: dread d4/d15/d2e/db7/d3c/f59 [0,4194304] 0 2024-09-19T09:41:43.489 INFO:tasks.workunit.client.0.smithi042.stdout:1/833: mknod d4/d15/d2e/c10c 0 2024-09-19T09:41:43.519 INFO:tasks.workunit.client.0.smithi042.stdout:6/767: dwrite d1/de/d76/d99/db2/d34/d3f/f9e [0,4194304] 0 2024-09-19T09:41:43.520 INFO:tasks.workunit.client.0.smithi042.stdout:6/768: mkdir d1/de/d76/de9 0 2024-09-19T09:41:43.521 INFO:tasks.workunit.client.0.smithi042.stdout:6/769: write d1/d20/d6a/d46/d92/d4f/f9b [8049,50689] 0 2024-09-19T09:41:43.521 INFO:tasks.workunit.client.0.smithi042.stdout:6/770: chown d1/de/d12/d9a 9 1 2024-09-19T09:41:43.521 INFO:tasks.workunit.client.0.smithi042.stdout:3/824: dwrite d4/d8/d9/dc/dbf/d35/f44 [4194304,4194304] 0 2024-09-19T09:41:43.521 INFO:tasks.workunit.client.0.smithi042.stdout:6/771: write d1/de/d76/d99/db2/fd2 [785205,126959] 0 2024-09-19T09:41:43.521 INFO:tasks.workunit.client.0.smithi042.stdout:1/834: dwrite d4/d15/d9e/ffe [0,4194304] 0 2024-09-19T09:41:43.521 INFO:tasks.workunit.client.0.smithi042.stdout:7/629: dwrite d0/f35 [0,4194304] 0 2024-09-19T09:41:43.522 INFO:tasks.workunit.client.0.smithi042.stdout:7/630: fsync d0/fb 0 2024-09-19T09:41:43.522 INFO:tasks.workunit.client.0.smithi042.stdout:7/631: write d0/d14/d44/f54 [4872051,105060] 0 2024-09-19T09:41:43.522 INFO:tasks.workunit.client.0.smithi042.stdout:7/632: fsync d0/f33 0 2024-09-19T09:41:43.522 INFO:tasks.workunit.client.0.smithi042.stdout:3/825: creat d4/d8/d9/dc/dbf/d5c/d82/d48/da5/f110 x:0 0 0 2024-09-19T09:41:43.523 INFO:tasks.workunit.client.0.smithi042.stdout:1/835: link d4/d12/d8d/dca/dd4/l103 d4/d15/d2e/d105/l10d 0 2024-09-19T09:41:43.526 INFO:tasks.workunit.client.0.smithi042.stdout:9/608: dwrite d8/da/d19/d1c/d21/d7f/f8a [0,4194304] 0 2024-09-19T09:41:43.527 INFO:tasks.workunit.client.0.smithi042.stdout:7/633: mkdir d0/d3d/d92/dc7 0 2024-09-19T09:41:43.528 INFO:tasks.workunit.client.0.smithi042.stdout:9/609: mkdir d8/da/d19/d1c/db4 0 2024-09-19T09:41:43.529 INFO:tasks.workunit.client.0.smithi042.stdout:7/634: mknod d0/d14/d3a/cc8 0 2024-09-19T09:41:43.529 INFO:tasks.workunit.client.0.smithi042.stdout:7/635: fdatasync d0/d56/f66 0 2024-09-19T09:41:43.532 INFO:tasks.workunit.client.0.smithi042.stdout:9/610: rename d8/db/d31/d39 to d8/d1d/db2/db5 0 2024-09-19T09:41:43.533 INFO:tasks.workunit.client.0.smithi042.stdout:7/636: creat d0/d3d/db0/fc9 x:0 0 0 2024-09-19T09:41:43.534 INFO:tasks.workunit.client.0.smithi042.stdout:7/637: rmdir d0/d40/d9d/db5 39 2024-09-19T09:41:43.534 INFO:tasks.workunit.client.0.smithi042.stdout:9/611: dread d8/d1d/f1f [0,4194304] 0 2024-09-19T09:41:43.536 INFO:tasks.workunit.client.0.smithi042.stdout:4/759: sync 2024-09-19T09:41:43.536 INFO:tasks.workunit.client.0.smithi042.stdout:5/722: sync 2024-09-19T09:41:43.536 INFO:tasks.workunit.client.0.smithi042.stdout:8/826: sync 2024-09-19T09:41:43.536 INFO:tasks.workunit.client.0.smithi042.stdout:0/694: sync 2024-09-19T09:41:43.537 INFO:tasks.workunit.client.0.smithi042.stdout:4/760: creat d0/d28/d36/df9/f101 x:0 0 0 2024-09-19T09:41:43.537 INFO:tasks.workunit.client.0.smithi042.stdout:4/761: write d0/d1b/d1c/d2e/d3b/fdc [269087,68871] 0 2024-09-19T09:41:43.537 INFO:tasks.workunit.client.0.smithi042.stdout:6/772: dwrite d1/d20/d6a/f5a [4194304,4194304] 0 2024-09-19T09:41:43.538 INFO:tasks.workunit.client.0.smithi042.stdout:0/695: symlink d2/d10/d12/d16/d57/d78/db3/dbc/ld9 0 2024-09-19T09:41:43.539 INFO:tasks.workunit.client.0.smithi042.stdout:6/773: creat d1/de/d12/fea x:0 0 0 2024-09-19T09:41:43.539 INFO:tasks.workunit.client.0.smithi042.stdout:6/774: fdatasync d1/f5e 0 2024-09-19T09:41:43.540 INFO:tasks.workunit.client.0.smithi042.stdout:4/762: write d0/d67/d96/fa8 [360189,63609] 0 2024-09-19T09:41:43.540 INFO:tasks.workunit.client.0.smithi042.stdout:6/775: getdents d1/de/d54/dda 0 2024-09-19T09:41:43.542 INFO:tasks.workunit.client.0.smithi042.stdout:0/696: unlink d2/d10/d12/d16/d57/d99/dd0/da5/d52/f97 0 2024-09-19T09:41:43.543 INFO:tasks.workunit.client.0.smithi042.stdout:1/836: write d4/d15/d19/d42/d51/f81 [7994278,60465] 0 2024-09-19T09:41:43.543 INFO:tasks.workunit.client.0.smithi042.stdout:1/837: chown d4/d15/d2e/db7/d3c/dd5/ded 258 1 2024-09-19T09:41:43.543 INFO:tasks.workunit.client.0.smithi042.stdout:1/838: readlink d4/d15/d19/d42/la1 0 2024-09-19T09:41:43.543 INFO:tasks.workunit.client.0.smithi042.stdout:1/839: stat d4/d15/d2e/db7/d3c/f43 0 2024-09-19T09:41:43.544 INFO:tasks.workunit.client.0.smithi042.stdout:7/638: dread d0/d14/d44/f54 [0,4194304] 0 2024-09-19T09:41:43.544 INFO:tasks.workunit.client.0.smithi042.stdout:9/612: rename d8/d1d/db2 to d8/da/d89/da7/db6 0 2024-09-19T09:41:43.544 INFO:tasks.workunit.client.0.smithi042.stdout:7/639: chown d0/d3d/f4a 3810 1 2024-09-19T09:41:43.544 INFO:tasks.workunit.client.0.smithi042.stdout:7/640: stat d0/d40/l49 0 2024-09-19T09:41:43.545 INFO:tasks.workunit.client.0.smithi042.stdout:6/776: mknod d1/de/d76/de9/ceb 0 2024-09-19T09:41:43.545 INFO:tasks.workunit.client.0.smithi042.stdout:6/777: fdatasync d1/de/d76/d99/db2/d34/d6f/d93/db5/f6e 0 2024-09-19T09:41:43.547 INFO:tasks.workunit.client.0.smithi042.stdout:3/826: dwrite d4/d8/d9/d1b/fc8 [4194304,4194304] 0 2024-09-19T09:41:43.547 INFO:tasks.workunit.client.0.smithi042.stdout:0/697: mknod d2/d10/da1/cda 0 2024-09-19T09:41:43.548 INFO:tasks.workunit.client.0.smithi042.stdout:1/840: symlink d4/d12/d8d/d91/d7f/l10e 0 2024-09-19T09:41:43.548 INFO:tasks.workunit.client.0.smithi042.stdout:1/841: write d4/d15/d61/d85/fab [71852,121145] 0 2024-09-19T09:41:43.549 INFO:tasks.workunit.client.0.smithi042.stdout:5/723: rename d2/d4/cdd to d2/d4/d20/da4/dde/cf8 0 2024-09-19T09:41:43.550 INFO:tasks.workunit.client.0.smithi042.stdout:9/613: unlink d8/db/l27 0 2024-09-19T09:41:43.551 INFO:tasks.workunit.client.0.smithi042.stdout:6/778: mknod d1/d20/d6a/d46/d92/d3a/cec 0 2024-09-19T09:41:43.551 INFO:tasks.workunit.client.0.smithi042.stdout:6/779: truncate d1/de/d54/f7e 491800 0 2024-09-19T09:41:43.551 INFO:tasks.workunit.client.0.smithi042.stdout:6/780: write d1/de/d76/d99/db2/f2a [1700796,92172] 0 2024-09-19T09:41:43.552 INFO:tasks.workunit.client.0.smithi042.stdout:7/641: write d0/d14/d3a/f3e [1001695,5758] 0 2024-09-19T09:41:43.554 INFO:tasks.workunit.client.0.smithi042.stdout:0/698: mknod d2/d8e/d32/cdb 0 2024-09-19T09:41:43.554 INFO:tasks.workunit.client.0.smithi042.stdout:0/699: chown d2/d10/d12/d16/d57/d99 3931948 1 2024-09-19T09:41:43.554 INFO:tasks.workunit.client.0.smithi042.stdout:0/700: truncate d2/f1c 9237019 0 2024-09-19T09:41:43.554 INFO:tasks.workunit.client.0.smithi042.stdout:0/701: chown d2/d10/d12/d16/d51 24172 1 2024-09-19T09:41:43.555 INFO:tasks.workunit.client.0.smithi042.stdout:3/827: creat d4/d8/d9/dc/dbf/d5c/d82/d48/da5/de6/f111 x:0 0 0 2024-09-19T09:41:43.560 INFO:tasks.workunit.client.0.smithi042.stdout:9/614: write d8/db/d31/f64 [3537818,1700] 0 2024-09-19T09:41:43.560 INFO:tasks.workunit.client.0.smithi042.stdout:9/615: fsync d8/da/d19/d1c/d21/f84 0 2024-09-19T09:41:43.562 INFO:tasks.workunit.client.0.smithi042.stdout:6/781: dread d1/de/d76/d99/db2/fd1 [0,4194304] 0 2024-09-19T09:41:43.564 INFO:tasks.workunit.client.0.smithi042.stdout:0/702: dread d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da6/fc1 [0,4194304] 0 2024-09-19T09:41:43.564 INFO:tasks.workunit.client.0.smithi042.stdout:1/842: creat d4/d15/d61/d85/dc9/de8/f10f x:0 0 0 2024-09-19T09:41:43.564 INFO:tasks.workunit.client.0.smithi042.stdout:5/724: link d2/d8e/cc1 d2/d4/d20/d60/d72/d75/cf9 0 2024-09-19T09:41:43.566 INFO:tasks.workunit.client.0.smithi042.stdout:9/616: creat d8/da/d19/d1c/fb7 x:0 0 0 2024-09-19T09:41:43.567 INFO:tasks.workunit.client.0.smithi042.stdout:6/782: mknod d1/d20/d6a/d46/d92/d3a/ced 0 2024-09-19T09:41:43.569 INFO:tasks.workunit.client.0.smithi042.stdout:1/843: rmdir d4/d15/d2e/d105 39 2024-09-19T09:41:43.569 INFO:tasks.workunit.client.0.smithi042.stdout:1/844: getdents d4/d15/d19/d42/d51/d79 0 2024-09-19T09:41:43.570 INFO:tasks.workunit.client.0.smithi042.stdout:0/703: truncate d2/d8e/f4c 1602422 0 2024-09-19T09:41:43.570 INFO:tasks.workunit.client.0.smithi042.stdout:0/704: write d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/f69 [4313553,63953] 0 2024-09-19T09:41:43.570 INFO:tasks.workunit.client.0.smithi042.stdout:0/705: chown d2/d10/d12/d16/d57/d99/cb7 1679088031 1 2024-09-19T09:41:43.572 INFO:tasks.workunit.client.0.smithi042.stdout:5/725: creat d2/d25/d37/ffa x:0 0 0 2024-09-19T09:41:43.572 INFO:tasks.workunit.client.0.smithi042.stdout:2/782: sync 2024-09-19T09:41:43.573 INFO:tasks.workunit.client.0.smithi042.stdout:1/845: dread d4/d15/d19/d45/f4d [0,4194304] 0 2024-09-19T09:41:43.574 INFO:tasks.workunit.client.0.smithi042.stdout:0/706: creat d2/d10/d12/d16/fdc x:0 0 0 2024-09-19T09:41:43.574 INFO:tasks.workunit.client.0.smithi042.stdout:3/828: dwrite d4/d8/d9/dc/dbf/d5c/d82/f103 [0,4194304] 0 2024-09-19T09:41:43.575 INFO:tasks.workunit.client.0.smithi042.stdout:0/707: creat d2/d10/d12/d24/d82/fdd x:0 0 0 2024-09-19T09:41:43.577 INFO:tasks.workunit.client.0.smithi042.stdout:1/846: mkdir d4/d15/d61/d85/dc9/de8/d110 0 2024-09-19T09:41:43.577 INFO:tasks.workunit.client.0.smithi042.stdout:9/617: write d8/da/d19/f6b [2272208,74835] 0 2024-09-19T09:41:43.582 INFO:tasks.workunit.client.0.smithi042.stdout:2/783: mknod d7/dd/d1f/c106 0 2024-09-19T09:41:43.583 INFO:tasks.workunit.client.0.smithi042.stdout:3/829: unlink d4/d8/f72 0 2024-09-19T09:41:43.583 INFO:tasks.workunit.client.0.smithi042.stdout:3/830: readlink d4/d8/d9/dc/dbf/d5c/d82/d48/l79 0 2024-09-19T09:41:43.585 INFO:tasks.workunit.client.0.smithi042.stdout:0/708: symlink d2/d10/d12/d16/d57/lde 0 2024-09-19T09:41:43.586 INFO:tasks.workunit.client.0.smithi042.stdout:5/726: write d2/d4/fe7 [3991217,68455] 0 2024-09-19T09:41:43.586 INFO:tasks.workunit.client.0.smithi042.stdout:6/783: dwrite d1/de/d76/d99/db2/d34/d6f/d4a/d98/fd5 [0,4194304] 0 2024-09-19T09:41:43.586 INFO:tasks.workunit.client.0.smithi042.stdout:6/784: fdatasync d1/d20/d6a/d46/d92/d3a/f75 0 2024-09-19T09:41:43.586 INFO:tasks.workunit.client.0.smithi042.stdout:6/785: fsync d1/d20/f38 0 2024-09-19T09:41:43.586 INFO:tasks.workunit.client.0.smithi042.stdout:1/847: creat d4/d15/d2e/db7/d3c/dd5/ded/f111 x:0 0 0 2024-09-19T09:41:43.587 INFO:tasks.workunit.client.0.smithi042.stdout:9/618: rmdir d8/da/d89/d8e 39 2024-09-19T09:41:43.587 INFO:tasks.workunit.client.0.smithi042.stdout:9/619: chown d8/db/d31/c7d 0 1 2024-09-19T09:41:43.588 INFO:tasks.workunit.client.0.smithi042.stdout:3/831: truncate d4/d8/d9/d1b/fd1 314719 0 2024-09-19T09:41:43.588 INFO:tasks.workunit.client.0.smithi042.stdout:3/832: stat d4/d8/d9/dc/dbf/d6d 0 2024-09-19T09:41:43.590 INFO:tasks.workunit.client.0.smithi042.stdout:0/709: mknod d2/d10/d1d/d34/cdf 0 2024-09-19T09:41:43.590 INFO:tasks.workunit.client.0.smithi042.stdout:0/710: truncate d2/d10/d1d/f59 935755 0 2024-09-19T09:41:43.590 INFO:tasks.workunit.client.0.smithi042.stdout:5/727: mkdir d2/d25/dfb 0 2024-09-19T09:41:43.591 INFO:tasks.workunit.client.0.smithi042.stdout:3/833: dread d4/d8/d9/dc/dbf/d5c/d82/fe2 [0,4194304] 0 2024-09-19T09:41:43.591 INFO:tasks.workunit.client.0.smithi042.stdout:6/786: truncate d1/d20/d6a/d90/fdd 8174234 0 2024-09-19T09:41:43.591 INFO:tasks.workunit.client.0.smithi042.stdout:1/848: mkdir d4/d15/d61/d85/dc9/de8/d112 0 2024-09-19T09:41:43.591 INFO:tasks.workunit.client.0.smithi042.stdout:1/849: dread - d4/d15/d19/d45/d82/d89/fe1 zero size 2024-09-19T09:41:43.591 INFO:tasks.workunit.client.0.smithi042.stdout:2/784: write d7/dd/d14/d35/d4e/f97 [3560190,126257] 0 2024-09-19T09:41:43.592 INFO:tasks.workunit.client.0.smithi042.stdout:9/620: creat d8/da/fb8 x:0 0 0 2024-09-19T09:41:43.592 INFO:tasks.workunit.client.0.smithi042.stdout:6/787: creat d1/d20/fee x:0 0 0 2024-09-19T09:41:43.592 INFO:tasks.workunit.client.0.smithi042.stdout:6/788: dread - d1/de/d76/d99/db2/d34/d6f/fc4 zero size 2024-09-19T09:41:43.593 INFO:tasks.workunit.client.0.smithi042.stdout:2/785: mkdir d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d107 0 2024-09-19T09:41:43.594 INFO:tasks.workunit.client.0.smithi042.stdout:9/621: mknod d8/da/d89/d8e/dae/cb9 0 2024-09-19T09:41:43.594 INFO:tasks.workunit.client.0.smithi042.stdout:6/789: rmdir d1/de/d54/dda 39 2024-09-19T09:41:43.595 INFO:tasks.workunit.client.0.smithi042.stdout:9/622: mknod d8/da/d70/cba 0 2024-09-19T09:41:43.598 INFO:tasks.workunit.client.0.smithi042.stdout:9/623: mknod d8/da/d89/da7/db6/db5/d87/dad/cbb 0 2024-09-19T09:41:43.599 INFO:tasks.workunit.client.0.smithi042.stdout:9/624: chown d8/da/d89/d8e/cb3 5 1 2024-09-19T09:41:43.599 INFO:tasks.workunit.client.0.smithi042.stdout:9/625: chown d8/db/db1 342359197 1 2024-09-19T09:41:43.601 INFO:tasks.workunit.client.0.smithi042.stdout:9/626: creat d8/da/d89/fbc x:0 0 0 2024-09-19T09:41:43.601 INFO:tasks.workunit.client.0.smithi042.stdout:9/627: chown d8/da/d19/d1c/d21/d67/f5b 415 1 2024-09-19T09:41:43.601 INFO:tasks.workunit.client.0.smithi042.stdout:1/850: write d4/d15/d61/fc7 [604262,42942] 0 2024-09-19T09:41:43.603 INFO:tasks.workunit.client.0.smithi042.stdout:8/827: rename d1/db2/df3 to d1/da/d14/df6 0 2024-09-19T09:41:43.605 INFO:tasks.workunit.client.0.smithi042.stdout:8/828: chown d1/da/d14/l71 14 1 2024-09-19T09:41:43.605 INFO:tasks.workunit.client.0.smithi042.stdout:8/829: write d1/da8/d41/feb [596830,36544] 0 2024-09-19T09:41:43.605 INFO:tasks.workunit.client.0.smithi042.stdout:8/830: truncate d1/da/d14/f85 816991 0 2024-09-19T09:41:43.606 INFO:tasks.workunit.client.0.smithi042.stdout:2/786: symlink d7/dd/d14/d35/d4c/d61/l108 0 2024-09-19T09:41:43.607 INFO:tasks.workunit.client.0.smithi042.stdout:7/642: rename d0/lf to d0/d3d/d55/lca 0 2024-09-19T09:41:43.609 INFO:tasks.workunit.client.0.smithi042.stdout:6/790: rename d1/de/d76/d99/db2/d34/d6f/c7d to d1/de/d54/dcb/cef 0 2024-09-19T09:41:43.613 INFO:tasks.workunit.client.0.smithi042.stdout:6/791: mknod d1/cf0 0 2024-09-19T09:41:43.615 INFO:tasks.workunit.client.0.smithi042.stdout:7/643: symlink d0/d14/lcb 0 2024-09-19T09:41:43.615 INFO:tasks.workunit.client.0.smithi042.stdout:9/628: getdents d8/da/d89/d8e/dae 0 2024-09-19T09:41:43.616 INFO:tasks.workunit.client.0.smithi042.stdout:9/629: read - d8/da/f8d zero size 2024-09-19T09:41:43.617 INFO:tasks.workunit.client.0.smithi042.stdout:6/792: creat d1/de/d76/d99/db2/d34/d6f/d4a/d98/ff1 x:0 0 0 2024-09-19T09:41:43.620 INFO:tasks.workunit.client.0.smithi042.stdout:7/644: mkdir d0/d3d/d55/d72/db6/dbb/dcc 0 2024-09-19T09:41:43.621 INFO:tasks.workunit.client.0.smithi042.stdout:0/711: dwrite d2/d10/d12/d16/d57/d99/fc6 [0,4194304] 0 2024-09-19T09:41:43.622 INFO:tasks.workunit.client.0.smithi042.stdout:2/787: mknod d7/dd/d14/d35/d4e/c109 0 2024-09-19T09:41:43.625 INFO:tasks.workunit.client.0.smithi042.stdout:3/834: dwrite d4/d78/d9d/fa7 [0,4194304] 0 2024-09-19T09:41:43.625 INFO:tasks.workunit.client.0.smithi042.stdout:1/851: dwrite d4/d15/d19/f1a [0,4194304] 0 2024-09-19T09:41:43.625 INFO:tasks.workunit.client.0.smithi042.stdout:8/831: dwrite d1/da/f2f [4194304,4194304] 0 2024-09-19T09:41:43.627 INFO:tasks.workunit.client.0.smithi042.stdout:7/645: mknod d0/d40/d9d/ccd 0 2024-09-19T09:41:43.628 INFO:tasks.workunit.client.0.smithi042.stdout:5/728: dwrite d2/d4/d64/da7/f23 [4194304,4194304] 0 2024-09-19T09:41:43.628 INFO:tasks.workunit.client.0.smithi042.stdout:5/729: write d2/d4/d20/ff4 [383855,37716] 0 2024-09-19T09:41:43.628 INFO:tasks.workunit.client.0.smithi042.stdout:5/730: stat d2/d4/d20/l49 0 2024-09-19T09:41:43.632 INFO:tasks.workunit.client.0.smithi042.stdout:3/835: symlink d4/d8/d9/dc/dbf/d5c/d82/d48/dc3/df3/l112 0 2024-09-19T09:41:43.632 INFO:tasks.workunit.client.0.smithi042.stdout:3/836: write d4/d8/d9/dc/dbf/d35/f51 [4332876,29886] 0 2024-09-19T09:41:43.632 INFO:tasks.workunit.client.0.smithi042.stdout:3/837: write d4/d8/d9/dc/dbf/d5c/fab [2508782,130524] 0 2024-09-19T09:41:43.637 INFO:tasks.workunit.client.0.smithi042.stdout:8/832: symlink d1/da8/d3d/d58/dd1/lf7 0 2024-09-19T09:41:43.642 INFO:tasks.workunit.client.0.smithi042.stdout:9/630: dwrite d8/da/d19/f2b [0,4194304] 0 2024-09-19T09:41:43.645 INFO:tasks.workunit.client.0.smithi042.stdout:7/646: rename d0/d14/d44/f54 to d0/d3d/d85/fce 0 2024-09-19T09:41:43.647 INFO:tasks.workunit.client.0.smithi042.stdout:0/712: mkdir d2/d10/d12/de0 0 2024-09-19T09:41:43.648 INFO:tasks.workunit.client.0.smithi042.stdout:2/788: dwrite d7/dd/d14/d35/d4c/d61/d87/dc6/ffe [0,4194304] 0 2024-09-19T09:41:43.650 INFO:tasks.workunit.client.0.smithi042.stdout:8/833: creat d1/da8/db1/dcb/ff8 x:0 0 0 2024-09-19T09:41:43.650 INFO:tasks.workunit.client.0.smithi042.stdout:8/834: readlink d1/da8/d41/l4d 0 2024-09-19T09:41:43.651 INFO:tasks.workunit.client.0.smithi042.stdout:9/631: mknod d8/da/d89/cbd 0 2024-09-19T09:41:43.651 INFO:tasks.workunit.client.0.smithi042.stdout:9/632: write d8/f1a [782435,4592] 0 2024-09-19T09:41:43.651 INFO:tasks.workunit.client.0.smithi042.stdout:9/633: write d8/d1d/faf [908589,41197] 0 2024-09-19T09:41:43.652 INFO:tasks.workunit.client.0.smithi042.stdout:7/647: creat d0/d3d/d85/fcf x:0 0 0 2024-09-19T09:41:43.653 INFO:tasks.workunit.client.0.smithi042.stdout:0/713: symlink d2/d10/d12/d16/d57/d78/db3/dbc/le1 0 2024-09-19T09:41:43.654 INFO:tasks.workunit.client.0.smithi042.stdout:0/714: write d2/d8e/d32/f83 [1353685,24367] 0 2024-09-19T09:41:43.656 INFO:tasks.workunit.client.0.smithi042.stdout:2/789: symlink d7/dd/de3/l10a 0 2024-09-19T09:41:43.656 INFO:tasks.workunit.client.0.smithi042.stdout:9/634: write d8/da/d19/d1c/d21/d7f/f5a [939248,100440] 0 2024-09-19T09:41:43.656 INFO:tasks.workunit.client.0.smithi042.stdout:8/835: mkdir d1/da8/d92/dc7/df9 0 2024-09-19T09:41:43.658 INFO:tasks.workunit.client.0.smithi042.stdout:5/731: dwrite d2/d4/f56 [4194304,4194304] 0 2024-09-19T09:41:43.658 INFO:tasks.workunit.client.0.smithi042.stdout:5/732: stat d2/d4/d20 0 2024-09-19T09:41:43.658 INFO:tasks.workunit.client.0.smithi042.stdout:7/648: mkdir d0/d40/d9d/dd0 0 2024-09-19T09:41:43.659 INFO:tasks.workunit.client.0.smithi042.stdout:0/715: creat d2/d10/d12/fe2 x:0 0 0 2024-09-19T09:41:43.659 INFO:tasks.workunit.client.0.smithi042.stdout:0/716: chown d2/d10/da1/lba 4845843 1 2024-09-19T09:41:43.661 INFO:tasks.workunit.client.0.smithi042.stdout:3/838: dwrite d4/d8/d9/dc/dbf/d6d/d8f/dcd/f10b [0,4194304] 0 2024-09-19T09:41:43.661 INFO:tasks.workunit.client.0.smithi042.stdout:5/733: readlink d2/d4/d64/l8f 0 2024-09-19T09:41:43.661 INFO:tasks.workunit.client.0.smithi042.stdout:1/852: dwrite d4/d15/d19/d42/f9c [0,4194304] 0 2024-09-19T09:41:43.662 INFO:tasks.workunit.client.0.smithi042.stdout:4/763: sync 2024-09-19T09:41:43.662 INFO:tasks.workunit.client.0.smithi042.stdout:4/764: dread - d0/d1b/d1c/d61/d7f/d83/fa5 zero size 2024-09-19T09:41:43.662 INFO:tasks.workunit.client.0.smithi042.stdout:4/765: truncate d0/d1b/d1c/d2e/d44/fed 100966 0 2024-09-19T09:41:43.662 INFO:tasks.workunit.client.0.smithi042.stdout:4/766: fsync d0/d1b/d1c/f25 0 2024-09-19T09:41:43.662 INFO:tasks.workunit.client.0.smithi042.stdout:7/649: rmdir d0/d56/d5c 39 2024-09-19T09:41:43.666 INFO:tasks.workunit.client.0.smithi042.stdout:3/839: rmdir d4/d8/d9/d39 39 2024-09-19T09:41:43.666 INFO:tasks.workunit.client.0.smithi042.stdout:4/767: dread d0/d1b/d1c/d2e/d3b/f47 [0,4194304] 0 2024-09-19T09:41:43.666 INFO:tasks.workunit.client.0.smithi042.stdout:4/768: read - d0/d28/d36/df9/f101 zero size 2024-09-19T09:41:43.667 INFO:tasks.workunit.client.0.smithi042.stdout:5/734: getdents d2/d25/d37/dc2 0 2024-09-19T09:41:43.668 INFO:tasks.workunit.client.0.smithi042.stdout:1/853: creat d4/d15/d19/f113 x:0 0 0 2024-09-19T09:41:43.668 INFO:tasks.workunit.client.0.smithi042.stdout:9/635: read d8/f3d [2077171,104259] 0 2024-09-19T09:41:43.668 INFO:tasks.workunit.client.0.smithi042.stdout:9/636: chown d8/db/d31/f64 15 1 2024-09-19T09:41:43.668 INFO:tasks.workunit.client.0.smithi042.stdout:9/637: chown d8/da/d19/d1c/d21/c63 437 1 2024-09-19T09:41:43.670 INFO:tasks.workunit.client.0.smithi042.stdout:7/650: stat d0/d3d/d92/la8 0 2024-09-19T09:41:43.670 INFO:tasks.workunit.client.0.smithi042.stdout:7/651: fdatasync d0/fb 0 2024-09-19T09:41:43.674 INFO:tasks.workunit.client.0.smithi042.stdout:4/769: link d0/f14 d0/d1b/d1c/d2e/d3f/d5a/f102 0 2024-09-19T09:41:43.674 INFO:tasks.workunit.client.0.smithi042.stdout:4/770: readlink d0/d1b/d1c/d2e/d3b/l4c 0 2024-09-19T09:41:43.674 INFO:tasks.workunit.client.0.smithi042.stdout:4/771: fdatasync d0/d1b/d1c/f25 0 2024-09-19T09:41:43.675 INFO:tasks.workunit.client.0.smithi042.stdout:8/836: write d1/da8/d41/d55/d99/da4/f73 [367162,72279] 0 2024-09-19T09:41:43.675 INFO:tasks.workunit.client.0.smithi042.stdout:3/840: unlink d4/d8/d9/dc/dbf/d6d/fd0 0 2024-09-19T09:41:43.675 INFO:tasks.workunit.client.0.smithi042.stdout:3/841: fdatasync d4/d8/d9/dc/dbf/d5c/fab 0 2024-09-19T09:41:43.675 INFO:tasks.workunit.client.0.smithi042.stdout:3/842: chown d4/d8/d4c 12494 1 2024-09-19T09:41:43.677 INFO:tasks.workunit.client.0.smithi042.stdout:1/854: rename d4/d15/d44/l6b to d4/d15/d61/l114 0 2024-09-19T09:41:43.677 INFO:tasks.workunit.client.0.smithi042.stdout:1/855: chown d4/d12/d8d/d91/d7f/d99/ddc/l92 24439 1 2024-09-19T09:41:43.677 INFO:tasks.workunit.client.0.smithi042.stdout:1/856: write d4/fa5 [564214,64272] 0 2024-09-19T09:41:43.677 INFO:tasks.workunit.client.0.smithi042.stdout:9/638: rmdir d8/da/d70 39 2024-09-19T09:41:43.678 INFO:tasks.workunit.client.0.smithi042.stdout:8/837: creat d1/d2e/ffa x:0 0 0 2024-09-19T09:41:43.679 INFO:tasks.workunit.client.0.smithi042.stdout:2/790: dwrite d7/dd/d1f/d3f/fdf [0,4194304] 0 2024-09-19T09:41:43.679 INFO:tasks.workunit.client.0.smithi042.stdout:2/791: stat d7/dd/d1f/d3f/fdf 0 2024-09-19T09:41:43.679 INFO:tasks.workunit.client.0.smithi042.stdout:4/772: rename d0/d1b/d1c/d2e/f9a to d0/d1b/d1c/d61/dc8/f103 0 2024-09-19T09:41:43.681 INFO:tasks.workunit.client.0.smithi042.stdout:9/639: truncate d8/f6f 3032112 0 2024-09-19T09:41:43.681 INFO:tasks.workunit.client.0.smithi042.stdout:9/640: write d8/da/d19/d1c/d21/f96 [731023,97353] 0 2024-09-19T09:41:43.681 INFO:tasks.workunit.client.0.smithi042.stdout:3/843: write d4/d8/d9/dc/dbf/f27 [1851799,106018] 0 2024-09-19T09:41:43.681 INFO:tasks.workunit.client.0.smithi042.stdout:3/844: write d4/d8/f36 [2157633,65678] 0 2024-09-19T09:41:43.682 INFO:tasks.workunit.client.0.smithi042.stdout:8/838: unlink d1/l3 0 2024-09-19T09:41:43.684 INFO:tasks.workunit.client.0.smithi042.stdout:9/641: dread d8/d1d/d28/fa4 [0,4194304] 0 2024-09-19T09:41:43.687 INFO:tasks.workunit.client.0.smithi042.stdout:4/773: dread d0/d1b/d1c/f55 [0,4194304] 0 2024-09-19T09:41:43.688 INFO:tasks.workunit.client.0.smithi042.stdout:4/774: mkdir d0/d1b/d1c/d2e/d104 0 2024-09-19T09:41:43.694 INFO:tasks.workunit.client.0.smithi042.stdout:9/642: truncate d8/da/d19/f2b 496320 0 2024-09-19T09:41:43.696 INFO:tasks.workunit.client.0.smithi042.stdout:9/643: creat d8/da/d89/da7/fbe x:0 0 0 2024-09-19T09:41:43.703 INFO:tasks.workunit.client.0.smithi042.stdout:7/652: dwrite d0/d3d/d85/d99/fb8 [0,4194304] 0 2024-09-19T09:41:43.705 INFO:tasks.workunit.client.0.smithi042.stdout:7/653: link d0/d40/d9d/f8f d0/d3d/d55/fd1 0 2024-09-19T09:41:43.706 INFO:tasks.workunit.client.0.smithi042.stdout:7/654: creat d0/d3d/d55/d72/fd2 x:0 0 0 2024-09-19T09:41:43.707 INFO:tasks.workunit.client.0.smithi042.stdout:7/655: creat d0/fd3 x:0 0 0 2024-09-19T09:41:43.715 INFO:tasks.workunit.client.0.smithi042.stdout:4/775: dwrite d0/d1b/d1c/f59 [0,4194304] 0 2024-09-19T09:41:43.715 INFO:tasks.workunit.client.0.smithi042.stdout:5/735: dwrite d2/d4/d2e/fd7 [0,4194304] 0 2024-09-19T09:41:43.715 INFO:tasks.workunit.client.0.smithi042.stdout:4/776: chown d0/d1b/d1c/d2e/d3f/d5a/ff6 6989 1 2024-09-19T09:41:43.716 INFO:tasks.workunit.client.0.smithi042.stdout:2/792: dwrite d7/dd/f8d [4194304,4194304] 0 2024-09-19T09:41:43.717 INFO:tasks.workunit.client.0.smithi042.stdout:4/777: dread d0/d1b/d1c/d2e/d3b/fdc [0,4194304] 0 2024-09-19T09:41:43.717 INFO:tasks.workunit.client.0.smithi042.stdout:4/778: readlink d0/d28/d87/l9f 0 2024-09-19T09:41:43.717 INFO:tasks.workunit.client.0.smithi042.stdout:4/779: write d0/f16 [3123249,100170] 0 2024-09-19T09:41:43.717 INFO:tasks.workunit.client.0.smithi042.stdout:4/780: chown d0/d1b/d1c/d61/d7f/fe2 56012 1 2024-09-19T09:41:43.717 INFO:tasks.workunit.client.0.smithi042.stdout:3/845: dwrite d4/d8/f19 [4194304,4194304] 0 2024-09-19T09:41:43.719 INFO:tasks.workunit.client.0.smithi042.stdout:5/736: creat d2/d4/d20/d60/db0/ffc x:0 0 0 2024-09-19T09:41:43.720 INFO:tasks.workunit.client.0.smithi042.stdout:4/781: mkdir d0/d1b/d1c/d2e/d3b/d95/db1/dba/d105 0 2024-09-19T09:41:43.722 INFO:tasks.workunit.client.0.smithi042.stdout:3/846: creat d4/d8/d9/d1b/dd5/f113 x:0 0 0 2024-09-19T09:41:43.722 INFO:tasks.workunit.client.0.smithi042.stdout:7/656: dwrite d0/f36 [0,4194304] 0 2024-09-19T09:41:43.723 INFO:tasks.workunit.client.0.smithi042.stdout:5/737: symlink d2/d4/d64/lfd 0 2024-09-19T09:41:43.726 INFO:tasks.workunit.client.0.smithi042.stdout:7/657: symlink d0/d3d/d85/d99/ld4 0 2024-09-19T09:41:43.727 INFO:tasks.workunit.client.0.smithi042.stdout:2/793: read d7/dd/d14/d35/d4e/d63/dd6/fd9 [18102,22986] 0 2024-09-19T09:41:43.730 INFO:tasks.workunit.client.0.smithi042.stdout:3/847: write d4/d8/d9/dc/dbf/d5c/f94 [2825222,24689] 0 2024-09-19T09:41:43.730 INFO:tasks.workunit.client.0.smithi042.stdout:5/738: symlink d2/d4/d64/lfe 0 2024-09-19T09:41:43.731 INFO:tasks.workunit.client.0.smithi042.stdout:7/658: creat d0/d3d/d55/d72/fd5 x:0 0 0 2024-09-19T09:41:43.731 INFO:tasks.workunit.client.0.smithi042.stdout:2/794: mkdir d7/dd/d1f/d3f/d10b 0 2024-09-19T09:41:43.732 INFO:tasks.workunit.client.0.smithi042.stdout:4/782: write d0/d1b/d1c/db8/fc3 [3755775,45274] 0 2024-09-19T09:41:43.732 INFO:tasks.workunit.client.0.smithi042.stdout:3/848: mkdir d4/d8/d9/d1b/d4f/d9c/d114 0 2024-09-19T09:41:43.733 INFO:tasks.workunit.client.0.smithi042.stdout:3/849: chown d4/d8/d4c/fd2 2 1 2024-09-19T09:41:43.734 INFO:tasks.workunit.client.0.smithi042.stdout:2/795: getdents d7/dd/d14/d35/d4c/d61 0 2024-09-19T09:41:43.737 INFO:tasks.workunit.client.0.smithi042.stdout:4/783: symlink d0/d1b/d1c/d2e/dc4/l106 0 2024-09-19T09:41:43.740 INFO:tasks.workunit.client.0.smithi042.stdout:3/850: rename d4/d8/d9/dc/dbf/d5c to d4/d8/d9/d115 0 2024-09-19T09:41:43.741 INFO:tasks.workunit.client.0.smithi042.stdout:4/784: creat d0/d1b/d1c/d2e/d3f/f107 x:0 0 0 2024-09-19T09:41:43.742 INFO:tasks.workunit.client.0.smithi042.stdout:5/739: getdents d2/d4/d64/dab 0 2024-09-19T09:41:43.742 INFO:tasks.workunit.client.0.smithi042.stdout:4/785: symlink d0/d1b/d1c/d2e/d3b/d95/db1/dba/d105/l108 0 2024-09-19T09:41:43.743 INFO:tasks.workunit.client.0.smithi042.stdout:5/740: read d2/d4/f78 [706054,70836] 0 2024-09-19T09:41:43.744 INFO:tasks.workunit.client.0.smithi042.stdout:2/796: creat d7/dd/d14/d35/d45/d5e/d79/f10c x:0 0 0 2024-09-19T09:41:43.744 INFO:tasks.workunit.client.0.smithi042.stdout:4/786: rename d0/d1b/d1c/d61/d7f/d83 to d0/d1b/d1c/d2e/d3b/d95/db1/dba/d109 0 2024-09-19T09:41:43.745 INFO:tasks.workunit.client.0.smithi042.stdout:5/741: rename d2/d25/l44 to d2/d4/d20/d60/lff 0 2024-09-19T09:41:43.745 INFO:tasks.workunit.client.0.smithi042.stdout:5/742: write d2/fad [791949,123212] 0 2024-09-19T09:41:43.746 INFO:tasks.workunit.client.0.smithi042.stdout:4/787: creat d0/d1b/d1c/d2e/d3b/d95/f10a x:0 0 0 2024-09-19T09:41:43.746 INFO:tasks.workunit.client.0.smithi042.stdout:4/788: write d0/d1b/d1c/d2e/d3b/d95/db1/dba/d109/fc6 [92926,53386] 0 2024-09-19T09:41:43.746 INFO:tasks.workunit.client.0.smithi042.stdout:2/797: rmdir d7/dd/d14/d35/d4c/d61/d87 39 2024-09-19T09:41:43.746 INFO:tasks.workunit.client.0.smithi042.stdout:2/798: chown d7/dd/d1f 8810 1 2024-09-19T09:41:43.747 INFO:tasks.workunit.client.0.smithi042.stdout:4/789: symlink d0/d28/d36/d91/l10b 0 2024-09-19T09:41:43.747 INFO:tasks.workunit.client.0.smithi042.stdout:2/799: truncate d7/f62 426539 0 2024-09-19T09:41:43.747 INFO:tasks.workunit.client.0.smithi042.stdout:5/743: mknod d2/d4/d64/da7/db4/c100 0 2024-09-19T09:41:43.747 INFO:tasks.workunit.client.0.smithi042.stdout:2/800: chown d7/dd/d14/d35/d45/d5e/f85 57035 1 2024-09-19T09:41:43.748 INFO:tasks.workunit.client.0.smithi042.stdout:4/790: creat d0/d1b/d1c/d2e/d3b/d95/db1/f10c x:0 0 0 2024-09-19T09:41:43.748 INFO:tasks.workunit.client.0.smithi042.stdout:4/791: truncate d0/d1b/d1c/d2e/d3b/f53 1666564 0 2024-09-19T09:41:43.749 INFO:tasks.workunit.client.0.smithi042.stdout:4/792: dread - d0/d1b/d1c/d2e/d3f/d6b/d8f/fe8 zero size 2024-09-19T09:41:43.749 INFO:tasks.workunit.client.0.smithi042.stdout:5/744: creat d2/d4/d20/d60/d72/d75/dc3/f101 x:0 0 0 2024-09-19T09:41:43.750 INFO:tasks.workunit.client.0.smithi042.stdout:2/801: rmdir d7/dd/d1f/d3f/d10b 0 2024-09-19T09:41:43.753 INFO:tasks.workunit.client.0.smithi042.stdout:2/802: dread d7/dd/d14/d35/d4e/d9c/f99 [0,4194304] 0 2024-09-19T09:41:43.753 INFO:tasks.workunit.client.0.smithi042.stdout:2/803: getdents d7/dd/d1f 0 2024-09-19T09:41:43.755 INFO:tasks.workunit.client.0.smithi042.stdout:2/804: creat d7/dd/d14/d35/d4e/d63/dd6/f10d x:0 0 0 2024-09-19T09:41:43.755 INFO:tasks.workunit.client.0.smithi042.stdout:2/805: write d7/dd/d14/d35/d4e/f65 [4432291,127677] 0 2024-09-19T09:41:43.756 INFO:tasks.workunit.client.0.smithi042.stdout:4/793: dread d0/fe [0,4194304] 0 2024-09-19T09:41:43.757 INFO:tasks.workunit.client.0.smithi042.stdout:2/806: creat d7/dd/d14/d35/d4c/d70/f10e x:0 0 0 2024-09-19T09:41:43.758 INFO:tasks.workunit.client.0.smithi042.stdout:2/807: readlink d7/l58 0 2024-09-19T09:41:43.758 INFO:tasks.workunit.client.0.smithi042.stdout:2/808: fdatasync d7/dd/d14/d35/d45/d5e/f85 0 2024-09-19T09:41:43.758 INFO:tasks.workunit.client.0.smithi042.stdout:6/793: sync 2024-09-19T09:41:43.759 INFO:tasks.workunit.client.0.smithi042.stdout:6/794: mkdir d1/de/d76/d99/db2/d34/d6f/df2 0 2024-09-19T09:41:43.761 INFO:tasks.workunit.client.0.smithi042.stdout:6/795: unlink d1/de/d12/d9a/ce0 0 2024-09-19T09:41:43.762 INFO:tasks.workunit.client.0.smithi042.stdout:6/796: symlink d1/d20/d6a/d46/d95/lf3 0 2024-09-19T09:41:43.762 INFO:tasks.workunit.client.0.smithi042.stdout:6/797: stat d1/d20/d6a/d46/d92/d3a/f4d 0 2024-09-19T09:41:43.763 INFO:tasks.workunit.client.0.smithi042.stdout:6/798: symlink d1/d20/d6a/d46/d92/d4f/lf4 0 2024-09-19T09:41:43.764 INFO:tasks.workunit.client.0.smithi042.stdout:7/659: dwrite d0/d56/da9/fc3 [0,4194304] 0 2024-09-19T09:41:43.766 INFO:tasks.workunit.client.0.smithi042.stdout:3/851: dwrite d4/f52 [0,4194304] 0 2024-09-19T09:41:43.769 INFO:tasks.workunit.client.0.smithi042.stdout:7/660: dread d0/d56/f66 [0,4194304] 0 2024-09-19T09:41:43.773 INFO:tasks.workunit.client.0.smithi042.stdout:4/794: read d0/f19 [1048433,51825] 0 2024-09-19T09:41:43.773 INFO:tasks.workunit.client.0.smithi042.stdout:4/795: fsync d0/d28/fac 0 2024-09-19T09:41:43.773 INFO:tasks.workunit.client.0.smithi042.stdout:4/796: write d0/d1b/f41 [3238294,101489] 0 2024-09-19T09:41:43.773 INFO:tasks.workunit.client.0.smithi042.stdout:7/661: creat d0/d3d/fd6 x:0 0 0 2024-09-19T09:41:43.774 INFO:tasks.workunit.client.0.smithi042.stdout:4/797: read - d0/d1b/d1c/d2e/d3f/d6b/fb5 zero size 2024-09-19T09:41:43.774 INFO:tasks.workunit.client.0.smithi042.stdout:7/662: mkdir d0/d40/d9d/dd7 0 2024-09-19T09:41:43.774 INFO:tasks.workunit.client.0.smithi042.stdout:4/798: read d0/d1b/d1c/f2c [360584,44818] 0 2024-09-19T09:41:43.775 INFO:tasks.workunit.client.0.smithi042.stdout:5/745: dwrite d2/d4/d20/d60/d72/f9c [0,4194304] 0 2024-09-19T09:41:43.775 INFO:tasks.workunit.client.0.smithi042.stdout:4/799: fsync d0/d1b/d56/f80 0 2024-09-19T09:41:43.775 INFO:tasks.workunit.client.0.smithi042.stdout:5/746: write d2/fe1 [957823,81238] 0 2024-09-19T09:41:43.776 INFO:tasks.workunit.client.0.smithi042.stdout:2/809: dwrite d7/dd/d14/d35/d4e/d9c/fde [0,4194304] 0 2024-09-19T09:41:43.776 INFO:tasks.workunit.client.0.smithi042.stdout:3/852: write d4/d8/d4c/d6b/f102 [1354727,118821] 0 2024-09-19T09:41:43.776 INFO:tasks.workunit.client.0.smithi042.stdout:3/853: write d4/d8/d9/d1b/d4f/d9c/fbb [1450207,64853] 0 2024-09-19T09:41:43.782 INFO:tasks.workunit.client.0.smithi042.stdout:7/663: write d0/d3d/d92/da1/f7f [1178397,37386] 0 2024-09-19T09:41:43.783 INFO:tasks.workunit.client.0.smithi042.stdout:7/664: fsync d0/f27 0 2024-09-19T09:41:43.784 INFO:tasks.workunit.client.0.smithi042.stdout:4/800: mknod d0/d1b/d1c/db8/c10d 0 2024-09-19T09:41:43.784 INFO:tasks.workunit.client.0.smithi042.stdout:2/810: rename d7/lbb to d7/dd/d14/l10f 0 2024-09-19T09:41:43.786 INFO:tasks.workunit.client.0.smithi042.stdout:7/665: truncate d0/f82 2978024 0 2024-09-19T09:41:43.786 INFO:tasks.workunit.client.0.smithi042.stdout:3/854: write d4/d8/d9/d1b/d4f/fe7 [2456406,58926] 0 2024-09-19T09:41:43.787 INFO:tasks.workunit.client.0.smithi042.stdout:4/801: mknod d0/d1b/d56/d86/c10e 0 2024-09-19T09:41:43.789 INFO:tasks.workunit.client.0.smithi042.stdout:6/799: dwrite d1/de/da7/dc2/fe7 [8388608,4194304] 0 2024-09-19T09:41:43.789 INFO:tasks.workunit.client.0.smithi042.stdout:6/800: stat d1/d20/d6a/d46/fc1 0 2024-09-19T09:41:43.789 INFO:tasks.workunit.client.0.smithi042.stdout:2/811: creat d7/d9b/f110 x:0 0 0 2024-09-19T09:41:43.789 INFO:tasks.workunit.client.0.smithi042.stdout:4/802: dread d0/f92 [0,4194304] 0 2024-09-19T09:41:43.796 INFO:tasks.workunit.client.0.smithi042.stdout:7/666: dread d0/d14/d3a/f3e [0,4194304] 0 2024-09-19T09:41:43.796 INFO:tasks.workunit.client.0.smithi042.stdout:5/747: dwrite d2/d4/d64/d6a/fdf [4194304,4194304] 0 2024-09-19T09:41:43.800 INFO:tasks.workunit.client.0.smithi042.stdout:6/801: creat d1/de/d76/d99/db2/ff5 x:0 0 0 2024-09-19T09:41:43.801 INFO:tasks.workunit.client.0.smithi042.stdout:4/803: symlink d0/d67/l10f 0 2024-09-19T09:41:43.805 INFO:tasks.workunit.client.0.smithi042.stdout:7/667: rename d0/d14/d44/d47/faf to d0/d40/d9d/dd0/fd8 0 2024-09-19T09:41:43.806 INFO:tasks.workunit.client.0.smithi042.stdout:5/748: mkdir d2/d4/d20/da4/dde/d102 0 2024-09-19T09:41:43.808 INFO:tasks.workunit.client.0.smithi042.stdout:2/812: dwrite d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/f95 [4194304,4194304] 0 2024-09-19T09:41:43.808 INFO:tasks.workunit.client.0.smithi042.stdout:2/813: write d7/d9b/fb5 [589107,10053] 0 2024-09-19T09:41:43.808 INFO:tasks.workunit.client.0.smithi042.stdout:2/814: dread - d7/dd/d14/d35/d4e/d9c/fda zero size 2024-09-19T09:41:43.808 INFO:tasks.workunit.client.0.smithi042.stdout:2/815: chown d7/dd/d1f 2666 1 2024-09-19T09:41:43.808 INFO:tasks.workunit.client.0.smithi042.stdout:5/749: dread d2/d4/d20/fc9 [0,4194304] 0 2024-09-19T09:41:43.809 INFO:tasks.workunit.client.0.smithi042.stdout:6/802: mknod d1/de/d5d/cf6 0 2024-09-19T09:41:43.810 INFO:tasks.workunit.client.0.smithi042.stdout:4/804: mkdir d0/d28/d36/d91/d110 0 2024-09-19T09:41:43.811 INFO:tasks.workunit.client.0.smithi042.stdout:7/668: creat d0/d3d/d85/d99/fd9 x:0 0 0 2024-09-19T09:41:43.811 INFO:tasks.workunit.client.0.smithi042.stdout:7/669: write d0/d3d/d55/f71 [924827,118042] 0 2024-09-19T09:41:43.813 INFO:tasks.workunit.client.0.smithi042.stdout:2/816: mknod d7/dd/d14/d35/d4c/d61/c111 0 2024-09-19T09:41:43.815 INFO:tasks.workunit.client.0.smithi042.stdout:5/750: rename d2/d25/d37/dc2/ff7 to d2/d4/d20/d60/d72/d75/f103 0 2024-09-19T09:41:43.816 INFO:tasks.workunit.client.0.smithi042.stdout:6/803: rename d1/de/d76/d99/db2/d34/d6f/d4a/f78 to d1/de/d54/dda/ff7 0 2024-09-19T09:41:43.816 INFO:tasks.workunit.client.0.smithi042.stdout:6/804: write d1/d20/d6a/d90/fe2 [123764,14834] 0 2024-09-19T09:41:43.817 INFO:tasks.workunit.client.0.smithi042.stdout:6/805: dread - d1/de/d5d/fcf zero size 2024-09-19T09:41:43.818 INFO:tasks.workunit.client.0.smithi042.stdout:2/817: rename d7/dd/d14/d35/d4e/f65 to d7/dd/d1f/f112 0 2024-09-19T09:41:43.818 INFO:tasks.workunit.client.0.smithi042.stdout:2/818: stat d7/dd/d14/d35/d4c/d61/deb 0 2024-09-19T09:41:43.822 INFO:tasks.workunit.client.0.smithi042.stdout:2/819: creat d7/f113 x:0 0 0 2024-09-19T09:41:43.822 INFO:tasks.workunit.client.0.smithi042.stdout:2/820: truncate d7/dd/d14/d35/d45/d5e/f85 226211 0 2024-09-19T09:41:43.824 INFO:tasks.workunit.client.0.smithi042.stdout:2/821: rename d7/dd/d14/d35/d4e/d63/cca to d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d107/c114 0 2024-09-19T09:41:43.825 INFO:tasks.workunit.client.0.smithi042.stdout:2/822: symlink d7/dd/d1f/l115 0 2024-09-19T09:41:43.826 INFO:tasks.workunit.client.0.smithi042.stdout:2/823: mknod d7/d9b/c116 0 2024-09-19T09:41:43.826 INFO:tasks.workunit.client.0.smithi042.stdout:2/824: readlink d7/dd/de3/l10a 0 2024-09-19T09:41:43.826 INFO:tasks.workunit.client.0.smithi042.stdout:2/825: readlink d7/dd/d1f/l115 0 2024-09-19T09:41:43.826 INFO:tasks.workunit.client.0.smithi042.stdout:2/826: chown d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/d88/f95 3415270 1 2024-09-19T09:41:43.828 INFO:tasks.workunit.client.0.smithi042.stdout:2/827: rmdir d7/dd/d1f 39 2024-09-19T09:41:43.829 INFO:tasks.workunit.client.0.smithi042.stdout:2/828: creat d7/dd/d14/d35/d4c/f117 x:0 0 0 2024-09-19T09:41:43.830 INFO:tasks.workunit.client.0.smithi042.stdout:4/805: dwrite d0/d1b/d1c/d2e/d3b/d95/db1/dba/d109/f99 [0,4194304] 0 2024-09-19T09:41:43.830 INFO:tasks.workunit.client.0.smithi042.stdout:6/806: dread d1/d20/d6a/d90/fdd [0,4194304] 0 2024-09-19T09:41:43.830 INFO:tasks.workunit.client.0.smithi042.stdout:6/807: chown d1/de/d5d 31476 1 2024-09-19T09:41:43.831 INFO:tasks.workunit.client.0.smithi042.stdout:1/857: sync 2024-09-19T09:41:43.831 INFO:tasks.workunit.client.0.smithi042.stdout:0/717: sync 2024-09-19T09:41:43.831 INFO:tasks.workunit.client.0.smithi042.stdout:8/839: sync 2024-09-19T09:41:43.831 INFO:tasks.workunit.client.0.smithi042.stdout:0/718: fsync d2/d10/d12/d24/d82/fdd 0 2024-09-19T09:41:43.832 INFO:tasks.workunit.client.0.smithi042.stdout:9/644: sync 2024-09-19T09:41:43.832 INFO:tasks.workunit.client.0.smithi042.stdout:4/806: creat d0/d1b/d1c/d2e/d3b/d95/db1/dba/f111 x:0 0 0 2024-09-19T09:41:43.833 INFO:tasks.workunit.client.0.smithi042.stdout:2/829: mkdir d7/dd/d14/d35/d45/d5e/d79/d118 0 2024-09-19T09:41:43.834 INFO:tasks.workunit.client.0.smithi042.stdout:6/808: creat d1/d20/d6a/d46/d92/ff8 x:0 0 0 2024-09-19T09:41:43.835 INFO:tasks.workunit.client.0.smithi042.stdout:1/858: creat d4/d12/d8d/dca/dd4/f115 x:0 0 0 2024-09-19T09:41:43.836 INFO:tasks.workunit.client.0.smithi042.stdout:7/670: dwrite d0/d3d/f4b [0,4194304] 0 2024-09-19T09:41:43.837 INFO:tasks.workunit.client.0.smithi042.stdout:8/840: creat d1/da8/d41/d55/d99/da4/dc2/ffb x:0 0 0 2024-09-19T09:41:43.839 INFO:tasks.workunit.client.0.smithi042.stdout:0/719: creat d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/fe3 x:0 0 0 2024-09-19T09:41:43.842 INFO:tasks.workunit.client.0.smithi042.stdout:4/807: getdents d0/d1b/d1c/d2e/d3b/d95/db1 0 2024-09-19T09:41:43.846 INFO:tasks.workunit.client.0.smithi042.stdout:2/830: rename d7/dd/f12 to d7/dd/d22/d30/d66/f119 0 2024-09-19T09:41:43.847 INFO:tasks.workunit.client.0.smithi042.stdout:0/720: dread d2/d10/d12/d16/f9b [0,4194304] 0 2024-09-19T09:41:43.847 INFO:tasks.workunit.client.0.smithi042.stdout:0/721: fdatasync d2/fe 0 2024-09-19T09:41:43.847 INFO:tasks.workunit.client.0.smithi042.stdout:9/645: unlink d8/d1d/d28/la1 0 2024-09-19T09:41:43.847 INFO:tasks.workunit.client.0.smithi042.stdout:9/646: fsync d8/da/d19/f1b 0 2024-09-19T09:41:43.848 INFO:tasks.workunit.client.0.smithi042.stdout:6/809: mkdir d1/d20/d6a/d46/df9 0 2024-09-19T09:41:43.850 INFO:tasks.workunit.client.0.smithi042.stdout:1/859: mknod d4/d15/d19/d45/d82/c116 0 2024-09-19T09:41:43.850 INFO:tasks.workunit.client.0.smithi042.stdout:1/860: fsync d4/f13 0 2024-09-19T09:41:43.850 INFO:tasks.workunit.client.0.smithi042.stdout:1/861: chown d4/d15/d19/d42/d51 4 1 2024-09-19T09:41:43.850 INFO:tasks.workunit.client.0.smithi042.stdout:5/751: link d2/d4/d64/da7/c3b d2/db/d3c/c104 0 2024-09-19T09:41:43.851 INFO:tasks.workunit.client.0.smithi042.stdout:7/671: truncate d0/d3d/d92/da1/f91 997747 0 2024-09-19T09:41:43.856 INFO:tasks.workunit.client.0.smithi042.stdout:0/722: creat d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/dca/fe4 x:0 0 0 2024-09-19T09:41:43.856 INFO:tasks.workunit.client.0.smithi042.stdout:6/810: mkdir d1/de/d76/d99/db2/d34/d6f/d93/dfa 0 2024-09-19T09:41:43.856 INFO:tasks.workunit.client.0.smithi042.stdout:6/811: read - d1/de/d76/d99/db2/d34/d6f/d4a/d98/ff1 zero size 2024-09-19T09:41:43.856 INFO:tasks.workunit.client.0.smithi042.stdout:0/723: write d2/d10/d12/d16/d51/fd7 [251945,108282] 0 2024-09-19T09:41:43.856 INFO:tasks.workunit.client.0.smithi042.stdout:0/724: write d2/d10/d12/d16/d57/d78/db3/fc8 [842133,47964] 0 2024-09-19T09:41:43.856 INFO:tasks.workunit.client.0.smithi042.stdout:8/841: dwrite d1/da/dd/fbe [0,4194304] 0 2024-09-19T09:41:43.857 INFO:tasks.workunit.client.0.smithi042.stdout:1/862: creat d4/d12/d8d/dca/f117 x:0 0 0 2024-09-19T09:41:43.857 INFO:tasks.workunit.client.0.smithi042.stdout:1/863: truncate d4/d1e/d25/fee 805147 0 2024-09-19T09:41:43.858 INFO:tasks.workunit.client.0.smithi042.stdout:1/864: write d4/d12/d8d/dca/dd4/f115 [57847,101106] 0 2024-09-19T09:41:43.859 INFO:tasks.workunit.client.0.smithi042.stdout:5/752: getdents d2/d4/d20/d31 0 2024-09-19T09:41:43.859 INFO:tasks.workunit.client.0.smithi042.stdout:5/753: readlink d2/d4/d64/dab/l19 0 2024-09-19T09:41:43.861 INFO:tasks.workunit.client.0.smithi042.stdout:9/647: dread f5 [0,4194304] 0 2024-09-19T09:41:43.861 INFO:tasks.workunit.client.0.smithi042.stdout:9/648: chown d8/da/d19/d1c/d21 2020959293 1 2024-09-19T09:41:43.861 INFO:tasks.workunit.client.0.smithi042.stdout:9/649: write d8/da/d19/d1c/d21/d7f/d72/fab [426868,105655] 0 2024-09-19T09:41:43.861 INFO:tasks.workunit.client.0.smithi042.stdout:9/650: truncate d8/da/d89/fbc 343722 0 2024-09-19T09:41:43.861 INFO:tasks.workunit.client.0.smithi042.stdout:9/651: chown d8/da/c46 1087 1 2024-09-19T09:41:43.864 INFO:tasks.workunit.client.0.smithi042.stdout:8/842: mkdir d1/da/d14/dfc 0 2024-09-19T09:41:43.864 INFO:tasks.workunit.client.0.smithi042.stdout:8/843: fdatasync d1/da/dd/d74/fda 0 2024-09-19T09:41:43.864 INFO:tasks.workunit.client.0.smithi042.stdout:8/844: chown d1/da/dd/d74/dbc/fc0 45991 1 2024-09-19T09:41:43.866 INFO:tasks.workunit.client.0.smithi042.stdout:6/812: creat d1/de/ffb x:0 0 0 2024-09-19T09:41:43.866 INFO:tasks.workunit.client.0.smithi042.stdout:6/813: chown d1/de/d76/d99/db2/d34/d6f/d4a/d98/fd5 35606 1 2024-09-19T09:41:43.867 INFO:tasks.workunit.client.0.smithi042.stdout:0/725: rmdir d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da6 39 2024-09-19T09:41:43.870 INFO:tasks.workunit.client.0.smithi042.stdout:9/652: mkdir d8/da/d19/d1c/d21/dbf 0 2024-09-19T09:41:43.870 INFO:tasks.workunit.client.0.smithi042.stdout:9/653: truncate d8/da/d19/d1c/d21/d7f/f9a 683591 0 2024-09-19T09:41:43.870 INFO:tasks.workunit.client.0.smithi042.stdout:9/654: dread - d8/da/d89/da7/db6/db5/f83 zero size 2024-09-19T09:41:43.872 INFO:tasks.workunit.client.0.smithi042.stdout:5/754: unlink d2/fb1 0 2024-09-19T09:41:43.872 INFO:tasks.workunit.client.0.smithi042.stdout:7/672: dwrite d0/d3d/d92/fa4 [0,4194304] 0 2024-09-19T09:41:43.872 INFO:tasks.workunit.client.0.smithi042.stdout:7/673: fsync d0/d3d/db0/fc9 0 2024-09-19T09:41:43.873 INFO:tasks.workunit.client.0.smithi042.stdout:8/845: symlink d1/da/dcd/lfd 0 2024-09-19T09:41:43.873 INFO:tasks.workunit.client.0.smithi042.stdout:7/674: read d0/d3d/d55/f74 [545635,26879] 0 2024-09-19T09:41:43.876 INFO:tasks.workunit.client.0.smithi042.stdout:1/865: dwrite d4/d15/d61/d85/dc9/de8/f10f [0,4194304] 0 2024-09-19T09:41:43.877 INFO:tasks.workunit.client.0.smithi042.stdout:6/814: symlink d1/de/d54/lfc 0 2024-09-19T09:41:43.878 INFO:tasks.workunit.client.0.smithi042.stdout:0/726: getdents d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/d9f 0 2024-09-19T09:41:43.883 INFO:tasks.workunit.client.0.smithi042.stdout:0/727: mkdir d2/d10/d12/d16/d57/d99/dd0/de5 0 2024-09-19T09:41:43.883 INFO:tasks.workunit.client.0.smithi042.stdout:0/728: dread d2/d10/d1d/f59 [0,4194304] 0 2024-09-19T09:41:43.887 INFO:tasks.workunit.client.0.smithi042.stdout:2/831: link c5 d7/dd/d14/d35/d4c/d61/deb/c11a 0 2024-09-19T09:41:43.887 INFO:tasks.workunit.client.0.smithi042.stdout:2/832: write d7/dd/d14/d35/ff5 [570716,56863] 0 2024-09-19T09:41:43.887 INFO:tasks.workunit.client.0.smithi042.stdout:2/833: readlink d7/dd/d14/d35/d4c/d61/d87/dc3/lf0 0 2024-09-19T09:41:43.889 INFO:tasks.workunit.client.0.smithi042.stdout:7/675: rename d0/d3d/d55/d72/lbd to d0/d40/d9d/db5/lda 0 2024-09-19T09:41:43.889 INFO:tasks.workunit.client.0.smithi042.stdout:1/866: dread d4/d15/d19/d42/d51/ff0 [0,4194304] 0 2024-09-19T09:41:43.892 INFO:tasks.workunit.client.0.smithi042.stdout:0/729: mkdir d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/d9f/de6 0 2024-09-19T09:41:43.892 INFO:tasks.workunit.client.0.smithi042.stdout:5/755: creat d2/d4/d64/da7/dda/de6/f105 x:0 0 0 2024-09-19T09:41:43.894 INFO:tasks.workunit.client.0.smithi042.stdout:7/676: mkdir d0/d40/d9d/dd0/ddb 0 2024-09-19T09:41:43.895 INFO:tasks.workunit.client.0.smithi042.stdout:8/846: dwrite d1/da8/d41/d55/f6b [0,4194304] 0 2024-09-19T09:41:43.895 INFO:tasks.workunit.client.0.smithi042.stdout:8/847: write d1/d72/f91 [1395852,39893] 0 2024-09-19T09:41:43.895 INFO:tasks.workunit.client.0.smithi042.stdout:8/848: chown d1/da/d14/df6 96 1 2024-09-19T09:41:43.896 INFO:tasks.workunit.client.0.smithi042.stdout:8/849: getdents d1/da/dd/d8e 0 2024-09-19T09:41:43.897 INFO:tasks.workunit.client.0.smithi042.stdout:9/655: dwrite d8/db/f61 [0,4194304] 0 2024-09-19T09:41:43.900 INFO:tasks.workunit.client.0.smithi042.stdout:9/656: link d8/da/d89/da7/db6/db5/f83 d8/db/d31/fc0 0 2024-09-19T09:41:43.904 INFO:tasks.workunit.client.0.smithi042.stdout:3/855: sync 2024-09-19T09:41:43.905 INFO:tasks.workunit.client.0.smithi042.stdout:7/677: dread d0/f59 [0,4194304] 0 2024-09-19T09:41:43.905 INFO:tasks.workunit.client.0.smithi042.stdout:1/867: dread d4/d29/f102 [0,4194304] 0 2024-09-19T09:41:43.906 INFO:tasks.workunit.client.0.smithi042.stdout:3/856: rename d4/d8/d4c/d6b/db9/c106 to d4/d8/d9/dc/dbf/d6d/c116 0 2024-09-19T09:41:43.907 INFO:tasks.workunit.client.0.smithi042.stdout:7/678: truncate d0/d56/f66 1615873 0 2024-09-19T09:41:43.908 INFO:tasks.workunit.client.0.smithi042.stdout:3/857: mknod d4/d8/d9/dc/dbf/c117 0 2024-09-19T09:41:43.908 INFO:tasks.workunit.client.0.smithi042.stdout:3/858: truncate d4/d8/d9/d1b/fd1 678783 0 2024-09-19T09:41:43.908 INFO:tasks.workunit.client.0.smithi042.stdout:3/859: dread - d4/d8/d9/ff4 zero size 2024-09-19T09:41:43.908 INFO:tasks.workunit.client.0.smithi042.stdout:3/860: fsync d4/d8/d4c/f71 0 2024-09-19T09:41:43.909 INFO:tasks.workunit.client.0.smithi042.stdout:7/679: dread - d0/d14/fa7 zero size 2024-09-19T09:41:43.910 INFO:tasks.workunit.client.0.smithi042.stdout:9/657: dread d8/da/d19/f2b [0,4194304] 0 2024-09-19T09:41:43.912 INFO:tasks.workunit.client.0.smithi042.stdout:9/658: symlink d8/lc1 0 2024-09-19T09:41:43.912 INFO:tasks.workunit.client.0.smithi042.stdout:9/659: fdatasync d8/da/fb8 0 2024-09-19T09:41:43.913 INFO:tasks.workunit.client.0.smithi042.stdout:1/868: dread d4/d15/d19/fe [0,4194304] 0 2024-09-19T09:41:43.913 INFO:tasks.workunit.client.0.smithi042.stdout:1/869: write d4/d15/d61/d85/fab [1724101,23171] 0 2024-09-19T09:41:43.915 INFO:tasks.workunit.client.0.smithi042.stdout:9/660: dread d8/db/d31/f75 [0,4194304] 0 2024-09-19T09:41:43.915 INFO:tasks.workunit.client.0.smithi042.stdout:9/661: write d8/da/d70/f7a [5215901,53631] 0 2024-09-19T09:41:43.915 INFO:tasks.workunit.client.0.smithi042.stdout:1/870: mknod d4/d15/d61/d85/dc9/de8/df5/c118 0 2024-09-19T09:41:43.916 INFO:tasks.workunit.client.0.smithi042.stdout:1/871: read d4/d12/d8d/d91/feb [327232,5668] 0 2024-09-19T09:41:43.917 INFO:tasks.workunit.client.0.smithi042.stdout:1/872: getdents d4/d1e/d25 0 2024-09-19T09:41:43.918 INFO:tasks.workunit.client.0.smithi042.stdout:5/756: dwrite d2/d4/fe7 [0,4194304] 0 2024-09-19T09:41:43.919 INFO:tasks.workunit.client.0.smithi042.stdout:5/757: symlink d2/d4/d20/da4/dde/l106 0 2024-09-19T09:41:43.919 INFO:tasks.workunit.client.0.smithi042.stdout:5/758: rmdir d2/d4/d20/d31 39 2024-09-19T09:41:43.920 INFO:tasks.workunit.client.0.smithi042.stdout:5/759: symlink d2/db/l107 0 2024-09-19T09:41:43.921 INFO:tasks.workunit.client.0.smithi042.stdout:8/850: dwrite d1/da8/d41/feb [0,4194304] 0 2024-09-19T09:41:43.922 INFO:tasks.workunit.client.0.smithi042.stdout:0/730: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da0/fab [4194304,4194304] 0 2024-09-19T09:41:43.926 INFO:tasks.workunit.client.0.smithi042.stdout:2/834: dwrite d7/dd/d14/d35/d4c/d61/d87/da6/fc2 [0,4194304] 0 2024-09-19T09:41:43.926 INFO:tasks.workunit.client.0.smithi042.stdout:3/861: dread d4/d8/d9/dc/f59 [0,4194304] 0 2024-09-19T09:41:43.927 INFO:tasks.workunit.client.0.smithi042.stdout:2/835: truncate d7/dd/d1f/d3f/f6c 405192 0 2024-09-19T09:41:43.930 INFO:tasks.workunit.client.0.smithi042.stdout:5/760: dread d2/d4/d20/f62 [0,4194304] 0 2024-09-19T09:41:43.940 INFO:tasks.workunit.client.0.smithi042.stdout:7/680: dread d0/d3d/d85/d99/fb8 [0,4194304] 0 2024-09-19T09:41:43.945 INFO:tasks.workunit.client.0.smithi042.stdout:3/862: write d4/d8/d9/d1b/d4f/f77 [2833990,75311] 0 2024-09-19T09:41:43.946 INFO:tasks.workunit.client.0.smithi042.stdout:5/761: dread d2/d4/fa [0,4194304] 0 2024-09-19T09:41:43.946 INFO:tasks.workunit.client.0.smithi042.stdout:1/873: dwrite d4/d15/d19/d45/f4d [0,4194304] 0 2024-09-19T09:41:43.946 INFO:tasks.workunit.client.0.smithi042.stdout:1/874: creat d4/d15/d19/d45/f119 x:0 0 0 2024-09-19T09:41:43.947 INFO:tasks.workunit.client.0.smithi042.stdout:7/681: dread d0/d14/d3a/f8a [0,4194304] 0 2024-09-19T09:41:43.947 INFO:tasks.workunit.client.0.smithi042.stdout:7/682: truncate d0/d3d/d55/d72/fc2 650771 0 2024-09-19T09:41:43.949 INFO:tasks.workunit.client.0.smithi042.stdout:7/683: unlink d0/d14/d3c/c51 0 2024-09-19T09:41:43.949 INFO:tasks.workunit.client.0.smithi042.stdout:7/684: chown d0/d3d/d55/d72/db6 232369 1 2024-09-19T09:41:43.954 INFO:tasks.workunit.client.0.smithi042.stdout:8/851: dread d1/da8/d41/d55/fc5 [0,4194304] 0 2024-09-19T09:41:43.955 INFO:tasks.workunit.client.0.smithi042.stdout:2/836: dread d7/dd/d14/d35/d4e/d63/f104 [0,4194304] 0 2024-09-19T09:41:43.956 INFO:tasks.workunit.client.0.smithi042.stdout:2/837: write d7/dd/d14/d35/d4c/d61/d87/dbf/dc7/fee [479583,67647] 0 2024-09-19T09:41:43.958 INFO:tasks.workunit.client.0.smithi042.stdout:0/731: dwrite d2/d10/d1e/f6c [4194304,4194304] 0 2024-09-19T09:41:43.962 INFO:tasks.workunit.client.0.smithi042.stdout:3/863: dread d4/d8/d9/dc/f6e [0,4194304] 0 2024-09-19T09:41:43.966 INFO:tasks.workunit.client.0.smithi042.stdout:3/864: creat d4/d8/d9/dc/dbf/f118 x:0 0 0 2024-09-19T09:41:43.966 INFO:tasks.workunit.client.0.smithi042.stdout:4/808: sync 2024-09-19T09:41:43.967 INFO:tasks.workunit.client.0.smithi042.stdout:5/762: dread d2/d4/d64/dab/f47 [0,4194304] 0 2024-09-19T09:41:43.968 INFO:tasks.workunit.client.0.smithi042.stdout:4/809: getdents d0/d1b/d1c/d2e/d3b/d95 0 2024-09-19T09:41:43.968 INFO:tasks.workunit.client.0.smithi042.stdout:2/838: dread d7/dd/d14/d35/d4e/f9d [0,4194304] 0 2024-09-19T09:41:43.968 INFO:tasks.workunit.client.0.smithi042.stdout:2/839: fdatasync d7/dd/d14/d35/d4c/fcb 0 2024-09-19T09:41:43.969 INFO:tasks.workunit.client.0.smithi042.stdout:5/763: getdents d2/d4/d20/d60 0 2024-09-19T09:41:43.970 INFO:tasks.workunit.client.0.smithi042.stdout:7/685: dwrite d0/d14/d3a/f6e [4194304,4194304] 0 2024-09-19T09:41:43.970 INFO:tasks.workunit.client.0.smithi042.stdout:7/686: chown d0/d3d/d85/f8b 7788 1 2024-09-19T09:41:43.972 INFO:tasks.workunit.client.0.smithi042.stdout:7/687: rename d0/d3d/d55/d72 to d0/d14/d3a/ddc 0 2024-09-19T09:41:43.976 INFO:tasks.workunit.client.0.smithi042.stdout:3/865: dread d4/d78/d9d/fe8 [0,4194304] 0 2024-09-19T09:41:43.977 INFO:tasks.workunit.client.0.smithi042.stdout:3/866: symlink d4/d8/d9/d115/d82/d8c/l119 0 2024-09-19T09:41:43.978 INFO:tasks.workunit.client.0.smithi042.stdout:5/764: dread d2/d25/f2b [0,4194304] 0 2024-09-19T09:41:43.978 INFO:tasks.workunit.client.0.smithi042.stdout:2/840: write d7/dd/d14/d35/d4c/d61/d87/dc6/ffe [829841,115660] 0 2024-09-19T09:41:43.979 INFO:tasks.workunit.client.0.smithi042.stdout:3/867: mknod d4/d8/d9/d115/d82/d48/da5/de6/c11a 0 2024-09-19T09:41:43.979 INFO:tasks.workunit.client.0.smithi042.stdout:5/765: fsync d2/d4/d64/da7/dda/de6/fd4 0 2024-09-19T09:41:43.979 INFO:tasks.workunit.client.0.smithi042.stdout:4/810: write d0/d1b/d1c/fdb [1813415,2923] 0 2024-09-19T09:41:43.982 INFO:tasks.workunit.client.0.smithi042.stdout:3/868: truncate d4/d8/d9/f56 4450667 0 2024-09-19T09:41:43.984 INFO:tasks.workunit.client.0.smithi042.stdout:5/766: creat d2/d4/d20/d60/d72/f108 x:0 0 0 2024-09-19T09:41:43.987 INFO:tasks.workunit.client.0.smithi042.stdout:3/869: mkdir d4/d8/d9/d115/d82/d8c/d104/d11b 0 2024-09-19T09:41:43.988 INFO:tasks.workunit.client.0.smithi042.stdout:8/852: dwrite d1/da8/d41/d55/d99/da4/f6d [4194304,4194304] 0 2024-09-19T09:41:43.988 INFO:tasks.workunit.client.0.smithi042.stdout:8/853: write d1/da8/d41/ff1 [761747,46619] 0 2024-09-19T09:41:43.988 INFO:tasks.workunit.client.0.smithi042.stdout:8/854: truncate d1/ddc/ff0 28412 0 2024-09-19T09:41:43.989 INFO:tasks.workunit.client.0.smithi042.stdout:8/855: fdatasync d1/da8/db1/dcb/ff4 0 2024-09-19T09:41:43.989 INFO:tasks.workunit.client.0.smithi042.stdout:5/767: truncate d2/d4/d64/dab/f92 2584001 0 2024-09-19T09:41:43.989 INFO:tasks.workunit.client.0.smithi042.stdout:5/768: chown d2/d4/d64/da7/db4/dd8/fe5 134 1 2024-09-19T09:41:43.990 INFO:tasks.workunit.client.0.smithi042.stdout:5/769: chown d2/db/d3c/c59 1466 1 2024-09-19T09:41:43.990 INFO:tasks.workunit.client.0.smithi042.stdout:4/811: symlink d0/d1b/l112 0 2024-09-19T09:41:43.990 INFO:tasks.workunit.client.0.smithi042.stdout:4/812: stat d0/d1b/d1c/d2e/d3f/d6b/fb5 0 2024-09-19T09:41:43.991 INFO:tasks.workunit.client.0.smithi042.stdout:4/813: rmdir d0/d1b/d1c/d2e/d3b/d95/db1/dba 39 2024-09-19T09:41:43.992 INFO:tasks.workunit.client.0.smithi042.stdout:7/688: dwrite d0/d14/d3a/ddc/fd2 [0,4194304] 0 2024-09-19T09:41:43.993 INFO:tasks.workunit.client.0.smithi042.stdout:0/732: dwrite d2/d10/d12/d24/f42 [0,4194304] 0 2024-09-19T09:41:43.995 INFO:tasks.workunit.client.0.smithi042.stdout:7/689: creat d0/fdd x:0 0 0 2024-09-19T09:41:43.996 INFO:tasks.workunit.client.0.smithi042.stdout:7/690: chown d0/d3d/d85/d99/fd9 505536 1 2024-09-19T09:41:43.996 INFO:tasks.workunit.client.0.smithi042.stdout:0/733: write d2/d10/d6b/f77 [617742,100020] 0 2024-09-19T09:41:44.000 INFO:tasks.workunit.client.0.smithi042.stdout:0/734: creat d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/fe7 x:0 0 0 2024-09-19T09:41:44.000 INFO:tasks.workunit.client.0.smithi042.stdout:0/735: write d2/d10/d6b/f77 [1784405,87981] 0 2024-09-19T09:41:44.001 INFO:tasks.workunit.client.0.smithi042.stdout:0/736: symlink d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/le8 0 2024-09-19T09:41:44.001 INFO:tasks.workunit.client.0.smithi042.stdout:0/737: dread - d2/d10/fd2 zero size 2024-09-19T09:41:44.002 INFO:tasks.workunit.client.0.smithi042.stdout:2/841: rename d7/dd/d14/d35/d4c/d61/d87/dbf to d7/dd/d14/d11b 0 2024-09-19T09:41:44.004 INFO:tasks.workunit.client.0.smithi042.stdout:8/856: rename d1/da/l23 to d1/da8/db1/lfe 0 2024-09-19T09:41:44.006 INFO:tasks.workunit.client.0.smithi042.stdout:5/770: rename d2/d25/f2b to d2/d4/d20/d31/f109 0 2024-09-19T09:41:44.006 INFO:tasks.workunit.client.0.smithi042.stdout:8/857: creat d1/da/dd/d74/fff x:0 0 0 2024-09-19T09:41:44.007 INFO:tasks.workunit.client.0.smithi042.stdout:2/842: symlink d7/d9b/l11c 0 2024-09-19T09:41:44.008 INFO:tasks.workunit.client.0.smithi042.stdout:8/858: truncate d1/da/dd/f5c 824215 0 2024-09-19T09:41:44.009 INFO:tasks.workunit.client.0.smithi042.stdout:8/859: write d1/da8/d41/ff1 [1584400,71648] 0 2024-09-19T09:41:44.010 INFO:tasks.workunit.client.0.smithi042.stdout:8/860: mknod d1/da/dd/d74/c100 0 2024-09-19T09:41:44.010 INFO:tasks.workunit.client.0.smithi042.stdout:8/861: fdatasync d1/da8/f54 0 2024-09-19T09:41:44.012 INFO:tasks.workunit.client.0.smithi042.stdout:5/771: rename d2/d4/la1 to d2/de3/l10a 0 2024-09-19T09:41:44.012 INFO:tasks.workunit.client.0.smithi042.stdout:5/772: fsync d2/db/d3c/fa0 0 2024-09-19T09:41:44.012 INFO:tasks.workunit.client.0.smithi042.stdout:5/773: dread - d2/d4/d64/dab/fc5 zero size 2024-09-19T09:41:44.013 INFO:tasks.workunit.client.0.smithi042.stdout:8/862: unlink d1/da/dd/fbe 0 2024-09-19T09:41:44.015 INFO:tasks.workunit.client.0.smithi042.stdout:0/738: dread d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da0/fab [0,4194304] 0 2024-09-19T09:41:44.016 INFO:tasks.workunit.client.0.smithi042.stdout:2/843: dread d7/dd/d14/d35/d4e/d9c/fae [0,4194304] 0 2024-09-19T09:41:44.019 INFO:tasks.workunit.client.0.smithi042.stdout:0/739: mknod d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da0/ce9 0 2024-09-19T09:41:44.019 INFO:tasks.workunit.client.0.smithi042.stdout:0/740: chown d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/cae 194260661 1 2024-09-19T09:41:44.021 INFO:tasks.workunit.client.0.smithi042.stdout:2/844: symlink d7/dd/d14/d35/d4e/d9c/l11d 0 2024-09-19T09:41:44.021 INFO:tasks.workunit.client.0.smithi042.stdout:2/845: fdatasync d7/dd/d14/d35/d45/d5e/f85 0 2024-09-19T09:41:44.021 INFO:tasks.workunit.client.0.smithi042.stdout:2/846: chown d7/dd/d14/d11b/lcc 27 1 2024-09-19T09:41:44.025 INFO:tasks.workunit.client.0.smithi042.stdout:2/847: dread d7/dd/d14/d11b/dc7/fee [0,4194304] 0 2024-09-19T09:41:44.027 INFO:tasks.workunit.client.0.smithi042.stdout:3/870: dwrite f0 [0,4194304] 0 2024-09-19T09:41:44.027 INFO:tasks.workunit.client.0.smithi042.stdout:7/691: dwrite d0/d14/d3a/f3e [0,4194304] 0 2024-09-19T09:41:44.030 INFO:tasks.workunit.client.0.smithi042.stdout:8/863: link d1/da/d14/c29 d1/da/dd/c101 0 2024-09-19T09:41:44.031 INFO:tasks.workunit.client.0.smithi042.stdout:3/871: mkdir d4/d8/d4c/d6b/dfc/d11c 0 2024-09-19T09:41:44.031 INFO:tasks.workunit.client.0.smithi042.stdout:3/872: dread - d4/d8/d9/dc/dbf/f118 zero size 2024-09-19T09:41:44.032 INFO:tasks.workunit.client.0.smithi042.stdout:7/692: mkdir d0/dde 0 2024-09-19T09:41:44.034 INFO:tasks.workunit.client.0.smithi042.stdout:7/693: mknod d0/d14/d3a/ddc/db6/dbb/dcc/cdf 0 2024-09-19T09:41:44.035 INFO:tasks.workunit.client.0.smithi042.stdout:7/694: mknod d0/d40/d9d/db5/ce0 0 2024-09-19T09:41:44.035 INFO:tasks.workunit.client.0.smithi042.stdout:7/695: write d0/d14/d44/fc5 [241327,115099] 0 2024-09-19T09:41:44.035 INFO:tasks.workunit.client.0.smithi042.stdout:5/774: write d2/d25/d37/dc2/fed [4184252,72281] 0 2024-09-19T09:41:44.037 INFO:tasks.workunit.client.0.smithi042.stdout:5/775: rename d2/d4/d20/d60/d72/d75/c9a to d2/d4/d20/d60/d72/d75/c10b 0 2024-09-19T09:41:44.037 INFO:tasks.workunit.client.0.smithi042.stdout:6/815: sync 2024-09-19T09:41:44.038 INFO:tasks.workunit.client.0.smithi042.stdout:6/816: mknod d1/d20/cfd 0 2024-09-19T09:41:44.038 INFO:tasks.workunit.client.0.smithi042.stdout:6/817: write d1/d20/d6a/d46/d92/d4f/f9b [1083931,111150] 0 2024-09-19T09:41:44.040 INFO:tasks.workunit.client.0.smithi042.stdout:0/741: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/fe3 [0,4194304] 0 2024-09-19T09:41:44.046 INFO:tasks.workunit.client.0.smithi042.stdout:0/742: rmdir d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/d9f/de6 0 2024-09-19T09:41:44.051 INFO:tasks.workunit.client.0.smithi042.stdout:2/848: dwrite d7/dd/d14/d35/d4c/d61/d87/fe6 [0,4194304] 0 2024-09-19T09:41:44.051 INFO:tasks.workunit.client.0.smithi042.stdout:2/849: write d7/dd/d14/d35/d4e/f80 [716071,73782] 0 2024-09-19T09:41:44.051 INFO:tasks.workunit.client.0.smithi042.stdout:2/850: fsync d7/dd/d22/f86 0 2024-09-19T09:41:44.055 INFO:tasks.workunit.client.0.smithi042.stdout:0/743: dread d2/d10/d1d/d34/f4a [0,4194304] 0 2024-09-19T09:41:44.055 INFO:tasks.workunit.client.0.smithi042.stdout:0/744: read d2/d10/f15 [4056653,72867] 0 2024-09-19T09:41:44.056 INFO:tasks.workunit.client.0.smithi042.stdout:0/745: dread d2/f1c [8388608,4194304] 0 2024-09-19T09:41:44.059 INFO:tasks.workunit.client.0.smithi042.stdout:3/873: dwrite d4/d8/d4c/f81 [0,4194304] 0 2024-09-19T09:41:44.060 INFO:tasks.workunit.client.0.smithi042.stdout:8/864: dwrite d1/da/d3f/fbd [0,4194304] 0 2024-09-19T09:41:44.066 INFO:tasks.workunit.client.0.smithi042.stdout:5/776: dwrite d2/d4/d20/d31/f32 [0,4194304] 0 2024-09-19T09:41:44.067 INFO:tasks.workunit.client.0.smithi042.stdout:3/874: symlink d4/d8/d9/dc/dbf/d35/l11d 0 2024-09-19T09:41:44.067 INFO:tasks.workunit.client.0.smithi042.stdout:9/662: sync 2024-09-19T09:41:44.067 INFO:tasks.workunit.client.0.smithi042.stdout:1/875: sync 2024-09-19T09:41:44.067 INFO:tasks.workunit.client.0.smithi042.stdout:1/876: write d4/d15/d19/d45/f119 [594750,15096] 0 2024-09-19T09:41:44.068 INFO:tasks.workunit.client.0.smithi042.stdout:6/818: dwrite d1/d20/d6a/d90/fe2 [0,4194304] 0 2024-09-19T09:41:44.068 INFO:tasks.workunit.client.0.smithi042.stdout:5/777: creat d2/d4/d20/d60/db0/f10c x:0 0 0 2024-09-19T09:41:44.069 INFO:tasks.workunit.client.0.smithi042.stdout:3/875: creat d4/d8/d9/dc/dbf/d107/f11e x:0 0 0 2024-09-19T09:41:44.070 INFO:tasks.workunit.client.0.smithi042.stdout:9/663: rmdir d8/da 39 2024-09-19T09:41:44.071 INFO:tasks.workunit.client.0.smithi042.stdout:1/877: link d4/c11 d4/d15/d19/d45/c11a 0 2024-09-19T09:41:44.073 INFO:tasks.workunit.client.0.smithi042.stdout:6/819: creat d1/de/ffe x:0 0 0 2024-09-19T09:41:44.074 INFO:tasks.workunit.client.0.smithi042.stdout:6/820: fsync d1/d20/d6a/d90/fdd 0 2024-09-19T09:41:44.074 INFO:tasks.workunit.client.0.smithi042.stdout:6/821: write d1/de/d5d/fcf [598551,75610] 0 2024-09-19T09:41:44.074 INFO:tasks.workunit.client.0.smithi042.stdout:7/696: dwrite d0/d14/d3a/ddc/f86 [4194304,4194304] 0 2024-09-19T09:41:44.074 INFO:tasks.workunit.client.0.smithi042.stdout:3/876: creat d4/d8/dff/f11f x:0 0 0 2024-09-19T09:41:44.075 INFO:tasks.workunit.client.0.smithi042.stdout:3/877: chown d4/d8/d4c/d6b/db9/dee 2 1 2024-09-19T09:41:44.075 INFO:tasks.workunit.client.0.smithi042.stdout:3/878: read d4/d8/d9/dc/dbf/d8b/f99 [45051,71173] 0 2024-09-19T09:41:44.075 INFO:tasks.workunit.client.0.smithi042.stdout:3/879: truncate d4/d8/d9/d115/d82/d8c/d9f/fd4 569524 0 2024-09-19T09:41:44.075 INFO:tasks.workunit.client.0.smithi042.stdout:1/878: creat d4/d15/d2e/d105/f11b x:0 0 0 2024-09-19T09:41:44.076 INFO:tasks.workunit.client.0.smithi042.stdout:5/778: unlink d2/d4/d20/l9d 0 2024-09-19T09:41:44.077 INFO:tasks.workunit.client.0.smithi042.stdout:8/865: dwrite d1/da8/d41/fb5 [0,4194304] 0 2024-09-19T09:41:44.080 INFO:tasks.workunit.client.0.smithi042.stdout:7/697: creat d0/d14/d3c/fe1 x:0 0 0 2024-09-19T09:41:44.080 INFO:tasks.workunit.client.0.smithi042.stdout:1/879: write d4/d15/f21 [2985084,59974] 0 2024-09-19T09:41:44.080 INFO:tasks.workunit.client.0.smithi042.stdout:5/779: mkdir d2/d4/d20/d60/d72/d75/d10d 0 2024-09-19T09:41:44.081 INFO:tasks.workunit.client.0.smithi042.stdout:7/698: symlink d0/d40/d9d/db5/le2 0 2024-09-19T09:41:44.085 INFO:tasks.workunit.client.0.smithi042.stdout:1/880: dread d4/f14 [0,4194304] 0 2024-09-19T09:41:44.087 INFO:tasks.workunit.client.0.smithi042.stdout:4/814: sync 2024-09-19T09:41:44.087 INFO:tasks.workunit.client.0.smithi042.stdout:0/746: link d2/d8e/l58 d2/d10/d12/d16/d57/d99/dd0/lea 0 2024-09-19T09:41:44.092 INFO:tasks.workunit.client.0.smithi042.stdout:0/747: symlink d2/d10/d12/d16/d57/d99/dd0/leb 0 2024-09-19T09:41:44.092 INFO:tasks.workunit.client.0.smithi042.stdout:0/748: write d2/d10/d12/d16/d57/d99/dd0/fb4 [1650045,9573] 0 2024-09-19T09:41:44.096 INFO:tasks.workunit.client.0.smithi042.stdout:0/749: mkdir d2/d10/d12/dec 0 2024-09-19T09:41:44.096 INFO:tasks.workunit.client.0.smithi042.stdout:0/750: write d2/d10/f15 [1068570,127456] 0 2024-09-19T09:41:44.099 INFO:tasks.workunit.client.0.smithi042.stdout:0/751: unlink d2/d10/d1d/l9e 0 2024-09-19T09:41:44.099 INFO:tasks.workunit.client.0.smithi042.stdout:0/752: fdatasync d2/d10/d12/f31 0 2024-09-19T09:41:44.101 INFO:tasks.workunit.client.0.smithi042.stdout:7/699: write d0/d56/f88 [3928678,9753] 0 2024-09-19T09:41:44.101 INFO:tasks.workunit.client.0.smithi042.stdout:7/700: write d0/d3d/d55/fd1 [22147,60731] 0 2024-09-19T09:41:44.101 INFO:tasks.workunit.client.0.smithi042.stdout:7/701: fdatasync d0/d14/d3a/ddc/f8c 0 2024-09-19T09:41:44.101 INFO:tasks.workunit.client.0.smithi042.stdout:7/702: write d0/d3d/d92/da1/f7f [3154074,7238] 0 2024-09-19T09:41:44.101 INFO:tasks.workunit.client.0.smithi042.stdout:0/753: rmdir d2/d10/d12/d16/d57/d99/dd0/de5 0 2024-09-19T09:41:44.103 INFO:tasks.workunit.client.0.smithi042.stdout:0/754: mknod d2/d10/d12/d24/dbd/ced 0 2024-09-19T09:41:44.105 INFO:tasks.workunit.client.0.smithi042.stdout:5/780: write d2/d4/d64/d6a/f85 [2276216,17647] 0 2024-09-19T09:41:44.108 INFO:tasks.workunit.client.0.smithi042.stdout:4/815: dread d0/f19 [0,4194304] 0 2024-09-19T09:41:44.110 INFO:tasks.workunit.client.0.smithi042.stdout:0/755: dread d2/d10/d12/d16/d57/d99/dd0/fb4 [0,4194304] 0 2024-09-19T09:41:44.110 INFO:tasks.workunit.client.0.smithi042.stdout:0/756: write d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/fe7 [313451,35031] 0 2024-09-19T09:41:44.112 INFO:tasks.workunit.client.0.smithi042.stdout:0/757: creat d2/d10/d12/d24/fee x:0 0 0 2024-09-19T09:41:44.112 INFO:tasks.workunit.client.0.smithi042.stdout:6/822: dwrite d1/de/ffb [0,4194304] 0 2024-09-19T09:41:44.112 INFO:tasks.workunit.client.0.smithi042.stdout:6/823: read - d1/de/d12/fea zero size 2024-09-19T09:41:44.115 INFO:tasks.workunit.client.0.smithi042.stdout:1/881: dwrite d4/d15/d61/d85/dc9/f107 [0,4194304] 0 2024-09-19T09:41:44.117 INFO:tasks.workunit.client.0.smithi042.stdout:1/882: creat d4/d12/db9/f11c x:0 0 0 2024-09-19T09:41:44.118 INFO:tasks.workunit.client.0.smithi042.stdout:3/880: dwrite d4/d8/d9/dc/dbf/d35/fb7 [0,4194304] 0 2024-09-19T09:41:44.119 INFO:tasks.workunit.client.0.smithi042.stdout:3/881: getdents d4/d78 0 2024-09-19T09:41:44.119 INFO:tasks.workunit.client.0.smithi042.stdout:3/882: write d4/d8/d9/dc/dbf/d107/f11e [228204,70754] 0 2024-09-19T09:41:44.120 INFO:tasks.workunit.client.0.smithi042.stdout:7/703: dwrite d0/d14/f83 [0,4194304] 0 2024-09-19T09:41:44.121 INFO:tasks.workunit.client.0.smithi042.stdout:0/758: read d2/d10/fbb [586565,98052] 0 2024-09-19T09:41:44.122 INFO:tasks.workunit.client.0.smithi042.stdout:3/883: creat d4/d8/d4c/d6b/db9/dcb/f120 x:0 0 0 2024-09-19T09:41:44.124 INFO:tasks.workunit.client.0.smithi042.stdout:7/704: rename d0/d56/da9/fb3 to d0/d3d/d92/da1/fe3 0 2024-09-19T09:41:44.125 INFO:tasks.workunit.client.0.smithi042.stdout:0/759: mknod d2/d10/d12/d16/d57/cef 0 2024-09-19T09:41:44.126 INFO:tasks.workunit.client.0.smithi042.stdout:3/884: creat d4/f121 x:0 0 0 2024-09-19T09:41:44.126 INFO:tasks.workunit.client.0.smithi042.stdout:3/885: readlink d4/d8/d9/d115/ld6 0 2024-09-19T09:41:44.126 INFO:tasks.workunit.client.0.smithi042.stdout:3/886: stat f0 0 2024-09-19T09:41:44.127 INFO:tasks.workunit.client.0.smithi042.stdout:7/705: mknod d0/d40/d9d/dd7/ce4 0 2024-09-19T09:41:44.129 INFO:tasks.workunit.client.0.smithi042.stdout:7/706: rename d0/d56/da9/fc3 to d0/d40/d9d/fe5 0 2024-09-19T09:41:44.129 INFO:tasks.workunit.client.0.smithi042.stdout:7/707: chown d0/d14/d3a/ddc/d9b 257654 1 2024-09-19T09:41:44.130 INFO:tasks.workunit.client.0.smithi042.stdout:1/883: rmdir d4/d1e 39 2024-09-19T09:41:44.133 INFO:tasks.workunit.client.0.smithi042.stdout:0/760: dread d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/f69 [0,4194304] 0 2024-09-19T09:41:44.134 INFO:tasks.workunit.client.0.smithi042.stdout:7/708: dread d0/d3d/d85/fce [0,4194304] 0 2024-09-19T09:41:44.139 INFO:tasks.workunit.client.0.smithi042.stdout:3/887: write d4/d8/d9/dc/dbf/d35/fb7 [1788146,22272] 0 2024-09-19T09:41:44.141 INFO:tasks.workunit.client.0.smithi042.stdout:3/888: rename d4/d8/d9/d1b/d4f/d9c to d4/d8/d9/dc/dbf/d6d/d122 0 2024-09-19T09:41:44.141 INFO:tasks.workunit.client.0.smithi042.stdout:4/816: dwrite d0/d1b/d1c/d2e/d3f/ff1 [0,4194304] 0 2024-09-19T09:41:44.141 INFO:tasks.workunit.client.0.smithi042.stdout:6/824: dwrite d1/de/d5d/f61 [0,4194304] 0 2024-09-19T09:41:44.144 INFO:tasks.workunit.client.0.smithi042.stdout:6/825: write d1/de/d76/d99/db2/d34/d6f/d93/db5/f6e [558780,72345] 0 2024-09-19T09:41:44.144 INFO:tasks.workunit.client.0.smithi042.stdout:6/826: read - d1/de/d76/d99/db2/d34/d6f/d4a/fc3 zero size 2024-09-19T09:41:44.146 INFO:tasks.workunit.client.0.smithi042.stdout:4/817: rename d0/d1b/f2b to d0/d28/d36/d91/f113 0 2024-09-19T09:41:44.146 INFO:tasks.workunit.client.0.smithi042.stdout:4/818: dread - d0/d1b/d1c/d2e/d3b/d95/db1/f10c zero size 2024-09-19T09:41:44.147 INFO:tasks.workunit.client.0.smithi042.stdout:4/819: mknod d0/d1b/d69/dc0/c114 0 2024-09-19T09:41:44.148 INFO:tasks.workunit.client.0.smithi042.stdout:7/709: dread d0/d14/d3a/f80 [0,4194304] 0 2024-09-19T09:41:44.149 INFO:tasks.workunit.client.0.smithi042.stdout:3/889: rename d4/d8/d4c/f81 to d4/d8/d9/d39/d4b/d7d/f123 0 2024-09-19T09:41:44.150 INFO:tasks.workunit.client.0.smithi042.stdout:3/890: stat d4/d8/d9/dc/dbf/d6d 0 2024-09-19T09:41:44.150 INFO:tasks.workunit.client.0.smithi042.stdout:3/891: write d4/d8/d9/d1b/d4f/faf [4944291,86840] 0 2024-09-19T09:41:44.151 INFO:tasks.workunit.client.0.smithi042.stdout:4/820: creat d0/d1b/d56/de1/f115 x:0 0 0 2024-09-19T09:41:44.151 INFO:tasks.workunit.client.0.smithi042.stdout:4/821: chown d0/d28/d36/c9c 6311877 1 2024-09-19T09:41:44.152 INFO:tasks.workunit.client.0.smithi042.stdout:7/710: truncate d0/d3d/d85/f8b 2918767 0 2024-09-19T09:41:44.154 INFO:tasks.workunit.client.0.smithi042.stdout:4/822: chown d0/d1b/f40 2374 1 2024-09-19T09:41:44.155 INFO:tasks.workunit.client.0.smithi042.stdout:7/711: symlink d0/d40/d9d/le6 0 2024-09-19T09:41:44.160 INFO:tasks.workunit.client.0.smithi042.stdout:7/712: link d0/d14/f83 d0/d14/d3a/ddc/db6/dbb/fe7 0 2024-09-19T09:41:44.162 INFO:tasks.workunit.client.0.smithi042.stdout:7/713: link d0/fa d0/d40/d9d/dd0/ddb/fe8 0 2024-09-19T09:41:44.163 INFO:tasks.workunit.client.0.smithi042.stdout:2/851: sync 2024-09-19T09:41:44.163 INFO:tasks.workunit.client.0.smithi042.stdout:2/852: write d7/dd/d22/d30/f4d [1090615,121119] 0 2024-09-19T09:41:44.163 INFO:tasks.workunit.client.0.smithi042.stdout:2/853: chown d7/dd/f59 2745211 1 2024-09-19T09:41:44.164 INFO:tasks.workunit.client.0.smithi042.stdout:1/884: dwrite d4/d15/d61/d85/dc9/f107 [0,4194304] 0 2024-09-19T09:41:44.165 INFO:tasks.workunit.client.0.smithi042.stdout:4/823: write d0/d28/fae [4404252,106133] 0 2024-09-19T09:41:44.165 INFO:tasks.workunit.client.0.smithi042.stdout:4/824: write d0/d1b/d1c/d61/d7f/fe2 [70858,70143] 0 2024-09-19T09:41:44.166 INFO:tasks.workunit.client.0.smithi042.stdout:6/827: dwrite d1/de/d5d/f61 [0,4194304] 0 2024-09-19T09:41:44.167 INFO:tasks.workunit.client.0.smithi042.stdout:6/828: write d1/de/d76/d99/db2/d34/d6f/d4a/fc3 [552460,25823] 0 2024-09-19T09:41:44.167 INFO:tasks.workunit.client.0.smithi042.stdout:7/714: mknod d0/d14/ce9 0 2024-09-19T09:41:44.167 INFO:tasks.workunit.client.0.smithi042.stdout:7/715: read - d0/d3d/d85/d99/fb7 zero size 2024-09-19T09:41:44.168 INFO:tasks.workunit.client.0.smithi042.stdout:2/854: unlink d7/dd/cf2 0 2024-09-19T09:41:44.169 INFO:tasks.workunit.client.0.smithi042.stdout:6/829: dread d1/d20/d6a/d46/d92/d3a/f4d [0,4194304] 0 2024-09-19T09:41:44.169 INFO:tasks.workunit.client.0.smithi042.stdout:4/825: read d0/d1b/d1c/d2e/d3b/f47 [2644342,26205] 0 2024-09-19T09:41:44.169 INFO:tasks.workunit.client.0.smithi042.stdout:1/885: creat d4/d15/d2e/db7/d3c/dd5/f11d x:0 0 0 2024-09-19T09:41:44.176 INFO:tasks.workunit.client.0.smithi042.stdout:7/716: mknod d0/d40/d9d/cea 0 2024-09-19T09:41:44.176 INFO:tasks.workunit.client.0.smithi042.stdout:7/717: write d0/fa [548273,48148] 0 2024-09-19T09:41:44.177 INFO:tasks.workunit.client.0.smithi042.stdout:3/892: dwrite d4/d8/d9/d1b/d4f/faf [0,4194304] 0 2024-09-19T09:41:44.177 INFO:tasks.workunit.client.0.smithi042.stdout:3/893: chown d4/d8/d9/d1b/f63 3256 1 2024-09-19T09:41:44.177 INFO:tasks.workunit.client.0.smithi042.stdout:3/894: truncate d4/d8/d4c/d6b/db9/dcb/deb/ff7 605379 0 2024-09-19T09:41:44.177 INFO:tasks.workunit.client.0.smithi042.stdout:3/895: readlink d4/l53 0 2024-09-19T09:41:44.177 INFO:tasks.workunit.client.0.smithi042.stdout:3/896: read - d4/d8/d4c/fe3 zero size 2024-09-19T09:41:44.178 INFO:tasks.workunit.client.0.smithi042.stdout:3/897: chown d4/d8/d9/d1b/d4f 36 1 2024-09-19T09:41:44.178 INFO:tasks.workunit.client.0.smithi042.stdout:6/830: mknod d1/de/d76/d99/db2/d34/d3f/cff 0 2024-09-19T09:41:44.179 INFO:tasks.workunit.client.0.smithi042.stdout:7/718: mknod d0/d40/d9d/dd0/ddb/ceb 0 2024-09-19T09:41:44.179 INFO:tasks.workunit.client.0.smithi042.stdout:1/886: mknod d4/d15/d19/d45/d82/d89/c11e 0 2024-09-19T09:41:44.183 INFO:tasks.workunit.client.0.smithi042.stdout:1/887: mkdir d4/d15/d19/d45/d82/d11f 0 2024-09-19T09:41:44.183 INFO:tasks.workunit.client.0.smithi042.stdout:1/888: chown d4/d15/f21 41537 1 2024-09-19T09:41:44.183 INFO:tasks.workunit.client.0.smithi042.stdout:1/889: fdatasync d4/d15/d19/d42/d51/db5/dd0/ffc 0 2024-09-19T09:41:44.185 INFO:tasks.workunit.client.0.smithi042.stdout:1/890: mkdir d4/d15/d19/d120 0 2024-09-19T09:41:44.186 INFO:tasks.workunit.client.0.smithi042.stdout:1/891: getdents d4/d15/d2e 0 2024-09-19T09:41:44.188 INFO:tasks.workunit.client.0.smithi042.stdout:7/719: rmdir d0/d56/da9 0 2024-09-19T09:41:44.188 INFO:tasks.workunit.client.0.smithi042.stdout:1/892: creat d4/d15/d19/d45/f121 x:0 0 0 2024-09-19T09:41:44.188 INFO:tasks.workunit.client.0.smithi042.stdout:1/893: readlink d4/d15/d19/d42/l84 0 2024-09-19T09:41:44.193 INFO:tasks.workunit.client.0.smithi042.stdout:7/720: write d0/d3d/d85/f8b [636439,85951] 0 2024-09-19T09:41:44.193 INFO:tasks.workunit.client.0.smithi042.stdout:1/894: dread d4/d15/f21 [0,4194304] 0 2024-09-19T09:41:44.193 INFO:tasks.workunit.client.0.smithi042.stdout:1/895: fdatasync d4/d15/d2e/db7/d3c/fd3 0 2024-09-19T09:41:44.194 INFO:tasks.workunit.client.0.smithi042.stdout:7/721: rmdir d0/d14/d3a/dc4 0 2024-09-19T09:41:44.199 INFO:tasks.workunit.client.0.smithi042.stdout:2/855: dwrite d7/dd/d48/d96/fba [0,4194304] 0 2024-09-19T09:41:44.199 INFO:tasks.workunit.client.0.smithi042.stdout:3/898: dwrite d4/d8/d9/d115/f94 [0,4194304] 0 2024-09-19T09:41:44.201 INFO:tasks.workunit.client.0.smithi042.stdout:2/856: mknod d7/dd/d14/d35/d45/d5e/d79/d118/c11e 0 2024-09-19T09:41:44.221 INFO:tasks.workunit.client.0.smithi042.stdout:1/896: dwrite d4/d15/d2e/db7/d3c/fa3 [4194304,4194304] 0 2024-09-19T09:41:44.223 INFO:tasks.workunit.client.0.smithi042.stdout:1/897: mkdir d4/d15/d2e/db7/d3c/d122 0 2024-09-19T09:41:44.224 INFO:tasks.workunit.client.0.smithi042.stdout:1/898: link d4/d15/d2e/db7/d3c/c7a d4/d12/d8d/dca/c123 0 2024-09-19T09:41:44.225 INFO:tasks.workunit.client.0.smithi042.stdout:3/899: dwrite d4/d8/d9/d115/d82/d8c/d104/f9e [0,4194304] 0 2024-09-19T09:41:44.226 INFO:tasks.workunit.client.0.smithi042.stdout:1/899: mkdir d4/d15/d19/dae/d124 0 2024-09-19T09:41:44.226 INFO:tasks.workunit.client.0.smithi042.stdout:1/900: write d4/d15/d2e/db7/f98 [736856,50168] 0 2024-09-19T09:41:44.226 INFO:tasks.workunit.client.0.smithi042.stdout:3/900: rmdir d4/d78 39 2024-09-19T09:41:44.227 INFO:tasks.workunit.client.0.smithi042.stdout:3/901: creat d4/d8/d9/d115/d82/d8c/f124 x:0 0 0 2024-09-19T09:41:44.227 INFO:tasks.workunit.client.0.smithi042.stdout:3/902: chown d4/d8/d9/d115/d82/d8c/d104/c3b 47020 1 2024-09-19T09:41:44.228 INFO:tasks.workunit.client.0.smithi042.stdout:3/903: write d4/d8/d9/d39/df8/f10d [784195,27375] 0 2024-09-19T09:41:44.228 INFO:tasks.workunit.client.0.smithi042.stdout:7/722: dwrite d0/d56/d5c/f63 [0,4194304] 0 2024-09-19T09:41:44.230 INFO:tasks.workunit.client.0.smithi042.stdout:3/904: rmdir d4/d8/d9/dc/dbf/db5 0 2024-09-19T09:41:44.230 INFO:tasks.workunit.client.0.smithi042.stdout:3/905: readlink d4/d8/d9/d115/d82/d8c/d104/l43 0 2024-09-19T09:41:44.231 INFO:tasks.workunit.client.0.smithi042.stdout:7/723: chown d0/d14/l29 11 1 2024-09-19T09:41:44.232 INFO:tasks.workunit.client.0.smithi042.stdout:2/857: dwrite d7/dd/d14/d35/d4c/d70/f7a [0,4194304] 0 2024-09-19T09:41:44.233 INFO:tasks.workunit.client.0.smithi042.stdout:7/724: mkdir d0/d14/d3a/dec 0 2024-09-19T09:41:44.233 INFO:tasks.workunit.client.0.smithi042.stdout:7/725: write d0/d3d/fd6 [546226,49359] 0 2024-09-19T09:41:44.234 INFO:tasks.workunit.client.0.smithi042.stdout:2/858: mkdir d7/dd/d14/d35/d45/d5e/d11f 0 2024-09-19T09:41:44.236 INFO:tasks.workunit.client.0.smithi042.stdout:2/859: mknod d7/dd/d14/dec/c120 0 2024-09-19T09:41:44.236 INFO:tasks.workunit.client.0.smithi042.stdout:2/860: write d7/dd/d14/d11b/dc7/d88/ff8 [562786,67157] 0 2024-09-19T09:41:44.239 INFO:tasks.workunit.client.0.smithi042.stdout:2/861: rename d7/dd/d14/d11b/cc4 to d7/dd/d22/c121 0 2024-09-19T09:41:44.241 INFO:tasks.workunit.client.0.smithi042.stdout:2/862: mkdir d7/dd/d1f/d122 0 2024-09-19T09:41:44.241 INFO:tasks.workunit.client.0.smithi042.stdout:1/901: dread d4/d15/d61/fa7 [0,4194304] 0 2024-09-19T09:41:44.241 INFO:tasks.workunit.client.0.smithi042.stdout:1/902: truncate d4/d1e/f1f 4131506 0 2024-09-19T09:41:44.242 INFO:tasks.workunit.client.0.smithi042.stdout:2/863: unlink d7/dd/d22/d30/d66/led 0 2024-09-19T09:41:44.244 INFO:tasks.workunit.client.0.smithi042.stdout:1/903: creat d4/d12/d8d/de3/f125 x:0 0 0 2024-09-19T09:41:44.244 INFO:tasks.workunit.client.0.smithi042.stdout:1/904: chown d4/d15/d19/d45/f119 7 1 2024-09-19T09:41:44.245 INFO:tasks.workunit.client.0.smithi042.stdout:2/864: creat d7/dd/d1f/d122/f123 x:0 0 0 2024-09-19T09:41:44.247 INFO:tasks.workunit.client.0.smithi042.stdout:1/905: truncate d4/f14 3033064 0 2024-09-19T09:41:44.248 INFO:tasks.workunit.client.0.smithi042.stdout:2/865: mkdir d7/dd/d14/d35/d4c/d70/d124 0 2024-09-19T09:41:44.250 INFO:tasks.workunit.client.0.smithi042.stdout:2/866: mknod d7/dd/d1f/c125 0 2024-09-19T09:41:44.250 INFO:tasks.workunit.client.0.smithi042.stdout:3/906: dwrite d4/d78/d9d/fe8 [0,4194304] 0 2024-09-19T09:41:44.251 INFO:tasks.workunit.client.0.smithi042.stdout:7/726: dwrite d0/d14/f83 [0,4194304] 0 2024-09-19T09:41:44.251 INFO:tasks.workunit.client.0.smithi042.stdout:2/867: truncate d7/dd/d14/d35/d4e/d9c/fae 3354793 0 2024-09-19T09:41:44.253 INFO:tasks.workunit.client.0.smithi042.stdout:3/907: mkdir d4/d8/d9/d115/d82/d8c/d104/d125 0 2024-09-19T09:41:44.257 INFO:tasks.workunit.client.0.smithi042.stdout:7/727: getdents d0 0 2024-09-19T09:41:44.257 INFO:tasks.workunit.client.0.smithi042.stdout:7/728: chown d0/d40/f6c 9663 1 2024-09-19T09:41:44.259 INFO:tasks.workunit.client.0.smithi042.stdout:3/908: symlink d4/d8/d4c/d6b/db9/dcb/l126 0 2024-09-19T09:41:44.260 INFO:tasks.workunit.client.0.smithi042.stdout:9/664: sync 2024-09-19T09:41:44.261 INFO:tasks.workunit.client.0.smithi042.stdout:7/729: rename d0/c52 to d0/dde/ced 0 2024-09-19T09:41:44.262 INFO:tasks.workunit.client.0.smithi042.stdout:2/868: symlink d7/dd/d1f/d3f/dfa/d102/l126 0 2024-09-19T09:41:44.264 INFO:tasks.workunit.client.0.smithi042.stdout:9/665: creat d8/da/d19/d1c/db4/fc2 x:0 0 0 2024-09-19T09:41:44.269 INFO:tasks.workunit.client.0.smithi042.stdout:1/906: dwrite d4/d15/d2e/db7/d3c/fd3 [0,4194304] 0 2024-09-19T09:41:44.270 INFO:tasks.workunit.client.0.smithi042.stdout:7/730: symlink d0/d14/d9f/lee 0 2024-09-19T09:41:44.273 INFO:tasks.workunit.client.0.smithi042.stdout:7/731: link d0/d14/d3a/f3e d0/d14/d3a/ddc/d9b/fef 0 2024-09-19T09:41:44.281 INFO:tasks.workunit.client.0.smithi042.stdout:2/869: write d7/dd/d1f/d3f/f5c [186837,45790] 0 2024-09-19T09:41:44.281 INFO:tasks.workunit.client.0.smithi042.stdout:2/870: read - d7/dd/d22/d30/d66/fe8 zero size 2024-09-19T09:41:44.283 INFO:tasks.workunit.client.0.smithi042.stdout:2/871: creat d7/dd/d14/d35/d45/d5e/d79/f127 x:0 0 0 2024-09-19T09:41:44.285 INFO:tasks.workunit.client.0.smithi042.stdout:7/732: dread d0/d40/f65 [0,4194304] 0 2024-09-19T09:41:44.286 INFO:tasks.workunit.client.0.smithi042.stdout:1/907: rename d4/d15/d19/d42/d51/db5 to d4/d15/d19/d45/d82/d89/d126 0 2024-09-19T09:41:44.287 INFO:tasks.workunit.client.0.smithi042.stdout:7/733: creat d0/d14/d44/d47/ff0 x:0 0 0 2024-09-19T09:41:44.289 INFO:tasks.workunit.client.0.smithi042.stdout:1/908: mkdir d4/d12/d8d/d91/d106/d127 0 2024-09-19T09:41:44.289 INFO:tasks.workunit.client.0.smithi042.stdout:1/909: dread - d4/d15/d2e/db7/d3c/dd5/ded/f111 zero size 2024-09-19T09:41:44.289 INFO:tasks.workunit.client.0.smithi042.stdout:1/910: fsync d4/d15/d2e/db7/d3c/fd3 0 2024-09-19T09:41:44.289 INFO:tasks.workunit.client.0.smithi042.stdout:1/911: chown d4/d15/d19/d45/d82/d89/d126/dd0/ffd 7 1 2024-09-19T09:41:44.291 INFO:tasks.workunit.client.0.smithi042.stdout:9/666: dwrite d8/da/f10 [0,4194304] 0 2024-09-19T09:41:44.293 INFO:tasks.workunit.client.0.smithi042.stdout:8/866: sync 2024-09-19T09:41:44.293 INFO:tasks.workunit.client.0.smithi042.stdout:5/781: sync 2024-09-19T09:41:44.293 INFO:tasks.workunit.client.0.smithi042.stdout:0/761: sync 2024-09-19T09:41:44.293 INFO:tasks.workunit.client.0.smithi042.stdout:8/867: write d1/da8/d41/d55/d99/da4/f73 [2646706,6388] 0 2024-09-19T09:41:44.293 INFO:tasks.workunit.client.0.smithi042.stdout:5/782: mkdir d2/d4/d64/da7/dda/d10e 0 2024-09-19T09:41:44.294 INFO:tasks.workunit.client.0.smithi042.stdout:0/762: creat d2/d10/d12/d16/ff0 x:0 0 0 2024-09-19T09:41:44.297 INFO:tasks.workunit.client.0.smithi042.stdout:5/783: rename d2/d4/d20/d60/db0/f10c to d2/d4/d20/da4/f10f 0 2024-09-19T09:41:44.297 INFO:tasks.workunit.client.0.smithi042.stdout:5/784: readlink d2/d4/d64/l8f 0 2024-09-19T09:41:44.297 INFO:tasks.workunit.client.0.smithi042.stdout:5/785: dread - d2/d4/d64/da7/db4/dd8/fe5 zero size 2024-09-19T09:41:44.298 INFO:tasks.workunit.client.0.smithi042.stdout:0/763: symlink d2/d10/d12/d16/d57/d99/dd0/da5/d52/lf1 0 2024-09-19T09:41:44.298 INFO:tasks.workunit.client.0.smithi042.stdout:0/764: chown d2/d10/d12/d16/d57/d99/dd0/da5/d52/f55 1752460471 1 2024-09-19T09:41:44.298 INFO:tasks.workunit.client.0.smithi042.stdout:0/765: write d2/d10/d12/d16/d57/d99/dd0/da5/d52/f55 [5119788,113208] 0 2024-09-19T09:41:44.298 INFO:tasks.workunit.client.0.smithi042.stdout:0/766: chown d2/d10/d12/d16/c92 6575792 1 2024-09-19T09:41:44.299 INFO:tasks.workunit.client.0.smithi042.stdout:5/786: truncate d2/d4/d64/d6a/fdf 4901940 0 2024-09-19T09:41:44.299 INFO:tasks.workunit.client.0.smithi042.stdout:0/767: mkdir d2/d10/da1/df2 0 2024-09-19T09:41:44.301 INFO:tasks.workunit.client.0.smithi042.stdout:5/787: write d2/d4/d64/da7/dda/de6/fca [356995,124758] 0 2024-09-19T09:41:44.301 INFO:tasks.workunit.client.0.smithi042.stdout:0/768: creat d2/d8e/d32/ff3 x:0 0 0 2024-09-19T09:41:44.301 INFO:tasks.workunit.client.0.smithi042.stdout:0/769: write d2/d10/d12/d16/d57/d99/dd0/da5/f22 [1208791,33085] 0 2024-09-19T09:41:44.303 INFO:tasks.workunit.client.0.smithi042.stdout:5/788: dread d2/d4/d64/da7/dda/de6/fd4 [0,4194304] 0 2024-09-19T09:41:44.305 INFO:tasks.workunit.client.0.smithi042.stdout:7/734: dread d0/d14/d3a/ddc/db6/dbb/fe7 [0,4194304] 0 2024-09-19T09:41:44.305 INFO:tasks.workunit.client.0.smithi042.stdout:0/770: unlink d2/d10/ld8 0 2024-09-19T09:41:44.310 INFO:tasks.workunit.client.0.smithi042.stdout:1/912: dread d4/d15/d61/fa7 [0,4194304] 0 2024-09-19T09:41:44.314 INFO:tasks.workunit.client.0.smithi042.stdout:0/771: dread d2/d10/d12/d16/d57/d99/dd0/da5/f47 [0,4194304] 0 2024-09-19T09:41:44.314 INFO:tasks.workunit.client.0.smithi042.stdout:2/872: dwrite d7/dd/d14/d35/d4e/f97 [0,4194304] 0 2024-09-19T09:41:44.315 INFO:tasks.workunit.client.0.smithi042.stdout:0/772: rmdir d2/d10/d12/d16/d57/d99/dd0/da5/d8a 39 2024-09-19T09:41:44.316 INFO:tasks.workunit.client.0.smithi042.stdout:9/667: dwrite d8/d1d/d28/fa4 [0,4194304] 0 2024-09-19T09:41:44.319 INFO:tasks.workunit.client.0.smithi042.stdout:9/668: symlink d8/da/d89/da7/db6/db5/d87/dad/lc3 0 2024-09-19T09:41:44.319 INFO:tasks.workunit.client.0.smithi042.stdout:9/669: write d8/d32/f69 [1818868,104285] 0 2024-09-19T09:41:44.320 INFO:tasks.workunit.client.0.smithi042.stdout:9/670: mknod d8/da/d89/da7/db6/db5/d87/cc4 0 2024-09-19T09:41:44.320 INFO:tasks.workunit.client.0.smithi042.stdout:9/671: rename d8/da/d89 to d8/da/d89/d8e/dae/dc5 22 2024-09-19T09:41:44.320 INFO:tasks.workunit.client.0.smithi042.stdout:9/672: dread - d8/da/d19/d1c/fb7 zero size 2024-09-19T09:41:44.321 INFO:tasks.workunit.client.0.smithi042.stdout:9/673: creat d8/da/d89/d8e/fc6 x:0 0 0 2024-09-19T09:41:44.324 INFO:tasks.workunit.client.0.smithi042.stdout:0/773: dread d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/fe3 [0,4194304] 0 2024-09-19T09:41:44.324 INFO:tasks.workunit.client.0.smithi042.stdout:0/774: stat d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/lb1 0 2024-09-19T09:41:44.326 INFO:tasks.workunit.client.0.smithi042.stdout:5/789: dread d2/d25/d37/dc2/fed [0,4194304] 0 2024-09-19T09:41:44.326 INFO:tasks.workunit.client.0.smithi042.stdout:5/790: read d2/d4/d20/d60/db0/fd0 [43833,60061] 0 2024-09-19T09:41:44.327 INFO:tasks.workunit.client.0.smithi042.stdout:8/868: dwrite d1/da/d3f/fbd [0,4194304] 0 2024-09-19T09:41:44.327 INFO:tasks.workunit.client.0.smithi042.stdout:8/869: write d1/da8/d41/d55/d99/da4/dc2/fef [620398,96872] 0 2024-09-19T09:41:44.329 INFO:tasks.workunit.client.0.smithi042.stdout:8/870: mkdir d1/da8/d3d/d102 0 2024-09-19T09:41:44.329 INFO:tasks.workunit.client.0.smithi042.stdout:5/791: mkdir d2/d4/d64/d110 0 2024-09-19T09:41:44.329 INFO:tasks.workunit.client.0.smithi042.stdout:7/735: dwrite d0/d14/d44/d47/ff0 [0,4194304] 0 2024-09-19T09:41:44.334 INFO:tasks.workunit.client.0.smithi042.stdout:5/792: creat d2/d25/dfb/f111 x:0 0 0 2024-09-19T09:41:44.334 INFO:tasks.workunit.client.0.smithi042.stdout:1/913: dwrite d4/fa2 [4194304,4194304] 0 2024-09-19T09:41:44.334 INFO:tasks.workunit.client.0.smithi042.stdout:0/775: dread d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/db5/fbf [0,4194304] 0 2024-09-19T09:41:44.334 INFO:tasks.workunit.client.0.smithi042.stdout:0/776: read - d2/d8e/d32/ff3 zero size 2024-09-19T09:41:44.341 INFO:tasks.workunit.client.0.smithi042.stdout:5/793: read d2/d4/d64/da7/f23 [645798,24006] 0 2024-09-19T09:41:44.343 INFO:tasks.workunit.client.0.smithi042.stdout:1/914: symlink d4/d12/d8d/d91/l128 0 2024-09-19T09:41:44.343 INFO:tasks.workunit.client.0.smithi042.stdout:1/915: truncate d4/d12/db9/fdd 859055 0 2024-09-19T09:41:44.345 INFO:tasks.workunit.client.0.smithi042.stdout:0/777: mknod d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da0/cf4 0 2024-09-19T09:41:44.345 INFO:tasks.workunit.client.0.smithi042.stdout:0/778: write d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/fa2 [152725,28086] 0 2024-09-19T09:41:44.345 INFO:tasks.workunit.client.0.smithi042.stdout:0/779: chown d2/d10/d12/d16/d57 6 1 2024-09-19T09:41:44.345 INFO:tasks.workunit.client.0.smithi042.stdout:5/794: creat d2/d25/dfb/f112 x:0 0 0 2024-09-19T09:41:44.345 INFO:tasks.workunit.client.0.smithi042.stdout:5/795: fsync d2/d4/d64/dab/fc5 0 2024-09-19T09:41:44.346 INFO:tasks.workunit.client.0.smithi042.stdout:0/780: getdents d2/d10/d12/d24/d82 0 2024-09-19T09:41:44.346 INFO:tasks.workunit.client.0.smithi042.stdout:1/916: mkdir d4/d15/d19/d129 0 2024-09-19T09:41:44.347 INFO:tasks.workunit.client.0.smithi042.stdout:5/796: unlink d2/d4/d2e/l33 0 2024-09-19T09:41:44.347 INFO:tasks.workunit.client.0.smithi042.stdout:0/781: creat d2/d10/d12/d16/d57/ff5 x:0 0 0 2024-09-19T09:41:44.349 INFO:tasks.workunit.client.0.smithi042.stdout:0/782: rename d2/d10/d12/d16/d57/d78/db3 to d2/d10/df6 0 2024-09-19T09:41:44.349 INFO:tasks.workunit.client.0.smithi042.stdout:7/736: write d0/d3d/d92/f95 [2271917,91062] 0 2024-09-19T09:41:44.350 INFO:tasks.workunit.client.0.smithi042.stdout:6/831: sync 2024-09-19T09:41:44.351 INFO:tasks.workunit.client.0.smithi042.stdout:7/737: rename d0/f27 to d0/d40/ff1 0 2024-09-19T09:41:44.351 INFO:tasks.workunit.client.0.smithi042.stdout:4/826: sync 2024-09-19T09:41:44.352 INFO:tasks.workunit.client.0.smithi042.stdout:6/832: link d1/de/d12/fea d1/de/d12/d9a/f100 0 2024-09-19T09:41:44.354 INFO:tasks.workunit.client.0.smithi042.stdout:9/674: dwrite d8/da/d19/d1c/d21/d7f/d72/fab [0,4194304] 0 2024-09-19T09:41:44.354 INFO:tasks.workunit.client.0.smithi042.stdout:8/871: dwrite d1/da/dd/fbb [0,4194304] 0 2024-09-19T09:41:44.355 INFO:tasks.workunit.client.0.smithi042.stdout:8/872: stat d1/da/dd/d74/f9e 0 2024-09-19T09:41:44.355 INFO:tasks.workunit.client.0.smithi042.stdout:7/738: creat d0/d3d/d85/d99/ff2 x:0 0 0 2024-09-19T09:41:44.356 INFO:tasks.workunit.client.0.smithi042.stdout:6/833: creat d1/de/d54/dda/f101 x:0 0 0 2024-09-19T09:41:44.356 INFO:tasks.workunit.client.0.smithi042.stdout:6/834: dread - d1/d20/fee zero size 2024-09-19T09:41:44.356 INFO:tasks.workunit.client.0.smithi042.stdout:6/835: chown d1/d20/d6a/d90/f3b 4347985 1 2024-09-19T09:41:44.359 INFO:tasks.workunit.client.0.smithi042.stdout:7/739: creat d0/d14/d3a/ddc/d9b/ff3 x:0 0 0 2024-09-19T09:41:44.359 INFO:tasks.workunit.client.0.smithi042.stdout:9/675: write d8/db/d31/f97 [331307,68686] 0 2024-09-19T09:41:44.359 INFO:tasks.workunit.client.0.smithi042.stdout:9/676: truncate d8/da/d19/f7c 897432 0 2024-09-19T09:41:44.359 INFO:tasks.workunit.client.0.smithi042.stdout:9/677: chown d8/da/d19/l29 0 1 2024-09-19T09:41:44.359 INFO:tasks.workunit.client.0.smithi042.stdout:6/836: link d1/de/d76/d99/db2/d34/d6f/d4a/d98/ff1 d1/d20/d6a/d90/f102 0 2024-09-19T09:41:44.360 INFO:tasks.workunit.client.0.smithi042.stdout:6/837: write d1/de/d76/d99/db2/d34/d6f/d93/db5/f6e [395271,102215] 0 2024-09-19T09:41:44.365 INFO:tasks.workunit.client.0.smithi042.stdout:6/838: rename d1/de/da7/dc2/fe7 to d1/de/d54/d81/f103 0 2024-09-19T09:41:44.365 INFO:tasks.workunit.client.0.smithi042.stdout:6/839: truncate d1/de/f2d 5061181 0 2024-09-19T09:41:44.365 INFO:tasks.workunit.client.0.smithi042.stdout:6/840: getdents d1/de/d76/d99/db2/d34/d6f/d93/dfa 0 2024-09-19T09:41:44.367 INFO:tasks.workunit.client.0.smithi042.stdout:6/841: symlink d1/d20/d6a/d90/l104 0 2024-09-19T09:41:44.367 INFO:tasks.workunit.client.0.smithi042.stdout:6/842: dread - d1/de/d54/dda/f86 zero size 2024-09-19T09:41:44.368 INFO:tasks.workunit.client.0.smithi042.stdout:9/678: dread f1 [0,4194304] 0 2024-09-19T09:41:44.369 INFO:tasks.workunit.client.0.smithi042.stdout:6/843: mknod d1/de/d76/d99/db2/d34/d6f/d4a/c105 0 2024-09-19T09:41:44.370 INFO:tasks.workunit.client.0.smithi042.stdout:9/679: mkdir d8/da/d89/da7/db6/dc7 0 2024-09-19T09:41:44.371 INFO:tasks.workunit.client.0.smithi042.stdout:9/680: fdatasync d8/f6f 0 2024-09-19T09:41:44.373 INFO:tasks.workunit.client.0.smithi042.stdout:6/844: rename d1/de/d76/d99/db2/d34/d3f/cff to d1/d20/d6a/c106 0 2024-09-19T09:41:44.373 INFO:tasks.workunit.client.0.smithi042.stdout:5/797: dwrite d2/d4/fa [0,4194304] 0 2024-09-19T09:41:44.373 INFO:tasks.workunit.client.0.smithi042.stdout:5/798: write d2/d4/d20/d60/d72/d75/dc3/f101 [801867,48608] 0 2024-09-19T09:41:44.374 INFO:tasks.workunit.client.0.smithi042.stdout:5/799: fsync d2/d4/d64/dab/f47 0 2024-09-19T09:41:44.374 INFO:tasks.workunit.client.0.smithi042.stdout:9/681: creat d8/da/d89/da7/db6/db5/d87/fc8 x:0 0 0 2024-09-19T09:41:44.374 INFO:tasks.workunit.client.0.smithi042.stdout:9/682: write d8/db/d31/f97 [4413065,86578] 0 2024-09-19T09:41:44.374 INFO:tasks.workunit.client.0.smithi042.stdout:9/683: fdatasync d8/da/d89/da7/fbe 0 2024-09-19T09:41:44.374 INFO:tasks.workunit.client.0.smithi042.stdout:5/800: creat d2/d4/d64/d110/f113 x:0 0 0 2024-09-19T09:41:44.375 INFO:tasks.workunit.client.0.smithi042.stdout:0/783: dwrite f0 [0,4194304] 0 2024-09-19T09:41:44.376 INFO:tasks.workunit.client.0.smithi042.stdout:0/784: dread d2/d10/d1d/f59 [0,4194304] 0 2024-09-19T09:41:44.376 INFO:tasks.workunit.client.0.smithi042.stdout:6/845: rename d1/de/d76/d99/db2/d34/d6f/d93/db5/f6e to d1/de/da7/dc2/f107 0 2024-09-19T09:41:44.377 INFO:tasks.workunit.client.0.smithi042.stdout:0/785: write d2/d8e/d32/f83 [934118,95841] 0 2024-09-19T09:41:44.377 INFO:tasks.workunit.client.0.smithi042.stdout:9/684: rmdir d8/da/d19/d1c/db4 39 2024-09-19T09:41:44.377 INFO:tasks.workunit.client.0.smithi042.stdout:7/740: dwrite d0/d3d/d85/d99/fd9 [0,4194304] 0 2024-09-19T09:41:44.383 INFO:tasks.workunit.client.0.smithi042.stdout:6/846: rename d1/de/d12/fc9 to d1/d20/d6a/d46/d95/f108 0 2024-09-19T09:41:44.383 INFO:tasks.workunit.client.0.smithi042.stdout:0/786: mknod d2/d10/df6/dbc/cf7 0 2024-09-19T09:41:44.383 INFO:tasks.workunit.client.0.smithi042.stdout:6/847: write d1/d20/d6a/fab [762671,51134] 0 2024-09-19T09:41:44.389 INFO:tasks.workunit.client.0.smithi042.stdout:8/873: link d1/da/d14/f17 d1/da8/d3d/f103 0 2024-09-19T09:41:44.391 INFO:tasks.workunit.client.0.smithi042.stdout:9/685: dread d8/da/d19/d1c/d21/d7f/d72/fab [0,4194304] 0 2024-09-19T09:41:44.391 INFO:tasks.workunit.client.0.smithi042.stdout:9/686: fsync d8/d32/f58 0 2024-09-19T09:41:44.392 INFO:tasks.workunit.client.0.smithi042.stdout:7/741: creat d0/d14/d3a/ddc/d9b/ff4 x:0 0 0 2024-09-19T09:41:44.394 INFO:tasks.workunit.client.0.smithi042.stdout:6/848: unlink d1/d20/d6a/d46/d95/lbc 0 2024-09-19T09:41:44.400 INFO:tasks.workunit.client.0.smithi042.stdout:0/787: rmdir d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da6 39 2024-09-19T09:41:44.400 INFO:tasks.workunit.client.0.smithi042.stdout:9/687: unlink d8/da/d89/da7/db6/db5/d87/cc4 0 2024-09-19T09:41:44.400 INFO:tasks.workunit.client.0.smithi042.stdout:3/909: sync 2024-09-19T09:41:44.400 INFO:tasks.workunit.client.0.smithi042.stdout:8/874: dread d1/da/dd/d74/f9e [0,4194304] 0 2024-09-19T09:41:44.400 INFO:tasks.workunit.client.0.smithi042.stdout:3/910: dread - d4/d8/d9/d115/d82/d48/da5/f100 zero size 2024-09-19T09:41:44.400 INFO:tasks.workunit.client.0.smithi042.stdout:3/911: readlink d4/d8/d9/dc/dbf/d6d/d8f/dcd/lf2 0 2024-09-19T09:41:44.400 INFO:tasks.workunit.client.0.smithi042.stdout:9/688: symlink d8/da/d89/lc9 0 2024-09-19T09:41:44.400 INFO:tasks.workunit.client.0.smithi042.stdout:6/849: dread d1/fc [0,4194304] 0 2024-09-19T09:41:44.401 INFO:tasks.workunit.client.0.smithi042.stdout:0/788: symlink d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/d9f/lf8 0 2024-09-19T09:41:44.402 INFO:tasks.workunit.client.0.smithi042.stdout:8/875: creat d1/da/dcd/f104 x:0 0 0 2024-09-19T09:41:44.402 INFO:tasks.workunit.client.0.smithi042.stdout:8/876: stat d1/da8 0 2024-09-19T09:41:44.402 INFO:tasks.workunit.client.0.smithi042.stdout:8/877: stat d1/d2e 0 2024-09-19T09:41:44.402 INFO:tasks.workunit.client.0.smithi042.stdout:5/801: dwrite d2/d4/d20/d60/d72/d75/dc3/f101 [0,4194304] 0 2024-09-19T09:41:44.403 INFO:tasks.workunit.client.0.smithi042.stdout:0/789: creat d2/d10/d12/d24/dc0/ff9 x:0 0 0 2024-09-19T09:41:44.403 INFO:tasks.workunit.client.0.smithi042.stdout:3/912: truncate d4/d8/d9/d1b/d4f/faf 304612 0 2024-09-19T09:41:44.403 INFO:tasks.workunit.client.0.smithi042.stdout:3/913: chown d4/d8/d9/d39/df8/f10d 48684292 1 2024-09-19T09:41:44.403 INFO:tasks.workunit.client.0.smithi042.stdout:3/914: write d4/d8/d9/d1b/d4f/fe7 [2466887,68209] 0 2024-09-19T09:41:44.403 INFO:tasks.workunit.client.0.smithi042.stdout:3/915: dread - d4/d8/dff/f11f zero size 2024-09-19T09:41:44.407 INFO:tasks.workunit.client.0.smithi042.stdout:9/689: rename d8/da/d19/d1c/d21/d7f/d72/fab to d8/d1d/d28/fca 0 2024-09-19T09:41:44.408 INFO:tasks.workunit.client.0.smithi042.stdout:8/878: mknod d1/da8/d41/d55/c105 0 2024-09-19T09:41:44.414 INFO:tasks.workunit.client.0.smithi042.stdout:3/916: truncate d4/d8/d9/d1b/d4f/fe7 1398896 0 2024-09-19T09:41:44.414 INFO:tasks.workunit.client.0.smithi042.stdout:3/917: dread - d4/d8/d9/d115/d82/d8c/fc4 zero size 2024-09-19T09:41:44.417 INFO:tasks.workunit.client.0.smithi042.stdout:3/918: link d4/d8/d9/d115/d82/d8c/d104/c37 d4/d8/d9/dc/dbf/d35/c127 0 2024-09-19T09:41:44.429 INFO:tasks.workunit.client.0.smithi042.stdout:6/850: dwrite d1/de/d12/d9a/f100 [0,4194304] 0 2024-09-19T09:41:44.431 INFO:tasks.workunit.client.0.smithi042.stdout:5/802: dwrite d2/db/f2f [8388608,4194304] 0 2024-09-19T09:41:44.431 INFO:tasks.workunit.client.0.smithi042.stdout:6/851: mkdir d1/de/d76/d99/db2/d34/d6f/d93/db5/d109 0 2024-09-19T09:41:44.432 INFO:tasks.workunit.client.0.smithi042.stdout:6/852: rmdir d1/de/d76/d99/db2/d34/d6f/df2 0 2024-09-19T09:41:44.433 INFO:tasks.workunit.client.0.smithi042.stdout:5/803: dread d2/d4/d64/da7/faa [0,4194304] 0 2024-09-19T09:41:44.433 INFO:tasks.workunit.client.0.smithi042.stdout:6/853: creat d1/de/d76/d99/db2/d34/d6f/f10a x:0 0 0 2024-09-19T09:41:44.433 INFO:tasks.workunit.client.0.smithi042.stdout:5/804: symlink d2/d4/d20/d60/d72/d75/d10d/l114 0 2024-09-19T09:41:44.433 INFO:tasks.workunit.client.0.smithi042.stdout:5/805: readlink d2/l26 0 2024-09-19T09:41:44.435 INFO:tasks.workunit.client.0.smithi042.stdout:6/854: unlink d1/de/d12/d9a/ce5 0 2024-09-19T09:41:44.436 INFO:tasks.workunit.client.0.smithi042.stdout:6/855: rmdir d1/de/da7 39 2024-09-19T09:41:44.437 INFO:tasks.workunit.client.0.smithi042.stdout:6/856: mknod d1/de/d76/c10b 0 2024-09-19T09:41:44.438 INFO:tasks.workunit.client.0.smithi042.stdout:0/790: dwrite d2/d10/d1d/d34/f4a [0,4194304] 0 2024-09-19T09:41:44.438 INFO:tasks.workunit.client.0.smithi042.stdout:8/879: dwrite d1/da/d3f/f98 [0,4194304] 0 2024-09-19T09:41:44.438 INFO:tasks.workunit.client.0.smithi042.stdout:6/857: truncate d1/d20/d6a/d90/f3b 120440 0 2024-09-19T09:41:44.438 INFO:tasks.workunit.client.0.smithi042.stdout:6/858: write d1/de/d12/d9a/fde [1655745,38366] 0 2024-09-19T09:41:44.438 INFO:tasks.workunit.client.0.smithi042.stdout:3/919: dwrite d4/d8/d9/d115/d82/d8c/d9f/ff1 [0,4194304] 0 2024-09-19T09:41:44.438 INFO:tasks.workunit.client.0.smithi042.stdout:3/920: dread - d4/d8/d9/d115/d82/d48/da5/f100 zero size 2024-09-19T09:41:44.439 INFO:tasks.workunit.client.0.smithi042.stdout:0/791: mknod d2/d10/d12/da4/cfa 0 2024-09-19T09:41:44.439 INFO:tasks.workunit.client.0.smithi042.stdout:0/792: readlink d2/d10/d1e/db2/lce 0 2024-09-19T09:41:44.441 INFO:tasks.workunit.client.0.smithi042.stdout:6/859: creat d1/d20/d6a/d46/d95/f10c x:0 0 0 2024-09-19T09:41:44.445 INFO:tasks.workunit.client.0.smithi042.stdout:3/921: getdents d4/d8/d9/d39/d4b 0 2024-09-19T09:41:44.446 INFO:tasks.workunit.client.0.smithi042.stdout:3/922: write d4/d8/d9/d39/df8/f10d [141608,100773] 0 2024-09-19T09:41:44.446 INFO:tasks.workunit.client.0.smithi042.stdout:0/793: mkdir d2/d10/d12/d16/d57/d78/dfb 0 2024-09-19T09:41:44.448 INFO:tasks.workunit.client.0.smithi042.stdout:6/860: mknod d1/c10d 0 2024-09-19T09:41:44.450 INFO:tasks.workunit.client.0.smithi042.stdout:3/923: link d4/d8/d9/d115/d82/d8c/d104/c37 d4/d8/d4c/d6b/db9/dee/c128 0 2024-09-19T09:41:44.450 INFO:tasks.workunit.client.0.smithi042.stdout:3/924: chown d4/d78 83454044 1 2024-09-19T09:41:44.451 INFO:tasks.workunit.client.0.smithi042.stdout:0/794: symlink d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/lfc 0 2024-09-19T09:41:44.452 INFO:tasks.workunit.client.0.smithi042.stdout:3/925: creat d4/d8/d4c/d6b/f129 x:0 0 0 2024-09-19T09:41:44.455 INFO:tasks.workunit.client.0.smithi042.stdout:0/795: unlink d2/d10/d12/d16/d57/d99/dd0/da5/d8a/cd4 0 2024-09-19T09:41:44.455 INFO:tasks.workunit.client.0.smithi042.stdout:5/806: dwrite d2/d4/d20/d60/db0/fd0 [0,4194304] 0 2024-09-19T09:41:44.456 INFO:tasks.workunit.client.0.smithi042.stdout:0/796: mkdir d2/d10/d12/d24/dbd/dfd 0 2024-09-19T09:41:44.456 INFO:tasks.workunit.client.0.smithi042.stdout:0/797: chown d2/d10/d12/d24/dbd/dfd 29827 1 2024-09-19T09:41:44.457 INFO:tasks.workunit.client.0.smithi042.stdout:6/861: write d1/d20/d6a/d90/fe2 [1839524,65706] 0 2024-09-19T09:41:44.459 INFO:tasks.workunit.client.0.smithi042.stdout:0/798: readlink d2/d10/d12/l5f 0 2024-09-19T09:41:44.460 INFO:tasks.workunit.client.0.smithi042.stdout:0/799: unlink d2/d10/d12/d24/dbd/cd5 0 2024-09-19T09:41:44.460 INFO:tasks.workunit.client.0.smithi042.stdout:0/800: write d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/dca/fe4 [650207,77365] 0 2024-09-19T09:41:44.461 INFO:tasks.workunit.client.0.smithi042.stdout:8/880: dwrite d1/da8/db1/dcb/ff8 [0,4194304] 0 2024-09-19T09:41:44.462 INFO:tasks.workunit.client.0.smithi042.stdout:2/873: sync 2024-09-19T09:41:44.469 INFO:tasks.workunit.client.0.smithi042.stdout:8/881: rename d1/db2/l96 to d1/da8/l106 0 2024-09-19T09:41:44.470 INFO:tasks.workunit.client.0.smithi042.stdout:5/807: dread d2/db/d3c/fa0 [0,4194304] 0 2024-09-19T09:41:44.475 INFO:tasks.workunit.client.0.smithi042.stdout:2/874: dread d7/dd/d14/d35/d4c/f76 [0,4194304] 0 2024-09-19T09:41:44.477 INFO:tasks.workunit.client.0.smithi042.stdout:2/875: mknod d7/dd/d14/d35/d4c/d61/deb/c128 0 2024-09-19T09:41:44.477 INFO:tasks.workunit.client.0.smithi042.stdout:4/827: sync 2024-09-19T09:41:44.477 INFO:tasks.workunit.client.0.smithi042.stdout:1/917: sync 2024-09-19T09:41:44.477 INFO:tasks.workunit.client.0.smithi042.stdout:7/742: sync 2024-09-19T09:41:44.477 INFO:tasks.workunit.client.0.smithi042.stdout:0/801: link d2/d10/d12/d16/d57/d99/dd0/l65 d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/lfe 0 2024-09-19T09:41:44.478 INFO:tasks.workunit.client.0.smithi042.stdout:2/876: mkdir d7/dd/d1f/d3f/dfa/d129 0 2024-09-19T09:41:44.479 INFO:tasks.workunit.client.0.smithi042.stdout:4/828: dread d0/d1b/d1c/fb4 [0,4194304] 0 2024-09-19T09:41:44.479 INFO:tasks.workunit.client.0.smithi042.stdout:4/829: chown d0/d1b/d1c/cf0 109 1 2024-09-19T09:41:44.479 INFO:tasks.workunit.client.0.smithi042.stdout:6/862: write d1/d20/d6a/d46/d92/d3a/f42 [3009721,101761] 0 2024-09-19T09:41:44.480 INFO:tasks.workunit.client.0.smithi042.stdout:1/918: creat d4/d15/d19/f12a x:0 0 0 2024-09-19T09:41:44.483 INFO:tasks.workunit.client.0.smithi042.stdout:0/802: creat d2/d8e/fff x:0 0 0 2024-09-19T09:41:44.484 INFO:tasks.workunit.client.0.smithi042.stdout:7/743: symlink d0/d14/d3a/dec/lf5 0 2024-09-19T09:41:44.485 INFO:tasks.workunit.client.0.smithi042.stdout:2/877: readlink d7/l3d 0 2024-09-19T09:41:44.486 INFO:tasks.workunit.client.0.smithi042.stdout:6/863: rmdir d1/de/d76/d99/db2/d34/d6f/d4a 39 2024-09-19T09:41:44.487 INFO:tasks.workunit.client.0.smithi042.stdout:0/803: creat d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/d9f/f100 x:0 0 0 2024-09-19T09:41:44.487 INFO:tasks.workunit.client.0.smithi042.stdout:4/830: write d0/f71 [1593542,78537] 0 2024-09-19T09:41:44.487 INFO:tasks.workunit.client.0.smithi042.stdout:4/831: write d0/d1b/d1c/d2e/d3f/fd9 [849969,102545] 0 2024-09-19T09:41:44.491 INFO:tasks.workunit.client.0.smithi042.stdout:4/832: unlink d0/d1b/d1c/d2e/d3f/d5a/fb0 0 2024-09-19T09:41:44.493 INFO:tasks.workunit.client.0.smithi042.stdout:5/808: dwrite d2/d4/d64/dab/f1a [0,4194304] 0 2024-09-19T09:41:44.496 INFO:tasks.workunit.client.0.smithi042.stdout:4/833: dread d0/d1b/d1c/d2e/d3b/f53 [0,4194304] 0 2024-09-19T09:41:44.496 INFO:tasks.workunit.client.0.smithi042.stdout:5/809: rmdir d2/d25/d37/dc2 39 2024-09-19T09:41:44.499 INFO:tasks.workunit.client.0.smithi042.stdout:5/810: symlink d2/d4/d20/d60/db0/l115 0 2024-09-19T09:41:44.499 INFO:tasks.workunit.client.0.smithi042.stdout:5/811: dread - d2/d4/d64/d6a/f73 zero size 2024-09-19T09:41:44.500 INFO:tasks.workunit.client.0.smithi042.stdout:5/812: truncate d2/d4/d20/f45 2718672 0 2024-09-19T09:41:44.500 INFO:tasks.workunit.client.0.smithi042.stdout:2/878: write d7/dd/d14/d35/d45/d5e/d79/fb6 [3890365,123354] 0 2024-09-19T09:41:44.501 INFO:tasks.workunit.client.0.smithi042.stdout:2/879: creat d7/dd/d22/d30/d66/f12a x:0 0 0 2024-09-19T09:41:44.504 INFO:tasks.workunit.client.0.smithi042.stdout:1/919: dwrite d4/d12/f2d [0,4194304] 0 2024-09-19T09:41:44.505 INFO:tasks.workunit.client.0.smithi042.stdout:5/813: dread d2/db/fe [0,4194304] 0 2024-09-19T09:41:44.505 INFO:tasks.workunit.client.0.smithi042.stdout:1/920: chown d4/d12/d8d/d91/feb 8 1 2024-09-19T09:41:44.505 INFO:tasks.workunit.client.0.smithi042.stdout:1/921: write d4/f47 [4910830,94879] 0 2024-09-19T09:41:44.506 INFO:tasks.workunit.client.0.smithi042.stdout:8/882: dwrite d1/da8/d3d/d58/faa [0,4194304] 0 2024-09-19T09:41:44.507 INFO:tasks.workunit.client.0.smithi042.stdout:5/814: symlink d2/d4/de8/l116 0 2024-09-19T09:41:44.507 INFO:tasks.workunit.client.0.smithi042.stdout:5/815: truncate d2/d25/f80 63039 0 2024-09-19T09:41:44.508 INFO:tasks.workunit.client.0.smithi042.stdout:1/922: truncate d4/d15/d19/d42/d51/ff0 2543551 0 2024-09-19T09:41:44.509 INFO:tasks.workunit.client.0.smithi042.stdout:6/864: dwrite d1/d20/d6a/d46/d92/d3a/f4d [0,4194304] 0 2024-09-19T09:41:44.509 INFO:tasks.workunit.client.0.smithi042.stdout:5/816: truncate d2/f1e 2814099 0 2024-09-19T09:41:44.511 INFO:tasks.workunit.client.0.smithi042.stdout:5/817: symlink d2/d4/d64/da7/dda/l117 0 2024-09-19T09:41:44.512 INFO:tasks.workunit.client.0.smithi042.stdout:6/865: mkdir d1/d20/d6a/d46/df9/d10e 0 2024-09-19T09:41:44.514 INFO:tasks.workunit.client.0.smithi042.stdout:0/804: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/fd6 [0,4194304] 0 2024-09-19T09:41:44.518 INFO:tasks.workunit.client.0.smithi042.stdout:0/805: rename d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/d9f/fc5 to d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/f101 0 2024-09-19T09:41:44.518 INFO:tasks.workunit.client.0.smithi042.stdout:0/806: dread - d2/d10/d12/d24/d5b/fcb zero size 2024-09-19T09:41:44.518 INFO:tasks.workunit.client.0.smithi042.stdout:0/807: truncate d2/d10/d12/fcf 493395 0 2024-09-19T09:41:44.519 INFO:tasks.workunit.client.0.smithi042.stdout:5/818: dread d2/d4/d20/f62 [0,4194304] 0 2024-09-19T09:41:44.522 INFO:tasks.workunit.client.0.smithi042.stdout:1/923: write d4/d15/d19/d45/d82/d89/d126/dda/fb2 [692937,44963] 0 2024-09-19T09:41:44.523 INFO:tasks.workunit.client.0.smithi042.stdout:0/808: creat d2/d10/d1d/f102 x:0 0 0 2024-09-19T09:41:44.523 INFO:tasks.workunit.client.0.smithi042.stdout:5/819: truncate d2/d4/d20/d60/d72/f9c 355488 0 2024-09-19T09:41:44.523 INFO:tasks.workunit.client.0.smithi042.stdout:0/809: truncate d2/d10/d12/fe2 196042 0 2024-09-19T09:41:44.526 INFO:tasks.workunit.client.0.smithi042.stdout:0/810: chown d2/d10/d6b/cb9 169 1 2024-09-19T09:41:44.526 INFO:tasks.workunit.client.0.smithi042.stdout:0/811: getdents d2/d8e/d32 0 2024-09-19T09:41:44.527 INFO:tasks.workunit.client.0.smithi042.stdout:0/812: write d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/d9f/f100 [506394,119238] 0 2024-09-19T09:41:44.527 INFO:tasks.workunit.client.0.smithi042.stdout:0/813: truncate d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/fa2 884839 0 2024-09-19T09:41:44.528 INFO:tasks.workunit.client.0.smithi042.stdout:0/814: mknod d2/d10/d12/da4/c103 0 2024-09-19T09:41:44.530 INFO:tasks.workunit.client.0.smithi042.stdout:0/815: creat d2/d10/d12/d24/dc0/f104 x:0 0 0 2024-09-19T09:41:44.530 INFO:tasks.workunit.client.0.smithi042.stdout:4/834: dwrite d0/d1b/d1c/db8/fbf [0,4194304] 0 2024-09-19T09:41:44.530 INFO:tasks.workunit.client.0.smithi042.stdout:4/835: readlink d0/d1b/d1c/d2e/d3f/l88 0 2024-09-19T09:41:44.530 INFO:tasks.workunit.client.0.smithi042.stdout:8/883: dread d1/da8/d3d/d58/fab [0,4194304] 0 2024-09-19T09:41:44.530 INFO:tasks.workunit.client.0.smithi042.stdout:2/880: dwrite d7/dd/d1f/d3f/f78 [0,4194304] 0 2024-09-19T09:41:44.531 INFO:tasks.workunit.client.0.smithi042.stdout:0/816: symlink d2/d10/d1e/db2/l105 0 2024-09-19T09:41:44.531 INFO:tasks.workunit.client.0.smithi042.stdout:0/817: stat d2/d10/d12/d16/d57 0 2024-09-19T09:41:44.533 INFO:tasks.workunit.client.0.smithi042.stdout:2/881: creat d7/dd/d14/d35/d4e/d63/dd6/f12b x:0 0 0 2024-09-19T09:41:44.533 INFO:tasks.workunit.client.0.smithi042.stdout:2/882: chown d7/dd/d14/d11b/dc7/d88/f95 3870004 1 2024-09-19T09:41:44.533 INFO:tasks.workunit.client.0.smithi042.stdout:2/883: chown d7/dd/d14/d35/d4c/d61/d87/da6 21 1 2024-09-19T09:41:44.533 INFO:tasks.workunit.client.0.smithi042.stdout:2/884: write d7/dd/d14/d35/d45/d5e/d79/fa1 [437531,3161] 0 2024-09-19T09:41:44.534 INFO:tasks.workunit.client.0.smithi042.stdout:0/818: mkdir d2/d10/d12/d16/d57/d78/dfb/d106 0 2024-09-19T09:41:44.534 INFO:tasks.workunit.client.0.smithi042.stdout:0/819: fdatasync f0 0 2024-09-19T09:41:44.537 INFO:tasks.workunit.client.0.smithi042.stdout:2/885: dread d7/dd/d48/d96/fa5 [0,4194304] 0 2024-09-19T09:41:44.538 INFO:tasks.workunit.client.0.smithi042.stdout:1/924: write d4/d29/fe0 [1225029,12725] 0 2024-09-19T09:41:44.539 INFO:tasks.workunit.client.0.smithi042.stdout:2/886: rename d7/dd/d14/d11b/lcc to d7/dd/d1f/d122/l12c 0 2024-09-19T09:41:44.541 INFO:tasks.workunit.client.0.smithi042.stdout:2/887: link d7/dd/d14/d35/d4e/d9c/fb1 d7/dd/d14/d35/d45/d5e/f12d 0 2024-09-19T09:41:44.542 INFO:tasks.workunit.client.0.smithi042.stdout:2/888: symlink d7/dd/d14/d35/d45/d5e/l12e 0 2024-09-19T09:41:44.543 INFO:tasks.workunit.client.0.smithi042.stdout:2/889: dread - d7/dd/d1f/d122/f123 zero size 2024-09-19T09:41:44.543 INFO:tasks.workunit.client.0.smithi042.stdout:2/890: readlink d7/dd/d22/d30/l72 0 2024-09-19T09:41:44.544 INFO:tasks.workunit.client.0.smithi042.stdout:6/866: dwrite d1/de/d76/d99/db2/d34/d6f/d4a/d98/fd4 [0,4194304] 0 2024-09-19T09:41:44.544 INFO:tasks.workunit.client.0.smithi042.stdout:6/867: dread - d1/d20/d6a/d46/d95/f108 zero size 2024-09-19T09:41:44.544 INFO:tasks.workunit.client.0.smithi042.stdout:2/891: rename d7/dd/c5d to d7/dd/d22/d30/c12f 0 2024-09-19T09:41:44.544 INFO:tasks.workunit.client.0.smithi042.stdout:2/892: chown d7/dd/d14/f56 678 1 2024-09-19T09:41:44.547 INFO:tasks.workunit.client.0.smithi042.stdout:6/868: symlink d1/de/d76/d99/db2/d34/d6f/d93/dfa/l10f 0 2024-09-19T09:41:44.547 INFO:tasks.workunit.client.0.smithi042.stdout:5/820: dwrite d2/db/d3c/f94 [0,4194304] 0 2024-09-19T09:41:44.547 INFO:tasks.workunit.client.0.smithi042.stdout:5/821: truncate d2/f1b 4429143 0 2024-09-19T09:41:44.548 INFO:tasks.workunit.client.0.smithi042.stdout:2/893: rmdir d7/dd/d48 39 2024-09-19T09:41:44.550 INFO:tasks.workunit.client.0.smithi042.stdout:2/894: rmdir d7/dd/d14/d35/d45/d5e 39 2024-09-19T09:41:44.550 INFO:tasks.workunit.client.0.smithi042.stdout:2/895: chown d7/dd/d14/d11b/dc7/d88/f95 64710 1 2024-09-19T09:41:44.553 INFO:tasks.workunit.client.0.smithi042.stdout:1/925: dread d4/d15/d19/fec [0,4194304] 0 2024-09-19T09:41:44.553 INFO:tasks.workunit.client.0.smithi042.stdout:1/926: chown d4/d15/d2e/d105/l10d 397626 1 2024-09-19T09:41:44.554 INFO:tasks.workunit.client.0.smithi042.stdout:0/820: dread d2/d10/d1d/f25 [0,4194304] 0 2024-09-19T09:41:44.557 INFO:tasks.workunit.client.0.smithi042.stdout:0/821: rename d2/d10/d12/dec to d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/d107 0 2024-09-19T09:41:44.557 INFO:tasks.workunit.client.0.smithi042.stdout:0/822: getdents d2/d10/d12/de0 0 2024-09-19T09:41:44.558 INFO:tasks.workunit.client.0.smithi042.stdout:8/884: dwrite d1/da/dd/f70 [0,4194304] 0 2024-09-19T09:41:44.559 INFO:tasks.workunit.client.0.smithi042.stdout:4/836: dwrite d0/d28/d36/df9/f101 [0,4194304] 0 2024-09-19T09:41:44.564 INFO:tasks.workunit.client.0.smithi042.stdout:0/823: write d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/fcc [83930,102587] 0 2024-09-19T09:41:44.564 INFO:tasks.workunit.client.0.smithi042.stdout:4/837: unlink d0/d1b/d1c/d2e/d3f/d6e/l77 0 2024-09-19T09:41:44.577 INFO:tasks.workunit.client.0.smithi042.stdout:2/896: dwrite d7/dd/d14/f25 [8388608,4194304] 0 2024-09-19T09:41:44.577 INFO:tasks.workunit.client.0.smithi042.stdout:2/897: stat d7/dd/d14/d35/d4e/d63/f9a 0 2024-09-19T09:41:44.577 INFO:tasks.workunit.client.0.smithi042.stdout:2/898: write d7/dd/f47 [886465,100454] 0 2024-09-19T09:41:44.579 INFO:tasks.workunit.client.0.smithi042.stdout:2/899: creat d7/dd/d14/d35/d4c/f130 x:0 0 0 2024-09-19T09:41:44.583 INFO:tasks.workunit.client.0.smithi042.stdout:2/900: mkdir d7/d131 0 2024-09-19T09:41:44.586 INFO:tasks.workunit.client.0.smithi042.stdout:8/885: dwrite d1/da/d3f/fd8 [0,4194304] 0 2024-09-19T09:41:44.586 INFO:tasks.workunit.client.0.smithi042.stdout:2/901: rename d7/l3d to d7/dd/d14/dec/dfd/l132 0 2024-09-19T09:41:44.588 INFO:tasks.workunit.client.0.smithi042.stdout:6/869: dwrite d1/de/d76/d99/db2/d34/d6f/d4a/d98/fd4 [0,4194304] 0 2024-09-19T09:41:44.588 INFO:tasks.workunit.client.0.smithi042.stdout:8/886: unlink d1/da8/d3d/d95/ld3 0 2024-09-19T09:41:44.589 INFO:tasks.workunit.client.0.smithi042.stdout:6/870: creat d1/de/d12/f110 x:0 0 0 2024-09-19T09:41:44.590 INFO:tasks.workunit.client.0.smithi042.stdout:8/887: creat d1/da8/d41/d55/d99/f107 x:0 0 0 2024-09-19T09:41:44.590 INFO:tasks.workunit.client.0.smithi042.stdout:1/927: dwrite d4/d15/d61/fa7 [0,4194304] 0 2024-09-19T09:41:44.590 INFO:tasks.workunit.client.0.smithi042.stdout:1/928: fdatasync d4/d1e/ff1 0 2024-09-19T09:41:44.591 INFO:tasks.workunit.client.0.smithi042.stdout:5/822: dwrite d2/d4/d64/da7/f35 [0,4194304] 0 2024-09-19T09:41:44.592 INFO:tasks.workunit.client.0.smithi042.stdout:6/871: truncate d1/de/d76/d99/db2/d34/d6f/fcc 1655580 0 2024-09-19T09:41:44.592 INFO:tasks.workunit.client.0.smithi042.stdout:0/824: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/fcc [0,4194304] 0 2024-09-19T09:41:44.592 INFO:tasks.workunit.client.0.smithi042.stdout:0/825: chown d2/d10/d12/d16/d57/d99/dd0/fb4 13 1 2024-09-19T09:41:44.592 INFO:tasks.workunit.client.0.smithi042.stdout:8/888: rmdir d1/da/dd/d74 39 2024-09-19T09:41:44.592 INFO:tasks.workunit.client.0.smithi042.stdout:5/823: dread d2/d4/d20/d60/d72/f65 [0,4194304] 0 2024-09-19T09:41:44.594 INFO:tasks.workunit.client.0.smithi042.stdout:1/929: creat d4/d15/d19/d42/d51/f12b x:0 0 0 2024-09-19T09:41:44.594 INFO:tasks.workunit.client.0.smithi042.stdout:1/930: chown d4/f14 1724993072 1 2024-09-19T09:41:44.594 INFO:tasks.workunit.client.0.smithi042.stdout:1/931: read d4/f47 [127862,33469] 0 2024-09-19T09:41:44.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:44 smithi171 ceph-mon[35803]: pgmap v409: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s rd, 170 MiB/s wr, 651 op/s 2024-09-19T09:41:44.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:44 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:44.597 INFO:tasks.workunit.client.0.smithi042.stdout:0/826: creat d2/d10/d12/d16/d57/d78/f108 x:0 0 0 2024-09-19T09:41:44.598 INFO:tasks.workunit.client.0.smithi042.stdout:1/932: unlink d4/f14 0 2024-09-19T09:41:44.600 INFO:tasks.workunit.client.0.smithi042.stdout:8/889: dread d1/da8/d3d/f6c [0,4194304] 0 2024-09-19T09:41:44.600 INFO:tasks.workunit.client.0.smithi042.stdout:8/890: read d1/da/dd/f5c [640621,16199] 0 2024-09-19T09:41:44.600 INFO:tasks.workunit.client.0.smithi042.stdout:0/827: unlink d2/d10/d1d/d34/f86 0 2024-09-19T09:41:44.603 INFO:tasks.workunit.client.0.smithi042.stdout:1/933: mkdir d4/d15/d19/dae/d124/d12c 0 2024-09-19T09:41:44.608 INFO:tasks.workunit.client.0.smithi042.stdout:8/891: creat d1/db2/f108 x:0 0 0 2024-09-19T09:41:44.609 INFO:tasks.workunit.client.0.smithi042.stdout:1/934: write d4/d12/d8d/d91/d106/f57 [1939920,93720] 0 2024-09-19T09:41:44.609 INFO:tasks.workunit.client.0.smithi042.stdout:2/902: getdents d7 0 2024-09-19T09:41:44.610 INFO:tasks.workunit.client.0.smithi042.stdout:9/690: sync 2024-09-19T09:41:44.612 INFO:tasks.workunit.client.0.smithi042.stdout:6/872: dwrite d1/d20/d6a/d90/f3b [0,4194304] 0 2024-09-19T09:41:44.612 INFO:tasks.workunit.client.0.smithi042.stdout:8/892: link d1/da/dd/d74/f7e d1/da/dd/f109 0 2024-09-19T09:41:44.612 INFO:tasks.workunit.client.0.smithi042.stdout:1/935: rmdir d4/d15/d61/d85 39 2024-09-19T09:41:44.614 INFO:tasks.workunit.client.0.smithi042.stdout:9/691: creat d8/db/d31/fcb x:0 0 0 2024-09-19T09:41:44.614 INFO:tasks.workunit.client.0.smithi042.stdout:9/692: readlink d8/db/l99 0 2024-09-19T09:41:44.615 INFO:tasks.workunit.client.0.smithi042.stdout:6/873: getdents d1 0 2024-09-19T09:41:44.615 INFO:tasks.workunit.client.0.smithi042.stdout:6/874: write d1/d20/d6a/d90/fe2 [2643254,38031] 0 2024-09-19T09:41:44.615 INFO:tasks.workunit.client.0.smithi042.stdout:8/893: mknod d1/d2e/c10a 0 2024-09-19T09:41:44.616 INFO:tasks.workunit.client.0.smithi042.stdout:1/936: getdents d4/d15/d19/dae 0 2024-09-19T09:41:44.617 INFO:tasks.workunit.client.0.smithi042.stdout:9/693: creat d8/da/d19/fcc x:0 0 0 2024-09-19T09:41:44.617 INFO:tasks.workunit.client.0.smithi042.stdout:6/875: symlink d1/d20/d6a/d46/d92/d3a/l111 0 2024-09-19T09:41:44.618 INFO:tasks.workunit.client.0.smithi042.stdout:6/876: rename d1/de/d54 to d1/de/d54/dda/d112 22 2024-09-19T09:41:44.618 INFO:tasks.workunit.client.0.smithi042.stdout:8/894: truncate d1/da8/d3d/f6c 4136475 0 2024-09-19T09:41:44.618 INFO:tasks.workunit.client.0.smithi042.stdout:1/937: getdents d4/d15/d61/d85/dc9/de8 0 2024-09-19T09:41:44.620 INFO:tasks.workunit.client.0.smithi042.stdout:5/824: dwrite d2/d4/f78 [0,4194304] 0 2024-09-19T09:41:44.620 INFO:tasks.workunit.client.0.smithi042.stdout:9/694: creat d8/d1d/d28/fcd x:0 0 0 2024-09-19T09:41:44.620 INFO:tasks.workunit.client.0.smithi042.stdout:6/877: mkdir d1/d20/d6a/d113 0 2024-09-19T09:41:44.620 INFO:tasks.workunit.client.0.smithi042.stdout:6/878: chown d1/d20/d6a/d46/d92/d3a/f42 301 1 2024-09-19T09:41:44.621 INFO:tasks.workunit.client.0.smithi042.stdout:6/879: chown d1/d20/dc6 1141 1 2024-09-19T09:41:44.621 INFO:tasks.workunit.client.0.smithi042.stdout:6/880: chown d1/de/d76/d99/db2 7533160 1 2024-09-19T09:41:44.621 INFO:tasks.workunit.client.0.smithi042.stdout:8/895: creat d1/da/dd/dac/f10b x:0 0 0 2024-09-19T09:41:44.624 INFO:tasks.workunit.client.0.smithi042.stdout:1/938: mkdir d4/d15/d19/d45/d82/d89/d126/dda/d12d 0 2024-09-19T09:41:44.627 INFO:tasks.workunit.client.0.smithi042.stdout:2/903: dwrite d7/dd/d48/fc1 [0,4194304] 0 2024-09-19T09:41:44.629 INFO:tasks.workunit.client.0.smithi042.stdout:9/695: mkdir d8/da/d19/d1c/da5/dce 0 2024-09-19T09:41:44.631 INFO:tasks.workunit.client.0.smithi042.stdout:0/828: rmdir d2/d10/d12/d16/d57/d99/dd0/da5 39 2024-09-19T09:41:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:44 smithi136 ceph-mon[34840]: pgmap v409: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s rd, 170 MiB/s wr, 651 op/s 2024-09-19T09:41:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:44 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:44.637 INFO:tasks.workunit.client.0.smithi042.stdout:9/696: read d8/da/f50 [4883330,112645] 0 2024-09-19T09:41:44.639 INFO:tasks.workunit.client.0.smithi042.stdout:9/697: creat d8/da/d19/d1c/fcf x:0 0 0 2024-09-19T09:41:44.642 INFO:tasks.workunit.client.0.smithi042.stdout:6/881: dwrite d1/d20/f27 [0,4194304] 0 2024-09-19T09:41:44.645 INFO:tasks.workunit.client.0.smithi042.stdout:5/825: rename d2/db/d3c/c104 to d2/d4/de8/c118 0 2024-09-19T09:41:44.647 INFO:tasks.workunit.client.0.smithi042.stdout:7/744: sync 2024-09-19T09:41:44.647 INFO:tasks.workunit.client.0.smithi042.stdout:3/926: sync 2024-09-19T09:41:44.647 INFO:tasks.workunit.client.0.smithi042.stdout:7/745: chown d0/d40/d9d/db5/cc6 15 1 2024-09-19T09:41:44.649 INFO:tasks.workunit.client.0.smithi042.stdout:3/927: creat d4/d8/d9/dc/dbf/d6d/d122/d114/f12a x:0 0 0 2024-09-19T09:41:44.655 INFO:tasks.workunit.client.0.smithi042.stdout:1/939: dwrite d4/d12/d8d/d91/d7f/fba [0,4194304] 0 2024-09-19T09:41:44.657 INFO:tasks.workunit.client.0.smithi042.stdout:1/940: symlink d4/d29/l12e 0 2024-09-19T09:41:44.659 INFO:tasks.workunit.client.0.smithi042.stdout:1/941: creat d4/d12/d8d/d91/d106/d127/f12f x:0 0 0 2024-09-19T09:41:44.661 INFO:tasks.workunit.client.0.smithi042.stdout:8/896: dwrite d1/db2/f108 [0,4194304] 0 2024-09-19T09:41:44.661 INFO:tasks.workunit.client.0.smithi042.stdout:5/826: dread d2/db/d3c/f94 [0,4194304] 0 2024-09-19T09:41:44.661 INFO:tasks.workunit.client.0.smithi042.stdout:8/897: dread - d1/fcf zero size 2024-09-19T09:41:44.664 INFO:tasks.workunit.client.0.smithi042.stdout:5/827: mknod d2/d25/d37/dc2/c119 0 2024-09-19T09:41:44.665 INFO:tasks.workunit.client.0.smithi042.stdout:3/928: write d4/d8/d9/d1b/dd5/fd8 [3410389,111709] 0 2024-09-19T09:41:44.665 INFO:tasks.workunit.client.0.smithi042.stdout:5/828: read d2/d4/d2e/f4c [1069236,11193] 0 2024-09-19T09:41:44.666 INFO:tasks.workunit.client.0.smithi042.stdout:3/929: mknod d4/d8/d9/dc/dbf/d8b/c12b 0 2024-09-19T09:41:44.666 INFO:tasks.workunit.client.0.smithi042.stdout:7/746: dwrite d0/f23 [0,4194304] 0 2024-09-19T09:41:44.667 INFO:tasks.workunit.client.0.smithi042.stdout:5/829: link d2/d4/d20/d60/db0/cf2 d2/d25/d37/dc2/c11a 0 2024-09-19T09:41:44.667 INFO:tasks.workunit.client.0.smithi042.stdout:5/830: readlink d2/d4/d64/lfe 0 2024-09-19T09:41:44.668 INFO:tasks.workunit.client.0.smithi042.stdout:7/747: mknod d0/d14/d3a/ddc/d9b/cf6 0 2024-09-19T09:41:44.670 INFO:tasks.workunit.client.0.smithi042.stdout:5/831: link d2/de3/l10a d2/d4/d20/da4/l11b 0 2024-09-19T09:41:44.670 INFO:tasks.workunit.client.0.smithi042.stdout:5/832: truncate d2/d25/d37/ffa 314974 0 2024-09-19T09:41:44.671 INFO:tasks.workunit.client.0.smithi042.stdout:9/698: dwrite d8/da/d19/fcc [0,4194304] 0 2024-09-19T09:41:44.671 INFO:tasks.workunit.client.0.smithi042.stdout:9/699: stat d8/d1d/d28/f43 0 2024-09-19T09:41:44.671 INFO:tasks.workunit.client.0.smithi042.stdout:6/882: dwrite d1/d20/d6a/d90/fe2 [0,4194304] 0 2024-09-19T09:41:44.672 INFO:tasks.workunit.client.0.smithi042.stdout:5/833: read d2/d4/d20/d60/d72/f9c [70854,18077] 0 2024-09-19T09:41:44.672 INFO:tasks.workunit.client.0.smithi042.stdout:2/904: rename d7/dd/d22/d30/d66/ce4 to d7/dd/d1f/d3f/dfa/d102/c133 0 2024-09-19T09:41:44.672 INFO:tasks.workunit.client.0.smithi042.stdout:2/905: chown d7/dd/d14/d35/d4e/d9c/fde 1 1 2024-09-19T09:41:44.673 INFO:tasks.workunit.client.0.smithi042.stdout:2/906: readlink d7/dd/d14/d35/d4c/d61/l100 0 2024-09-19T09:41:44.673 INFO:tasks.workunit.client.0.smithi042.stdout:2/907: chown d7/d9b/db9/cd3 27770132 1 2024-09-19T09:41:44.673 INFO:tasks.workunit.client.0.smithi042.stdout:2/908: chown d7/dd/d14/d35/d45/d5e/d79/fb6 2478747 1 2024-09-19T09:41:44.673 INFO:tasks.workunit.client.0.smithi042.stdout:2/909: chown d7/dd/d14/d11b/fd4 40694575 1 2024-09-19T09:41:44.674 INFO:tasks.workunit.client.0.smithi042.stdout:9/700: getdents d8/da/d89/d8e 0 2024-09-19T09:41:44.674 INFO:tasks.workunit.client.0.smithi042.stdout:4/838: sync 2024-09-19T09:41:44.676 INFO:tasks.workunit.client.0.smithi042.stdout:0/829: rename d2/d10/d1e to d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d109 0 2024-09-19T09:41:44.676 INFO:tasks.workunit.client.0.smithi042.stdout:4/839: mkdir d0/d1b/d1c/d2e/d3f/d5a/d116 0 2024-09-19T09:41:44.678 INFO:tasks.workunit.client.0.smithi042.stdout:1/942: rename d4/d12/d8d/dca/dd4/l103 to d4/d15/d19/d42/l130 0 2024-09-19T09:41:44.679 INFO:tasks.workunit.client.0.smithi042.stdout:4/840: creat d0/d1b/f117 x:0 0 0 2024-09-19T09:41:44.679 INFO:tasks.workunit.client.0.smithi042.stdout:1/943: mknod d4/d12/d8d/dca/dd4/c131 0 2024-09-19T09:41:44.681 INFO:tasks.workunit.client.0.smithi042.stdout:8/898: rename d1/da8/d92/dc7/df9 to d1/d10c 0 2024-09-19T09:41:44.684 INFO:tasks.workunit.client.0.smithi042.stdout:4/841: link d0/d1b/d1c/d2e/d3f/d5a/f5b d0/d1b/d1c/d2e/d3f/d6e/da0/f118 0 2024-09-19T09:41:44.685 INFO:tasks.workunit.client.0.smithi042.stdout:3/930: dread d4/f74 [0,4194304] 0 2024-09-19T09:41:44.685 INFO:tasks.workunit.client.0.smithi042.stdout:3/931: write d4/d8/d9/dc/fe1 [962901,83781] 0 2024-09-19T09:41:44.686 INFO:tasks.workunit.client.0.smithi042.stdout:2/910: dread d7/dd/d14/d35/d4e/d9c/fae [0,4194304] 0 2024-09-19T09:41:44.686 INFO:tasks.workunit.client.0.smithi042.stdout:2/911: chown d7/c5f 0 1 2024-09-19T09:41:44.686 INFO:tasks.workunit.client.0.smithi042.stdout:8/899: creat d1/da/d14/df6/f10d x:0 0 0 2024-09-19T09:41:44.686 INFO:tasks.workunit.client.0.smithi042.stdout:8/900: chown d1/da8/d41/fb5 23 1 2024-09-19T09:41:44.687 INFO:tasks.workunit.client.0.smithi042.stdout:4/842: creat d0/d28/d36/df9/f119 x:0 0 0 2024-09-19T09:41:44.687 INFO:tasks.workunit.client.0.smithi042.stdout:4/843: chown d0/d1b/d1c/d61/d7f/fe2 46440954 1 2024-09-19T09:41:44.687 INFO:tasks.workunit.client.0.smithi042.stdout:4/844: write d0/d1b/d1c/d2e/d3b/fdc [592602,126145] 0 2024-09-19T09:41:44.688 INFO:tasks.workunit.client.0.smithi042.stdout:3/932: creat d4/d8/d4c/f12c x:0 0 0 2024-09-19T09:41:44.688 INFO:tasks.workunit.client.0.smithi042.stdout:3/933: write d4/d8/d9/d1b/d4f/faf [758807,118402] 0 2024-09-19T09:41:44.689 INFO:tasks.workunit.client.0.smithi042.stdout:2/912: getdents d7/dd/d14/d35/d4c/d70 0 2024-09-19T09:41:44.691 INFO:tasks.workunit.client.0.smithi042.stdout:3/934: mknod d4/d8/d9/d115/d82/d48/dc3/df3/c12d 0 2024-09-19T09:41:44.692 INFO:tasks.workunit.client.0.smithi042.stdout:2/913: creat d7/dd/d22/d30/f134 x:0 0 0 2024-09-19T09:41:44.692 INFO:tasks.workunit.client.0.smithi042.stdout:2/914: write d7/dd/d22/fb7 [286147,73783] 0 2024-09-19T09:41:44.692 INFO:tasks.workunit.client.0.smithi042.stdout:4/845: rmdir d0/d1b/d1c/d2e 39 2024-09-19T09:41:44.693 INFO:tasks.workunit.client.0.smithi042.stdout:3/935: creat d4/d8/dff/f12e x:0 0 0 2024-09-19T09:41:44.693 INFO:tasks.workunit.client.0.smithi042.stdout:2/915: getdents d7/dd/d1f/d122 0 2024-09-19T09:41:44.693 INFO:tasks.workunit.client.0.smithi042.stdout:2/916: chown d7/dd/d14/d35/d4e/d63/l9e 3465 1 2024-09-19T09:41:44.694 INFO:tasks.workunit.client.0.smithi042.stdout:4/846: creat d0/f11a x:0 0 0 2024-09-19T09:41:44.694 INFO:tasks.workunit.client.0.smithi042.stdout:1/944: write d4/d15/d61/fa7 [277903,120993] 0 2024-09-19T09:41:44.697 INFO:tasks.workunit.client.0.smithi042.stdout:3/936: mkdir d4/d8/d9/d115/d82/d8c/d9f/d12f 0 2024-09-19T09:41:44.698 INFO:tasks.workunit.client.0.smithi042.stdout:4/847: getdents d0/d28/d36 0 2024-09-19T09:41:44.699 INFO:tasks.workunit.client.0.smithi042.stdout:1/945: rmdir d4/d15/d2e/db7/d3c 39 2024-09-19T09:41:44.703 INFO:tasks.workunit.client.0.smithi042.stdout:1/946: write d4/d15/d19/fec [50697,106058] 0 2024-09-19T09:41:44.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:44 smithi042 ceph-mon[31223]: pgmap v409: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s rd, 170 MiB/s wr, 651 op/s 2024-09-19T09:41:44.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:44 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:44.706 INFO:tasks.workunit.client.0.smithi042.stdout:1/947: creat d4/d15/d2e/d105/f132 x:0 0 0 2024-09-19T09:41:44.710 INFO:tasks.workunit.client.0.smithi042.stdout:5/834: dwrite d2/d4/f56 [4194304,4194304] 0 2024-09-19T09:41:44.712 INFO:tasks.workunit.client.0.smithi042.stdout:7/748: dwrite d0/d14/d3a/ddc/fc2 [0,4194304] 0 2024-09-19T09:41:44.712 INFO:tasks.workunit.client.0.smithi042.stdout:7/749: chown d0/d14/d3c/lb4 25903 1 2024-09-19T09:41:44.712 INFO:tasks.workunit.client.0.smithi042.stdout:9/701: dwrite d8/da/d89/da7/db6/db5/d87/dad/fb0 [0,4194304] 0 2024-09-19T09:41:44.712 INFO:tasks.workunit.client.0.smithi042.stdout:9/702: readlink d8/d1d/d28/l9c 0 2024-09-19T09:41:44.727 INFO:tasks.workunit.client.0.smithi042.stdout:5/835: dwrite d2/d4/fd5 [0,4194304] 0 2024-09-19T09:41:44.728 INFO:tasks.workunit.client.0.smithi042.stdout:8/901: dwrite d1/da/d3f/f6f [0,4194304] 0 2024-09-19T09:41:44.728 INFO:tasks.workunit.client.0.smithi042.stdout:5/836: mkdir d2/d4/d20/dc0/d11c 0 2024-09-19T09:41:44.730 INFO:tasks.workunit.client.0.smithi042.stdout:8/902: read d1/da/d14/f17 [1870124,26124] 0 2024-09-19T09:41:44.734 INFO:tasks.workunit.client.0.smithi042.stdout:2/917: rename d7/dd/d14/c82 to d7/dd/d14/d35/d45/d5e/d79/d118/c135 0 2024-09-19T09:41:44.734 INFO:tasks.workunit.client.0.smithi042.stdout:2/918: stat d7/dd/d14/d35/d4c/d61/d87/dc6 0 2024-09-19T09:41:44.734 INFO:tasks.workunit.client.0.smithi042.stdout:8/903: mknod d1/da/dcd/c10e 0 2024-09-19T09:41:44.734 INFO:tasks.workunit.client.0.smithi042.stdout:8/904: write d1/da/d3f/f67 [1697506,34839] 0 2024-09-19T09:41:44.735 INFO:tasks.workunit.client.0.smithi042.stdout:8/905: write d1/da/dd/d74/f7e [2107101,106802] 0 2024-09-19T09:41:44.735 INFO:tasks.workunit.client.0.smithi042.stdout:8/906: truncate d1/d2e/ffa 600477 0 2024-09-19T09:41:44.736 INFO:tasks.workunit.client.0.smithi042.stdout:8/907: creat d1/d2e/f10f x:0 0 0 2024-09-19T09:41:44.740 INFO:tasks.workunit.client.0.smithi042.stdout:8/908: getdents d1/d2e 0 2024-09-19T09:41:44.740 INFO:tasks.workunit.client.0.smithi042.stdout:8/909: read - d1/da8/d41/fdf zero size 2024-09-19T09:41:44.740 INFO:tasks.workunit.client.0.smithi042.stdout:8/910: chown d1/da 1066 1 2024-09-19T09:41:44.740 INFO:tasks.workunit.client.0.smithi042.stdout:8/911: rmdir d1/da8/db1 39 2024-09-19T09:41:44.741 INFO:tasks.workunit.client.0.smithi042.stdout:8/912: mkdir d1/da8/d41/d55/d99/d110 0 2024-09-19T09:41:44.744 INFO:tasks.workunit.client.0.smithi042.stdout:5/837: dwrite d2/db/d3c/f3f [4194304,4194304] 0 2024-09-19T09:41:44.744 INFO:tasks.workunit.client.0.smithi042.stdout:5/838: getdents d2/d4/d20/dc0/d11c 0 2024-09-19T09:41:44.745 INFO:tasks.workunit.client.0.smithi042.stdout:5/839: readlink d2/d4/d20/da4/l11b 0 2024-09-19T09:41:44.745 INFO:tasks.workunit.client.0.smithi042.stdout:5/840: write d2/d4/d20/d60/db0/ff1 [215154,57329] 0 2024-09-19T09:41:44.752 INFO:tasks.workunit.client.0.smithi042.stdout:8/913: read d1/da/d3f/f6f [3765200,43077] 0 2024-09-19T09:41:44.756 INFO:tasks.workunit.client.0.smithi042.stdout:4/848: rename d0/d1b/d1c/d2e/d3f to d0/d28/d87/da1/d11b 0 2024-09-19T09:41:44.756 INFO:tasks.workunit.client.0.smithi042.stdout:4/849: mknod d0/d1b/d1c/d2e/d3b/d95/db1/dba/d105/c11c 0 2024-09-19T09:41:44.756 INFO:tasks.workunit.client.0.smithi042.stdout:4/850: write d0/d1b/d1c/d61/d7f/f8a [1041377,128028] 0 2024-09-19T09:41:44.757 INFO:tasks.workunit.client.0.smithi042.stdout:7/750: rename d0/d14/c20 to d0/d3d/d92/dc7/cf7 0 2024-09-19T09:41:44.758 INFO:tasks.workunit.client.0.smithi042.stdout:4/851: symlink d0/d1b/d1c/d61/l11d 0 2024-09-19T09:41:44.759 INFO:tasks.workunit.client.0.smithi042.stdout:8/914: read d1/da8/d41/d55/d99/da4/f6d [6219677,85064] 0 2024-09-19T09:41:44.759 INFO:tasks.workunit.client.0.smithi042.stdout:9/703: rename d8/da/d19/d1c/d21/d7f/f5a to d8/da/d19/d1c/d21/d67/d7b/fd0 0 2024-09-19T09:41:44.760 INFO:tasks.workunit.client.0.smithi042.stdout:8/915: mkdir d1/da/dd/dac/d111 0 2024-09-19T09:41:44.760 INFO:tasks.workunit.client.0.smithi042.stdout:4/852: rmdir d0/d28/d87/da1/d11b/d6b/d8f 39 2024-09-19T09:41:44.760 INFO:tasks.workunit.client.0.smithi042.stdout:8/916: truncate d1/da8/d41/d55/d99/da4/dc2/fec 80528 0 2024-09-19T09:41:44.761 INFO:tasks.workunit.client.0.smithi042.stdout:8/917: symlink d1/d2e/l112 0 2024-09-19T09:41:44.761 INFO:tasks.workunit.client.0.smithi042.stdout:0/830: dread f0 [0,4194304] 0 2024-09-19T09:41:44.762 INFO:tasks.workunit.client.0.smithi042.stdout:4/853: creat d0/d1b/d1c/d2e/d3b/d95/f11e x:0 0 0 2024-09-19T09:41:44.762 INFO:tasks.workunit.client.0.smithi042.stdout:7/751: dread d0/d40/d9d/dd0/fd8 [4194304,4194304] 0 2024-09-19T09:41:44.762 INFO:tasks.workunit.client.0.smithi042.stdout:7/752: chown d0/d14/d3c/c53 1181206 1 2024-09-19T09:41:44.762 INFO:tasks.workunit.client.0.smithi042.stdout:7/753: rmdir d0/d14/d3a/dec 39 2024-09-19T09:41:44.763 INFO:tasks.workunit.client.0.smithi042.stdout:7/754: creat d0/d40/d9d/ff8 x:0 0 0 2024-09-19T09:41:44.770 INFO:tasks.workunit.client.0.smithi042.stdout:9/704: dread d8/da/d19/d1c/d21/d7f/f8a [0,4194304] 0 2024-09-19T09:41:44.770 INFO:tasks.workunit.client.0.smithi042.stdout:9/705: fsync f5 0 2024-09-19T09:41:44.775 INFO:tasks.workunit.client.0.smithi042.stdout:8/918: dread d1/da/dd/fa3 [0,4194304] 0 2024-09-19T09:41:44.775 INFO:tasks.workunit.client.0.smithi042.stdout:2/919: rename d7/dd/d14/d11b to d7/dd/d14/d35/d4c/d70/d136 0 2024-09-19T09:41:44.776 INFO:tasks.workunit.client.0.smithi042.stdout:7/755: dread d0/d14/d3a/f3e [0,4194304] 0 2024-09-19T09:41:44.777 INFO:tasks.workunit.client.0.smithi042.stdout:7/756: chown d0/d14 5 1 2024-09-19T09:41:44.778 INFO:tasks.workunit.client.0.smithi042.stdout:0/831: rmdir d2/d10/d12/d24 39 2024-09-19T09:41:44.778 INFO:tasks.workunit.client.0.smithi042.stdout:0/832: readlink d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/l9c 0 2024-09-19T09:41:44.778 INFO:tasks.workunit.client.0.smithi042.stdout:0/833: stat d2/d10/d12/fcf 0 2024-09-19T09:41:44.780 INFO:tasks.workunit.client.0.smithi042.stdout:8/919: mkdir d1/da8/d3d/d95/d113 0 2024-09-19T09:41:44.780 INFO:tasks.workunit.client.0.smithi042.stdout:8/920: fsync d1/da8/d41/d55/d99/da4/dc2/fec 0 2024-09-19T09:41:44.780 INFO:tasks.workunit.client.0.smithi042.stdout:9/706: write d8/da/d19/fcc [3364660,37778] 0 2024-09-19T09:41:44.780 INFO:tasks.workunit.client.0.smithi042.stdout:8/921: chown d1/da8/d41/f75 274 1 2024-09-19T09:41:44.780 INFO:tasks.workunit.client.0.smithi042.stdout:8/922: fsync d1/da/dd/d74/f9e 0 2024-09-19T09:41:44.781 INFO:tasks.workunit.client.0.smithi042.stdout:5/841: rename d2/def to d2/d4/d20/da4/dde/d102/d11d 0 2024-09-19T09:41:44.781 INFO:tasks.workunit.client.0.smithi042.stdout:8/923: read d1/da/dd/d74/dbc/fc0 [40285,36763] 0 2024-09-19T09:41:44.781 INFO:tasks.workunit.client.0.smithi042.stdout:8/924: write d1/da/f21 [9376845,90538] 0 2024-09-19T09:41:44.781 INFO:tasks.workunit.client.0.smithi042.stdout:5/842: write d2/d25/d37/ffa [222206,100188] 0 2024-09-19T09:41:44.781 INFO:tasks.workunit.client.0.smithi042.stdout:2/920: creat d7/dd/d14/d35/d4e/d63/f137 x:0 0 0 2024-09-19T09:41:44.782 INFO:tasks.workunit.client.0.smithi042.stdout:2/921: chown d7/dd/d1f/d3f/f5c 2 1 2024-09-19T09:41:44.784 INFO:tasks.workunit.client.0.smithi042.stdout:5/843: mknod d2/d4/d64/da7/c11e 0 2024-09-19T09:41:44.784 INFO:tasks.workunit.client.0.smithi042.stdout:5/844: readlink d2/d4/d20/d60/db0/lcc 0 2024-09-19T09:41:44.784 INFO:tasks.workunit.client.0.smithi042.stdout:5/845: chown d2/db/l107 1475722 1 2024-09-19T09:41:44.785 INFO:tasks.workunit.client.0.smithi042.stdout:0/834: dread d2/d10/d12/d16/d57/d99/dd0/fb4 [0,4194304] 0 2024-09-19T09:41:44.785 INFO:tasks.workunit.client.0.smithi042.stdout:0/835: stat d2/c7 0 2024-09-19T09:41:44.785 INFO:tasks.workunit.client.0.smithi042.stdout:0/836: dread - d2/d10/d12/d16/fdc zero size 2024-09-19T09:41:44.786 INFO:tasks.workunit.client.0.smithi042.stdout:0/837: getdents d2/d10/d12/d16/d57/d99/dd0/da5 0 2024-09-19T09:41:44.786 INFO:tasks.workunit.client.0.smithi042.stdout:0/838: stat d2/c3a 0 2024-09-19T09:41:44.786 INFO:tasks.workunit.client.0.smithi042.stdout:0/839: fdatasync d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/dca/fe4 0 2024-09-19T09:41:44.787 INFO:tasks.workunit.client.0.smithi042.stdout:0/840: stat d2/d10/d12/d24/d5b/l93 0 2024-09-19T09:41:44.787 INFO:tasks.workunit.client.0.smithi042.stdout:0/841: write d2/d10/d12/d16/d51/fd7 [715730,28388] 0 2024-09-19T09:41:44.798 INFO:tasks.workunit.client.0.smithi042.stdout:9/707: dwrite d8/f1a [4194304,4194304] 0 2024-09-19T09:41:44.801 INFO:tasks.workunit.client.0.smithi042.stdout:9/708: dread d8/d32/f58 [0,4194304] 0 2024-09-19T09:41:44.802 INFO:tasks.workunit.client.0.smithi042.stdout:9/709: fdatasync d8/d32/f58 0 2024-09-19T09:41:44.802 INFO:tasks.workunit.client.0.smithi042.stdout:4/854: rename d0/d28/d87/da1/d11b/d6b/d8f to d0/d1b/dd8/d11f 0 2024-09-19T09:41:44.803 INFO:tasks.workunit.client.0.smithi042.stdout:9/710: creat d8/da/d19/d1c/fd1 x:0 0 0 2024-09-19T09:41:44.805 INFO:tasks.workunit.client.0.smithi042.stdout:7/757: rename d0/d3d/fd6 to d0/d3d/db0/ff9 0 2024-09-19T09:41:44.805 INFO:tasks.workunit.client.0.smithi042.stdout:5/846: dwrite d2/d4/d64/d6a/f73 [0,4194304] 0 2024-09-19T09:41:44.805 INFO:tasks.workunit.client.0.smithi042.stdout:4/855: mknod d0/d28/d36/c120 0 2024-09-19T09:41:44.805 INFO:tasks.workunit.client.0.smithi042.stdout:4/856: readlink d0/d1b/d1c/d2e/d3b/d95/db1/dba/dbd/le5 0 2024-09-19T09:41:44.805 INFO:tasks.workunit.client.0.smithi042.stdout:4/857: getdents d0/d1b/d1c/d2e/d44/dc1 0 2024-09-19T09:41:44.806 INFO:tasks.workunit.client.0.smithi042.stdout:9/711: getdents d8/da 0 2024-09-19T09:41:44.807 INFO:tasks.workunit.client.0.smithi042.stdout:5/847: dread d2/fad [0,4194304] 0 2024-09-19T09:41:44.807 INFO:tasks.workunit.client.0.smithi042.stdout:2/922: rename d7/dd/d22/d30/d66/fe8 to d7/dd/d14/d35/d4e/d9c/f138 0 2024-09-19T09:41:44.808 INFO:tasks.workunit.client.0.smithi042.stdout:9/712: creat d8/da/d19/d1c/d21/dbf/fd2 x:0 0 0 2024-09-19T09:41:44.808 INFO:tasks.workunit.client.0.smithi042.stdout:9/713: chown d8/da/fb8 235469 1 2024-09-19T09:41:44.809 INFO:tasks.workunit.client.0.smithi042.stdout:7/758: rename d0/d3d/l6a to d0/lfa 0 2024-09-19T09:41:44.810 INFO:tasks.workunit.client.0.smithi042.stdout:2/923: mknod d7/dd/d14/d35/d4e/d9c/c139 0 2024-09-19T09:41:44.810 INFO:tasks.workunit.client.0.smithi042.stdout:2/924: chown d7/dd/d14/d35/d45/d5e/f12d 11886 1 2024-09-19T09:41:44.811 INFO:tasks.workunit.client.0.smithi042.stdout:9/714: unlink d8/da/d89/fbc 0 2024-09-19T09:41:44.812 INFO:tasks.workunit.client.0.smithi042.stdout:4/858: rename d0/d1b/d1c/l5e to d0/d1b/d1c/d2e/d44/dc1/l121 0 2024-09-19T09:41:44.813 INFO:tasks.workunit.client.0.smithi042.stdout:2/925: mkdir d7/dd/d1f/d3f/dfa/d13a 0 2024-09-19T09:41:44.813 INFO:tasks.workunit.client.0.smithi042.stdout:5/848: dread d2/d25/f9f [0,4194304] 0 2024-09-19T09:41:44.813 INFO:tasks.workunit.client.0.smithi042.stdout:4/859: creat d0/d1b/d69/f122 x:0 0 0 2024-09-19T09:41:44.814 INFO:tasks.workunit.client.0.smithi042.stdout:2/926: symlink d7/dd/l13b 0 2024-09-19T09:41:44.814 INFO:tasks.workunit.client.0.smithi042.stdout:4/860: chown d0/d1b/f26 9354 1 2024-09-19T09:41:44.816 INFO:tasks.workunit.client.0.smithi042.stdout:4/861: mkdir d0/d1b/d1c/d6a/d123 0 2024-09-19T09:41:44.816 INFO:tasks.workunit.client.0.smithi042.stdout:0/842: dwrite d2/d10/d12/d16/d57/d99/dd0/fb4 [0,4194304] 0 2024-09-19T09:41:44.817 INFO:tasks.workunit.client.0.smithi042.stdout:0/843: write d2/d10/d12/d16/d57/f6a [90556,55558] 0 2024-09-19T09:41:44.817 INFO:tasks.workunit.client.0.smithi042.stdout:0/844: read - d2/d10/fd2 zero size 2024-09-19T09:41:44.817 INFO:tasks.workunit.client.0.smithi042.stdout:0/845: fsync d2/d10/d12/d16/d57/d99/dd0/da5/d8a/fd6 0 2024-09-19T09:41:44.818 INFO:tasks.workunit.client.0.smithi042.stdout:4/862: creat d0/d1b/dd8/f124 x:0 0 0 2024-09-19T09:41:44.819 INFO:tasks.workunit.client.0.smithi042.stdout:9/715: dread d8/da/d89/da7/db6/db5/d87/dad/fb0 [0,4194304] 0 2024-09-19T09:41:44.821 INFO:tasks.workunit.client.0.smithi042.stdout:4/863: unlink d0/d28/d87/f8d 0 2024-09-19T09:41:44.821 INFO:tasks.workunit.client.0.smithi042.stdout:4/864: write d0/d28/d87/da1/d11b/d5a/f5b [7426192,49811] 0 2024-09-19T09:41:44.822 INFO:tasks.workunit.client.0.smithi042.stdout:4/865: symlink d0/d28/d87/da1/d11b/d6e/da0/l125 0 2024-09-19T09:41:44.824 INFO:tasks.workunit.client.0.smithi042.stdout:4/866: unlink d0/f6c 0 2024-09-19T09:41:44.825 INFO:tasks.workunit.client.0.smithi042.stdout:7/759: dwrite d0/d14/d3a/ddc/d9b/ff4 [0,4194304] 0 2024-09-19T09:41:44.825 INFO:tasks.workunit.client.0.smithi042.stdout:2/927: dread d7/d9b/fb5 [0,4194304] 0 2024-09-19T09:41:44.837 INFO:tasks.workunit.client.0.smithi042.stdout:0/846: dwrite d2/d10/d6b/fb0 [0,4194304] 0 2024-09-19T09:41:44.839 INFO:tasks.workunit.client.0.smithi042.stdout:0/847: creat d2/d10/da1/df2/f10a x:0 0 0 2024-09-19T09:41:44.847 INFO:tasks.workunit.client.0.smithi042.stdout:0/848: read d2/d8e/f4c [1257652,74005] 0 2024-09-19T09:41:44.848 INFO:tasks.workunit.client.0.smithi042.stdout:0/849: link d2/d10/d12/fcf d2/d10/d12/d16/f10b 0 2024-09-19T09:41:44.848 INFO:tasks.workunit.client.0.smithi042.stdout:0/850: fsync d2/d10/d12/d16/f5e 0 2024-09-19T09:41:44.849 INFO:tasks.workunit.client.0.smithi042.stdout:0/851: rmdir d2/d10/d12/d24/dbd 39 2024-09-19T09:41:44.850 INFO:tasks.workunit.client.0.smithi042.stdout:0/852: getdents d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a 0 2024-09-19T09:41:44.850 INFO:tasks.workunit.client.0.smithi042.stdout:2/928: dwrite d7/dd/d14/dec/ff9 [0,4194304] 0 2024-09-19T09:41:44.851 INFO:tasks.workunit.client.0.smithi042.stdout:2/929: chown d7/dd/d14/d35/ff5 2686 1 2024-09-19T09:41:44.851 INFO:tasks.workunit.client.0.smithi042.stdout:7/760: dwrite d0/d40/d9d/ff8 [0,4194304] 0 2024-09-19T09:41:44.851 INFO:tasks.workunit.client.0.smithi042.stdout:2/930: truncate d7/dd/d14/dec/ffb 870417 0 2024-09-19T09:41:44.851 INFO:tasks.workunit.client.0.smithi042.stdout:7/761: fdatasync d0/d14/d3a/f8a 0 2024-09-19T09:41:44.851 INFO:tasks.workunit.client.0.smithi042.stdout:2/931: write d7/d9b/fb5 [1577060,126806] 0 2024-09-19T09:41:44.851 INFO:tasks.workunit.client.0.smithi042.stdout:2/932: write d7/dd/d14/d35/d4e/d63/dd6/f10d [294549,68983] 0 2024-09-19T09:41:44.851 INFO:tasks.workunit.client.0.smithi042.stdout:2/933: fdatasync d7/dd/d14/d35/d4e/d9c/fae 0 2024-09-19T09:41:44.851 INFO:tasks.workunit.client.0.smithi042.stdout:4/867: dwrite d0/d1b/f90 [0,4194304] 0 2024-09-19T09:41:44.851 INFO:tasks.workunit.client.0.smithi042.stdout:5/849: dwrite d2/d4/fd5 [4194304,4194304] 0 2024-09-19T09:41:44.851 INFO:tasks.workunit.client.0.smithi042.stdout:5/850: fsync d2/d4/d20/d60/d72/f65 0 2024-09-19T09:41:44.852 INFO:tasks.workunit.client.0.smithi042.stdout:0/853: creat d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/d9f/f10c x:0 0 0 2024-09-19T09:41:44.853 INFO:tasks.workunit.client.0.smithi042.stdout:7/762: truncate d0/d40/f6c 354942 0 2024-09-19T09:41:44.853 INFO:tasks.workunit.client.0.smithi042.stdout:7/763: chown d0/fbe 1 1 2024-09-19T09:41:44.854 INFO:tasks.workunit.client.0.smithi042.stdout:7/764: fsync d0/d14/d3a/ddc/fd5 0 2024-09-19T09:41:44.861 INFO:tasks.workunit.client.0.smithi042.stdout:7/765: dread d0/f36 [0,4194304] 0 2024-09-19T09:41:44.864 INFO:tasks.workunit.client.0.smithi042.stdout:7/766: creat d0/d14/d3a/ddc/db6/dbb/ffb x:0 0 0 2024-09-19T09:41:44.864 INFO:tasks.workunit.client.0.smithi042.stdout:4/868: dread d0/d28/d36/d91/f113 [0,4194304] 0 2024-09-19T09:41:44.864 INFO:tasks.workunit.client.0.smithi042.stdout:4/869: write d0/d1b/d1c/db8/fc3 [2168108,21600] 0 2024-09-19T09:41:44.864 INFO:tasks.workunit.client.0.smithi042.stdout:4/870: chown d0/d28/d87/l98 79 1 2024-09-19T09:41:44.864 INFO:tasks.workunit.client.0.smithi042.stdout:4/871: fsync d0/f5 0 2024-09-19T09:41:44.865 INFO:tasks.workunit.client.0.smithi042.stdout:7/767: creat d0/d3d/ffc x:0 0 0 2024-09-19T09:41:44.866 INFO:tasks.workunit.client.0.smithi042.stdout:5/851: dread d2/d4/f78 [0,4194304] 0 2024-09-19T09:41:44.866 INFO:tasks.workunit.client.0.smithi042.stdout:4/872: mknod d0/d28/d36/c126 0 2024-09-19T09:41:44.866 INFO:tasks.workunit.client.0.smithi042.stdout:4/873: fdatasync d0/d28/d87/da1/d11b/d6e/da0/f118 0 2024-09-19T09:41:44.868 INFO:tasks.workunit.client.0.smithi042.stdout:5/852: symlink d2/d25/l11f 0 2024-09-19T09:41:44.869 INFO:tasks.workunit.client.0.smithi042.stdout:5/853: rmdir d2/d25/d37/dc2 39 2024-09-19T09:41:44.871 INFO:tasks.workunit.client.0.smithi042.stdout:5/854: creat d2/d4/d64/f120 x:0 0 0 2024-09-19T09:41:44.871 INFO:tasks.workunit.client.0.smithi042.stdout:5/855: symlink d2/d4/d64/dab/l121 0 2024-09-19T09:41:44.872 INFO:tasks.workunit.client.0.smithi042.stdout:5/856: rename d2/d4/d20/da4/dde/l106 to d2/d8e/l122 0 2024-09-19T09:41:44.873 INFO:tasks.workunit.client.0.smithi042.stdout:2/934: dwrite d7/dd/d14/d35/d4c/fcb [12582912,4194304] 0 2024-09-19T09:41:44.873 INFO:tasks.workunit.client.0.smithi042.stdout:0/854: dwrite d2/d10/d12/d24/dc0/f104 [0,4194304] 0 2024-09-19T09:41:44.873 INFO:tasks.workunit.client.0.smithi042.stdout:0/855: read - d2/d10/d12/d16/d57/d78/f108 zero size 2024-09-19T09:41:44.876 INFO:tasks.workunit.client.0.smithi042.stdout:2/935: mkdir d7/dd/d14/d35/d45/d13c 0 2024-09-19T09:41:44.882 INFO:tasks.workunit.client.0.smithi042.stdout:4/874: rmdir d0/d1b/d1c/d6a 39 2024-09-19T09:41:44.882 INFO:tasks.workunit.client.0.smithi042.stdout:4/875: write d0/d1b/d1c/d2e/ffd [770043,9662] 0 2024-09-19T09:41:44.889 INFO:tasks.workunit.client.0.smithi042.stdout:7/768: dread d0/d14/f4e [0,4194304] 0 2024-09-19T09:41:44.891 INFO:tasks.workunit.client.0.smithi042.stdout:7/769: creat d0/d40/d9d/dd7/ffd x:0 0 0 2024-09-19T09:41:44.896 INFO:tasks.workunit.client.0.smithi042.stdout:2/936: rename d7/dd/d14/d35/d4c/d70/d136/dc7/d88/f95 to d7/dd/d22/d30/f13d 0 2024-09-19T09:41:44.898 INFO:tasks.workunit.client.0.smithi042.stdout:2/937: symlink d7/dd/d1f/d3f/dfa/d102/l13e 0 2024-09-19T09:41:44.899 INFO:tasks.workunit.client.0.smithi042.stdout:6/883: sync 2024-09-19T09:41:44.899 INFO:tasks.workunit.client.0.smithi042.stdout:2/938: mknod d7/dd/d1f/d3f/c13f 0 2024-09-19T09:41:44.899 INFO:tasks.workunit.client.0.smithi042.stdout:2/939: fsync d7/f98 0 2024-09-19T09:41:44.899 INFO:tasks.workunit.client.0.smithi042.stdout:5/857: dwrite d2/d4/f56 [0,4194304] 0 2024-09-19T09:41:44.899 INFO:tasks.workunit.client.0.smithi042.stdout:5/858: write d2/d4/d64/d110/f113 [62313,73108] 0 2024-09-19T09:41:44.900 INFO:tasks.workunit.client.0.smithi042.stdout:7/770: dread d0/d14/d3a/ddc/fc2 [0,4194304] 0 2024-09-19T09:41:44.900 INFO:tasks.workunit.client.0.smithi042.stdout:2/940: truncate d7/dd/d14/d35/d4e/f9d 3054109 0 2024-09-19T09:41:44.900 INFO:tasks.workunit.client.0.smithi042.stdout:7/771: mkdir d0/d14/d3a/ddc/db6/dbb/dcc/dfe 0 2024-09-19T09:41:44.905 INFO:tasks.workunit.client.0.smithi042.stdout:5/859: write d2/d4/d20/fc9 [4026052,1007] 0 2024-09-19T09:41:44.906 INFO:tasks.workunit.client.0.smithi042.stdout:4/876: dwrite d0/d28/d87/da1/d11b/f107 [0,4194304] 0 2024-09-19T09:41:44.909 INFO:tasks.workunit.client.0.smithi042.stdout:0/856: dwrite d2/d10/d12/d16/d57/d99/dd0/fb4 [0,4194304] 0 2024-09-19T09:41:44.909 INFO:tasks.workunit.client.0.smithi042.stdout:2/941: unlink d7/dd/d14/d35/d4c/fcb 0 2024-09-19T09:41:44.909 INFO:tasks.workunit.client.0.smithi042.stdout:2/942: read d7/dd/f47 [588598,3565] 0 2024-09-19T09:41:44.909 INFO:tasks.workunit.client.0.smithi042.stdout:2/943: readlink d7/l6d 0 2024-09-19T09:41:44.911 INFO:tasks.workunit.client.0.smithi042.stdout:5/860: unlink d2/d25/c5c 0 2024-09-19T09:41:44.916 INFO:tasks.workunit.client.0.smithi042.stdout:5/861: mknod d2/d4/d20/d60/c123 0 2024-09-19T09:41:44.916 INFO:tasks.workunit.client.0.smithi042.stdout:5/862: truncate d2/d4/d64/da7/faa 1305755 0 2024-09-19T09:41:44.919 INFO:tasks.workunit.client.0.smithi042.stdout:5/863: mknod d2/d4/d20/d31/c124 0 2024-09-19T09:41:44.921 INFO:tasks.workunit.client.0.smithi042.stdout:5/864: write d2/d4/d20/d60/d72/f65 [219268,29744] 0 2024-09-19T09:41:44.924 INFO:tasks.workunit.client.0.smithi042.stdout:6/884: dwrite d1/d20/d6a/fdf [0,4194304] 0 2024-09-19T09:41:44.926 INFO:tasks.workunit.client.0.smithi042.stdout:2/944: dread d7/dd/d22/f32 [4194304,4194304] 0 2024-09-19T09:41:44.926 INFO:tasks.workunit.client.0.smithi042.stdout:6/885: getdents d1/de/d76/d99/db2/d34/d6f/d93 0 2024-09-19T09:41:44.927 INFO:tasks.workunit.client.0.smithi042.stdout:6/886: truncate d1/de/d76/f7a 4511893 0 2024-09-19T09:41:44.927 INFO:tasks.workunit.client.0.smithi042.stdout:3/937: sync 2024-09-19T09:41:44.927 INFO:tasks.workunit.client.0.smithi042.stdout:3/938: read - d4/d8/fe5 zero size 2024-09-19T09:41:44.927 INFO:tasks.workunit.client.0.smithi042.stdout:1/948: sync 2024-09-19T09:41:44.927 INFO:tasks.workunit.client.0.smithi042.stdout:8/925: sync 2024-09-19T09:41:44.927 INFO:tasks.workunit.client.0.smithi042.stdout:8/926: chown d1/c34 648 1 2024-09-19T09:41:44.927 INFO:tasks.workunit.client.0.smithi042.stdout:9/716: sync 2024-09-19T09:41:44.927 INFO:tasks.workunit.client.0.smithi042.stdout:3/939: symlink d4/d8/d4c/d6b/l130 0 2024-09-19T09:41:44.928 INFO:tasks.workunit.client.0.smithi042.stdout:1/949: symlink d4/d15/d19/d45/d82/d89/d126/dda/d12d/l133 0 2024-09-19T09:41:44.929 INFO:tasks.workunit.client.0.smithi042.stdout:8/927: mkdir d1/da8/d3d/d58/dd1/d114 0 2024-09-19T09:41:44.930 INFO:tasks.workunit.client.0.smithi042.stdout:9/717: creat d8/da/d19/fd3 x:0 0 0 2024-09-19T09:41:44.930 INFO:tasks.workunit.client.0.smithi042.stdout:6/887: dread d1/d20/dc6/fdb [0,4194304] 0 2024-09-19T09:41:44.931 INFO:tasks.workunit.client.0.smithi042.stdout:9/718: creat d8/d32/fd4 x:0 0 0 2024-09-19T09:41:44.932 INFO:tasks.workunit.client.0.smithi042.stdout:4/877: dwrite d0/d28/d87/da1/d11b/d5a/f75 [0,4194304] 0 2024-09-19T09:41:44.933 INFO:tasks.workunit.client.0.smithi042.stdout:4/878: dread - d0/d1b/d1c/d61/d7f/fe3 zero size 2024-09-19T09:41:44.933 INFO:tasks.workunit.client.0.smithi042.stdout:7/772: dwrite d0/d14/d3a/f7e [0,4194304] 0 2024-09-19T09:41:44.934 INFO:tasks.workunit.client.0.smithi042.stdout:9/719: link d8/da/d19/d1c/d21/d67/d7b/fd0 d8/da/d19/d1c/d21/dbf/fd5 0 2024-09-19T09:41:44.934 INFO:tasks.workunit.client.0.smithi042.stdout:3/940: write d4/d8/d9/d1b/fd1 [208423,18573] 0 2024-09-19T09:41:44.934 INFO:tasks.workunit.client.0.smithi042.stdout:3/941: write d4/d8/d9/f1e [5075128,56756] 0 2024-09-19T09:41:44.935 INFO:tasks.workunit.client.0.smithi042.stdout:0/857: rename d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/d9f/f10c to d2/d10/d12/d16/d57/d99/dd0/f10d 0 2024-09-19T09:41:44.937 INFO:tasks.workunit.client.0.smithi042.stdout:9/720: mkdir d8/d1d/dd6 0 2024-09-19T09:41:44.941 INFO:tasks.workunit.client.0.smithi042.stdout:5/865: rename d2/d4/l16 to d2/d4/d20/d60/db0/l125 0 2024-09-19T09:41:44.941 INFO:tasks.workunit.client.0.smithi042.stdout:0/858: dread d2/d8e/d32/f83 [0,4194304] 0 2024-09-19T09:41:44.943 INFO:tasks.workunit.client.0.smithi042.stdout:3/942: dread d4/d8/d9/d115/d82/d48/dc3/fef [0,4194304] 0 2024-09-19T09:41:44.943 INFO:tasks.workunit.client.0.smithi042.stdout:3/943: fsync d4/d8/d4c/d6b/db9/dcb/deb/ff7 0 2024-09-19T09:41:44.943 INFO:tasks.workunit.client.0.smithi042.stdout:0/859: symlink d2/d10/d12/d24/dc0/l10e 0 2024-09-19T09:41:44.944 INFO:tasks.workunit.client.0.smithi042.stdout:5/866: mknod d2/db/c126 0 2024-09-19T09:41:44.945 INFO:tasks.workunit.client.0.smithi042.stdout:2/945: write d7/dd/d14/f1d [1165256,104096] 0 2024-09-19T09:41:44.946 INFO:tasks.workunit.client.0.smithi042.stdout:3/944: creat d4/d8/d4c/d6b/db9/f131 x:0 0 0 2024-09-19T09:41:44.948 INFO:tasks.workunit.client.0.smithi042.stdout:5/867: mknod d2/d4/d2e/c127 0 2024-09-19T09:41:44.949 INFO:tasks.workunit.client.0.smithi042.stdout:8/928: dread d1/da8/d41/d55/d99/da4/f6d [0,4194304] 0 2024-09-19T09:41:44.949 INFO:tasks.workunit.client.0.smithi042.stdout:0/860: dread d2/d10/d12/fe2 [0,4194304] 0 2024-09-19T09:41:44.949 INFO:tasks.workunit.client.0.smithi042.stdout:2/946: truncate d7/dd/d14/d35/d45/d5e/f39 11681 0 2024-09-19T09:41:44.950 INFO:tasks.workunit.client.0.smithi042.stdout:2/947: fsync d7/dd/d14/dec/ff9 0 2024-09-19T09:41:44.951 INFO:tasks.workunit.client.0.smithi042.stdout:8/929: symlink d1/da8/db1/l115 0 2024-09-19T09:41:44.952 INFO:tasks.workunit.client.0.smithi042.stdout:2/948: mkdir d7/dd/d1f/d3f/dfa/d140 0 2024-09-19T09:41:44.952 INFO:tasks.workunit.client.0.smithi042.stdout:5/868: dread d2/d4/d20/d60/d72/f84 [0,4194304] 0 2024-09-19T09:41:44.960 INFO:tasks.workunit.client.0.smithi042.stdout:2/949: dread d7/dd/d1f/d3f/f69 [0,4194304] 0 2024-09-19T09:41:44.960 INFO:tasks.workunit.client.0.smithi042.stdout:6/888: dwrite d1/de/d76/d99/db2/d34/d6f/dbe/fe8 [0,4194304] 0 2024-09-19T09:41:44.962 INFO:tasks.workunit.client.0.smithi042.stdout:6/889: rmdir d1/d20/d6a/d46/d92/d3a 39 2024-09-19T09:41:44.962 INFO:tasks.workunit.client.0.smithi042.stdout:2/950: mknod d7/dd/d48/c141 0 2024-09-19T09:41:44.967 INFO:tasks.workunit.client.0.smithi042.stdout:3/945: write d4/d8/f19 [6553723,24472] 0 2024-09-19T09:41:44.967 INFO:tasks.workunit.client.0.smithi042.stdout:1/950: write d4/d15/d19/d45/d82/d89/d126/dd0/ffc [8211819,81829] 0 2024-09-19T09:41:44.969 INFO:tasks.workunit.client.0.smithi042.stdout:1/951: write d4/d15/d2e/fa4 [189447,54461] 0 2024-09-19T09:41:44.969 INFO:tasks.workunit.client.0.smithi042.stdout:1/952: chown d4/d15/d19/d45/f100 29 1 2024-09-19T09:41:44.969 INFO:tasks.workunit.client.0.smithi042.stdout:1/953: truncate d4/d15/d19/d45/d82/d89/d126/dd0/ffd 977455 0 2024-09-19T09:41:44.970 INFO:tasks.workunit.client.0.smithi042.stdout:1/954: symlink d4/d15/d2e/d105/l134 0 2024-09-19T09:41:44.971 INFO:tasks.workunit.client.0.smithi042.stdout:4/879: rename d0/d1b/dd8/d11f/fe8 to d0/d67/d96/f127 0 2024-09-19T09:41:44.972 INFO:tasks.workunit.client.0.smithi042.stdout:1/955: symlink d4/d15/d61/d85/l135 0 2024-09-19T09:41:44.974 INFO:tasks.workunit.client.0.smithi042.stdout:1/956: read - d4/d1e/f8e zero size 2024-09-19T09:41:44.975 INFO:tasks.workunit.client.0.smithi042.stdout:1/957: mkdir d4/d15/d61/d85/dc9/de8/d110/d136 0 2024-09-19T09:41:44.976 INFO:tasks.workunit.client.0.smithi042.stdout:9/721: dwrite d8/db/d31/fcb [0,4194304] 0 2024-09-19T09:41:44.976 INFO:tasks.workunit.client.0.smithi042.stdout:1/958: creat d4/d15/d61/d85/dc9/de8/d110/d136/f137 x:0 0 0 2024-09-19T09:41:44.980 INFO:tasks.workunit.client.0.smithi042.stdout:9/722: rename d8/d32/l9b to d8/db/ld7 0 2024-09-19T09:41:44.980 INFO:tasks.workunit.client.0.smithi042.stdout:4/880: dread d0/d1b/d1c/f1f [0,4194304] 0 2024-09-19T09:41:44.982 INFO:tasks.workunit.client.0.smithi042.stdout:4/881: rmdir d0/d1b/d56 39 2024-09-19T09:41:44.984 INFO:tasks.workunit.client.0.smithi042.stdout:0/861: write d2/d10/d6b/fb0 [876834,70189] 0 2024-09-19T09:41:44.985 INFO:tasks.workunit.client.0.smithi042.stdout:4/882: unlink d0/d1b/d1c/d2e/lf4 0 2024-09-19T09:41:44.986 INFO:tasks.workunit.client.0.smithi042.stdout:6/890: dread d1/de/d76/d99/db2/d34/d6f/d4a/f83 [4194304,4194304] 0 2024-09-19T09:41:44.986 INFO:tasks.workunit.client.0.smithi042.stdout:7/773: dwrite d0/fbf [0,4194304] 0 2024-09-19T09:41:44.986 INFO:tasks.workunit.client.0.smithi042.stdout:7/774: chown d0/d14/d3c/lb9 0 1 2024-09-19T09:41:44.988 INFO:tasks.workunit.client.0.smithi042.stdout:8/930: dwrite d1/da8/d3d/d58/fab [0,4194304] 0 2024-09-19T09:41:44.988 INFO:tasks.workunit.client.0.smithi042.stdout:8/931: write d1/db2/fd4 [562209,14192] 0 2024-09-19T09:41:44.988 INFO:tasks.workunit.client.0.smithi042.stdout:5/869: dwrite d2/d4/d64/f120 [0,4194304] 0 2024-09-19T09:41:44.989 INFO:tasks.workunit.client.0.smithi042.stdout:4/883: readlink d0/d1b/d56/lcb 0 2024-09-19T09:41:44.989 INFO:tasks.workunit.client.0.smithi042.stdout:4/884: read - d0/d67/d96/f127 zero size 2024-09-19T09:41:44.991 INFO:tasks.workunit.client.0.smithi042.stdout:3/946: dwrite d4/d8/d9/dc/f59 [0,4194304] 0 2024-09-19T09:41:44.993 INFO:tasks.workunit.client.0.smithi042.stdout:4/885: dread d0/f5 [0,4194304] 0 2024-09-19T09:41:44.993 INFO:tasks.workunit.client.0.smithi042.stdout:4/886: chown d0/d1b/d56/d86 4 1 2024-09-19T09:41:44.994 INFO:tasks.workunit.client.0.smithi042.stdout:7/775: mkdir d0/d14/d3a/ddc/db6/dbb/dff 0 2024-09-19T09:41:44.994 INFO:tasks.workunit.client.0.smithi042.stdout:4/887: mknod d0/d1b/d1c/d6a/d123/c128 0 2024-09-19T09:41:44.995 INFO:tasks.workunit.client.0.smithi042.stdout:3/947: creat d4/d78/f132 x:0 0 0 2024-09-19T09:41:45.001 INFO:tasks.workunit.client.0.smithi042.stdout:7/776: rename d0/f5 to d0/d3d/db0/f100 0 2024-09-19T09:41:45.001 INFO:tasks.workunit.client.0.smithi042.stdout:7/777: fdatasync d0/d3d/d85/f8b 0 2024-09-19T09:41:45.005 INFO:tasks.workunit.client.0.smithi042.stdout:4/888: mkdir d0/d1b/d1c/d2e/d44/dc1/d129 0 2024-09-19T09:41:45.007 INFO:tasks.workunit.client.0.smithi042.stdout:3/948: creat d4/d78/d9d/f133 x:0 0 0 2024-09-19T09:41:45.007 INFO:tasks.workunit.client.0.smithi042.stdout:6/891: write d1/de/d76/d99/db2/d34/f73 [3432068,55748] 0 2024-09-19T09:41:45.007 INFO:tasks.workunit.client.0.smithi042.stdout:2/951: dwrite d7/dd/d14/d35/d4c/d70/d136/dc7/fee [0,4194304] 0 2024-09-19T09:41:45.008 INFO:tasks.workunit.client.0.smithi042.stdout:2/952: mkdir d7/dd/d14/d35/d45/d5e/d79/d118/d142 0 2024-09-19T09:41:45.012 INFO:tasks.workunit.client.0.smithi042.stdout:5/870: stat d2/d4/d64 0 2024-09-19T09:41:45.012 INFO:tasks.workunit.client.0.smithi042.stdout:6/892: rmdir d1/de/d54/dcb 39 2024-09-19T09:41:45.012 INFO:tasks.workunit.client.0.smithi042.stdout:1/959: dwrite d4/d29/f38 [0,4194304] 0 2024-09-19T09:41:45.013 INFO:tasks.workunit.client.0.smithi042.stdout:1/960: write d4/d15/d19/d45/d82/d89/d126/dda/f2b [1264508,59302] 0 2024-09-19T09:41:45.015 INFO:tasks.workunit.client.0.smithi042.stdout:4/889: rename d0/d1b/f1e to d0/d28/d87/da1/d11b/d6e/da0/f12a 0 2024-09-19T09:41:45.018 INFO:tasks.workunit.client.0.smithi042.stdout:5/871: symlink d2/d4/d20/d60/d72/d75/d10d/l128 0 2024-09-19T09:41:45.020 INFO:tasks.workunit.client.0.smithi042.stdout:6/893: symlink d1/de/d76/d99/db2/d34/d6f/d4a/l114 0 2024-09-19T09:41:45.020 INFO:tasks.workunit.client.0.smithi042.stdout:9/723: dwrite d8/d1d/d28/f43 [4194304,4194304] 0 2024-09-19T09:41:45.020 INFO:tasks.workunit.client.0.smithi042.stdout:8/932: dwrite d1/da8/d41/d55/f6b [0,4194304] 0 2024-09-19T09:41:45.021 INFO:tasks.workunit.client.0.smithi042.stdout:7/778: dread d0/d14/d3a/ddc/d9b/ff4 [0,4194304] 0 2024-09-19T09:41:45.021 INFO:tasks.workunit.client.0.smithi042.stdout:1/961: dread d4/d15/d2e/fa4 [0,4194304] 0 2024-09-19T09:41:45.024 INFO:tasks.workunit.client.0.smithi042.stdout:4/890: symlink d0/d1b/d1c/d2e/d3b/d95/db1/l12b 0 2024-09-19T09:41:45.026 INFO:tasks.workunit.client.0.smithi042.stdout:9/724: link d8/c18 d8/d32/cd8 0 2024-09-19T09:41:45.026 INFO:tasks.workunit.client.0.smithi042.stdout:7/779: creat d0/d14/d44/d47/f101 x:0 0 0 2024-09-19T09:41:45.027 INFO:tasks.workunit.client.0.smithi042.stdout:1/962: mkdir d4/d15/d19/dae/d124/d138 0 2024-09-19T09:41:45.027 INFO:tasks.workunit.client.0.smithi042.stdout:1/963: dread - d4/d1e/ff1 zero size 2024-09-19T09:41:45.027 INFO:tasks.workunit.client.0.smithi042.stdout:5/872: mkdir d2/d4/d64/d129 0 2024-09-19T09:41:45.028 INFO:tasks.workunit.client.0.smithi042.stdout:3/949: dwrite d4/d8/d9/d115/ff9 [0,4194304] 0 2024-09-19T09:41:45.028 INFO:tasks.workunit.client.0.smithi042.stdout:3/950: dread - d4/d8/d9/d39/d4b/f54 zero size 2024-09-19T09:41:45.028 INFO:tasks.workunit.client.0.smithi042.stdout:8/933: dread d1/da/d14/f1a [0,4194304] 0 2024-09-19T09:41:45.028 INFO:tasks.workunit.client.0.smithi042.stdout:4/891: mknod d0/d28/d36/d91/d110/c12c 0 2024-09-19T09:41:45.028 INFO:tasks.workunit.client.0.smithi042.stdout:8/934: fsync d1/da8/d3d/d58/f82 0 2024-09-19T09:41:45.029 INFO:tasks.workunit.client.0.smithi042.stdout:4/892: write d0/d28/d36/fcc [840166,46044] 0 2024-09-19T09:41:45.029 INFO:tasks.workunit.client.0.smithi042.stdout:6/894: mknod d1/de/d76/d99/db2/c115 0 2024-09-19T09:41:45.030 INFO:tasks.workunit.client.0.smithi042.stdout:1/964: symlink d4/d15/d44/l139 0 2024-09-19T09:41:45.030 INFO:tasks.workunit.client.0.smithi042.stdout:1/965: dread - d4/d15/d19/dae/f109 zero size 2024-09-19T09:41:45.030 INFO:tasks.workunit.client.0.smithi042.stdout:5/873: mknod d2/d4/d20/d60/db0/c12a 0 2024-09-19T09:41:45.033 INFO:tasks.workunit.client.0.smithi042.stdout:3/951: rename d4/d8/d9/d115/d82/d48/f5a to d4/d8/d9/d115/d82/d8c/d104/d125/f134 0 2024-09-19T09:41:45.033 INFO:tasks.workunit.client.0.smithi042.stdout:9/725: dread d8/f3d [0,4194304] 0 2024-09-19T09:41:45.034 INFO:tasks.workunit.client.0.smithi042.stdout:8/935: unlink d1/da/d3f/f50 0 2024-09-19T09:41:45.035 INFO:tasks.workunit.client.0.smithi042.stdout:8/936: write d1/da8/f54 [3467722,25627] 0 2024-09-19T09:41:45.035 INFO:tasks.workunit.client.0.smithi042.stdout:4/893: mknod d0/d28/d87/c12d 0 2024-09-19T09:41:45.036 INFO:tasks.workunit.client.0.smithi042.stdout:4/894: fdatasync d0/d28/d36/d91/f113 0 2024-09-19T09:41:45.037 INFO:tasks.workunit.client.0.smithi042.stdout:4/895: chown d0/d1b/f41 54 1 2024-09-19T09:41:45.037 INFO:tasks.workunit.client.0.smithi042.stdout:4/896: truncate d0/d1b/d69/dc0/f100 359324 0 2024-09-19T09:41:45.037 INFO:tasks.workunit.client.0.smithi042.stdout:1/966: truncate d4/fa5 2223540 0 2024-09-19T09:41:45.037 INFO:tasks.workunit.client.0.smithi042.stdout:3/952: mknod d4/d8/d9/dc/dbf/d35/c135 0 2024-09-19T09:41:45.037 INFO:tasks.workunit.client.0.smithi042.stdout:3/953: write d4/d8/d9/d1b/fb8 [418504,88980] 0 2024-09-19T09:41:45.039 INFO:tasks.workunit.client.0.smithi042.stdout:9/726: creat d8/da/d19/d1c/d21/d67/d7b/fd9 x:0 0 0 2024-09-19T09:41:45.039 INFO:tasks.workunit.client.0.smithi042.stdout:9/727: write d8/da/d89/da7/fbe [127581,119491] 0 2024-09-19T09:41:45.039 INFO:tasks.workunit.client.0.smithi042.stdout:4/897: mknod d0/d1b/d1c/d2e/d44/c12e 0 2024-09-19T09:41:45.041 INFO:tasks.workunit.client.0.smithi042.stdout:1/967: symlink d4/d29/l13a 0 2024-09-19T09:41:45.041 INFO:tasks.workunit.client.0.smithi042.stdout:1/968: chown d4/d15/d2e/db7/c77 1106117601 1 2024-09-19T09:41:45.043 INFO:tasks.workunit.client.0.smithi042.stdout:9/728: mknod d8/da/d89/da7/cda 0 2024-09-19T09:41:45.043 INFO:tasks.workunit.client.0.smithi042.stdout:9/729: chown d8/d1d/d28/fca 48 1 2024-09-19T09:41:45.043 INFO:tasks.workunit.client.0.smithi042.stdout:9/730: write d8/db/d31/f97 [790313,118233] 0 2024-09-19T09:41:45.048 INFO:tasks.workunit.client.0.smithi042.stdout:3/954: symlink d4/d8/l136 0 2024-09-19T09:41:45.048 INFO:tasks.workunit.client.0.smithi042.stdout:3/955: write d4/d8/f36 [2990068,67974] 0 2024-09-19T09:41:45.051 INFO:tasks.workunit.client.0.smithi042.stdout:9/731: mknod d8/db/db1/cdb 0 2024-09-19T09:41:45.051 INFO:tasks.workunit.client.0.smithi042.stdout:9/732: fsync d8/d1d/faf 0 2024-09-19T09:41:45.053 INFO:tasks.workunit.client.0.smithi042.stdout:8/937: truncate d1/da/d14/f17 3878939 0 2024-09-19T09:41:45.054 INFO:tasks.workunit.client.0.smithi042.stdout:3/956: symlink d4/d8/d4c/d6b/l137 0 2024-09-19T09:41:45.055 INFO:tasks.workunit.client.0.smithi042.stdout:6/895: dwrite d1/d20/dc6/fdb [0,4194304] 0 2024-09-19T09:41:45.056 INFO:tasks.workunit.client.0.smithi042.stdout:3/957: mkdir d4/d8/d9/d115/d82/d8c/d9f/d138 0 2024-09-19T09:41:45.056 INFO:tasks.workunit.client.0.smithi042.stdout:7/780: dwrite d0/d3d/d85/f8b [0,4194304] 0 2024-09-19T09:41:45.057 INFO:tasks.workunit.client.0.smithi042.stdout:7/781: readlink d0/d14/l29 0 2024-09-19T09:41:45.057 INFO:tasks.workunit.client.0.smithi042.stdout:7/782: dread - d0/d14/d3a/ddc/fd5 zero size 2024-09-19T09:41:45.059 INFO:tasks.workunit.client.0.smithi042.stdout:6/896: unlink d1/de/d76/d99/db2/d34/d3f/f50 0 2024-09-19T09:41:45.061 INFO:tasks.workunit.client.0.smithi042.stdout:7/783: creat d0/d14/d44/f102 x:0 0 0 2024-09-19T09:41:45.061 INFO:tasks.workunit.client.0.smithi042.stdout:7/784: write d0/d56/f88 [553983,127944] 0 2024-09-19T09:41:45.061 INFO:tasks.workunit.client.0.smithi042.stdout:7/785: dread - d0/d3d/d85/d99/ff2 zero size 2024-09-19T09:41:45.061 INFO:tasks.workunit.client.0.smithi042.stdout:4/898: dwrite d0/f15 [8388608,4194304] 0 2024-09-19T09:41:45.067 INFO:tasks.workunit.client.0.smithi042.stdout:9/733: read d8/db/f26 [1407884,104989] 0 2024-09-19T09:41:45.067 INFO:tasks.workunit.client.0.smithi042.stdout:9/734: write d8/da/f50 [2439114,56143] 0 2024-09-19T09:41:45.069 INFO:tasks.workunit.client.0.smithi042.stdout:7/786: link d0/d14/c7b d0/d3d/db0/c103 0 2024-09-19T09:41:45.071 INFO:tasks.workunit.client.0.smithi042.stdout:1/969: link d4/d1e/d25/c10b d4/d15/d61/d85/dc9/c13b 0 2024-09-19T09:41:45.071 INFO:tasks.workunit.client.0.smithi042.stdout:1/970: truncate d4/d15/d2e/d105/f132 931339 0 2024-09-19T09:41:45.071 INFO:tasks.workunit.client.0.smithi042.stdout:1/971: readlink d4/d15/d2e/ldb 0 2024-09-19T09:41:45.071 INFO:tasks.workunit.client.0.smithi042.stdout:1/972: write d4/d15/d19/fec [2875703,32474] 0 2024-09-19T09:41:45.071 INFO:tasks.workunit.client.0.smithi042.stdout:1/973: getdents d4/d15/d2e/db7/d3c/d122 0 2024-09-19T09:41:45.074 INFO:tasks.workunit.client.0.smithi042.stdout:3/958: dread d4/d8/d9/dc/dbf/d35/f51 [0,4194304] 0 2024-09-19T09:41:45.074 INFO:tasks.workunit.client.0.smithi042.stdout:5/874: link d2/d8e/ld6 d2/d4/d64/d110/l12b 0 2024-09-19T09:41:45.075 INFO:tasks.workunit.client.0.smithi042.stdout:1/974: dread d4/d12/d8d/d91/d7f/d99/fc3 [0,4194304] 0 2024-09-19T09:41:45.077 INFO:tasks.workunit.client.0.smithi042.stdout:3/959: creat d4/d8/d9/d1b/f139 x:0 0 0 2024-09-19T09:41:45.077 INFO:tasks.workunit.client.0.smithi042.stdout:3/960: fdatasync d4/d78/d9d/f133 0 2024-09-19T09:41:45.077 INFO:tasks.workunit.client.0.smithi042.stdout:9/735: write d8/f11 [2824312,91917] 0 2024-09-19T09:41:45.077 INFO:tasks.workunit.client.0.smithi042.stdout:9/736: chown d8/da/d19/d1c/d21/d67/d7b/fd9 10496 1 2024-09-19T09:41:45.077 INFO:tasks.workunit.client.0.smithi042.stdout:9/737: write d8/db/d31/f97 [1149660,96160] 0 2024-09-19T09:41:45.078 INFO:tasks.workunit.client.0.smithi042.stdout:9/738: dread - d8/da/d19/d1c/d21/d67/d7b/fd9 zero size 2024-09-19T09:41:45.082 INFO:tasks.workunit.client.0.smithi042.stdout:9/739: write d8/d32/f58 [2386036,2441] 0 2024-09-19T09:41:45.083 INFO:tasks.workunit.client.0.smithi042.stdout:4/899: dwrite d0/d28/fac [0,4194304] 0 2024-09-19T09:41:45.089 INFO:tasks.workunit.client.0.smithi042.stdout:8/938: rename d1/da8/d3d to d1/da/d14/dfc/d116 0 2024-09-19T09:41:45.089 INFO:tasks.workunit.client.0.smithi042.stdout:0/862: sync 2024-09-19T09:41:45.091 INFO:tasks.workunit.client.0.smithi042.stdout:9/740: read d8/d1d/d28/fa4 [88605,73073] 0 2024-09-19T09:41:45.091 INFO:tasks.workunit.client.0.smithi042.stdout:6/897: rename d1/de/d54/dda/f101 to d1/de/d76/de9/f116 0 2024-09-19T09:41:45.091 INFO:tasks.workunit.client.0.smithi042.stdout:6/898: chown d1/f5e 861 1 2024-09-19T09:41:45.091 INFO:tasks.workunit.client.0.smithi042.stdout:6/899: chown d1/de/d76/d99/db2/cb3 250614 1 2024-09-19T09:41:45.092 INFO:tasks.workunit.client.0.smithi042.stdout:9/741: creat d8/d1d/dd6/fdc x:0 0 0 2024-09-19T09:41:45.094 INFO:tasks.workunit.client.0.smithi042.stdout:0/863: rmdir d2/d10/d12/d16/d57/d99/dd0/da5/d8a 39 2024-09-19T09:41:45.097 INFO:tasks.workunit.client.0.smithi042.stdout:3/961: dwrite d4/d8/d4c/d6b/f129 [0,4194304] 0 2024-09-19T09:41:45.097 INFO:tasks.workunit.client.0.smithi042.stdout:3/962: chown c1 2 1 2024-09-19T09:41:45.097 INFO:tasks.workunit.client.0.smithi042.stdout:2/953: sync 2024-09-19T09:41:45.097 INFO:tasks.workunit.client.0.smithi042.stdout:2/954: write d7/dd/d14/d35/d45/d5e/d79/fa1 [605609,19783] 0 2024-09-19T09:41:45.098 INFO:tasks.workunit.client.0.smithi042.stdout:1/975: dwrite d4/f13 [0,4194304] 0 2024-09-19T09:41:45.100 INFO:tasks.workunit.client.0.smithi042.stdout:3/963: symlink d4/d8/d9/d115/d82/d8c/d104/d11b/l13a 0 2024-09-19T09:41:45.100 INFO:tasks.workunit.client.0.smithi042.stdout:2/955: dread d7/dd/d14/d35/d4e/f80 [0,4194304] 0 2024-09-19T09:41:45.100 INFO:tasks.workunit.client.0.smithi042.stdout:3/964: stat d4/d8/d4c/d6b/f129 0 2024-09-19T09:41:45.100 INFO:tasks.workunit.client.0.smithi042.stdout:3/965: truncate d4/d8/f19 9437042 0 2024-09-19T09:41:45.100 INFO:tasks.workunit.client.0.smithi042.stdout:2/956: truncate d7/dd/d1f/d122/f123 418642 0 2024-09-19T09:41:45.100 INFO:tasks.workunit.client.0.smithi042.stdout:3/966: dread - d4/d8/dff/f109 zero size 2024-09-19T09:41:45.101 INFO:tasks.workunit.client.0.smithi042.stdout:2/957: creat d7/dd/d1f/d3f/dfa/f143 x:0 0 0 2024-09-19T09:41:45.104 INFO:tasks.workunit.client.0.smithi042.stdout:3/967: creat d4/d8/d9/dc/dbf/d8b/f13b x:0 0 0 2024-09-19T09:41:45.104 INFO:tasks.workunit.client.0.smithi042.stdout:3/968: write d4/d8/d9/dc/dbf/d35/f51 [3784537,52878] 0 2024-09-19T09:41:45.104 INFO:tasks.workunit.client.0.smithi042.stdout:3/969: write d4/d8/d4c/d6b/db9/dcb/deb/ff7 [1247593,98605] 0 2024-09-19T09:41:45.107 INFO:tasks.workunit.client.0.smithi042.stdout:3/970: mknod d4/d8/d9/d115/d82/d8c/d9f/d12f/c13c 0 2024-09-19T09:41:45.107 INFO:tasks.workunit.client.0.smithi042.stdout:3/971: fdatasync d4/f121 0 2024-09-19T09:41:45.111 INFO:tasks.workunit.client.0.smithi042.stdout:2/958: rename d7/dd/d1f/d3f/dfa/d140 to d7/dd/d14/d35/d45/d144 0 2024-09-19T09:41:45.112 INFO:tasks.workunit.client.0.smithi042.stdout:4/900: rmdir d0/d28/d87/da1/d11b/d6b 39 2024-09-19T09:41:45.117 INFO:tasks.workunit.client.0.smithi042.stdout:3/972: mkdir d4/d13d 0 2024-09-19T09:41:45.117 INFO:tasks.workunit.client.0.smithi042.stdout:2/959: creat d7/d9b/db9/f145 x:0 0 0 2024-09-19T09:41:45.117 INFO:tasks.workunit.client.0.smithi042.stdout:3/973: stat d4/d8/d9/dc/f2b 0 2024-09-19T09:41:45.117 INFO:tasks.workunit.client.0.smithi042.stdout:3/974: write d4/d8/d9/d115/d82/d48/da5/f100 [559725,85403] 0 2024-09-19T09:41:45.118 INFO:tasks.workunit.client.0.smithi042.stdout:2/960: symlink d7/dd/d14/d35/d4c/l146 0 2024-09-19T09:41:45.118 INFO:tasks.workunit.client.0.smithi042.stdout:3/975: symlink d4/d8/d9/d115/d82/l13e 0 2024-09-19T09:41:45.119 INFO:tasks.workunit.client.0.smithi042.stdout:3/976: creat d4/d8/d9/f13f x:0 0 0 2024-09-19T09:41:45.121 INFO:tasks.workunit.client.0.smithi042.stdout:3/977: rename d4/d13d to d4/d8/d4c/d140 0 2024-09-19T09:41:45.122 INFO:tasks.workunit.client.0.smithi042.stdout:3/978: mknod d4/d8/d9/d115/d82/c141 0 2024-09-19T09:41:45.123 INFO:tasks.workunit.client.0.smithi042.stdout:3/979: symlink d4/d8/d4c/d6b/dfc/d11c/l142 0 2024-09-19T09:41:45.123 INFO:tasks.workunit.client.0.smithi042.stdout:3/980: symlink d4/d8/d9/d115/d82/d8c/d9f/d12f/l143 0 2024-09-19T09:41:45.124 INFO:tasks.workunit.client.0.smithi042.stdout:8/939: dwrite d1/db2/fd4 [0,4194304] 0 2024-09-19T09:41:45.126 INFO:tasks.workunit.client.0.smithi042.stdout:9/742: dwrite d8/da/d19/d1c/f9e [0,4194304] 0 2024-09-19T09:41:45.126 INFO:tasks.workunit.client.0.smithi042.stdout:9/743: readlink d8/db/l99 0 2024-09-19T09:41:45.126 INFO:tasks.workunit.client.0.smithi042.stdout:9/744: fsync d8/da/d89/d8e/fc6 0 2024-09-19T09:41:45.126 INFO:tasks.workunit.client.0.smithi042.stdout:8/940: dread d1/da8/d41/d55/d99/da4/dc2/fec [0,4194304] 0 2024-09-19T09:41:45.126 INFO:tasks.workunit.client.0.smithi042.stdout:0/864: dwrite d2/d10/d12/d24/d5b/fd3 [0,4194304] 0 2024-09-19T09:41:45.127 INFO:tasks.workunit.client.0.smithi042.stdout:4/901: dwrite d0/d1b/d1c/d2e/d3b/d95/db1/dba/d109/fc6 [0,4194304] 0 2024-09-19T09:41:45.127 INFO:tasks.workunit.client.0.smithi042.stdout:2/961: write d7/dd/d14/d35/d4c/d61/d87/fe6 [2972687,69148] 0 2024-09-19T09:41:45.127 INFO:tasks.workunit.client.0.smithi042.stdout:4/902: write d0/d1b/d1c/d2e/d3b/d95/f11e [806826,28614] 0 2024-09-19T09:41:45.127 INFO:tasks.workunit.client.0.smithi042.stdout:9/745: creat d8/da/d19/d1c/d21/d67/d7b/fdd x:0 0 0 2024-09-19T09:41:45.127 INFO:tasks.workunit.client.0.smithi042.stdout:9/746: fsync d8/f11 0 2024-09-19T09:41:45.128 INFO:tasks.workunit.client.0.smithi042.stdout:8/941: creat d1/da8/f117 x:0 0 0 2024-09-19T09:41:45.129 INFO:tasks.workunit.client.0.smithi042.stdout:0/865: mkdir d2/d10/d12/d16/d10f 0 2024-09-19T09:41:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.128+0000 7fd0f83d6640 1 -- 172.21.15.42:0/3544291284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0f0101d80 msgr2=0x7fd0f0108610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.128+0000 7fd0f83d6640 1 --2- 172.21.15.42:0/3544291284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0f0101d80 0x7fd0f0108610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8009ca0 tx=0x7fd0e802a8b0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.128+0000 7fd0f83d6640 1 -- 172.21.15.42:0/3544291284 shutdown_connections 2024-09-19T09:41:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.128+0000 7fd0f83d6640 1 --2- 172.21.15.42:0/3544291284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0f0101d80 0x7fd0f0108610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.128+0000 7fd0f83d6640 1 --2- 172.21.15.42:0/3544291284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0f01013c0 0x7fd0f0101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.128+0000 7fd0f83d6640 1 --2- 172.21.15.42:0/3544291284 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0f01001d0 0x7fd0f01005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.128+0000 7fd0f83d6640 1 -- 172.21.15.42:0/3544291284 >> 172.21.15.42:0/3544291284 conn(0x7fd0f00fb930 msgr2=0x7fd0f00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.128+0000 7fd0f83d6640 1 -- 172.21.15.42:0/3544291284 shutdown_connections 2024-09-19T09:41:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.128+0000 7fd0f83d6640 1 -- 172.21.15.42:0/3544291284 wait complete. 2024-09-19T09:41:45.131 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.129+0000 7fd0f83d6640 1 Processor -- start 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.129+0000 7fd0f83d6640 1 -- start start 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.129+0000 7fd0f83d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0f01001d0 0x7fd0f0197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.129+0000 7fd0f83d6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0f01013c0 0x7fd0f01982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.129+0000 7fd0f83d6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0f0101d80 0x7fd0f019f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.129+0000 7fd0f83d6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f010b610 con 0x7fd0f01001d0 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.129+0000 7fd0f83d6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f010b490 con 0x7fd0f0101d80 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.129+0000 7fd0f83d6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f010b790 con 0x7fd0f01013c0 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.130+0000 7fd0f6172640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0f01001d0 0x7fd0f0197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.130+0000 7fd0f6172640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0f01001d0 0x7fd0f0197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60248/0 (socket says 172.21.15.42:60248) 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.130+0000 7fd0f6172640 1 -- 172.21.15.42:0/2766408776 learned_addr learned my addr 172.21.15.42:0/2766408776 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.130+0000 7fd0f6973640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0f0101d80 0x7fd0f019f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.130+0000 7fd0f5971640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0f01013c0 0x7fd0f01982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.133 INFO:tasks.workunit.client.0.smithi042.stdout:4/903: mkdir d0/d1b/d1c/d61/d12f 0 2024-09-19T09:41:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.130+0000 7fd0f6172640 1 -- 172.21.15.42:0/2766408776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0f01013c0 msgr2=0x7fd0f01982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.130+0000 7fd0f6172640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0f01013c0 0x7fd0f01982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.130+0000 7fd0f6172640 1 -- 172.21.15.42:0/2766408776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0f0101d80 msgr2=0x7fd0f019f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.130+0000 7fd0f6172640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0f0101d80 0x7fd0f019f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.130+0000 7fd0f6172640 1 -- 172.21.15.42:0/2766408776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f019f990 con 0x7fd0f01001d0 2024-09-19T09:41:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.131+0000 7fd0f6172640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0f01001d0 0x7fd0f0197d70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00e9c0 tx=0x7fd0ec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:45.134 INFO:tasks.workunit.client.0.smithi042.stdout:9/747: creat d8/da/d89/da7/db6/db5/fde x:0 0 0 2024-09-19T09:41:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.131+0000 7fd0e77fe640 1 -- 172.21.15.42:0/2766408776 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec00cd80 con 0x7fd0f01001d0 2024-09-19T09:41:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.131+0000 7fd0e77fe640 1 -- 172.21.15.42:0/2766408776 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0ec0035f0 con 0x7fd0f01001d0 2024-09-19T09:41:45.135 INFO:tasks.workunit.client.0.smithi042.stdout:8/942: creat d1/da8/d92/dc7/f118 x:0 0 0 2024-09-19T09:41:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.132+0000 7fd0f83d6640 1 -- 172.21.15.42:0/2766408776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f019fc80 con 0x7fd0f01001d0 2024-09-19T09:41:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.132+0000 7fd0e77fe640 1 -- 172.21.15.42:0/2766408776 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec010690 con 0x7fd0f01001d0 2024-09-19T09:41:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.132+0000 7fd0f83d6640 1 -- 172.21.15.42:0/2766408776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f01a01d0 con 0x7fd0f01001d0 2024-09-19T09:41:45.136 INFO:tasks.workunit.client.0.smithi042.stdout:0/866: fdatasync d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/dca/fe4 0 2024-09-19T09:41:45.136 INFO:tasks.workunit.client.0.smithi042.stdout:0/867: getdents d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a 0 2024-09-19T09:41:45.137 INFO:tasks.workunit.client.0.smithi042.stdout:9/748: rmdir d8/da/d89/d8e 39 2024-09-19T09:41:45.137 INFO:tasks.workunit.client.0.smithi042.stdout:3/981: dread d4/d8/d9/d115/d82/d8c/d104/f4e [0,4194304] 0 2024-09-19T09:41:45.137 INFO:tasks.workunit.client.0.smithi042.stdout:3/982: write d4/d8/d4c/d6b/dfc/ffd [3974871,80382] 0 2024-09-19T09:41:45.137 INFO:tasks.workunit.client.0.smithi042.stdout:0/868: rename d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da6 to d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d110 0 2024-09-19T09:41:45.137 INFO:tasks.workunit.client.0.smithi042.stdout:9/749: rename d8 to d8/da/d19/d1c/d21/d67/d88/ddf 22 2024-09-19T09:41:45.137 INFO:tasks.workunit.client.0.smithi042.stdout:0/869: getdents d2/d10/d12/d24/dc0 0 2024-09-19T09:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.135+0000 7fd0fb250740 1 Processor -- start 2024-09-19T09:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.135+0000 7fd0fb250740 1 -- start start 2024-09-19T09:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.135+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 0x563a77237da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.135+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a7723cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.135+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 0x563a7723f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.135+0000 7fd0fb250740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563a7719b2f0 con 0x563a7723d370 2024-09-19T09:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.135+0000 7fd0fb250740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563a77143270 con 0x563a772382e0 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.135+0000 7fd0fb250740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563a771972b0 con 0x563a772379a0 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.136+0000 7fd0f5971640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 0x563a7723f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.136+0000 7fd0f5971640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 0x563a7723f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60254/0 (socket says 172.21.15.42:60254) 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.136+0000 7fd0f5971640 1 -- 172.21.15.42:0/3474269492 learned_addr learned my addr 172.21.15.42:0/3474269492 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.136+0000 7fd0f6973640 1 --2- 172.21.15.42:0/3474269492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 0x563a77237da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.137+0000 7fd0f5971640 1 -- 172.21.15.42:0/3474269492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 msgr2=0x563a77237da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.137+0000 7fd0f5971640 1 --2- 172.21.15.42:0/3474269492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 0x563a77237da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.137+0000 7fd0f5971640 1 -- 172.21.15.42:0/3474269492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 msgr2=0x563a7723cda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.137+0000 7fd0f5971640 1 --2- 172.21.15.42:0/3474269492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a7723cda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.137+0000 7fd0f5971640 1 -- 172.21.15.42:0/3474269492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a77142340 con 0x563a7723d370 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.137+0000 7fd0e77fe640 1 -- 172.21.15.42:0/2766408776 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd0ec0037a0 con 0x7fd0f01001d0 2024-09-19T09:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.137+0000 7fd0f5971640 1 --2- 172.21.15.42:0/3474269492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 0x563a7723f830 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000ad00 tx=0x7fd0e0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46724b8dd9b48e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:45.141 INFO:tasks.workunit.client.0.smithi042.stdout:4/904: dread d0/d1b/d1c/d2e/d3b/d95/f11e [0,4194304] 0 2024-09-19T09:41:45.141 INFO:tasks.workunit.client.0.smithi042.stdout:4/905: readlink d0/d1b/d1c/d2e/d3b/d95/db1/l12b 0 2024-09-19T09:41:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.138+0000 7fd0e4bfe640 1 -- 172.21.15.42:0/3474269492 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0005220 con 0x563a7723d370 2024-09-19T09:41:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.138+0000 7fd0e4bfe640 1 -- 172.21.15.42:0/3474269492 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e0004c80 con 0x563a7723d370 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.138+0000 7fd0e4bfe640 1 -- 172.21.15.42:0/3474269492 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00189a0 con 0x563a7723d370 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.138+0000 7fd0e77fe640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0dc0a3370 0x7fd0dc0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0fb250740 1 -- 172.21.15.42:0/3474269492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 msgr2=0x563a7723f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0fb250740 1 --2- 172.21.15.42:0/3474269492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 0x563a7723f830 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000ad00 tx=0x7fd0e0005f90 comp rx=0 tx=0).stop 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0e77fe640 1 -- 172.21.15.42:0/2766408776 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd0ec0cfd10 con 0x7fd0f01001d0 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0fb250740 1 -- 172.21.15.42:0/3474269492 shutdown_connections 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0fb250740 1 --2- 172.21.15.42:0/3474269492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 0x563a7723f830 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0fb250740 1 --2- 172.21.15.42:0/3474269492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a7723cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0fb250740 1 --2- 172.21.15.42:0/3474269492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 0x563a77237da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0fb250740 1 -- 172.21.15.42:0/3474269492 >> 172.21.15.42:0/3474269492 conn(0x563a77233010 msgr2=0x563a77233410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0f6973640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0dc0a3370 0x7fd0dc0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0fb250740 1 -- 172.21.15.42:0/3474269492 shutdown_connections 2024-09-19T09:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0fb250740 1 -- 172.21.15.42:0/3474269492 wait complete. 2024-09-19T09:41:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0fb250740 1 -- start start 2024-09-19T09:41:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.139+0000 7fd0f6973640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0dc0a3370 0x7fd0dc0a5830 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8005e30 tx=0x7fd0e8030930 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0fb250740 1 Processor -- start 2024-09-19T09:41:45.144 INFO:tasks.workunit.client.0.smithi042.stdout:8/943: chown d1/da/d14/l1e 22323 1 2024-09-19T09:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 0x563a77241c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77242190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 0x563a772491d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0fb250740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563a77240340 con 0x563a7723d370 2024-09-19T09:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0fb250740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563a77124290 con 0x563a772382e0 2024-09-19T09:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0fb250740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563a772404c0 con 0x563a772379a0 2024-09-19T09:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0fb250740 10 client.0 _ll_register_callbacks cb 0x563a77155140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0f6973640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 0x563a772491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0f5971640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77242190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0f5971640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77242190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:46268/0 (socket says 172.21.15.42:46268) 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0f5971640 1 -- 172.21.15.42:0/2971738926 learned_addr learned my addr 172.21.15.42:0/2971738926 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.140+0000 7fd0f6172640 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 0x563a77241c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0f5971640 1 -- 172.21.15.42:0/2971738926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 msgr2=0x563a77241c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0f5971640 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 0x563a77241c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0f5971640 1 -- 172.21.15.42:0/2971738926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 msgr2=0x563a772491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0f5971640 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 0x563a772491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0f5971640 1 -- 172.21.15.42:0/2971738926 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a76eae210 con 0x563a772382e0 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0f6172640 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 0x563a77241c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0f5971640 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77242190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0005de0 tx=0x7fd0e000aa30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e63f5c997ab70f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/2971738926 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0028070 con 0x563a772382e0 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/2971738926 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd0e0004e30 con 0x563a772382e0 2024-09-19T09:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0fb250740 1 -- 172.21.15.42:0/2971738926 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0e0004c80 con 0x563a772382e0 2024-09-19T09:41:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/2971738926 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd0e0034050 con 0x563a772382e0 2024-09-19T09:41:45.148 INFO:tasks.workunit.client.0.smithi042.stdout:3/983: symlink d4/d78/db1/l144 0 2024-09-19T09:41:45.148 INFO:tasks.workunit.client.0.smithi042.stdout:9/750: creat d8/da/d89/da7/db6/dc7/fe0 x:0 0 0 2024-09-19T09:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0fb250740 10 client.25796 fetch_fsmap learned FSMap version 32 2024-09-19T09:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.141+0000 7fd0fb250740 1 -- 172.21.15.42:0/2971738926 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563a76f7a620 con 0x563a772382e0 2024-09-19T09:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.142+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/2971738926 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e00186a0 con 0x563a772382e0 2024-09-19T09:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.143+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/2971738926 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8398+0+0 (secure 0 0 0) 0x7fd0e000b040 con 0x563a772382e0 2024-09-19T09:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.143+0000 7fd0fb250740 10 client.25796 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.143+0000 7fd0fb250740 10 client.25796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.143+0000 7fd0fb250740 20 client.25796 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.143+0000 7fd0fb250740 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563a7724d5d0 0x563a7724f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.143+0000 7fd0fb250740 4 client.25796 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.143+0000 7fd0fb250740 1 -- 172.21.15.42:0/2971738926 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd0e0004c80 con 0x563a7724d5d0 2024-09-19T09:41:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.144+0000 7fd0f6172640 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563a7724d5d0 0x563a7724f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.150 INFO:tasks.workunit.client.0.smithi042.stdout:2/962: dwrite d7/dd/d1f/d3f/f6c [0,4194304] 0 2024-09-19T09:41:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.145+0000 7fd0f6172640 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563a7724d5d0 0x563a7724f9c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4972993fdf8d5e70 server_cookie=ad69486b8080b0a4 in_seq=0 out_seq=0 2024-09-19T09:41:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.145+0000 7fd0d9ffb640 10 client.25796 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.146+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/2971738926 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd0e0004c80 con 0x563a7724d5d0 2024-09-19T09:41:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.146+0000 7fd0d9ffb640 10 client.25796 handle_command_reply: tid=0 2024-09-19T09:41:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.146+0000 7fd0fb250740 1 client.25796 shutdown 2024-09-19T09:41:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 1 -- 172.21.15.42:0/2971738926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 msgr2=0x563a77242190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77242190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0005de0 tx=0x7fd0e000aa30 comp rx=0 tx=0).stop 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 1 -- 172.21.15.42:0/2971738926 shutdown_connections 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563a7724d5d0 0x563a7724f9c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a7723d370 0x563a772491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77242190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 1 --2- 172.21.15.42:0/2971738926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772379a0 0x563a77241c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0d9ffb640 0 client.25796 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 1 -- 172.21.15.42:0/2971738926 >> 172.21.15.42:0/2971738926 conn(0x563a77233010 msgr2=0x563a77234820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 1 -- 172.21.15.42:0/2971738926 shutdown_connections 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 1 -- 172.21.15.42:0/2971738926 wait complete. 2024-09-19T09:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.147+0000 7fd0fb250740 20 client.25796 trim_cache size 0 max 16384 2024-09-19T09:41:45.153 INFO:tasks.workunit.client.0.smithi042.stdout:3/984: truncate d4/d8/d9/d115/fc7 2291819 0 2024-09-19T09:41:45.153 INFO:tasks.workunit.client.0.smithi042.stdout:9/751: creat d8/da/d89/d8e/fe1 x:0 0 0 2024-09-19T09:41:45.153 INFO:tasks.workunit.client.0.smithi042.stdout:8/944: write d1/d2e/ff5 [1906619,1353] 0 2024-09-19T09:41:45.154 INFO:tasks.workunit.client.0.smithi042.stdout:2/963: symlink d7/dd/d14/d35/d4c/d61/d87/da6/l147 0 2024-09-19T09:41:45.154 INFO:tasks.workunit.client.0.smithi042.stdout:2/964: truncate d7/dd/f15 4808096 0 2024-09-19T09:41:45.154 INFO:tasks.workunit.client.0.smithi042.stdout:3/985: link d4/d8/d9/d1b/d4f/c5d d4/d8/d4c/c145 0 2024-09-19T09:41:45.154 INFO:tasks.workunit.client.0.smithi042.stdout:9/752: symlink d8/da/le2 0 2024-09-19T09:41:45.154 INFO:tasks.workunit.client.0.smithi042.stdout:9/753: stat d8/db/d31 0 2024-09-19T09:41:45.156 INFO:tasks.workunit.client.0.smithi042.stdout:4/906: dread d0/d28/d87/da1/d11b/d5a/f102 [0,4194304] 0 2024-09-19T09:41:45.159 INFO:tasks.workunit.client.0.smithi042.stdout:3/986: creat d4/d8/d9/d115/d82/d48/dc3/df3/f146 x:0 0 0 2024-09-19T09:41:45.159 INFO:tasks.workunit.client.0.smithi042.stdout:2/965: mkdir d7/dd/d14/d35/d4e/d63/dd6/d148 0 2024-09-19T09:41:45.159 INFO:tasks.workunit.client.0.smithi042.stdout:8/945: mknod d1/da/d14/dfc/d116/d95/d113/c119 0 2024-09-19T09:41:45.159 INFO:tasks.workunit.client.0.smithi042.stdout:3/987: readlink d4/d8/l136 0 2024-09-19T09:41:45.159 INFO:tasks.workunit.client.0.smithi042.stdout:2/966: write d7/dd/d14/d35/d4e/d63/dd6/fd9 [3323862,92262] 0 2024-09-19T09:41:45.159 INFO:tasks.workunit.client.0.smithi042.stdout:0/870: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/fe3 [0,4194304] 0 2024-09-19T09:41:45.163 INFO:tasks.workunit.client.0.smithi042.stdout:0/871: dread d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/dca/fe4 [0,4194304] 0 2024-09-19T09:41:45.164 INFO:tasks.workunit.client.0.smithi042.stdout:3/988: unlink d4/d8/d9/d1b/d4f/fa9 0 2024-09-19T09:41:45.165 INFO:tasks.workunit.client.0.smithi042.stdout:8/946: mknod d1/da/dd/dac/d111/c11a 0 2024-09-19T09:41:45.165 INFO:tasks.workunit.client.0.smithi042.stdout:8/947: stat d1/da8/d41/l4d 0 2024-09-19T09:41:45.166 INFO:tasks.workunit.client.0.smithi042.stdout:0/872: getdents d2/d10/d12/d24/dbd/dfd 0 2024-09-19T09:41:45.168 INFO:tasks.workunit.client.0.smithi042.stdout:8/948: creat d1/da8/de1/f11b x:0 0 0 2024-09-19T09:41:45.169 INFO:tasks.workunit.client.0.smithi042.stdout:4/907: symlink d0/d1b/d1c/d6a/l130 0 2024-09-19T09:41:45.174 INFO:tasks.workunit.client.0.smithi042.stdout:3/989: rename d4/d8/d9/d115/d82/d48/dc3 to d4/d8/d9/d1b/d147 0 2024-09-19T09:41:45.174 INFO:tasks.workunit.client.0.smithi042.stdout:9/754: dwrite d8/da/f8d [0,4194304] 0 2024-09-19T09:41:45.174 INFO:tasks.workunit.client.0.smithi042.stdout:9/755: chown d8/da/d19/d1c/d21/c63 115 1 2024-09-19T09:41:45.175 INFO:tasks.workunit.client.0.smithi042.stdout:3/990: mknod d4/d8/d4c/d6b/dfc/d11c/c148 0 2024-09-19T09:41:45.175 INFO:tasks.workunit.client.0.smithi042.stdout:3/991: chown d4/d8/d9 42410000 1 2024-09-19T09:41:45.175 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.174+0000 7fd0fb250740 1 Processor -- start 2024-09-19T09:41:45.175 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.174+0000 7fd0fb250740 1 -- start start 2024-09-19T09:41:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.174+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a772379a0 0x563a772394c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.176 INFO:tasks.workunit.client.0.smithi042.stdout:8/949: dread d1/da/f63 [0,4194304] 0 2024-09-19T09:41:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.174+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772382e0 0x563a77239a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.174+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a7723d370 0x563a77249190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.174+0000 7fd0fb250740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f01a6ed0 con 0x563a772379a0 2024-09-19T09:41:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.174+0000 7fd0fb250740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f01a8b90 con 0x563a7723d370 2024-09-19T09:41:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.174+0000 7fd0fb250740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f01a7630 con 0x563a772382e0 2024-09-19T09:41:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.174+0000 7fd0f5971640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772382e0 0x563a77239a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.175+0000 7fd0f5971640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772382e0 0x563a77239a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:52910/0 (socket says 172.21.15.42:52910) 2024-09-19T09:41:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.175+0000 7fd0f5971640 1 -- 172.21.15.42:0/1320507942 learned_addr learned my addr 172.21.15.42:0/1320507942 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.175+0000 7fd0f6973640 1 --2- 172.21.15.42:0/1320507942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a7723d370 0x563a77249190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.177 INFO:tasks.workunit.client.0.smithi042.stdout:0/873: write d2/d10/d12/d24/f42 [413737,101888] 0 2024-09-19T09:41:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.175+0000 7fd0f6172640 1 --2- 172.21.15.42:0/1320507942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a772379a0 0x563a772394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.175+0000 7fd0f6973640 1 -- 172.21.15.42:0/1320507942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772382e0 msgr2=0x563a77239a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.175+0000 7fd0f6973640 1 --2- 172.21.15.42:0/1320507942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772382e0 0x563a77239a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.175+0000 7fd0f6973640 1 -- 172.21.15.42:0/1320507942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a772379a0 msgr2=0x563a772394c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.175+0000 7fd0f6973640 1 --2- 172.21.15.42:0/1320507942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a772379a0 0x563a772394c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.175+0000 7fd0f6973640 1 -- 172.21.15.42:0/1320507942 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a772387c0 con 0x563a7723d370 2024-09-19T09:41:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.176+0000 7fd0f6973640 1 --2- 172.21.15.42:0/1320507942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a7723d370 0x563a77249190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0e802add0 tx=0x7fd0e8041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=225f4a1032723f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:45.179 INFO:tasks.workunit.client.0.smithi042.stdout:9/756: mknod d8/da/d89/d8e/dae/ce3 0 2024-09-19T09:41:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.176+0000 7fd0dbfff640 1 -- 172.21.15.42:0/1320507942 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8030cf0 con 0x563a7723d370 2024-09-19T09:41:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.177+0000 7fd0dbfff640 1 -- 172.21.15.42:0/1320507942 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e8036050 con 0x563a7723d370 2024-09-19T09:41:45.180 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.177+0000 7fd0dbfff640 1 -- 172.21.15.42:0/1320507942 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8004780 con 0x563a7723d370 2024-09-19T09:41:45.180 INFO:tasks.workunit.client.0.smithi042.stdout:3/992: creat d4/d78/d9d/f149 x:0 0 0 2024-09-19T09:41:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 -- 172.21.15.42:0/1320507942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a7723d370 msgr2=0x563a77249190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 --2- 172.21.15.42:0/1320507942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a7723d370 0x563a77249190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0e802add0 tx=0x7fd0e8041000 comp rx=0 tx=0).stop 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 -- 172.21.15.42:0/1320507942 shutdown_connections 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 --2- 172.21.15.42:0/1320507942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a7723d370 0x563a77249190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 --2- 172.21.15.42:0/1320507942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a772382e0 0x563a77239a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 --2- 172.21.15.42:0/1320507942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a772379a0 0x563a772394c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 -- 172.21.15.42:0/1320507942 >> 172.21.15.42:0/1320507942 conn(0x563a77233010 msgr2=0x563a77241c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 -- 172.21.15.42:0/1320507942 shutdown_connections 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 -- 172.21.15.42:0/1320507942 wait complete. 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 -- start start 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.178+0000 7fd0fb250740 1 Processor -- start 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a772379a0 0x563a77246020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77246560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0fb250740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a7723d370 0x563a772b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0fb250740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f01a8490 con 0x563a772379a0 2024-09-19T09:41:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0fb250740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f01a7dc0 con 0x563a772382e0 2024-09-19T09:41:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0fb250740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f01a4eb0 con 0x563a7723d370 2024-09-19T09:41:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0fb250740 10 client.0 _ll_register_callbacks cb 0x7fd0e000ab80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0f5971640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77246560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0f5971640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77246560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:46298/0 (socket says 172.21.15.42:46298) 2024-09-19T09:41:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0f5971640 1 -- 172.21.15.42:0/375024762 learned_addr learned my addr 172.21.15.42:0/375024762 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0f6172640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a772379a0 0x563a77246020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0f6973640 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a7723d370 0x563a772b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.184 INFO:tasks.workunit.client.0.smithi042.stdout:8/950: unlink d1/da8/d41/d55/d99/le0 0 2024-09-19T09:41:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0f5971640 1 -- 172.21.15.42:0/375024762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a7723d370 msgr2=0x563a772b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0f5971640 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a7723d370 0x563a772b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0f5971640 1 -- 172.21.15.42:0/375024762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a772379a0 msgr2=0x563a77246020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0f5971640 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a772379a0 0x563a77246020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.179+0000 7fd0f5971640 1 -- 172.21.15.42:0/375024762 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a772b66a0 con 0x563a772382e0 2024-09-19T09:41:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.180+0000 7fd0f5971640 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77246560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000ac50 tx=0x7fd0e0005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55eb7223d178c923 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.180+0000 7fd0d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.180+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/375024762 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0028040 con 0x563a772382e0 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.180+0000 7fd0fb250740 1 -- 172.21.15.42:0/375024762 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0e8036050 con 0x563a772382e0 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.180+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/375024762 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd0e0004030 con 0x563a772382e0 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.180+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/375024762 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd0e0004230 con 0x563a772382e0 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.180+0000 7fd0fb250740 10 client.25802 fetch_fsmap learned FSMap version 32 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.180+0000 7fd0fb250740 1 -- 172.21.15.42:0/375024762 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563a772b7830 con 0x563a772382e0 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.180+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/375024762 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e8036050 con 0x563a772382e0 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.181+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/375024762 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8398+0+0 (secure 0 0 0) 0x7fd0e0004a50 con 0x563a772382e0 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.181+0000 7fd0fb250740 10 client.25802 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.181+0000 7fd0fb250740 10 client.25802 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.181+0000 7fd0fb250740 20 client.25802 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.181+0000 7fd0fb250740 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563a772b8230 0x563a772ba650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.181+0000 7fd0fb250740 4 client.25802 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:41:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.181+0000 7fd0fb250740 1 -- 172.21.15.42:0/375024762 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a771a8a20 con 0x563a772b8230 2024-09-19T09:41:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.181+0000 7fd0f6172640 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563a772b8230 0x563a772ba650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.181+0000 7fd0f6172640 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563a772b8230 0x563a772ba650 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cfdcd33c1605304 server_cookie=e9f9467e31249c8e in_seq=0 out_seq=0 2024-09-19T09:41:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.181+0000 7fd0d9ffb640 10 client.25802 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:45.189 INFO:tasks.workunit.client.0.smithi042.stdout:9/757: rmdir d8/da/d19/d1c/da5/dce 0 2024-09-19T09:41:45.189 INFO:tasks.workunit.client.0.smithi042.stdout:9/758: read - d8/da/d70/f92 zero size 2024-09-19T09:41:45.189 INFO:tasks.workunit.client.0.smithi042.stdout:2/967: dwrite d7/dd/d14/d35/d4c/d61/d87/da6/fc2 [4194304,4194304] 0 2024-09-19T09:41:45.189 INFO:tasks.workunit.client.0.smithi042.stdout:2/968: chown d7/dd/d1f/c36 38 1 2024-09-19T09:41:45.189 INFO:tasks.workunit.client.0.smithi042.stdout:4/908: dwrite d0/d1b/dd8/fdd [0,4194304] 0 2024-09-19T09:41:45.189 INFO:tasks.workunit.client.0.smithi042.stdout:4/909: chown d0/d1b/d1c/d2e/d3b/feb 37356 1 2024-09-19T09:41:45.189 INFO:tasks.workunit.client.0.smithi042.stdout:3/993: rmdir d4/d8/d9 39 2024-09-19T09:41:45.190 INFO:tasks.workunit.client.0.smithi042.stdout:4/910: unlink d0/d1b/d1c/d6a/l130 0 2024-09-19T09:41:45.190 INFO:tasks.workunit.client.0.smithi042.stdout:4/911: write d0/d1b/f117 [938900,76234] 0 2024-09-19T09:41:45.191 INFO:tasks.workunit.client.0.smithi042.stdout:8/951: symlink d1/da8/d92/dc7/l11c 0 2024-09-19T09:41:45.191 INFO:tasks.workunit.client.0.smithi042.stdout:8/952: write d1/da/d14/dfc/d116/d58/fab [5115465,33690] 0 2024-09-19T09:41:45.191 INFO:tasks.workunit.client.0.smithi042.stdout:8/953: dread d1/da8/d41/d55/d99/da4/dc2/fec [0,4194304] 0 2024-09-19T09:41:45.192 INFO:tasks.workunit.client.0.smithi042.stdout:9/759: creat d8/da/d19/d1c/da5/fe4 x:0 0 0 2024-09-19T09:41:45.192 INFO:tasks.workunit.client.0.smithi042.stdout:9/760: dread - d8/db/d31/fc0 zero size 2024-09-19T09:41:45.192 INFO:tasks.workunit.client.0.smithi042.stdout:9/761: fsync d8/da/d89/da7/db6/dc7/fe0 0 2024-09-19T09:41:45.199 INFO:tasks.workunit.client.0.smithi042.stdout:0/874: symlink d2/d10/d12/d16/d57/d99/dd0/da5/l111 0 2024-09-19T09:41:45.201 INFO:tasks.workunit.client.0.smithi042.stdout:2/969: dread d7/dd/d14/d35/d4e/d9c/fbd [0,4194304] 0 2024-09-19T09:41:45.201 INFO:tasks.workunit.client.0.smithi042.stdout:2/970: write d7/dd/d1f/d3f/dfa/f143 [76014,41352] 0 2024-09-19T09:41:45.211 INFO:tasks.workunit.client.0.smithi042.stdout:0/875: dread d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da0/fab [4194304,4194304] 0 2024-09-19T09:41:45.214 INFO:tasks.workunit.client.0.smithi042.stdout:3/994: link d4/d8/d9/d115/d82/d48/fdc d4/d8/d9/d39/d4b/f14a 0 2024-09-19T09:41:45.215 INFO:tasks.workunit.client.0.smithi042.stdout:3/995: write d4/d8/d9/d115/ff9 [4875846,108712] 0 2024-09-19T09:41:45.217 INFO:tasks.workunit.client.0.smithi042.stdout:0/876: dread d2/d10/d6b/f77 [0,4194304] 0 2024-09-19T09:41:45.217 INFO:tasks.workunit.client.0.smithi042.stdout:0/877: dread - d2/d10/d12/d24/fee zero size 2024-09-19T09:41:45.219 INFO:tasks.workunit.client.0.smithi042.stdout:9/762: unlink d8/da/f1e 0 2024-09-19T09:41:45.221 INFO:tasks.workunit.client.0.smithi042.stdout:2/971: mkdir d7/d131/d149 0 2024-09-19T09:41:45.221 INFO:tasks.workunit.client.0.smithi042.stdout:2/972: read - d7/dd/d22/d30/d66/fe2 zero size 2024-09-19T09:41:45.221 INFO:tasks.workunit.client.0.smithi042.stdout:2/973: dread - d7/dd/d14/d35/d4c/d70/d136/fd4 zero size 2024-09-19T09:41:45.221 INFO:tasks.workunit.client.0.smithi042.stdout:2/974: write d7/d9b/fb5 [2714426,73614] 0 2024-09-19T09:41:45.222 INFO:tasks.workunit.client.0.smithi042.stdout:9/763: mkdir d8/da/d89/da7/db6/db5/d87/dad/de5 0 2024-09-19T09:41:45.222 INFO:tasks.workunit.client.0.smithi042.stdout:9/764: truncate d8/da/d19/d1c/d21/dbf/fd2 1030831 0 2024-09-19T09:41:45.222 INFO:tasks.workunit.client.0.smithi042.stdout:9/765: stat d8/da/d89/da7/db6/db5/d87/fc8 0 2024-09-19T09:41:45.222 INFO:tasks.workunit.client.0.smithi042.stdout:9/766: chown d8/da/d19/d1c/d21/dbf 5966 1 2024-09-19T09:41:45.222 INFO:tasks.workunit.client.0.smithi042.stdout:9/767: readlink d8/da/d19/l71 0 2024-09-19T09:41:45.222 INFO:tasks.workunit.client.0.smithi042.stdout:9/768: dread - d8/da/d89/da7/db6/db5/fde zero size 2024-09-19T09:41:45.223 INFO:tasks.workunit.client.0.smithi042.stdout:9/769: readlink d8/da/l77 0 2024-09-19T09:41:45.223 INFO:tasks.workunit.client.0.smithi042.stdout:9/770: chown d8/da/d19/lac 369287019 1 2024-09-19T09:41:45.223 INFO:tasks.workunit.client.0.smithi042.stdout:9/771: truncate f1 5354098 0 2024-09-19T09:41:45.223 INFO:tasks.workunit.client.0.smithi042.stdout:4/912: dwrite d0/d67/d96/f127 [0,4194304] 0 2024-09-19T09:41:45.223 INFO:tasks.workunit.client.0.smithi042.stdout:4/913: truncate d0/d28/d36/f66 1047863 0 2024-09-19T09:41:45.224 INFO:tasks.workunit.client.0.smithi042.stdout:2/975: creat d7/dd/d14/d35/d4e/d63/dd6/d148/f14a x:0 0 0 2024-09-19T09:41:45.225 INFO:tasks.workunit.client.0.smithi042.stdout:3/996: write d4/d8/d9/d39/d4b/d7d/fe0 [511068,51307] 0 2024-09-19T09:41:45.226 INFO:tasks.workunit.client.0.smithi042.stdout:8/954: dwrite d1/da/d14/dfc/d116/d58/faa [0,4194304] 0 2024-09-19T09:41:45.228 INFO:tasks.workunit.client.0.smithi042.stdout:9/772: rename d8/da/d19/d1c/d21/dbf/fd5 to d8/da/d19/d1c/fe6 0 2024-09-19T09:41:45.236 INFO:tasks.workunit.client.0.smithi042.stdout:5/875: sync 2024-09-19T09:41:45.236 INFO:tasks.workunit.client.0.smithi042.stdout:7/787: sync 2024-09-19T09:41:45.236 INFO:tasks.workunit.client.0.smithi042.stdout:7/788: chown d0/d3d/d85/fcf 3265 1 2024-09-19T09:41:45.236 INFO:tasks.workunit.client.0.smithi042.stdout:5/876: symlink d2/d4/d64/da7/dda/l12c 0 2024-09-19T09:41:45.237 INFO:tasks.workunit.client.0.smithi042.stdout:3/997: symlink d4/d8/d9/d1b/l14b 0 2024-09-19T09:41:45.244 INFO:tasks.workunit.client.0.smithi042.stdout:9/773: dread d8/f1a [0,4194304] 0 2024-09-19T09:41:45.247 INFO:tasks.workunit.client.0.smithi042.stdout:8/955: creat d1/da8/db1/dcb/f11d x:0 0 0 2024-09-19T09:41:45.248 INFO:tasks.workunit.client.0.smithi042.stdout:7/789: symlink d0/l104 0 2024-09-19T09:41:45.249 INFO:tasks.workunit.client.0.smithi042.stdout:4/914: dwrite d0/d1b/d1c/f25 [0,4194304] 0 2024-09-19T09:41:45.250 INFO:tasks.workunit.client.0.smithi042.stdout:3/998: rename d4/d8/d9/d39/d4b/f54 to d4/d8/d9/d39/df8/f14c 0 2024-09-19T09:41:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0d9ffb640 1 -- 172.21.15.42:0/375024762 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a771a8a20 con 0x563a772b8230 2024-09-19T09:41:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0d9ffb640 10 client.25802 handle_command_reply: tid=0 2024-09-19T09:41:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 client.25802 shutdown 2024-09-19T09:41:45.251 INFO:tasks.workunit.client.0.smithi042.stdout:2/976: dwrite d7/dd/d14/d35/d4e/d9c/f138 [0,4194304] 0 2024-09-19T09:41:45.251 INFO:tasks.workunit.client.0.smithi042.stdout:2/977: readlink d7/dd/d14/d35/d4c/d61/l100 0 2024-09-19T09:41:45.251 INFO:tasks.workunit.client.0.smithi042.stdout:2/978: write d7/f6a [1268515,8481] 0 2024-09-19T09:41:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 -- 172.21.15.42:0/375024762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 msgr2=0x563a77246560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77246560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000ac50 tx=0x7fd0e0005dc0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 -- 172.21.15.42:0/375024762 shutdown_connections 2024-09-19T09:41:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x563a772b8230 0x563a772ba650 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a7723d370 0x563a772b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a772382e0 0x563a77246560 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 --2- 172.21.15.42:0/375024762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563a772379a0 0x563a77246020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0d9ffb640 0 client.25802 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 -- 172.21.15.42:0/375024762 >> 172.21.15.42:0/375024762 conn(0x563a77233010 msgr2=0x563a772319a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 -- 172.21.15.42:0/375024762 shutdown_connections 2024-09-19T09:41:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 1 -- 172.21.15.42:0/375024762 wait complete. 2024-09-19T09:41:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.249+0000 7fd0fb250740 20 client.25802 trim_cache size 0 max 16384 2024-09-19T09:41:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:41:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:41:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:41:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 -- 172.21.15.42:0/2766408776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0dc0a3370 msgr2=0x7fd0dc0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0dc0a3370 0x7fd0dc0a5830 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8005e30 tx=0x7fd0e8030930 comp rx=0 tx=0).stop 2024-09-19T09:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 -- 172.21.15.42:0/2766408776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0f01001d0 msgr2=0x7fd0f0197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0f01001d0 0x7fd0f0197d70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00e9c0 tx=0x7fd0ec00ee80 comp rx=0 tx=0).stop 2024-09-19T09:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 -- 172.21.15.42:0/2766408776 shutdown_connections 2024-09-19T09:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd0dc0a3370 0x7fd0dc0a5830 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0f0101d80 0x7fd0f019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0f01013c0 0x7fd0f01982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 --2- 172.21.15.42:0/2766408776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0f01001d0 0x7fd0f0197d70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 -- 172.21.15.42:0/2766408776 >> 172.21.15.42:0/2766408776 conn(0x7fd0f00fb930 msgr2=0x7fd0f0106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 -- 172.21.15.42:0/2766408776 shutdown_connections 2024-09-19T09:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:45.250+0000 7fd0f83d6640 1 -- 172.21.15.42:0/2766408776 wait complete. 2024-09-19T09:41:45.256 INFO:tasks.workunit.client.0.smithi042.stdout:3/999: read d4/d8/d9/dc/fe1 [520800,119295] 0 2024-09-19T09:41:45.256 INFO:tasks.workunit.client.0.smithi042.stdout:9/774: creat d8/d32/fe7 x:0 0 0 2024-09-19T09:41:45.257 INFO:tasks.workunit.client.0.smithi042.stdout:8/956: link d1/da/d14/dfc/d116/d58/l7c d1/d72/de8/l11e 0 2024-09-19T09:41:45.257 INFO:tasks.workunit.client.0.smithi042.stdout:7/790: creat d0/d14/d3a/f105 x:0 0 0 2024-09-19T09:41:45.259 INFO:tasks.workunit.client.0.smithi042.stdout:2/979: truncate d7/dd/d14/dec/ffb 217796 0 2024-09-19T09:41:45.259 INFO:tasks.workunit.client.0.smithi042.stdout:5/877: dwrite d2/db/f10 [0,4194304] 0 2024-09-19T09:41:45.260 INFO:tasks.workunit.client.0.smithi042.stdout:8/957: mkdir d1/da/d14/dfc/d116/d95/d113/d11f 0 2024-09-19T09:41:45.260 INFO:tasks.workunit.client.0.smithi042.stdout:6/900: sync 2024-09-19T09:41:45.260 INFO:tasks.workunit.client.0.smithi042.stdout:1/976: sync 2024-09-19T09:41:45.261 INFO:tasks.workunit.client.0.smithi042.stdout:7/791: symlink d0/dde/l106 0 2024-09-19T09:41:45.261 INFO:tasks.workunit.client.0.smithi042.stdout:7/792: dread - d0/d14/d3c/fe1 zero size 2024-09-19T09:41:45.261 INFO:tasks.workunit.client.0.smithi042.stdout:7/793: write d0/d14/fa7 [468391,61463] 0 2024-09-19T09:41:45.267 INFO:tasks.workunit.client.0.smithi042.stdout:7/794: creat d0/d40/d9d/db5/f107 x:0 0 0 2024-09-19T09:41:45.269 INFO:tasks.workunit.client.0.smithi042.stdout:2/980: dread d7/dd/f40 [4194304,4194304] 0 2024-09-19T09:41:45.269 INFO:tasks.workunit.client.0.smithi042.stdout:2/981: truncate d7/dd/d1f/d3f/dfa/f143 520794 0 2024-09-19T09:41:45.269 INFO:tasks.workunit.client.0.smithi042.stdout:2/982: dread - d7/dd/d14/d35/d4c/f117 zero size 2024-09-19T09:41:45.271 INFO:tasks.workunit.client.0.smithi042.stdout:2/983: symlink d7/dd/l14b 0 2024-09-19T09:41:45.271 INFO:tasks.workunit.client.0.smithi042.stdout:6/901: read d1/de/d54/fa1 [550102,86429] 0 2024-09-19T09:41:45.271 INFO:tasks.workunit.client.0.smithi042.stdout:6/902: chown d1/d20/d6a/d90/f3b 29745357 1 2024-09-19T09:41:45.271 INFO:tasks.workunit.client.0.smithi042.stdout:6/903: chown d1/de/d54/dda/c7f 140 1 2024-09-19T09:41:45.271 INFO:tasks.workunit.client.0.smithi042.stdout:2/984: rmdir d7/dd/d48/d96 39 2024-09-19T09:41:45.272 INFO:tasks.workunit.client.0.smithi042.stdout:6/904: mkdir d1/de/d117 0 2024-09-19T09:41:45.272 INFO:tasks.workunit.client.0.smithi042.stdout:6/905: write d1/de/d76/d99/db2/d34/d6f/d4a/d98/fa4 [660340,93353] 0 2024-09-19T09:41:45.273 INFO:tasks.workunit.client.0.smithi042.stdout:2/985: symlink d7/dd/d14/dec/dfd/l14c 0 2024-09-19T09:41:45.274 INFO:tasks.workunit.client.0.smithi042.stdout:2/986: creat d7/dd/d14/d35/d4c/d70/d136/f14d x:0 0 0 2024-09-19T09:41:45.275 INFO:tasks.workunit.client.0.smithi042.stdout:8/958: dread d1/da/f21 [4194304,4194304] 0 2024-09-19T09:41:45.276 INFO:tasks.workunit.client.0.smithi042.stdout:8/959: write d1/d2e/ffa [262702,24588] 0 2024-09-19T09:41:45.276 INFO:tasks.workunit.client.0.smithi042.stdout:5/878: write d2/d4/d20/d60/d72/d75/f103 [1548641,30912] 0 2024-09-19T09:41:45.276 INFO:tasks.workunit.client.0.smithi042.stdout:4/915: dwrite d0/d28/d36/f66 [0,4194304] 0 2024-09-19T09:41:45.278 INFO:tasks.workunit.client.0.smithi042.stdout:2/987: rename d7/dd/d14/d35/d4c/d61/d87/fe6 to d7/dd/d14/dec/f14e 0 2024-09-19T09:41:45.279 INFO:tasks.workunit.client.0.smithi042.stdout:7/795: dread d0/d14/d3a/f6e [0,4194304] 0 2024-09-19T09:41:45.279 INFO:tasks.workunit.client.0.smithi042.stdout:7/796: write d0/d14/d44/d47/ff0 [4503578,6994] 0 2024-09-19T09:41:45.282 INFO:tasks.workunit.client.0.smithi042.stdout:4/916: symlink d0/d1b/d1c/d61/dc8/l131 0 2024-09-19T09:41:45.282 INFO:tasks.workunit.client.0.smithi042.stdout:4/917: fsync d0/d1b/d1c/d2e/f76 0 2024-09-19T09:41:45.284 INFO:tasks.workunit.client.0.smithi042.stdout:2/988: mknod d7/dd/d14/c14f 0 2024-09-19T09:41:45.284 INFO:tasks.workunit.client.0.smithi042.stdout:9/775: dwrite d8/db/d31/fc0 [0,4194304] 0 2024-09-19T09:41:45.285 INFO:tasks.workunit.client.0.smithi042.stdout:2/989: chown d7/l50 74051410 1 2024-09-19T09:41:45.287 INFO:tasks.workunit.client.0.smithi042.stdout:1/977: dwrite d4/d12/d8d/dca/dd4/f115 [0,4194304] 0 2024-09-19T09:41:45.292 INFO:tasks.workunit.client.0.smithi042.stdout:9/776: rmdir d8 39 2024-09-19T09:41:45.292 INFO:tasks.workunit.client.0.smithi042.stdout:9/777: truncate d8/d1d/faf 1592721 0 2024-09-19T09:41:45.296 INFO:tasks.workunit.client.0.smithi042.stdout:2/990: unlink d7/dd/d1f/d3f/f69 0 2024-09-19T09:41:45.296 INFO:tasks.workunit.client.0.smithi042.stdout:2/991: write d7/dd/d14/d35/d4e/d63/f137 [609248,56306] 0 2024-09-19T09:41:45.296 INFO:tasks.workunit.client.0.smithi042.stdout:2/992: dread - d7/dd/d14/d35/d4e/d63/dd6/f12b zero size 2024-09-19T09:41:45.299 INFO:tasks.workunit.client.0.smithi042.stdout:6/906: dwrite d1/d20/d6a/d46/d92/d3a/fd6 [0,4194304] 0 2024-09-19T09:41:45.299 INFO:tasks.workunit.client.0.smithi042.stdout:6/907: readlink d1/de/d12/l1b 0 2024-09-19T09:41:45.302 INFO:tasks.workunit.client.0.smithi042.stdout:5/879: link d2/d8e/ld6 d2/d4/d64/da7/dda/de6/l12d 0 2024-09-19T09:41:45.302 INFO:tasks.workunit.client.0.smithi042.stdout:5/880: write d2/d4/d20/d60/d72/f108 [911619,99547] 0 2024-09-19T09:41:45.304 INFO:tasks.workunit.client.0.smithi042.stdout:1/978: mknod d4/d15/d9e/c13c 0 2024-09-19T09:41:45.304 INFO:tasks.workunit.client.0.smithi042.stdout:7/797: dwrite d0/d40/d9d/dd7/ffd [0,4194304] 0 2024-09-19T09:41:45.305 INFO:tasks.workunit.client.0.smithi042.stdout:9/778: mknod d8/da/d19/d1c/da5/ce8 0 2024-09-19T09:41:45.307 INFO:tasks.workunit.client.0.smithi042.stdout:6/908: getdents d1/de/d54/dda 0 2024-09-19T09:41:45.308 INFO:tasks.workunit.client.0.smithi042.stdout:5/881: read d2/d4/d20/d31/f109 [2803009,75299] 0 2024-09-19T09:41:45.310 INFO:tasks.workunit.client.0.smithi042.stdout:8/960: dwrite d1/da/d3f/fbd [0,4194304] 0 2024-09-19T09:41:45.310 INFO:tasks.workunit.client.0.smithi042.stdout:7/798: truncate d0/d14/d3a/f3e 2888229 0 2024-09-19T09:41:45.310 INFO:tasks.workunit.client.0.smithi042.stdout:7/799: stat d0/d14/d3a/ddc/db6/dbb/dcc 0 2024-09-19T09:41:45.311 INFO:tasks.workunit.client.0.smithi042.stdout:7/800: write d0/d3d/db0/fc9 [482172,18575] 0 2024-09-19T09:41:45.311 INFO:tasks.workunit.client.0.smithi042.stdout:9/779: mkdir d8/da/d19/d1c/d21/de9 0 2024-09-19T09:41:45.312 INFO:tasks.workunit.client.0.smithi042.stdout:1/979: dread d4/d12/d8d/d91/d7f/fba [0,4194304] 0 2024-09-19T09:41:45.312 INFO:tasks.workunit.client.0.smithi042.stdout:1/980: fdatasync d4/d15/d9e/fb8 0 2024-09-19T09:41:45.312 INFO:tasks.workunit.client.0.smithi042.stdout:6/909: unlink d1/de/d76/d99/db2/d34/d6f/d4a/c105 0 2024-09-19T09:41:45.313 INFO:tasks.workunit.client.0.smithi042.stdout:5/882: symlink d2/db/d3c/l12e 0 2024-09-19T09:41:45.313 INFO:tasks.workunit.client.0.smithi042.stdout:5/883: dread - d2/d4/d64/da7/dda/de6/f105 zero size 2024-09-19T09:41:45.314 INFO:tasks.workunit.client.0.smithi042.stdout:8/961: symlink d1/da/l120 0 2024-09-19T09:41:45.314 INFO:tasks.workunit.client.0.smithi042.stdout:8/962: chown d1/da/f2f 1262 1 2024-09-19T09:41:45.315 INFO:tasks.workunit.client.0.smithi042.stdout:4/918: dwrite d0/d67/f8e [0,4194304] 0 2024-09-19T09:41:45.315 INFO:tasks.workunit.client.0.smithi042.stdout:7/801: truncate d0/d3d/f4b 1303422 0 2024-09-19T09:41:45.316 INFO:tasks.workunit.client.0.smithi042.stdout:9/780: symlink d8/da/d19/d1c/d21/de9/lea 0 2024-09-19T09:41:45.317 INFO:tasks.workunit.client.0.smithi042.stdout:1/981: rmdir d4/d15/d19/d45/d82/d89/d126/dda/d12d 39 2024-09-19T09:41:45.317 INFO:tasks.workunit.client.0.smithi042.stdout:4/919: dread d0/d1b/f117 [0,4194304] 0 2024-09-19T09:41:45.317 INFO:tasks.workunit.client.0.smithi042.stdout:2/993: dwrite d7/dd/d22/d30/f13d [4194304,4194304] 0 2024-09-19T09:41:45.317 INFO:tasks.workunit.client.0.smithi042.stdout:2/994: stat d7/dd/l20 0 2024-09-19T09:41:45.318 INFO:tasks.workunit.client.0.smithi042.stdout:6/910: creat d1/de/d54/d81/f118 x:0 0 0 2024-09-19T09:41:45.318 INFO:tasks.workunit.client.0.smithi042.stdout:6/911: fsync d1/de/d76/d99/db2/d34/d6f/d4a/f83 0 2024-09-19T09:41:45.318 INFO:tasks.workunit.client.0.smithi042.stdout:4/920: creat d0/d1b/d1c/d6a/d123/f132 x:0 0 0 2024-09-19T09:41:45.318 INFO:tasks.workunit.client.0.smithi042.stdout:4/921: write d0/fe [2801590,118403] 0 2024-09-19T09:41:45.318 INFO:tasks.workunit.client.0.smithi042.stdout:8/963: symlink d1/da8/d41/d55/d99/l121 0 2024-09-19T09:41:45.320 INFO:tasks.workunit.client.0.smithi042.stdout:7/802: link d0/c2b d0/d14/d44/d47/c108 0 2024-09-19T09:41:45.321 INFO:tasks.workunit.client.0.smithi042.stdout:7/803: write d0/d14/d3a/ddc/db6/dbb/fe7 [4852329,73944] 0 2024-09-19T09:41:45.321 INFO:tasks.workunit.client.0.smithi042.stdout:7/804: fdatasync d0/f1a 0 2024-09-19T09:41:45.322 INFO:tasks.workunit.client.0.smithi042.stdout:5/884: write d2/db/f10 [82996,18286] 0 2024-09-19T09:41:45.322 INFO:tasks.workunit.client.0.smithi042.stdout:5/885: fsync d2/d4/d64/da7/dda/de6/fca 0 2024-09-19T09:41:45.322 INFO:tasks.workunit.client.0.smithi042.stdout:5/886: fdatasync d2/fad 0 2024-09-19T09:41:45.328 INFO:tasks.workunit.client.0.smithi042.stdout:1/982: symlink d4/d15/d19/dae/d124/d12c/l13d 0 2024-09-19T09:41:45.328 INFO:tasks.workunit.client.0.smithi042.stdout:1/983: chown d4/d15/d61/d85/lf2 334 1 2024-09-19T09:41:45.328 INFO:tasks.workunit.client.0.smithi042.stdout:6/912: rename d1/de/d76/d99/db2/d34/d6f/d4a/f82 to d1/de/d76/d99/db2/d34/d6f/d4a/f119 0 2024-09-19T09:41:45.330 INFO:tasks.workunit.client.0.smithi042.stdout:7/805: creat d0/d3d/d92/dc7/f109 x:0 0 0 2024-09-19T09:41:45.331 INFO:tasks.workunit.client.0.smithi042.stdout:7/806: chown d0/d40/d9d/f8f 1035590 1 2024-09-19T09:41:45.331 INFO:tasks.workunit.client.0.smithi042.stdout:1/984: dread d4/f7b [0,4194304] 0 2024-09-19T09:41:45.331 INFO:tasks.workunit.client.0.smithi042.stdout:1/985: fdatasync d4/d15/d19/d42/d51/f81 0 2024-09-19T09:41:45.335 INFO:tasks.workunit.client.0.smithi042.stdout:6/913: symlink d1/de/d76/d99/db2/d34/d6f/d93/l11a 0 2024-09-19T09:41:45.335 INFO:tasks.workunit.client.0.smithi042.stdout:6/914: write d1/d20/d6a/d46/d92/d3a/f42 [710378,52902] 0 2024-09-19T09:41:45.335 INFO:tasks.workunit.client.0.smithi042.stdout:2/995: write f6 [5644373,84099] 0 2024-09-19T09:41:45.339 INFO:tasks.workunit.client.0.smithi042.stdout:6/915: mknod d1/de/d117/c11b 0 2024-09-19T09:41:45.339 INFO:tasks.workunit.client.0.smithi042.stdout:6/916: write d1/de/d76/d99/db2/d34/d3f/f96 [774182,120207] 0 2024-09-19T09:41:45.341 INFO:tasks.workunit.client.0.smithi042.stdout:7/807: read d0/d14/f83 [1771328,22877] 0 2024-09-19T09:41:45.341 INFO:tasks.workunit.client.0.smithi042.stdout:7/808: truncate d0/f59 4763992 0 2024-09-19T09:41:45.341 INFO:tasks.workunit.client.0.smithi042.stdout:9/781: dwrite d8/da/d89/da7/db6/db5/f83 [0,4194304] 0 2024-09-19T09:41:45.341 INFO:tasks.workunit.client.0.smithi042.stdout:4/922: rename d0/d1b/dd8 to d0/d1b/d69/dc0/d133 0 2024-09-19T09:41:45.344 INFO:tasks.workunit.client.0.smithi042.stdout:5/887: dwrite d2/f1e [0,4194304] 0 2024-09-19T09:41:45.344 INFO:tasks.workunit.client.0.smithi042.stdout:5/888: write d2/d4/fe7 [5146475,48148] 0 2024-09-19T09:41:45.344 INFO:tasks.workunit.client.0.smithi042.stdout:8/964: rename d1/da/dd/f3a to d1/d2e/f122 0 2024-09-19T09:41:45.345 INFO:tasks.workunit.client.0.smithi042.stdout:6/917: dread d1/de/d54/f87 [0,4194304] 0 2024-09-19T09:41:45.345 INFO:tasks.workunit.client.0.smithi042.stdout:4/923: creat d0/d67/d96/f134 x:0 0 0 2024-09-19T09:41:45.345 INFO:tasks.workunit.client.0.smithi042.stdout:0/878: sync 2024-09-19T09:41:45.346 INFO:tasks.workunit.client.0.smithi042.stdout:2/996: creat d7/f150 x:0 0 0 2024-09-19T09:41:45.349 INFO:tasks.workunit.client.0.smithi042.stdout:5/889: mkdir d2/d25/dfb/d12f 0 2024-09-19T09:41:45.350 INFO:tasks.workunit.client.0.smithi042.stdout:8/965: rmdir d1/da/dcd 39 2024-09-19T09:41:45.353 INFO:tasks.workunit.client.0.smithi042.stdout:1/986: rename d4/d12/d8d/d91/l128 to d4/d15/d9e/l13e 0 2024-09-19T09:41:45.354 INFO:tasks.workunit.client.0.smithi042.stdout:6/918: creat d1/d20/dc6/f11c x:0 0 0 2024-09-19T09:41:45.361 INFO:tasks.workunit.client.0.smithi042.stdout:0/879: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d109/f6c [0,4194304] 0 2024-09-19T09:41:45.361 INFO:tasks.workunit.client.0.smithi042.stdout:0/880: fsync d2/d10/d6b/f77 0 2024-09-19T09:41:45.361 INFO:tasks.workunit.client.0.smithi042.stdout:0/881: readlink d2/d10/d12/l5f 0 2024-09-19T09:41:45.361 INFO:tasks.workunit.client.0.smithi042.stdout:7/809: write d0/d3d/f4a [1237256,38222] 0 2024-09-19T09:41:45.361 INFO:tasks.workunit.client.0.smithi042.stdout:7/810: fdatasync d0/d3d/db0/f100 0 2024-09-19T09:41:45.361 INFO:tasks.workunit.client.0.smithi042.stdout:7/811: stat d0/d56/f88 0 2024-09-19T09:41:45.364 INFO:tasks.workunit.client.0.smithi042.stdout:8/966: symlink d1/da/dd/dac/l123 0 2024-09-19T09:41:45.368 INFO:tasks.workunit.client.0.smithi042.stdout:1/987: creat d4/d12/d8d/f13f x:0 0 0 2024-09-19T09:41:45.368 INFO:tasks.workunit.client.0.smithi042.stdout:6/919: mkdir d1/de/d76/d99/db2/d34/d6f/d93/db5/d11d 0 2024-09-19T09:41:45.368 INFO:tasks.workunit.client.0.smithi042.stdout:4/924: mknod d0/d1b/d69/dc0/d133/d11f/c135 0 2024-09-19T09:41:45.369 INFO:tasks.workunit.client.0.smithi042.stdout:4/925: dread - d0/d1b/d1c/d2e/d3b/d95/db1/f10c zero size 2024-09-19T09:41:45.372 INFO:tasks.workunit.client.0.smithi042.stdout:6/920: dread d1/de/d76/d99/db2/d34/d6f/d4a/fc3 [0,4194304] 0 2024-09-19T09:41:45.372 INFO:tasks.workunit.client.0.smithi042.stdout:7/812: rmdir d0/d3d/d85/d99 39 2024-09-19T09:41:45.372 INFO:tasks.workunit.client.0.smithi042.stdout:7/813: chown d0/d3d/d55/c9e 50 1 2024-09-19T09:41:45.372 INFO:tasks.workunit.client.0.smithi042.stdout:2/997: getdents d7/dd/d1f/d3f/dfa/d102 0 2024-09-19T09:41:45.372 INFO:tasks.workunit.client.0.smithi042.stdout:2/998: stat d7/dd/d14/d35/d4c/d70/d136/fd4 0 2024-09-19T09:41:45.373 INFO:tasks.workunit.client.0.smithi042.stdout:2/999: fdatasync d7/dd/d22/d30/f134 0 2024-09-19T09:41:45.373 INFO:tasks.workunit.client.0.smithi042.stdout:8/967: unlink d1/db2/fd4 0 2024-09-19T09:41:45.374 INFO:tasks.workunit.client.0.smithi042.stdout:6/921: write d1/fc [2482954,57040] 0 2024-09-19T09:41:45.374 INFO:tasks.workunit.client.0.smithi042.stdout:7/814: link d0/c10 d0/d14/d3a/ddc/db6/dbb/dcc/dfe/c10a 0 2024-09-19T09:41:45.374 INFO:tasks.workunit.client.0.smithi042.stdout:7/815: dread - d0/d3d/d85/d99/fb7 zero size 2024-09-19T09:41:45.374 INFO:tasks.workunit.client.0.smithi042.stdout:8/968: creat d1/da/dd/d8e/f124 x:0 0 0 2024-09-19T09:41:45.374 INFO:tasks.workunit.client.0.smithi042.stdout:8/969: chown d1/da8/d41/l4b 29 1 2024-09-19T09:41:45.376 INFO:tasks.workunit.client.0.smithi042.stdout:6/922: getdents d1/de/d12/d9a 0 2024-09-19T09:41:45.376 INFO:tasks.workunit.client.0.smithi042.stdout:6/923: fdatasync d1/d20/d6a/d46/fc1 0 2024-09-19T09:41:45.376 INFO:tasks.workunit.client.0.smithi042.stdout:5/890: dwrite d2/d4/d64/dab/f1d [0,4194304] 0 2024-09-19T09:41:45.377 INFO:tasks.workunit.client.0.smithi042.stdout:7/816: mknod d0/dde/c10b 0 2024-09-19T09:41:45.377 INFO:tasks.workunit.client.0.smithi042.stdout:7/817: fdatasync d0/d40/f65 0 2024-09-19T09:41:45.377 INFO:tasks.workunit.client.0.smithi042.stdout:7/818: chown d0/d3d/d92 214 1 2024-09-19T09:41:45.377 INFO:tasks.workunit.client.0.smithi042.stdout:1/988: dread d4/f94 [0,4194304] 0 2024-09-19T09:41:45.378 INFO:tasks.workunit.client.0.smithi042.stdout:7/819: write d0/d3d/d55/f71 [594296,74138] 0 2024-09-19T09:41:45.378 INFO:tasks.workunit.client.0.smithi042.stdout:8/970: creat d1/f125 x:0 0 0 2024-09-19T09:41:45.379 INFO:tasks.workunit.client.0.smithi042.stdout:6/924: truncate d1/de/f2d 23581 0 2024-09-19T09:41:45.380 INFO:tasks.workunit.client.0.smithi042.stdout:1/989: creat d4/f140 x:0 0 0 2024-09-19T09:41:45.381 INFO:tasks.workunit.client.0.smithi042.stdout:7/820: mknod d0/d14/d3a/ddc/db6/dbb/dcc/dfe/c10c 0 2024-09-19T09:41:45.384 INFO:tasks.workunit.client.0.smithi042.stdout:6/925: link d1/d20/l3e d1/de/d76/d99/db2/d34/d6f/d93/db5/l11e 0 2024-09-19T09:41:45.384 INFO:tasks.workunit.client.0.smithi042.stdout:6/926: fdatasync d1/de/d76/d99/db2/d34/d6f/f10a 0 2024-09-19T09:41:45.385 INFO:tasks.workunit.client.0.smithi042.stdout:5/891: symlink d2/d4/d20/d31/l130 0 2024-09-19T09:41:45.385 INFO:tasks.workunit.client.0.smithi042.stdout:5/892: chown d2/d25/f97 5607 1 2024-09-19T09:41:45.386 INFO:tasks.workunit.client.0.smithi042.stdout:8/971: dread d1/da8/d41/d55/f6b [0,4194304] 0 2024-09-19T09:41:45.386 INFO:tasks.workunit.client.0.smithi042.stdout:1/990: link d4/d12/d8d/dca/dd4/c131 d4/d15/d61/d85/dc9/c141 0 2024-09-19T09:41:45.387 INFO:tasks.workunit.client.0.smithi042.stdout:7/821: creat d0/d14/d3a/f10d x:0 0 0 2024-09-19T09:41:45.390 INFO:tasks.workunit.client.0.smithi042.stdout:6/927: rename d1/de/ld8 to d1/de/d76/d99/db2/d34/d6f/d93/db5/l11f 0 2024-09-19T09:41:45.390 INFO:tasks.workunit.client.0.smithi042.stdout:6/928: chown d1/de/d5d/cf6 6105576 1 2024-09-19T09:41:45.392 INFO:tasks.workunit.client.0.smithi042.stdout:1/991: creat d4/d15/d2e/db7/f142 x:0 0 0 2024-09-19T09:41:45.392 INFO:tasks.workunit.client.0.smithi042.stdout:4/926: dwrite d0/d1b/d1c/d2e/d3b/d95/db1/dba/d109/fa5 [0,4194304] 0 2024-09-19T09:41:45.393 INFO:tasks.workunit.client.0.smithi042.stdout:8/972: dread d1/da/dd/f5c [0,4194304] 0 2024-09-19T09:41:45.393 INFO:tasks.workunit.client.0.smithi042.stdout:8/973: read d1/d2e/ff5 [379517,82619] 0 2024-09-19T09:41:45.394 INFO:tasks.workunit.client.0.smithi042.stdout:1/992: symlink d4/d12/d8d/d91/d106/d127/l143 0 2024-09-19T09:41:45.395 INFO:tasks.workunit.client.0.smithi042.stdout:4/927: mknod d0/d28/d36/df9/c136 0 2024-09-19T09:41:45.396 INFO:tasks.workunit.client.0.smithi042.stdout:1/993: symlink d4/d12/db9/l144 0 2024-09-19T09:41:45.396 INFO:tasks.workunit.client.0.smithi042.stdout:1/994: read - d4/d12/d8d/de3/f125 zero size 2024-09-19T09:41:45.396 INFO:tasks.workunit.client.0.smithi042.stdout:1/995: fsync d4/d15/d2e/d105/f132 0 2024-09-19T09:41:45.401 INFO:tasks.workunit.client.0.smithi042.stdout:1/996: dread d4/d15/d19/d45/d82/d89/d126/dda/f2b [0,4194304] 0 2024-09-19T09:41:45.402 INFO:tasks.workunit.client.0.smithi042.stdout:1/997: truncate d4/d29/fc2 607983 0 2024-09-19T09:41:45.402 INFO:tasks.workunit.client.0.smithi042.stdout:1/998: fdatasync d4/f47 0 2024-09-19T09:41:45.405 INFO:tasks.workunit.client.0.smithi042.stdout:6/929: read d1/de/d12/fea [2805023,2312] 0 2024-09-19T09:41:45.406 INFO:tasks.workunit.client.0.smithi042.stdout:7/822: dread d0/d40/d9d/ff8 [0,4194304] 0 2024-09-19T09:41:45.406 INFO:tasks.workunit.client.0.smithi042.stdout:7/823: write d0/d14/d3a/f3f [1161778,44855] 0 2024-09-19T09:41:45.407 INFO:tasks.workunit.client.0.smithi042.stdout:5/893: dwrite d2/d4/d2e/f4c [0,4194304] 0 2024-09-19T09:41:45.407 INFO:tasks.workunit.client.0.smithi042.stdout:5/894: write d2/d25/f80 [698794,40791] 0 2024-09-19T09:41:45.408 INFO:tasks.workunit.client.0.smithi042.stdout:5/895: getdents d2/de3 0 2024-09-19T09:41:45.409 INFO:tasks.workunit.client.0.smithi042.stdout:7/824: dread d0/d3d/d92/da1/fe3 [0,4194304] 0 2024-09-19T09:41:45.410 INFO:tasks.workunit.client.0.smithi042.stdout:5/896: getdents d2/d4/d64/da7/db4 0 2024-09-19T09:41:45.411 INFO:tasks.workunit.client.0.smithi042.stdout:7/825: creat d0/d3d/d55/f10e x:0 0 0 2024-09-19T09:41:45.413 INFO:tasks.workunit.client.0.smithi042.stdout:7/826: link d0/d3d/d92/da1/f91 d0/d3d/d85/f10f 0 2024-09-19T09:41:45.415 INFO:tasks.workunit.client.0.smithi042.stdout:7/827: creat d0/d40/d9d/db5/f110 x:0 0 0 2024-09-19T09:41:45.417 INFO:tasks.workunit.client.0.smithi042.stdout:7/828: rename d0/d14/d3a to d0/d3d/d55/d111 0 2024-09-19T09:41:45.422 INFO:tasks.workunit.client.0.smithi042.stdout:6/930: write d1/de/d76/d99/db2/d34/d6f/d4a/f119 [2916493,100784] 0 2024-09-19T09:41:45.425 INFO:tasks.workunit.client.0.smithi042.stdout:6/931: symlink d1/de/d54/dcb/l120 0 2024-09-19T09:41:45.426 INFO:tasks.workunit.client.0.smithi042.stdout:6/932: creat d1/de/d54/dcb/f121 x:0 0 0 2024-09-19T09:41:45.427 INFO:tasks.workunit.client.0.smithi042.stdout:6/933: symlink d1/de/d54/dda/l122 0 2024-09-19T09:41:45.427 INFO:tasks.workunit.client.0.smithi042.stdout:6/934: dread - d1/d20/dc6/f11c zero size 2024-09-19T09:41:45.427 INFO:tasks.workunit.client.0.smithi042.stdout:6/935: write d1/de/d76/d99/db2/d34/d6f/d4a/d98/fa4 [752414,45723] 0 2024-09-19T09:41:45.428 INFO:tasks.workunit.client.0.smithi042.stdout:6/936: link d1/d20/f56 d1/d20/d6a/f123 0 2024-09-19T09:41:45.429 INFO:tasks.workunit.client.0.smithi042.stdout:6/937: stat d1/d20/d6a/d90/f31 0 2024-09-19T09:41:45.430 INFO:tasks.workunit.client.0.smithi042.stdout:6/938: mkdir d1/de/d12/d124 0 2024-09-19T09:41:45.430 INFO:tasks.workunit.client.0.smithi042.stdout:6/939: stat d1/de/d76/d99/db2/d34/d6f/d93/fc0 0 2024-09-19T09:41:45.430 INFO:tasks.workunit.client.0.smithi042.stdout:6/940: truncate d1/d20/d6a/d46/d95/f108 640769 0 2024-09-19T09:41:45.430 INFO:tasks.workunit.client.0.smithi042.stdout:6/941: creat d1/de/d76/d99/db2/d34/d6f/f125 x:0 0 0 2024-09-19T09:41:45.431 INFO:tasks.workunit.client.0.smithi042.stdout:8/974: dwrite d1/d2e/f60 [0,4194304] 0 2024-09-19T09:41:45.432 INFO:tasks.workunit.client.0.smithi042.stdout:4/928: dwrite d0/d1b/d1c/d2e/d3b/d95/db1/dba/d109/fa5 [0,4194304] 0 2024-09-19T09:41:45.432 INFO:tasks.workunit.client.0.smithi042.stdout:1/999: dwrite d4/f13 [0,4194304] 0 2024-09-19T09:41:45.433 INFO:tasks.workunit.client.0.smithi042.stdout:4/929: mkdir d0/d1b/d1c/d61/d12f/d137 0 2024-09-19T09:41:45.434 INFO:tasks.workunit.client.0.smithi042.stdout:4/930: fsync d0/d1b/d56/f80 0 2024-09-19T09:41:45.434 INFO:tasks.workunit.client.0.smithi042.stdout:4/931: write d0/d1b/d69/dc0/f100 [811529,130605] 0 2024-09-19T09:41:45.436 INFO:tasks.workunit.client.0.smithi042.stdout:5/897: dwrite d2/d25/dfb/f112 [0,4194304] 0 2024-09-19T09:41:45.436 INFO:tasks.workunit.client.0.smithi042.stdout:5/898: chown d2/d4/d20/d60/d72 28 1 2024-09-19T09:41:45.436 INFO:tasks.workunit.client.0.smithi042.stdout:5/899: stat d2/db/faf 0 2024-09-19T09:41:45.437 INFO:tasks.workunit.client.0.smithi042.stdout:7/829: dwrite d0/f82 [0,4194304] 0 2024-09-19T09:41:45.437 INFO:tasks.workunit.client.0.smithi042.stdout:7/830: dread - d0/d3d/d85/fa6 zero size 2024-09-19T09:41:45.439 INFO:tasks.workunit.client.0.smithi042.stdout:8/975: read d1/da8/d41/feb [4045684,19574] 0 2024-09-19T09:41:45.443 INFO:tasks.workunit.client.0.smithi042.stdout:8/976: symlink d1/da/d14/l126 0 2024-09-19T09:41:45.445 INFO:tasks.workunit.client.0.smithi042.stdout:8/977: symlink d1/l127 0 2024-09-19T09:41:45.448 INFO:tasks.workunit.client.0.smithi042.stdout:8/978: rmdir d1/da8/d92/dc7 39 2024-09-19T09:41:45.461 INFO:tasks.workunit.client.0.smithi042.stdout:7/831: dwrite d0/f17 [0,4194304] 0 2024-09-19T09:41:45.461 INFO:tasks.workunit.client.0.smithi042.stdout:7/832: chown d0/d3d/d55/d111/dec/lf5 9601 1 2024-09-19T09:41:45.461 INFO:tasks.workunit.client.0.smithi042.stdout:7/833: readlink d0/d3d/d92/la8 0 2024-09-19T09:41:45.463 INFO:tasks.workunit.client.0.smithi042.stdout:7/834: mkdir d0/d3d/d92/dc7/d112 0 2024-09-19T09:41:45.463 INFO:tasks.workunit.client.0.smithi042.stdout:7/835: write d0/d3d/d55/f5f [877527,101924] 0 2024-09-19T09:41:45.463 INFO:tasks.workunit.client.0.smithi042.stdout:7/836: dread - d0/d3d/d85/fa6 zero size 2024-09-19T09:41:45.463 INFO:tasks.workunit.client.0.smithi042.stdout:7/837: getdents d0/d3d/d55/d111/dec 0 2024-09-19T09:41:45.464 INFO:tasks.workunit.client.0.smithi042.stdout:5/900: dwrite d2/d4/d2e/fcd [0,4194304] 0 2024-09-19T09:41:45.464 INFO:tasks.workunit.client.0.smithi042.stdout:7/838: creat d0/d3d/d92/f113 x:0 0 0 2024-09-19T09:41:45.466 INFO:tasks.workunit.client.0.smithi042.stdout:5/901: link d2/d4/d20/d31/lce d2/db/d3c/d86/l131 0 2024-09-19T09:41:45.466 INFO:tasks.workunit.client.0.smithi042.stdout:5/902: stat d2/d4 0 2024-09-19T09:41:45.467 INFO:tasks.workunit.client.0.smithi042.stdout:5/903: readlink d2/d8e/l122 0 2024-09-19T09:41:45.467 INFO:tasks.workunit.client.0.smithi042.stdout:5/904: chown d2/d4/d20/d60/d72/d75/d10d/l114 196052 1 2024-09-19T09:41:45.467 INFO:tasks.workunit.client.0.smithi042.stdout:4/932: dwrite d0/d28/d87/da1/d11b/ff1 [4194304,4194304] 0 2024-09-19T09:41:45.468 INFO:tasks.workunit.client.0.smithi042.stdout:7/839: unlink d0/d14/f1c 0 2024-09-19T09:41:45.468 INFO:tasks.workunit.client.0.smithi042.stdout:5/905: symlink d2/d4/d20/da4/l132 0 2024-09-19T09:41:45.469 INFO:tasks.workunit.client.0.smithi042.stdout:4/933: truncate d0/d1b/d1c/d61/d7f/fe2 3482689 0 2024-09-19T09:41:45.470 INFO:tasks.workunit.client.0.smithi042.stdout:8/979: dwrite d1/db2/f108 [0,4194304] 0 2024-09-19T09:41:45.470 INFO:tasks.workunit.client.0.smithi042.stdout:5/906: rmdir d2/d4/d20/d31 39 2024-09-19T09:41:45.470 INFO:tasks.workunit.client.0.smithi042.stdout:4/934: mkdir d0/d1b/d1c/d2e/d44/d138 0 2024-09-19T09:41:45.472 INFO:tasks.workunit.client.0.smithi042.stdout:7/840: rename d0/d14/l64 to d0/d3d/d55/d111/ddc/db6/l114 0 2024-09-19T09:41:45.474 INFO:tasks.workunit.client.0.smithi042.stdout:5/907: mknod d2/d4/d20/d60/dea/c133 0 2024-09-19T09:41:45.475 INFO:tasks.workunit.client.0.smithi042.stdout:7/841: mknod d0/d40/c115 0 2024-09-19T09:41:45.475 INFO:tasks.workunit.client.0.smithi042.stdout:7/842: readlink d0/d40/lac 0 2024-09-19T09:41:45.479 INFO:tasks.workunit.client.0.smithi042.stdout:7/843: mkdir d0/d14/d9f/d116 0 2024-09-19T09:41:45.481 INFO:tasks.workunit.client.0.smithi042.stdout:8/980: rename d1/da/d3f/f5e to d1/da/d14/dfc/d116/f128 0 2024-09-19T09:41:45.483 INFO:tasks.workunit.client.0.smithi042.stdout:4/935: rename d0/d28/d36/df9 to d0/d28/d139 0 2024-09-19T09:41:45.483 INFO:tasks.workunit.client.0.smithi042.stdout:4/936: write d0/d1b/d1c/d2e/d3b/f7d [1348067,70959] 0 2024-09-19T09:41:45.485 INFO:tasks.workunit.client.0.smithi042.stdout:5/908: rename d2/d4/d20/d60/d72/d75/c10b to d2/db/d3c/c134 0 2024-09-19T09:41:45.486 INFO:tasks.workunit.client.0.smithi042.stdout:9/782: sync 2024-09-19T09:41:45.486 INFO:tasks.workunit.client.0.smithi042.stdout:9/783: readlink d8/db/ld7 0 2024-09-19T09:41:45.486 INFO:tasks.workunit.client.0.smithi042.stdout:4/937: mkdir d0/d1b/d1c/d2e/d44/dc1/d13a 0 2024-09-19T09:41:45.488 INFO:tasks.workunit.client.0.smithi042.stdout:9/784: rename d8/da/d89/d8e/fe1 to d8/da/d89/d8e/dae/feb 0 2024-09-19T09:41:45.488 INFO:tasks.workunit.client.0.smithi042.stdout:9/785: write d8/db/f26 [4419600,73416] 0 2024-09-19T09:41:45.489 INFO:tasks.workunit.client.0.smithi042.stdout:4/938: creat d0/d1b/d1c/d2e/d44/dc1/d129/f13b x:0 0 0 2024-09-19T09:41:45.489 INFO:tasks.workunit.client.0.smithi042.stdout:4/939: fdatasync d0/f15 0 2024-09-19T09:41:45.489 INFO:tasks.workunit.client.0.smithi042.stdout:9/786: mknod d8/da/d89/da7/db6/db5/d87/cec 0 2024-09-19T09:41:45.492 INFO:tasks.workunit.client.0.smithi042.stdout:9/787: symlink d8/da/d19/led 0 2024-09-19T09:41:45.492 INFO:tasks.workunit.client.0.smithi042.stdout:9/788: write d8/da/d89/da7/db6/dc7/fe0 [260208,97619] 0 2024-09-19T09:41:45.492 INFO:tasks.workunit.client.0.smithi042.stdout:9/789: fsync d8/da/d19/d1c/fcf 0 2024-09-19T09:41:45.492 INFO:tasks.workunit.client.0.smithi042.stdout:7/844: dread d0/d3d/d55/d111/ddc/f86 [4194304,4194304] 0 2024-09-19T09:41:45.493 INFO:tasks.workunit.client.0.smithi042.stdout:7/845: creat d0/d3d/d55/d111/dec/f117 x:0 0 0 2024-09-19T09:41:45.494 INFO:tasks.workunit.client.0.smithi042.stdout:8/981: write d1/da8/db1/dcb/ff8 [1226753,74445] 0 2024-09-19T09:41:45.494 INFO:tasks.workunit.client.0.smithi042.stdout:8/982: truncate d1/da/dd/d74/fff 651143 0 2024-09-19T09:41:45.494 INFO:tasks.workunit.client.0.smithi042.stdout:8/983: write d1/da/dd/d8e/f124 [541066,85396] 0 2024-09-19T09:41:45.504 INFO:tasks.workunit.client.0.smithi042.stdout:9/790: dread d8/da/d19/d1c/fe6 [0,4194304] 0 2024-09-19T09:41:45.509 INFO:tasks.workunit.client.0.smithi042.stdout:5/909: dwrite d2/d4/d64/d6a/f85 [4194304,4194304] 0 2024-09-19T09:41:45.522 INFO:tasks.workunit.client.0.smithi042.stdout:7/846: truncate d0/d40/d9d/ff8 860417 0 2024-09-19T09:41:45.535 INFO:tasks.workunit.client.0.smithi042.stdout:9/791: creat d8/da/d19/d1c/d21/de9/fee x:0 0 0 2024-09-19T09:41:45.535 INFO:tasks.workunit.client.0.smithi042.stdout:9/792: chown d8/da/d89/d8e/dae 10481 1 2024-09-19T09:41:45.540 INFO:tasks.workunit.client.0.smithi042.stdout:9/793: dread f1 [0,4194304] 0 2024-09-19T09:41:45.540 INFO:tasks.workunit.client.0.smithi042.stdout:9/794: chown d8/c9 1527 1 2024-09-19T09:41:45.548 INFO:tasks.workunit.client.0.smithi042.stdout:9/795: read d8/db/d31/fcb [1010496,29628] 0 2024-09-19T09:41:45.569 INFO:tasks.workunit.client.0.smithi042.stdout:9/796: dwrite d8/da/d19/d1c/d21/f96 [0,4194304] 0 2024-09-19T09:41:45.570 INFO:tasks.workunit.client.0.smithi042.stdout:9/797: fdatasync d8/da/d89/d8e/fc6 0 2024-09-19T09:41:45.614 INFO:tasks.workunit.client.0.smithi042.stdout:5/910: getdents d2/d4/d64 0 2024-09-19T09:41:45.615 INFO:tasks.workunit.client.0.smithi042.stdout:7/847: getdents d0/d14/d3c 0 2024-09-19T09:41:45.617 INFO:tasks.workunit.client.0.smithi042.stdout:0/882: sync 2024-09-19T09:41:45.617 INFO:tasks.workunit.client.0.smithi042.stdout:0/883: readlink d2/d10/df6/dbc/le1 0 2024-09-19T09:41:45.617 INFO:tasks.workunit.client.0.smithi042.stdout:0/884: chown d2/d10/d12/d16/d57/c7c 3672334 1 2024-09-19T09:41:45.617 INFO:tasks.workunit.client.0.smithi042.stdout:8/984: creat d1/da/d14/dfc/d116/d58/dd1/d114/f129 x:0 0 0 2024-09-19T09:41:45.619 INFO:tasks.workunit.client.0.smithi042.stdout:6/942: sync 2024-09-19T09:41:45.621 INFO:tasks.workunit.client.0.smithi042.stdout:4/940: sync 2024-09-19T09:41:45.623 INFO:tasks.workunit.client.0.smithi042.stdout:9/798: creat d8/da/d89/fef x:0 0 0 2024-09-19T09:41:45.631 INFO:tasks.workunit.client.0.smithi042.stdout:5/911: creat d2/d25/f135 x:0 0 0 2024-09-19T09:41:45.633 INFO:tasks.workunit.client.0.smithi042.stdout:9/799: dread d8/da/d19/d1c/f9e [0,4194304] 0 2024-09-19T09:41:45.633 INFO:tasks.workunit.client.0.smithi042.stdout:7/848: mkdir d0/d3d/d92/da1/d118 0 2024-09-19T09:41:45.633 INFO:tasks.workunit.client.0.smithi042.stdout:7/849: fsync d0/d3d/d55/d111/ddc/d9b/ff3 0 2024-09-19T09:41:45.633 INFO:tasks.workunit.client.0.smithi042.stdout:7/850: dread - d0/d40/d9d/fa3 zero size 2024-09-19T09:41:45.633 INFO:tasks.workunit.client.0.smithi042.stdout:7/851: chown d0/c58 0 1 2024-09-19T09:41:45.637 INFO:tasks.workunit.client.0.smithi042.stdout:6/943: symlink d1/d20/l126 0 2024-09-19T09:41:45.637 INFO:tasks.workunit.client.0.smithi042.stdout:6/944: write d1/d20/d6a/d46/fc1 [347884,9320] 0 2024-09-19T09:41:45.639 INFO:tasks.workunit.client.0.smithi042.stdout:0/885: dwrite d2/d10/d12/d24/d5b/fcb [0,4194304] 0 2024-09-19T09:41:45.639 INFO:tasks.workunit.client.0.smithi042.stdout:0/886: write d2/d10/d12/d24/d82/fdd [928169,47698] 0 2024-09-19T09:41:45.639 INFO:tasks.workunit.client.0.smithi042.stdout:4/941: unlink d0/d1b/f40 0 2024-09-19T09:41:45.642 INFO:tasks.workunit.client.0.smithi042.stdout:7/852: dread d0/d3d/d55/d111/ddc/d9b/ff4 [0,4194304] 0 2024-09-19T09:41:45.643 INFO:tasks.workunit.client.0.smithi042.stdout:7/853: chown d0/d40/l90 1740 1 2024-09-19T09:41:45.645 INFO:tasks.workunit.client.0.smithi042.stdout:5/912: link d2/d4/d20/d60/db0/fd0 d2/d4/d20/f136 0 2024-09-19T09:41:45.648 INFO:tasks.workunit.client.0.smithi042.stdout:9/800: creat d8/da/d19/d1c/ff0 x:0 0 0 2024-09-19T09:41:45.650 INFO:tasks.workunit.client.0.smithi042.stdout:6/945: creat d1/de/d76/d99/db2/d34/d6f/f127 x:0 0 0 2024-09-19T09:41:45.651 INFO:tasks.workunit.client.0.smithi042.stdout:6/946: write d1/d20/d6a/fab [1410820,16199] 0 2024-09-19T09:41:45.651 INFO:tasks.workunit.client.0.smithi042.stdout:6/947: write d1/de/d76/d99/db2/f80 [2514631,54318] 0 2024-09-19T09:41:45.654 INFO:tasks.workunit.client.0.smithi042.stdout:4/942: unlink d0/d1b/d1c/d2e/d44/dc1/d129/f13b 0 2024-09-19T09:41:45.656 INFO:tasks.workunit.client.0.smithi042.stdout:4/943: dread d0/d1b/f6f [0,4194304] 0 2024-09-19T09:41:45.659 INFO:tasks.workunit.client.0.smithi042.stdout:7/854: creat d0/d40/d9d/dd7/f119 x:0 0 0 2024-09-19T09:41:45.660 INFO:tasks.workunit.client.0.smithi042.stdout:5/913: creat d2/d25/dfb/f137 x:0 0 0 2024-09-19T09:41:45.663 INFO:tasks.workunit.client.0.smithi042.stdout:9/801: creat d8/da/d19/d1c/d21/d67/ff1 x:0 0 0 2024-09-19T09:41:45.666 INFO:tasks.workunit.client.0.smithi042.stdout:6/948: mkdir d1/d20/d6a/d90/d128 0 2024-09-19T09:41:45.669 INFO:tasks.workunit.client.0.smithi042.stdout:4/944: symlink d0/d67/l13c 0 2024-09-19T09:41:45.674 INFO:tasks.workunit.client.0.smithi042.stdout:7/855: creat d0/d40/d9d/dd0/f11a x:0 0 0 2024-09-19T09:41:45.674 INFO:tasks.workunit.client.0.smithi042.stdout:7/856: fdatasync d0/d56/d5c/f97 0 2024-09-19T09:41:45.674 INFO:tasks.workunit.client.0.smithi042.stdout:7/857: chown d0/d3d/d55/d87/lae 87047 1 2024-09-19T09:41:45.674 INFO:tasks.workunit.client.0.smithi042.stdout:7/858: chown d0/l104 374 1 2024-09-19T09:41:45.677 INFO:tasks.workunit.client.0.smithi042.stdout:9/802: mknod d8/da/d19/d1c/d21/cf2 0 2024-09-19T09:41:45.677 INFO:tasks.workunit.client.0.smithi042.stdout:9/803: write d8/da/d19/fcc [905443,45929] 0 2024-09-19T09:41:45.681 INFO:tasks.workunit.client.0.smithi042.stdout:4/945: mknod d0/d1b/d1c/d2e/d3b/d95/db1/c13d 0 2024-09-19T09:41:45.682 INFO:tasks.workunit.client.0.smithi042.stdout:5/914: dread d2/d4/d20/d31/f32 [0,4194304] 0 2024-09-19T09:41:45.682 INFO:tasks.workunit.client.0.smithi042.stdout:5/915: chown d2/d4/d20/da4/f10f 15 1 2024-09-19T09:41:45.685 INFO:tasks.workunit.client.0.smithi042.stdout:9/804: truncate d8/da/d19/d1c/d21/dbf/fd2 898232 0 2024-09-19T09:41:45.690 INFO:tasks.workunit.client.0.smithi042.stdout:6/949: truncate d1/d20/d6a/d46/fc1 157870 0 2024-09-19T09:41:45.696 INFO:tasks.workunit.client.0.smithi042.stdout:4/946: symlink d0/d28/l13e 0 2024-09-19T09:41:45.696 INFO:tasks.workunit.client.0.smithi042.stdout:4/947: getdents d0/d1b/d1c/d2e/d44/dc1/d13a 0 2024-09-19T09:41:45.696 INFO:tasks.workunit.client.0.smithi042.stdout:4/948: read - d0/d1b/d1c/d2e/d3b/d95/db1/dba/d109/faf zero size 2024-09-19T09:41:45.697 INFO:tasks.workunit.client.0.smithi042.stdout:5/916: creat d2/d4/d20/da4/f138 x:0 0 0 2024-09-19T09:41:45.698 INFO:tasks.workunit.client.0.smithi042.stdout:5/917: fsync d2/fad 0 2024-09-19T09:41:45.702 INFO:tasks.workunit.client.0.smithi042.stdout:9/805: creat d8/da/d19/d1c/d21/ff3 x:0 0 0 2024-09-19T09:41:45.702 INFO:tasks.workunit.client.0.smithi042.stdout:9/806: dread - d8/da/d89/d8e/dae/feb zero size 2024-09-19T09:41:45.705 INFO:tasks.workunit.client.0.smithi042.stdout:6/950: mknod d1/d20/d6a/d46/c129 0 2024-09-19T09:41:45.709 INFO:tasks.workunit.client.0.smithi042.stdout:4/949: link d0/d1b/f23 d0/d28/d87/da1/d11b/d5a/f13f 0 2024-09-19T09:41:45.717 INFO:tasks.workunit.client.0.smithi042.stdout:5/918: dwrite d2/d4/d2e/fcd [0,4194304] 0 2024-09-19T09:41:45.718 INFO:tasks.workunit.client.0.smithi042.stdout:6/951: dread d1/d20/f38 [0,4194304] 0 2024-09-19T09:41:45.718 INFO:tasks.workunit.client.0.smithi042.stdout:6/952: stat d1/d20 0 2024-09-19T09:41:45.718 INFO:tasks.workunit.client.0.smithi042.stdout:9/807: dwrite d8/d1d/f1f [0,4194304] 0 2024-09-19T09:41:45.721 INFO:tasks.workunit.client.0.smithi042.stdout:8/985: rename d1/da/dcd/lfd to d1/da8/d41/d55/d99/d110/l12a 0 2024-09-19T09:41:45.721 INFO:tasks.workunit.client.0.smithi042.stdout:8/986: chown d1/da8/db1/dcb/f11d 4881 1 2024-09-19T09:41:45.722 INFO:tasks.workunit.client.0.smithi042.stdout:8/987: readlink d1/da/d14/dfc/d116/d58/dd1/lf7 0 2024-09-19T09:41:45.722 INFO:tasks.workunit.client.0.smithi042.stdout:0/887: sync 2024-09-19T09:41:45.722 INFO:tasks.workunit.client.0.smithi042.stdout:7/859: rename d0/d40/d9d/db5 to d0/dde/d11b 0 2024-09-19T09:41:45.726 INFO:tasks.workunit.client.0.smithi042.stdout:4/950: rename d0/d28/d87/da1/d11b/d6e/da0 to d0/d28/d87/d140 0 2024-09-19T09:41:45.726 INFO:tasks.workunit.client.0.smithi042.stdout:4/951: chown d0/f14 614470447 1 2024-09-19T09:41:45.726 INFO:tasks.workunit.client.0.smithi042.stdout:4/952: readlink d0/d1b/d1c/d2e/d44/l5f 0 2024-09-19T09:41:45.726 INFO:tasks.workunit.client.0.smithi042.stdout:4/953: stat d0/d28/d139/f101 0 2024-09-19T09:41:45.731 INFO:tasks.workunit.client.0.smithi042.stdout:5/919: rename d2/d4/d20/d60/dea/c133 to d2/d25/dfb/d12f/c139 0 2024-09-19T09:41:45.732 INFO:tasks.workunit.client.0.smithi042.stdout:5/920: symlink d2/d4/d64/d6a/l13a 0 2024-09-19T09:41:45.732 INFO:tasks.workunit.client.0.smithi042.stdout:5/921: readlink d2/d4/d64/l8f 0 2024-09-19T09:41:45.732 INFO:tasks.workunit.client.0.smithi042.stdout:5/922: fsync d2/d25/dfb/f137 0 2024-09-19T09:41:45.734 INFO:tasks.workunit.client.0.smithi042.stdout:6/953: rename d1/d20/dc6/f11c to d1/d20/d6a/d46/d92/d4f/f12a 0 2024-09-19T09:41:45.734 INFO:tasks.workunit.client.0.smithi042.stdout:6/954: chown d1/de/d12/d9a 1857535771 1 2024-09-19T09:41:45.736 INFO:tasks.workunit.client.0.smithi042.stdout:9/808: rename d8/da/d19/d1c/da5/fe4 to d8/da/d19/d1c/d21/dbf/ff4 0 2024-09-19T09:41:45.736 INFO:tasks.workunit.client.0.smithi042.stdout:9/809: chown d8/d32/cd8 1742 1 2024-09-19T09:41:45.738 INFO:tasks.workunit.client.0.smithi042.stdout:7/860: rename d0/d14 to d0/d3d/d55/d111/ddc/d9b/d11c 0 2024-09-19T09:41:45.739 INFO:tasks.workunit.client.0.smithi042.stdout:5/923: rename d2/d4/d20/d60/db0/l125 to d2/d4/d20/d60/d72/d75/l13b 0 2024-09-19T09:41:45.740 INFO:tasks.workunit.client.0.smithi042.stdout:7/861: rmdir d0/d56 39 2024-09-19T09:41:45.740 INFO:tasks.workunit.client.0.smithi042.stdout:7/862: stat d0/d3d/d92/da1/f91 0 2024-09-19T09:41:45.742 INFO:tasks.workunit.client.0.smithi042.stdout:8/988: dwrite d1/da8/d41/fb5 [0,4194304] 0 2024-09-19T09:41:45.742 INFO:tasks.workunit.client.0.smithi042.stdout:8/989: fdatasync d1/da8/db1/dcb/f11d 0 2024-09-19T09:41:45.742 INFO:tasks.workunit.client.0.smithi042.stdout:8/990: rmdir d1/da8/d41/d55 39 2024-09-19T09:41:45.745 INFO:tasks.workunit.client.0.smithi042.stdout:8/991: rename d1/da8/f64 to d1/da/f12b 0 2024-09-19T09:41:45.746 INFO:tasks.workunit.client.0.smithi042.stdout:0/888: dwrite d2/d10/fbb [0,4194304] 0 2024-09-19T09:41:45.747 INFO:tasks.workunit.client.0.smithi042.stdout:9/810: dread d8/f11 [4194304,4194304] 0 2024-09-19T09:41:45.749 INFO:tasks.workunit.client.0.smithi042.stdout:5/924: read d2/d4/d64/dab/f1d [1661342,67988] 0 2024-09-19T09:41:45.749 INFO:tasks.workunit.client.0.smithi042.stdout:9/811: mkdir d8/da/d89/da7/df5 0 2024-09-19T09:41:45.749 INFO:tasks.workunit.client.0.smithi042.stdout:9/812: write d8/da/d19/d1c/d21/f84 [986237,125788] 0 2024-09-19T09:41:45.751 INFO:tasks.workunit.client.0.smithi042.stdout:0/889: rmdir d2/d10/d12/d16/d57/d99/dd0/da5/d8a 39 2024-09-19T09:41:45.751 INFO:tasks.workunit.client.0.smithi042.stdout:0/890: chown d2/d10/d12/d16/c92 428238 1 2024-09-19T09:41:45.751 INFO:tasks.workunit.client.0.smithi042.stdout:0/891: chown d2/d10/df6/dbc/ld9 151289 1 2024-09-19T09:41:45.752 INFO:tasks.workunit.client.0.smithi042.stdout:5/925: mkdir d2/d4/d20/d60/d72/d75/dc3/d13c 0 2024-09-19T09:41:45.752 INFO:tasks.workunit.client.0.smithi042.stdout:5/926: rmdir d2/d4/d20/d60/d72/d75 39 2024-09-19T09:41:45.758 INFO:tasks.workunit.client.0.smithi042.stdout:0/892: chown d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d109/f98 1056 1 2024-09-19T09:41:45.759 INFO:tasks.workunit.client.0.smithi042.stdout:8/992: dread d1/da/d3f/f67 [0,4194304] 0 2024-09-19T09:41:45.760 INFO:tasks.workunit.client.0.smithi042.stdout:0/893: creat d2/d10/d12/d16/d10f/f112 x:0 0 0 2024-09-19T09:41:45.769 INFO:tasks.workunit.client.0.smithi042.stdout:8/993: dread d1/da/dd/f49 [0,4194304] 0 2024-09-19T09:41:45.770 INFO:tasks.workunit.client.0.smithi042.stdout:8/994: fsync d1/da8/d41/fb5 0 2024-09-19T09:41:45.771 INFO:tasks.workunit.client.0.smithi042.stdout:8/995: creat d1/d2e/dd7/f12c x:0 0 0 2024-09-19T09:41:45.775 INFO:tasks.workunit.client.0.smithi042.stdout:0/894: write d2/d10/d12/d16/f5e [1889375,101192] 0 2024-09-19T09:41:45.777 INFO:tasks.workunit.client.0.smithi042.stdout:0/895: truncate d2/d10/d12/d16/f9b 846770 0 2024-09-19T09:41:45.777 INFO:tasks.workunit.client.0.smithi042.stdout:0/896: write d2/d10/d12/d24/d5b/fd3 [4683753,109122] 0 2024-09-19T09:41:45.777 INFO:tasks.workunit.client.0.smithi042.stdout:6/955: dwrite d1/de/d76/d99/db2/d34/d3f/f9e [4194304,4194304] 0 2024-09-19T09:41:45.777 INFO:tasks.workunit.client.0.smithi042.stdout:6/956: chown d1/d20/d6a/d46/d95/f10c 60767016 1 2024-09-19T09:41:45.778 INFO:tasks.workunit.client.0.smithi042.stdout:7/863: dwrite d0/d3d/d55/d111/f80 [0,4194304] 0 2024-09-19T09:41:45.779 INFO:tasks.workunit.client.0.smithi042.stdout:4/954: dwrite d0/f16 [0,4194304] 0 2024-09-19T09:41:45.779 INFO:tasks.workunit.client.0.smithi042.stdout:4/955: truncate d0/f92 472276 0 2024-09-19T09:41:45.779 INFO:tasks.workunit.client.0.smithi042.stdout:4/956: write d0/d28/d36/d91/f113 [5175879,25462] 0 2024-09-19T09:41:45.779 INFO:tasks.workunit.client.0.smithi042.stdout:0/897: mknod d2/d10/d12/d24/dbd/dfd/c113 0 2024-09-19T09:41:45.779 INFO:tasks.workunit.client.0.smithi042.stdout:8/996: dread d1/da/d14/dfc/d116/d59/f80 [0,4194304] 0 2024-09-19T09:41:45.781 INFO:tasks.workunit.client.0.smithi042.stdout:4/957: read d0/d1b/d1c/d2e/d3b/f3c [309889,123109] 0 2024-09-19T09:41:45.781 INFO:tasks.workunit.client.0.smithi042.stdout:4/958: chown d0/d1b/d1c/d61/dc8/f103 627487486 1 2024-09-19T09:41:45.786 INFO:tasks.workunit.client.0.smithi042.stdout:4/959: mknod d0/d1b/d1c/d61/d12f/c141 0 2024-09-19T09:41:45.787 INFO:tasks.workunit.client.0.smithi042.stdout:6/957: dread d1/d20/d6a/fcd [0,4194304] 0 2024-09-19T09:41:45.799 INFO:tasks.workunit.client.0.smithi042.stdout:7/864: dwrite d0/d40/f65 [0,4194304] 0 2024-09-19T09:41:45.799 INFO:tasks.workunit.client.0.smithi042.stdout:4/960: write d0/d1b/d1c/f59 [914316,23483] 0 2024-09-19T09:41:45.799 INFO:tasks.workunit.client.0.smithi042.stdout:9/813: rename d8/db/d31 to d8/da/d89/da7/db6/db5/d87/dad/de5/df6 0 2024-09-19T09:41:45.802 INFO:tasks.workunit.client.0.smithi042.stdout:0/898: rename d2/d10/d1d/c67 to d2/d10/df6/dbc/c114 0 2024-09-19T09:41:45.802 INFO:tasks.workunit.client.0.smithi042.stdout:9/814: symlink d8/da/d19/d1c/db4/lf7 0 2024-09-19T09:41:45.802 INFO:tasks.workunit.client.0.smithi042.stdout:9/815: chown d8/da/d89/da7/db6/db5/d87 174933630 1 2024-09-19T09:41:45.804 INFO:tasks.workunit.client.0.smithi042.stdout:6/958: rename d1/de/d76/d99/db2/d34/d6f/d4a/d98/fa4 to d1/d20/d6a/f12b 0 2024-09-19T09:41:45.804 INFO:tasks.workunit.client.0.smithi042.stdout:6/959: write d1/d20/d6a/d46/d95/f10c [604336,37605] 0 2024-09-19T09:41:45.804 INFO:tasks.workunit.client.0.smithi042.stdout:6/960: write d1/f5e [435952,60775] 0 2024-09-19T09:41:45.804 INFO:tasks.workunit.client.0.smithi042.stdout:6/961: truncate d1/d20/dc6/fdb 4867626 0 2024-09-19T09:41:45.805 INFO:tasks.workunit.client.0.smithi042.stdout:6/962: rmdir d1/de/d76/d99/db2/d34/d6f/d93 39 2024-09-19T09:41:45.807 INFO:tasks.workunit.client.0.smithi042.stdout:8/997: dwrite d1/da/d3f/f98 [0,4194304] 0 2024-09-19T09:41:45.810 INFO:tasks.workunit.client.0.smithi042.stdout:4/961: dread d0/d1b/d1c/d61/d7f/f8a [0,4194304] 0 2024-09-19T09:41:45.814 INFO:tasks.workunit.client.0.smithi042.stdout:4/962: mknod d0/d28/d87/da1/c142 0 2024-09-19T09:41:45.815 INFO:tasks.workunit.client.0.smithi042.stdout:4/963: write d0/d1b/f2a [922753,1762] 0 2024-09-19T09:41:45.818 INFO:tasks.workunit.client.0.smithi042.stdout:4/964: creat d0/d67/f143 x:0 0 0 2024-09-19T09:41:45.818 INFO:tasks.workunit.client.0.smithi042.stdout:4/965: dread - d0/d1b/d69/dc0/d133/f124 zero size 2024-09-19T09:41:45.822 INFO:tasks.workunit.client.0.smithi042.stdout:4/966: mkdir d0/d1b/d1c/d61/d7f/d144 0 2024-09-19T09:41:45.824 INFO:tasks.workunit.client.0.smithi042.stdout:5/927: sync 2024-09-19T09:41:45.824 INFO:tasks.workunit.client.0.smithi042.stdout:5/928: write d2/d4/d20/d60/d72/f108 [1041008,31297] 0 2024-09-19T09:41:45.825 INFO:tasks.workunit.client.0.smithi042.stdout:7/865: dwrite d0/d40/f65 [0,4194304] 0 2024-09-19T09:41:45.826 INFO:tasks.workunit.client.0.smithi042.stdout:4/967: mkdir d0/d1b/d1c/d145 0 2024-09-19T09:41:45.827 INFO:tasks.workunit.client.0.smithi042.stdout:7/866: mkdir d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/d11d 0 2024-09-19T09:41:45.834 INFO:tasks.workunit.client.0.smithi042.stdout:6/963: dwrite d1/de/d76/d99/db2/d34/f3d [0,4194304] 0 2024-09-19T09:41:45.835 INFO:tasks.workunit.client.0.smithi042.stdout:0/899: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/fe7 [0,4194304] 0 2024-09-19T09:41:45.836 INFO:tasks.workunit.client.0.smithi042.stdout:9/816: dwrite d8/da/d19/d1c/d21/d67/d7b/fdd [0,4194304] 0 2024-09-19T09:41:45.836 INFO:tasks.workunit.client.0.smithi042.stdout:9/817: write d8/da/d19/d1c/d21/d67/d7b/f9f [1255160,39583] 0 2024-09-19T09:41:45.836 INFO:tasks.workunit.client.0.smithi042.stdout:8/998: dwrite d1/da/d3f/f6f [0,4194304] 0 2024-09-19T09:41:45.836 INFO:tasks.workunit.client.0.smithi042.stdout:8/999: chown d1/da/dd/l3e 0 1 2024-09-19T09:41:45.837 INFO:tasks.workunit.client.0.smithi042.stdout:9/818: getdents d8/da/d89/da7/db6/dc7 0 2024-09-19T09:41:45.839 INFO:tasks.workunit.client.0.smithi042.stdout:9/819: symlink d8/d1d/d28/lf8 0 2024-09-19T09:41:45.839 INFO:tasks.workunit.client.0.smithi042.stdout:9/820: stat d8/da/d70/f92 0 2024-09-19T09:41:45.844 INFO:tasks.workunit.client.0.smithi042.stdout:0/900: write d2/d8e/f46 [1334059,38835] 0 2024-09-19T09:41:45.848 INFO:tasks.workunit.client.0.smithi042.stdout:5/929: dwrite d2/d4/d64/d6a/f85 [0,4194304] 0 2024-09-19T09:41:45.849 INFO:tasks.workunit.client.0.smithi042.stdout:5/930: mkdir d2/db/d3c/d13d 0 2024-09-19T09:41:45.850 INFO:tasks.workunit.client.0.smithi042.stdout:5/931: symlink d2/d25/dfb/l13e 0 2024-09-19T09:41:45.853 INFO:tasks.workunit.client.0.smithi042.stdout:7/867: dwrite d0/d40/ff1 [0,4194304] 0 2024-09-19T09:41:45.853 INFO:tasks.workunit.client.0.smithi042.stdout:5/932: dread d2/fe1 [0,4194304] 0 2024-09-19T09:41:45.853 INFO:tasks.workunit.client.0.smithi042.stdout:5/933: write d2/d4/d2e/fd7 [4764869,17509] 0 2024-09-19T09:41:45.853 INFO:tasks.workunit.client.0.smithi042.stdout:5/934: chown d2/db/d3c/f94 2 1 2024-09-19T09:41:45.856 INFO:tasks.workunit.client.0.smithi042.stdout:4/968: rename d0/d28/d87/da1/d11b/d6b/fe0 to d0/d28/d87/d140/f146 0 2024-09-19T09:41:45.857 INFO:tasks.workunit.client.0.smithi042.stdout:4/969: chown d0/d28/d87/da1/c142 8 1 2024-09-19T09:41:45.857 INFO:tasks.workunit.client.0.smithi042.stdout:6/964: rename d1/de/da7/dc2/f107 to d1/de/d54/dda/f12c 0 2024-09-19T09:41:45.859 INFO:tasks.workunit.client.0.smithi042.stdout:6/965: rmdir d1/de/d5d 39 2024-09-19T09:41:45.861 INFO:tasks.workunit.client.0.smithi042.stdout:6/966: rename d1/de/d54/dcb/l120 to d1/de/da7/l12d 0 2024-09-19T09:41:45.862 INFO:tasks.workunit.client.0.smithi042.stdout:9/821: creat d8/da/d89/da7/db6/db5/d87/ff9 x:0 0 0 2024-09-19T09:41:45.862 INFO:tasks.workunit.client.0.smithi042.stdout:9/822: truncate d8/da/d89/d8e/dae/feb 153438 0 2024-09-19T09:41:45.863 INFO:tasks.workunit.client.0.smithi042.stdout:9/823: link d8/da/d89/da7/db6/db5/d87/dad/de5/df6/f64 d8/da/ffa 0 2024-09-19T09:41:45.863 INFO:tasks.workunit.client.0.smithi042.stdout:6/967: dread d1/de/d76/d99/db2/d34/d6f/d4a/fc3 [0,4194304] 0 2024-09-19T09:41:45.864 INFO:tasks.workunit.client.0.smithi042.stdout:9/824: symlink d8/db/db1/lfb 0 2024-09-19T09:41:45.864 INFO:tasks.workunit.client.0.smithi042.stdout:9/825: fsync d8/da/d19/d1c/d21/d67/ff1 0 2024-09-19T09:41:45.864 INFO:tasks.workunit.client.0.smithi042.stdout:6/968: rmdir d1/d20 39 2024-09-19T09:41:45.865 INFO:tasks.workunit.client.0.smithi042.stdout:9/826: mkdir d8/da/d89/da7/db6/db5/d87/dad/de5/dfc 0 2024-09-19T09:41:45.870 INFO:tasks.workunit.client.0.smithi042.stdout:7/868: dwrite d0/f17 [4194304,4194304] 0 2024-09-19T09:41:45.870 INFO:tasks.workunit.client.0.smithi042.stdout:4/970: read d0/d28/d87/da1/fca [340767,15760] 0 2024-09-19T09:41:45.872 INFO:tasks.workunit.client.0.smithi042.stdout:9/827: dread d8/d1d/d28/f9d [0,4194304] 0 2024-09-19T09:41:45.876 INFO:tasks.workunit.client.0.smithi042.stdout:7/869: creat d0/dde/d11b/f11e x:0 0 0 2024-09-19T09:41:45.878 INFO:tasks.workunit.client.0.smithi042.stdout:7/870: creat d0/d3d/f11f x:0 0 0 2024-09-19T09:41:45.878 INFO:tasks.workunit.client.0.smithi042.stdout:7/871: write d0/d40/d9d/f8f [1080798,26850] 0 2024-09-19T09:41:45.878 INFO:tasks.workunit.client.0.smithi042.stdout:7/872: write d0/fbe [223021,4908] 0 2024-09-19T09:41:45.879 INFO:tasks.workunit.client.0.smithi042.stdout:5/935: link d2/d4/d20/d31/lce d2/d4/d64/d110/l13f 0 2024-09-19T09:41:45.879 INFO:tasks.workunit.client.0.smithi042.stdout:5/936: read - d2/d4/d64/da7/db4/dd8/fe5 zero size 2024-09-19T09:41:45.879 INFO:tasks.workunit.client.0.smithi042.stdout:5/937: dread - d2/d4/d20/da4/f138 zero size 2024-09-19T09:41:45.879 INFO:tasks.workunit.client.0.smithi042.stdout:5/938: dread - d2/d4/d64/da7/dda/de6/f105 zero size 2024-09-19T09:41:45.879 INFO:tasks.workunit.client.0.smithi042.stdout:6/969: dread d1/d20/d6a/d46/d92/d3a/f4d [0,4194304] 0 2024-09-19T09:41:45.880 INFO:tasks.workunit.client.0.smithi042.stdout:5/939: getdents d2/d4/d2e 0 2024-09-19T09:41:45.881 INFO:tasks.workunit.client.0.smithi042.stdout:6/970: creat d1/de/d76/f12e x:0 0 0 2024-09-19T09:41:45.882 INFO:tasks.workunit.client.0.smithi042.stdout:5/940: creat d2/d4/d2e/f140 x:0 0 0 2024-09-19T09:41:45.883 INFO:tasks.workunit.client.0.smithi042.stdout:6/971: mkdir d1/de/d76/de9/d12f 0 2024-09-19T09:41:45.883 INFO:tasks.workunit.client.0.smithi042.stdout:5/941: dread d2/d4/d20/ff4 [0,4194304] 0 2024-09-19T09:41:45.885 INFO:tasks.workunit.client.0.smithi042.stdout:5/942: unlink d2/d4/d64/dab/f1a 0 2024-09-19T09:41:45.885 INFO:tasks.workunit.client.0.smithi042.stdout:5/943: read d2/f1b [4258281,31894] 0 2024-09-19T09:41:45.886 INFO:tasks.workunit.client.0.smithi042.stdout:0/901: dwrite d2/d10/d1d/f25 [0,4194304] 0 2024-09-19T09:41:45.887 INFO:tasks.workunit.client.0.smithi042.stdout:5/944: unlink d2/db/d3c/c134 0 2024-09-19T09:41:45.889 INFO:tasks.workunit.client.0.smithi042.stdout:0/902: unlink d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d109/db2/l105 0 2024-09-19T09:41:45.890 INFO:tasks.workunit.client.0.smithi042.stdout:7/873: dread d0/d3d/d55/d111/f7e [0,4194304] 0 2024-09-19T09:41:45.892 INFO:tasks.workunit.client.0.smithi042.stdout:7/874: creat d0/d3d/d55/d111/ddc/db6/dbb/dcc/dfe/f120 x:0 0 0 2024-09-19T09:41:45.893 INFO:tasks.workunit.client.0.smithi042.stdout:7/875: mkdir d0/d3d/d92/da1/d118/d121 0 2024-09-19T09:41:45.894 INFO:tasks.workunit.client.0.smithi042.stdout:4/971: dwrite d0/d28/fac [4194304,4194304] 0 2024-09-19T09:41:45.895 INFO:tasks.workunit.client.0.smithi042.stdout:7/876: rmdir d0/d3d/d92/da1/d118 39 2024-09-19T09:41:45.896 INFO:tasks.workunit.client.0.smithi042.stdout:5/945: dread d2/d4/d64/dab/f47 [0,4194304] 0 2024-09-19T09:41:45.896 INFO:tasks.workunit.client.0.smithi042.stdout:5/946: chown d2/db/c126 6 1 2024-09-19T09:41:45.897 INFO:tasks.workunit.client.0.smithi042.stdout:9/828: link d8/da/d89/da7/db6/db5/faa d8/d1d/d28/ffd 0 2024-09-19T09:41:45.897 INFO:tasks.workunit.client.0.smithi042.stdout:9/829: write d8/da/d19/d1c/d21/d67/f5b [4549294,20734] 0 2024-09-19T09:41:45.897 INFO:tasks.workunit.client.0.smithi042.stdout:5/947: truncate d2/d25/d37/dc2/ff6 2167283 0 2024-09-19T09:41:45.898 INFO:tasks.workunit.client.0.smithi042.stdout:9/830: creat d8/da/d19/d1c/d21/d67/d7b/ffe x:0 0 0 2024-09-19T09:41:45.899 INFO:tasks.workunit.client.0.smithi042.stdout:5/948: creat d2/d4/d2e/f141 x:0 0 0 2024-09-19T09:41:45.899 INFO:tasks.workunit.client.0.smithi042.stdout:5/949: readlink d2/db/l13 0 2024-09-19T09:41:45.903 INFO:tasks.workunit.client.0.smithi042.stdout:4/972: dread d0/d1b/d1c/f51 [0,4194304] 0 2024-09-19T09:41:45.904 INFO:tasks.workunit.client.0.smithi042.stdout:9/831: write d8/f6f [2887917,63310] 0 2024-09-19T09:41:45.905 INFO:tasks.workunit.client.0.smithi042.stdout:9/832: mknod d8/da/cff 0 2024-09-19T09:41:45.905 INFO:tasks.workunit.client.0.smithi042.stdout:6/972: dwrite d1/de/d76/d99/db2/d34/d6f/d4a/d98/fd4 [0,4194304] 0 2024-09-19T09:41:45.905 INFO:tasks.workunit.client.0.smithi042.stdout:6/973: truncate d1/d20/d6a/fcd 4725056 0 2024-09-19T09:41:45.905 INFO:tasks.workunit.client.0.smithi042.stdout:6/974: readlink d1/de/d12/l1b 0 2024-09-19T09:41:45.906 INFO:tasks.workunit.client.0.smithi042.stdout:9/833: creat d8/d1d/dd6/f100 x:0 0 0 2024-09-19T09:41:45.906 INFO:tasks.workunit.client.0.smithi042.stdout:5/950: read d2/d25/f9f [3326305,101690] 0 2024-09-19T09:41:45.907 INFO:tasks.workunit.client.0.smithi042.stdout:9/834: creat d8/d1d/d28/f101 x:0 0 0 2024-09-19T09:41:45.907 INFO:tasks.workunit.client.0.smithi042.stdout:9/835: dread - d8/da/d19/d1c/d21/dbf/ff4 zero size 2024-09-19T09:41:45.907 INFO:tasks.workunit.client.0.smithi042.stdout:5/951: mkdir d2/d4/d64/da7/dda/d142 0 2024-09-19T09:41:45.907 INFO:tasks.workunit.client.0.smithi042.stdout:5/952: write d2/d4/d64/dab/f1d [3686908,108990] 0 2024-09-19T09:41:45.908 INFO:tasks.workunit.client.0.smithi042.stdout:5/953: symlink d2/d4/d20/da4/dde/d102/d11d/l143 0 2024-09-19T09:41:45.909 INFO:tasks.workunit.client.0.smithi042.stdout:5/954: chown d2/d4/d20/d60/dea 1432 1 2024-09-19T09:41:45.910 INFO:tasks.workunit.client.0.smithi042.stdout:9/836: unlink d8/da/d89/da7/db6/db5/d87/dad/de5/df6/c85 0 2024-09-19T09:41:45.910 INFO:tasks.workunit.client.0.smithi042.stdout:9/837: dread - d8/da/d19/d1c/fb7 zero size 2024-09-19T09:41:45.911 INFO:tasks.workunit.client.0.smithi042.stdout:5/955: dread d2/d4/d20/d60/d72/f84 [0,4194304] 0 2024-09-19T09:41:45.911 INFO:tasks.workunit.client.0.smithi042.stdout:5/956: truncate d2/d4/d64/da7/db4/dd8/fe5 1040772 0 2024-09-19T09:41:45.911 INFO:tasks.workunit.client.0.smithi042.stdout:5/957: getdents d2/d4/d64 0 2024-09-19T09:41:45.911 INFO:tasks.workunit.client.0.smithi042.stdout:5/958: truncate d2/d4/fa 4913268 0 2024-09-19T09:41:45.913 INFO:tasks.workunit.client.0.smithi042.stdout:0/903: rename d2/d10/l37 to d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/l115 0 2024-09-19T09:41:45.913 INFO:tasks.workunit.client.0.smithi042.stdout:0/904: chown d2/d10/d12/d16/d57/d99/dd0/da5/f22 247 1 2024-09-19T09:41:45.915 INFO:tasks.workunit.client.0.smithi042.stdout:7/877: rename d0/d3d/d55/d111/ddc/d9b/d11c/d3c/lb9 to d0/d3d/l122 0 2024-09-19T09:41:45.915 INFO:tasks.workunit.client.0.smithi042.stdout:7/878: fsync d0/d40/d9d/dd0/fd8 0 2024-09-19T09:41:45.915 INFO:tasks.workunit.client.0.smithi042.stdout:7/879: read d0/f59 [1348881,118223] 0 2024-09-19T09:41:45.916 INFO:tasks.workunit.client.0.smithi042.stdout:0/905: mknod d2/d10/d12/d16/d57/d78/c116 0 2024-09-19T09:41:45.917 INFO:tasks.workunit.client.0.smithi042.stdout:0/906: write d2/d10/d12/d24/d5b/fc9 [601246,89396] 0 2024-09-19T09:41:45.920 INFO:tasks.workunit.client.0.smithi042.stdout:6/975: rename d1/d20/d6a/d46/d92/d4f/f9b to d1/de/d76/d99/db2/d34/d6f/f130 0 2024-09-19T09:41:45.921 INFO:tasks.workunit.client.0.smithi042.stdout:6/976: mknod d1/d20/d6a/d46/d92/c131 0 2024-09-19T09:41:45.921 INFO:tasks.workunit.client.0.smithi042.stdout:6/977: chown d1/de/d76/d99/db2/d34/d6f/d93/db5/l11e 695 1 2024-09-19T09:41:45.922 INFO:tasks.workunit.client.0.smithi042.stdout:0/907: mkdir d2/d10/d12/d16/d57/d99/dd0/d117 0 2024-09-19T09:41:45.923 INFO:tasks.workunit.client.0.smithi042.stdout:0/908: chown d2/d8e/c49 4115 1 2024-09-19T09:41:45.923 INFO:tasks.workunit.client.0.smithi042.stdout:0/909: write d2/d10/d12/d24/fee [711578,17158] 0 2024-09-19T09:41:45.923 INFO:tasks.workunit.client.0.smithi042.stdout:5/959: write d2/d25/dfb/f112 [3102718,91147] 0 2024-09-19T09:41:45.923 INFO:tasks.workunit.client.0.smithi042.stdout:5/960: truncate d2/d4/d20/d60/d72/f65 549344 0 2024-09-19T09:41:45.923 INFO:tasks.workunit.client.0.smithi042.stdout:5/961: truncate d2/d4/d20/d60/db0/ffc 679372 0 2024-09-19T09:41:45.926 INFO:tasks.workunit.client.0.smithi042.stdout:6/978: creat d1/de/d12/d124/f132 x:0 0 0 2024-09-19T09:41:45.928 INFO:tasks.workunit.client.0.smithi042.stdout:0/910: write d2/d10/fbb [2433275,124812] 0 2024-09-19T09:41:45.930 INFO:tasks.workunit.client.0.smithi042.stdout:4/973: dwrite d0/d1b/f2a [0,4194304] 0 2024-09-19T09:41:45.931 INFO:tasks.workunit.client.0.smithi042.stdout:0/911: unlink d2/d10/d12/d16/d57/d99/dd0/da5/d8a/l8d 0 2024-09-19T09:41:45.932 INFO:tasks.workunit.client.0.smithi042.stdout:5/962: creat d2/d4/d20/da4/dde/d102/f144 x:0 0 0 2024-09-19T09:41:45.933 INFO:tasks.workunit.client.0.smithi042.stdout:6/979: mknod d1/de/d76/d99/db2/d34/d6f/d4a/c133 0 2024-09-19T09:41:45.933 INFO:tasks.workunit.client.0.smithi042.stdout:6/980: stat d1/de/d76/f7a 0 2024-09-19T09:41:45.933 INFO:tasks.workunit.client.0.smithi042.stdout:5/963: read d2/d25/d37/fee [79525,16723] 0 2024-09-19T09:41:45.935 INFO:tasks.workunit.client.0.smithi042.stdout:9/838: dwrite d8/da/d19/d1c/fcf [0,4194304] 0 2024-09-19T09:41:45.935 INFO:tasks.workunit.client.0.smithi042.stdout:9/839: chown d8/da/d89/da7/db6/dc7/fe0 0 1 2024-09-19T09:41:45.935 INFO:tasks.workunit.client.0.smithi042.stdout:9/840: write d8/da/d19/d1c/d21/d67/ff1 [675723,119456] 0 2024-09-19T09:41:45.940 INFO:tasks.workunit.client.0.smithi042.stdout:5/964: mknod d2/d4/d20/dc0/c145 0 2024-09-19T09:41:45.940 INFO:tasks.workunit.client.0.smithi042.stdout:0/912: rename d2/d10/d12/da4/c103 to d2/d10/d12/d16/c118 0 2024-09-19T09:41:45.940 INFO:tasks.workunit.client.0.smithi042.stdout:5/965: truncate d2/d4/d20/d60/db0/ff1 324959 0 2024-09-19T09:41:45.940 INFO:tasks.workunit.client.0.smithi042.stdout:5/966: fdatasync d2/d4/d64/d6a/fdf 0 2024-09-19T09:41:45.952 INFO:tasks.workunit.client.0.smithi042.stdout:5/967: link d2/d4/d20/d60/db0/c12a d2/d4/d64/da7/dda/d142/c146 0 2024-09-19T09:41:45.952 INFO:tasks.workunit.client.0.smithi042.stdout:5/968: getdents d2/d4/d8a 0 2024-09-19T09:41:45.953 INFO:tasks.workunit.client.0.smithi042.stdout:5/969: unlink d2/d25/d37/fee 0 2024-09-19T09:41:45.954 INFO:tasks.workunit.client.0.smithi042.stdout:4/974: dwrite d0/f71 [0,4194304] 0 2024-09-19T09:41:45.954 INFO:tasks.workunit.client.0.smithi042.stdout:4/975: write d0/d1b/d69/f122 [34457,59228] 0 2024-09-19T09:41:45.961 INFO:tasks.workunit.client.0.smithi042.stdout:6/981: dwrite d1/d20/d6a/f12b [0,4194304] 0 2024-09-19T09:41:45.961 INFO:tasks.workunit.client.0.smithi042.stdout:6/982: chown d1/d20/d6a/d46/d95/f108 822 1 2024-09-19T09:41:45.965 INFO:tasks.workunit.client.0.smithi042.stdout:6/983: rmdir d1/de/d76/d99/db2/d34/d6f 39 2024-09-19T09:41:45.965 INFO:tasks.workunit.client.0.smithi042.stdout:6/984: stat d1/d20/d6a/d46/d92/d3a/f75 0 2024-09-19T09:41:45.965 INFO:tasks.workunit.client.0.smithi042.stdout:6/985: fsync d1/f18 0 2024-09-19T09:41:45.965 INFO:tasks.workunit.client.0.smithi042.stdout:6/986: read d1/d20/d6a/d46/d92/d3a/f47 [193708,20977] 0 2024-09-19T09:41:45.966 INFO:tasks.workunit.client.0.smithi042.stdout:6/987: symlink d1/de/d12/d124/l134 0 2024-09-19T09:41:45.966 INFO:tasks.workunit.client.0.smithi042.stdout:6/988: readlink d1/l14 0 2024-09-19T09:41:45.966 INFO:tasks.workunit.client.0.smithi042.stdout:6/989: mkdir d1/d20/d6a/d90/d135 0 2024-09-19T09:41:45.966 INFO:tasks.workunit.client.0.smithi042.stdout:5/970: write d2/db/d3c/f94 [3849624,117876] 0 2024-09-19T09:41:45.969 INFO:tasks.workunit.client.0.smithi042.stdout:5/971: write d2/d25/d37/dc2/ff6 [310738,65346] 0 2024-09-19T09:41:45.969 INFO:tasks.workunit.client.0.smithi042.stdout:5/972: fdatasync d2/d4/d20/d60/d72/fd2 0 2024-09-19T09:41:45.970 INFO:tasks.workunit.client.0.smithi042.stdout:4/976: dread d0/d28/d87/da1/d11b/d5a/f13f [0,4194304] 0 2024-09-19T09:41:45.970 INFO:tasks.workunit.client.0.smithi042.stdout:4/977: fdatasync d0/d28/d87/d140/f146 0 2024-09-19T09:41:45.970 INFO:tasks.workunit.client.0.smithi042.stdout:4/978: chown d0/cab 343 1 2024-09-19T09:41:45.970 INFO:tasks.workunit.client.0.smithi042.stdout:4/979: readlink d0/l8 0 2024-09-19T09:41:45.970 INFO:tasks.workunit.client.0.smithi042.stdout:5/973: creat d2/d4/d64/d110/f147 x:0 0 0 2024-09-19T09:41:45.970 INFO:tasks.workunit.client.0.smithi042.stdout:4/980: mkdir d0/d28/d147 0 2024-09-19T09:41:45.971 INFO:tasks.workunit.client.0.smithi042.stdout:4/981: symlink d0/d1b/d1c/d2e/d3b/d95/db1/l148 0 2024-09-19T09:41:45.973 INFO:tasks.workunit.client.0.smithi042.stdout:4/982: mknod d0/d1b/c149 0 2024-09-19T09:41:45.974 INFO:tasks.workunit.client.0.smithi042.stdout:4/983: symlink d0/d1b/d1c/d2e/d44/dc1/l14a 0 2024-09-19T09:41:45.974 INFO:tasks.workunit.client.0.smithi042.stdout:4/984: stat d0/d1b/d1c/d61/l11d 0 2024-09-19T09:41:45.975 INFO:tasks.workunit.client.0.smithi042.stdout:5/974: dread d2/d4/d20/d31/f109 [0,4194304] 0 2024-09-19T09:41:45.975 INFO:tasks.workunit.client.0.smithi042.stdout:5/975: write d2/d4/d20/da4/f10f [887277,88644] 0 2024-09-19T09:41:45.975 INFO:tasks.workunit.client.0.smithi042.stdout:4/985: truncate d0/d28/d87/da1/d11b/fd9 1014218 0 2024-09-19T09:41:45.977 INFO:tasks.workunit.client.0.smithi042.stdout:4/986: creat d0/d1b/d56/d86/f14b x:0 0 0 2024-09-19T09:41:45.978 INFO:tasks.workunit.client.0.smithi042.stdout:4/987: creat d0/d1b/d1c/d6a/d123/f14c x:0 0 0 2024-09-19T09:41:45.983 INFO:tasks.workunit.client.0.smithi042.stdout:5/976: dread d2/d4/f15 [0,4194304] 0 2024-09-19T09:41:45.983 INFO:tasks.workunit.client.0.smithi042.stdout:5/977: write d2/d4/d64/da7/f23 [49427,60511] 0 2024-09-19T09:41:45.987 INFO:tasks.workunit.client.0.smithi042.stdout:6/990: dwrite d1/de/d76/d99/db2/d34/f73 [0,4194304] 0 2024-09-19T09:41:45.987 INFO:tasks.workunit.client.0.smithi042.stdout:6/991: chown d1/c10d 51823 1 2024-09-19T09:41:45.988 INFO:tasks.workunit.client.0.smithi042.stdout:6/992: readlink d1/d20/d6a/d46/d92/l63 0 2024-09-19T09:41:45.991 INFO:tasks.workunit.client.0.smithi042.stdout:5/978: dread d2/db/f2f [4194304,4194304] 0 2024-09-19T09:41:45.997 INFO:tasks.workunit.client.0.smithi042.stdout:7/880: sync 2024-09-19T09:41:45.998 INFO:tasks.workunit.client.0.smithi042.stdout:7/881: symlink d0/d3d/d55/d111/ddc/l123 0 2024-09-19T09:41:46.003 INFO:tasks.workunit.client.0.smithi042.stdout:4/988: dwrite d0/d28/fa9 [0,4194304] 0 2024-09-19T09:41:46.003 INFO:tasks.workunit.client.0.smithi042.stdout:4/989: truncate d0/f11a 865294 0 2024-09-19T09:41:46.005 INFO:tasks.workunit.client.0.smithi042.stdout:4/990: link d0/d1b/d69/dc0/cee d0/d1b/d1c/d61/d12f/c14d 0 2024-09-19T09:41:46.006 INFO:tasks.workunit.client.0.smithi042.stdout:4/991: symlink d0/d28/d147/l14e 0 2024-09-19T09:41:46.007 INFO:tasks.workunit.client.0.smithi042.stdout:4/992: creat d0/d1b/d69/dc0/f14f x:0 0 0 2024-09-19T09:41:46.009 INFO:tasks.workunit.client.0.smithi042.stdout:5/979: rename d2/d4/d64/da7/dda/de6 to d2/d4/d20/d60/d72/d75/d10d/d148 0 2024-09-19T09:41:46.011 INFO:tasks.workunit.client.0.smithi042.stdout:7/882: rename d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/ca2 to d0/d3d/d85/d99/c124 0 2024-09-19T09:41:46.011 INFO:tasks.workunit.client.0.smithi042.stdout:5/980: mkdir d2/d25/d37/d149 0 2024-09-19T09:41:46.013 INFO:tasks.workunit.client.0.smithi042.stdout:7/883: unlink d0/lc 0 2024-09-19T09:41:46.013 INFO:tasks.workunit.client.0.smithi042.stdout:7/884: readlink d0/d3d/d55/lca 0 2024-09-19T09:41:46.021 INFO:tasks.workunit.client.0.smithi042.stdout:7/885: write d0/d3d/d85/d99/fd9 [596053,73856] 0 2024-09-19T09:41:46.022 INFO:tasks.workunit.client.0.smithi042.stdout:7/886: rmdir d0/d3d/d55/d111/ddc/d9b/d11c/d9f 39 2024-09-19T09:41:46.023 INFO:tasks.workunit.client.0.smithi042.stdout:5/981: link d2/d4/d64/d110/f147 d2/d25/d37/dc2/f14a 0 2024-09-19T09:41:46.023 INFO:tasks.workunit.client.0.smithi042.stdout:4/993: dwrite d0/d28/d87/d140/fb9 [0,4194304] 0 2024-09-19T09:41:46.023 INFO:tasks.workunit.client.0.smithi042.stdout:5/982: fsync d2/d4/d20/f45 0 2024-09-19T09:41:46.024 INFO:tasks.workunit.client.0.smithi042.stdout:5/983: fdatasync d2/d4/d20/da4/f10f 0 2024-09-19T09:41:46.024 INFO:tasks.workunit.client.0.smithi042.stdout:5/984: fdatasync d2/d4/d20/ff4 0 2024-09-19T09:41:46.024 INFO:tasks.workunit.client.0.smithi042.stdout:7/887: link d0/d3d/db0/c103 d0/d3d/d55/d111/ddc/d9b/d11c/d3c/c125 0 2024-09-19T09:41:46.025 INFO:tasks.workunit.client.0.smithi042.stdout:7/888: mkdir d0/d56/d5c/d126 0 2024-09-19T09:41:46.026 INFO:tasks.workunit.client.0.smithi042.stdout:7/889: chown d0/d3d/d55/d111/ddc/d9b/ff3 62202217 1 2024-09-19T09:41:46.027 INFO:tasks.workunit.client.0.smithi042.stdout:7/890: creat d0/d3d/d55/d111/ddc/d9b/d11c/d3c/f127 x:0 0 0 2024-09-19T09:41:46.039 INFO:tasks.workunit.client.0.smithi042.stdout:5/985: dread d2/d4/f56 [0,4194304] 0 2024-09-19T09:41:46.039 INFO:tasks.workunit.client.0.smithi042.stdout:7/891: dread d0/d3d/f4b [0,4194304] 0 2024-09-19T09:41:46.040 INFO:tasks.workunit.client.0.smithi042.stdout:4/994: dwrite d0/d67/f8e [0,4194304] 0 2024-09-19T09:41:46.041 INFO:tasks.workunit.client.0.smithi042.stdout:7/892: creat d0/d3d/d55/d111/ddc/d9b/d11c/d3c/f128 x:0 0 0 2024-09-19T09:41:46.043 INFO:tasks.workunit.client.0.smithi042.stdout:4/995: mknod d0/d1b/d56/d86/dcf/c150 0 2024-09-19T09:41:46.044 INFO:tasks.workunit.client.0.smithi042.stdout:4/996: write d0/f19 [8930824,82299] 0 2024-09-19T09:41:46.045 INFO:tasks.workunit.client.0.smithi042.stdout:5/986: dread d2/db/d3c/fa0 [0,4194304] 0 2024-09-19T09:41:46.045 INFO:tasks.workunit.client.0.smithi042.stdout:5/987: chown d2/l91 147505 1 2024-09-19T09:41:46.045 INFO:tasks.workunit.client.0.smithi042.stdout:5/988: chown d2/d4/d20/d60/d72/d75/d10d/l114 10454035 1 2024-09-19T09:41:46.045 INFO:tasks.workunit.client.0.smithi042.stdout:5/989: fsync d2/d4/d20/da4/f10f 0 2024-09-19T09:41:46.047 INFO:tasks.workunit.client.0.smithi042.stdout:9/841: sync 2024-09-19T09:41:46.048 INFO:tasks.workunit.client.0.smithi042.stdout:9/842: rmdir d8/d32 39 2024-09-19T09:41:46.048 INFO:tasks.workunit.client.0.smithi042.stdout:5/990: dread d2/d4/d20/d31/f32 [0,4194304] 0 2024-09-19T09:41:46.050 INFO:tasks.workunit.client.0.smithi042.stdout:7/893: dread d0/d40/f4f [0,4194304] 0 2024-09-19T09:41:46.050 INFO:tasks.workunit.client.0.smithi042.stdout:9/843: rename d8/db/db1 to d8/da/d89/d102 0 2024-09-19T09:41:46.051 INFO:tasks.workunit.client.0.smithi042.stdout:4/997: dread d0/d1b/d1c/d61/d7f/fe2 [0,4194304] 0 2024-09-19T09:41:46.051 INFO:tasks.workunit.client.0.smithi042.stdout:7/894: symlink d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/l129 0 2024-09-19T09:41:46.052 INFO:tasks.workunit.client.0.smithi042.stdout:9/844: getdents d8/da/d19/d1c/d21/d67/d7b 0 2024-09-19T09:41:46.052 INFO:tasks.workunit.client.0.smithi042.stdout:9/845: chown d8/da/d19/d1c/d21/d67/f5b 48442 1 2024-09-19T09:41:46.052 INFO:tasks.workunit.client.0.smithi042.stdout:4/998: read d0/d1b/d1c/d2e/ffd [530203,118158] 0 2024-09-19T09:41:46.052 INFO:tasks.workunit.client.0.smithi042.stdout:4/999: truncate d0/d28/d87/da1/d11b/d6b/fb5 336826 0 2024-09-19T09:41:46.054 INFO:tasks.workunit.client.0.smithi042.stdout:7/895: rename d0/d3d/d55/d111/ddc/db6/dbb/dcc/dfe/c10c to d0/dde/c12a 0 2024-09-19T09:41:46.055 INFO:tasks.workunit.client.0.smithi042.stdout:9/846: unlink d8/da/d19/d1c/d21/d7f/c95 0 2024-09-19T09:41:46.061 INFO:tasks.workunit.client.0.smithi042.stdout:9/847: dread d8/da/d89/da7/db6/db5/d87/dad/fb0 [0,4194304] 0 2024-09-19T09:41:46.061 INFO:tasks.workunit.client.0.smithi042.stdout:5/991: dread d2/d4/d64/f120 [0,4194304] 0 2024-09-19T09:41:46.066 INFO:tasks.workunit.client.0.smithi042.stdout:5/992: dread d2/fad [0,4194304] 0 2024-09-19T09:41:46.066 INFO:tasks.workunit.client.0.smithi042.stdout:5/993: chown d2/db/d3c/d86 333390 1 2024-09-19T09:41:46.066 INFO:tasks.workunit.client.0.smithi042.stdout:5/994: stat d2/d4/d20/d60/d72/d75/l13b 0 2024-09-19T09:41:46.069 INFO:tasks.workunit.client.0.smithi042.stdout:5/995: link d2/d4/d20/d60/d72/d75/l90 d2/d4/d20/da4/l14b 0 2024-09-19T09:41:46.069 INFO:tasks.workunit.client.0.smithi042.stdout:5/996: chown d2/d25/d37 31 1 2024-09-19T09:41:46.069 INFO:tasks.workunit.client.0.smithi042.stdout:5/997: chown d2/d4/d64/dab/f92 3568 1 2024-09-19T09:41:46.069 INFO:tasks.workunit.client.0.smithi042.stdout:5/998: dread - d2/d25/dfb/f111 zero size 2024-09-19T09:41:46.076 INFO:tasks.workunit.client.0.smithi042.stdout:5/999: read d2/db/d3c/fa0 [2001063,77273] 0 2024-09-19T09:41:46.076 INFO:tasks.workunit.client.0.smithi042.stdout:7/896: dwrite d0/d3d/d55/d111/ddc/f8c [0,4194304] 0 2024-09-19T09:41:46.083 INFO:tasks.workunit.client.0.smithi042.stdout:9/848: dwrite d8/d32/fe7 [0,4194304] 0 2024-09-19T09:41:46.085 INFO:tasks.workunit.client.0.smithi042.stdout:7/897: dread d0/d3d/d92/fa4 [0,4194304] 0 2024-09-19T09:41:46.086 INFO:tasks.workunit.client.0.smithi042.stdout:9/849: creat d8/da/d19/d1c/d21/dbf/f103 x:0 0 0 2024-09-19T09:41:46.087 INFO:tasks.workunit.client.0.smithi042.stdout:9/850: creat d8/da/d19/d1c/d21/de9/f104 x:0 0 0 2024-09-19T09:41:46.089 INFO:tasks.workunit.client.0.smithi042.stdout:9/851: rmdir d8/da/d19/d1c/d21/d67 39 2024-09-19T09:41:46.089 INFO:tasks.workunit.client.0.smithi042.stdout:9/852: getdents d8/da/d70 0 2024-09-19T09:41:46.090 INFO:tasks.workunit.client.0.smithi042.stdout:9/853: write d8/da/d89/da7/db6/db5/d87/dad/de5/df6/fcb [4496438,82259] 0 2024-09-19T09:41:46.091 INFO:tasks.workunit.client.0.smithi042.stdout:0/913: sync 2024-09-19T09:41:46.091 INFO:tasks.workunit.client.0.smithi042.stdout:6/993: sync 2024-09-19T09:41:46.091 INFO:tasks.workunit.client.0.smithi042.stdout:9/854: creat d8/d1d/f105 x:0 0 0 2024-09-19T09:41:46.092 INFO:tasks.workunit.client.0.smithi042.stdout:9/855: chown d8/da/d89/fef 404 1 2024-09-19T09:41:46.092 INFO:tasks.workunit.client.0.smithi042.stdout:6/994: creat d1/d20/d6a/d46/df9/f136 x:0 0 0 2024-09-19T09:41:46.093 INFO:tasks.workunit.client.0.smithi042.stdout:9/856: symlink d8/da/d19/d1c/d21/de9/l106 0 2024-09-19T09:41:46.094 INFO:tasks.workunit.client.0.smithi042.stdout:0/914: symlink d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/dca/l119 0 2024-09-19T09:41:46.094 INFO:tasks.workunit.client.0.smithi042.stdout:0/915: getdents d2/d10/d12/d24/d82 0 2024-09-19T09:41:46.094 INFO:tasks.workunit.client.0.smithi042.stdout:6/995: truncate d1/de/d76/d99/db2/f80 2416481 0 2024-09-19T09:41:46.094 INFO:tasks.workunit.client.0.smithi042.stdout:0/916: rmdir d2/d10/df6 39 2024-09-19T09:41:46.095 INFO:tasks.workunit.client.0.smithi042.stdout:0/917: creat d2/d10/d1d/d34/d89/f11a x:0 0 0 2024-09-19T09:41:46.095 INFO:tasks.workunit.client.0.smithi042.stdout:0/918: stat d2/d10/d12/d16/c17 0 2024-09-19T09:41:46.113 INFO:tasks.workunit.client.0.smithi042.stdout:7/898: dwrite d0/f35 [0,4194304] 0 2024-09-19T09:41:46.113 INFO:tasks.workunit.client.0.smithi042.stdout:6/996: dwrite d1/d20/d6a/d90/f91 [0,4194304] 0 2024-09-19T09:41:46.117 INFO:tasks.workunit.client.0.smithi042.stdout:7/899: creat d0/d3d/d55/d111/ddc/f12b x:0 0 0 2024-09-19T09:41:46.117 INFO:tasks.workunit.client.0.smithi042.stdout:0/919: link d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d109/f6c d2/d10/df6/f11b 0 2024-09-19T09:41:46.119 INFO:tasks.workunit.client.0.smithi042.stdout:0/920: creat d2/d10/d12/d24/d82/f11c x:0 0 0 2024-09-19T09:41:46.119 INFO:tasks.workunit.client.0.smithi042.stdout:6/997: dread d1/de/d76/d99/db2/d34/d6f/d4a/f119 [0,4194304] 0 2024-09-19T09:41:46.119 INFO:tasks.workunit.client.0.smithi042.stdout:6/998: getdents d1 0 2024-09-19T09:41:46.119 INFO:tasks.workunit.client.0.smithi042.stdout:7/900: symlink d0/d3d/d55/d111/ddc/d9b/d11c/d44/l12c 0 2024-09-19T09:41:46.119 INFO:tasks.workunit.client.0.smithi042.stdout:7/901: chown d0/d3d/d55/d111/ddc/d9b/d11c/lcb 20685627 1 2024-09-19T09:41:46.120 INFO:tasks.workunit.client.0.smithi042.stdout:9/857: link d8/d32/f69 d8/da/d89/da7/db6/dc7/f107 0 2024-09-19T09:41:46.121 INFO:tasks.workunit.client.0.smithi042.stdout:9/858: write d8/da/d19/fcc [936640,106546] 0 2024-09-19T09:41:46.121 INFO:tasks.workunit.client.0.smithi042.stdout:6/999: stat d1/d20/d6a/d90/cce 0 2024-09-19T09:41:46.121 INFO:tasks.workunit.client.0.smithi042.stdout:0/921: creat d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/f11d x:0 0 0 2024-09-19T09:41:46.122 INFO:tasks.workunit.client.0.smithi042.stdout:7/902: truncate d0/fbf 2629674 0 2024-09-19T09:41:46.123 INFO:tasks.workunit.client.0.smithi042.stdout:7/903: mknod d0/d3d/d92/dc7/d112/c12d 0 2024-09-19T09:41:46.124 INFO:tasks.workunit.client.0.smithi042.stdout:0/922: mknod d2/d10/d6b/c11e 0 2024-09-19T09:41:46.125 INFO:tasks.workunit.client.0.smithi042.stdout:7/904: creat d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/d11d/f12e x:0 0 0 2024-09-19T09:41:46.128 INFO:tasks.workunit.client.0.smithi042.stdout:7/905: symlink d0/d3d/d92/dc7/d112/l12f 0 2024-09-19T09:41:46.128 INFO:tasks.workunit.client.0.smithi042.stdout:7/906: readlink d0/d3d/d55/lc1 0 2024-09-19T09:41:46.128 INFO:tasks.workunit.client.0.smithi042.stdout:7/907: dread - d0/d3d/d92/f113 zero size 2024-09-19T09:41:46.129 INFO:tasks.workunit.client.0.smithi042.stdout:7/908: mknod d0/d3d/d55/d111/ddc/d9b/d11c/d9f/d116/c130 0 2024-09-19T09:41:46.131 INFO:tasks.workunit.client.0.smithi042.stdout:7/909: mknod d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/c131 0 2024-09-19T09:41:46.131 INFO:tasks.workunit.client.0.smithi042.stdout:7/910: fdatasync d0/fbf 0 2024-09-19T09:41:46.132 INFO:tasks.workunit.client.0.smithi042.stdout:7/911: link d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/c108 d0/d3d/d55/d111/ddc/d9b/d11c/d44/c132 0 2024-09-19T09:41:46.132 INFO:tasks.workunit.client.0.smithi042.stdout:7/912: write d0/d3d/d92/f95 [131818,2310] 0 2024-09-19T09:41:46.144 INFO:tasks.workunit.client.0.smithi042.stdout:9/859: dwrite d8/d1d/f3f [0,4194304] 0 2024-09-19T09:41:46.144 INFO:tasks.workunit.client.0.smithi042.stdout:9/860: write d8/da/d89/da7/db6/db5/d87/fc8 [414366,77576] 0 2024-09-19T09:41:46.146 INFO:tasks.workunit.client.0.smithi042.stdout:9/861: creat d8/da/d19/d1c/d21/f108 x:0 0 0 2024-09-19T09:41:46.146 INFO:tasks.workunit.client.0.smithi042.stdout:7/913: dwrite d0/d3d/d55/d111/ddc/db6/dbb/dcc/dfe/f120 [0,4194304] 0 2024-09-19T09:41:46.146 INFO:tasks.workunit.client.0.smithi042.stdout:7/914: write d0/d3d/f11f [363012,51831] 0 2024-09-19T09:41:46.149 INFO:tasks.workunit.client.0.smithi042.stdout:7/915: rename d0/d40/d9d/c70 to d0/d3d/d55/d111/ddc/d9b/d11c/c133 0 2024-09-19T09:41:46.164 INFO:tasks.workunit.client.0.smithi042.stdout:9/862: dwrite d8/da/d19/d1c/d21/de9/f104 [0,4194304] 0 2024-09-19T09:41:46.165 INFO:tasks.workunit.client.0.smithi042.stdout:9/863: write d8/da/d19/d1c/d21/dbf/f103 [1018323,72159] 0 2024-09-19T09:41:46.165 INFO:tasks.workunit.client.0.smithi042.stdout:9/864: mknod d8/da/d89/da7/db6/db5/d87/dad/c109 0 2024-09-19T09:41:46.165 INFO:tasks.workunit.client.0.smithi042.stdout:9/865: write d8/da/d19/d1c/d21/d67/d7b/ffe [20018,420] 0 2024-09-19T09:41:46.165 INFO:tasks.workunit.client.0.smithi042.stdout:9/866: readlink d8/d32/l41 0 2024-09-19T09:41:46.166 INFO:tasks.workunit.client.0.smithi042.stdout:9/867: mkdir d8/da/d89/d10a 0 2024-09-19T09:41:46.167 INFO:tasks.workunit.client.0.smithi042.stdout:9/868: link d8/c18 d8/db/c10b 0 2024-09-19T09:41:46.167 INFO:tasks.workunit.client.0.smithi042.stdout:9/869: fsync d8/d32/fd4 0 2024-09-19T09:41:46.168 INFO:tasks.workunit.client.0.smithi042.stdout:7/916: dwrite d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/ff0 [0,4194304] 0 2024-09-19T09:41:46.168 INFO:tasks.workunit.client.0.smithi042.stdout:9/870: unlink d8/d1d/dd6/fdc 0 2024-09-19T09:41:46.173 INFO:tasks.workunit.client.0.smithi042.stdout:7/917: rename d0/d56/d5c/d126 to d0/d3d/d55/d111/ddc/d9b/d11c/d9f/d116/d134 0 2024-09-19T09:41:46.173 INFO:tasks.workunit.client.0.smithi042.stdout:7/918: chown d0/d56/c6f 65359912 1 2024-09-19T09:41:46.176 INFO:tasks.workunit.client.0.smithi042.stdout:7/919: link d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/l129 d0/d3d/d55/d111/ddc/d9b/d11c/l135 0 2024-09-19T09:41:46.176 INFO:tasks.workunit.client.0.smithi042.stdout:7/920: fdatasync d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/f101 0 2024-09-19T09:41:46.185 INFO:tasks.workunit.client.0.smithi042.stdout:9/871: dwrite d8/da/d19/d1c/d21/ff3 [0,4194304] 0 2024-09-19T09:41:46.185 INFO:tasks.workunit.client.0.smithi042.stdout:9/872: readlink d8/da/d19/d1c/db4/lf7 0 2024-09-19T09:41:46.187 INFO:tasks.workunit.client.0.smithi042.stdout:9/873: creat d8/da/d89/da7/f10c x:0 0 0 2024-09-19T09:41:46.187 INFO:tasks.workunit.client.0.smithi042.stdout:9/874: fdatasync d8/da/d19/d1c/d21/dbf/ff4 0 2024-09-19T09:41:46.187 INFO:tasks.workunit.client.0.smithi042.stdout:9/875: symlink d8/d32/l10d 0 2024-09-19T09:41:46.196 INFO:tasks.workunit.client.0.smithi042.stdout:7/921: dwrite d0/d40/d9d/ff8 [0,4194304] 0 2024-09-19T09:41:46.201 INFO:tasks.workunit.client.0.smithi042.stdout:9/876: rename d8/da/d89/da7/cda to d8/da/d19/d1c/c10e 0 2024-09-19T09:41:46.202 INFO:tasks.workunit.client.0.smithi042.stdout:0/923: sync 2024-09-19T09:41:46.203 INFO:tasks.workunit.client.0.smithi042.stdout:7/922: rename d0/d3d/d55/d111/ddc/d9b/d11c/d44/c132 to d0/d3d/d85/c136 0 2024-09-19T09:41:46.204 INFO:tasks.workunit.client.0.smithi042.stdout:0/924: rmdir d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/d107 0 2024-09-19T09:41:46.204 INFO:tasks.workunit.client.0.smithi042.stdout:7/923: truncate d0/f35 5403 0 2024-09-19T09:41:46.204 INFO:tasks.workunit.client.0.smithi042.stdout:9/877: dread d8/f6f [0,4194304] 0 2024-09-19T09:41:46.204 INFO:tasks.workunit.client.0.smithi042.stdout:9/878: write d8/da/d19/f2b [669443,7473] 0 2024-09-19T09:41:46.204 INFO:tasks.workunit.client.0.smithi042.stdout:7/924: creat d0/d40/d9d/f137 x:0 0 0 2024-09-19T09:41:46.205 INFO:tasks.workunit.client.0.smithi042.stdout:0/925: creat d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/d9f/f11f x:0 0 0 2024-09-19T09:41:46.206 INFO:tasks.workunit.client.0.smithi042.stdout:9/879: link d8/d32/l3a d8/da/d70/l10f 0 2024-09-19T09:41:46.207 INFO:tasks.workunit.client.0.smithi042.stdout:7/925: mkdir d0/dde/d138 0 2024-09-19T09:41:46.207 INFO:tasks.workunit.client.0.smithi042.stdout:9/880: mknod d8/da/d19/d1c/d21/d67/c110 0 2024-09-19T09:41:46.224 INFO:tasks.workunit.client.0.smithi042.stdout:0/926: dwrite d2/d10/d12/d16/d57/f6a [0,4194304] 0 2024-09-19T09:41:46.224 INFO:tasks.workunit.client.0.smithi042.stdout:0/927: chown d2/d10/d1d 62696788 1 2024-09-19T09:41:46.226 INFO:tasks.workunit.client.0.smithi042.stdout:0/928: rename d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/dca/l119 to d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da0/l120 0 2024-09-19T09:41:46.227 INFO:tasks.workunit.client.0.smithi042.stdout:0/929: mkdir d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d109/db2/d121 0 2024-09-19T09:41:46.228 INFO:tasks.workunit.client.0.smithi042.stdout:0/930: write d2/d10/d12/d16/f9b [1351642,26073] 0 2024-09-19T09:41:46.228 INFO:tasks.workunit.client.0.smithi042.stdout:0/931: truncate d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d85/da0/fab 2476636 0 2024-09-19T09:41:46.232 INFO:tasks.workunit.client.0.smithi042.stdout:7/926: dwrite d0/d40/f4f [0,4194304] 0 2024-09-19T09:41:46.233 INFO:tasks.workunit.client.0.smithi042.stdout:7/927: creat d0/f139 x:0 0 0 2024-09-19T09:41:46.233 INFO:tasks.workunit.client.0.smithi042.stdout:7/928: readlink d0/d3d/d55/d111/ddc/l123 0 2024-09-19T09:41:46.234 INFO:tasks.workunit.client.0.smithi042.stdout:7/929: symlink d0/d3d/d55/d111/ddc/d9b/d11c/l13a 0 2024-09-19T09:41:46.249 INFO:tasks.workunit.client.0.smithi042.stdout:7/930: dwrite d0/d3d/d55/f74 [0,4194304] 0 2024-09-19T09:41:46.254 INFO:tasks.workunit.client.0.smithi042.stdout:7/931: write d0/d3d/d92/fa4 [626346,106106] 0 2024-09-19T09:41:46.255 INFO:tasks.workunit.client.0.smithi042.stdout:7/932: mkdir d0/d3d/d85/d13b 0 2024-09-19T09:41:46.256 INFO:tasks.workunit.client.0.smithi042.stdout:7/933: creat d0/d3d/d55/d111/ddc/d9b/d11c/d3c/f13c x:0 0 0 2024-09-19T09:41:46.257 INFO:tasks.workunit.client.0.smithi042.stdout:7/934: creat d0/d56/f13d x:0 0 0 2024-09-19T09:41:46.283 INFO:tasks.workunit.client.0.smithi042.stdout:7/935: dwrite d0/d40/d9d/dd0/fd8 [0,4194304] 0 2024-09-19T09:41:46.283 INFO:tasks.workunit.client.0.smithi042.stdout:7/936: write d0/dde/d11b/f11e [614150,113030] 0 2024-09-19T09:41:46.283 INFO:tasks.workunit.client.0.smithi042.stdout:7/937: chown d0/d3d/d55/d111/ddc/db6/dbb/ffb 223 1 2024-09-19T09:41:46.290 INFO:tasks.workunit.client.0.smithi042.stdout:9/881: sync 2024-09-19T09:41:46.290 INFO:tasks.workunit.client.0.smithi042.stdout:0/932: sync 2024-09-19T09:41:46.290 INFO:tasks.workunit.client.0.smithi042.stdout:9/882: write d8/d1d/d28/f101 [589202,27964] 0 2024-09-19T09:41:46.291 INFO:tasks.workunit.client.0.smithi042.stdout:0/933: mknod d2/d10/d12/d16/d51/c122 0 2024-09-19T09:41:46.291 INFO:tasks.workunit.client.0.smithi042.stdout:0/934: readlink d2/d10/d12/d16/d57/d99/dd0/leb 0 2024-09-19T09:41:46.294 INFO:tasks.workunit.client.0.smithi042.stdout:7/938: dread d0/d56/d5c/f63 [0,4194304] 0 2024-09-19T09:41:46.295 INFO:tasks.workunit.client.0.smithi042.stdout:7/939: symlink d0/d3d/d55/d111/ddc/l13e 0 2024-09-19T09:41:46.295 INFO:tasks.workunit.client.0.smithi042.stdout:7/940: write d0/dde/d11b/f107 [668142,126427] 0 2024-09-19T09:41:46.298 INFO:tasks.workunit.client.0.smithi042.stdout:7/941: write d0/d3d/d55/d111/f7e [4187324,105340] 0 2024-09-19T09:41:46.307 INFO:tasks.workunit.client.0.smithi042.stdout:7/942: write d0/d3d/d55/d111/f80 [1591688,45685] 0 2024-09-19T09:41:46.308 INFO:tasks.workunit.client.0.smithi042.stdout:7/943: symlink d0/d3d/d55/d111/ddc/d9b/l13f 0 2024-09-19T09:41:46.309 INFO:tasks.workunit.client.0.smithi042.stdout:7/944: symlink d0/d3d/l140 0 2024-09-19T09:41:46.310 INFO:tasks.workunit.client.0.smithi042.stdout:7/945: symlink d0/d3d/d55/l141 0 2024-09-19T09:41:46.311 INFO:tasks.workunit.client.0.smithi042.stdout:7/946: truncate d0/d40/f65 1192394 0 2024-09-19T09:41:46.311 INFO:tasks.workunit.client.0.smithi042.stdout:7/947: mkdir d0/d3d/d55/d111/ddc/db6/dbb/dff/d142 0 2024-09-19T09:41:46.312 INFO:tasks.workunit.client.0.smithi042.stdout:9/883: dwrite d8/da/d19/d1c/d21/d7f/f8a [0,4194304] 0 2024-09-19T09:41:46.313 INFO:tasks.workunit.client.0.smithi042.stdout:7/948: mknod d0/d3d/d55/d111/ddc/d9b/d11c/c143 0 2024-09-19T09:41:46.313 INFO:tasks.workunit.client.0.smithi042.stdout:9/884: mknod d8/da/d89/da7/db6/db5/d87/dad/de5/dfc/c111 0 2024-09-19T09:41:46.314 INFO:tasks.workunit.client.0.smithi042.stdout:7/949: truncate d0/d40/f6c 69513 0 2024-09-19T09:41:46.315 INFO:tasks.workunit.client.0.smithi042.stdout:7/950: truncate d0/d3d/d92/da1/f7f 1984802 0 2024-09-19T09:41:46.325 INFO:tasks.workunit.client.0.smithi042.stdout:7/951: dread d0/d40/d9d/ff8 [0,4194304] 0 2024-09-19T09:41:46.326 INFO:tasks.workunit.client.0.smithi042.stdout:7/952: creat d0/d3d/d55/d111/ddc/db6/f144 x:0 0 0 2024-09-19T09:41:46.327 INFO:tasks.workunit.client.0.smithi042.stdout:7/953: rmdir d0/d3d/d55/d111/ddc/db6/dbb/dcc/dfe 39 2024-09-19T09:41:46.329 INFO:tasks.workunit.client.0.smithi042.stdout:9/885: dwrite d8/da/d19/d1c/d21/d67/ff1 [0,4194304] 0 2024-09-19T09:41:46.331 INFO:tasks.workunit.client.0.smithi042.stdout:9/886: getdents d8/da/d19/d1c/d21 0 2024-09-19T09:41:46.333 INFO:tasks.workunit.client.0.smithi042.stdout:7/954: dread d0/d3d/d85/f10f [0,4194304] 0 2024-09-19T09:41:46.334 INFO:tasks.workunit.client.0.smithi042.stdout:7/955: truncate d0/d3d/d55/d111/f3e 1948044 0 2024-09-19T09:41:46.334 INFO:tasks.workunit.client.0.smithi042.stdout:7/956: readlink d0/d3d/d55/d111/ddc/d9b/l13f 0 2024-09-19T09:41:46.356 INFO:tasks.workunit.client.0.smithi042.stdout:9/887: dwrite d8/da/d89/da7/db6/db5/d87/dad/de5/df6/fcb [0,4194304] 0 2024-09-19T09:41:46.356 INFO:tasks.workunit.client.0.smithi042.stdout:9/888: readlink d8/da/d19/d1c/db4/lf7 0 2024-09-19T09:41:46.356 INFO:tasks.workunit.client.0.smithi042.stdout:7/957: dwrite d0/d40/f65 [0,4194304] 0 2024-09-19T09:41:46.357 INFO:tasks.workunit.client.0.smithi042.stdout:9/889: readlink d8/db/l99 0 2024-09-19T09:41:46.357 INFO:tasks.workunit.client.0.smithi042.stdout:7/958: creat d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/f145 x:0 0 0 2024-09-19T09:41:46.357 INFO:tasks.workunit.client.0.smithi042.stdout:7/959: read - d0/d3d/d85/d99/fb7 zero size 2024-09-19T09:41:46.358 INFO:tasks.workunit.client.0.smithi042.stdout:7/960: fsync d0/d3d/d55/d111/ddc/d9b/d11c/d3c/f127 0 2024-09-19T09:41:46.358 INFO:tasks.workunit.client.0.smithi042.stdout:7/961: rmdir d0 39 2024-09-19T09:41:46.358 INFO:tasks.workunit.client.0.smithi042.stdout:7/962: dread - d0/f7c zero size 2024-09-19T09:41:46.359 INFO:tasks.workunit.client.0.smithi042.stdout:7/963: symlink d0/d3d/d55/d111/ddc/d9b/d11c/d9f/d116/l146 0 2024-09-19T09:41:46.359 INFO:tasks.workunit.client.0.smithi042.stdout:7/964: getdents d0/d3d/d55/d111/ddc/db6 0 2024-09-19T09:41:46.360 INFO:tasks.workunit.client.0.smithi042.stdout:7/965: symlink d0/d56/d5c/l147 0 2024-09-19T09:41:46.361 INFO:tasks.workunit.client.0.smithi042.stdout:7/966: creat d0/d3d/d55/d111/ddc/d9b/d11c/d44/d47/f148 x:0 0 0 2024-09-19T09:41:46.361 INFO:tasks.workunit.client.0.smithi042.stdout:7/967: dread - d0/d3d/d55/d111/ddc/d9b/d11c/d44/f102 zero size 2024-09-19T09:41:46.361 INFO:tasks.workunit.client.0.smithi042.stdout:7/968: creat d0/d3d/d85/f149 x:0 0 0 2024-09-19T09:41:46.362 INFO:tasks.workunit.client.0.smithi042.stdout:9/890: dread d8/d32/fe7 [0,4194304] 0 2024-09-19T09:41:46.362 INFO:tasks.workunit.client.0.smithi042.stdout:9/891: chown d8/da/d19/d1c/d21/dbf 12162169 1 2024-09-19T09:41:46.364 INFO:tasks.workunit.client.0.smithi042.stdout:7/969: symlink d0/d3d/d92/dc7/d112/l14a 0 2024-09-19T09:41:46.371 INFO:tasks.workunit.client.0.smithi042.stdout:0/935: sync 2024-09-19T09:41:46.375 INFO:tasks.workunit.client.0.smithi042.stdout:0/936: read d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/f69 [1363230,7579] 0 2024-09-19T09:41:46.391 INFO:tasks.workunit.client.0.smithi042.stdout:7/970: dwrite d0/d3d/d55/d111/f3e [0,4194304] 0 2024-09-19T09:41:46.391 INFO:tasks.workunit.client.0.smithi042.stdout:9/892: dwrite d8/da/d19/d1c/d21/d67/d7b/f9f [0,4194304] 0 2024-09-19T09:41:46.391 INFO:tasks.workunit.client.0.smithi042.stdout:7/971: chown d0/d3d/d85/d13b 150304 1 2024-09-19T09:41:46.391 INFO:tasks.workunit.client.0.smithi042.stdout:9/893: dread - d8/d1d/d28/fcd zero size 2024-09-19T09:41:46.393 INFO:tasks.workunit.client.0.smithi042.stdout:7/972: link d0/d3d/d55/d111/ddc/d9b/d11c/d3c/f127 d0/d3d/d92/da1/d118/f14b 0 2024-09-19T09:41:46.397 INFO:tasks.workunit.client.0.smithi042.stdout:0/937: rename d2/d10/d1d/d34/l4b to d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d110/l123 0 2024-09-19T09:41:46.397 INFO:tasks.workunit.client.0.smithi042.stdout:7/973: rename d0/d3d/d85/d99 to d0/d3d/d55/d111/ddc/db6/dbb/dcc/d14c 0 2024-09-19T09:41:46.397 INFO:tasks.workunit.client.0.smithi042.stdout:7/974: write d0/d3d/d55/f5f [1669100,48906] 0 2024-09-19T09:41:46.397 INFO:tasks.workunit.client.0.smithi042.stdout:7/975: dread - d0/d3d/d55/d111/f10d zero size 2024-09-19T09:41:46.397 INFO:tasks.workunit.client.0.smithi042.stdout:7/976: chown d0/d3d/d92/da1/d118 285743903 1 2024-09-19T09:41:46.397 INFO:tasks.workunit.client.0.smithi042.stdout:0/938: unlink d2/d10/d12/d24/d5b/fd3 0 2024-09-19T09:41:46.397 INFO:tasks.workunit.client.0.smithi042.stdout:0/939: mknod d2/d10/d12/d16/d57/d78/dfb/c124 0 2024-09-19T09:41:46.428 INFO:tasks.workunit.client.0.smithi042.stdout:9/894: dwrite d8/da/d19/d1c/d21/dbf/fd2 [0,4194304] 0 2024-09-19T09:41:46.428 INFO:tasks.workunit.client.0.smithi042.stdout:9/895: fdatasync d8/d1d/faf 0 2024-09-19T09:41:46.430 INFO:tasks.workunit.client.0.smithi042.stdout:0/940: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d110/fc1 [0,4194304] 0 2024-09-19T09:41:46.430 INFO:tasks.workunit.client.0.smithi042.stdout:0/941: readlink d2/d10/d1d/l66 0 2024-09-19T09:41:46.433 INFO:tasks.workunit.client.0.smithi042.stdout:7/977: dwrite d0/d3d/d55/d111/ddc/d9b/fef [0,4194304] 0 2024-09-19T09:41:46.453 INFO:tasks.workunit.client.0.smithi042.stdout:9/896: dwrite d8/db/f26 [0,4194304] 0 2024-09-19T09:41:46.454 INFO:tasks.workunit.client.0.smithi042.stdout:9/897: readlink d8/d1d/d28/lf8 0 2024-09-19T09:41:46.454 INFO:tasks.workunit.client.0.smithi042.stdout:7/978: dwrite d0/d3d/db0/ff9 [0,4194304] 0 2024-09-19T09:41:46.454 INFO:tasks.workunit.client.0.smithi042.stdout:7/979: read - d0/d3d/d92/dc7/f109 zero size 2024-09-19T09:41:46.454 INFO:tasks.workunit.client.0.smithi042.stdout:0/942: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d110/fc1 [0,4194304] 0 2024-09-19T09:41:46.454 INFO:tasks.workunit.client.0.smithi042.stdout:0/943: write d2/d10/d1d/d34/f4a [714915,76252] 0 2024-09-19T09:41:46.456 INFO:tasks.workunit.client.0.smithi042.stdout:9/898: mknod d8/da/d89/da7/c112 0 2024-09-19T09:41:46.457 INFO:tasks.workunit.client.0.smithi042.stdout:9/899: mknod d8/d1d/d28/c113 0 2024-09-19T09:41:46.457 INFO:tasks.workunit.client.0.smithi042.stdout:9/900: stat d8/da/d89/da7/db6/db5/d87/ff9 0 2024-09-19T09:41:46.457 INFO:tasks.workunit.client.0.smithi042.stdout:9/901: mknod d8/da/d19/c114 0 2024-09-19T09:41:46.458 INFO:tasks.workunit.client.0.smithi042.stdout:9/902: chown d8/da/d89/lc9 15591 1 2024-09-19T09:41:46.459 INFO:tasks.workunit.client.0.smithi042.stdout:9/903: creat d8/da/d89/da7/db6/db5/d87/dad/de5/f115 x:0 0 0 2024-09-19T09:41:46.459 INFO:tasks.workunit.client.0.smithi042.stdout:9/904: fsync d8/da/d19/d1c/d21/dbf/fd2 0 2024-09-19T09:41:46.463 INFO:tasks.workunit.client.0.smithi042.stdout:0/944: write d2/d10/df6/f11b [4346064,42801] 0 2024-09-19T09:41:46.465 INFO:tasks.workunit.client.0.smithi042.stdout:0/945: creat d2/d10/d6b/f125 x:0 0 0 2024-09-19T09:41:46.467 INFO:tasks.workunit.client.0.smithi042.stdout:0/946: creat d2/d10/d1d/f126 x:0 0 0 2024-09-19T09:41:46.468 INFO:tasks.workunit.client.0.smithi042.stdout:0/947: read d2/d8e/d32/f83 [285304,120413] 0 2024-09-19T09:41:46.468 INFO:tasks.workunit.client.0.smithi042.stdout:0/948: fdatasync d2/d10/d12/d16/d10f/f112 0 2024-09-19T09:41:46.475 INFO:tasks.workunit.client.0.smithi042.stdout:0/949: write d2/d10/d12/d24/dc0/f104 [343881,100061] 0 2024-09-19T09:41:46.475 INFO:tasks.workunit.client.0.smithi042.stdout:7/980: dwrite d0/d3d/d55/d111/f8a [4194304,4194304] 0 2024-09-19T09:41:46.477 INFO:tasks.workunit.client.0.smithi042.stdout:0/950: rename d2/d10/d12/d16/ff0 to d2/d10/df6/f127 0 2024-09-19T09:41:46.477 INFO:tasks.workunit.client.0.smithi042.stdout:7/981: creat d0/d3d/d92/dc7/d112/f14d x:0 0 0 2024-09-19T09:41:46.478 INFO:tasks.workunit.client.0.smithi042.stdout:0/951: getdents d2/d10/d1d/d34/d89 0 2024-09-19T09:41:46.478 INFO:tasks.workunit.client.0.smithi042.stdout:0/952: write d2/d10/d12/d16/d57/f73 [214535,21604] 0 2024-09-19T09:41:46.480 INFO:tasks.workunit.client.0.smithi042.stdout:7/982: mknod d0/d3d/d55/d111/ddc/c14e 0 2024-09-19T09:41:46.486 INFO:tasks.workunit.client.0.smithi042.stdout:7/983: dread d0/d3d/db0/f100 [0,4194304] 0 2024-09-19T09:41:46.488 INFO:tasks.workunit.client.0.smithi042.stdout:7/984: write d0/d40/d9d/f8f [980011,32334] 0 2024-09-19T09:41:46.488 INFO:tasks.workunit.client.0.smithi042.stdout:7/985: truncate d0/d3d/d55/d111/ddc/d9b/ff3 240675 0 2024-09-19T09:41:46.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:46 smithi171 ceph-mon[35803]: pgmap v410: 97 pgs: 97 active+clean; 1.3 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 MiB/s rd, 211 MiB/s wr, 530 op/s 2024-09-19T09:41:46.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:46 smithi136 ceph-mon[34840]: pgmap v410: 97 pgs: 97 active+clean; 1.3 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 MiB/s rd, 211 MiB/s wr, 530 op/s 2024-09-19T09:41:46.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:46 smithi042 ceph-mon[31223]: pgmap v410: 97 pgs: 97 active+clean; 1.3 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 MiB/s rd, 211 MiB/s wr, 530 op/s 2024-09-19T09:41:47.977 INFO:tasks.workunit.client.0.smithi042.stdout:7/986: sync 2024-09-19T09:41:47.977 INFO:tasks.workunit.client.0.smithi042.stdout:0/953: sync 2024-09-19T09:41:47.977 INFO:tasks.workunit.client.0.smithi042.stdout:9/905: sync 2024-09-19T09:41:47.981 INFO:tasks.workunit.client.0.smithi042.stdout:9/906: mknod d8/da/d19/d1c/db4/c116 0 2024-09-19T09:41:47.982 INFO:tasks.workunit.client.0.smithi042.stdout:0/954: dread d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/db5/fbf [0,4194304] 0 2024-09-19T09:41:47.983 INFO:tasks.workunit.client.0.smithi042.stdout:7/987: dread d0/d40/d9d/dd0/fd8 [0,4194304] 0 2024-09-19T09:41:47.985 INFO:tasks.workunit.client.0.smithi042.stdout:7/988: stat d0/d3d/d55/d111/ddc/d9b/d11c/c7b 0 2024-09-19T09:41:47.988 INFO:tasks.workunit.client.0.smithi042.stdout:7/989: link d0/fa d0/d3d/d55/d111/ddc/d9b/d11c/d9f/f14f 0 2024-09-19T09:41:47.988 INFO:tasks.workunit.client.0.smithi042.stdout:7/990: fdatasync d0/d40/f65 0 2024-09-19T09:41:47.993 INFO:tasks.workunit.client.0.smithi042.stdout:7/991: rename d0/d3d/db0/c103 to d0/d3d/d55/d111/ddc/db6/dbb/dcc/dfe/c150 0 2024-09-19T09:41:47.993 INFO:tasks.workunit.client.0.smithi042.stdout:7/992: write d0/d3d/d92/dc7/f109 [946244,17412] 0 2024-09-19T09:41:47.993 INFO:tasks.workunit.client.0.smithi042.stdout:7/993: readlink d0/d3d/d55/l141 0 2024-09-19T09:41:47.996 INFO:tasks.workunit.client.0.smithi042.stdout:7/994: mkdir d0/d3d/db0/d151 0 2024-09-19T09:41:47.997 INFO:tasks.workunit.client.0.smithi042.stdout:7/995: mknod d0/d56/c152 0 2024-09-19T09:41:47.997 INFO:tasks.workunit.client.0.smithi042.stdout:7/996: dread - d0/d3d/d92/da1/d118/f14b zero size 2024-09-19T09:41:48.008 INFO:tasks.workunit.client.0.smithi042.stdout:0/955: dwrite d2/d10/d1d/f25 [0,4194304] 0 2024-09-19T09:41:48.008 INFO:tasks.workunit.client.0.smithi042.stdout:0/956: write d2/f54 [245665,93296] 0 2024-09-19T09:41:48.008 INFO:tasks.workunit.client.0.smithi042.stdout:0/957: truncate d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/d8f/db5/fd1 369447 0 2024-09-19T09:41:48.018 INFO:tasks.workunit.client.0.smithi042.stdout:0/958: read d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d109/f6f [2873894,90092] 0 2024-09-19T09:41:48.027 INFO:tasks.workunit.client.0.smithi042.stdout:7/997: dwrite d0/d3d/d55/d111/f7e [0,4194304] 0 2024-09-19T09:41:48.027 INFO:tasks.workunit.client.0.smithi042.stdout:7/998: write d0/d3d/d85/f149 [85102,67623] 0 2024-09-19T09:41:48.028 INFO:tasks.workunit.client.0.smithi042.stdout:7/999: mknod d0/d3d/d55/d111/ddc/db6/dbb/dcc/dfe/c153 0 2024-09-19T09:41:48.031 INFO:tasks.workunit.client.0.smithi042.stdout:0/959: link d2/d10/d12/d24/laa d2/d10/l128 0 2024-09-19T09:41:48.033 INFO:tasks.workunit.client.0.smithi042.stdout:0/960: rmdir d2/d10/d12/d16/d57/d78/dfb/d106 0 2024-09-19T09:41:48.033 INFO:tasks.workunit.client.0.smithi042.stdout:0/961: write d2/d10/da1/df2/f10a [86061,3612] 0 2024-09-19T09:41:48.034 INFO:tasks.workunit.client.0.smithi042.stdout:0/962: mkdir d2/d10/df6/d129 0 2024-09-19T09:41:48.035 INFO:tasks.workunit.client.0.smithi042.stdout:0/963: getdents d2/d8e 0 2024-09-19T09:41:48.036 INFO:tasks.workunit.client.0.smithi042.stdout:0/964: creat d2/d10/d12/d16/d57/d99/f12a x:0 0 0 2024-09-19T09:41:48.037 INFO:tasks.workunit.client.0.smithi042.stdout:0/965: creat d2/d10/da1/df2/f12b x:0 0 0 2024-09-19T09:41:48.037 INFO:tasks.workunit.client.0.smithi042.stdout:0/966: fdatasync d2/d10/d12/d16/d51/f56 0 2024-09-19T09:41:48.038 INFO:tasks.workunit.client.0.smithi042.stdout:0/967: readlink d2/d10/d12/d16/d57/d99/dd0/da5/d52/lf1 0 2024-09-19T09:41:48.039 INFO:tasks.workunit.client.0.smithi042.stdout:0/968: rmdir d2/d10/d12/d16/d57/d78/dfb 39 2024-09-19T09:41:48.040 INFO:tasks.workunit.client.0.smithi042.stdout:0/969: creat d2/d10/df6/dbc/f12c x:0 0 0 2024-09-19T09:41:48.041 INFO:tasks.workunit.client.0.smithi042.stdout:0/970: unlink d2/l14 0 2024-09-19T09:41:48.041 INFO:tasks.workunit.client.0.smithi042.stdout:0/971: chown d2/d10/d12/d16/d57/f6a 1833 1 2024-09-19T09:41:48.062 INFO:tasks.workunit.client.0.smithi042.stdout:0/972: dwrite d2/d8e/d32/ff3 [0,4194304] 0 2024-09-19T09:41:48.063 INFO:tasks.workunit.client.0.smithi042.stdout:0/973: write d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/d5a/fe3 [4290918,87028] 0 2024-09-19T09:41:48.065 INFO:tasks.workunit.client.0.smithi042.stdout:0/974: symlink d2/d10/d12/d24/dbd/dfd/l12d 0 2024-09-19T09:41:48.065 INFO:tasks.workunit.client.0.smithi042.stdout:0/975: write d2/d10/d12/d24/fee [93690,100992] 0 2024-09-19T09:41:48.065 INFO:tasks.workunit.client.0.smithi042.stdout:0/976: chown d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d109/f6f 1859 1 2024-09-19T09:41:48.074 INFO:tasks.workunit.client.0.smithi042.stdout:0/977: read d2/d10/d1d/f25 [3576876,36606] 0 2024-09-19T09:41:48.075 INFO:tasks.workunit.client.0.smithi042.stdout:0/978: chown d2/d10/d12/d16/d57/d78/c116 7718 1 2024-09-19T09:41:48.075 INFO:tasks.workunit.client.0.smithi042.stdout:0/979: dread - d2/d10/d12/d16/fdc zero size 2024-09-19T09:41:48.079 INFO:tasks.workunit.client.0.smithi042.stdout:9/907: sync 2024-09-19T09:41:48.080 INFO:tasks.workunit.client.0.smithi042.stdout:9/908: link d8/c9 d8/da/d19/d1c/d21/c117 0 2024-09-19T09:41:48.084 INFO:tasks.workunit.client.0.smithi042.stdout:0/980: link d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d109/db2/lce d2/d10/d12/d24/l12e 0 2024-09-19T09:41:48.085 INFO:tasks.workunit.client.0.smithi042.stdout:0/981: getdents d2/d10 0 2024-09-19T09:41:48.089 INFO:tasks.workunit.client.0.smithi042.stdout:9/909: link d8/da/d89/da7/db6/db5/d87/dad/de5/df6/f64 d8/da/d89/da7/db6/f118 0 2024-09-19T09:41:48.090 INFO:tasks.workunit.client.0.smithi042.stdout:9/910: creat d8/da/d89/d8e/f119 x:0 0 0 2024-09-19T09:41:48.100 INFO:tasks.workunit.client.0.smithi042.stdout:9/911: dread d8/f1a [4194304,4194304] 0 2024-09-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi042.stdout:0/982: dwrite d2/d10/d12/d16/fdc [0,4194304] 0 2024-09-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi042.stdout:0/983: chown d2/d10/d12/d16/d51/c122 47432 1 2024-09-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi042.stdout:0/984: readlink d2/d10/d12/d24/dc0/l10e 0 2024-09-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi042.stdout:9/912: write d8/d1d/d28/f101 [276902,42718] 0 2024-09-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi042.stdout:9/913: mkdir d8/da/d89/da7/db6/db5/d87/dad/de5/dfc/d11a 0 2024-09-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi042.stdout:9/914: write d8/da/d19/d1c/d21/d67/d7b/fd9 [48647,73585] 0 2024-09-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi042.stdout:9/915: dread d8/f11 [4194304,4194304] 0 2024-09-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi042.stdout:0/985: dwrite d2/d10/d6b/fb0 [0,4194304] 0 2024-09-19T09:41:48.125 INFO:tasks.workunit.client.0.smithi042.stdout:0/986: write d2/d10/f15 [1408078,76924] 0 2024-09-19T09:41:48.128 INFO:tasks.workunit.client.0.smithi042.stdout:9/916: rename d8/d1d/dd6/f100 to d8/da/d89/da7/db6/f11b 0 2024-09-19T09:41:48.141 INFO:tasks.workunit.client.0.smithi042.stdout:0/987: dwrite d2/f1c [0,4194304] 0 2024-09-19T09:41:48.141 INFO:tasks.workunit.client.0.smithi042.stdout:9/917: rename d8/d32/fe7 to d8/da/d89/da7/db6/f11c 0 2024-09-19T09:41:48.142 INFO:tasks.workunit.client.0.smithi042.stdout:9/918: mkdir d8/da/d19/d1c/d21/d67/d11d 0 2024-09-19T09:41:48.146 INFO:tasks.workunit.client.0.smithi042.stdout:9/919: write d8/da/d19/f7c [782913,113700] 0 2024-09-19T09:41:48.147 INFO:tasks.workunit.client.0.smithi042.stdout:9/920: mknod d8/da/d89/da7/db6/dc7/c11e 0 2024-09-19T09:41:48.147 INFO:tasks.workunit.client.0.smithi042.stdout:9/921: write d8/da/d19/d1c/d21/dbf/fd2 [4636343,50359] 0 2024-09-19T09:41:48.147 INFO:tasks.workunit.client.0.smithi042.stdout:0/988: dread d2/d10/d12/d24/f42 [0,4194304] 0 2024-09-19T09:41:48.148 INFO:tasks.workunit.client.0.smithi042.stdout:9/922: rmdir d8/da/d89 39 2024-09-19T09:41:48.149 INFO:tasks.workunit.client.0.smithi042.stdout:0/989: symlink d2/d8e/l12f 0 2024-09-19T09:41:48.168 INFO:tasks.workunit.client.0.smithi042.stdout:9/923: dwrite d8/da/d19/d1c/d21/ff3 [0,4194304] 0 2024-09-19T09:41:48.168 INFO:tasks.workunit.client.0.smithi042.stdout:9/924: fdatasync d8/d1d/f105 0 2024-09-19T09:41:48.176 INFO:tasks.workunit.client.0.smithi042.stdout:9/925: dread d8/da/d89/da7/db6/db5/d87/dad/de5/df6/fcb [0,4194304] 0 2024-09-19T09:41:48.194 INFO:tasks.workunit.client.0.smithi042.stdout:9/926: dwrite d8/da/d89/da7/db6/db5/f6e [0,4194304] 0 2024-09-19T09:41:48.195 INFO:tasks.workunit.client.0.smithi042.stdout:9/927: creat d8/d1d/d28/f11f x:0 0 0 2024-09-19T09:41:48.200 INFO:tasks.workunit.client.0.smithi042.stdout:0/990: sync 2024-09-19T09:41:48.200 INFO:tasks.workunit.client.0.smithi042.stdout:0/991: write d2/d10/d12/d24/f42 [4474882,78120] 0 2024-09-19T09:41:48.201 INFO:tasks.workunit.client.0.smithi042.stdout:0/992: symlink d2/d10/d12/de0/l130 0 2024-09-19T09:41:48.205 INFO:tasks.workunit.client.0.smithi042.stdout:0/993: getdents d2/d10/d12/d24 0 2024-09-19T09:41:48.206 INFO:tasks.workunit.client.0.smithi042.stdout:0/994: getdents d2/d10/d12/d16/d51 0 2024-09-19T09:41:48.206 INFO:tasks.workunit.client.0.smithi042.stdout:0/995: stat d2/d10/df6/dbc/cc7 0 2024-09-19T09:41:48.206 INFO:tasks.workunit.client.0.smithi042.stdout:0/996: creat d2/f131 x:0 0 0 2024-09-19T09:41:48.208 INFO:tasks.workunit.client.0.smithi042.stdout:0/997: unlink f0 0 2024-09-19T09:41:48.211 INFO:tasks.workunit.client.0.smithi042.stdout:9/928: dwrite d8/d1d/f105 [0,4194304] 0 2024-09-19T09:41:48.212 INFO:tasks.workunit.client.0.smithi042.stdout:9/929: mknod d8/d1d/dd6/c120 0 2024-09-19T09:41:48.213 INFO:tasks.workunit.client.0.smithi042.stdout:9/930: fdatasync d8/da/d89/da7/db6/f11c 0 2024-09-19T09:41:48.213 INFO:tasks.workunit.client.0.smithi042.stdout:9/931: truncate d8/d1d/f1f 2741589 0 2024-09-19T09:41:48.223 INFO:tasks.workunit.client.0.smithi042.stdout:9/932: dread d8/da/d19/f6b [0,4194304] 0 2024-09-19T09:41:48.223 INFO:tasks.workunit.client.0.smithi042.stdout:9/933: write d8/da/d19/d1c/d21/d67/d7b/fd0 [1231386,96373] 0 2024-09-19T09:41:48.224 INFO:tasks.workunit.client.0.smithi042.stdout:9/934: creat d8/da/d89/f121 x:0 0 0 2024-09-19T09:41:48.224 INFO:tasks.workunit.client.0.smithi042.stdout:9/935: truncate d8/d1d/f1f 3204437 0 2024-09-19T09:41:48.225 INFO:tasks.workunit.client.0.smithi042.stdout:0/998: dwrite d2/d10/d12/d16/d57/d99/f12a [0,4194304] 0 2024-09-19T09:41:48.246 INFO:tasks.workunit.client.0.smithi042.stdout:0/999: dwrite d2/d10/d12/d16/d57/d99/dd0/da5/d8a/d9d/f11d [0,4194304] 0 2024-09-19T09:41:48.248 INFO:tasks.workunit.client.0.smithi042.stdout:9/936: dwrite d8/da/d89/da7/db6/db5/fde [0,4194304] 0 2024-09-19T09:41:48.248 INFO:tasks.workunit.client.0.smithi042.stdout:9/937: truncate d8/d1d/f3f 3558992 0 2024-09-19T09:41:48.249 INFO:tasks.workunit.client.0.smithi042.stdout:9/938: write d8/da/d19/d1c/db4/fc2 [763139,30404] 0 2024-09-19T09:41:48.259 INFO:tasks.workunit.client.0.smithi042.stdout:9/939: read d8/da/f10 [1109441,112500] 0 2024-09-19T09:41:48.260 INFO:tasks.workunit.client.0.smithi042.stdout:9/940: link d8/da/d19/d1c/d21/f84 d8/da/d19/d1c/d21/f122 0 2024-09-19T09:41:48.263 INFO:tasks.workunit.client.0.smithi042.stdout:9/941: dread d8/da/d89/da7/db6/dc7/fe0 [0,4194304] 0 2024-09-19T09:41:48.289 INFO:tasks.workunit.client.0.smithi042.stdout:9/942: dwrite d8/d1d/f3f [0,4194304] 0 2024-09-19T09:41:48.290 INFO:tasks.workunit.client.0.smithi042.stdout:9/943: chown d8/da/f10 3176383 1 2024-09-19T09:41:48.291 INFO:tasks.workunit.client.0.smithi042.stdout:9/944: rename d8/da/d19/d1c/d21/de9/f104 to d8/d1d/d28/f123 0 2024-09-19T09:41:48.291 INFO:tasks.workunit.client.0.smithi042.stdout:9/945: read - d8/d1d/d28/f11f zero size 2024-09-19T09:41:48.292 INFO:tasks.workunit.client.0.smithi042.stdout:9/946: mkdir d8/da/d89/da7/db6/db5/d87/dad/de5/dfc/d11a/d124 0 2024-09-19T09:41:48.292 INFO:tasks.workunit.client.0.smithi042.stdout:9/947: readlink d8/da/d70/la6 0 2024-09-19T09:41:48.307 INFO:tasks.workunit.client.0.smithi042.stdout:9/948: dwrite d8/d1d/d28/f11f [0,4194304] 0 2024-09-19T09:41:48.310 INFO:tasks.workunit.client.0.smithi042.stdout:9/949: mkdir d8/da/d89/d125 0 2024-09-19T09:41:48.311 INFO:tasks.workunit.client.0.smithi042.stdout:9/950: mkdir d8/da/d89/da7/db6/d126 0 2024-09-19T09:41:48.312 INFO:tasks.workunit.client.0.smithi042.stdout:9/951: symlink d8/da/d89/da7/db6/db5/d87/dad/de5/dfc/d11a/l127 0 2024-09-19T09:41:48.312 INFO:tasks.workunit.client.0.smithi042.stdout:9/952: fsync d8/da/d89/da7/db6/db5/d87/dad/fb0 0 2024-09-19T09:41:48.313 INFO:tasks.workunit.client.0.smithi042.stdout:9/953: creat d8/da/d19/d1c/d21/d7f/f128 x:0 0 0 2024-09-19T09:41:48.314 INFO:tasks.workunit.client.0.smithi042.stdout:9/954: link d8/da/d89/d102/lfb d8/da/d89/d10a/l129 0 2024-09-19T09:41:48.329 INFO:tasks.workunit.client.0.smithi042.stdout:9/955: dwrite d8/d1d/f105 [0,4194304] 0 2024-09-19T09:41:48.330 INFO:tasks.workunit.client.0.smithi042.stdout:9/956: mknod d8/da/d89/da7/db6/db5/d87/dad/c12a 0 2024-09-19T09:41:48.332 INFO:tasks.workunit.client.0.smithi042.stdout:9/957: rename d8/da/d19/d1c/d21/d67/d7b/fdd to d8/d1d/dd6/f12b 0 2024-09-19T09:41:48.335 INFO:tasks.workunit.client.0.smithi042.stdout:9/958: dread d8/da/d19/d1c/d21/f84 [0,4194304] 0 2024-09-19T09:41:48.335 INFO:tasks.workunit.client.0.smithi042.stdout:9/959: chown d8/d32/l41 25 1 2024-09-19T09:41:48.335 INFO:tasks.workunit.client.0.smithi042.stdout:9/960: getdents d8/d32 0 2024-09-19T09:41:48.344 INFO:tasks.workunit.client.0.smithi042.stdout:9/961: read d8/da/d89/da7/db6/db5/f6e [1257107,69807] 0 2024-09-19T09:41:48.344 INFO:tasks.workunit.client.0.smithi042.stdout:9/962: readlink d8/da/d89/d102/lfb 0 2024-09-19T09:41:48.345 INFO:tasks.workunit.client.0.smithi042.stdout:9/963: mknod d8/da/d19/d1c/d21/c12c 0 2024-09-19T09:41:48.346 INFO:tasks.workunit.client.0.smithi042.stdout:9/964: creat d8/da/d89/f12d x:0 0 0 2024-09-19T09:41:48.346 INFO:tasks.workunit.client.0.smithi042.stdout:9/965: fdatasync d8/da/fb8 0 2024-09-19T09:41:48.351 INFO:tasks.workunit.client.0.smithi042.stdout:9/966: dread d8/da/d89/da7/db6/db5/d87/dad/de5/df6/fcb [0,4194304] 0 2024-09-19T09:41:48.351 INFO:tasks.workunit.client.0.smithi042.stdout:9/967: fsync d8/f11 0 2024-09-19T09:41:48.351 INFO:tasks.workunit.client.0.smithi042.stdout:9/968: fdatasync d8/da/d89/da7/db6/db5/d87/fc8 0 2024-09-19T09:41:48.351 INFO:tasks.workunit.client.0.smithi042.stdout:9/969: truncate d8/da/d89/f121 823971 0 2024-09-19T09:41:48.351 INFO:tasks.workunit.client.0.smithi042.stdout:9/970: write d8/da/d19/d1c/fb7 [259811,32848] 0 2024-09-19T09:41:48.352 INFO:tasks.workunit.client.0.smithi042.stdout:9/971: symlink d8/da/d19/d1c/d21/d67/l12e 0 2024-09-19T09:41:48.353 INFO:tasks.workunit.client.0.smithi042.stdout:9/972: mkdir d8/da/d89/d10a/d12f 0 2024-09-19T09:41:48.356 INFO:tasks.workunit.client.0.smithi042.stdout:9/973: dread d8/d1d/d28/f9d [0,4194304] 0 2024-09-19T09:41:48.358 INFO:tasks.workunit.client.0.smithi042.stdout:9/974: dread d8/da/d19/d1c/d21/f84 [0,4194304] 0 2024-09-19T09:41:48.377 INFO:tasks.workunit.client.0.smithi042.stdout:9/975: dwrite d8/da/d89/fef [0,4194304] 0 2024-09-19T09:41:48.385 INFO:tasks.workunit.client.0.smithi042.stdout:9/976: write d8/da/d19/d1c/d21/d67/d7b/f9f [290120,52049] 0 2024-09-19T09:41:48.386 INFO:tasks.workunit.client.0.smithi042.stdout:9/977: creat d8/da/d89/da7/db6/db5/d87/f130 x:0 0 0 2024-09-19T09:41:48.386 INFO:tasks.workunit.client.0.smithi042.stdout:9/978: stat d8/d1d/d28/f9d 0 2024-09-19T09:41:48.407 INFO:tasks.workunit.client.0.smithi042.stdout:9/979: dwrite d8/f6f [0,4194304] 0 2024-09-19T09:41:48.415 INFO:tasks.workunit.client.0.smithi042.stdout:9/980: dread d8/d1d/f3f [0,4194304] 0 2024-09-19T09:41:48.416 INFO:tasks.workunit.client.0.smithi042.stdout:9/981: write d8/da/d19/d1c/d21/dbf/f103 [458264,106521] 0 2024-09-19T09:41:48.417 INFO:tasks.workunit.client.0.smithi042.stdout:9/982: write d8/da/d19/d1c/fb7 [755275,64681] 0 2024-09-19T09:41:48.422 INFO:tasks.workunit.client.0.smithi042.stdout:9/983: dread d8/da/d19/d1c/d21/d67/ff1 [0,4194304] 0 2024-09-19T09:41:48.443 INFO:tasks.workunit.client.0.smithi042.stdout:9/984: dwrite d8/da/d89/da7/db6/dc7/f107 [0,4194304] 0 2024-09-19T09:41:48.456 INFO:tasks.workunit.client.0.smithi042.stdout:9/985: dread d8/da/d19/d1c/d21/d67/d7b/fd0 [0,4194304] 0 2024-09-19T09:41:48.457 INFO:tasks.workunit.client.0.smithi042.stdout:9/986: creat d8/da/d89/da7/db6/db5/d87/dad/de5/dfc/f131 x:0 0 0 2024-09-19T09:41:48.472 INFO:tasks.workunit.client.0.smithi042.stdout:9/987: dwrite d8/da/d89/da7/db6/db5/d87/dad/de5/f115 [0,4194304] 0 2024-09-19T09:41:48.473 INFO:tasks.workunit.client.0.smithi042.stdout:9/988: stat d8/da/d89/da7/fbe 0 2024-09-19T09:41:48.479 INFO:tasks.workunit.client.0.smithi042.stdout:9/989: dread d8/da/d19/d1c/d21/d67/f5b [0,4194304] 0 2024-09-19T09:41:48.483 INFO:tasks.workunit.client.0.smithi042.stdout:9/990: dread f1 [0,4194304] 0 2024-09-19T09:41:48.484 INFO:tasks.workunit.client.0.smithi042.stdout:9/991: creat d8/da/d89/d8e/dae/f132 x:0 0 0 2024-09-19T09:41:48.490 INFO:tasks.workunit.client.0.smithi042.stdout:9/992: dread d8/da/d89/da7/db6/db5/d87/dad/fb0 [0,4194304] 0 2024-09-19T09:41:48.510 INFO:tasks.workunit.client.0.smithi042.stdout:9/993: dwrite d8/da/d89/fef [0,4194304] 0 2024-09-19T09:41:48.511 INFO:tasks.workunit.client.0.smithi042.stdout:9/994: unlink d8/da/f10 0 2024-09-19T09:41:48.512 INFO:tasks.workunit.client.0.smithi042.stdout:9/995: fdatasync d8/da/d89/d8e/dae/f132 0 2024-09-19T09:41:48.519 INFO:tasks.workunit.client.0.smithi042.stdout:9/996: dread d8/da/d19/fcc [0,4194304] 0 2024-09-19T09:41:48.520 INFO:tasks.workunit.client.0.smithi042.stdout:9/997: creat d8/f133 x:0 0 0 2024-09-19T09:41:48.521 INFO:tasks.workunit.client.0.smithi042.stdout:9/998: chown d8/da/d19/d1c/d21/de9/lea 1644 1 2024-09-19T09:41:48.536 INFO:tasks.workunit.client.0.smithi042.stdout:9/999: dwrite d8/da/d19/d1c/db4/fc2 [0,4194304] 0 2024-09-19T09:41:48.538 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm -rf -- ./tmp.yeyYVEglXo 2024-09-19T09:41:48.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:48 smithi171 ceph-mon[35803]: pgmap v411: 97 pgs: 97 active+clean; 1.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 237 MiB/s rd, 309 MiB/s wr, 467 op/s 2024-09-19T09:41:48.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:48 smithi136 ceph-mon[34840]: pgmap v411: 97 pgs: 97 active+clean; 1.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 237 MiB/s rd, 309 MiB/s wr, 467 op/s 2024-09-19T09:41:48.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:48 smithi042 ceph-mon[31223]: pgmap v411: 97 pgs: 97 active+clean; 1.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 237 MiB/s rd, 309 MiB/s wr, 467 op/s 2024-09-19T09:41:49.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:49 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:49.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:49 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:49.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:49 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:50.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:50 smithi171 ceph-mon[35803]: pgmap v412: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 262 MiB/s rd, 332 MiB/s wr, 519 op/s 2024-09-19T09:41:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:50 smithi136 ceph-mon[34840]: pgmap v412: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 262 MiB/s rd, 332 MiB/s wr, 519 op/s 2024-09-19T09:41:50.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:50 smithi042 ceph-mon[31223]: pgmap v412: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 262 MiB/s rd, 332 MiB/s wr, 519 op/s 2024-09-19T09:41:52.108 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:41:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:52.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:52 smithi042 ceph-mon[31223]: pgmap v413: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 248 MiB/s rd, 318 MiB/s wr, 521 op/s 2024-09-19T09:41:52.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:52 smithi171 ceph-mon[35803]: pgmap v413: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 248 MiB/s rd, 318 MiB/s wr, 521 op/s 2024-09-19T09:41:52.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:52 smithi136 ceph-mon[34840]: pgmap v413: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 248 MiB/s rd, 318 MiB/s wr, 521 op/s 2024-09-19T09:41:52.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.913+0000 7f47f8eff640 1 -- 172.21.15.42:0/422403999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f4101de0 msgr2=0x7f47f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:52.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.913+0000 7f47f8eff640 1 --2- 172.21.15.42:0/422403999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f4101de0 0x7f47f41021c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009900 tx=0x7f47e402a410 comp rx=0 tx=0).stop 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.913+0000 7f47f8eff640 1 -- 172.21.15.42:0/422403999 shutdown_connections 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.913+0000 7f47f8eff640 1 --2- 172.21.15.42:0/422403999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47f4106f10 0x7f47f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.913+0000 7f47f8eff640 1 --2- 172.21.15.42:0/422403999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f4102790 0x7f47f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.913+0000 7f47f8eff640 1 --2- 172.21.15.42:0/422403999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f4101de0 0x7f47f41021c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.913+0000 7f47f8eff640 1 -- 172.21.15.42:0/422403999 >> 172.21.15.42:0/422403999 conn(0x7f47f40fd8c0 msgr2=0x7f47f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.913+0000 7f47f8eff640 1 -- 172.21.15.42:0/422403999 shutdown_connections 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.913+0000 7f47f8eff640 1 -- 172.21.15.42:0/422403999 wait complete. 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f8eff640 1 Processor -- start 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f8eff640 1 -- start start 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f8eff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f4101de0 0x7f47f4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f8eff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f4102790 0x7f47f4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f8eff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47f4106f10 0x7f47f419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f8eff640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4111f30 con 0x7f47f4101de0 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f8eff640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4111db0 con 0x7f47f4106f10 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f8eff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41120b0 con 0x7f47f4102790 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f4101de0 0x7f47f4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f4101de0 0x7f47f4198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46996/0 (socket says 172.21.15.42:46996) 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f259c640 1 -- 172.21.15.42:0/4161815387 learned_addr learned my addr 172.21.15.42:0/4161815387 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f1d9b640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f4102790 0x7f47f4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47f4106f10 0x7f47f419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f259c640 1 -- 172.21.15.42:0/4161815387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f4102790 msgr2=0x7f47f4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f259c640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f4102790 0x7f47f4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f259c640 1 -- 172.21.15.42:0/4161815387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47f4106f10 msgr2=0x7f47f419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f259c640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47f4106f10 0x7f47f419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.914+0000 7f47f259c640 1 -- 172.21.15.42:0/4161815387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f419d4c0 con 0x7f47f4101de0 2024-09-19T09:41:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.915+0000 7f47f259c640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f4101de0 0x7f47f4198510 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f47e4006010 tx=0x7f47e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.915+0000 7f47e37fe640 1 -- 172.21.15.42:0/4161815387 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e403f030 con 0x7f47f4101de0 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.915+0000 7f47e37fe640 1 -- 172.21.15.42:0/4161815387 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e4003ce0 con 0x7f47f4101de0 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.915+0000 7f47f8eff640 1 -- 172.21.15.42:0/4161815387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f419d750 con 0x7f47f4101de0 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.915+0000 7f47e37fe640 1 -- 172.21.15.42:0/4161815387 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4035070 con 0x7f47f4101de0 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.915+0000 7f47f8eff640 1 -- 172.21.15.42:0/4161815387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f41a5090 con 0x7f47f4101de0 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.917+0000 7f47e37fe640 1 -- 172.21.15.42:0/4161815387 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f47e4042030 con 0x7f47f4101de0 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.917+0000 7f47fb2d8740 1 Processor -- start 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47fb2d8740 1 -- start start 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541df973a0 0x56541df97780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541dfa6a90 0x56541dfa8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56541defd2e0 con 0x56541df97cc0 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56541dea4ce0 con 0x56541df973a0 2024-09-19T09:41:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56541def92a0 con 0x56541dfa6a90 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47f259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541df973a0 0x56541df97780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47f259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47002/0 (socket says 172.21.15.42:47002) 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47f259c640 1 -- 172.21.15.42:0/2210921326 learned_addr learned my addr 172.21.15.42:0/2210921326 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47f1d9b640 1 --2- 172.21.15.42:0/2210921326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541dfa6a90 0x56541dfa8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47f2d9d640 1 -- 172.21.15.42:0/2210921326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541dfa6a90 msgr2=0x56541dfa8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/2210921326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541dfa6a90 0x56541dfa8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47f2d9d640 1 -- 172.21.15.42:0/2210921326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 msgr2=0x56541dfa6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/2210921326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47f2d9d640 1 -- 172.21.15.42:0/2210921326 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56541de89440 con 0x56541df973a0 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.918+0000 7f47e37fe640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f47dc0a3240 0x7f47dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.919+0000 7f47f259c640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f47dc0a3240 0x7f47dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.919+0000 7f47e37fe640 1 -- 172.21.15.42:0/4161815387 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f47e40efde0 con 0x7f47f4101de0 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.919+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/2210921326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541df973a0 0x56541df97780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009f00 tx=0x7f47ec011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74e6e723f307fc90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.919+0000 7f47e0ff9640 1 -- 172.21.15.42:0/2210921326 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec004d20 con 0x56541df973a0 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.919+0000 7f47e0ff9640 1 -- 172.21.15.42:0/2210921326 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47ec004050 con 0x56541df973a0 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.919+0000 7f47e0ff9640 1 -- 172.21.15.42:0/2210921326 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec005220 con 0x56541df973a0 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 -- 172.21.15.42:0/2210921326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541df973a0 msgr2=0x56541df97780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47f259c640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f47dc0a3240 0x7f47dc0a5700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47e4004650 tx=0x7f47e40f38c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/2210921326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541df973a0 0x56541df97780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009f00 tx=0x7f47ec011810 comp rx=0 tx=0).stop 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 -- 172.21.15.42:0/2210921326 shutdown_connections 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/2210921326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541dfa6a90 0x56541dfa8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/2210921326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/2210921326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541df973a0 0x56541df97780 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 -- 172.21.15.42:0/2210921326 >> 172.21.15.42:0/2210921326 conn(0x56541df93a30 msgr2=0x56541df93e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 -- 172.21.15.42:0/2210921326 shutdown_connections 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 -- 172.21.15.42:0/2210921326 wait complete. 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 -- start start 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.920+0000 7f47fb2d8740 1 Processor -- start 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df973a0 0x56541dfa6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfa3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56541dfa96c0 con 0x56541df97cc0 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56541deb8050 con 0x56541dfa6a90 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56541dfa9840 con 0x56541df973a0 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47fb2d8740 10 client.0 _ll_register_callbacks cb 0x56541def8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47004/0 (socket says 172.21.15.42:47004) 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f1d9b640 1 -- 172.21.15.42:0/1172569586 learned_addr learned my addr 172.21.15.42:0/1172569586 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df973a0 0x56541dfa6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfa3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f1d9b640 1 -- 172.21.15.42:0/1172569586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df973a0 msgr2=0x56541dfa6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f1d9b640 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df973a0 0x56541dfa6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f1d9b640 1 -- 172.21.15.42:0/1172569586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 msgr2=0x56541dfa3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f1d9b640 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfa3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f1d9b640 1 -- 172.21.15.42:0/1172569586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56541dc6e3c0 con 0x56541df97cc0 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df973a0 0x56541dfa6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47f1d9b640 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa36f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f47e800bf00 tx=0x7f47e8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f2d132113fc1c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.921+0000 7f47d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47d9ffb640 1 -- 172.21.15.42:0/1172569586 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8004020 con 0x56541df97cc0 2024-09-19T09:41:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47d9ffb640 1 -- 172.21.15.42:0/1172569586 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f47e80041c0 con 0x56541df97cc0 2024-09-19T09:41:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47fb2d8740 1 -- 172.21.15.42:0/1172569586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47ec004050 con 0x56541df97cc0 2024-09-19T09:41:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47d9ffb640 1 -- 172.21.15.42:0/1172569586 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f47e80043c0 con 0x56541df97cc0 2024-09-19T09:41:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47fb2d8740 10 client.16380 fetch_fsmap learned FSMap version 33 2024-09-19T09:41:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47fb2d8740 1 -- 172.21.15.42:0/1172569586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56541dfb5110 con 0x56541df97cc0 2024-09-19T09:41:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47d9ffb640 1 -- 172.21.15.42:0/1172569586 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47ec004050 con 0x56541df97cc0 2024-09-19T09:41:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47d9ffb640 1 -- 172.21.15.42:0/1172569586 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8406+0+0 (secure 0 0 0) 0x7f47e8003ab0 con 0x56541df97cc0 2024-09-19T09:41:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47fb2d8740 10 client.16380 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T09:41:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47fb2d8740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47fb2d8740 20 client.16380 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56541dfb65e0 0x56541dfb8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47fb2d8740 4 client.16380 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47fb2d8740 1 -- 172.21.15.42:0/1172569586 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56541df0a850 con 0x56541dfb65e0 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.922+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56541dfb65e0 0x56541dfb8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.923+0000 7f47d9ffb640 10 client.16380 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.923+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56541dfb65e0 0x56541dfb8a20 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4d34d61c5aff8f1 server_cookie=387852b06518f5be in_seq=0 out_seq=0 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.923+0000 7f47d9ffb640 1 -- 172.21.15.42:0/1172569586 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56541df0a850 con 0x56541dfb65e0 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.923+0000 7f47d9ffb640 10 client.16380 handle_command_reply: tid=0 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.923+0000 7f47fb2d8740 1 client.16380 shutdown 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 1 -- 172.21.15.42:0/1172569586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 msgr2=0x56541dfa36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa36f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f47e800bf00 tx=0x7f47e8011810 comp rx=0 tx=0).stop 2024-09-19T09:41:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 1 -- 172.21.15.42:0/1172569586 shutdown_connections 2024-09-19T09:41:52.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56541dfb65e0 0x56541dfb8a20 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfa3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df97cc0 0x56541dfa36f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47d9ffb640 0 client.16380 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:52.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/1172569586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df973a0 0x56541dfa6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 1 -- 172.21.15.42:0/1172569586 >> 172.21.15.42:0/1172569586 conn(0x56541df93a30 msgr2=0x56541df99790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:52.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 1 -- 172.21.15.42:0/1172569586 shutdown_connections 2024-09-19T09:41:52.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 1 -- 172.21.15.42:0/1172569586 wait complete. 2024-09-19T09:41:52.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.924+0000 7f47fb2d8740 20 client.16380 trim_cache size 0 max 16384 2024-09-19T09:41:52.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.942+0000 7f47fb2d8740 1 Processor -- start 2024-09-19T09:41:52.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.942+0000 7f47fb2d8740 1 -- start start 2024-09-19T09:41:52.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.942+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfb2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.942+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 0x56541dfbe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.942+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfbe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.942+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41ab490 con 0x56541df973a0 2024-09-19T09:41:52.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.942+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41ad150 con 0x56541dfa6a90 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.942+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41abbf0 con 0x56541df97cc0 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.942+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfb2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfb2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47018/0 (socket says 172.21.15.42:47018) 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f2d9d640 1 -- 172.21.15.42:0/3887262266 learned_addr learned my addr 172.21.15.42:0/3887262266 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f1d9b640 1 --2- 172.21.15.42:0/3887262266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 0x56541dfbe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/3887262266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfbe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f2d9d640 1 -- 172.21.15.42:0/3887262266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 msgr2=0x56541dfbe2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/3887262266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 0x56541dfbe2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f2d9d640 1 -- 172.21.15.42:0/3887262266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 msgr2=0x56541dfbe830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/3887262266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfbe830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f2d9d640 1 -- 172.21.15.42:0/3887262266 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56541df934d0 con 0x56541df973a0 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f1d9b640 1 --2- 172.21.15.42:0/3887262266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 0x56541dfbe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:52.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/3887262266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfb2960 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005fd0 tx=0x7f47ec011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8374f2d758148988 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:52.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47dbfff640 1 -- 172.21.15.42:0/3887262266 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0045b0 con 0x56541df973a0 2024-09-19T09:41:52.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47dbfff640 1 -- 172.21.15.42:0/3887262266 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47ec004d40 con 0x56541df973a0 2024-09-19T09:41:52.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.943+0000 7f47dbfff640 1 -- 172.21.15.42:0/3887262266 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec028450 con 0x56541df973a0 2024-09-19T09:41:52.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 -- 172.21.15.42:0/3887262266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 msgr2=0x56541dfb2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:52.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/3887262266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfb2960 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005fd0 tx=0x7f47ec011810 comp rx=0 tx=0).stop 2024-09-19T09:41:52.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 -- 172.21.15.42:0/3887262266 shutdown_connections 2024-09-19T09:41:52.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/3887262266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfbe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/3887262266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 0x56541dfbe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/3887262266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfb2960 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 -- 172.21.15.42:0/3887262266 >> 172.21.15.42:0/3887262266 conn(0x56541df93a30 msgr2=0x56541dfa27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:52.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 -- 172.21.15.42:0/3887262266 shutdown_connections 2024-09-19T09:41:52.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 -- 172.21.15.42:0/3887262266 wait complete. 2024-09-19T09:41:52.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 -- start start 2024-09-19T09:41:52.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.944+0000 7f47fb2d8740 1 Processor -- start 2024-09-19T09:41:52.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfaeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 0x56541dfaf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47fb2d8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfaa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41aca50 con 0x56541df973a0 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41ac380 con 0x56541dfa6a90 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47fb2d8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41a9470 con 0x56541df97cc0 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47fb2d8740 10 client.0 _ll_register_callbacks cb 0x7f47e800bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfaeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfaeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47034/0 (socket says 172.21.15.42:47034) 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47f2d9d640 1 -- 172.21.15.42:0/4155603494 learned_addr learned my addr 172.21.15.42:0/4155603494 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47f1d9b640 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 0x56541dfaf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfaa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47f2d9d640 1 -- 172.21.15.42:0/4155603494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 msgr2=0x56541dfaf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 0x56541dfaf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47f2d9d640 1 -- 172.21.15.42:0/4155603494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 msgr2=0x56541dfaa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfaa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.945+0000 7f47f2d9d640 1 -- 172.21.15.42:0/4155603494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56541dfaac30 con 0x56541df973a0 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.946+0000 7f47f2d9d640 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfaeea0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009560 tx=0x7f47ec005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1452a000a7c2d824 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.946+0000 7f47d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.946+0000 7f47d9ffb640 1 -- 172.21.15.42:0/4155603494 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec003c30 con 0x56541df973a0 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.946+0000 7f47d9ffb640 1 -- 172.21.15.42:0/4155603494 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f47ec0043b0 con 0x56541df973a0 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.946+0000 7f47fb2d8740 1 -- 172.21.15.42:0/4155603494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47ec004d40 con 0x56541df973a0 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.946+0000 7f47d9ffb640 1 -- 172.21.15.42:0/4155603494 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f47ec003dd0 con 0x56541df973a0 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.946+0000 7f47fb2d8740 10 client.16386 fetch_fsmap learned FSMap version 33 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.946+0000 7f47fb2d8740 1 -- 172.21.15.42:0/4155603494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56541e020f60 con 0x56541df973a0 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.946+0000 7f47d9ffb640 1 -- 172.21.15.42:0/4155603494 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47ec004d40 con 0x56541df973a0 2024-09-19T09:41:52.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.946+0000 7f47d9ffb640 1 -- 172.21.15.42:0/4155603494 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 33) ==== 8406+0+0 (secure 0 0 0) 0x7f47ec044070 con 0x56541df973a0 2024-09-19T09:41:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.947+0000 7f47fb2d8740 10 client.16386 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T09:41:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.947+0000 7f47fb2d8740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.947+0000 7f47fb2d8740 20 client.16386 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.947+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56541e0213d0 0x56541e0237c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.947+0000 7f47fb2d8740 4 client.16386 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:41:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.947+0000 7f47fb2d8740 1 -- 172.21.15.42:0/4155603494 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56541df04d60 con 0x56541e0213d0 2024-09-19T09:41:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.947+0000 7f47f1d9b640 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56541e0213d0 0x56541e0237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.947+0000 7f47f1d9b640 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56541e0213d0 0x56541e0237c0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df3a7e7175a016c6 server_cookie=cd1b20bc2b9b0d38 in_seq=0 out_seq=0 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.947+0000 7f47d9ffb640 10 client.16386 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47d9ffb640 1 -- 172.21.15.42:0/4155603494 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56541df04d60 con 0x56541e0213d0 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47d9ffb640 10 client.16386 handle_command_reply: tid=0 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 client.16386 shutdown 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 -- 172.21.15.42:0/4155603494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 msgr2=0x56541dfaeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfaeea0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009560 tx=0x7f47ec005700 comp rx=0 tx=0).stop 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 -- 172.21.15.42:0/4155603494 shutdown_connections 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56541e0213d0 0x56541e0237c0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56541dfa6a90 0x56541dfaa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56541df97cc0 0x56541dfaf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47d9ffb640 0 client.16386 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 --2- 172.21.15.42:0/4155603494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56541df973a0 0x56541dfaeea0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 -- 172.21.15.42:0/4155603494 >> 172.21.15.42:0/4155603494 conn(0x56541df93a30 msgr2=0x56541df9e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 -- 172.21.15.42:0/4155603494 shutdown_connections 2024-09-19T09:41:52.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 1 -- 172.21.15.42:0/4155603494 wait complete. 2024-09-19T09:41:52.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.948+0000 7f47fb2d8740 20 client.16386 trim_cache size 0 max 16384 2024-09-19T09:41:52.958 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:41:52.958 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-19T09:41:52.958 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-09-19T09:41:52.958 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:41:52.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 -- 172.21.15.42:0/4161815387 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f47dc0a3240 msgr2=0x7f47dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:52.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f47dc0a3240 0x7f47dc0a5700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47e4004650 tx=0x7f47e40f38c0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 -- 172.21.15.42:0/4161815387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f4101de0 msgr2=0x7f47f4198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:52.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f4101de0 0x7f47f4198510 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f47e4006010 tx=0x7f47e40042f0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 -- 172.21.15.42:0/4161815387 shutdown_connections 2024-09-19T09:41:52.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f47dc0a3240 0x7f47dc0a5700 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47f4106f10 0x7f47f419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f4102790 0x7f47f4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 --2- 172.21.15.42:0/4161815387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f4101de0 0x7f47f4198510 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:52.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 -- 172.21.15.42:0/4161815387 >> 172.21.15.42:0/4161815387 conn(0x7f47f40fd8c0 msgr2=0x7f47f40fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:52.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 -- 172.21.15.42:0/4161815387 shutdown_connections 2024-09-19T09:41:52.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:52.949+0000 7f47f8eff640 1 -- 172.21.15.42:0/4161815387 wait complete. 2024-09-19T09:41:53.912 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:41:53.913 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:41:54.183 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:54.558 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:54 smithi042 ceph-mon[31223]: pgmap v414: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 184 MiB/s rd, 230 MiB/s wr, 385 op/s 2024-09-19T09:41:54.558 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:54 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:54.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:54 smithi171 ceph-mon[35803]: pgmap v414: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 184 MiB/s rd, 230 MiB/s wr, 385 op/s 2024-09-19T09:41:54.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:54 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:54.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:54 smithi136 ceph-mon[34840]: pgmap v414: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 184 MiB/s rd, 230 MiB/s wr, 385 op/s 2024-09-19T09:41:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:54 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.637+0000 7fcc590b3640 1 -- 172.21.15.42:0/3906078198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc54102d90 msgr2=0x7fcc54103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.637+0000 7fcc590b3640 1 --2- 172.21.15.42:0/3906078198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc54102d90 0x7fcc54103170 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009930 tx=0x7fcc4402a420 comp rx=0 tx=0).stop 2024-09-19T09:41:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.638+0000 7fcc590b3640 1 -- 172.21.15.42:0/3906078198 shutdown_connections 2024-09-19T09:41:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.638+0000 7fcc590b3640 1 --2- 172.21.15.42:0/3906078198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc54108290 0x7fcc5410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.638+0000 7fcc590b3640 1 --2- 172.21.15.42:0/3906078198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc54103740 0x7fcc54107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.638+0000 7fcc590b3640 1 --2- 172.21.15.42:0/3906078198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc54102d90 0x7fcc54103170 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.638+0000 7fcc590b3640 1 -- 172.21.15.42:0/3906078198 >> 172.21.15.42:0/3906078198 conn(0x7fcc540fc7d0 msgr2=0x7fcc540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.638+0000 7fcc590b3640 1 -- 172.21.15.42:0/3906078198 shutdown_connections 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.638+0000 7fcc590b3640 1 -- 172.21.15.42:0/3906078198 wait complete. 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.638+0000 7fcc590b3640 1 Processor -- start 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.638+0000 7fcc590b3640 1 -- start start 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc590b3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc54102d90 0x7fcc541985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc590b3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc54103740 0x7fcc54198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc590b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc54108290 0x7fcc5419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc590b3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcc54112090 con 0x7fcc54108290 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc590b3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcc54111f10 con 0x7fcc54102d90 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc590b3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcc54112210 con 0x7fcc54103740 2024-09-19T09:41:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5359e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc54108290 0x7fcc5419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5259c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc54103740 0x7fcc54198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc52d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc54102d90 0x7fcc541985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5359e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc54108290 0x7fcc5419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47054/0 (socket says 172.21.15.42:47054) 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5259c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc54103740 0x7fcc54198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:56434/0 (socket says 172.21.15.42:56434) 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5359e640 1 -- 172.21.15.42:0/1726414768 learned_addr learned my addr 172.21.15.42:0/1726414768 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5359e640 1 -- 172.21.15.42:0/1726414768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc54103740 msgr2=0x7fcc54198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5359e640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc54103740 0x7fcc54198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5359e640 1 -- 172.21.15.42:0/1726414768 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc54102d90 msgr2=0x7fcc541985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5359e640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc54102d90 0x7fcc541985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5359e640 1 -- 172.21.15.42:0/1726414768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5419d580 con 0x7fcc54108290 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc52d9d640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc54102d90 0x7fcc541985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.639+0000 7fcc5359e640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc54108290 0x7fcc5419cea0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00eb10 tx=0x7fcc4c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.640+0000 7fcc3bfff640 1 -- 172.21.15.42:0/1726414768 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c004b20 con 0x7fcc54108290 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.640+0000 7fcc3bfff640 1 -- 172.21.15.42:0/1726414768 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc4c004cc0 con 0x7fcc54108290 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.640+0000 7fcc590b3640 1 -- 172.21.15.42:0/1726414768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5419d870 con 0x7fcc54108290 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.640+0000 7fcc3bfff640 1 -- 172.21.15.42:0/1726414768 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c010760 con 0x7fcc54108290 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.640+0000 7fcc590b3640 1 -- 172.21.15.42:0/1726414768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc541a5150 con 0x7fcc54108290 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.641+0000 7fcc590b3640 1 -- 172.21.15.42:0/1726414768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc5406a7f0 con 0x7fcc54108290 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.642+0000 7fcc3bfff640 1 -- 172.21.15.42:0/1726414768 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fcc4c005020 con 0x7fcc54108290 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.642+0000 7fcc3bfff640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcc3c0a3240 0x7fcc3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.643+0000 7fcc3bfff640 1 -- 172.21.15.42:0/1726414768 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fcc4c0cfe20 con 0x7fcc54108290 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.643+0000 7fcc52d9d640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcc3c0a3240 0x7fcc3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.643+0000 7fcc52d9d640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcc3c0a3240 0x7fcc3c0a5700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009900 tx=0x7fcc440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.647+0000 7fcc3bfff640 1 -- 172.21.15.42:0/1726414768 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcc4c09cb20 con 0x7fcc54108290 2024-09-19T09:41:54.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.860+0000 7fcc590b3640 1 -- 172.21.15.42:0/1726414768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc5410a2a0 con 0x7fcc54108290 2024-09-19T09:41:54.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.860+0000 7fcc3bfff640 1 -- 172.21.15.42:0/1726414768 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11998 (secure 0 0 0) 0x7fcc4c09c420 con 0x7fcc54108290 2024-09-19T09:41:54.863 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:41:54.863 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":34,"btime":"2024-09-19T09:41:53:301528+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:41:52.981420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:41:54.863 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 34 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.862+0000 7fcc590b3640 1 -- 172.21.15.42:0/1726414768 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcc3c0a3240 msgr2=0x7fcc3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.862+0000 7fcc590b3640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcc3c0a3240 0x7fcc3c0a5700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009900 tx=0x7fcc440058d0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.862+0000 7fcc590b3640 1 -- 172.21.15.42:0/1726414768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc54108290 msgr2=0x7fcc5419cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.862+0000 7fcc590b3640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc54108290 0x7fcc5419cea0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00eb10 tx=0x7fcc4c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.863+0000 7fcc590b3640 1 -- 172.21.15.42:0/1726414768 shutdown_connections 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.863+0000 7fcc590b3640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcc3c0a3240 0x7fcc3c0a5700 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.863+0000 7fcc590b3640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc54108290 0x7fcc5419cea0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.863+0000 7fcc590b3640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc54103740 0x7fcc54198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.863+0000 7fcc590b3640 1 --2- 172.21.15.42:0/1726414768 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc54102d90 0x7fcc541985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.863+0000 7fcc590b3640 1 -- 172.21.15.42:0/1726414768 >> 172.21.15.42:0/1726414768 conn(0x7fcc540fc7d0 msgr2=0x7fcc54106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.863+0000 7fcc590b3640 1 -- 172.21.15.42:0/1726414768 shutdown_connections 2024-09-19T09:41:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:54.863+0000 7fcc590b3640 1 -- 172.21.15.42:0/1726414768 wait complete. 2024-09-19T09:41:55.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:55 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1726414768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:55.589 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:41:55.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:55 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1726414768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:55.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:55 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1726414768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:55.850 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:56.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 -- 172.21.15.42:0/3391986723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1868100a80 msgr2=0x7f1868100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 --2- 172.21.15.42:0/3391986723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1868100a80 0x7f1868100ee0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1858009930 tx=0x7f185802a420 comp rx=0 tx=0).stop 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 -- 172.21.15.42:0/3391986723 shutdown_connections 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 --2- 172.21.15.42:0/3391986723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1868101420 0x7f186810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 --2- 172.21.15.42:0/3391986723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1868100a80 0x7f1868100ee0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 --2- 172.21.15.42:0/3391986723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1868106a80 0x7f1868106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 -- 172.21.15.42:0/3391986723 >> 172.21.15.42:0/3391986723 conn(0x7f18680fc7a0 msgr2=0x7f18680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 -- 172.21.15.42:0/3391986723 shutdown_connections 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 -- 172.21.15.42:0/3391986723 wait complete. 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 Processor -- start 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.291+0000 7f18700e6640 1 -- start start 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f18700e6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1868100a80 0x7f1868198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f18700e6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1868101420 0x7f1868198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f18700e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1868106a80 0x7f186819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f18700e6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1868110e80 con 0x7f1868106a80 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f18700e6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1868110d00 con 0x7f1868100a80 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f18700e6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1868111000 con 0x7f1868101420 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186e683640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1868106a80 0x7f186819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186de82640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1868100a80 0x7f1868198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186e683640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1868106a80 0x7f186819ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47072/0 (socket says 172.21.15.42:47072) 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186d681640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1868101420 0x7f1868198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186e683640 1 -- 172.21.15.42:0/4143661694 learned_addr learned my addr 172.21.15.42:0/4143661694 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186e683640 1 -- 172.21.15.42:0/4143661694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1868101420 msgr2=0x7f1868198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186e683640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1868101420 0x7f1868198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186e683640 1 -- 172.21.15.42:0/4143661694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1868100a80 msgr2=0x7f1868198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186e683640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1868100a80 0x7f1868198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186e683640 1 -- 172.21.15.42:0/4143661694 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186819d3d0 con 0x7f1868106a80 2024-09-19T09:41:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186de82640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1868100a80 0x7f1868198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.292+0000 7f186e683640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1868106a80 0x7f186819ccf0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f186000eb10 tx=0x7f186000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.293+0000 7f185effd640 1 -- 172.21.15.42:0/4143661694 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860004b20 con 0x7f1868106a80 2024-09-19T09:41:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.293+0000 7f18700e6640 1 -- 172.21.15.42:0/4143661694 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186819d6c0 con 0x7f1868106a80 2024-09-19T09:41:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.293+0000 7f185effd640 1 -- 172.21.15.42:0/4143661694 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1860004cc0 con 0x7f1868106a80 2024-09-19T09:41:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.293+0000 7f185effd640 1 -- 172.21.15.42:0/4143661694 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860010760 con 0x7f1868106a80 2024-09-19T09:41:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.293+0000 7f18700e6640 1 -- 172.21.15.42:0/4143661694 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18681a4fa0 con 0x7f1868106a80 2024-09-19T09:41:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.295+0000 7f185effd640 1 -- 172.21.15.42:0/4143661694 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1860005020 con 0x7f1868106a80 2024-09-19T09:41:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.295+0000 7f18724bf740 1 Processor -- start 2024-09-19T09:41:56.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.295+0000 7f18724bf740 1 -- start start 2024-09-19T09:41:56.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f18724bf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f18724bf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268af4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f18724bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268b01760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f18724bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559268a5a2f0 con 0x559268aff370 2024-09-19T09:41:56.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f18724bf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559268a01cf0 con 0x559268af5b40 2024-09-19T09:41:56.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f18724bf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x559268a562b0 con 0x559268af45d0 2024-09-19T09:41:56.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f185effd640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f18540a3240 0x7f18540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186d681640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186d681640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:51436/0 (socket says 172.21.15.42:51436) 2024-09-19T09:41:56.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186d681640 1 -- 172.21.15.42:0/2097298241 learned_addr learned my addr 172.21.15.42:0/2097298241 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186d681640 1 --2- 172.21.15.42:0/2097298241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268b01760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186de82640 1 --2- 172.21.15.42:0/2097298241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268af4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f185effd640 1 -- 172.21.15.42:0/4143661694 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f18600cffd0 con 0x7f1868106a80 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186e683640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f18540a3240 0x7f18540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186d681640 1 -- 172.21.15.42:0/2097298241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 msgr2=0x559268af4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186d681640 1 --2- 172.21.15.42:0/2097298241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268af4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186d681640 1 -- 172.21.15.42:0/2097298241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 msgr2=0x559268b01760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186d681640 1 --2- 172.21.15.42:0/2097298241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268b01760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186d681640 1 -- 172.21.15.42:0/2097298241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592689e63a0 con 0x559268af5b40 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.296+0000 7f186d681640 1 --2- 172.21.15.42:0/2097298241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af4090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1858006010 tx=0x7f1858009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9d5eb748f566f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f186e683640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f18540a3240 0x7f18540a5700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1860005ba0 tx=0x7f186000efd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f1853fff640 1 -- 172.21.15.42:0/2097298241 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858035030 con 0x559268af5b40 2024-09-19T09:41:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f1853fff640 1 -- 172.21.15.42:0/2097298241 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1858005020 con 0x559268af5b40 2024-09-19T09:41:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f1853fff640 1 -- 172.21.15.42:0/2097298241 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18580049a0 con 0x559268af5b40 2024-09-19T09:41:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f18724bf740 1 -- 172.21.15.42:0/2097298241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 msgr2=0x559268af4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f18724bf740 1 --2- 172.21.15.42:0/2097298241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af4090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1858006010 tx=0x7f1858009260 comp rx=0 tx=0).stop 2024-09-19T09:41:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f18724bf740 1 -- 172.21.15.42:0/2097298241 shutdown_connections 2024-09-19T09:41:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f18724bf740 1 --2- 172.21.15.42:0/2097298241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268b01760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f18724bf740 1 --2- 172.21.15.42:0/2097298241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268af4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f18724bf740 1 --2- 172.21.15.42:0/2097298241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af4090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.297+0000 7f18724bf740 1 -- 172.21.15.42:0/2097298241 >> 172.21.15.42:0/2097298241 conn(0x559268abd310 msgr2=0x559268af0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.298+0000 7f18724bf740 1 -- 172.21.15.42:0/2097298241 shutdown_connections 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.298+0000 7f18724bf740 1 -- 172.21.15.42:0/2097298241 wait complete. 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.298+0000 7f18724bf740 1 -- start start 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.298+0000 7f18724bf740 1 Processor -- start 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18724bf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af45d0 0x559268afeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18724bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268af5b40 0x559268afc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18724bf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268aff370 0x559268afc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18724bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559268b02010 con 0x559268af5b40 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18724bf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559268a15060 con 0x559268af45d0 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18724bf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x559268b02190 con 0x559268aff370 2024-09-19T09:41:56.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18724bf740 10 client.0 _ll_register_callbacks cb 0x5592687688c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186de82640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268af5b40 0x559268afc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186d681640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af45d0 0x559268afeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186de82640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268af5b40 0x559268afc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47092/0 (socket says 172.21.15.42:47092) 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186de82640 1 -- 172.21.15.42:0/3331621038 learned_addr learned my addr 172.21.15.42:0/3331621038 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186d681640 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268aff370 0x559268afc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186de82640 1 -- 172.21.15.42:0/3331621038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268aff370 msgr2=0x559268afc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186de82640 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268aff370 0x559268afc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186de82640 1 -- 172.21.15.42:0/3331621038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af45d0 msgr2=0x559268afeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186de82640 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af45d0 0x559268afeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186de82640 1 -- 172.21.15.42:0/3331621038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592687cb3c0 con 0x559268af5b40 2024-09-19T09:41:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186d681640 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af45d0 0x559268afeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f186de82640 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268af5b40 0x559268afc050 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1864012d20 tx=0x7f186400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6377adaa7e78210f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18517fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18517fa640 1 -- 172.21.15.42:0/3331621038 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864012110 con 0x559268af5b40 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18517fa640 1 -- 172.21.15.42:0/3331621038 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f1864004050 con 0x559268af5b40 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.299+0000 7f18724bf740 1 -- 172.21.15.42:0/3331621038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1858005020 con 0x559268af5b40 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18517fa640 1 -- 172.21.15.42:0/3331621038 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f18640122b0 con 0x559268af5b40 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18724bf740 10 client.16404 fetch_fsmap learned FSMap version 34 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18724bf740 1 -- 172.21.15.42:0/3331621038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559268b0db50 con 0x559268af5b40 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18517fa640 1 -- 172.21.15.42:0/3331621038 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1858005020 con 0x559268af5b40 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18517fa640 1 -- 172.21.15.42:0/3331621038 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7f1864010430 con 0x559268af5b40 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18724bf740 10 client.16404 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18724bf740 10 client.16404 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:41:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18724bf740 20 client.16404 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18724bf740 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x559268b0f010 0x559268b11460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18724bf740 4 client.16404 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f18724bf740 1 -- 172.21.15.42:0/3331621038 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559268a67860 con 0x559268b0f010 2024-09-19T09:41:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.300+0000 7f186d681640 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x559268b0f010 0x559268b11460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.301+0000 7f18517fa640 10 client.16404 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:41:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.301+0000 7f186d681640 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x559268b0f010 0x559268b11460 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=18de03984c046ebe server_cookie=e19b585a35215191 in_seq=0 out_seq=0 2024-09-19T09:41:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.301+0000 7f18517fa640 1 -- 172.21.15.42:0/3331621038 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559268a67860 con 0x559268b0f010 2024-09-19T09:41:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.301+0000 7f18517fa640 10 client.16404 handle_command_reply: tid=0 2024-09-19T09:41:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.301+0000 7f18724bf740 1 client.16404 shutdown 2024-09-19T09:41:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.301+0000 7f18724bf740 1 -- 172.21.15.42:0/3331621038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268af5b40 msgr2=0x559268afc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.301+0000 7f18724bf740 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268af5b40 0x559268afc050 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1864012d20 tx=0x7f186400f790 comp rx=0 tx=0).stop 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.302+0000 7f18724bf740 1 -- 172.21.15.42:0/3331621038 shutdown_connections 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.302+0000 7f18724bf740 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x559268b0f010 0x559268b11460 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.302+0000 7f18724bf740 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268aff370 0x559268afc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.302+0000 7f18724bf740 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268af5b40 0x559268afc050 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.302+0000 7f18724bf740 1 --2- 172.21.15.42:0/3331621038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af45d0 0x559268afeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.302+0000 7f18517fa640 0 client.16404 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.302+0000 7f18724bf740 1 -- 172.21.15.42:0/3331621038 >> 172.21.15.42:0/3331621038 conn(0x559268abd310 msgr2=0x559268af6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.302+0000 7f18724bf740 1 -- 172.21.15.42:0/3331621038 shutdown_connections 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.302+0000 7f18724bf740 1 -- 172.21.15.42:0/3331621038 wait complete. 2024-09-19T09:41:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.302+0000 7f18724bf740 20 client.16404 trim_cache size 0 max 16384 2024-09-19T09:41:56.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.315+0000 7f18724bf740 1 Processor -- start 2024-09-19T09:41:56.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.315+0000 7f18724bf740 1 -- start start 2024-09-19T09:41:56.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f18724bf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268af5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f18724bf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f18724bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268af7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f18724bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f18681ab420 con 0x559268aff370 2024-09-19T09:41:56.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f18724bf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f18681ad110 con 0x559268af5b40 2024-09-19T09:41:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f18724bf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f18681abb80 con 0x559268af45d0 2024-09-19T09:41:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f186d681640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268af5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f186d681640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268af7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f186d681640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268af7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47108/0 (socket says 172.21.15.42:47108) 2024-09-19T09:41:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f186de82640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f186d681640 1 -- 172.21.15.42:0/582540435 learned_addr learned my addr 172.21.15.42:0/582540435 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f186d681640 1 -- 172.21.15.42:0/582540435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 msgr2=0x559268af5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f186d681640 1 --2- 172.21.15.42:0/582540435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268af5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f186d681640 1 -- 172.21.15.42:0/582540435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 msgr2=0x559268af7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f186d681640 1 --2- 172.21.15.42:0/582540435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.316+0000 7f186d681640 1 -- 172.21.15.42:0/582540435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559268b11ae0 con 0x559268aff370 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.317+0000 7f186de82640 1 --2- 172.21.15.42:0/582540435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.317+0000 7f186d681640 1 --2- 172.21.15.42:0/582540435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268af7660 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1858031710 tx=0x7f1858009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e9a98e494fa637 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.319+0000 7f18537fe640 1 -- 172.21.15.42:0/582540435 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858035040 con 0x559268aff370 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.319+0000 7f18537fe640 1 -- 172.21.15.42:0/582540435 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1858005040 con 0x559268aff370 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.319+0000 7f18537fe640 1 -- 172.21.15.42:0/582540435 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858004ad0 con 0x559268aff370 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.320+0000 7f18724bf740 1 -- 172.21.15.42:0/582540435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 msgr2=0x559268af7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.320+0000 7f18724bf740 1 --2- 172.21.15.42:0/582540435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268af7660 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1858031710 tx=0x7f1858009260 comp rx=0 tx=0).stop 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.320+0000 7f18724bf740 1 -- 172.21.15.42:0/582540435 shutdown_connections 2024-09-19T09:41:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.320+0000 7f18724bf740 1 --2- 172.21.15.42:0/582540435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268af7660 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.320+0000 7f18724bf740 1 --2- 172.21.15.42:0/582540435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268af7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.320+0000 7f18724bf740 1 --2- 172.21.15.42:0/582540435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268af5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.320+0000 7f18724bf740 1 -- 172.21.15.42:0/582540435 >> 172.21.15.42:0/582540435 conn(0x559268abd310 msgr2=0x559268aeba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.320+0000 7f18724bf740 1 -- 172.21.15.42:0/582540435 shutdown_connections 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.320+0000 7f18724bf740 1 -- 172.21.15.42:0/582540435 wait complete. 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.320+0000 7f18724bf740 1 -- start start 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f18724bf740 1 Processor -- start 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f18724bf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268b07810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f18724bf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268b07d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f18724bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268af8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f18724bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f18681aca10 con 0x559268aff370 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f18724bf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f18681ac310 con 0x559268af5b40 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f18724bf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f18681a9400 con 0x559268af45d0 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f18724bf740 10 client.0 _ll_register_callbacks cb 0x7f1864009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f186d681640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268b07810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f186de82640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268b07d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f186d681640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268af8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f186de82640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268b07d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:51476/0 (socket says 172.21.15.42:51476) 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.321+0000 7f186de82640 1 -- 172.21.15.42:0/1221057426 learned_addr learned my addr 172.21.15.42:0/1221057426 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f186de82640 1 -- 172.21.15.42:0/1221057426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 msgr2=0x559268b07810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f186de82640 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268b07810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f186de82640 1 -- 172.21.15.42:0/1221057426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 msgr2=0x559268af8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f186de82640 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268af8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f186de82640 1 -- 172.21.15.42:0/1221057426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559268af94e0 con 0x559268af5b40 2024-09-19T09:41:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f186de82640 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268b07d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1864010a40 tx=0x7f1864005990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e313657c90a143e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f18517fa640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:41:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f18517fa640 1 -- 172.21.15.42:0/1221057426 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864035060 con 0x559268af5b40 2024-09-19T09:41:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f18517fa640 1 -- 172.21.15.42:0/1221057426 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f18640050b0 con 0x559268af5b40 2024-09-19T09:41:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f18724bf740 1 -- 172.21.15.42:0/1221057426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1858005040 con 0x559268af5b40 2024-09-19T09:41:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f18517fa640 1 -- 172.21.15.42:0/1221057426 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f186402c070 con 0x559268af5b40 2024-09-19T09:41:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f18724bf740 10 client.25844 fetch_fsmap learned FSMap version 35 2024-09-19T09:41:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f18724bf740 1 -- 172.21.15.42:0/1221057426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559268b79a60 con 0x559268af5b40 2024-09-19T09:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.322+0000 7f18517fa640 1 -- 172.21.15.42:0/1221057426 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1858005040 con 0x559268af5b40 2024-09-19T09:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.323+0000 7f18517fa640 1 -- 172.21.15.42:0/1221057426 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 35) ==== 8414+0+0 (secure 0 0 0) 0x7f18640038d0 con 0x559268af5b40 2024-09-19T09:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.323+0000 7f18724bf740 10 client.25844 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.323+0000 7f18724bf740 10 client.25844 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.323+0000 7f18724bf740 20 client.25844 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.323+0000 7f18724bf740 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x559268b7a2d0 0x559268b7c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.323+0000 7f18724bf740 4 client.25844 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.323+0000 7f18724bf740 1 -- 172.21.15.42:0/1221057426 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559268a61d70 con 0x559268b7a2d0 2024-09-19T09:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.323+0000 7f186d681640 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x559268b7a2d0 0x559268b7c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.323+0000 7f18517fa640 10 client.25844 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.323+0000 7f186d681640 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x559268b7a2d0 0x559268b7c6f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b424d7056cb0be10 server_cookie=2cad1fb9814a9b7 in_seq=0 out_seq=0 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18517fa640 1 -- 172.21.15.42:0/1221057426 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559268a61d70 con 0x559268b7a2d0 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18517fa640 10 client.25844 handle_command_reply: tid=0 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 client.25844 shutdown 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 -- 172.21.15.42:0/1221057426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 msgr2=0x559268b07d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268b07d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1864010a40 tx=0x7f1864005990 comp rx=0 tx=0).stop 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 -- 172.21.15.42:0/1221057426 shutdown_connections 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x559268b7a2d0 0x559268b7c6f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559268aff370 0x559268af8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559268af5b40 0x559268b07d50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 --2- 172.21.15.42:0/1221057426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559268af45d0 0x559268b07810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18517fa640 0 client.25844 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:41:56.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 -- 172.21.15.42:0/1221057426 >> 172.21.15.42:0/1221057426 conn(0x559268abd310 msgr2=0x559268afd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 -- 172.21.15.42:0/1221057426 shutdown_connections 2024-09-19T09:41:56.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 1 -- 172.21.15.42:0/1221057426 wait complete. 2024-09-19T09:41:56.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.324+0000 7f18724bf740 20 client.25844 trim_cache size 0 max 16384 2024-09-19T09:41:56.337 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:41:56.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 -- 172.21.15.42:0/4143661694 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f18540a3240 msgr2=0x7f18540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f18540a3240 0x7f18540a5700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1860005ba0 tx=0x7f186000efd0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 -- 172.21.15.42:0/4143661694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1868106a80 msgr2=0x7f186819ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:56.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1868106a80 0x7f186819ccf0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f186000eb10 tx=0x7f186000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 -- 172.21.15.42:0/4143661694 shutdown_connections 2024-09-19T09:41:56.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f18540a3240 0x7f18540a5700 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1868106a80 0x7f186819ccf0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1868101420 0x7f1868198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 --2- 172.21.15.42:0/4143661694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1868100a80 0x7f1868198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:56.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 -- 172.21.15.42:0/4143661694 >> 172.21.15.42:0/4143661694 conn(0x7f18680fc7a0 msgr2=0x7f186806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:56.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 -- 172.21.15.42:0/4143661694 shutdown_connections 2024-09-19T09:41:56.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:56.325+0000 7f18700e6640 1 -- 172.21.15.42:0/4143661694 wait complete. 2024-09-19T09:41:56.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:56 smithi171 ceph-mon[35803]: pgmap v415: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s rd, 199 MiB/s wr, 383 op/s 2024-09-19T09:41:56.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:56 smithi136 ceph-mon[34840]: pgmap v415: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s rd, 199 MiB/s wr, 383 op/s 2024-09-19T09:41:56.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:56 smithi042 ceph-mon[31223]: pgmap v415: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s rd, 199 MiB/s wr, 383 op/s 2024-09-19T09:41:56.987 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:41:57.270 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:57.580 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:57 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:57.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:57 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:57.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:57 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:57.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.755+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3986664820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bd0102d40 msgr2=0x7f0bd0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.755+0000 7f0bd53d1640 1 --2- 172.21.15.42:0/3986664820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bd0102d40 0x7f0bd0103120 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009900 tx=0x7f0bc002a480 comp rx=0 tx=0).stop 2024-09-19T09:41:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.755+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3986664820 shutdown_connections 2024-09-19T09:41:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.755+0000 7f0bd53d1640 1 --2- 172.21.15.42:0/3986664820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bd010c170 0x7f0bd010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.755+0000 7f0bd53d1640 1 --2- 172.21.15.42:0/3986664820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bd0103660 0x7f0bd010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.755+0000 7f0bd53d1640 1 --2- 172.21.15.42:0/3986664820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bd0102d40 0x7f0bd0103120 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.755+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3986664820 >> 172.21.15.42:0/3986664820 conn(0x7f0bd00fc7a0 msgr2=0x7f0bd00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.755+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3986664820 shutdown_connections 2024-09-19T09:41:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.755+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3986664820 wait complete. 2024-09-19T09:41:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bd53d1640 1 Processor -- start 2024-09-19T09:41:57.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bd53d1640 1 -- start start 2024-09-19T09:41:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bd53d1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bd0102d40 0x7f0bd0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bd53d1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bd0103660 0x7f0bd0198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bd53d1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bd010c170 0x7f0bd019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bd53d1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd0111f70 con 0x7f0bd0103660 2024-09-19T09:41:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bd53d1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd0111df0 con 0x7f0bd010c170 2024-09-19T09:41:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bd53d1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01120f0 con 0x7f0bd0102d40 2024-09-19T09:41:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bd0103660 0x7f0bd0198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bd0102d40 0x7f0bd0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bd0103660 0x7f0bd0198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47140/0 (socket says 172.21.15.42:47140) 2024-09-19T09:41:57.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bd010c170 0x7f0bd019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.756+0000 7f0bce7fc640 1 -- 172.21.15.42:0/3720387176 learned_addr learned my addr 172.21.15.42:0/3720387176 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bce7fc640 1 -- 172.21.15.42:0/3720387176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bd0102d40 msgr2=0x7f0bd0198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bce7fc640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bd0102d40 0x7f0bd0198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bce7fc640 1 -- 172.21.15.42:0/3720387176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bd010c170 msgr2=0x7f0bd019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bce7fc640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bd010c170 0x7f0bd019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bce7fc640 1 -- 172.21.15.42:0/3720387176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd019d400 con 0x7f0bd0103660 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bcf7fe640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bd010c170 0x7f0bd019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bce7fc640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bd0103660 0x7f0bd0198990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400d740 tx=0x7f0bc400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bb7fff640 1 -- 172.21.15.42:0/3720387176 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4017070 con 0x7f0bd0103660 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3720387176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd019d6f0 con 0x7f0bd0103660 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bb7fff640 1 -- 172.21.15.42:0/3720387176 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc400de50 con 0x7f0bd0103660 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bb7fff640 1 -- 172.21.15.42:0/3720387176 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400f620 con 0x7f0bd0103660 2024-09-19T09:41:57.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.757+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3720387176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd01a4fd0 con 0x7f0bd0103660 2024-09-19T09:41:57.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bb7fff640 1 -- 172.21.15.42:0/3720387176 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f0bc4009c30 con 0x7f0bd0103660 2024-09-19T09:41:57.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bd77aa740 1 Processor -- start 2024-09-19T09:41:57.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bd77aa740 1 -- start start 2024-09-19T09:41:57.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 0x563257d6c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6c5d0 0x563257d6ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d79760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563257cd22f0 con 0x563257d6c5d0 2024-09-19T09:41:57.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563257c79cf0 con 0x563257d77370 2024-09-19T09:41:57.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563257cce2b0 con 0x563257d6db40 2024-09-19T09:41:57.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6c5d0 0x563257d6ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6c5d0 0x563257d6ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47146/0 (socket says 172.21.15.42:47146) 2024-09-19T09:41:57.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d79760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bceffd640 1 -- 172.21.15.42:0/3213330726 learned_addr learned my addr 172.21.15.42:0/3213330726 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:57.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bcf7fe640 1 --2- 172.21.15.42:0/3213330726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 0x563257d6c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bb7fff640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3240 0x7f0bb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bceffd640 1 -- 172.21.15.42:0/3213330726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 msgr2=0x563257d6c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:57.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bceffd640 1 --2- 172.21.15.42:0/3213330726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 0x563257d6c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bceffd640 1 -- 172.21.15.42:0/3213330726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 msgr2=0x563257d79760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:57.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bceffd640 1 --2- 172.21.15.42:0/3213330726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d79760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.760+0000 7f0bceffd640 1 -- 172.21.15.42:0/3213330726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563257c5e3a0 con 0x563257d6c5d0 2024-09-19T09:41:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.761+0000 7f0bcf7fe640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3240 0x7f0bb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.761+0000 7f0bb7fff640 1 -- 172.21.15.42:0/3720387176 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0bc40cf480 con 0x7f0bd0103660 2024-09-19T09:41:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.761+0000 7f0bceffd640 1 --2- 172.21.15.42:0/3213330726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6c5d0 0x563257d6ca10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009900 tx=0x7f0bc0005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898d5fe99af48ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.761+0000 7f0bb57fa640 1 -- 172.21.15.42:0/3213330726 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0040070 con 0x563257d6c5d0 2024-09-19T09:41:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.761+0000 7f0bb57fa640 1 -- 172.21.15.42:0/3213330726 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc00318f0 con 0x563257d6c5d0 2024-09-19T09:41:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.761+0000 7f0bb57fa640 1 -- 172.21.15.42:0/3213330726 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0035040 con 0x563257d6c5d0 2024-09-19T09:41:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3213330726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6c5d0 msgr2=0x563257d6ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3213330726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6c5d0 0x563257d6ca10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009900 tx=0x7f0bc0005e00 comp rx=0 tx=0).stop 2024-09-19T09:41:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bcf7fe640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3240 0x7f0bb80a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8005c40 tx=0x7f0bc8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3213330726 shutdown_connections 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3213330726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d79760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3213330726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6c5d0 0x563257d6ca10 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3213330726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 0x563257d6c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3213330726 >> 172.21.15.42:0/3213330726 conn(0x563257d35310 msgr2=0x563257d68c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3213330726 shutdown_connections 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3213330726 wait complete. 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 -- start start 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.762+0000 7f0bd77aa740 1 Processor -- start 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d76ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 0x563257d73f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d744f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563257d7a010 con 0x563257d6db40 2024-09-19T09:41:57.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563257c8d060 con 0x563257d77370 2024-09-19T09:41:57.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563257d7a190 con 0x563257d6c5d0 2024-09-19T09:41:57.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bd77aa740 10 client.0 _ll_register_callbacks cb 0x5632579e08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:57.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d76ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d76ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:56494/0 (socket says 172.21.15.42:56494) 2024-09-19T09:41:57.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 0x563257d73f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bceffd640 1 -- 172.21.15.42:0/2157787499 learned_addr learned my addr 172.21.15.42:0/2157787499 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bcf7fe640 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bceffd640 1 -- 172.21.15.42:0/2157787499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 msgr2=0x563257d744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bceffd640 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bceffd640 1 -- 172.21.15.42:0/2157787499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 msgr2=0x563257d73f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bceffd640 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 0x563257d73f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bceffd640 1 -- 172.21.15.42:0/2157787499 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563257a433c0 con 0x563257d6c5d0 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bceffd640 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d76ce0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0005940 tx=0x7f0bc0005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23cf0ddf4df3c77d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.763+0000 7f0bb2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/2157787499 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc004c070 con 0x563257d6c5d0 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/2157787499 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0bc00048d0 con 0x563257d6c5d0 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bd77aa740 1 -- 172.21.15.42:0/2157787499 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc00318f0 con 0x563257d6c5d0 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/2157787499 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0bc0058050 con 0x563257d6c5d0 2024-09-19T09:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bd77aa740 10 client.25774 fetch_fsmap learned FSMap version 35 2024-09-19T09:41:57.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bd77aa740 1 -- 172.21.15.42:0/2157787499 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563257d7a010 con 0x563257d6c5d0 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/2157787499 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc00318f0 con 0x563257d6c5d0 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/2157787499 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 35) ==== 8414+0+0 (secure 0 0 0) 0x7f0bc003c960 con 0x563257d6c5d0 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bd77aa740 10 client.25774 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bd77aa740 10 client.25774 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bd77aa740 20 client.25774 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x563257d86ba0 0x563257d88f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bd77aa740 4 client.25774 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.764+0000 7f0bd77aa740 1 -- 172.21.15.42:0/2157787499 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563257cdf860 con 0x563257d86ba0 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.765+0000 7f0bce7fc640 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x563257d86ba0 0x563257d88f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.765+0000 7f0bb2ff5640 10 client.25774 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:41:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.765+0000 7f0bce7fc640 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x563257d86ba0 0x563257d88f90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=64ad04f823900733 server_cookie=1253f4c042839599 in_seq=0 out_seq=0 2024-09-19T09:41:57.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/2157787499 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563257cdf860 con 0x563257d86ba0 2024-09-19T09:41:57.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bb2ff5640 10 client.25774 handle_command_reply: tid=0 2024-09-19T09:41:57.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 client.25774 shutdown 2024-09-19T09:41:57.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 -- 172.21.15.42:0/2157787499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 msgr2=0x563257d76ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d76ce0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0005940 tx=0x7f0bc0005250 comp rx=0 tx=0).stop 2024-09-19T09:41:57.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 -- 172.21.15.42:0/2157787499 shutdown_connections 2024-09-19T09:41:57.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x563257d86ba0 0x563257d88f90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 0x563257d73f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/2157787499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d76ce0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bb2ff5640 0 client.25774 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:41:57.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 -- 172.21.15.42:0/2157787499 >> 172.21.15.42:0/2157787499 conn(0x563257d35310 msgr2=0x563257d6e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:57.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 -- 172.21.15.42:0/2157787499 shutdown_connections 2024-09-19T09:41:57.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 1 -- 172.21.15.42:0/2157787499 wait complete. 2024-09-19T09:41:57.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.766+0000 7f0bd77aa740 20 client.25774 trim_cache size 0 max 16384 2024-09-19T09:41:57.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.779+0000 7f0bd77aa740 1 Processor -- start 2024-09-19T09:41:57.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.779+0000 7f0bd77aa740 1 -- start start 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d6c5d0 0x563257d832b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 0x563257d8e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d77370 0x563257d8ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01ad640 con 0x563257d77370 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01af360 con 0x563257d6c5d0 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01addd0 con 0x563257d6db40 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d77370 0x563257d8ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 0x563257d8e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d6c5d0 0x563257d832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 0x563257d8e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:56506/0 (socket says 172.21.15.42:56506) 2024-09-19T09:41:57.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bce7fc640 1 -- 172.21.15.42:0/3981985981 learned_addr learned my addr 172.21.15.42:0/3981985981 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:57.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bcf7fe640 1 -- 172.21.15.42:0/3981985981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 msgr2=0x563257d8e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:57.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bcf7fe640 1 --2- 172.21.15.42:0/3981985981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 0x563257d8e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bcf7fe640 1 -- 172.21.15.42:0/3981985981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d6c5d0 msgr2=0x563257d832b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:57.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bcf7fe640 1 --2- 172.21.15.42:0/3981985981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d6c5d0 0x563257d832b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bcf7fe640 1 -- 172.21.15.42:0/3981985981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563257d69730 con 0x563257d77370 2024-09-19T09:41:57.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.780+0000 7f0bcf7fe640 1 --2- 172.21.15.42:0/3981985981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d77370 0x563257d8ece0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800fd60 tx=0x7f0bc8013030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a73aaafd5c7c3a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:57.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bb4ff9640 1 -- 172.21.15.42:0/3981985981 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc801f0d0 con 0x563257d77370 2024-09-19T09:41:57.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bb4ff9640 1 -- 172.21.15.42:0/3981985981 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc801f270 con 0x563257d77370 2024-09-19T09:41:57.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bb4ff9640 1 -- 172.21.15.42:0/3981985981 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc802a460 con 0x563257d77370 2024-09-19T09:41:57.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3981985981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d77370 msgr2=0x563257d8ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3981985981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d77370 0x563257d8ece0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800fd60 tx=0x7f0bc8013030 comp rx=0 tx=0).stop 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3981985981 shutdown_connections 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3981985981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d77370 0x563257d8ece0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3981985981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6db40 0x563257d8e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3981985981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d6c5d0 0x563257d832b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3981985981 >> 172.21.15.42:0/3981985981 conn(0x563257d35310 msgr2=0x563257d73080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3981985981 shutdown_connections 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.781+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3981985981 wait complete. 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bd77aa740 1 -- start start 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bd77aa740 1 Processor -- start 2024-09-19T09:41:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d70f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 0x563257d714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bd77aa740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01aec60 con 0x563257d6db40 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01ae560 con 0x563257d77370 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bd77aa740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01ab620 con 0x563257d6c5d0 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bd77aa740 10 client.0 _ll_register_callbacks cb 0x7f0bc40d2e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 0x563257d714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d70f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d70f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:56514/0 (socket says 172.21.15.42:56514) 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bceffd640 1 -- 172.21.15.42:0/3826785576 learned_addr learned my addr 172.21.15.42:0/3826785576 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 0x563257d714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47174/0 (socket says 172.21.15.42:47174) 2024-09-19T09:41:57.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bcf7fe640 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bceffd640 1 -- 172.21.15.42:0/3826785576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 msgr2=0x563257d719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:57.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bceffd640 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bceffd640 1 -- 172.21.15.42:0/3826785576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 msgr2=0x563257d714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:57.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bceffd640 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 0x563257d714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bceffd640 1 -- 172.21.15.42:0/3826785576 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563257df0770 con 0x563257d6c5d0 2024-09-19T09:41:57.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.782+0000 7f0bce7fc640 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 0x563257d714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bceffd640 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d70f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0bc002a9a0 tx=0x7f0bc00058c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a4e498dca4660b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bb2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/3826785576 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0055020 con 0x563257d6c5d0 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3826785576 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc801f270 con 0x563257d6c5d0 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/3826785576 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0bc0004030 con 0x563257d6c5d0 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/3826785576 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0bc004c040 con 0x563257d6c5d0 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bd77aa740 10 client.25780 fetch_fsmap learned FSMap version 35 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3826785576 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563257df1a10 con 0x563257d6c5d0 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/3826785576 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc801f270 con 0x563257d6c5d0 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/3826785576 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 35) ==== 8414+0+0 (secure 0 0 0) 0x7f0bc003c440 con 0x563257d6c5d0 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bd77aa740 10 client.25780 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bd77aa740 10 client.25780 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:41:57.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bd77aa740 20 client.25780 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x563257df21c0 0x563257df45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bd77aa740 4 client.25780 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.783+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3826785576 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563257cd9d70 con 0x563257df21c0 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bce7fc640 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x563257df21c0 0x563257df45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bce7fc640 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x563257df21c0 0x563257df45e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=425d5009eeef49ea server_cookie=d56c67eaaa86b657 in_seq=0 out_seq=0 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bb2ff5640 10 client.25780 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bb2ff5640 1 -- 172.21.15.42:0/3826785576 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563257cd9d70 con 0x563257df21c0 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bb2ff5640 10 client.25780 handle_command_reply: tid=0 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 client.25780 shutdown 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3826785576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 msgr2=0x563257d70f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d70f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0bc002a9a0 tx=0x7f0bc00058c0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3826785576 shutdown_connections 2024-09-19T09:41:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x563257df21c0 0x563257df45e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563257d77370 0x563257d719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563257d6db40 0x563257d714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 --2- 172.21.15.42:0/3826785576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563257d6c5d0 0x563257d70f60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3826785576 >> 172.21.15.42:0/3826785576 conn(0x563257d35310 msgr2=0x563257d6e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bb2ff5640 0 client.25780 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:41:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3826785576 shutdown_connections 2024-09-19T09:41:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.784+0000 7f0bd77aa740 1 -- 172.21.15.42:0/3826785576 wait complete. 2024-09-19T09:41:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd77aa740 20 client.25780 trim_cache size 0 max 16384 2024-09-19T09:41:57.794 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:41:57.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3720387176 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3240 msgr2=0x7f0bb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3240 0x7f0bb80a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8005c40 tx=0x7f0bc8004a40 comp rx=0 tx=0).stop 2024-09-19T09:41:57.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3720387176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bd0103660 msgr2=0x7f0bd0198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:57.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bd0103660 0x7f0bd0198990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400d740 tx=0x7f0bc400dc00 comp rx=0 tx=0).stop 2024-09-19T09:41:57.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3720387176 shutdown_connections 2024-09-19T09:41:57.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f0bb80a3240 0x7f0bb80a5700 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bd010c170 0x7f0bd019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bd0103660 0x7f0bd0198990 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 --2- 172.21.15.42:0/3720387176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bd0102d40 0x7f0bd0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:57.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3720387176 >> 172.21.15.42:0/3720387176 conn(0x7f0bd00fc7a0 msgr2=0x7f0bd00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:57.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3720387176 shutdown_connections 2024-09-19T09:41:57.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:57.785+0000 7f0bd53d1640 1 -- 172.21.15.42:0/3720387176 wait complete. 2024-09-19T09:41:57.889 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:41:57.889 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:41:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.375+0000 7fecb1f4b640 1 -- 172.21.15.42:0/2407734575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac1025f0 msgr2=0x7fecac108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.375+0000 7fecb1f4b640 1 --2- 172.21.15.42:0/2407734575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac1025f0 0x7fecac108e80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7feca4009ca0 tx=0x7feca402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.375+0000 7fecb1f4b640 1 -- 172.21.15.42:0/2407734575 shutdown_connections 2024-09-19T09:41:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.375+0000 7fecb1f4b640 1 --2- 172.21.15.42:0/2407734575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac1025f0 0x7fecac108e80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.375+0000 7fecb1f4b640 1 --2- 172.21.15.42:0/2407734575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecac101c30 0x7fecac1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.375+0000 7fecb1f4b640 1 --2- 172.21.15.42:0/2407734575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecac100a40 0x7fecac100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.375+0000 7fecb1f4b640 1 -- 172.21.15.42:0/2407734575 >> 172.21.15.42:0/2407734575 conn(0x7fecac0fc1e0 msgr2=0x7fecac0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.375+0000 7fecb1f4b640 1 -- 172.21.15.42:0/2407734575 shutdown_connections 2024-09-19T09:41:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.375+0000 7fecb1f4b640 1 -- 172.21.15.42:0/2407734575 wait complete. 2024-09-19T09:41:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecb1f4b640 1 Processor -- start 2024-09-19T09:41:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecb1f4b640 1 -- start start 2024-09-19T09:41:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecb1f4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac100a40 0x7fecac196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecb1f4b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecac101c30 0x7fecac1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecb1f4b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecac1025f0 0x7fecac19e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.397 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecb1f4b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fecac10c710 con 0x7fecac100a40 2024-09-19T09:41:58.397 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecb1f4b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fecac10c590 con 0x7fecac1025f0 2024-09-19T09:41:58.397 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecb1f4b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fecac10c890 con 0x7fecac101c30 2024-09-19T09:41:58.397 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac100a40 0x7fecac196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.397 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac100a40 0x7fecac196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47192/0 (socket says 172.21.15.42:47192) 2024-09-19T09:41:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.376+0000 7fecab7fe640 1 -- 172.21.15.42:0/77696883 learned_addr learned my addr 172.21.15.42:0/77696883 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7feca2ffd640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecac101c30 0x7fecac1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7fecabfff640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecac1025f0 0x7fecac19e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7fecab7fe640 1 -- 172.21.15.42:0/77696883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecac101c30 msgr2=0x7fecac1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7fecab7fe640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecac101c30 0x7fecac1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7fecab7fe640 1 -- 172.21.15.42:0/77696883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecac1025f0 msgr2=0x7fecac19e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7fecab7fe640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecac1025f0 0x7fecac19e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7fecab7fe640 1 -- 172.21.15.42:0/77696883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac0699a0 con 0x7fecac100a40 2024-09-19T09:41:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7feca2ffd640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecac101c30 0x7fecac1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7fecab7fe640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac100a40 0x7fecac196c80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00e9c0 tx=0x7fec9c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7feca97fa640 1 -- 172.21.15.42:0/77696883 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00cd80 con 0x7fecac100a40 2024-09-19T09:41:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7feca97fa640 1 -- 172.21.15.42:0/77696883 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec9c0035f0 con 0x7fecac100a40 2024-09-19T09:41:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7fecb1f4b640 1 -- 172.21.15.42:0/77696883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecac069c90 con 0x7fecac100a40 2024-09-19T09:41:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7feca97fa640 1 -- 172.21.15.42:0/77696883 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c010690 con 0x7fecac100a40 2024-09-19T09:41:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.377+0000 7fecb1f4b640 1 -- 172.21.15.42:0/77696883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecac06a190 con 0x7fecac100a40 2024-09-19T09:41:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.379+0000 7feca97fa640 1 -- 172.21.15.42:0/77696883 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fec9c0037a0 con 0x7fecac100a40 2024-09-19T09:41:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecb4dc5740 1 Processor -- start 2024-09-19T09:41:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecb4dc5740 1 -- start start 2024-09-19T09:41:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 0x55b9a87bbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87c1370 0x55b9a87c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9a871f2f0 con 0x55b9a87c1370 2024-09-19T09:41:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b9a86c7270 con 0x55b9a87bc2e0 2024-09-19T09:41:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b9a871b2b0 con 0x55b9a87bb9a0 2024-09-19T09:41:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7feca2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87c1370 0x55b9a87c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecabfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 0x55b9a87bbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecabfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 0x55b9a87bbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:56542/0 (socket says 172.21.15.42:56542) 2024-09-19T09:41:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7feca2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87c1370 0x55b9a87c3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47194/0 (socket says 172.21.15.42:47194) 2024-09-19T09:41:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecabfff640 1 -- 172.21.15.42:0/3646004285 learned_addr learned my addr 172.21.15.42:0/3646004285 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecab7fe640 1 --2- 172.21.15.42:0/3646004285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecabfff640 1 -- 172.21.15.42:0/3646004285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 msgr2=0x55b9a87c0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:58.403 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecabfff640 1 --2- 172.21.15.42:0/3646004285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87c0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecabfff640 1 -- 172.21.15.42:0/3646004285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87c1370 msgr2=0x55b9a87c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecabfff640 1 --2- 172.21.15.42:0/3646004285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87c1370 0x55b9a87c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7fecabfff640 1 -- 172.21.15.42:0/3646004285 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a86c6340 con 0x55b9a87bb9a0 2024-09-19T09:41:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7feca2ffd640 1 --2- 172.21.15.42:0/3646004285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87c1370 0x55b9a87c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.380+0000 7feca97fa640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec980a32f0 0x7fec980a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.381+0000 7fecab7fe640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec980a32f0 0x7fec980a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.381+0000 7fecabfff640 1 --2- 172.21.15.42:0/3646004285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 0x55b9a87bbda0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feca4009ca0 tx=0x7feca4005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bbe8c3186d33f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.381+0000 7feca97fa640 1 -- 172.21.15.42:0/77696883 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fec9c0cfc80 con 0x7fecac100a40 2024-09-19T09:41:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.381+0000 7feca1ffb640 1 -- 172.21.15.42:0/3646004285 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4031650 con 0x55b9a87bb9a0 2024-09-19T09:41:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.381+0000 7feca1ffb640 1 -- 172.21.15.42:0/3646004285 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca4036030 con 0x55b9a87bb9a0 2024-09-19T09:41:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.381+0000 7feca1ffb640 1 -- 172.21.15.42:0/3646004285 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca40047f0 con 0x55b9a87bb9a0 2024-09-19T09:41:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3646004285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 msgr2=0x55b9a87bbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecab7fe640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec980a32f0 0x7fec980a57b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0cdad0 tx=0x7fec9c0d3760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/3646004285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 0x55b9a87bbda0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feca4009ca0 tx=0x7feca4005fa0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3646004285 shutdown_connections 2024-09-19T09:41:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/3646004285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87c1370 0x55b9a87c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/3646004285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87c0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/3646004285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 0x55b9a87bbda0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3646004285 >> 172.21.15.42:0/3646004285 conn(0x55b9a87b7010 msgr2=0x55b9a87b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3646004285 shutdown_connections 2024-09-19T09:41:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3646004285 wait complete. 2024-09-19T09:41:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 -- start start 2024-09-19T09:41:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.382+0000 7fecb4dc5740 1 Processor -- start 2024-09-19T09:41:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bb9a0 0x55b9a87c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87c1370 0x55b9a87ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9a87c4160 con 0x55b9a87bb9a0 2024-09-19T09:41:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b9a86a8290 con 0x55b9a87bc2e0 2024-09-19T09:41:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b9a87c42e0 con 0x55b9a87c1370 2024-09-19T09:41:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecb4dc5740 10 client.0 _ll_register_callbacks cb 0x55b9a86d9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bb9a0 0x55b9a87c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bb9a0 0x55b9a87c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47200/0 (socket says 172.21.15.42:47200) 2024-09-19T09:41:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecabfff640 1 -- 172.21.15.42:0/2684877249 learned_addr learned my addr 172.21.15.42:0/2684877249 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7feca2ffd640 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecabfff640 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87c1370 0x55b9a87ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecabfff640 1 -- 172.21.15.42:0/2684877249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87c1370 msgr2=0x55b9a87ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecabfff640 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87c1370 0x55b9a87ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecabfff640 1 -- 172.21.15.42:0/2684877249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 msgr2=0x55b9a87c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecabfff640 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecabfff640 1 -- 172.21.15.42:0/2684877249 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9a8432210 con 0x55b9a87bb9a0 2024-09-19T09:41:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fecabfff640 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bb9a0 0x55b9a87c59e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7feca4009a60 tx=0x7feca4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded0f9c4d83b76fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fec8affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.383+0000 7fec8affd640 1 -- 172.21.15.42:0/2684877249 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4058060 con 0x55b9a87bb9a0 2024-09-19T09:41:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fec8affd640 1 -- 172.21.15.42:0/2684877249 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7feca4003b70 con 0x55b9a87bb9a0 2024-09-19T09:41:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fecb4dc5740 1 -- 172.21.15.42:0/2684877249 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca4036030 con 0x55b9a87bb9a0 2024-09-19T09:41:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fec8affd640 1 -- 172.21.15.42:0/2684877249 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7feca404a040 con 0x55b9a87bb9a0 2024-09-19T09:41:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fecb4dc5740 10 client.16440 fetch_fsmap learned FSMap version 36 2024-09-19T09:41:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fecb4dc5740 1 -- 172.21.15.42:0/2684877249 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b9a84fe620 con 0x55b9a87bb9a0 2024-09-19T09:41:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fec8affd640 1 -- 172.21.15.42:0/2684877249 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca4036030 con 0x55b9a87bb9a0 2024-09-19T09:41:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fec8affd640 1 -- 172.21.15.42:0/2684877249 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7feca4050070 con 0x55b9a87bb9a0 2024-09-19T09:41:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fecb4dc5740 10 client.16440 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:41:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fecb4dc5740 10 client.16440 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fecb4dc5740 20 client.16440 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b9a87d5780 0x55b9a87d7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fecb4dc5740 4 client.16440 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.384+0000 7fecb4dc5740 1 -- 172.21.15.42:0/2684877249 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9a872ca20 con 0x55b9a87d5780 2024-09-19T09:41:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.385+0000 7feca2ffd640 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b9a87d5780 0x55b9a87d7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.385+0000 7feca2ffd640 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b9a87d5780 0x55b9a87d7ba0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f38224667c42c50b server_cookie=3af219ea6d3f3d0c in_seq=0 out_seq=0 2024-09-19T09:41:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.385+0000 7fec8affd640 10 client.16440 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fec8affd640 1 -- 172.21.15.42:0/2684877249 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9a872ca20 con 0x55b9a87d5780 2024-09-19T09:41:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fec8affd640 10 client.16440 handle_command_reply: tid=0 2024-09-19T09:41:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 client.16440 shutdown 2024-09-19T09:41:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 -- 172.21.15.42:0/2684877249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bb9a0 msgr2=0x55b9a87c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bb9a0 0x55b9a87c59e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7feca4009a60 tx=0x7feca4005bd0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 -- 172.21.15.42:0/2684877249 shutdown_connections 2024-09-19T09:41:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b9a87d5780 0x55b9a87d7ba0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87c1370 0x55b9a87ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/2684877249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bb9a0 0x55b9a87c59e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fec8affd640 0 client.16440 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 -- 172.21.15.42:0/2684877249 >> 172.21.15.42:0/2684877249 conn(0x55b9a87b7010 msgr2=0x55b9a87b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 -- 172.21.15.42:0/2684877249 shutdown_connections 2024-09-19T09:41:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.386+0000 7fecb4dc5740 1 -- 172.21.15.42:0/2684877249 wait complete. 2024-09-19T09:41:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.387+0000 7fecb4dc5740 20 client.16440 trim_cache size 0 max 16384 2024-09-19T09:41:58.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecb4dc5740 1 Processor -- start 2024-09-19T09:41:58.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecb4dc5740 1 -- start start 2024-09-19T09:41:58.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87b7010 0x55b9a87bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bb9a0 0x55b9a87ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.422 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bc2e0 0x55b9a87b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1a6da0 con 0x55b9a87bc2e0 2024-09-19T09:41:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1a8b20 con 0x55b9a87bb9a0 2024-09-19T09:41:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1a7530 con 0x55b9a87b7010 2024-09-19T09:41:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bc2e0 0x55b9a87b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bc2e0 0x55b9a87b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47212/0 (socket says 172.21.15.42:47212) 2024-09-19T09:41:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecabfff640 1 -- 172.21.15.42:0/442993548 learned_addr learned my addr 172.21.15.42:0/442993548 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7fecabfff640 1 --2- 172.21.15.42:0/442993548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87b7010 0x55b9a87bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.401+0000 7feca2ffd640 1 --2- 172.21.15.42:0/442993548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bb9a0 0x55b9a87ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.402+0000 7fecabfff640 1 -- 172.21.15.42:0/442993548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87b7010 msgr2=0x55b9a87bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.402+0000 7fecabfff640 1 --2- 172.21.15.42:0/442993548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87b7010 0x55b9a87bbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.402+0000 7fecabfff640 1 -- 172.21.15.42:0/442993548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bb9a0 msgr2=0x55b9a87ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.402+0000 7fecabfff640 1 --2- 172.21.15.42:0/442993548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bb9a0 0x55b9a87ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.402+0000 7fecabfff640 1 -- 172.21.15.42:0/442993548 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a87ce400 con 0x55b9a87bc2e0 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.402+0000 7fecabfff640 1 --2- 172.21.15.42:0/442993548 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bc2e0 0x55b9a87b60b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7feca4004400 tx=0x7feca402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1733951b1a364441 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.402+0000 7feca17fa640 1 -- 172.21.15.42:0/442993548 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4058040 con 0x55b9a87bc2e0 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.402+0000 7feca17fa640 1 -- 172.21.15.42:0/442993548 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca4036070 con 0x55b9a87bc2e0 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.402+0000 7feca17fa640 1 -- 172.21.15.42:0/442993548 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4003970 con 0x55b9a87bc2e0 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 -- 172.21.15.42:0/442993548 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bc2e0 msgr2=0x55b9a87b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/442993548 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bc2e0 0x55b9a87b60b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7feca4004400 tx=0x7feca402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 -- 172.21.15.42:0/442993548 shutdown_connections 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/442993548 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87bc2e0 0x55b9a87b60b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/442993548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bb9a0 0x55b9a87ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/442993548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87b7010 0x55b9a87bbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 -- 172.21.15.42:0/442993548 >> 172.21.15.42:0/442993548 conn(0x55b9a87c0e90 msgr2=0x55b9a87b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 -- 172.21.15.42:0/442993548 shutdown_connections 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 -- 172.21.15.42:0/442993548 wait complete. 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 -- start start 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 Processor -- start 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87b7010 0x55b9a87ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 0x55b9a87caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.403+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1a8420 con 0x55b9a87b7010 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1a7cc0 con 0x55b9a87bc2e0 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecb4dc5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1a4d80 con 0x55b9a87bb9a0 2024-09-19T09:41:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecb4dc5740 10 client.0 _ll_register_callbacks cb 0x7fec9400bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87b7010 0x55b9a87ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87b7010 0x55b9a87ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47228/0 (socket says 172.21.15.42:47228) 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecabfff640 1 -- 172.21.15.42:0/3793343085 learned_addr learned my addr 172.21.15.42:0/3793343085 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7feca2ffd640 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 0x55b9a87caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecabfff640 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecabfff640 1 -- 172.21.15.42:0/3793343085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 msgr2=0x55b9a87caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecabfff640 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 0x55b9a87caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecabfff640 1 -- 172.21.15.42:0/3793343085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 msgr2=0x55b9a87cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecabfff640 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecabfff640 1 -- 172.21.15.42:0/3793343085 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9a87cc110 con 0x55b9a87b7010 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecabfff640 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87b7010 0x55b9a87ca5b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7feca4004f20 tx=0x7feca402f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ff6f2cb3ba3d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fec8affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fec8affd640 1 -- 172.21.15.42:0/3793343085 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4058040 con 0x55b9a87b7010 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fec8affd640 1 -- 172.21.15.42:0/3793343085 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7feca402f810 con 0x55b9a87b7010 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3793343085 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca4036070 con 0x55b9a87b7010 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fec8affd640 1 -- 172.21.15.42:0/3793343085 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7feca4003970 con 0x55b9a87b7010 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecb4dc5740 10 client.16446 fetch_fsmap learned FSMap version 36 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.404+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3793343085 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b9a87cc110 con 0x55b9a87b7010 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7fec8affd640 1 -- 172.21.15.42:0/3793343085 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca4036070 con 0x55b9a87b7010 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7fec8affd640 1 -- 172.21.15.42:0/3793343085 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7feca4050040 con 0x55b9a87b7010 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7fecb4dc5740 10 client.16446 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7fecb4dc5740 10 client.16446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7fecb4dc5740 20 client.16446 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b9a87c1370 0x55b9a88429d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7fecb4dc5740 4 client.16446 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:41:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3793343085 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9a8726d70 con 0x55b9a87c1370 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7feca2ffd640 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b9a87c1370 0x55b9a88429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7feca2ffd640 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b9a87c1370 0x55b9a88429d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b089eea29cfee4bf server_cookie=2484dbc98ae04d81 in_seq=0 out_seq=0 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.405+0000 7fec8affd640 10 client.16446 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fec8affd640 1 -- 172.21.15.42:0/3793343085 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b9a8726d70 con 0x55b9a87c1370 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fec8affd640 10 client.16446 handle_command_reply: tid=0 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 client.16446 shutdown 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3793343085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87b7010 msgr2=0x55b9a87ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87b7010 0x55b9a87ca5b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7feca4004f20 tx=0x7feca402f3d0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3793343085 shutdown_connections 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b9a87c1370 0x55b9a88429d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9a87bc2e0 0x55b9a87cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fec8affd640 0 client.16446 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:41:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b9a87bb9a0 0x55b9a87caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 --2- 172.21.15.42:0/3793343085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9a87b7010 0x55b9a87ca5b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3793343085 >> 172.21.15.42:0/3793343085 conn(0x55b9a87c0e90 msgr2=0x55b9a87b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3793343085 shutdown_connections 2024-09-19T09:41:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 1 -- 172.21.15.42:0/3793343085 wait complete. 2024-09-19T09:41:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.417+0000 7fecb4dc5740 20 client.16446 trim_cache size 0 max 16384 2024-09-19T09:41:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:41:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:41:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:41:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:41:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 -- 172.21.15.42:0/77696883 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec980a32f0 msgr2=0x7fec980a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec980a32f0 0x7fec980a57b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0cdad0 tx=0x7fec9c0d3760 comp rx=0 tx=0).stop 2024-09-19T09:41:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 -- 172.21.15.42:0/77696883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac100a40 msgr2=0x7fecac196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac100a40 0x7fecac196c80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00e9c0 tx=0x7fec9c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:41:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 -- 172.21.15.42:0/77696883 shutdown_connections 2024-09-19T09:41:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fec980a32f0 0x7fec980a57b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecac1025f0 0x7fecac19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecac101c30 0x7fecac1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 --2- 172.21.15.42:0/77696883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac100a40 0x7fecac196c80 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 -- 172.21.15.42:0/77696883 >> 172.21.15.42:0/77696883 conn(0x7fecac0fc1e0 msgr2=0x7fecac104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 -- 172.21.15.42:0/77696883 shutdown_connections 2024-09-19T09:41:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:41:58.418+0000 7fecb1f4b640 1 -- 172.21.15.42:0/77696883 wait complete. 2024-09-19T09:41:58.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:58 smithi042 ceph-mon[31223]: pgmap v416: 97 pgs: 97 active+clean; 982 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 158 MiB/s wr, 413 op/s 2024-09-19T09:41:58.583 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:41:58.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:58 smithi171 ceph-mon[35803]: pgmap v416: 97 pgs: 97 active+clean; 982 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 158 MiB/s wr, 413 op/s 2024-09-19T09:41:58.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:58 smithi136 ceph-mon[34840]: pgmap v416: 97 pgs: 97 active+clean; 982 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 158 MiB/s wr, 413 op/s 2024-09-19T09:41:58.846 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:59.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.394+0000 7f20aaa51640 1 -- 172.21.15.42:0/728564722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20a4100e20 msgr2=0x7f20a4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:59.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.394+0000 7f20aaa51640 1 --2- 172.21.15.42:0/728564722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20a4100e20 0x7f20a4101200 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2094009900 tx=0x7f209402a480 comp rx=0 tx=0).stop 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.394+0000 7f20aaa51640 1 -- 172.21.15.42:0/728564722 shutdown_connections 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.394+0000 7f20aaa51640 1 --2- 172.21.15.42:0/728564722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a4102ef0 0x7f20a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.394+0000 7f20aaa51640 1 --2- 172.21.15.42:0/728564722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20a4102570 0x7f20a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.394+0000 7f20aaa51640 1 --2- 172.21.15.42:0/728564722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20a4100e20 0x7f20a4101200 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.394+0000 7f20aaa51640 1 -- 172.21.15.42:0/728564722 >> 172.21.15.42:0/728564722 conn(0x7f20a40fc7d0 msgr2=0x7f20a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.394+0000 7f20aaa51640 1 -- 172.21.15.42:0/728564722 shutdown_connections 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.394+0000 7f20aaa51640 1 -- 172.21.15.42:0/728564722 wait complete. 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f20aaa51640 1 Processor -- start 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f20aaa51640 1 -- start start 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f20aaa51640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a4100e20 0x7f20a40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f20aaa51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20a4102570 0x7f20a40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f20aaa51640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20a4102ef0 0x7f20a40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f20aaa51640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20a4110fa0 con 0x7f20a4102570 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f20aaa51640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f20a4110e20 con 0x7f20a4102ef0 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f20aaa51640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f20a4111120 con 0x7f20a4100e20 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f209bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20a4102570 0x7f20a40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f209bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20a4102570 0x7f20a40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47252/0 (socket says 172.21.15.42:47252) 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f209bfff640 1 -- 172.21.15.42:0/1070908649 learned_addr learned my addr 172.21.15.42:0/1070908649 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f20a8fee640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20a4102ef0 0x7f20a40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.395+0000 7f20a3fff640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a4100e20 0x7f20a40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f209bfff640 1 -- 172.21.15.42:0/1070908649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a4100e20 msgr2=0x7f20a40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f209bfff640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a4100e20 0x7f20a40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f209bfff640 1 -- 172.21.15.42:0/1070908649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20a4102ef0 msgr2=0x7f20a40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f209bfff640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20a4102ef0 0x7f20a40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f209bfff640 1 -- 172.21.15.42:0/1070908649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a41a6aa0 con 0x7f20a4102570 2024-09-19T09:41:59.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f209bfff640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20a4102570 0x7f20a40fd1c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f208c00d950 tx=0x7f208c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f20a1ffb640 1 -- 172.21.15.42:0/1070908649 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c017030 con 0x7f20a4102570 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f20a1ffb640 1 -- 172.21.15.42:0/1070908649 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f208c004020 con 0x7f20a4102570 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f20a1ffb640 1 -- 172.21.15.42:0/1070908649 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c0047a0 con 0x7f20a4102570 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f20aaa51640 1 -- 172.21.15.42:0/1070908649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a41a6d90 con 0x7f20a4102570 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.396+0000 7f20aaa51640 1 -- 172.21.15.42:0/1070908649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a41a7250 con 0x7f20a4102570 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.398+0000 7f20a1ffb640 1 -- 172.21.15.42:0/1070908649 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f208c0041d0 con 0x7f20a4102570 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20ace2a740 1 Processor -- start 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20ace2a740 1 -- start start 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1faf93090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 0x55f1faf93a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf9e370 0x55f1fafa0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20ace2a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f1faef92f0 con 0x55f1faf94b40 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20ace2a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f1faea0cf0 con 0x55f1faf935d0 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20ace2a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f1faef52b0 con 0x55f1faf9e370 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20a8fee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1faf93090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20a8fee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1faf93090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47264/0 (socket says 172.21.15.42:47264) 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20a8fee640 1 -- 172.21.15.42:0/2087986873 learned_addr learned my addr 172.21.15.42:0/2087986873 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20a1ffb640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20900a32c0 0x7f20900a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20a3fff640 1 --2- 172.21.15.42:0/2087986873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 0x55f1faf93a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20a8fee640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20900a32c0 0x7f20900a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20a1ffb640 1 -- 172.21.15.42:0/1070908649 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f208c0cf240 con 0x7f20a4102570 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f209bfff640 1 --2- 172.21.15.42:0/2087986873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf9e370 0x55f1fafa0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20a3fff640 1 -- 172.21.15.42:0/2087986873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf9e370 msgr2=0x55f1fafa0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.399+0000 7f20a3fff640 1 --2- 172.21.15.42:0/2087986873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf9e370 0x55f1fafa0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.400+0000 7f20a3fff640 1 -- 172.21.15.42:0/2087986873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 msgr2=0x55f1faf93090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.400+0000 7f20a3fff640 1 --2- 172.21.15.42:0/2087986873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1faf93090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.400+0000 7f20a3fff640 1 -- 172.21.15.42:0/2087986873 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1fae853a0 con 0x55f1faf935d0 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.400+0000 7f20a8fee640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20900a32c0 0x7f20900a5780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f209c00adc0 tx=0x7f209c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.400+0000 7f20a3fff640 1 --2- 172.21.15.42:0/2087986873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 0x55f1faf93a10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2094005940 tx=0x7f2094004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cfb5d6401738a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.400+0000 7f209a7fc640 1 -- 172.21.15.42:0/2087986873 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2094035030 con 0x55f1faf935d0 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.400+0000 7f209a7fc640 1 -- 172.21.15.42:0/2087986873 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2094040070 con 0x55f1faf935d0 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.400+0000 7f209a7fc640 1 -- 172.21.15.42:0/2087986873 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2094031b00 con 0x55f1faf935d0 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 -- 172.21.15.42:0/2087986873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 msgr2=0x55f1faf93a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 --2- 172.21.15.42:0/2087986873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 0x55f1faf93a10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2094005940 tx=0x7f2094004170 comp rx=0 tx=0).stop 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 -- 172.21.15.42:0/2087986873 shutdown_connections 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 --2- 172.21.15.42:0/2087986873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf9e370 0x55f1fafa0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 --2- 172.21.15.42:0/2087986873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 0x55f1faf93a10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 --2- 172.21.15.42:0/2087986873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1faf93090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 -- 172.21.15.42:0/2087986873 >> 172.21.15.42:0/2087986873 conn(0x55f1faf5c310 msgr2=0x55f1faf8fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 -- 172.21.15.42:0/2087986873 shutdown_connections 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 -- 172.21.15.42:0/2087986873 wait complete. 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 -- start start 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.401+0000 7f20ace2a740 1 Processor -- start 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 0x55f1faf9dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf94b40 0x55f1faf9b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf9e370 0x55f1faf9b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20ace2a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f1fafa1010 con 0x55f1faf9e370 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20ace2a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f1faeb4060 con 0x55f1faf935d0 2024-09-19T09:41:59.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20ace2a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f1fafa1190 con 0x55f1faf94b40 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20ace2a740 10 client.0 _ll_register_callbacks cb 0x55f1fac078c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20a8fee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf9e370 0x55f1faf9b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f209bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf94b40 0x55f1faf9b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20a3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 0x55f1faf9dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f209bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf94b40 0x55f1faf9b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:56624/0 (socket says 172.21.15.42:56624) 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20a3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 0x55f1faf9dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:51598/0 (socket says 172.21.15.42:51598) 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20a8fee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf9e370 0x55f1faf9b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47278/0 (socket says 172.21.15.42:47278) 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f209bfff640 1 -- 172.21.15.42:0/1289577641 learned_addr learned my addr 172.21.15.42:0/1289577641 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f209bfff640 1 -- 172.21.15.42:0/1289577641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 msgr2=0x55f1faf9dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f209bfff640 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 0x55f1faf9dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f209bfff640 1 -- 172.21.15.42:0/1289577641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf9e370 msgr2=0x55f1faf9b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f209bfff640 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf9e370 0x55f1faf9b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f209bfff640 1 -- 172.21.15.42:0/1289577641 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1fac6a3c0 con 0x55f1faf94b40 2024-09-19T09:41:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f209bfff640 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf94b40 0x55f1faf9b020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f208c009fd0 tx=0x7f208c005200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=358151f92454d728 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20837fe640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20837fe640 1 -- 172.21.15.42:0/1289577641 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c09bee0 con 0x55f1faf94b40 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.402+0000 7f20837fe640 1 -- 172.21.15.42:0/1289577641 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f208c084b30 con 0x55f1faf94b40 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20ace2a740 1 -- 172.21.15.42:0/1289577641 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2094040070 con 0x55f1faf94b40 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20837fe640 1 -- 172.21.15.42:0/1289577641 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f208c0ba070 con 0x55f1faf94b40 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20ace2a740 10 client.25807 fetch_fsmap learned FSMap version 36 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20ace2a740 1 -- 172.21.15.42:0/1289577641 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f1fafacb10 con 0x55f1faf94b40 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20837fe640 1 -- 172.21.15.42:0/1289577641 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2094040070 con 0x55f1faf94b40 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20837fe640 1 -- 172.21.15.42:0/1289577641 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7f208c09ac30 con 0x55f1faf94b40 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20ace2a740 10 client.25807 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20ace2a740 10 client.25807 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20ace2a740 20 client.25807 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20ace2a740 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f1fafae0a0 0x55f1fafb04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20ace2a740 4 client.25807 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20ace2a740 1 -- 172.21.15.42:0/1289577641 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1faf06860 con 0x55f1fafae0a0 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.403+0000 7f20a3fff640 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f1fafae0a0 0x55f1fafb04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.404+0000 7f20a3fff640 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f1fafae0a0 0x55f1fafb04c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=269c154287ffd7a0 server_cookie=8171f43b3aed1a60 in_seq=0 out_seq=0 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.404+0000 7f20837fe640 10 client.25807 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20837fe640 1 -- 172.21.15.42:0/1289577641 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1faf06860 con 0x55f1fafae0a0 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20837fe640 10 client.25807 handle_command_reply: tid=0 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 client.25807 shutdown 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 -- 172.21.15.42:0/1289577641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf94b40 msgr2=0x55f1faf9b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf94b40 0x55f1faf9b020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f208c009fd0 tx=0x7f208c005200 comp rx=0 tx=0).stop 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 -- 172.21.15.42:0/1289577641 shutdown_connections 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f1fafae0a0 0x55f1fafb04c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf9e370 0x55f1faf9b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf94b40 0x55f1faf9b020 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20837fe640 0 client.25807 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:41:59.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 --2- 172.21.15.42:0/1289577641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf935d0 0x55f1faf9dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 -- 172.21.15.42:0/1289577641 >> 172.21.15.42:0/1289577641 conn(0x55f1faf5c310 msgr2=0x55f1faf959c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:59.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 -- 172.21.15.42:0/1289577641 shutdown_connections 2024-09-19T09:41:59.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 1 -- 172.21.15.42:0/1289577641 wait complete. 2024-09-19T09:41:59.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.406+0000 7f20ace2a740 20 client.25807 trim_cache size 0 max 16384 2024-09-19T09:41:59.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.420+0000 7f20ace2a740 1 Processor -- start 2024-09-19T09:41:59.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.420+0000 7f20ace2a740 1 -- start start 2024-09-19T09:41:59.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.420+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 0x55f1faf8fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.420+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafaa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.420+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 0x55f1fafb5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.420+0000 7f20ace2a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20a41af8e0 con 0x55f1faf94b40 2024-09-19T09:41:59.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.420+0000 7f20ace2a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f20a41b1660 con 0x55f1faf9e370 2024-09-19T09:41:59.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.420+0000 7f20ace2a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f20a41b0070 con 0x55f1faf935d0 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f209bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafaa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f209bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafaa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47282/0 (socket says 172.21.15.42:47282) 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f209bfff640 1 -- 172.21.15.42:0/2936174234 learned_addr learned my addr 172.21.15.42:0/2936174234 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f20a8fee640 1 --2- 172.21.15.42:0/2936174234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 0x55f1fafb5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f20a3fff640 1 --2- 172.21.15.42:0/2936174234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 0x55f1faf8fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f209bfff640 1 -- 172.21.15.42:0/2936174234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 msgr2=0x55f1faf8fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f209bfff640 1 --2- 172.21.15.42:0/2936174234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 0x55f1faf8fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f209bfff640 1 -- 172.21.15.42:0/2936174234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 msgr2=0x55f1fafb5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f209bfff640 1 --2- 172.21.15.42:0/2936174234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 0x55f1fafb5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f209bfff640 1 -- 172.21.15.42:0/2936174234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1fafa1160 con 0x55f1faf94b40 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f209bfff640 1 --2- 172.21.15.42:0/2936174234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafaa2b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f208c00b5a0 tx=0x7f208c005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6a16bec0501813 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f2099ffb640 1 -- 172.21.15.42:0/2936174234 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c014070 con 0x55f1faf94b40 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f2099ffb640 1 -- 172.21.15.42:0/2936174234 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f208c084e50 con 0x55f1faf94b40 2024-09-19T09:41:59.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.421+0000 7f2099ffb640 1 -- 172.21.15.42:0/2936174234 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c09b7e0 con 0x55f1faf94b40 2024-09-19T09:41:59.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.422+0000 7f20ace2a740 1 -- 172.21.15.42:0/2936174234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 msgr2=0x55f1fafaa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:59.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.422+0000 7f20ace2a740 1 --2- 172.21.15.42:0/2936174234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafaa2b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f208c00b5a0 tx=0x7f208c005130 comp rx=0 tx=0).stop 2024-09-19T09:41:59.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.422+0000 7f20ace2a740 1 -- 172.21.15.42:0/2936174234 shutdown_connections 2024-09-19T09:41:59.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.422+0000 7f20ace2a740 1 --2- 172.21.15.42:0/2936174234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 0x55f1fafb5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.422+0000 7f20ace2a740 1 --2- 172.21.15.42:0/2936174234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafaa2b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.422+0000 7f20ace2a740 1 --2- 172.21.15.42:0/2936174234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 0x55f1faf8fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.422+0000 7f20ace2a740 1 -- 172.21.15.42:0/2936174234 >> 172.21.15.42:0/2936174234 conn(0x55f1faf5c310 msgr2=0x55f1faf8f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.422+0000 7f20ace2a740 1 -- 172.21.15.42:0/2936174234 shutdown_connections 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.422+0000 7f20ace2a740 1 -- 172.21.15.42:0/2936174234 wait complete. 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.422+0000 7f20ace2a740 1 -- start start 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20ace2a740 1 Processor -- start 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 0x55f1fafa6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafa6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20ace2a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 0x55f1fafa33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20ace2a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20a41b0f60 con 0x55f1faf94b40 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20ace2a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f20a41b0800 con 0x55f1faf9e370 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20ace2a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f20a41ad8c0 con 0x55f1faf935d0 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20ace2a740 10 client.0 _ll_register_callbacks cb 0x7f208c097a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:59.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20a3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 0x55f1fafa6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f209bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafa6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20a8fee640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 0x55f1fafa33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f209bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafa6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47292/0 (socket says 172.21.15.42:47292) 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f209bfff640 1 -- 172.21.15.42:0/3845426698 learned_addr learned my addr 172.21.15.42:0/3845426698 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20a3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 0x55f1fafa6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:56634/0 (socket says 172.21.15.42:56634) 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20a8fee640 1 -- 172.21.15.42:0/3845426698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 msgr2=0x55f1fafa6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20a8fee640 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 0x55f1fafa6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20a8fee640 1 -- 172.21.15.42:0/3845426698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 msgr2=0x55f1fafa6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20a8fee640 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafa6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20a8fee640 1 -- 172.21.15.42:0/3845426698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1fafa3930 con 0x55f1faf9e370 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f209bfff640 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafa6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.423+0000 7f20a3fff640 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 0x55f1fafa6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:59.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.424+0000 7f20a8fee640 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 0x55f1fafa33f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a6b0 tx=0x7f209c004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eb12d5de973ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.424+0000 7f20837fe640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.424+0000 7f20837fe640 1 -- 172.21.15.42:0/3845426698 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c02c020 con 0x55f1faf9e370 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.424+0000 7f20837fe640 1 -- 172.21.15.42:0/3845426698 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f209c01c0d0 con 0x55f1faf9e370 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.424+0000 7f20ace2a740 1 -- 172.21.15.42:0/3845426698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f208c084e50 con 0x55f1faf9e370 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.424+0000 7f20837fe640 1 -- 172.21.15.42:0/3845426698 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f209c037050 con 0x55f1faf9e370 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.424+0000 7f20ace2a740 10 client.25898 fetch_fsmap learned FSMap version 36 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.424+0000 7f20ace2a740 1 -- 172.21.15.42:0/3845426698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f1fb019490 con 0x55f1faf9e370 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.424+0000 7f20837fe640 1 -- 172.21.15.42:0/3845426698 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f208c084e50 con 0x55f1faf9e370 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.425+0000 7f20837fe640 1 -- 172.21.15.42:0/3845426698 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7f209c01a6c0 con 0x55f1faf9e370 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.425+0000 7f20ace2a740 10 client.25898 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.425+0000 7f20ace2a740 10 client.25898 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.425+0000 7f20ace2a740 20 client.25898 populate_metadata read hostname 'smithi042' 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.425+0000 7f20ace2a740 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f1fb019d80 0x55f1fb01c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:59.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.425+0000 7f20ace2a740 4 client.25898 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:41:59.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.425+0000 7f20ace2a740 1 -- 172.21.15.42:0/3845426698 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1faf00d70 con 0x55f1fb019d80 2024-09-19T09:41:59.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.425+0000 7f20a3fff640 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f1fb019d80 0x55f1fb01c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:59.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.425+0000 7f20837fe640 10 client.25898 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:41:59.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.425+0000 7f20a3fff640 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f1fb019d80 0x55f1fb01c1a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d833ecfd914ba809 server_cookie=742ebdde80ad7d3c in_seq=0 out_seq=0 2024-09-19T09:41:59.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20837fe640 1 -- 172.21.15.42:0/3845426698 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1faf00d70 con 0x55f1fb019d80 2024-09-19T09:41:59.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20837fe640 10 client.25898 handle_command_reply: tid=0 2024-09-19T09:41:59.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20ace2a740 1 client.25898 shutdown 2024-09-19T09:41:59.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20ace2a740 1 -- 172.21.15.42:0/3845426698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 msgr2=0x55f1fafa33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:59.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20ace2a740 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 0x55f1fafa33f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a6b0 tx=0x7f209c004b50 comp rx=0 tx=0).stop 2024-09-19T09:41:59.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20ace2a740 1 -- 172.21.15.42:0/3845426698 shutdown_connections 2024-09-19T09:41:59.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20ace2a740 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x55f1fb019d80 0x55f1fb01c1a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20ace2a740 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1faf9e370 0x55f1fafa33f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20837fe640 0 client.25898 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:41:59.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20ace2a740 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1faf94b40 0x55f1fafa6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20ace2a740 1 --2- 172.21.15.42:0/3845426698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f1faf935d0 0x55f1fafa6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20ace2a740 1 -- 172.21.15.42:0/3845426698 >> 172.21.15.42:0/3845426698 conn(0x55f1faf5c310 msgr2=0x55f1faf9c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:59.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.426+0000 7f20ace2a740 1 -- 172.21.15.42:0/3845426698 shutdown_connections 2024-09-19T09:41:59.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20ace2a740 1 -- 172.21.15.42:0/3845426698 wait complete. 2024-09-19T09:41:59.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20ace2a740 20 client.25898 trim_cache size 0 max 16384 2024-09-19T09:41:59.433 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:41:59.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 -- 172.21.15.42:0/1070908649 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20900a32c0 msgr2=0x7f20900a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:59.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20900a32c0 0x7f20900a5780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f209c00adc0 tx=0x7f209c004a40 comp rx=0 tx=0).stop 2024-09-19T09:41:59.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 -- 172.21.15.42:0/1070908649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20a4102570 msgr2=0x7f20a40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:59.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20a4102570 0x7f20a40fd1c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f208c00d950 tx=0x7f208c00de10 comp rx=0 tx=0).stop 2024-09-19T09:41:59.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 -- 172.21.15.42:0/1070908649 shutdown_connections 2024-09-19T09:41:59.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f20900a32c0 0x7f20900a5780 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20a4102ef0 0x7f20a40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20a4102570 0x7f20a40fd1c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 --2- 172.21.15.42:0/1070908649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a4100e20 0x7f20a40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:59.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 -- 172.21.15.42:0/1070908649 >> 172.21.15.42:0/1070908649 conn(0x7f20a40fc7d0 msgr2=0x7f20a406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:59.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 -- 172.21.15.42:0/1070908649 shutdown_connections 2024-09-19T09:41:59.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:41:59.427+0000 7f20aaa51640 1 -- 172.21.15.42:0/1070908649 wait complete. 2024-09-19T09:41:59.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:41:59 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:59.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:41:59 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:41:59.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:41:59 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:42:00.241 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:42:00.532 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:00.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:00 smithi171 ceph-mon[35803]: pgmap v417: 97 pgs: 97 active+clean; 620 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s rd, 57 MiB/s wr, 314 op/s 2024-09-19T09:42:00.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:00 smithi136 ceph-mon[34840]: pgmap v417: 97 pgs: 97 active+clean; 620 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s rd, 57 MiB/s wr, 314 op/s 2024-09-19T09:42:00.653 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:00 smithi042 ceph-mon[31223]: pgmap v417: 97 pgs: 97 active+clean; 620 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s rd, 57 MiB/s wr, 314 op/s 2024-09-19T09:42:01.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.011+0000 7f8eb1f99640 1 -- 172.21.15.42:0/3612569094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eac102d30 msgr2=0x7f8eac103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:01.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.011+0000 7f8eb1f99640 1 --2- 172.21.15.42:0/3612569094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eac102d30 0x7f8eac103110 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009930 tx=0x7f8e9c02a420 comp rx=0 tx=0).stop 2024-09-19T09:42:01.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.011+0000 7f8eb1f99640 1 -- 172.21.15.42:0/3612569094 shutdown_connections 2024-09-19T09:42:01.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.011+0000 7f8eb1f99640 1 --2- 172.21.15.42:0/3612569094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eac1082a0 0x7f8eac10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.011+0000 7f8eb1f99640 1 --2- 172.21.15.42:0/3612569094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8eac1036e0 0x7f8eac107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.011+0000 7f8eb1f99640 1 --2- 172.21.15.42:0/3612569094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eac102d30 0x7f8eac103110 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.011+0000 7f8eb1f99640 1 -- 172.21.15.42:0/3612569094 >> 172.21.15.42:0/3612569094 conn(0x7f8eac0fc7d0 msgr2=0x7f8eac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:01.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.011+0000 7f8eb1f99640 1 -- 172.21.15.42:0/3612569094 shutdown_connections 2024-09-19T09:42:01.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.011+0000 7f8eb1f99640 1 -- 172.21.15.42:0/3612569094 wait complete. 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.011+0000 7f8eb1f99640 1 Processor -- start 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eb1f99640 1 -- start start 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eb1f99640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eac102d30 0x7f8eac100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eb1f99640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eac1036e0 0x7f8eac100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eb1f99640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8eac1082a0 0x7f8eac101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eb1f99640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1120a0 con 0x7f8eac102d30 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eb1f99640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac111f20 con 0x7f8eac1082a0 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eb1f99640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac112220 con 0x7f8eac1036e0 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eac102d30 0x7f8eac100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eab7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eac102d30 0x7f8eac100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43232/0 (socket says 172.21.15.42:43232) 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eab7fe640 1 -- 172.21.15.42:0/432219723 learned_addr learned my addr 172.21.15.42:0/432219723 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eabfff640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8eac1082a0 0x7f8eac101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eaaffd640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eac1036e0 0x7f8eac100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eab7fe640 1 -- 172.21.15.42:0/432219723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eac1036e0 msgr2=0x7f8eac100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eab7fe640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eac1036e0 0x7f8eac100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eab7fe640 1 -- 172.21.15.42:0/432219723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8eac1082a0 msgr2=0x7f8eac101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eab7fe640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8eac1082a0 0x7f8eac101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eab7fe640 1 -- 172.21.15.42:0/432219723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac1a6a80 con 0x7f8eac102d30 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.012+0000 7f8eab7fe640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eac102d30 0x7f8eac100990 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009230 tx=0x7f8e9c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.013+0000 7f8ea8ff9640 1 -- 172.21.15.42:0/432219723 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c03f030 con 0x7f8eac102d30 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.013+0000 7f8eb1f99640 1 -- 172.21.15.42:0/432219723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eac1a6d10 con 0x7f8eac102d30 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.013+0000 7f8eb1f99640 1 -- 172.21.15.42:0/432219723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eac1a71e0 con 0x7f8eac102d30 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.013+0000 7f8ea8ff9640 1 -- 172.21.15.42:0/432219723 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e9c003ad0 con 0x7f8eac102d30 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.013+0000 7f8ea8ff9640 1 -- 172.21.15.42:0/432219723 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c035070 con 0x7f8eac102d30 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.015+0000 7f8ea8ff9640 1 -- 172.21.15.42:0/432219723 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8e9c042030 con 0x7f8eac102d30 2024-09-19T09:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.015+0000 7f8eb4372740 1 Processor -- start 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eb4372740 1 -- start start 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8de090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8dea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 0x55d39d8eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eb4372740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d39d8442f0 con 0x55d39d8dfb40 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eb4372740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d39d7ebcf0 con 0x55d39d8de5d0 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eb4372740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d39d8402b0 con 0x55d39d8e9370 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8de090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8de090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43246/0 (socket says 172.21.15.42:43246) 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eab7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8dea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eaaffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 0x55d39d8eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eabfff640 1 -- 172.21.15.42:0/3888528209 learned_addr learned my addr 172.21.15.42:0/3888528209 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8ea8ff9640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8e940a3240 0x7f8e940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eaaffd640 1 -- 172.21.15.42:0/3888528209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 msgr2=0x55d39d8dea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eaaffd640 1 --2- 172.21.15.42:0/3888528209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8dea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eaaffd640 1 -- 172.21.15.42:0/3888528209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 msgr2=0x55d39d8de090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eaaffd640 1 --2- 172.21.15.42:0/3888528209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8de090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eaaffd640 1 -- 172.21.15.42:0/3888528209 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39d7d03a0 con 0x55d39d8e9370 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8eabfff640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8e940a3240 0x7f8e940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.016+0000 7f8ea8ff9640 1 -- 172.21.15.42:0/432219723 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8e9c0efbf0 con 0x7f8eac102d30 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.017+0000 7f8eaaffd640 1 --2- 172.21.15.42:0/3888528209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 0x55d39d8eb760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8eac06a370 tx=0x7f8ea0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ff2a58c06db32f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.017+0000 7f8e91ffb640 1 -- 172.21.15.42:0/3888528209 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0009d70 con 0x55d39d8e9370 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.017+0000 7f8e91ffb640 1 -- 172.21.15.42:0/3888528209 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea0005020 con 0x55d39d8e9370 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.017+0000 7f8e91ffb640 1 -- 172.21.15.42:0/3888528209 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0004b90 con 0x55d39d8e9370 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.017+0000 7f8eb4372740 1 -- 172.21.15.42:0/3888528209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 msgr2=0x55d39d8eb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:01.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.017+0000 7f8eb4372740 1 --2- 172.21.15.42:0/3888528209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 0x55d39d8eb760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8eac06a370 tx=0x7f8ea0011810 comp rx=0 tx=0).stop 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.017+0000 7f8eabfff640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8e940a3240 0x7f8e940a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005f40 tx=0x7f8ea4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 -- 172.21.15.42:0/3888528209 shutdown_connections 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 --2- 172.21.15.42:0/3888528209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 0x55d39d8eb760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 --2- 172.21.15.42:0/3888528209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8dea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 --2- 172.21.15.42:0/3888528209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8de090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 -- 172.21.15.42:0/3888528209 >> 172.21.15.42:0/3888528209 conn(0x55d39d8a7310 msgr2=0x55d39d8dac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 -- 172.21.15.42:0/3888528209 shutdown_connections 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 -- 172.21.15.42:0/3888528209 wait complete. 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 -- start start 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 Processor -- start 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 0x55d39d8e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d8e6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d39d8ec070 con 0x55d39d8e9370 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d39d7ff060 con 0x55d39d8de5d0 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.018+0000 7f8eb4372740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d39d8ec1f0 con 0x55d39d8dfb40 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d8e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eb4372740 10 client.0 _ll_register_callbacks cb 0x55d39d5528c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eaaffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 0x55d39d8e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d8e6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43260/0 (socket says 172.21.15.42:43260) 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eaaffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 0x55d39d8e5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:39338/0 (socket says 172.21.15.42:39338) 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eabfff640 1 -- 172.21.15.42:0/4062696915 learned_addr learned my addr 172.21.15.42:0/4062696915 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eab7fe640 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eabfff640 1 -- 172.21.15.42:0/4062696915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 msgr2=0x55d39d8e5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eabfff640 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 0x55d39d8e5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eabfff640 1 -- 172.21.15.42:0/4062696915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 msgr2=0x55d39d8e8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eabfff640 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8e8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eabfff640 1 -- 172.21.15.42:0/4062696915 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39d5b53c0 con 0x55d39d8e9370 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eabfff640 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d8e6450 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40109c0 tx=0x7f8ea4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfd846be60df8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8e8affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8e8affd640 1 -- 172.21.15.42:0/4062696915 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea402b060 con 0x55d39d8e9370 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8e8affd640 1 -- 172.21.15.42:0/4062696915 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8ea4018070 con 0x55d39d8e9370 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8eb4372740 1 -- 172.21.15.42:0/4062696915 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea0005020 con 0x55d39d8e9370 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.019+0000 7f8e8affd640 1 -- 172.21.15.42:0/4062696915 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8ea401e770 con 0x55d39d8e9370 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8eb4372740 10 client.16476 fetch_fsmap learned FSMap version 36 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8eb4372740 1 -- 172.21.15.42:0/4062696915 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55d39d8f7b10 con 0x55d39d8e9370 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8e8affd640 1 -- 172.21.15.42:0/4062696915 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea0005020 con 0x55d39d8e9370 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8e8affd640 1 -- 172.21.15.42:0/4062696915 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7f8ea400f040 con 0x55d39d8e9370 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8eb4372740 10 client.16476 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:42:01.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8eb4372740 10 client.16476 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8eb4372740 20 client.16476 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8eb4372740 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55d39d8f90a0 0x55d39d8fb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8eb4372740 4 client.16476 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8eb4372740 1 -- 172.21.15.42:0/4062696915 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d39d851860 con 0x55d39d8f90a0 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.020+0000 7f8eab7fe640 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55d39d8f90a0 0x55d39d8fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8eab7fe640 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55d39d8f90a0 0x55d39d8fb520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=675f363f9a49df22 server_cookie=24c42a1b0242b31 in_seq=0 out_seq=0 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8e8affd640 10 client.16476 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8e8affd640 1 -- 172.21.15.42:0/4062696915 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d39d851860 con 0x55d39d8f90a0 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8e8affd640 10 client.16476 handle_command_reply: tid=0 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8eb4372740 1 client.16476 shutdown 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8eb4372740 1 -- 172.21.15.42:0/4062696915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 msgr2=0x55d39d8e6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8eb4372740 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d8e6450 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40109c0 tx=0x7f8ea4004ab0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8eb4372740 1 -- 172.21.15.42:0/4062696915 shutdown_connections 2024-09-19T09:42:01.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8eb4372740 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55d39d8f90a0 0x55d39d8fb520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8eb4372740 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d8e6450 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8eb4372740 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 0x55d39d8e5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8e8affd640 0 client.16476 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:42:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.021+0000 7f8eb4372740 1 --2- 172.21.15.42:0/4062696915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8e8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.022+0000 7f8eb4372740 1 -- 172.21.15.42:0/4062696915 >> 172.21.15.42:0/4062696915 conn(0x55d39d8a7310 msgr2=0x55d39d8e0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.022+0000 7f8eb4372740 1 -- 172.21.15.42:0/4062696915 shutdown_connections 2024-09-19T09:42:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.022+0000 7f8eb4372740 1 -- 172.21.15.42:0/4062696915 wait complete. 2024-09-19T09:42:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.022+0000 7f8eb4372740 20 client.16476 trim_cache size 0 max 16384 2024-09-19T09:42:01.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eb4372740 1 Processor -- start 2024-09-19T09:42:01.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eb4372740 1 -- start start 2024-09-19T09:42:01.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8dae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 0x55d39d8f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d900e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eb4372740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9800e500 con 0x55d39d8e9370 2024-09-19T09:42:01.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eb4372740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98010280 con 0x55d39d8de5d0 2024-09-19T09:42:01.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eb4372740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9800ec90 con 0x55d39d8dfb40 2024-09-19T09:42:01.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d900e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eab7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8dae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eab7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8dae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:47196/0 (socket says 172.21.15.42:47196) 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eaaffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 0x55d39d8f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eab7fe640 1 -- 172.21.15.42:0/799032835 learned_addr learned my addr 172.21.15.42:0/799032835 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.035+0000 7f8eabfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d900e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43266/0 (socket says 172.21.15.42:43266) 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.036+0000 7f8eaaffd640 1 -- 172.21.15.42:0/799032835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 msgr2=0x55d39d8dae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.036+0000 7f8eaaffd640 1 --2- 172.21.15.42:0/799032835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8dae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.036+0000 7f8eaaffd640 1 -- 172.21.15.42:0/799032835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 msgr2=0x55d39d900e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.036+0000 7f8eaaffd640 1 --2- 172.21.15.42:0/799032835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d900e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.036+0000 7f8eaaffd640 1 -- 172.21.15.42:0/799032835 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39d8de3d0 con 0x55d39d8dfb40 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.036+0000 7f8eabfff640 1 --2- 172.21.15.42:0/799032835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d900e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.036+0000 7f8eaaffd640 1 --2- 172.21.15.42:0/799032835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 0x55d39d8f53a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0000c00 tx=0x7f8ea0009930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc4f56750830b1c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.036+0000 7f8e917fa640 1 -- 172.21.15.42:0/799032835 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea001d040 con 0x55d39d8dfb40 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.036+0000 7f8e917fa640 1 -- 172.21.15.42:0/799032835 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea0028070 con 0x55d39d8dfb40 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.036+0000 7f8e917fa640 1 -- 172.21.15.42:0/799032835 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0003db0 con 0x55d39d8dfb40 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 -- 172.21.15.42:0/799032835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 msgr2=0x55d39d8f53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 --2- 172.21.15.42:0/799032835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 0x55d39d8f53a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0000c00 tx=0x7f8ea0009930 comp rx=0 tx=0).stop 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 -- 172.21.15.42:0/799032835 shutdown_connections 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 --2- 172.21.15.42:0/799032835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8e9370 0x55d39d900e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 --2- 172.21.15.42:0/799032835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8dfb40 0x55d39d8f53a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 --2- 172.21.15.42:0/799032835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8dae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 -- 172.21.15.42:0/799032835 >> 172.21.15.42:0/799032835 conn(0x55d39d8a7310 msgr2=0x55d39d8da700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 -- 172.21.15.42:0/799032835 shutdown_connections 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 -- 172.21.15.42:0/799032835 wait complete. 2024-09-19T09:42:01.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 -- start start 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.037+0000 7f8eb4372740 1 Processor -- start 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8ecd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eb4372740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 0x55d39d8ed290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eb4372740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9800fb80 con 0x55d39d8dfb40 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eb4372740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9800f420 con 0x55d39d8de5d0 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eb4372740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9800c4e0 con 0x55d39d8e9370 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eb4372740 10 client.0 _ll_register_callbacks cb 0x7f8ea4009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eaaffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8ecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eab7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eaaffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8ecd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43270/0 (socket says 172.21.15.42:43270) 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eaaffd640 1 -- 172.21.15.42:0/2530879490 learned_addr learned my addr 172.21.15.42:0/2530879490 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eabfff640 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 0x55d39d8ed290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eab7fe640 1 -- 172.21.15.42:0/2530879490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 msgr2=0x55d39d8ed290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eab7fe640 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 0x55d39d8ed290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eab7fe640 1 -- 172.21.15.42:0/2530879490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 msgr2=0x55d39d8ecd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eab7fe640 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8ecd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eab7fe640 1 -- 172.21.15.42:0/2530879490 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39d8ed800 con 0x55d39d8de5d0 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eaaffd640 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8ecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eabfff640 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 0x55d39d8ed290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8eab7fe640 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8f19d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0bc180 tx=0x7f8e9c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbbfaea15bc7ecf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.038+0000 7f8e8affd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8e8affd640 1 -- 172.21.15.42:0/2530879490 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0bbb50 con 0x55d39d8de5d0 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8e8affd640 1 -- 172.21.15.42:0/2530879490 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8e9c0b8860 con 0x55d39d8de5d0 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8eb4372740 1 -- 172.21.15.42:0/2530879490 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea0028070 con 0x55d39d8de5d0 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8e8affd640 1 -- 172.21.15.42:0/2530879490 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8e9c0bc8f0 con 0x55d39d8de5d0 2024-09-19T09:42:01.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8eb4372740 10 client.25916 fetch_fsmap learned FSMap version 36 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8eb4372740 1 -- 172.21.15.42:0/2530879490 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55d39d963b60 con 0x55d39d8de5d0 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8e8affd640 1 -- 172.21.15.42:0/2530879490 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea0028070 con 0x55d39d8de5d0 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8e8affd640 1 -- 172.21.15.42:0/2530879490 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7f8e9c0c0170 con 0x55d39d8de5d0 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8eb4372740 10 client.25916 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8eb4372740 10 client.25916 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8eb4372740 20 client.25916 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8eb4372740 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55d39d9642c0 0x55d39d9666e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8eb4372740 4 client.25916 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8eb4372740 1 -- 172.21.15.42:0/2530879490 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d39d84bd70 con 0x55d39d9642c0 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.039+0000 7f8eaaffd640 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55d39d9642c0 0x55d39d9666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eaaffd640 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55d39d9642c0 0x55d39d9666e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9f63c8ca2303c1 server_cookie=12f3d16c3ea563f5 in_seq=0 out_seq=0 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8e8affd640 10 client.25916 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8e8affd640 1 -- 172.21.15.42:0/2530879490 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d39d84bd70 con 0x55d39d9642c0 2024-09-19T09:42:01.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8e8affd640 10 client.25916 handle_command_reply: tid=0 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 client.25916 shutdown 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 -- 172.21.15.42:0/2530879490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 msgr2=0x55d39d8f19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8f19d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0bc180 tx=0x7f8e9c009260 comp rx=0 tx=0).stop 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 -- 172.21.15.42:0/2530879490 shutdown_connections 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x55d39d9642c0 0x55d39d9666e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d39d8e9370 0x55d39d8ed290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39d8dfb40 0x55d39d8ecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8e8affd640 0 client.25916 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 --2- 172.21.15.42:0/2530879490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d39d8de5d0 0x55d39d8f19d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 -- 172.21.15.42:0/2530879490 >> 172.21.15.42:0/2530879490 conn(0x55d39d8a7310 msgr2=0x55d39d8e7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 -- 172.21.15.42:0/2530879490 shutdown_connections 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.040+0000 7f8eb4372740 1 -- 172.21.15.42:0/2530879490 wait complete. 2024-09-19T09:42:01.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb4372740 20 client.25916 trim_cache size 0 max 16384 2024-09-19T09:42:01.055 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:42:01.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 -- 172.21.15.42:0/432219723 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8e940a3240 msgr2=0x7f8e940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:01.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8e940a3240 0x7f8e940a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005f40 tx=0x7f8ea4004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:01.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 -- 172.21.15.42:0/432219723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eac102d30 msgr2=0x7f8eac100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:01.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eac102d30 0x7f8eac100990 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009230 tx=0x7f8e9c004270 comp rx=0 tx=0).stop 2024-09-19T09:42:01.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 -- 172.21.15.42:0/432219723 shutdown_connections 2024-09-19T09:42:01.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8e940a3240 0x7f8e940a5700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8eac1082a0 0x7f8eac101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eac1036e0 0x7f8eac100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 --2- 172.21.15.42:0/432219723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eac102d30 0x7f8eac100990 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:01.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 -- 172.21.15.42:0/432219723 >> 172.21.15.42:0/432219723 conn(0x7f8eac0fc7d0 msgr2=0x7f8eac105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:01.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 -- 172.21.15.42:0/432219723 shutdown_connections 2024-09-19T09:42:01.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:01.041+0000 7f8eb1f99640 1 -- 172.21.15.42:0/432219723 wait complete. 2024-09-19T09:42:01.751 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:42:02.015 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:02.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:02 smithi042 ceph-mon[31223]: pgmap v418: 97 pgs: 97 active+clean; 242 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 23 MiB/s wr, 255 op/s 2024-09-19T09:42:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.514+0000 7feb6d670640 1 -- 172.21.15.42:0/1739000275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb681036e0 msgr2=0x7feb68107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.514+0000 7feb6d670640 1 --2- 172.21.15.42:0/1739000275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb681036e0 0x7feb68107b90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009930 tx=0x7feb5c02a420 comp rx=0 tx=0).stop 2024-09-19T09:42:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.514+0000 7feb6d670640 1 -- 172.21.15.42:0/1739000275 shutdown_connections 2024-09-19T09:42:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.514+0000 7feb6d670640 1 --2- 172.21.15.42:0/1739000275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb681082a0 0x7feb6810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.514+0000 7feb6d670640 1 --2- 172.21.15.42:0/1739000275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb681036e0 0x7feb68107b90 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.514+0000 7feb6d670640 1 --2- 172.21.15.42:0/1739000275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb68102d30 0x7feb68103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.514+0000 7feb6d670640 1 -- 172.21.15.42:0/1739000275 >> 172.21.15.42:0/1739000275 conn(0x7feb680fc7d0 msgr2=0x7feb680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.514+0000 7feb6d670640 1 -- 172.21.15.42:0/1739000275 shutdown_connections 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.514+0000 7feb6d670640 1 -- 172.21.15.42:0/1739000275 wait complete. 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.515+0000 7feb6d670640 1 Processor -- start 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.515+0000 7feb6d670640 1 -- start start 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb6d670640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb68102d30 0x7feb681985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb6d670640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb681036e0 0x7feb68198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb6d670640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb681082a0 0x7feb6819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb6d670640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feb68112090 con 0x7feb681082a0 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb6d670640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feb68111f10 con 0x7feb68102d30 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb6d670640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feb68112210 con 0x7feb681036e0 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb681082a0 0x7feb6819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb66ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb68102d30 0x7feb681985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb66ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb68102d30 0x7feb681985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:47222/0 (socket says 172.21.15.42:47222) 2024-09-19T09:42:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb681082a0 0x7feb6819cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43288/0 (socket says 172.21.15.42:43288) 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb66ffd640 1 -- 172.21.15.42:0/2961903950 learned_addr learned my addr 172.21.15.42:0/2961903950 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb667fc640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb681036e0 0x7feb68198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb677fe640 1 -- 172.21.15.42:0/2961903950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb681036e0 msgr2=0x7feb68198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb677fe640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb681036e0 0x7feb68198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb677fe640 1 -- 172.21.15.42:0/2961903950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb68102d30 msgr2=0x7feb681985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb677fe640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb68102d30 0x7feb681985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb677fe640 1 -- 172.21.15.42:0/2961903950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6819d5a0 con 0x7feb681082a0 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb667fc640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb681036e0 0x7feb68198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.516+0000 7feb677fe640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb681082a0 0x7feb6819cec0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7feb6000da10 tx=0x7feb6000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.517+0000 7feb4ffff640 1 -- 172.21.15.42:0/2961903950 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6000bd70 con 0x7feb681082a0 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.517+0000 7feb4ffff640 1 -- 172.21.15.42:0/2961903950 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb60003e50 con 0x7feb681082a0 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.517+0000 7feb6d670640 1 -- 172.21.15.42:0/2961903950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6819d890 con 0x7feb681082a0 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.517+0000 7feb4ffff640 1 -- 172.21.15.42:0/2961903950 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600106a0 con 0x7feb681082a0 2024-09-19T09:42:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.517+0000 7feb6d670640 1 -- 172.21.15.42:0/2961903950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb681a5170 con 0x7feb681082a0 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.519+0000 7feb4ffff640 1 -- 172.21.15.42:0/2961903950 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7feb60003970 con 0x7feb681082a0 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.519+0000 7feb6fa49740 1 Processor -- start 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.519+0000 7feb6fa49740 1 -- start start 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.519+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba3b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.519+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba3ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.519+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 0x55ff4ba48760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.519+0000 7feb6fa49740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ff4b9a12f0 con 0x55ff4ba3b5d0 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.519+0000 7feb6fa49740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ff4b948cf0 con 0x55ff4ba46370 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.519+0000 7feb6fa49740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ff4b99d2b0 con 0x55ff4ba3cb40 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba3ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb66ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba3ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43296/0 (socket says 172.21.15.42:43296) 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb66ffd640 1 -- 172.21.15.42:0/4254159687 learned_addr learned my addr 172.21.15.42:0/4254159687 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb667fc640 1 --2- 172.21.15.42:0/4254159687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 0x55ff4ba48760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb667fc640 1 --2- 172.21.15.42:0/4254159687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba3b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb66ffd640 1 -- 172.21.15.42:0/4254159687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3cb40 msgr2=0x55ff4ba3b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb66ffd640 1 --2- 172.21.15.42:0/4254159687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba3b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb66ffd640 1 -- 172.21.15.42:0/4254159687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 msgr2=0x55ff4ba48760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb66ffd640 1 --2- 172.21.15.42:0/4254159687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 0x55ff4ba48760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb66ffd640 1 -- 172.21.15.42:0/4254159687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4b92d3a0 con 0x55ff4ba3b5d0 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb667fc640 1 --2- 172.21.15.42:0/4254159687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba3b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb4ffff640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feb500a32c0 0x7feb500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb667fc640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feb500a32c0 0x7feb500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb66ffd640 1 --2- 172.21.15.42:0/4254159687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba3ba10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7feb5800bda0 tx=0x7feb580107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c36f94b897d5ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb4ffff640 1 -- 172.21.15.42:0/2961903950 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7feb600cfcd0 con 0x7feb681082a0 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb4d7fa640 1 -- 172.21.15.42:0/4254159687 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5801c680 con 0x55ff4ba3b5d0 2024-09-19T09:42:02.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb4d7fa640 1 -- 172.21.15.42:0/4254159687 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb58011920 con 0x55ff4ba3b5d0 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.520+0000 7feb4d7fa640 1 -- 172.21.15.42:0/4254159687 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5801a800 con 0x55ff4ba3b5d0 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb6fa49740 1 -- 172.21.15.42:0/4254159687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3b5d0 msgr2=0x55ff4ba3ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb667fc640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feb500a32c0 0x7feb500a5780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb5c02a940 tx=0x7feb5c040040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb6fa49740 1 --2- 172.21.15.42:0/4254159687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba3ba10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7feb5800bda0 tx=0x7feb580107a0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb6fa49740 1 -- 172.21.15.42:0/4254159687 shutdown_connections 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb6fa49740 1 --2- 172.21.15.42:0/4254159687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 0x55ff4ba48760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb6fa49740 1 --2- 172.21.15.42:0/4254159687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba3ba10 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb6fa49740 1 --2- 172.21.15.42:0/4254159687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba3b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb6fa49740 1 -- 172.21.15.42:0/4254159687 >> 172.21.15.42:0/4254159687 conn(0x55ff4ba04310 msgr2=0x55ff4ba37c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb6fa49740 1 -- 172.21.15.42:0/4254159687 shutdown_connections 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb6fa49740 1 -- 172.21.15.42:0/4254159687 wait complete. 2024-09-19T09:42:02.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.521+0000 7feb6fa49740 1 -- start start 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb6fa49740 1 Processor -- start 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba45d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba42ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 0x55ff4ba435e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb6fa49740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ff4ba49070 con 0x55ff4ba3cb40 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb6fa49740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ff4b95c060 con 0x55ff4ba46370 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb6fa49740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ff4ba491f0 con 0x55ff4ba3b5d0 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb6fa49740 10 client.0 _ll_register_callbacks cb 0x55ff4b6af8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb667fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba42ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb667fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba42ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43300/0 (socket says 172.21.15.42:43300) 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb667fc640 1 -- 172.21.15.42:0/1354368279 learned_addr learned my addr 172.21.15.42:0/1354368279 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb677fe640 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 0x55ff4ba435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb66ffd640 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba45d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb667fc640 1 -- 172.21.15.42:0/1354368279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 msgr2=0x55ff4ba45d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb667fc640 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba45d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb667fc640 1 -- 172.21.15.42:0/1354368279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 msgr2=0x55ff4ba435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb667fc640 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 0x55ff4ba435e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb667fc640 1 -- 172.21.15.42:0/1354368279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff4b7123c0 con 0x55ff4ba3cb40 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.522+0000 7feb677fe640 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 0x55ff4ba435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb667fc640 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba42ff0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7feb5c006010 tx=0x7feb5c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb3e190766df081 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb4aff5640 1 -- 172.21.15.42:0/1354368279 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c04e070 con 0x55ff4ba3cb40 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb4aff5640 1 -- 172.21.15.42:0/1354368279 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7feb5c031d00 con 0x55ff4ba3cb40 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb6fa49740 1 -- 172.21.15.42:0/1354368279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb58011920 con 0x55ff4ba3cb40 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb4aff5640 1 -- 172.21.15.42:0/1354368279 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7feb5c035040 con 0x55ff4ba3cb40 2024-09-19T09:42:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb6fa49740 10 client.16494 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb6fa49740 1 -- 172.21.15.42:0/1354368279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ff4ba54ae0 con 0x55ff4ba3cb40 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb4aff5640 1 -- 172.21.15.42:0/1354368279 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb58011920 con 0x55ff4ba3cb40 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb4aff5640 1 -- 172.21.15.42:0/1354368279 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7feb5c048040 con 0x55ff4ba3cb40 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb6fa49740 10 client.16494 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb6fa49740 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb6fa49740 20 client.16494 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb6fa49740 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ff4ba55f90 0x55ff4ba583b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb6fa49740 4 client.16494 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.523+0000 7feb6fa49740 1 -- 172.21.15.42:0/1354368279 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff4b9ae860 con 0x55ff4ba55f90 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.524+0000 7feb66ffd640 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ff4ba55f90 0x55ff4ba583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.524+0000 7feb4aff5640 10 client.16494 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.524+0000 7feb66ffd640 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ff4ba55f90 0x55ff4ba583b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99894b20a3240393 server_cookie=a1a3e8bc197c2d56 in_seq=0 out_seq=0 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb4aff5640 1 -- 172.21.15.42:0/1354368279 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff4b9ae860 con 0x55ff4ba55f90 2024-09-19T09:42:02.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb4aff5640 10 client.16494 handle_command_reply: tid=0 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 client.16494 shutdown 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 -- 172.21.15.42:0/1354368279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3cb40 msgr2=0x55ff4ba42ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba42ff0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7feb5c006010 tx=0x7feb5c02a420 comp rx=0 tx=0).stop 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 -- 172.21.15.42:0/1354368279 shutdown_connections 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ff4ba55f90 0x55ff4ba583b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba46370 0x55ff4ba435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba42ff0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb4aff5640 0 client.16494 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 --2- 172.21.15.42:0/1354368279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba45d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 -- 172.21.15.42:0/1354368279 >> 172.21.15.42:0/1354368279 conn(0x55ff4ba04310 msgr2=0x55ff4ba3d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 -- 172.21.15.42:0/1354368279 shutdown_connections 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 1 -- 172.21.15.42:0/1354368279 wait complete. 2024-09-19T09:42:02.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.525+0000 7feb6fa49740 20 client.16494 trim_cache size 0 max 16384 2024-09-19T09:42:02.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb6fa49740 1 Processor -- start 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb6fa49740 1 -- start start 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba52310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba41fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba5dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb6fa49740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feb681ad710 con 0x55ff4ba46370 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb6fa49740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feb681af4c0 con 0x55ff4ba3cb40 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb6fa49740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feb681adea0 con 0x55ff4ba3b5d0 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba5dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb667fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba41fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb667fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba41fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:47250/0 (socket says 172.21.15.42:47250) 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba5dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43308/0 (socket says 172.21.15.42:43308) 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb667fc640 1 -- 172.21.15.42:0/2772177453 learned_addr learned my addr 172.21.15.42:0/2772177453 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:02.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.540+0000 7feb66ffd640 1 --2- 172.21.15.42:0/2772177453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba52310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.541+0000 7feb667fc640 1 -- 172.21.15.42:0/2772177453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 msgr2=0x55ff4ba52310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.541+0000 7feb667fc640 1 --2- 172.21.15.42:0/2772177453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba52310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.541+0000 7feb667fc640 1 -- 172.21.15.42:0/2772177453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 msgr2=0x55ff4ba5dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.541+0000 7feb667fc640 1 --2- 172.21.15.42:0/2772177453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba5dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.541+0000 7feb667fc640 1 -- 172.21.15.42:0/2772177453 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4ba3e120 con 0x55ff4ba3cb40 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.541+0000 7feb677fe640 1 --2- 172.21.15.42:0/2772177453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba5dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.541+0000 7feb667fc640 1 --2- 172.21.15.42:0/2772177453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba41fd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009230 tx=0x7feb5c003980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec0798dd9d6f4cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.541+0000 7feb4cff9640 1 -- 172.21.15.42:0/2772177453 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c04e030 con 0x55ff4ba3cb40 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.541+0000 7feb4cff9640 1 -- 172.21.15.42:0/2772177453 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb5c03db90 con 0x55ff4ba3cb40 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.541+0000 7feb4cff9640 1 -- 172.21.15.42:0/2772177453 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c04a6d0 con 0x55ff4ba3cb40 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 -- 172.21.15.42:0/2772177453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 msgr2=0x55ff4ba41fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 --2- 172.21.15.42:0/2772177453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba41fd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009230 tx=0x7feb5c003980 comp rx=0 tx=0).stop 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 -- 172.21.15.42:0/2772177453 shutdown_connections 2024-09-19T09:42:02.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 --2- 172.21.15.42:0/2772177453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba5dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 --2- 172.21.15.42:0/2772177453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba41fd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 --2- 172.21.15.42:0/2772177453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba52310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 -- 172.21.15.42:0/2772177453 >> 172.21.15.42:0/2772177453 conn(0x55ff4ba04310 msgr2=0x55ff4ba418c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 -- 172.21.15.42:0/2772177453 shutdown_connections 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 -- 172.21.15.42:0/2772177453 wait complete. 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 -- start start 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 Processor -- start 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.542+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba4eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba49ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb6fa49740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba4a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb6fa49740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feb681aed90 con 0x55ff4ba46370 2024-09-19T09:42:02.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb6fa49740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feb681ae630 con 0x55ff4ba3cb40 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb6fa49740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feb681ab6f0 con 0x55ff4ba3b5d0 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb6fa49740 10 client.0 _ll_register_callbacks cb 0x7feb5c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb66ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba4eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb667fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba49ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba4a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb66ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba4eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:39398/0 (socket says 172.21.15.42:39398) 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb66ffd640 1 -- 172.21.15.42:0/2546011749 learned_addr learned my addr 172.21.15.42:0/2546011749 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb667fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba49ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:47264/0 (socket says 172.21.15.42:47264) 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb677fe640 1 -- 172.21.15.42:0/2546011749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 msgr2=0x55ff4ba4eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb677fe640 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba4eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb677fe640 1 -- 172.21.15.42:0/2546011749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 msgr2=0x55ff4ba49ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb677fe640 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba49ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb677fe640 1 -- 172.21.15.42:0/2546011749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff4ba4abc0 con 0x55ff4ba46370 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb66ffd640 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba4eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb667fc640 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba49ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb677fe640 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba4a3e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7feb600cdb20 tx=0x7feb60098570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cb7e5324796129 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb4aff5640 1 -- 172.21.15.42:0/2546011749 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600a0680 con 0x55ff4ba46370 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb4aff5640 1 -- 172.21.15.42:0/2546011749 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7feb60004000 con 0x55ff4ba46370 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.543+0000 7feb6fa49740 1 -- 172.21.15.42:0/2546011749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb5c03db90 con 0x55ff4ba46370 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb4aff5640 1 -- 172.21.15.42:0/2546011749 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7feb600a4f40 con 0x55ff4ba46370 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb6fa49740 10 client.16500 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb6fa49740 1 -- 172.21.15.42:0/2546011749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ff4bac50b0 con 0x55ff4ba46370 2024-09-19T09:42:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb4aff5640 1 -- 172.21.15.42:0/2546011749 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb5c03db90 con 0x55ff4ba46370 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb4aff5640 1 -- 172.21.15.42:0/2546011749 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7feb60024060 con 0x55ff4ba46370 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb6fa49740 10 client.16500 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb6fa49740 10 client.16500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb6fa49740 20 client.16500 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb6fa49740 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ff4ba55f90 0x55ff4bac7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb6fa49740 4 client.16500 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb6fa49740 1 -- 172.21.15.42:0/2546011749 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff4b9a8d70 con 0x55ff4ba55f90 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.544+0000 7feb66ffd640 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ff4ba55f90 0x55ff4bac7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb66ffd640 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ff4ba55f90 0x55ff4bac7890 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22abcfdf7109da52 server_cookie=637b4d9f5a5e7b3f in_seq=0 out_seq=0 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb4aff5640 10 client.16500 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb4aff5640 1 -- 172.21.15.42:0/2546011749 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff4b9a8d70 con 0x55ff4ba55f90 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb4aff5640 10 client.16500 handle_command_reply: tid=0 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 client.16500 shutdown 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 -- 172.21.15.42:0/2546011749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 msgr2=0x55ff4ba4a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:02.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba4a3e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7feb600cdb20 tx=0x7feb60098570 comp rx=0 tx=0).stop 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 -- 172.21.15.42:0/2546011749 shutdown_connections 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ff4ba55f90 0x55ff4bac7890 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ff4ba46370 0x55ff4ba4a3e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb4aff5640 0 client.16500 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff4ba3cb40 0x55ff4ba49ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 --2- 172.21.15.42:0/2546011749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4ba3b5d0 0x55ff4ba4eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 -- 172.21.15.42:0/2546011749 >> 172.21.15.42:0/2546011749 conn(0x55ff4ba04310 msgr2=0x55ff4ba420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 -- 172.21.15.42:0/2546011749 shutdown_connections 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 1 -- 172.21.15.42:0/2546011749 wait complete. 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.545+0000 7feb6fa49740 20 client.16500 trim_cache size 0 max 16384 2024-09-19T09:42:02.559 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:42:02.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 -- 172.21.15.42:0/2961903950 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feb500a32c0 msgr2=0x7feb500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:02.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feb500a32c0 0x7feb500a5780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb5c02a940 tx=0x7feb5c040040 comp rx=0 tx=0).stop 2024-09-19T09:42:02.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 -- 172.21.15.42:0/2961903950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb681082a0 msgr2=0x7feb6819cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb681082a0 0x7feb6819cec0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7feb6000da10 tx=0x7feb6000ded0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 -- 172.21.15.42:0/2961903950 shutdown_connections 2024-09-19T09:42:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7feb500a32c0 0x7feb500a5780 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb681082a0 0x7feb6819cec0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb681036e0 0x7feb68198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 --2- 172.21.15.42:0/2961903950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb68102d30 0x7feb681985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 -- 172.21.15.42:0/2961903950 >> 172.21.15.42:0/2961903950 conn(0x7feb680fc7d0 msgr2=0x7feb68105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 -- 172.21.15.42:0/2961903950 shutdown_connections 2024-09-19T09:42:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:02.546+0000 7feb6d670640 1 -- 172.21.15.42:0/2961903950 wait complete. 2024-09-19T09:42:02.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:02 smithi171 ceph-mon[35803]: pgmap v418: 97 pgs: 97 active+clean; 242 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 23 MiB/s wr, 255 op/s 2024-09-19T09:42:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:02 smithi136 ceph-mon[34840]: pgmap v418: 97 pgs: 97 active+clean; 242 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 23 MiB/s wr, 255 op/s 2024-09-19T09:42:03.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:03 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:42:03.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:03 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:42:03.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:03 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:42:04.237 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:42:04.237 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:42:04.533 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:04 smithi136 ceph-mon[34840]: pgmap v419: 97 pgs: 97 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 257 op/s 2024-09-19T09:42:04.655 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:04 smithi042 ceph-mon[31223]: pgmap v419: 97 pgs: 97 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 257 op/s 2024-09-19T09:42:04.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:04 smithi171 ceph-mon[35803]: pgmap v419: 97 pgs: 97 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 257 op/s 2024-09-19T09:42:05.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 -- 172.21.15.42:0/961821196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb901082a0 msgr2=0x7ffb9010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 --2- 172.21.15.42:0/961821196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb901082a0 0x7ffb9010ec40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009cd0 tx=0x7ffb8802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 -- 172.21.15.42:0/961821196 shutdown_connections 2024-09-19T09:42:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 --2- 172.21.15.42:0/961821196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb901082a0 0x7ffb9010ec40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 --2- 172.21.15.42:0/961821196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb901036e0 0x7ffb90107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 --2- 172.21.15.42:0/961821196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb90102d30 0x7ffb90103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 -- 172.21.15.42:0/961821196 >> 172.21.15.42:0/961821196 conn(0x7ffb900fc7d0 msgr2=0x7ffb900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 -- 172.21.15.42:0/961821196 shutdown_connections 2024-09-19T09:42:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 -- 172.21.15.42:0/961821196 wait complete. 2024-09-19T09:42:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 Processor -- start 2024-09-19T09:42:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.998+0000 7ffb97c7d640 1 -- start start 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb97c7d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb90102d30 0x7ffb901a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb97c7d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb901036e0 0x7ffb901a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb97c7d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb901082a0 0x7ffb9019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb97c7d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901120a0 con 0x7ffb901036e0 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb97c7d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffb90111f20 con 0x7ffb90102d30 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb97c7d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffb90112220 con 0x7ffb901082a0 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95218640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb901036e0 0x7ffb901a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95a19640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb90102d30 0x7ffb901a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95218640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb901036e0 0x7ffb901a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43328/0 (socket says 172.21.15.42:43328) 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95218640 1 -- 172.21.15.42:0/2451436299 learned_addr learned my addr 172.21.15.42:0/2451436299 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb9621a640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb901082a0 0x7ffb9019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95218640 1 -- 172.21.15.42:0/2451436299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb901082a0 msgr2=0x7ffb9019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:05.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95218640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb901082a0 0x7ffb9019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95218640 1 -- 172.21.15.42:0/2451436299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb90102d30 msgr2=0x7ffb901a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:05.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95218640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb90102d30 0x7ffb901a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95218640 1 -- 172.21.15.42:0/2451436299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9019acc0 con 0x7ffb901036e0 2024-09-19T09:42:05.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95a19640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb90102d30 0x7ffb901a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:05.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:04.999+0000 7ffb95218640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb901036e0 0x7ffb901a0910 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000e9f0 tx=0x7ffb8000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:05.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.000+0000 7ffb86ffd640 1 -- 172.21.15.42:0/2451436299 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8000ccc0 con 0x7ffb901036e0 2024-09-19T09:42:05.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.000+0000 7ffb97c7d640 1 -- 172.21.15.42:0/2451436299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9019afb0 con 0x7ffb901036e0 2024-09-19T09:42:05.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.000+0000 7ffb86ffd640 1 -- 172.21.15.42:0/2451436299 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb80010910 con 0x7ffb901036e0 2024-09-19T09:42:05.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.000+0000 7ffb86ffd640 1 -- 172.21.15.42:0/2451436299 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80018920 con 0x7ffb901036e0 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.000+0000 7ffb97c7d640 1 -- 172.21.15.42:0/2451436299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb901a72a0 con 0x7ffb901036e0 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.002+0000 7ffb86ffd640 1 -- 172.21.15.42:0/2451436299 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ffb80010ac0 con 0x7ffb901036e0 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.002+0000 7ffb9a056740 1 Processor -- start 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.002+0000 7ffb9a056740 1 -- start start 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3cb7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cb8480 0x5588b3cc2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb86ffd640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb7c0a3240 0x7ffb7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cc2d40 0x5588b3cc5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb9a056740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5588b3c1d280 con 0x5588b3cb8480 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb9a056740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5588b3bc4b10 con 0x5588b3cc2d40 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb9a056740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5588b3c19240 con 0x5588b3cb7b60 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb95a19640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cb8480 0x5588b3cc2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb95218640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb7c0a3240 0x7ffb7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb9621a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cc2d40 0x5588b3cc5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb95a19640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cb8480 0x5588b3cc2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43334/0 (socket says 172.21.15.42:43334) 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb9621a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cc2d40 0x5588b3cc5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:47276/0 (socket says 172.21.15.42:47276) 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb95a19640 1 -- 172.21.15.42:0/595759683 learned_addr learned my addr 172.21.15.42:0/595759683 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb9621a640 1 --2- 172.21.15.42:0/595759683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3cb7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb86ffd640 1 -- 172.21.15.42:0/2451436299 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ffb800cfbb0 con 0x7ffb901036e0 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb95a19640 1 -- 172.21.15.42:0/595759683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 msgr2=0x5588b3cb7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb95a19640 1 --2- 172.21.15.42:0/595759683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3cb7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb95a19640 1 -- 172.21.15.42:0/595759683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cc2d40 msgr2=0x5588b3cc5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb95a19640 1 --2- 172.21.15.42:0/595759683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cc2d40 0x5588b3cc5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb95a19640 1 -- 172.21.15.42:0/595759683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b3bd11f0 con 0x5588b3cb8480 2024-09-19T09:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb9621a640 1 --2- 172.21.15.42:0/595759683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cc2d40 0x5588b3cc5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.003+0000 7ffb95218640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb7c0a3240 0x7ffb7c0a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffb8009c190 tx=0x7ffb8008e050 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.004+0000 7ffb95a19640 1 --2- 172.21.15.42:0/595759683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cb8480 0x5588b3cc2800 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0115c0 tx=0x7ffb8c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c462d1f9560c9e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.004+0000 7ffb7bfff640 1 -- 172.21.15.42:0/595759683 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c00f640 con 0x5588b3cb8480 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.004+0000 7ffb7bfff640 1 -- 172.21.15.42:0/595759683 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb8c00fcc0 con 0x5588b3cb8480 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.004+0000 7ffb7bfff640 1 -- 172.21.15.42:0/595759683 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c019cc0 con 0x5588b3cb8480 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 -- 172.21.15.42:0/595759683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cb8480 msgr2=0x5588b3cc2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 --2- 172.21.15.42:0/595759683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cb8480 0x5588b3cc2800 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0115c0 tx=0x7ffb8c011a80 comp rx=0 tx=0).stop 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 -- 172.21.15.42:0/595759683 shutdown_connections 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 --2- 172.21.15.42:0/595759683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cc2d40 0x5588b3cc5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 --2- 172.21.15.42:0/595759683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cb8480 0x5588b3cc2800 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 --2- 172.21.15.42:0/595759683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3cb7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 -- 172.21.15.42:0/595759683 >> 172.21.15.42:0/595759683 conn(0x5588b3cb40f0 msgr2=0x5588b3cb44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 -- 172.21.15.42:0/595759683 shutdown_connections 2024-09-19T09:42:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 -- 172.21.15.42:0/595759683 wait complete. 2024-09-19T09:42:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 -- start start 2024-09-19T09:42:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.005+0000 7ffb9a056740 1 Processor -- start 2024-09-19T09:42:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb7b60 0x5588b3cbfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb8480 0x5588b3cc0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9a056740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5588b3cc5910 con 0x5588b3cc2d40 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9a056740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5588b3bd7f10 con 0x5588b3cb7b60 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9a056740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5588b3cc5a90 con 0x5588b3cb8480 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9a056740 10 client.0 _ll_register_callbacks cb 0x5588b3ba0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9621a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9621a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43336/0 (socket says 172.21.15.42:43336) 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9621a640 1 -- 172.21.15.42:0/957776098 learned_addr learned my addr 172.21.15.42:0/957776098 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb95a19640 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb8480 0x5588b3cc0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9621a640 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb7b60 0x5588b3cbfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9621a640 1 -- 172.21.15.42:0/957776098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb8480 msgr2=0x5588b3cc0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9621a640 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb8480 0x5588b3cc0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9621a640 1 -- 172.21.15.42:0/957776098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb7b60 msgr2=0x5588b3cbfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9621a640 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb7b60 0x5588b3cbfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9621a640 1 -- 172.21.15.42:0/957776098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b398e6a0 con 0x5588b3cc2d40 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb95a19640 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb8480 0x5588b3cc0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb9621a640 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc0650 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ffb8802ae00 tx=0x7ffb880095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39edf8f585311b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb797fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb797fa640 1 -- 172.21.15.42:0/957776098 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb880309f0 con 0x5588b3cc2d40 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.006+0000 7ffb797fa640 1 -- 172.21.15.42:0/957776098 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ffb88030b90 con 0x5588b3cc2d40 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb9a056740 1 -- 172.21.15.42:0/957776098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb8c00fcc0 con 0x5588b3cc2d40 2024-09-19T09:42:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb797fa640 1 -- 172.21.15.42:0/957776098 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ffb88030d90 con 0x5588b3cc2d40 2024-09-19T09:42:05.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb9a056740 10 client.16512 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:05.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb9a056740 1 -- 172.21.15.42:0/957776098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5588b3cd1510 con 0x5588b3cc2d40 2024-09-19T09:42:05.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb797fa640 1 -- 172.21.15.42:0/957776098 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb8c00fcc0 con 0x5588b3cc2d40 2024-09-19T09:42:05.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb797fa640 1 -- 172.21.15.42:0/957776098 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7ffb88030070 con 0x5588b3cc2d40 2024-09-19T09:42:05.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb9a056740 10 client.16512 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:05.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb9a056740 10 client.16512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:05.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb9a056740 20 client.16512 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:05.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb9a056740 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5588b3cd2920 0x5588b3cd4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb9a056740 4 client.16512 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb9a056740 1 -- 172.21.15.42:0/957776098 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588b3c2a7f0 con 0x5588b3cd2920 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.007+0000 7ffb95a19640 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5588b3cd2920 0x5588b3cd4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.008+0000 7ffb95a19640 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5588b3cd2920 0x5588b3cd4d80 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc34cbdb6b970e31 server_cookie=854b0ab9ee309c09 in_seq=0 out_seq=0 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.008+0000 7ffb797fa640 10 client.16512 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.008+0000 7ffb797fa640 1 -- 172.21.15.42:0/957776098 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588b3c2a7f0 con 0x5588b3cd2920 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.008+0000 7ffb797fa640 10 client.16512 handle_command_reply: tid=0 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.008+0000 7ffb9a056740 1 client.16512 shutdown 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 1 -- 172.21.15.42:0/957776098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 msgr2=0x5588b3cc0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc0650 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ffb8802ae00 tx=0x7ffb880095c0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 1 -- 172.21.15.42:0/957776098 shutdown_connections 2024-09-19T09:42:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5588b3cd2920 0x5588b3cd4d80 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc0650 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb8480 0x5588b3cc0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 1 --2- 172.21.15.42:0/957776098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb7b60 0x5588b3cbfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb797fa640 0 client.16512 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 1 -- 172.21.15.42:0/957776098 >> 172.21.15.42:0/957776098 conn(0x5588b3cb40f0 msgr2=0x5588b3cb3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 1 -- 172.21.15.42:0/957776098 shutdown_connections 2024-09-19T09:42:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 1 -- 172.21.15.42:0/957776098 wait complete. 2024-09-19T09:42:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.009+0000 7ffb9a056740 20 client.16512 trim_cache size 0 max 16384 2024-09-19T09:42:05.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9a056740 1 Processor -- start 2024-09-19T09:42:05.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9a056740 1 -- start start 2024-09-19T09:42:05.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3cc1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cbf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9a056740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901af810 con 0x5588b3cc2d40 2024-09-19T09:42:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9a056740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901b15c0 con 0x5588b3cb8480 2024-09-19T09:42:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9a056740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901affa0 con 0x5588b3cb7b60 2024-09-19T09:42:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9621a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cbf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9621a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cbf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43338/0 (socket says 172.21.15.42:43338) 2024-09-19T09:42:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb95a19640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9621a640 1 -- 172.21.15.42:0/2881848127 learned_addr learned my addr 172.21.15.42:0/2881848127 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.028+0000 7ffb9621a640 1 --2- 172.21.15.42:0/2881848127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3cc1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.029+0000 7ffb9621a640 1 -- 172.21.15.42:0/2881848127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 msgr2=0x5588b3cc1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.029+0000 7ffb9621a640 1 --2- 172.21.15.42:0/2881848127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3cc1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.029+0000 7ffb9621a640 1 -- 172.21.15.42:0/2881848127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 msgr2=0x5588b3cba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.029+0000 7ffb9621a640 1 --2- 172.21.15.42:0/2881848127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.029+0000 7ffb9621a640 1 -- 172.21.15.42:0/2881848127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b3cb3b90 con 0x5588b3cc2d40 2024-09-19T09:42:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.029+0000 7ffb95a19640 1 --2- 172.21.15.42:0/2881848127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.029+0000 7ffb9621a640 1 --2- 172.21.15.42:0/2881848127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cbf4b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ffb8804b930 tx=0x7ffb8802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4bfa30daffbe91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.029+0000 7ffb7b7fe640 1 -- 172.21.15.42:0/2881848127 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8805c040 con 0x5588b3cc2d40 2024-09-19T09:42:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.029+0000 7ffb7b7fe640 1 -- 172.21.15.42:0/2881848127 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb8803f040 con 0x5588b3cc2d40 2024-09-19T09:42:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.029+0000 7ffb7b7fe640 1 -- 172.21.15.42:0/2881848127 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88003bd0 con 0x5588b3cc2d40 2024-09-19T09:42:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 -- 172.21.15.42:0/2881848127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 msgr2=0x5588b3cbf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 --2- 172.21.15.42:0/2881848127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cbf4b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ffb8804b930 tx=0x7ffb8802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 -- 172.21.15.42:0/2881848127 shutdown_connections 2024-09-19T09:42:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 --2- 172.21.15.42:0/2881848127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cbf4b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 --2- 172.21.15.42:0/2881848127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 --2- 172.21.15.42:0/2881848127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3cc1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 -- 172.21.15.42:0/2881848127 >> 172.21.15.42:0/2881848127 conn(0x5588b3cb40f0 msgr2=0x5588b3cb3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 -- 172.21.15.42:0/2881848127 shutdown_connections 2024-09-19T09:42:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 -- 172.21.15.42:0/2881848127 wait complete. 2024-09-19T09:42:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 -- start start 2024-09-19T09:42:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.030+0000 7ffb9a056740 1 Processor -- start 2024-09-19T09:42:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3ccb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cc6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9a056740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9a056740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901b0e90 con 0x5588b3cc2d40 2024-09-19T09:42:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9a056740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901b0730 con 0x5588b3cb8480 2024-09-19T09:42:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9a056740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901ad840 con 0x5588b3cb7b60 2024-09-19T09:42:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9a056740 10 client.0 _ll_register_callbacks cb 0x7ffb880305c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9621a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb95a19640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cc6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9621a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43350/0 (socket says 172.21.15.42:43350) 2024-09-19T09:42:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9621a640 1 -- 172.21.15.42:0/16701832 learned_addr learned my addr 172.21.15.42:0/16701832 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb95a19640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cc6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:47290/0 (socket says 172.21.15.42:47290) 2024-09-19T09:42:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9621a640 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3ccb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb95a19640 1 -- 172.21.15.42:0/16701832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 msgr2=0x5588b3ccb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb95a19640 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3ccb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb95a19640 1 -- 172.21.15.42:0/16701832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 msgr2=0x5588b3cc69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb95a19640 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb95a19640 1 -- 172.21.15.42:0/16701832 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b3cc6f10 con 0x5588b3cb8480 2024-09-19T09:42:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb9621a640 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb95a19640 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cc6490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c005890 tx=0x7ffb8c019860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3eeeb2085664b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.031+0000 7ffb797fa640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:42:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb797fa640 1 -- 172.21.15.42:0/16701832 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c019e50 con 0x5588b3cb8480 2024-09-19T09:42:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb9a056740 1 -- 172.21.15.42:0/16701832 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb8803f040 con 0x5588b3cb8480 2024-09-19T09:42:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb797fa640 1 -- 172.21.15.42:0/16701832 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ffb8c0050b0 con 0x5588b3cb8480 2024-09-19T09:42:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb797fa640 1 -- 172.21.15.42:0/16701832 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ffb8c035050 con 0x5588b3cb8480 2024-09-19T09:42:05.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb9a056740 10 client.25952 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:05.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb9a056740 1 -- 172.21.15.42:0/16701832 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5588b3d3d3c0 con 0x5588b3cb8480 2024-09-19T09:42:05.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb797fa640 1 -- 172.21.15.42:0/16701832 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb8803f040 con 0x5588b3cb8480 2024-09-19T09:42:05.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb797fa640 1 -- 172.21.15.42:0/16701832 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7ffb8c02c070 con 0x5588b3cb8480 2024-09-19T09:42:05.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb9a056740 10 client.25952 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:05.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb9a056740 10 client.25952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:05.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb9a056740 20 client.25952 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:05.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb9a056740 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5588b3d3d9d0 0x5588b3d3fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:05.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb9a056740 4 client.25952 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:42:05.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.032+0000 7ffb9a056740 1 -- 172.21.15.42:0/16701832 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5588b3c24d00 con 0x5588b3d3d9d0 2024-09-19T09:42:05.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.033+0000 7ffb9621a640 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5588b3d3d9d0 0x5588b3d3fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:05.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.033+0000 7ffb9621a640 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5588b3d3d9d0 0x5588b3d3fdf0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=626e86c002e8e0b6 server_cookie=8a0179f425d775a2 in_seq=0 out_seq=0 2024-09-19T09:42:05.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.033+0000 7ffb797fa640 10 client.25952 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:05.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb797fa640 1 -- 172.21.15.42:0/16701832 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5588b3c24d00 con 0x5588b3d3d9d0 2024-09-19T09:42:05.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb797fa640 10 client.25952 handle_command_reply: tid=0 2024-09-19T09:42:05.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 client.25952 shutdown 2024-09-19T09:42:05.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 -- 172.21.15.42:0/16701832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 msgr2=0x5588b3cc6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:05.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cc6490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c005890 tx=0x7ffb8c019860 comp rx=0 tx=0).stop 2024-09-19T09:42:05.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 -- 172.21.15.42:0/16701832 shutdown_connections 2024-09-19T09:42:05.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5588b3d3d9d0 0x5588b3d3fdf0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5588b3cc2d40 0x5588b3cc69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5588b3cb8480 0x5588b3cc6490 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 --2- 172.21.15.42:0/16701832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588b3cb7b60 0x5588b3ccb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb797fa640 0 client.25952 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:05.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 -- 172.21.15.42:0/16701832 >> 172.21.15.42:0/16701832 conn(0x5588b3cb40f0 msgr2=0x5588b3cbfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:05.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 -- 172.21.15.42:0/16701832 shutdown_connections 2024-09-19T09:42:05.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 1 -- 172.21.15.42:0/16701832 wait complete. 2024-09-19T09:42:05.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.034+0000 7ffb9a056740 20 client.25952 trim_cache size 0 max 16384 2024-09-19T09:42:05.051 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:42:05.051 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-19T09:42:05.052 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "76aa1bf2-e4c6-4f03-b50c-4fbbce0b445c", 2024-09-19T09:42:05.052 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-19T09:42:05.052 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:42:05.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 -- 172.21.15.42:0/2451436299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb7c0a3240 msgr2=0x7ffb7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:05.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb7c0a3240 0x7ffb7c0a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffb8009c190 tx=0x7ffb8008e050 comp rx=0 tx=0).stop 2024-09-19T09:42:05.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 -- 172.21.15.42:0/2451436299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb901036e0 msgr2=0x7ffb901a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:05.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb901036e0 0x7ffb901a0910 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000e9f0 tx=0x7ffb8000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 -- 172.21.15.42:0/2451436299 shutdown_connections 2024-09-19T09:42:05.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7ffb7c0a3240 0x7ffb7c0a5700 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb901082a0 0x7ffb9019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffb901036e0 0x7ffb901a0910 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 --2- 172.21.15.42:0/2451436299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb90102d30 0x7ffb901a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:05.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 -- 172.21.15.42:0/2451436299 >> 172.21.15.42:0/2451436299 conn(0x7ffb900fc7d0 msgr2=0x7ffb90101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:05.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 -- 172.21.15.42:0/2451436299 shutdown_connections 2024-09-19T09:42:05.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:05.035+0000 7ffb97c7d640 1 -- 172.21.15.42:0/2451436299 wait complete. 2024-09-19T09:42:05.838 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:42:06.101 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:06.489 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: pgmap v420: 97 pgs: 97 active+clean; 153 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 303 op/s 2024-09-19T09:42:06.489 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub queued for path: / 2024-09-19T09:42:06.489 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.490 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:06.494 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:06 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.579+0000 7f8b4da76640 1 -- 172.21.15.42:0/3538945868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b48100a80 msgr2=0x7f8b48100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.579+0000 7f8b4da76640 1 --2- 172.21.15.42:0/3538945868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b48100a80 0x7f8b48100ee0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009930 tx=0x7f8b3c02a420 comp rx=0 tx=0).stop 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.579+0000 7f8b4da76640 1 -- 172.21.15.42:0/3538945868 shutdown_connections 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.579+0000 7f8b4da76640 1 --2- 172.21.15.42:0/3538945868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b48101420 0x7f8b4810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.579+0000 7f8b4da76640 1 --2- 172.21.15.42:0/3538945868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b48100a80 0x7f8b48100ee0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.579+0000 7f8b4da76640 1 --2- 172.21.15.42:0/3538945868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b48106a80 0x7f8b48106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.579+0000 7f8b4da76640 1 -- 172.21.15.42:0/3538945868 >> 172.21.15.42:0/3538945868 conn(0x7f8b480fc7a0 msgr2=0x7f8b480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.579+0000 7f8b4da76640 1 -- 172.21.15.42:0/3538945868 shutdown_connections 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.579+0000 7f8b4da76640 1 -- 172.21.15.42:0/3538945868 wait complete. 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.580+0000 7f8b4da76640 1 Processor -- start 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.580+0000 7f8b4da76640 1 -- start start 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.580+0000 7f8b4da76640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b48100a80 0x7f8b48198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.580+0000 7f8b4da76640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b48101420 0x7f8b48198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.580+0000 7f8b4da76640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b48106a80 0x7f8b4819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.580+0000 7f8b4da76640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b48110e80 con 0x7f8b48106a80 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.580+0000 7f8b4da76640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8b48110d00 con 0x7f8b48101420 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.580+0000 7f8b4da76640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8b48111000 con 0x7f8b48100a80 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b47fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b48106a80 0x7f8b4819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b46ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b48101420 0x7f8b48198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b477fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b48100a80 0x7f8b48198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b46ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b48101420 0x7f8b48198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:47312/0 (socket says 172.21.15.42:47312) 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b47fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b48106a80 0x7f8b4819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43364/0 (socket says 172.21.15.42:43364) 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b46ffd640 1 -- 172.21.15.42:0/1570318162 learned_addr learned my addr 172.21.15.42:0/1570318162 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b477fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b48100a80 0x7f8b48198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:39478/0 (socket says 172.21.15.42:39478) 2024-09-19T09:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b47fff640 1 -- 172.21.15.42:0/1570318162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b48100a80 msgr2=0x7f8b48198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b47fff640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b48100a80 0x7f8b48198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b47fff640 1 -- 172.21.15.42:0/1570318162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b48101420 msgr2=0x7f8b48198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b47fff640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b48101420 0x7f8b48198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b47fff640 1 -- 172.21.15.42:0/1570318162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4819d400 con 0x7f8b48106a80 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b47fff640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b48106a80 0x7f8b4819cd20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009fd0 tx=0x7f8b4000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b44ff9640 1 -- 172.21.15.42:0/1570318162 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000ce20 con 0x7f8b48106a80 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b4da76640 1 -- 172.21.15.42:0/1570318162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4819d6f0 con 0x7f8b48106a80 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b44ff9640 1 -- 172.21.15.42:0/1570318162 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b40005020 con 0x7f8b48106a80 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b44ff9640 1 -- 172.21.15.42:0/1570318162 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40010720 con 0x7f8b48106a80 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.581+0000 7f8b4da76640 1 -- 172.21.15.42:0/1570318162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b481a4fd0 con 0x7f8b48106a80 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b44ff9640 1 -- 172.21.15.42:0/1570318162 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8b40005540 con 0x7f8b48106a80 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b4fe4f740 1 Processor -- start 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b4fe4f740 1 -- start start 2024-09-19T09:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644916634a0 0x564491663880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564491663dc0 0x56449166e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56449166e680 0x564491670a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5644915c92e0 con 0x56449166e680 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564491570ce0 con 0x564491663dc0 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5644915c52a0 con 0x5644916634a0 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b477fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564491663dc0 0x56449166e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b477fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564491663dc0 0x56449166e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:47320/0 (socket says 172.21.15.42:47320) 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b477fe640 1 -- 172.21.15.42:0/2240121081 learned_addr learned my addr 172.21.15.42:0/2240121081 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.584+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/2240121081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56449166e680 0x564491670a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b44ff9640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8b300a3240 0x7f8b300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b477fe640 1 -- 172.21.15.42:0/2240121081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644916634a0 msgr2=0x564491663880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b477fe640 1 --2- 172.21.15.42:0/2240121081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644916634a0 0x564491663880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b477fe640 1 -- 172.21.15.42:0/2240121081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56449166e680 msgr2=0x564491670a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b477fe640 1 --2- 172.21.15.42:0/2240121081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56449166e680 0x564491670a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b477fe640 1 -- 172.21.15.42:0/2240121081 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564491555440 con 0x564491663dc0 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/2240121081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56449166e680 0x564491670a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b47fff640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8b300a3240 0x7f8b300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b44ff9640 1 -- 172.21.15.42:0/1570318162 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8b400d0040 con 0x7f8b48106a80 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b477fe640 1 --2- 172.21.15.42:0/2240121081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564491663dc0 0x56449166e140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800bc90 tx=0x7f8b380107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b3da3f8aaba910b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b47fff640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8b300a3240 0x7f8b300a5700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8b4001a040 tx=0x7f8b40091b20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b2dffb640 1 -- 172.21.15.42:0/2240121081 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3801c480 con 0x564491663dc0 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b2dffb640 1 -- 172.21.15.42:0/2240121081 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3801cb00 con 0x564491663dc0 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.585+0000 7f8b2dffb640 1 -- 172.21.15.42:0/2240121081 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38011b40 con 0x564491663dc0 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.586+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/2240121081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564491663dc0 msgr2=0x56449166e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.586+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/2240121081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564491663dc0 0x56449166e140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800bc90 tx=0x7f8b380107a0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.586+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/2240121081 shutdown_connections 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.586+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/2240121081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56449166e680 0x564491670a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.586+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/2240121081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564491663dc0 0x56449166e140 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.586+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/2240121081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644916634a0 0x564491663880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.586+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/2240121081 >> 172.21.15.42:0/2240121081 conn(0x56449165fa30 msgr2=0x56449165fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.586+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/2240121081 shutdown_connections 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.586+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/2240121081 wait complete. 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b4fe4f740 1 -- start start 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b4fe4f740 1 Processor -- start 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644916634a0 0x56449166e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564491663dc0 0x56449166b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56449166e680 0x56449166b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564491671250 con 0x5644916634a0 2024-09-19T09:42:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564491584050 con 0x56449166e680 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5644916713d0 con 0x564491663dc0 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b4fe4f740 10 client.0 _ll_register_callbacks cb 0x5644915c4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b46ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644916634a0 0x56449166e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b46ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644916634a0 0x56449166e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43384/0 (socket says 172.21.15.42:43384) 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b46ffd640 1 -- 172.21.15.42:0/3503102448 learned_addr learned my addr 172.21.15.42:0/3503102448 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56449166e680 0x56449166b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.587+0000 7f8b477fe640 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564491663dc0 0x56449166b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b46ffd640 1 -- 172.21.15.42:0/3503102448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564491663dc0 msgr2=0x56449166b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564491663dc0 0x56449166b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b46ffd640 1 -- 172.21.15.42:0/3503102448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56449166e680 msgr2=0x56449166b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56449166e680 0x56449166b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b46ffd640 1 -- 172.21.15.42:0/3503102448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56449133a3c0 con 0x5644916634a0 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644916634a0 0x56449166e030 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c02a460 tx=0x7f8b3c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a513963c3d8cd7dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b26ffd640 1 -- 172.21.15.42:0/3503102448 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c035070 con 0x5644916634a0 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b26ffd640 1 -- 172.21.15.42:0/3503102448 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8b3c005020 con 0x5644916634a0 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/3503102448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b3801cb00 con 0x5644916634a0 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b26ffd640 1 -- 172.21.15.42:0/3503102448 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8b3c052050 con 0x5644916634a0 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b4fe4f740 10 client.16530 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.588+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/3503102448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56449167cc60 con 0x5644916634a0 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b26ffd640 1 -- 172.21.15.42:0/3503102448 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3801cb00 con 0x5644916634a0 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b26ffd640 1 -- 172.21.15.42:0/3503102448 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7f8b3c0047a0 con 0x5644916634a0 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b4fe4f740 10 client.16530 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b4fe4f740 10 client.16530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b4fe4f740 20 client.16530 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56449167e120 0x564491680510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b4fe4f740 4 client.16530 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/3503102448 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644915d6850 con 0x56449167e120 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b477fe640 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56449167e120 0x564491680510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b477fe640 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56449167e120 0x564491680510 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81a1719815cdee73 server_cookie=216650bd02e4b331 in_seq=0 out_seq=0 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.589+0000 7f8b26ffd640 10 client.16530 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b26ffd640 1 -- 172.21.15.42:0/3503102448 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644915d6850 con 0x56449167e120 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b26ffd640 10 client.16530 handle_command_reply: tid=0 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 client.16530 shutdown 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/3503102448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644916634a0 msgr2=0x56449166e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644916634a0 0x56449166e030 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c02a460 tx=0x7f8b3c005850 comp rx=0 tx=0).stop 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/3503102448 shutdown_connections 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x56449167e120 0x564491680510 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56449166e680 0x56449166b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564491663dc0 0x56449166b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/3503102448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5644916634a0 0x56449166e030 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b26ffd640 0 client.16530 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:06.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/3503102448 >> 172.21.15.42:0/3503102448 conn(0x56449165fa30 msgr2=0x564491665710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:06.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/3503102448 shutdown_connections 2024-09-19T09:42:06.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/3503102448 wait complete. 2024-09-19T09:42:06.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.590+0000 7f8b4fe4f740 20 client.16530 trim_cache size 0 max 16384 2024-09-19T09:42:06.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b4fe4f740 1 Processor -- start 2024-09-19T09:42:06.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b4fe4f740 1 -- start start 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491685d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x5644916862d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56449166e680 0x564491668540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b481ad600 con 0x564491663dc0 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8b481af3b0 con 0x5644916634a0 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8b481add90 con 0x56449166e680 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b477fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x5644916862d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b46ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491685d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b477fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x5644916862d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43394/0 (socket says 172.21.15.42:43394) 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b46ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491685d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:47342/0 (socket says 172.21.15.42:47342) 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.608+0000 7f8b477fe640 1 -- 172.21.15.42:0/1843415125 learned_addr learned my addr 172.21.15.42:0/1843415125 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/1843415125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56449166e680 0x564491668540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b477fe640 1 -- 172.21.15.42:0/1843415125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56449166e680 msgr2=0x564491668540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:06.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b477fe640 1 --2- 172.21.15.42:0/1843415125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56449166e680 0x564491668540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b477fe640 1 -- 172.21.15.42:0/1843415125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 msgr2=0x564491685d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:06.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b477fe640 1 --2- 172.21.15.42:0/1843415125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491685d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b477fe640 1 -- 172.21.15.42:0/1843415125 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564491660ae0 con 0x564491663dc0 2024-09-19T09:42:06.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/1843415125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491685d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:06.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b477fe640 1 --2- 172.21.15.42:0/1843415125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x5644916862d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8b380116f0 tx=0x7f8b3801f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e66e767d23e321 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b2d7fa640 1 -- 172.21.15.42:0/1843415125 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3802e020 con 0x564491663dc0 2024-09-19T09:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b2d7fa640 1 -- 172.21.15.42:0/1843415125 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b380054d0 con 0x564491663dc0 2024-09-19T09:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.609+0000 7f8b2d7fa640 1 -- 172.21.15.42:0/1843415125 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38011bf0 con 0x564491663dc0 2024-09-19T09:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.610+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1843415125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 msgr2=0x5644916862d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.610+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/1843415125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x5644916862d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8b380116f0 tx=0x7f8b3801f040 comp rx=0 tx=0).stop 2024-09-19T09:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.610+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1843415125 shutdown_connections 2024-09-19T09:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.610+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/1843415125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56449166e680 0x564491668540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.610+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/1843415125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x5644916862d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.610+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/1843415125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491685d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.610+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1843415125 >> 172.21.15.42:0/1843415125 conn(0x56449165fa30 msgr2=0x56449165eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.610+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1843415125 shutdown_connections 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.610+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1843415125 wait complete. 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.610+0000 7f8b4fe4f740 1 -- start start 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b4fe4f740 1 Processor -- start 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491676640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x564491676b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b4fe4f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56449166e680 0x564491674bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b481aec80 con 0x564491663dc0 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8b481ae520 con 0x5644916634a0 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b4fe4f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8b481ab5e0 con 0x56449166e680 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b4fe4f740 10 client.0 _ll_register_callbacks cb 0x7f8b3c009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b477fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x564491676b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b477fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x564491676b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43404/0 (socket says 172.21.15.42:43404) 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b477fe640 1 -- 172.21.15.42:0/1903417717 learned_addr learned my addr 172.21.15.42:0/1903417717 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491676640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56449166e680 0x564491674bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b477fe640 1 -- 172.21.15.42:0/1903417717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56449166e680 msgr2=0x564491674bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b477fe640 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56449166e680 0x564491674bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b477fe640 1 -- 172.21.15.42:0/1903417717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 msgr2=0x564491676640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b477fe640 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491676640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b477fe640 1 -- 172.21.15.42:0/1903417717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644916752b0 con 0x564491663dc0 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.611+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491676640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b477fe640 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x564491676b80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8b38000c00 tx=0x7f8b3800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e23ab599701d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b26ffd640 1 -- 172.21.15.42:0/1903417717 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38039060 con 0x564491663dc0 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b26ffd640 1 -- 172.21.15.42:0/1903417717 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8b38011970 con 0x564491663dc0 2024-09-19T09:42:06.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1903417717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b380054d0 con 0x564491663dc0 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b26ffd640 1 -- 172.21.15.42:0/1903417717 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8b3802e040 con 0x564491663dc0 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b4fe4f740 10 client.16536 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1903417717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5644916e9870 con 0x564491663dc0 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b26ffd640 1 -- 172.21.15.42:0/1903417717 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b380054d0 con 0x564491663dc0 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b26ffd640 1 -- 172.21.15.42:0/1903417717 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7f8b38003bf0 con 0x564491663dc0 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b4fe4f740 10 client.16536 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b4fe4f740 10 client.16536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b4fe4f740 20 client.16536 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.612+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5644916e9e20 0x5644916ec240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 4 client.16536 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1903417717 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5644915d0d60 con 0x5644916e9e20 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5644916e9e20 0x5644916ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b46ffd640 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5644916e9e20 0x5644916ec240 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b98dbd3b2ae6bd6 server_cookie=1f08c2fd74507743 in_seq=0 out_seq=0 2024-09-19T09:42:06.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b26ffd640 10 client.16536 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b26ffd640 1 -- 172.21.15.42:0/1903417717 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5644915d0d60 con 0x5644916e9e20 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b26ffd640 10 client.16536 handle_command_reply: tid=0 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 1 client.16536 shutdown 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1903417717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 msgr2=0x564491676b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x564491676b80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8b38000c00 tx=0x7f8b3800b410 comp rx=0 tx=0).stop 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1903417717 shutdown_connections 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5644916e9e20 0x5644916ec240 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56449166e680 0x564491674bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564491663dc0 0x564491676b80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b26ffd640 0 client.16536 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 1 --2- 172.21.15.42:0/1903417717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5644916634a0 0x564491676640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.613+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1903417717 >> 172.21.15.42:0/1903417717 conn(0x56449165fa30 msgr2=0x56449165e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1903417717 shutdown_connections 2024-09-19T09:42:06.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4fe4f740 1 -- 172.21.15.42:0/1903417717 wait complete. 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4fe4f740 20 client.16536 trim_cache size 0 max 16384 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stdout: "76aa1bf2-e4c6-4f03-b50c-4fbbce0b445c": { 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "76aa1bf2-e4c6-4f03-b50c-4fbbce0b445c", 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:06.621 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:42:06.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 -- 172.21.15.42:0/1570318162 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8b300a3240 msgr2=0x7f8b300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:06.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8b300a3240 0x7f8b300a5700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8b4001a040 tx=0x7f8b40091b20 comp rx=0 tx=0).stop 2024-09-19T09:42:06.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 -- 172.21.15.42:0/1570318162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b48106a80 msgr2=0x7f8b4819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:06.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b48106a80 0x7f8b4819cd20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009fd0 tx=0x7f8b4000ef10 comp rx=0 tx=0).stop 2024-09-19T09:42:06.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 -- 172.21.15.42:0/1570318162 shutdown_connections 2024-09-19T09:42:06.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f8b300a3240 0x7f8b300a5700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b48106a80 0x7f8b4819cd20 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b48101420 0x7f8b48198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 --2- 172.21.15.42:0/1570318162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b48100a80 0x7f8b48198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:06.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 -- 172.21.15.42:0/1570318162 >> 172.21.15.42:0/1570318162 conn(0x7f8b480fc7a0 msgr2=0x7f8b4806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:06.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 -- 172.21.15.42:0/1570318162 shutdown_connections 2024-09-19T09:42:06.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:06.614+0000 7f8b4da76640 1 -- 172.21.15.42:0/1570318162 wait complete. 2024-09-19T09:42:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: pgmap v420: 97 pgs: 97 active+clean; 153 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 303 op/s 2024-09-19T09:42:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub queued for path: / 2024-09-19T09:42:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:06.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:06 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: pgmap v420: 97 pgs: 97 active+clean; 153 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 303 op/s 2024-09-19T09:42:06.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub queued for path: / 2024-09-19T09:42:06.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.852 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.853 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.853 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.853 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.853 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:06.853 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:06.853 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:06 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.473 INFO:tasks.cephfs.filesystem:scrub status for tag:76aa1bf2-e4c6-4f03-b50c-4fbbce0b445c - {'path': '/', 'tag': '76aa1bf2-e4c6-4f03-b50c-4fbbce0b445c', 'options': 'recursive,force'} 2024-09-19T09:42:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:07.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:07 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.708 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:07.708 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:07 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:07.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:07.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:07 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: pgmap v421: 97 pgs: 97 active+clean; 157 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 371 op/s 2024-09-19T09:42:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:08.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:08 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: pgmap v421: 97 pgs: 97 active+clean; 157 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 371 op/s 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:08.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:08 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: pgmap v421: 97 pgs: 97 active+clean; 157 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 371 op/s 2024-09-19T09:42:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:08.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:08.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:08 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:09 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:09 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:09 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:09 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:09.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:09 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:09.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:09 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:09.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:09 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:09.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:09 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:09.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:09 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:09.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:09 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:09.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:09 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:09.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:09 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: pgmap v422: 97 pgs: 97 active+clean; 156 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 356 op/s 2024-09-19T09:42:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:10 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: pgmap v422: 97 pgs: 97 active+clean; 156 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 356 op/s 2024-09-19T09:42:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:10.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:10.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:10.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:10.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.706 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:10 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: pgmap v422: 97 pgs: 97 active+clean; 156 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 356 op/s 2024-09-19T09:42:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:10.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:10.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:10.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:10.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:10.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:10 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.511+0000 7f57a8add640 1 -- 172.21.15.42:0/680749803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57a4101c30 msgr2=0x7f57a41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.511+0000 7f57a8add640 1 --2- 172.21.15.42:0/680749803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57a4101c30 0x7f57a41020b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5798009900 tx=0x7f579802a410 comp rx=0 tx=0).stop 2024-09-19T09:42:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.512+0000 7f57a8add640 1 -- 172.21.15.42:0/680749803 shutdown_connections 2024-09-19T09:42:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.512+0000 7f57a8add640 1 --2- 172.21.15.42:0/680749803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57a41025f0 0x7f57a4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.512+0000 7f57a8add640 1 --2- 172.21.15.42:0/680749803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57a4101c30 0x7f57a41020b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.512+0000 7f57a8add640 1 --2- 172.21.15.42:0/680749803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f57a4100a40 0x7f57a4100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.512+0000 7f57a8add640 1 -- 172.21.15.42:0/680749803 >> 172.21.15.42:0/680749803 conn(0x7f57a40fc1e0 msgr2=0x7f57a40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.512+0000 7f57a8add640 1 -- 172.21.15.42:0/680749803 shutdown_connections 2024-09-19T09:42:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.512+0000 7f57a8add640 1 -- 172.21.15.42:0/680749803 wait complete. 2024-09-19T09:42:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.512+0000 7f57a8add640 1 Processor -- start 2024-09-19T09:42:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.512+0000 7f57a8add640 1 -- start start 2024-09-19T09:42:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a8add640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57a4100a40 0x7f57a4197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a8add640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57a4101c30 0x7f57a4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a8add640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f57a41025f0 0x7f57a419f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a8add640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f57a410c6f0 con 0x7f57a4100a40 2024-09-19T09:42:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a8add640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f57a410c570 con 0x7f57a4101c30 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a8add640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f57a410c870 con 0x7f57a41025f0 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57a4100a40 0x7f57a4197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57a4100a40 0x7f57a4197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47600/0 (socket says 172.21.15.42:47600) 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a259c640 1 -- 172.21.15.42:0/2068465774 learned_addr learned my addr 172.21.15.42:0/2068465774 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a1d9b640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57a4101c30 0x7f57a4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f57a41025f0 0x7f57a419f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a259c640 1 -- 172.21.15.42:0/2068465774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f57a41025f0 msgr2=0x7f57a419f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a259c640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f57a41025f0 0x7f57a419f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a259c640 1 -- 172.21.15.42:0/2068465774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57a4101c30 msgr2=0x7f57a4198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a259c640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57a4101c30 0x7f57a4198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a259c640 1 -- 172.21.15.42:0/2068465774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a419f9d0 con 0x7f57a4100a40 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a259c640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57a4100a40 0x7f57a4197dc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f579400e9c0 tx=0x7f579400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57937fe640 1 -- 172.21.15.42:0/2068465774 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579400cd80 con 0x7f57a4100a40 2024-09-19T09:42:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57a8add640 1 -- 172.21.15.42:0/2068465774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a419fcc0 con 0x7f57a4100a40 2024-09-19T09:42:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57937fe640 1 -- 172.21.15.42:0/2068465774 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57940035f0 con 0x7f57a4100a40 2024-09-19T09:42:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.513+0000 7f57937fe640 1 -- 172.21.15.42:0/2068465774 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794010690 con 0x7f57a4100a40 2024-09-19T09:42:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.514+0000 7f57a8add640 1 -- 172.21.15.42:0/2068465774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a41a01b0 con 0x7f57a4100a40 2024-09-19T09:42:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.516+0000 7f57937fe640 1 -- 172.21.15.42:0/2068465774 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f57940037a0 con 0x7f57a4100a40 2024-09-19T09:42:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.516+0000 7f57ab87c740 1 Processor -- start 2024-09-19T09:42:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.516+0000 7f57ab87c740 1 -- start start 2024-09-19T09:42:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.516+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 0x562fc6f9dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.516+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9e2e0 0x562fc6fa2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.516+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6fa3370 0x562fc6fa5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.516+0000 7f57ab87c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562fc6f012f0 con 0x562fc6f9e2e0 2024-09-19T09:42:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.516+0000 7f57ab87c740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562fc6ea9270 con 0x562fc6fa3370 2024-09-19T09:42:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.516+0000 7f57ab87c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562fc6efd2b0 con 0x562fc6f9d9a0 2024-09-19T09:42:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.516+0000 7f57a259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9e2e0 0x562fc6fa2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a2d9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 0x562fc6f9dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a2d9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 0x562fc6f9dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:34022/0 (socket says 172.21.15.42:34022) 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a1d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6fa3370 0x562fc6fa5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9e2e0 0x562fc6fa2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47602/0 (socket says 172.21.15.42:47602) 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1811884235 learned_addr learned my addr 172.21.15.42:0/1811884235 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1811884235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6fa3370 msgr2=0x562fc6fa5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1811884235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6fa3370 0x562fc6fa5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1811884235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9e2e0 msgr2=0x562fc6fa2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1811884235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9e2e0 0x562fc6fa2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1811884235 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fc6ea8340 con 0x562fc6f9d9a0 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57937fe640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f578c0a32f0 0x7f578c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a259c640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f578c0a32f0 0x7f578c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1811884235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 0x562fc6f9dda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f579c009fd0 tx=0x7f579c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da4eab5d5c74a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f57937fe640 1 -- 172.21.15.42:0/2068465774 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f57940cfd90 con 0x7f57a4100a40 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f5790ff9640 1 -- 172.21.15.42:0/1811884235 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c004d20 con 0x562fc6f9d9a0 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f5790ff9640 1 -- 172.21.15.42:0/1811884235 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f579c004050 con 0x562fc6f9d9a0 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.517+0000 7f5790ff9640 1 -- 172.21.15.42:0/1811884235 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c005260 con 0x562fc6f9d9a0 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57ab87c740 1 -- 172.21.15.42:0/1811884235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 msgr2=0x562fc6f9dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1811884235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 0x562fc6f9dda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f579c009fd0 tx=0x7f579c0118d0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57a259c640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f578c0a32f0 0x7f578c0a57b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f57940cdbe0 tx=0x7f57940dab30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57ab87c740 1 -- 172.21.15.42:0/1811884235 shutdown_connections 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1811884235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6fa3370 0x562fc6fa5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1811884235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9e2e0 0x562fc6fa2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1811884235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 0x562fc6f9dda0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57ab87c740 1 -- 172.21.15.42:0/1811884235 >> 172.21.15.42:0/1811884235 conn(0x562fc6f99010 msgr2=0x562fc6f99410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57ab87c740 1 -- 172.21.15.42:0/1811884235 shutdown_connections 2024-09-19T09:42:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57ab87c740 1 -- 172.21.15.42:0/1811884235 wait complete. 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.518+0000 7f57ab87c740 1 -- start start 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57ab87c740 1 Processor -- start 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 0x562fc6fa7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6f9e2e0 0x562fc6fa8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6fa3370 0x562fc6faf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57ab87c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562fc6fa6340 con 0x562fc6fa3370 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57ab87c740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562fc6e8a290 con 0x562fc6f9e2e0 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57ab87c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562fc6fa64c0 con 0x562fc6f9d9a0 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57ab87c740 10 client.0 _ll_register_callbacks cb 0x562fc6ebb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6fa3370 0x562fc6faf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6fa3370 0x562fc6faf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47610/0 (socket says 172.21.15.42:47610) 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1360740916 learned_addr learned my addr 172.21.15.42:0/1360740916 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a1d9b640 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6f9e2e0 0x562fc6fa8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 0x562fc6fa7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1360740916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 msgr2=0x562fc6fa7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 0x562fc6fa7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1360740916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6f9e2e0 msgr2=0x562fc6fa8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6f9e2e0 0x562fc6fa8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1360740916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fc6c14210 con 0x562fc6fa3370 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6fa3370 0x562fc6faf0b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x562fc6fa7060 tx=0x7f579c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b242cb53b8ec66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.519+0000 7f5789ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f5789ffb640 1 -- 172.21.15.42:0/1360740916 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c02d060 con 0x562fc6fa3370 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f57ab87c740 1 -- 172.21.15.42:0/1360740916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f579c004050 con 0x562fc6fa3370 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f5789ffb640 1 -- 172.21.15.42:0/1360740916 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f579c00f4e0 con 0x562fc6fa3370 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f5789ffb640 1 -- 172.21.15.42:0/1360740916 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f579c00f6e0 con 0x562fc6fa3370 2024-09-19T09:42:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f57ab87c740 10 client.16548 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f57ab87c740 1 -- 172.21.15.42:0/1360740916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562fc6ce0620 con 0x562fc6fa3370 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f5789ffb640 1 -- 172.21.15.42:0/1360740916 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f579c004050 con 0x562fc6fa3370 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f5789ffb640 1 -- 172.21.15.42:0/1360740916 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7f579c025040 con 0x562fc6fa3370 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f57ab87c740 10 client.16548 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f57ab87c740 10 client.16548 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f57ab87c740 20 client.16548 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562fc6fb3510 0x562fc6fb5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f57ab87c740 4 client.16548 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f57ab87c740 1 -- 172.21.15.42:0/1360740916 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fc6f0ea20 con 0x562fc6fb3510 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.520+0000 7f57a1d9b640 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562fc6fb3510 0x562fc6fb5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.521+0000 7f5789ffb640 10 client.16548 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.521+0000 7f57a1d9b640 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562fc6fb3510 0x562fc6fb5940 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20e2124630b3bf43 server_cookie=6c750bf8bef756d3 in_seq=0 out_seq=0 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.521+0000 7f5789ffb640 1 -- 172.21.15.42:0/1360740916 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fc6f0ea20 con 0x562fc6fb3510 2024-09-19T09:42:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.521+0000 7f5789ffb640 10 client.16548 handle_command_reply: tid=0 2024-09-19T09:42:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 client.16548 shutdown 2024-09-19T09:42:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 -- 172.21.15.42:0/1360740916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6fa3370 msgr2=0x562fc6faf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6fa3370 0x562fc6faf0b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x562fc6fa7060 tx=0x7f579c000f40 comp rx=0 tx=0).stop 2024-09-19T09:42:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 -- 172.21.15.42:0/1360740916 shutdown_connections 2024-09-19T09:42:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562fc6fb3510 0x562fc6fb5940 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6fa3370 0x562fc6faf0b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6f9e2e0 0x562fc6fa8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1360740916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9d9a0 0x562fc6fa7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 -- 172.21.15.42:0/1360740916 >> 172.21.15.42:0/1360740916 conn(0x562fc6f99010 msgr2=0x562fc6f9a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f5789ffb640 0 client.16548 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 -- 172.21.15.42:0/1360740916 shutdown_connections 2024-09-19T09:42:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 1 -- 172.21.15.42:0/1360740916 wait complete. 2024-09-19T09:42:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.522+0000 7f57ab87c740 20 client.16548 trim_cache size 0 max 16384 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57ab87c740 1 Processor -- start 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57ab87c740 1 -- start start 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6f993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9e2e0 0x562fc6faefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6fa3370 0x562fc6f99930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57ab87c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41a6ec0 con 0x562fc6f9d9a0 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57ab87c740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41a8c70 con 0x562fc6fa3370 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57ab87c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41a7650 con 0x562fc6f9e2e0 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57a2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6f993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57a2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6f993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47622/0 (socket says 172.21.15.42:47622) 2024-09-19T09:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1079194977 learned_addr learned my addr 172.21.15.42:0/1079194977 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57a1d9b640 1 --2- 172.21.15.42:0/1079194977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9e2e0 0x562fc6faefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.537+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1079194977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6fa3370 0x562fc6f99930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1079194977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9e2e0 msgr2=0x562fc6faefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1079194977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9e2e0 0x562fc6faefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1079194977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6fa3370 msgr2=0x562fc6f99930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1079194977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6fa3370 0x562fc6f99930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1079194977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fc6f98e30 con 0x562fc6f9d9a0 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57a1d9b640 1 --2- 172.21.15.42:0/1079194977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9e2e0 0x562fc6faefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1079194977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6f993f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f579c0289c0 tx=0x7f579c004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fb1d076e729b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f578bfff640 1 -- 172.21.15.42:0/1079194977 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c037040 con 0x562fc6f9d9a0 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f578bfff640 1 -- 172.21.15.42:0/1079194977 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f579c038040 con 0x562fc6f9d9a0 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f578bfff640 1 -- 172.21.15.42:0/1079194977 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c02d040 con 0x562fc6f9d9a0 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57ab87c740 1 -- 172.21.15.42:0/1079194977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 msgr2=0x562fc6f993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1079194977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6f993f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f579c0289c0 tx=0x7f579c004c50 comp rx=0 tx=0).stop 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57ab87c740 1 -- 172.21.15.42:0/1079194977 shutdown_connections 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1079194977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6fa3370 0x562fc6f99930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1079194977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6f9e2e0 0x562fc6faefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1079194977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6f993f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.538+0000 7f57ab87c740 1 -- 172.21.15.42:0/1079194977 >> 172.21.15.42:0/1079194977 conn(0x562fc6f99010 msgr2=0x562fc6f9f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 1 -- 172.21.15.42:0/1079194977 shutdown_connections 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 1 -- 172.21.15.42:0/1079194977 wait complete. 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 1 -- start start 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 1 Processor -- start 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6faef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6f9e2e0 0x562fc6faba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6fa3370 0x562fc6fabfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41a8540 con 0x562fc6f9d9a0 2024-09-19T09:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41a7de0 con 0x562fc6f9e2e0 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41a4ea0 con 0x562fc6fa3370 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57ab87c740 10 client.0 _ll_register_callbacks cb 0x7f57940daa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57a2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6faef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57a2d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6faef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47630/0 (socket says 172.21.15.42:47630) 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1184855101 learned_addr learned my addr 172.21.15.42:0/1184855101 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57a1d9b640 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6f9e2e0 0x562fc6faba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.539+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6fa3370 0x562fc6fabfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1184855101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6fa3370 msgr2=0x562fc6fabfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6fa3370 0x562fc6fabfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1184855101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6f9e2e0 msgr2=0x562fc6faba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6f9e2e0 0x562fc6faba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57a2d9d640 1 -- 172.21.15.42:0/1184855101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fc701c210 con 0x562fc6f9d9a0 2024-09-19T09:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57a2d9d640 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6faef10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f579c009560 tx=0x7f579c004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de656ae5af080d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f5789ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f5789ffb640 1 -- 172.21.15.42:0/1184855101 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c045020 con 0x562fc6f9d9a0 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57ab87c740 1 -- 172.21.15.42:0/1184855101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f579c038040 con 0x562fc6f9d9a0 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f5789ffb640 1 -- 172.21.15.42:0/1184855101 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f579c0045e0 con 0x562fc6f9d9a0 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f5789ffb640 1 -- 172.21.15.42:0/1184855101 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f579c037070 con 0x562fc6f9d9a0 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57ab87c740 10 client.16554 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57ab87c740 1 -- 172.21.15.42:0/1184855101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562fc701d470 con 0x562fc6f9d9a0 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f5789ffb640 1 -- 172.21.15.42:0/1184855101 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f579c038040 con 0x562fc6f9d9a0 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f5789ffb640 1 -- 172.21.15.42:0/1184855101 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7f579c033530 con 0x562fc6f9d9a0 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57ab87c740 10 client.16554 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57ab87c740 10 client.16554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.540+0000 7f57ab87c740 20 client.16554 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.541+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562fc701dd80 0x562fc70201a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.541+0000 7f57ab87c740 4 client.16554 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:42:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.541+0000 7f57ab87c740 1 -- 172.21.15.42:0/1184855101 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562fc6f08d70 con 0x562fc701dd80 2024-09-19T09:42:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.541+0000 7f57a1d9b640 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562fc701dd80 0x562fc70201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.541+0000 7f5789ffb640 10 client.16554 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.541+0000 7f57a1d9b640 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562fc701dd80 0x562fc70201a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36cb5b346674f62e server_cookie=95a4368749617eb5 in_seq=0 out_seq=0 2024-09-19T09:42:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f5789ffb640 1 -- 172.21.15.42:0/1184855101 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562fc6f08d70 con 0x562fc701dd80 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f5789ffb640 10 client.16554 handle_command_reply: tid=0 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f57ab87c740 1 client.16554 shutdown 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f57ab87c740 1 -- 172.21.15.42:0/1184855101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 msgr2=0x562fc6faef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6faef10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f579c009560 tx=0x7f579c004bc0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f57ab87c740 1 -- 172.21.15.42:0/1184855101 shutdown_connections 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x562fc701dd80 0x562fc70201a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562fc6fa3370 0x562fc6fabfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562fc6f9e2e0 0x562fc6faba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f5789ffb640 0 client.16554 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f57ab87c740 1 --2- 172.21.15.42:0/1184855101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc6f9d9a0 0x562fc6faef10 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.551+0000 7f57ab87c740 1 -- 172.21.15.42:0/1184855101 >> 172.21.15.42:0/1184855101 conn(0x562fc6f99010 msgr2=0x562fc6f979a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57ab87c740 1 -- 172.21.15.42:0/1184855101 shutdown_connections 2024-09-19T09:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57ab87c740 1 -- 172.21.15.42:0/1184855101 wait complete. 2024-09-19T09:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57ab87c740 20 client.16554 trim_cache size 0 max 16384 2024-09-19T09:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 -- 172.21.15.42:0/2068465774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f578c0a32f0 msgr2=0x7f578c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f578c0a32f0 0x7f578c0a57b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f57940cdbe0 tx=0x7f57940dab30 comp rx=0 tx=0).stop 2024-09-19T09:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 -- 172.21.15.42:0/2068465774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57a4100a40 msgr2=0x7f57a4197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57a4100a40 0x7f57a4197dc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f579400e9c0 tx=0x7f579400ee80 comp rx=0 tx=0).stop 2024-09-19T09:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 -- 172.21.15.42:0/2068465774 shutdown_connections 2024-09-19T09:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f578c0a32f0 0x7f578c0a57b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f57a41025f0 0x7f57a419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57a4101c30 0x7f57a4198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 --2- 172.21.15.42:0/2068465774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57a4100a40 0x7f57a4197dc0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 -- 172.21.15.42:0/2068465774 >> 172.21.15.42:0/2068465774 conn(0x7f57a40fc1e0 msgr2=0x7f57a40fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 -- 172.21.15.42:0/2068465774 shutdown_connections 2024-09-19T09:42:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:11.552+0000 7f57a8add640 1 -- 172.21.15.42:0/2068465774 wait complete. 2024-09-19T09:42:12.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:12 smithi136 ceph-mon[34840]: pgmap v423: 97 pgs: 97 active+clean; 159 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 418 op/s 2024-09-19T09:42:12.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:12 smithi042 ceph-mon[31223]: pgmap v423: 97 pgs: 97 active+clean; 159 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 418 op/s 2024-09-19T09:42:12.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:12 smithi171 ceph-mon[35803]: pgmap v423: 97 pgs: 97 active+clean; 159 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 418 op/s 2024-09-19T09:42:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:14 smithi136 ceph-mon[34840]: pgmap v424: 97 pgs: 97 active+clean; 154 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 400 op/s 2024-09-19T09:42:14.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:14 smithi042 ceph-mon[31223]: pgmap v424: 97 pgs: 97 active+clean; 154 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 400 op/s 2024-09-19T09:42:14.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:14 smithi171 ceph-mon[35803]: pgmap v424: 97 pgs: 97 active+clean; 154 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 400 op/s 2024-09-19T09:42:16.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:16 smithi136 ceph-mon[34840]: pgmap v425: 97 pgs: 97 active+clean; 148 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 403 op/s 2024-09-19T09:42:16.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:16 smithi042 ceph-mon[31223]: pgmap v425: 97 pgs: 97 active+clean; 148 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 403 op/s 2024-09-19T09:42:16.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:16 smithi171 ceph-mon[35803]: pgmap v425: 97 pgs: 97 active+clean; 148 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 403 op/s 2024-09-19T09:42:18.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:18 smithi136 ceph-mon[34840]: pgmap v426: 97 pgs: 97 active+clean; 144 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 444 op/s 2024-09-19T09:42:18.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:18 smithi042 ceph-mon[31223]: pgmap v426: 97 pgs: 97 active+clean; 144 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 444 op/s 2024-09-19T09:42:18.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:18 smithi171 ceph-mon[35803]: pgmap v426: 97 pgs: 97 active+clean; 144 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 444 op/s 2024-09-19T09:42:20.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:20 smithi136 ceph-mon[34840]: pgmap v427: 97 pgs: 97 active+clean; 148 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 408 op/s 2024-09-19T09:42:20.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:20 smithi042 ceph-mon[31223]: pgmap v427: 97 pgs: 97 active+clean; 148 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 408 op/s 2024-09-19T09:42:20.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:20 smithi171 ceph-mon[35803]: pgmap v427: 97 pgs: 97 active+clean; 148 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 408 op/s 2024-09-19T09:42:21.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:21.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:21.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:42:21.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:42:21.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:21.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:21.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:42:21.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:42:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:42:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:42:22.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:22 smithi042 ceph-mon[31223]: pgmap v428: 97 pgs: 97 active+clean; 146 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 451 op/s 2024-09-19T09:42:22.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:22 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:42:22.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:22 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:42:22.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:22 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:42:22.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:22 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:42:22.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:22 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:42:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:22 smithi171 ceph-mon[35803]: pgmap v428: 97 pgs: 97 active+clean; 146 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 451 op/s 2024-09-19T09:42:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:22 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:42:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:22 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:42:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:22 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:42:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:22 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:42:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:22 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:42:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:22 smithi136 ceph-mon[34840]: pgmap v428: 97 pgs: 97 active+clean; 146 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 451 op/s 2024-09-19T09:42:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:22 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:42:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:22 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:42:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:22 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:42:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:22 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:42:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:22 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:42:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.642+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1484845141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30a0101c50 msgr2=0x7f30a01020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.642+0000 7f30a4ff6640 1 --2- 172.21.15.42:0/1484845141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30a0101c50 0x7f30a01020d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3094009900 tx=0x7f309402a410 comp rx=0 tx=0).stop 2024-09-19T09:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.642+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1484845141 shutdown_connections 2024-09-19T09:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.642+0000 7f30a4ff6640 1 --2- 172.21.15.42:0/1484845141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a0102610 0x7f30a0108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.642+0000 7f30a4ff6640 1 --2- 172.21.15.42:0/1484845141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30a0101c50 0x7f30a01020d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.642+0000 7f30a4ff6640 1 --2- 172.21.15.42:0/1484845141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a0100a60 0x7f30a0100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.642+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1484845141 >> 172.21.15.42:0/1484845141 conn(0x7f30a00fc1e0 msgr2=0x7f30a00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.642+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1484845141 shutdown_connections 2024-09-19T09:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.642+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1484845141 wait complete. 2024-09-19T09:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f30a4ff6640 1 Processor -- start 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f30a4ff6640 1 -- start start 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f30a4ff6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a0100a60 0x7f30a0197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f30a4ff6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30a0101c50 0x7f30a0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f30a4ff6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a0102610 0x7f30a019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f30a4ff6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f30a010d890 con 0x7f30a0101c50 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f30a4ff6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f30a010d710 con 0x7f30a0102610 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f30a4ff6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30a010da10 con 0x7f30a0100a60 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f309dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30a0101c50 0x7f30a0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f309dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30a0101c50 0x7f30a0198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42240/0 (socket says 172.21.15.42:42240) 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f309dd9b640 1 -- 172.21.15.42:0/1329252272 learned_addr learned my addr 172.21.15.42:0/1329252272 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f309ed9d640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a0102610 0x7f30a019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.643+0000 7f309e59c640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a0100a60 0x7f30a0197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f309ed9d640 1 -- 172.21.15.42:0/1329252272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a0100a60 msgr2=0x7f30a0197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f309ed9d640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a0100a60 0x7f30a0197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f309ed9d640 1 -- 172.21.15.42:0/1329252272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30a0101c50 msgr2=0x7f30a0198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f309ed9d640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30a0101c50 0x7f30a0198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f309ed9d640 1 -- 172.21.15.42:0/1329252272 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a019f9e0 con 0x7f30a0102610 2024-09-19T09:42:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f309dd9b640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30a0101c50 0x7f30a0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f309ed9d640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a0102610 0x7f30a019f370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f309800e940 tx=0x7f309800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f308f7fe640 1 -- 172.21.15.42:0/1329252272 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098004d20 con 0x7f30a0102610 2024-09-19T09:42:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1329252272 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a019fcd0 con 0x7f30a0102610 2024-09-19T09:42:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f308f7fe640 1 -- 172.21.15.42:0/1329252272 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3098005020 con 0x7f30a0102610 2024-09-19T09:42:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f308f7fe640 1 -- 172.21.15.42:0/1329252272 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30980116d0 con 0x7f30a0102610 2024-09-19T09:42:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.644+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1329252272 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a01a0210 con 0x7f30a0102610 2024-09-19T09:42:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.647+0000 7f30a7e6b740 1 Processor -- start 2024-09-19T09:42:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.647+0000 7f308f7fe640 1 -- 172.21.15.42:0/1329252272 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f30980054d0 con 0x7f30a0102610 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f30a7e6b740 1 -- start start 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 0x555fa33ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 0x555fa33cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555fa332b2f0 con 0x555fa33cd370 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555fa32d3270 con 0x555fa33c79a0 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x555fa33272b0 con 0x555fa33c82e0 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f309dd9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f309e59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 0x555fa33ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f309dd9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:48406/0 (socket says 172.21.15.42:48406) 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f309dd9b640 1 -- 172.21.15.42:0/370816680 learned_addr learned my addr 172.21.15.42:0/370816680 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f309dd9b640 1 --2- 172.21.15.42:0/370816680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 0x555fa33cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f309e59c640 1 -- 172.21.15.42:0/370816680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 msgr2=0x555fa33c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f309e59c640 1 --2- 172.21.15.42:0/370816680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f309e59c640 1 -- 172.21.15.42:0/370816680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 msgr2=0x555fa33cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f309e59c640 1 --2- 172.21.15.42:0/370816680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 0x555fa33cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f309e59c640 1 -- 172.21.15.42:0/370816680 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fa32d2340 con 0x555fa33c82e0 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.648+0000 7f308f7fe640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f30880a32f0 0x7f30880a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.649+0000 7f309dd9b640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f30880a32f0 0x7f30880a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.649+0000 7f309e59c640 1 --2- 172.21.15.42:0/370816680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 0x555fa33ccda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3090009bf0 tx=0x7f3090011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab485d7e0ac53d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.649+0000 7f308f7fe640 1 -- 172.21.15.42:0/1329252272 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f30980cfd60 con 0x7f30a0102610 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.649+0000 7f308cff9640 1 -- 172.21.15.42:0/370816680 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090004030 con 0x555fa33c82e0 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.649+0000 7f308cff9640 1 -- 172.21.15.42:0/370816680 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3090005500 con 0x555fa33c82e0 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.649+0000 7f308cff9640 1 -- 172.21.15.42:0/370816680 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090004e40 con 0x555fa33c82e0 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 -- 172.21.15.42:0/370816680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 msgr2=0x555fa33ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/370816680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 0x555fa33ccda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3090009bf0 tx=0x7f3090011810 comp rx=0 tx=0).stop 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f309dd9b640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f30880a32f0 0x7f30880a57b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3094005e00 tx=0x7f30940315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 -- 172.21.15.42:0/370816680 shutdown_connections 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/370816680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 0x555fa33cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/370816680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 0x555fa33ccda0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/370816680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 -- 172.21.15.42:0/370816680 >> 172.21.15.42:0/370816680 conn(0x555fa33c3010 msgr2=0x555fa33c3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 -- 172.21.15.42:0/370816680 shutdown_connections 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 -- 172.21.15.42:0/370816680 wait complete. 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 -- start start 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 Processor -- start 2024-09-19T09:42:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c82e0 0x555fa33d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33cd370 0x555fa33d90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555fa33d0340 con 0x555fa33c82e0 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555fa32b4290 con 0x555fa33c79a0 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.650+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x555fa33d04c0 con 0x555fa33cd370 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f30a7e6b740 10 client.0 _ll_register_callbacks cb 0x555fa32e5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c82e0 0x555fa33d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309e59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c82e0 0x555fa33d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42254/0 (socket says 172.21.15.42:42254) 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309e59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33d1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:48416/0 (socket says 172.21.15.42:48416) 2024-09-19T09:42:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309dd9b640 1 -- 172.21.15.42:0/978139919 learned_addr learned my addr 172.21.15.42:0/978139919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309ed9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33cd370 0x555fa33d90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309dd9b640 1 -- 172.21.15.42:0/978139919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33cd370 msgr2=0x555fa33d90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309dd9b640 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33cd370 0x555fa33d90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309dd9b640 1 -- 172.21.15.42:0/978139919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 msgr2=0x555fa33d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309dd9b640 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33d1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309dd9b640 1 -- 172.21.15.42:0/978139919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fa303e210 con 0x555fa33c82e0 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f309dd9b640 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c82e0 0x555fa33d2070 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3094000c00 tx=0x7f309402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bef95a7acd8a60f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f3085ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f3085ffb640 1 -- 172.21.15.42:0/978139919 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094003970 con 0x555fa33c82e0 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f3085ffb640 1 -- 172.21.15.42:0/978139919 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3094003b10 con 0x555fa33c82e0 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.651+0000 7f30a7e6b740 1 -- 172.21.15.42:0/978139919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3090005500 con 0x555fa33c82e0 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f3085ffb640 1 -- 172.21.15.42:0/978139919 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3094003d10 con 0x555fa33c82e0 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f30a7e6b740 10 client.16566 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f30a7e6b740 1 -- 172.21.15.42:0/978139919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x555fa310a620 con 0x555fa33c82e0 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f3085ffb640 1 -- 172.21.15.42:0/978139919 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3090005500 con 0x555fa33c82e0 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f3085ffb640 1 -- 172.21.15.42:0/978139919 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7f30940544c0 con 0x555fa33c82e0 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f30a7e6b740 10 client.16566 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f30a7e6b740 10 client.16566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f30a7e6b740 20 client.16566 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555fa33dd7c0 0x555fa33dfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f30a7e6b740 4 client.16566 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.652+0000 7f30a7e6b740 1 -- 172.21.15.42:0/978139919 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fa3338a20 con 0x555fa33dd7c0 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.653+0000 7f309e59c640 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555fa33dd7c0 0x555fa33dfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.653+0000 7f3085ffb640 10 client.16566 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.653+0000 7f309e59c640 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555fa33dd7c0 0x555fa33dfc60 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42a774a47518ee5f server_cookie=fb46838cb7b701a4 in_seq=0 out_seq=0 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f3085ffb640 1 -- 172.21.15.42:0/978139919 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555fa3338a20 con 0x555fa33dd7c0 2024-09-19T09:42:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f3085ffb640 10 client.16566 handle_command_reply: tid=0 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 client.16566 shutdown 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 -- 172.21.15.42:0/978139919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c82e0 msgr2=0x555fa33d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c82e0 0x555fa33d2070 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3094000c00 tx=0x7f309402a410 comp rx=0 tx=0).stop 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 -- 172.21.15.42:0/978139919 shutdown_connections 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555fa33dd7c0 0x555fa33dfc60 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33cd370 0x555fa33d90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f3085ffb640 0 client.16566 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c82e0 0x555fa33d2070 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/978139919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33d1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 -- 172.21.15.42:0/978139919 >> 172.21.15.42:0/978139919 conn(0x555fa33c3010 msgr2=0x555fa33c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 -- 172.21.15.42:0/978139919 shutdown_connections 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 1 -- 172.21.15.42:0/978139919 wait complete. 2024-09-19T09:42:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.654+0000 7f30a7e6b740 20 client.16566 trim_cache size 0 max 16384 2024-09-19T09:42:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.668+0000 7f30a7e6b740 1 Processor -- start 2024-09-19T09:42:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f30a7e6b740 1 -- start start 2024-09-19T09:42:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c79a0 0x555fa33c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c82e0 0x555fa33d9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33cd370 0x555fa33c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01a90d0 con 0x555fa33c79a0 2024-09-19T09:42:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01aae80 con 0x555fa33c82e0 2024-09-19T09:42:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01a9860 con 0x555fa33cd370 2024-09-19T09:42:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c79a0 0x555fa33c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c79a0 0x555fa33c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42256/0 (socket says 172.21.15.42:42256) 2024-09-19T09:42:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309e59c640 1 -- 172.21.15.42:0/2344548520 learned_addr learned my addr 172.21.15.42:0/2344548520 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309dd9b640 1 --2- 172.21.15.42:0/2344548520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c82e0 0x555fa33d9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309ed9d640 1 --2- 172.21.15.42:0/2344548520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33cd370 0x555fa33c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309e59c640 1 -- 172.21.15.42:0/2344548520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33cd370 msgr2=0x555fa33c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309e59c640 1 --2- 172.21.15.42:0/2344548520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33cd370 0x555fa33c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309e59c640 1 -- 172.21.15.42:0/2344548520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c82e0 msgr2=0x555fa33d9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309e59c640 1 --2- 172.21.15.42:0/2344548520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c82e0 0x555fa33d9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309e59c640 1 -- 172.21.15.42:0/2344548520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fa33c2e30 con 0x555fa33c79a0 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309dd9b640 1 --2- 172.21.15.42:0/2344548520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c82e0 0x555fa33d9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f309e59c640 1 --2- 172.21.15.42:0/2344548520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c79a0 0x555fa33c3ec0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f30900099b0 tx=0x7f3090004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea4b0f6222bb907 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f3087fff640 1 -- 172.21.15.42:0/2344548520 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090032070 con 0x555fa33c79a0 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f3087fff640 1 -- 172.21.15.42:0/2344548520 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f309002a070 con 0x555fa33c79a0 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.669+0000 7f3087fff640 1 -- 172.21.15.42:0/2344548520 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309001e040 con 0x555fa33c79a0 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.670+0000 7f30a7e6b740 1 -- 172.21.15.42:0/2344548520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c79a0 msgr2=0x555fa33c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.670+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/2344548520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c79a0 0x555fa33c3ec0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f30900099b0 tx=0x7f3090004570 comp rx=0 tx=0).stop 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.670+0000 7f30a7e6b740 1 -- 172.21.15.42:0/2344548520 shutdown_connections 2024-09-19T09:42:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.670+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/2344548520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33cd370 0x555fa33c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.670+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/2344548520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c82e0 0x555fa33d9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.670+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/2344548520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33c79a0 0x555fa33c3ec0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.670+0000 7f30a7e6b740 1 -- 172.21.15.42:0/2344548520 >> 172.21.15.42:0/2344548520 conn(0x555fa33c3010 msgr2=0x555fa33d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.670+0000 7f30a7e6b740 1 -- 172.21.15.42:0/2344548520 shutdown_connections 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.670+0000 7f30a7e6b740 1 -- 172.21.15.42:0/2344548520 wait complete. 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.670+0000 7f30a7e6b740 1 -- start start 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f30a7e6b740 1 Processor -- start 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33d6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 0x555fa33d7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f30a7e6b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 0x555fa33d8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01aa750 con 0x555fa33cd370 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01a9ff0 con 0x555fa33c79a0 2024-09-19T09:42:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f30a7e6b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01a70b0 con 0x555fa33c82e0 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f30a7e6b740 10 client.0 _ll_register_callbacks cb 0x7f3094032880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 0x555fa33d8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309e59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33d6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 0x555fa33d8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42270/0 (socket says 172.21.15.42:42270) 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309ed9d640 1 -- 172.21.15.42:0/3413795359 learned_addr learned my addr 172.21.15.42:0/3413795359 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309dd9b640 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 0x555fa33d7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309ed9d640 1 -- 172.21.15.42:0/3413795359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 msgr2=0x555fa33d7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309ed9d640 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 0x555fa33d7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309ed9d640 1 -- 172.21.15.42:0/3413795359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 msgr2=0x555fa33d6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309ed9d640 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33d6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309ed9d640 1 -- 172.21.15.42:0/3413795359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fa33d8740 con 0x555fa33cd370 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309dd9b640 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 0x555fa33d7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.671+0000 7f309e59c640 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33d6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f309ed9d640 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 0x555fa33d8130 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3098005c40 tx=0x7f309801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a348ed51849fdc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f3085ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f3085ffb640 1 -- 172.21.15.42:0/3413795359 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30980b4020 con 0x555fa33cd370 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f3085ffb640 1 -- 172.21.15.42:0/3413795359 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f30980b5220 con 0x555fa33cd370 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f30a7e6b740 1 -- 172.21.15.42:0/3413795359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f309002a070 con 0x555fa33cd370 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f3085ffb640 1 -- 172.21.15.42:0/3413795359 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f309801f040 con 0x555fa33cd370 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f30a7e6b740 10 client.16572 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f30a7e6b740 1 -- 172.21.15.42:0/3413795359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x555fa3448b00 con 0x555fa33cd370 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f3085ffb640 1 -- 172.21.15.42:0/3413795359 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f309002a070 con 0x555fa33cd370 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f3085ffb640 1 -- 172.21.15.42:0/3413795359 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7f309800f040 con 0x555fa33cd370 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f30a7e6b740 10 client.16572 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f30a7e6b740 10 client.16572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f30a7e6b740 20 client.16572 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555fa3449400 0x555fa344b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f30a7e6b740 4 client.16572 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.672+0000 7f30a7e6b740 1 -- 172.21.15.42:0/3413795359 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555fa3332d70 con 0x555fa3449400 2024-09-19T09:42:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.673+0000 7f309e59c640 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555fa3449400 0x555fa344b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.673+0000 7f3085ffb640 10 client.16572 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.673+0000 7f309e59c640 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555fa3449400 0x555fa344b820 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cff7ace0db1281da server_cookie=1ac2e9fdfa14fa86 in_seq=0 out_seq=0 2024-09-19T09:42:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.683+0000 7f3085ffb640 1 -- 172.21.15.42:0/3413795359 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555fa3332d70 con 0x555fa3449400 2024-09-19T09:42:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.683+0000 7f3085ffb640 10 client.16572 handle_command_reply: tid=0 2024-09-19T09:42:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 client.16572 shutdown 2024-09-19T09:42:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 -- 172.21.15.42:0/3413795359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 msgr2=0x555fa33d8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 0x555fa33d8130 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3098005c40 tx=0x7f309801d000 comp rx=0 tx=0).stop 2024-09-19T09:42:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 -- 172.21.15.42:0/3413795359 shutdown_connections 2024-09-19T09:42:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555fa3449400 0x555fa344b820 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555fa33cd370 0x555fa33d8130 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555fa33c82e0 0x555fa33d7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f3085ffb640 0 client.16572 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 --2- 172.21.15.42:0/3413795359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555fa33c79a0 0x555fa33d6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 -- 172.21.15.42:0/3413795359 >> 172.21.15.42:0/3413795359 conn(0x555fa33c3010 msgr2=0x555fa33c19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 -- 172.21.15.42:0/3413795359 shutdown_connections 2024-09-19T09:42:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 1 -- 172.21.15.42:0/3413795359 wait complete. 2024-09-19T09:42:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.684+0000 7f30a7e6b740 20 client.16572 trim_cache size 0 max 16384 2024-09-19T09:42:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:42:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:42:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:42:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:42:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1329252272 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f30880a32f0 msgr2=0x7f30880a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f30880a32f0 0x7f30880a57b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3094005e00 tx=0x7f30940315b0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1329252272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a0102610 msgr2=0x7f30a019f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a0102610 0x7f30a019f370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f309800e940 tx=0x7f309800ee00 comp rx=0 tx=0).stop 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1329252272 shutdown_connections 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f30880a32f0 0x7f30880a57b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30a0102610 0x7f30a019f370 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30a0101c50 0x7f30a0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 --2- 172.21.15.42:0/1329252272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a0100a60 0x7f30a0197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1329252272 >> 172.21.15.42:0/1329252272 conn(0x7f30a00fc1e0 msgr2=0x7f30a0104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1329252272 shutdown_connections 2024-09-19T09:42:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:24.685+0000 7f30a4ff6640 1 -- 172.21.15.42:0/1329252272 wait complete. 2024-09-19T09:42:24.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:24 smithi042 ceph-mon[31223]: pgmap v429: 97 pgs: 97 active+clean; 145 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 384 op/s 2024-09-19T09:42:24.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:24 smithi171 ceph-mon[35803]: pgmap v429: 97 pgs: 97 active+clean; 145 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 384 op/s 2024-09-19T09:42:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:24 smithi136 ceph-mon[34840]: pgmap v429: 97 pgs: 97 active+clean; 145 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 384 op/s 2024-09-19T09:42:25.197 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T09:42:25.198 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:42:25.470 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:25.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.951+0000 7f97b7d5d640 1 -- 172.21.15.42:0/347792159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b0101420 msgr2=0x7f97b010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.951+0000 7f97b7d5d640 1 --2- 172.21.15.42:0/347792159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b0101420 0x7f97b010d950 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009cd0 tx=0x7f97a802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.951+0000 7f97b7d5d640 1 -- 172.21.15.42:0/347792159 shutdown_connections 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.951+0000 7f97b7d5d640 1 --2- 172.21.15.42:0/347792159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b0101420 0x7f97b010d950 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.951+0000 7f97b7d5d640 1 --2- 172.21.15.42:0/347792159 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97b0100a80 0x7f97b0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.951+0000 7f97b7d5d640 1 --2- 172.21.15.42:0/347792159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97b0106a80 0x7f97b0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.951+0000 7f97b7d5d640 1 -- 172.21.15.42:0/347792159 >> 172.21.15.42:0/347792159 conn(0x7f97b00fc7a0 msgr2=0x7f97b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.951+0000 7f97b7d5d640 1 -- 172.21.15.42:0/347792159 shutdown_connections 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.951+0000 7f97b7d5d640 1 -- 172.21.15.42:0/347792159 wait complete. 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.952+0000 7f97b7d5d640 1 Processor -- start 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.952+0000 7f97b7d5d640 1 -- start start 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.952+0000 7f97b7d5d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97b0100a80 0x7f97b019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.952+0000 7f97b7d5d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97b0101420 0x7f97b019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.952+0000 7f97b7d5d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b0106a80 0x7f97b019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.952+0000 7f97b7d5d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f97b0110e80 con 0x7f97b0106a80 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.952+0000 7f97b7d5d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97b0110d00 con 0x7f97b0101420 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.952+0000 7f97b7d5d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f97b0111000 con 0x7f97b0100a80 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b62fa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b0106a80 0x7f97b019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b5af9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97b0100a80 0x7f97b019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b52f8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97b0101420 0x7f97b019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b62fa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b0106a80 0x7f97b019eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42292/0 (socket says 172.21.15.42:42292) 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b62fa640 1 -- 172.21.15.42:0/894151067 learned_addr learned my addr 172.21.15.42:0/894151067 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b62fa640 1 -- 172.21.15.42:0/894151067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97b0100a80 msgr2=0x7f97b019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b62fa640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97b0100a80 0x7f97b019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b62fa640 1 -- 172.21.15.42:0/894151067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97b0101420 msgr2=0x7f97b019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b62fa640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97b0101420 0x7f97b019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b62fa640 1 -- 172.21.15.42:0/894151067 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b019f590 con 0x7f97b0106a80 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b5af9640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97b0100a80 0x7f97b019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b52f8640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97b0101420 0x7f97b019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b62fa640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b0106a80 0x7f97b019eeb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005cc0 tx=0x7f97a80093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97a6ffd640 1 -- 172.21.15.42:0/894151067 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a8003e00 con 0x7f97b0106a80 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97a6ffd640 1 -- 172.21.15.42:0/894151067 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97a8004520 con 0x7f97b0106a80 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97b7d5d640 1 -- 172.21.15.42:0/894151067 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b019f820 con 0x7f97b0106a80 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.953+0000 7f97a6ffd640 1 -- 172.21.15.42:0/894151067 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a8030db0 con 0x7f97b0106a80 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.954+0000 7f97b7d5d640 1 -- 172.21.15.42:0/894151067 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b01a7160 con 0x7f97b0106a80 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.955+0000 7f97b7d5d640 1 -- 172.21.15.42:0/894151067 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b0100ee0 con 0x7f97b0106a80 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.956+0000 7f97a6ffd640 1 -- 172.21.15.42:0/894151067 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f97a80046d0 con 0x7f97b0106a80 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.956+0000 7f97a6ffd640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f979c0a32c0 0x7f979c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.956+0000 7f97a6ffd640 1 -- 172.21.15.42:0/894151067 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f97a80f0aa0 con 0x7f97b0106a80 2024-09-19T09:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.956+0000 7f97b5af9640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f979c0a32c0 0x7f979c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.957+0000 7f97b5af9640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f979c0a32c0 0x7f979c0a5780 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009f40 tx=0x7f97ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:25.961+0000 7f97a6ffd640 1 -- 172.21.15.42:0/894151067 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f97a80bd7a0 con 0x7f97b0106a80 2024-09-19T09:42:26.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.177+0000 7f97b7d5d640 1 -- 172.21.15.42:0/894151067 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97b01a7390 con 0x7f97b0106a80 2024-09-19T09:42:26.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.178+0000 7f97a6ffd640 1 -- 172.21.15.42:0/894151067 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+12008 (secure 0 0 0) 0x7f97a80098b0 con 0x7f97b0106a80 2024-09-19T09:42:26.180 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:42:26.180 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":37,"btime":"2024-09-19T09:42:02:340689+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:42:01.428443+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:42:26.180 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 37 2024-09-19T09:42:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 -- 172.21.15.42:0/894151067 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f979c0a32c0 msgr2=0x7f979c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f979c0a32c0 0x7f979c0a5780 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009f40 tx=0x7f97ac005f90 comp rx=0 tx=0).stop 2024-09-19T09:42:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 -- 172.21.15.42:0/894151067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b0106a80 msgr2=0x7f97b019eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b0106a80 0x7f97b019eeb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005cc0 tx=0x7f97a80093d0 comp rx=0 tx=0).stop 2024-09-19T09:42:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 -- 172.21.15.42:0/894151067 shutdown_connections 2024-09-19T09:42:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f979c0a32c0 0x7f979c0a5780 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97b0106a80 0x7f97b019eeb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97b0101420 0x7f97b019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 --2- 172.21.15.42:0/894151067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97b0100a80 0x7f97b019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:26.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 -- 172.21.15.42:0/894151067 >> 172.21.15.42:0/894151067 conn(0x7f97b00fc7a0 msgr2=0x7f97b006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:26.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 -- 172.21.15.42:0/894151067 shutdown_connections 2024-09-19T09:42:26.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:26.180+0000 7f97b7d5d640 1 -- 172.21.15.42:0/894151067 wait complete. 2024-09-19T09:42:26.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:26 smithi042 ceph-mon[31223]: pgmap v430: 97 pgs: 97 active+clean; 144 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 395 op/s 2024-09-19T09:42:26.454 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:26 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/894151067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:26.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:26 smithi171 ceph-mon[35803]: pgmap v430: 97 pgs: 97 active+clean; 144 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 395 op/s 2024-09-19T09:42:26.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:26 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/894151067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:26.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:26 smithi136 ceph-mon[34840]: pgmap v430: 97 pgs: 97 active+clean; 144 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 395 op/s 2024-09-19T09:42:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:26 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/894151067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:26.927 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T09:42:26.927 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T09:42:27.202 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:27.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.685+0000 7fa971b5f640 1 -- 172.21.15.42:0/2252083190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa96c102570 msgr2=0x7fa96c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.685+0000 7fa971b5f640 1 --2- 172.21.15.42:0/2252083190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa96c102570 0x7fa96c1029b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa954009900 tx=0x7fa95402a480 comp rx=0 tx=0).stop 2024-09-19T09:42:27.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.686+0000 7fa971b5f640 1 -- 172.21.15.42:0/2252083190 shutdown_connections 2024-09-19T09:42:27.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.686+0000 7fa971b5f640 1 --2- 172.21.15.42:0/2252083190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa96c102ef0 0x7fa96c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.686+0000 7fa971b5f640 1 --2- 172.21.15.42:0/2252083190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa96c102570 0x7fa96c1029b0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.686+0000 7fa971b5f640 1 --2- 172.21.15.42:0/2252083190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c100e20 0x7fa96c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.686+0000 7fa971b5f640 1 -- 172.21.15.42:0/2252083190 >> 172.21.15.42:0/2252083190 conn(0x7fa96c0fc7d0 msgr2=0x7fa96c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.686+0000 7fa971b5f640 1 -- 172.21.15.42:0/2252083190 shutdown_connections 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.686+0000 7fa971b5f640 1 -- 172.21.15.42:0/2252083190 wait complete. 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.686+0000 7fa971b5f640 1 Processor -- start 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.686+0000 7fa971b5f640 1 -- start start 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa971b5f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c100e20 0x7fa96c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa971b5f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa96c102570 0x7fa96c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa971b5f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa96c102ef0 0x7fa96c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa971b5f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c110f80 con 0x7fa96c102570 2024-09-19T09:42:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa971b5f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c110e00 con 0x7fa96c102ef0 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa971b5f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c111100 con 0x7fa96c100e20 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa962ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa96c102570 0x7fa96c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa962ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa96c102570 0x7fa96c198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42304/0 (socket says 172.21.15.42:42304) 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa962ffd640 1 -- 172.21.15.42:0/2643580352 learned_addr learned my addr 172.21.15.42:0/2643580352 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c100e20 0x7fa96c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa96bfff640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa96c102ef0 0x7fa96c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa962ffd640 1 -- 172.21.15.42:0/2643580352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c100e20 msgr2=0x7fa96c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa962ffd640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c100e20 0x7fa96c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa962ffd640 1 -- 172.21.15.42:0/2643580352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa96c102ef0 msgr2=0x7fa96c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa962ffd640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa96c102ef0 0x7fa96c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa962ffd640 1 -- 172.21.15.42:0/2643580352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c19d490 con 0x7fa96c102570 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c100e20 0x7fa96c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa962ffd640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa96c102570 0x7fa96c198a20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa954006010 tx=0x7fa954003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.687+0000 7fa9697fa640 1 -- 172.21.15.42:0/2643580352 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95403f070 con 0x7fa96c102570 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.688+0000 7fa9697fa640 1 -- 172.21.15.42:0/2643580352 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa954031c30 con 0x7fa96c102570 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.688+0000 7fa971b5f640 1 -- 172.21.15.42:0/2643580352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c19d720 con 0x7fa96c102570 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.688+0000 7fa9697fa640 1 -- 172.21.15.42:0/2643580352 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa954035030 con 0x7fa96c102570 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.688+0000 7fa971b5f640 1 -- 172.21.15.42:0/2643580352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96c1a5060 con 0x7fa96c102570 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.690+0000 7fa9697fa640 1 -- 172.21.15.42:0/2643580352 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa954042070 con 0x7fa96c102570 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.690+0000 7fa973f38740 1 Processor -- start 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.690+0000 7fa973f38740 1 -- start start 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa973f38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d770fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa973f38740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d7710080 0x5597d771a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa973f38740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 0x5597d771cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa973f38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5597d76752a0 con 0x5597d770f760 2024-09-19T09:42:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa973f38740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5597d761cb10 con 0x5597d771a940 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa973f38740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5597d7671260 con 0x5597d7710080 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d770fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d770fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42314/0 (socket says 172.21.15.42:42314) 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96bfff640 1 -- 172.21.15.42:0/1231445457 learned_addr learned my addr 172.21.15.42:0/1231445457 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa962ffd640 1 --2- 172.21.15.42:0/1231445457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 0x5597d771cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/1231445457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d7710080 0x5597d771a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa9697fa640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa9580a3240 0x7fa9580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96bfff640 1 -- 172.21.15.42:0/1231445457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d7710080 msgr2=0x5597d771a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96bfff640 1 --2- 172.21.15.42:0/1231445457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d7710080 0x5597d771a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96bfff640 1 -- 172.21.15.42:0/1231445457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 msgr2=0x5597d771cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96bfff640 1 --2- 172.21.15.42:0/1231445457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 0x5597d771cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96bfff640 1 -- 172.21.15.42:0/1231445457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d73e6b90 con 0x5597d770f760 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa9697fa640 1 -- 172.21.15.42:0/2643580352 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa9540eff90 con 0x7fa96c102570 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96bfff640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa9580a3240 0x7fa9580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.691+0000 7fa96bfff640 1 --2- 172.21.15.42:0/1231445457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d770fb40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa964003b10 tx=0x7fa964009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5f012cd111c35b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa961ffb640 1 -- 172.21.15.42:0/1231445457 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964024070 con 0x5597d770f760 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa961ffb640 1 -- 172.21.15.42:0/1231445457 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa964010ce0 con 0x5597d770f760 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa961ffb640 1 -- 172.21.15.42:0/1231445457 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96401ee40 con 0x5597d770f760 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa96bfff640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa9580a3240 0x7fa9580a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa964021000 tx=0x7fa96401e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa973f38740 1 -- 172.21.15.42:0/1231445457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 msgr2=0x5597d770fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa973f38740 1 --2- 172.21.15.42:0/1231445457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d770fb40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa964003b10 tx=0x7fa964009f90 comp rx=0 tx=0).stop 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa973f38740 1 -- 172.21.15.42:0/1231445457 shutdown_connections 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa973f38740 1 --2- 172.21.15.42:0/1231445457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 0x5597d771cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa973f38740 1 --2- 172.21.15.42:0/1231445457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d7710080 0x5597d771a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa973f38740 1 --2- 172.21.15.42:0/1231445457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d770fb40 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa973f38740 1 -- 172.21.15.42:0/1231445457 >> 172.21.15.42:0/1231445457 conn(0x5597d770bcf0 msgr2=0x5597d770c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa973f38740 1 -- 172.21.15.42:0/1231445457 shutdown_connections 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.692+0000 7fa973f38740 1 -- 172.21.15.42:0/1231445457 wait complete. 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.693+0000 7fa973f38740 1 -- start start 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.693+0000 7fa973f38740 1 Processor -- start 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa973f38740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 0x5597d7717880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa973f38740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d7717dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa973f38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 0x5597d7718300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa973f38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5597d771d510 con 0x5597d771a940 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa973f38740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5597d75fd6e0 con 0x5597d7710080 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa973f38740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5597d771d690 con 0x5597d770f760 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa973f38740 10 client.0 _ll_register_callbacks cb 0x5597d7621a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 0x5597d7718300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 0x5597d7718300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42330/0 (socket says 172.21.15.42:42330) 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96bfff640 1 -- 172.21.15.42:0/3912680528 learned_addr learned my addr 172.21.15.42:0/3912680528 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96b7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 0x5597d7717880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa962ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d7717dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96bfff640 1 -- 172.21.15.42:0/3912680528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 msgr2=0x5597d7717880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96bfff640 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 0x5597d7717880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96bfff640 1 -- 172.21.15.42:0/3912680528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 msgr2=0x5597d7717dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96bfff640 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d7717dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96bfff640 1 -- 172.21.15.42:0/3912680528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597d7726a50 con 0x5597d771a940 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 0x5597d7717880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa962ffd640 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d7717dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa96bfff640 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 0x5597d7718300 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa964004010 tx=0x7fa96401e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150df19b38aac0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa94affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa94affd640 1 -- 172.21.15.42:0/3912680528 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964024030 con 0x5597d771a940 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa94affd640 1 -- 172.21.15.42:0/3912680528 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa9640049b0 con 0x5597d771a940 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.694+0000 7fa973f38740 1 -- 172.21.15.42:0/3912680528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa964010ce0 con 0x5597d771a940 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa94affd640 1 -- 172.21.15.42:0/3912680528 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa964038070 con 0x5597d771a940 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa973f38740 10 client.16590 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa973f38740 1 -- 172.21.15.42:0/3912680528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5597d77293e0 con 0x5597d771a940 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa94affd640 1 -- 172.21.15.42:0/3912680528 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa964010ce0 con 0x5597d771a940 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa94affd640 1 -- 172.21.15.42:0/3912680528 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7fa964034520 con 0x5597d771a940 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa973f38740 10 client.16590 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa973f38740 10 client.16590 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa973f38740 20 client.16590 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa973f38740 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5597d772a790 0x5597d772cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa973f38740 4 client.16590 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa973f38740 1 -- 172.21.15.42:0/3912680528 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597d76829d0 con 0x5597d772a790 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.695+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5597d772a790 0x5597d772cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.696+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5597d772a790 0x5597d772cb80 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea4f9778f5887675 server_cookie=ad956d0223fc47d2 in_seq=0 out_seq=0 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.696+0000 7fa94affd640 10 client.16590 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.696+0000 7fa94affd640 1 -- 172.21.15.42:0/3912680528 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597d76829d0 con 0x5597d772a790 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.696+0000 7fa94affd640 10 client.16590 handle_command_reply: tid=0 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.696+0000 7fa973f38740 1 client.16590 shutdown 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 1 -- 172.21.15.42:0/3912680528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 msgr2=0x5597d7718300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 0x5597d7718300 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa964004010 tx=0x7fa96401e6b0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 1 -- 172.21.15.42:0/3912680528 shutdown_connections 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5597d772a790 0x5597d772cb80 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 0x5597d7718300 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d7717dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 1 --2- 172.21.15.42:0/3912680528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 0x5597d7717880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa94affd640 0 client.16590 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 1 -- 172.21.15.42:0/3912680528 >> 172.21.15.42:0/3912680528 conn(0x5597d770bcf0 msgr2=0x5597d770ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 1 -- 172.21.15.42:0/3912680528 shutdown_connections 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 1 -- 172.21.15.42:0/3912680528 wait complete. 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.697+0000 7fa973f38740 20 client.16590 trim_cache size 0 max 16384 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.714+0000 7fa973f38740 1 Processor -- start 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.714+0000 7fa973f38740 1 -- start start 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.714+0000 7fa973f38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d7716ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.714+0000 7fa973f38740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d7710080 0x5597d7719750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.714+0000 7fa973f38740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 0x5597d77121c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa973f38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1ad5a0 con 0x5597d770f760 2024-09-19T09:42:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa973f38740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1af350 con 0x5597d771a940 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa973f38740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1add30 con 0x5597d7710080 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d7716ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d7716ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42338/0 (socket says 172.21.15.42:42338) 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96b7fe640 1 -- 172.21.15.42:0/3686017113 learned_addr learned my addr 172.21.15.42:0/3686017113 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96bfff640 1 --2- 172.21.15.42:0/3686017113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 0x5597d77121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96b7fe640 1 -- 172.21.15.42:0/3686017113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d7710080 msgr2=0x5597d7719750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/3686017113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d7710080 0x5597d7719750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96b7fe640 1 -- 172.21.15.42:0/3686017113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 msgr2=0x5597d77121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/3686017113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 0x5597d77121c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96b7fe640 1 -- 172.21.15.42:0/3686017113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d7707260 con 0x5597d770f760 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96bfff640 1 --2- 172.21.15.42:0/3686017113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 0x5597d77121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/3686017113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d7716ba0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x5597d772d180 tx=0x7fa95c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698500798fb2041a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa9617fa640 1 -- 172.21.15.42:0/3686017113 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c00fc20 con 0x5597d770f760 2024-09-19T09:42:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa9617fa640 1 -- 172.21.15.42:0/3686017113 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95c00fdc0 con 0x5597d770f760 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.715+0000 7fa9617fa640 1 -- 172.21.15.42:0/3686017113 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c004d50 con 0x5597d770f760 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.716+0000 7fa973f38740 1 -- 172.21.15.42:0/3686017113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 msgr2=0x5597d7716ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.716+0000 7fa973f38740 1 --2- 172.21.15.42:0/3686017113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d7716ba0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x5597d772d180 tx=0x7fa95c005f90 comp rx=0 tx=0).stop 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.716+0000 7fa973f38740 1 -- 172.21.15.42:0/3686017113 shutdown_connections 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.716+0000 7fa973f38740 1 --2- 172.21.15.42:0/3686017113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d771a940 0x5597d77121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.716+0000 7fa973f38740 1 --2- 172.21.15.42:0/3686017113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d7710080 0x5597d7719750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.716+0000 7fa973f38740 1 --2- 172.21.15.42:0/3686017113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d770f760 0x5597d7716ba0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.716+0000 7fa973f38740 1 -- 172.21.15.42:0/3686017113 >> 172.21.15.42:0/3686017113 conn(0x5597d770bcf0 msgr2=0x5597d770a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.716+0000 7fa973f38740 1 -- 172.21.15.42:0/3686017113 shutdown_connections 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.716+0000 7fa973f38740 1 -- 172.21.15.42:0/3686017113 wait complete. 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.716+0000 7fa973f38740 1 -- start start 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa973f38740 1 Processor -- start 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa973f38740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 0x5597d771e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa973f38740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d771ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa973f38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 0x5597d771f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa973f38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1aec20 con 0x5597d771a940 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa973f38740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1ae4c0 con 0x5597d7710080 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa973f38740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1ab580 con 0x5597d770f760 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa973f38740 10 client.0 _ll_register_callbacks cb 0x7fa964003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa96bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 0x5597d771f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa962ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d771ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa96b7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 0x5597d771e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa962ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d771ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:48528/0 (socket says 172.21.15.42:48528) 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa962ffd640 1 -- 172.21.15.42:0/515242793 learned_addr learned my addr 172.21.15.42:0/515242793 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa962ffd640 1 -- 172.21.15.42:0/515242793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 msgr2=0x5597d771e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa962ffd640 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 0x5597d771e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa962ffd640 1 -- 172.21.15.42:0/515242793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 msgr2=0x5597d771f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa962ffd640 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 0x5597d771f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.717+0000 7fa962ffd640 1 -- 172.21.15.42:0/515242793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597d770c980 con 0x5597d7710080 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa962ffd640 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d771ed60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa9540bc5d0 tx=0x7fa9540b88e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d36ec812ce6af7dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa94affd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa94affd640 1 -- 172.21.15.42:0/515242793 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa954049040 con 0x5597d7710080 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa94affd640 1 -- 172.21.15.42:0/515242793 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa9540ba940 con 0x5597d7710080 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa973f38740 1 -- 172.21.15.42:0/515242793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa95c00fdc0 con 0x5597d7710080 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa94affd640 1 -- 172.21.15.42:0/515242793 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa9540bbfa0 con 0x5597d7710080 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa973f38740 10 client.26030 fetch_fsmap learned FSMap version 37 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa973f38740 1 -- 172.21.15.42:0/515242793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5597d77954b0 con 0x5597d7710080 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa94affd640 1 -- 172.21.15.42:0/515242793 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95c00fdc0 con 0x5597d7710080 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa94affd640 1 -- 172.21.15.42:0/515242793 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7fa9540f20d0 con 0x5597d7710080 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa973f38740 10 client.26030 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:42:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa973f38740 10 client.26030 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa973f38740 20 client.26030 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa973f38740 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5597d7795cd0 0x5597d77980f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa973f38740 4 client.26030 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.718+0000 7fa973f38740 1 -- 172.21.15.42:0/515242793 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x5597d767cd20 con 0x5597d7795cd0 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.719+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5597d7795cd0 0x5597d77980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.719+0000 7fa96b7fe640 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5597d7795cd0 0x5597d77980f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc54b78c0a6d24f6 server_cookie=bb5c99df0b8464d6 in_seq=0 out_seq=0 2024-09-19T09:42:27.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:27.719+0000 7fa94affd640 10 client.26030 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:28.686 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:28 smithi136 ceph-mon[34840]: pgmap v431: 97 pgs: 97 active+clean; 146 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 459 op/s 2024-09-19T09:42:28.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:28 smithi042 ceph-mon[31223]: pgmap v431: 97 pgs: 97 active+clean; 146 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 459 op/s 2024-09-19T09:42:28.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:28 smithi171 ceph-mon[35803]: pgmap v431: 97 pgs: 97 active+clean; 146 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 459 op/s 2024-09-19T09:42:30.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.164+0000 7fa94affd640 1 -- 172.21.15.42:0/515242793 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5597d767cd20 con 0x5597d7795cd0 2024-09-19T09:42:30.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.164+0000 7fa94affd640 10 client.26030 handle_command_reply: tid=0 2024-09-19T09:42:30.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.164+0000 7fa973f38740 1 client.26030 shutdown 2024-09-19T09:42:30.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 1 -- 172.21.15.42:0/515242793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 msgr2=0x5597d771ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:30.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d771ed60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa9540bc5d0 tx=0x7fa9540b88e0 comp rx=0 tx=0).stop 2024-09-19T09:42:30.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 1 -- 172.21.15.42:0/515242793 shutdown_connections 2024-09-19T09:42:30.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5597d7795cd0 0x5597d77980f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:30.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597d771a940 0x5597d771f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:30.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5597d7710080 0x5597d771ed60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:30.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 1 --2- 172.21.15.42:0/515242793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597d770f760 0x5597d771e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:30.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa94affd640 0 client.26030 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:30.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 1 -- 172.21.15.42:0/515242793 >> 172.21.15.42:0/515242793 conn(0x5597d770bcf0 msgr2=0x5597d7718040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:30.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 1 -- 172.21.15.42:0/515242793 shutdown_connections 2024-09-19T09:42:30.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 1 -- 172.21.15.42:0/515242793 wait complete. 2024-09-19T09:42:30.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.165+0000 7fa973f38740 20 client.26030 trim_cache size 0 max 16384 2024-09-19T09:42:30.168 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:42:30.168 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 37, 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 24506, 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 14, 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "41d56c9e": { 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 14, 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 136.6, 2024-09-19T09:42:30.169 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "QUIESCED", 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:30.170 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:42:30.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 -- 172.21.15.42:0/2643580352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa9580a3240 msgr2=0x7fa9580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:30.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa9580a3240 0x7fa9580a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa964021000 tx=0x7fa96401e000 comp rx=0 tx=0).stop 2024-09-19T09:42:30.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 -- 172.21.15.42:0/2643580352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa96c102570 msgr2=0x7fa96c198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:30.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa96c102570 0x7fa96c198a20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa954006010 tx=0x7fa954003c10 comp rx=0 tx=0).stop 2024-09-19T09:42:30.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 -- 172.21.15.42:0/2643580352 shutdown_connections 2024-09-19T09:42:30.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa9580a3240 0x7fa9580a5700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:30.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa96c102ef0 0x7fa96c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:30.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa96c102570 0x7fa96c198a20 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:30.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 --2- 172.21.15.42:0/2643580352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c100e20 0x7fa96c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:30.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 -- 172.21.15.42:0/2643580352 >> 172.21.15.42:0/2643580352 conn(0x7fa96c0fc7d0 msgr2=0x7fa96c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:30.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 -- 172.21.15.42:0/2643580352 shutdown_connections 2024-09-19T09:42:30.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:30.166+0000 7fa971b5f640 1 -- 172.21.15.42:0/2643580352 wait complete. 2024-09-19T09:42:30.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:30 smithi042 ceph-mon[31223]: pgmap v432: 97 pgs: 97 active+clean; 145 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 422 op/s 2024-09-19T09:42:30.648 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:30 smithi171 ceph-mon[35803]: pgmap v432: 97 pgs: 97 active+clean; 145 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 422 op/s 2024-09-19T09:42:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:30 smithi136 ceph-mon[34840]: pgmap v432: 97 pgs: 97 active+clean; 145 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 422 op/s 2024-09-19T09:42:31.042 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '41d56c9e', quiesce took 5.8 seconds. Will release after: 10.8 2024-09-19T09:42:32.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:32 smithi042 ceph-mon[31223]: pgmap v433: 97 pgs: 97 active+clean; 145 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 479 op/s 2024-09-19T09:42:32.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:32 smithi171 ceph-mon[35803]: pgmap v433: 97 pgs: 97 active+clean; 145 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 479 op/s 2024-09-19T09:42:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:32 smithi136 ceph-mon[34840]: pgmap v433: 97 pgs: 97 active+clean; 145 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 479 op/s 2024-09-19T09:42:33.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:33 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:42:33.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:33 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:42:33.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:33 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:42:34.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:34 smithi042 ceph-mon[31223]: pgmap v434: 97 pgs: 97 active+clean; 146 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 452 op/s 2024-09-19T09:42:34.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:34 smithi171 ceph-mon[35803]: pgmap v434: 97 pgs: 97 active+clean; 146 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 452 op/s 2024-09-19T09:42:34.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:34 smithi136 ceph-mon[34840]: pgmap v434: 97 pgs: 97 active+clean; 146 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 452 op/s 2024-09-19T09:42:36.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:36 smithi042 ceph-mon[31223]: pgmap v435: 97 pgs: 97 active+clean; 146 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 428 op/s 2024-09-19T09:42:36.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:36 smithi171 ceph-mon[35803]: pgmap v435: 97 pgs: 97 active+clean; 146 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 428 op/s 2024-09-19T09:42:36.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:36 smithi136 ceph-mon[34840]: pgmap v435: 97 pgs: 97 active+clean; 146 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 428 op/s 2024-09-19T09:42:37.474 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:42:37.756 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.790+0000 7f3db8253640 1 -- 172.21.15.42:0/3599047529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3db01003b0 msgr2=0x7f3db01007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.790+0000 7f3db8253640 1 --2- 172.21.15.42:0/3599047529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3db01003b0 0x7f3db01007b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009900 tx=0x7f3dac02a410 comp rx=0 tx=0).stop 2024-09-19T09:42:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.790+0000 7f3db8253640 1 -- 172.21.15.42:0/3599047529 shutdown_connections 2024-09-19T09:42:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.790+0000 7f3db8253640 1 --2- 172.21.15.42:0/3599047529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0101690 0x7f3db0101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.790+0000 7f3db8253640 1 --2- 172.21.15.42:0/3599047529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3db0100cf0 0x7f3db0101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.790+0000 7f3db8253640 1 --2- 172.21.15.42:0/3599047529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3db01003b0 0x7f3db01007b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.790+0000 7f3db8253640 1 -- 172.21.15.42:0/3599047529 >> 172.21.15.42:0/3599047529 conn(0x7f3db00fc1e0 msgr2=0x7f3db00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.790+0000 7f3db8253640 1 -- 172.21.15.42:0/3599047529 shutdown_connections 2024-09-19T09:42:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.790+0000 7f3db8253640 1 -- 172.21.15.42:0/3599047529 wait complete. 2024-09-19T09:42:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db8253640 1 Processor -- start 2024-09-19T09:42:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db8253640 1 -- start start 2024-09-19T09:42:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db8253640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3db01003b0 0x7f3db0199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db8253640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3db0100cf0 0x7f3db019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db8253640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0101690 0x7f3db01a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db8253640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3db010f9b0 con 0x7f3db01003b0 2024-09-19T09:42:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db8253640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3db010f830 con 0x7f3db0101690 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db8253640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3db010fb30 con 0x7f3db0100cf0 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db5fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3db01003b0 0x7f3db0199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db5fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3db01003b0 0x7f3db0199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56790/0 (socket says 172.21.15.42:56790) 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db5fef640 1 -- 172.21.15.42:0/883052497 learned_addr learned my addr 172.21.15.42:0/883052497 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db67f0640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0101690 0x7f3db01a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db5fef640 1 -- 172.21.15.42:0/883052497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3db0100cf0 msgr2=0x7f3db019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db5fef640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3db0100cf0 0x7f3db019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db5fef640 1 -- 172.21.15.42:0/883052497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0101690 msgr2=0x7f3db01a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db5fef640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0101690 0x7f3db01a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db5fef640 1 -- 172.21.15.42:0/883052497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db01a1b90 con 0x7f3db01003b0 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.791+0000 7f3db67f0640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0101690 0x7f3db01a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.792+0000 7f3db5fef640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3db01003b0 0x7f3db0199f70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009230 tx=0x7f3dac004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.792+0000 7f3da6ffd640 1 -- 172.21.15.42:0/883052497 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac03f030 con 0x7f3db01003b0 2024-09-19T09:42:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.792+0000 7f3db8253640 1 -- 172.21.15.42:0/883052497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db01a1e20 con 0x7f3db01003b0 2024-09-19T09:42:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.792+0000 7f3da6ffd640 1 -- 172.21.15.42:0/883052497 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dac003ce0 con 0x7f3db01003b0 2024-09-19T09:42:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.792+0000 7f3da6ffd640 1 -- 172.21.15.42:0/883052497 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac035070 con 0x7f3db01003b0 2024-09-19T09:42:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.792+0000 7f3db8253640 1 -- 172.21.15.42:0/883052497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db01a2280 con 0x7f3db01003b0 2024-09-19T09:42:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.794+0000 7f3da6ffd640 1 -- 172.21.15.42:0/883052497 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3dac042030 con 0x7f3db01003b0 2024-09-19T09:42:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.794+0000 7f3dbafee740 1 Processor -- start 2024-09-19T09:42:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3dbafee740 1 -- start start 2024-09-19T09:42:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 0x55a36c648da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6492e0 0x55a36c64dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 0x55a36c650830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3dbafee740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a36c5ac2f0 con 0x55a36c6492e0 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3dbafee740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a36c554270 con 0x55a36c64e370 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3dbafee740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a36c5a82b0 con 0x55a36c6489a0 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3da6ffd640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3d9c0a32f0 0x7f3d9c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db5fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6492e0 0x55a36c64dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db5fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6492e0 0x55a36c64dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56806/0 (socket says 172.21.15.42:56806) 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db5fef640 1 -- 172.21.15.42:0/2904643808 learned_addr learned my addr 172.21.15.42:0/2904643808 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db67f0640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3d9c0a32f0 0x7f3d9c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db67f0640 1 --2- 172.21.15.42:0/2904643808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 0x55a36c648da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db57ee640 1 --2- 172.21.15.42:0/2904643808 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 0x55a36c650830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3da6ffd640 1 -- 172.21.15.42:0/883052497 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3dac0f0430 con 0x7f3db01003b0 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db5fef640 1 -- 172.21.15.42:0/2904643808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 msgr2=0x55a36c648da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db5fef640 1 --2- 172.21.15.42:0/2904643808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 0x55a36c648da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db5fef640 1 -- 172.21.15.42:0/2904643808 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 msgr2=0x55a36c650830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db5fef640 1 --2- 172.21.15.42:0/2904643808 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 0x55a36c650830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db5fef640 1 -- 172.21.15.42:0/2904643808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36c553340 con 0x55a36c6492e0 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.795+0000 7f3db57ee640 1 --2- 172.21.15.42:0/2904643808 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 0x55a36c650830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.796+0000 7f3db67f0640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3d9c0a32f0 0x7f3d9c0a57b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3da8005fd0 tx=0x7f3da800a9c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.796+0000 7f3db5fef640 1 --2- 172.21.15.42:0/2904643808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6492e0 0x55a36c64dda0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0314e0 tx=0x7f3dac02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fca8bc8f61e747 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.796+0000 7f3d9bfff640 1 -- 172.21.15.42:0/2904643808 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac049070 con 0x55a36c6492e0 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.796+0000 7f3d9bfff640 1 -- 172.21.15.42:0/2904643808 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dac0bc9d0 con 0x55a36c6492e0 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.796+0000 7f3d9bfff640 1 -- 172.21.15.42:0/2904643808 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac03b460 con 0x55a36c6492e0 2024-09-19T09:42:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.796+0000 7f3dbafee740 1 -- 172.21.15.42:0/2904643808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6492e0 msgr2=0x55a36c64dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.796+0000 7f3dbafee740 1 --2- 172.21.15.42:0/2904643808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6492e0 0x55a36c64dda0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0314e0 tx=0x7f3dac02a410 comp rx=0 tx=0).stop 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 -- 172.21.15.42:0/2904643808 shutdown_connections 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 --2- 172.21.15.42:0/2904643808 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 0x55a36c650830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 --2- 172.21.15.42:0/2904643808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6492e0 0x55a36c64dda0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 --2- 172.21.15.42:0/2904643808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 0x55a36c648da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 -- 172.21.15.42:0/2904643808 >> 172.21.15.42:0/2904643808 conn(0x55a36c644010 msgr2=0x55a36c644410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 -- 172.21.15.42:0/2904643808 shutdown_connections 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 -- 172.21.15.42:0/2904643808 wait complete. 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 -- start start 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 Processor -- start 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6489a0 0x55a36c652a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6492e0 0x55a36c652f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 0x55a36c659f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a36c651100 con 0x55a36c6489a0 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a36c535290 con 0x55a36c64e370 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.797+0000 7f3dbafee740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a36c651280 con 0x55a36c6492e0 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3dbafee740 10 client.0 _ll_register_callbacks cb 0x55a36c566140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db5fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6489a0 0x55a36c652a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db5fef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6489a0 0x55a36c652a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56822/0 (socket says 172.21.15.42:56822) 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db5fef640 1 -- 172.21.15.42:0/726674897 learned_addr learned my addr 172.21.15.42:0/726674897 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db67f0640 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 0x55a36c659f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db57ee640 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6492e0 0x55a36c652f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db5fef640 1 -- 172.21.15.42:0/726674897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6492e0 msgr2=0x55a36c652f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db5fef640 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6492e0 0x55a36c652f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db5fef640 1 -- 172.21.15.42:0/726674897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 msgr2=0x55a36c659f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db5fef640 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 0x55a36c659f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db5fef640 1 -- 172.21.15.42:0/726674897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a36c2bf210 con 0x55a36c6489a0 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3db5fef640 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6489a0 0x55a36c652a10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3dac004650 tx=0x7f3dac0c0d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940f8e6bc262d2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3d997fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3d997fa640 1 -- 172.21.15.42:0/726674897 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac049040 con 0x55a36c6489a0 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3d997fa640 1 -- 172.21.15.42:0/726674897 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3dac0b9040 con 0x55a36c6489a0 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3dbafee740 1 -- 172.21.15.42:0/726674897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dac0bc9d0 con 0x55a36c6489a0 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3d997fa640 1 -- 172.21.15.42:0/726674897 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3dac0c5640 con 0x55a36c6489a0 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3dbafee740 10 client.16608 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.798+0000 7f3dbafee740 1 -- 172.21.15.42:0/726674897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a36c38b620 con 0x55a36c6489a0 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.799+0000 7f3d997fa640 1 -- 172.21.15.42:0/726674897 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dac0bc9d0 con 0x55a36c6489a0 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.799+0000 7f3d997fa640 1 -- 172.21.15.42:0/726674897 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f3dac081ce0 con 0x55a36c6489a0 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.799+0000 7f3dbafee740 10 client.16608 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.799+0000 7f3dbafee740 10 client.16608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.799+0000 7f3dbafee740 20 client.16608 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.799+0000 7f3dbafee740 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a36c65e220 0x55a36c660640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.799+0000 7f3dbafee740 4 client.16608 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.799+0000 7f3dbafee740 1 -- 172.21.15.42:0/726674897 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a36c5b9a20 con 0x55a36c65e220 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.799+0000 7f3db57ee640 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a36c65e220 0x55a36c660640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.800+0000 7f3d997fa640 10 client.16608 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.800+0000 7f3db57ee640 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a36c65e220 0x55a36c660640 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf6603cc87a8b29 server_cookie=37ba443aecc2a684 in_seq=0 out_seq=0 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.800+0000 7f3d997fa640 1 -- 172.21.15.42:0/726674897 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a36c5b9a20 con 0x55a36c65e220 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.800+0000 7f3d997fa640 10 client.16608 handle_command_reply: tid=0 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.800+0000 7f3dbafee740 1 client.16608 shutdown 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 1 -- 172.21.15.42:0/726674897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6489a0 msgr2=0x55a36c652a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6489a0 0x55a36c652a10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3dac004650 tx=0x7f3dac0c0d80 comp rx=0 tx=0).stop 2024-09-19T09:42:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 1 -- 172.21.15.42:0/726674897 shutdown_connections 2024-09-19T09:42:37.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a36c65e220 0x55a36c660640 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c64e370 0x55a36c659f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6492e0 0x55a36c652f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 1 --2- 172.21.15.42:0/726674897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c6489a0 0x55a36c652a10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3d997fa640 0 client.16608 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:37.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 1 -- 172.21.15.42:0/726674897 >> 172.21.15.42:0/726674897 conn(0x55a36c644010 msgr2=0x55a36c645820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 1 -- 172.21.15.42:0/726674897 shutdown_connections 2024-09-19T09:42:37.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 1 -- 172.21.15.42:0/726674897 wait complete. 2024-09-19T09:42:37.810 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.801+0000 7f3dbafee740 20 client.16608 trim_cache size 0 max 16384 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.815+0000 7f3dbafee740 1 Processor -- start 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.815+0000 7f3dbafee740 1 -- start start 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.815+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6489a0 0x55a36c6430b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.815+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6492e0 0x55a36c659eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.815+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c664ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3dbafee740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3db01ab200 con 0x55a36c64e370 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3dbafee740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3db01acfe0 con 0x55a36c6489a0 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3dbafee740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3db01ab990 con 0x55a36c6492e0 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db67f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c664ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db67f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c664ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56838/0 (socket says 172.21.15.42:56838) 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db67f0640 1 -- 172.21.15.42:0/2459074199 learned_addr learned my addr 172.21.15.42:0/2459074199 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:37.822 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db57ee640 1 --2- 172.21.15.42:0/2459074199 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6492e0 0x55a36c659eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db5fef640 1 --2- 172.21.15.42:0/2459074199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6489a0 0x55a36c6430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db67f0640 1 -- 172.21.15.42:0/2459074199 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6492e0 msgr2=0x55a36c659eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db67f0640 1 --2- 172.21.15.42:0/2459074199 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6492e0 0x55a36c659eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db67f0640 1 -- 172.21.15.42:0/2459074199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6489a0 msgr2=0x55a36c6430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db67f0640 1 --2- 172.21.15.42:0/2459074199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6489a0 0x55a36c6430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db67f0640 1 -- 172.21.15.42:0/2459074199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36c643e30 con 0x55a36c64e370 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db5fef640 1 --2- 172.21.15.42:0/2459074199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6489a0 0x55a36c6430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3db67f0640 1 --2- 172.21.15.42:0/2459074199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c664ee0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3da8014110 tx=0x7f3da8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bcacabb2e648bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3d9b7fe640 1 -- 172.21.15.42:0/2459074199 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8004b20 con 0x55a36c64e370 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3d9b7fe640 1 -- 172.21.15.42:0/2459074199 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3da8012e30 con 0x55a36c64e370 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.816+0000 7f3d9b7fe640 1 -- 172.21.15.42:0/2459074199 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8005750 con 0x55a36c64e370 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 -- 172.21.15.42:0/2459074199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 msgr2=0x55a36c664ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 --2- 172.21.15.42:0/2459074199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c664ee0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3da8014110 tx=0x7f3da8017000 comp rx=0 tx=0).stop 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 -- 172.21.15.42:0/2459074199 shutdown_connections 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 --2- 172.21.15.42:0/2459074199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c664ee0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 --2- 172.21.15.42:0/2459074199 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6492e0 0x55a36c659eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 --2- 172.21.15.42:0/2459074199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6489a0 0x55a36c6430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 -- 172.21.15.42:0/2459074199 >> 172.21.15.42:0/2459074199 conn(0x55a36c644010 msgr2=0x55a36c6429a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 -- 172.21.15.42:0/2459074199 shutdown_connections 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 -- 172.21.15.42:0/2459074199 wait complete. 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 -- start start 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.817+0000 7f3dbafee740 1 Processor -- start 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 0x55a36c657a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6492e0 0x55a36c657f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3dbafee740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c658f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3dbafee740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3db01ac880 con 0x55a36c64e370 2024-09-19T09:42:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3dbafee740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3db01ac120 con 0x55a36c6492e0 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3dbafee740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3db01a91e0 con 0x55a36c6489a0 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3dbafee740 10 client.0 _ll_register_callbacks cb 0x7f3dac005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db67f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c658f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db5fef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 0x55a36c657a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db67f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c658f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56850/0 (socket says 172.21.15.42:56850) 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db67f0640 1 -- 172.21.15.42:0/3990913140 learned_addr learned my addr 172.21.15.42:0/3990913140 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db57ee640 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6492e0 0x55a36c657f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db5fef640 1 -- 172.21.15.42:0/3990913140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6492e0 msgr2=0x55a36c657f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db5fef640 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6492e0 0x55a36c657f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db5fef640 1 -- 172.21.15.42:0/3990913140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 msgr2=0x55a36c658f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db5fef640 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c658f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db5fef640 1 -- 172.21.15.42:0/3990913140 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a36c659510 con 0x55a36c6489a0 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db67f0640 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c658f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.818+0000 7f3db57ee640 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6492e0 0x55a36c657f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3db5fef640 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 0x55a36c657a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3dac03bfd0 tx=0x7f3dac0bd190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e539c4d75270a869 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3d997fa640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3d997fa640 1 -- 172.21.15.42:0/3990913140 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac049070 con 0x55a36c6489a0 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3d997fa640 1 -- 172.21.15.42:0/3990913140 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3dac0db2b0 con 0x55a36c6489a0 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3dbafee740 1 -- 172.21.15.42:0/3990913140 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3da8012e30 con 0x55a36c6489a0 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3d997fa640 1 -- 172.21.15.42:0/3990913140 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3dac0a2050 con 0x55a36c6489a0 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3dbafee740 10 client.25954 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3dbafee740 1 -- 172.21.15.42:0/3990913140 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a36c659510 con 0x55a36c6489a0 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3d997fa640 1 -- 172.21.15.42:0/3990913140 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3da8012e30 con 0x55a36c6489a0 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3d997fa640 1 -- 172.21.15.42:0/3990913140 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f3dac081ce0 con 0x55a36c6489a0 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3dbafee740 10 client.25954 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3dbafee740 10 client.25954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3dbafee740 20 client.25954 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3dbafee740 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a36c6c9910 0x55a36c6cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3dbafee740 4 client.25954 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:42:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.819+0000 7f3dbafee740 1 -- 172.21.15.42:0/3990913140 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a36c5b3d70 con 0x55a36c6c9910 2024-09-19T09:42:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.820+0000 7f3db57ee640 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a36c6c9910 0x55a36c6cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.820+0000 7f3db57ee640 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a36c6c9910 0x55a36c6cbd30 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93a9ef7724ab8068 server_cookie=508a23e8784fb3eb in_seq=0 out_seq=0 2024-09-19T09:42:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.820+0000 7f3d997fa640 10 client.25954 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3d997fa640 1 -- 172.21.15.42:0/3990913140 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a36c5b3d70 con 0x55a36c6c9910 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3d997fa640 10 client.25954 handle_command_reply: tid=0 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3dbafee740 1 client.25954 shutdown 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3dbafee740 1 -- 172.21.15.42:0/3990913140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 msgr2=0x55a36c657a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3dbafee740 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 0x55a36c657a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3dac03bfd0 tx=0x7f3dac0bd190 comp rx=0 tx=0).stop 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3dbafee740 1 -- 172.21.15.42:0/3990913140 shutdown_connections 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3dbafee740 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a36c6c9910 0x55a36c6cbd30 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3dbafee740 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a36c64e370 0x55a36c658f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3d997fa640 0 client.25954 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3dbafee740 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a36c6492e0 0x55a36c657f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3dbafee740 1 --2- 172.21.15.42:0/3990913140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a36c6489a0 0x55a36c657a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.831+0000 7f3dbafee740 1 -- 172.21.15.42:0/3990913140 >> 172.21.15.42:0/3990913140 conn(0x55a36c644010 msgr2=0x55a36c6431c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3dbafee740 1 -- 172.21.15.42:0/3990913140 shutdown_connections 2024-09-19T09:42:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3dbafee740 1 -- 172.21.15.42:0/3990913140 wait complete. 2024-09-19T09:42:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3dbafee740 20 client.25954 trim_cache size 0 max 16384 2024-09-19T09:42:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:42:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:42:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:42:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:42:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 -- 172.21.15.42:0/883052497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3d9c0a32f0 msgr2=0x7f3d9c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3d9c0a32f0 0x7f3d9c0a57b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3da8005fd0 tx=0x7f3da800a9c0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 -- 172.21.15.42:0/883052497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3db01003b0 msgr2=0x7f3db0199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3db01003b0 0x7f3db0199f70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009230 tx=0x7f3dac004360 comp rx=0 tx=0).stop 2024-09-19T09:42:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 -- 172.21.15.42:0/883052497 shutdown_connections 2024-09-19T09:42:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f3d9c0a32f0 0x7f3d9c0a57b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0101690 0x7f3db01a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3db0100cf0 0x7f3db019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 --2- 172.21.15.42:0/883052497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3db01003b0 0x7f3db0199f70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 -- 172.21.15.42:0/883052497 >> 172.21.15.42:0/883052497 conn(0x7f3db00fc1e0 msgr2=0x7f3db00fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 -- 172.21.15.42:0/883052497 shutdown_connections 2024-09-19T09:42:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:37.832+0000 7f3db8253640 1 -- 172.21.15.42:0/883052497 wait complete. 2024-09-19T09:42:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.227+0000 7f063043c640 1 -- 172.21.15.42:0/1933540099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0628106f10 msgr2=0x7f062810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.227+0000 7f063043c640 1 --2- 172.21.15.42:0/1933540099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0628106f10 0x7f062810ea90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0620009ca0 tx=0x7f062002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.227+0000 7f063043c640 1 -- 172.21.15.42:0/1933540099 shutdown_connections 2024-09-19T09:42:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.227+0000 7f063043c640 1 --2- 172.21.15.42:0/1933540099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0628106f10 0x7f062810ea90 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.227+0000 7f063043c640 1 --2- 172.21.15.42:0/1933540099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0628102790 0x7f06281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.227+0000 7f063043c640 1 --2- 172.21.15.42:0/1933540099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0628101de0 0x7f06281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.227+0000 7f063043c640 1 -- 172.21.15.42:0/1933540099 >> 172.21.15.42:0/1933540099 conn(0x7f06280fd8c0 msgr2=0x7f06280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.227+0000 7f063043c640 1 -- 172.21.15.42:0/1933540099 shutdown_connections 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.227+0000 7f063043c640 1 -- 172.21.15.42:0/1933540099 wait complete. 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f063043c640 1 Processor -- start 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f063043c640 1 -- start start 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f063043c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0628101de0 0x7f0628198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f063043c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0628102790 0x7f06281989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f063043c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0628106f10 0x7f062819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f063043c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0628111f90 con 0x7f0628101de0 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f063043c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0628111e10 con 0x7f0628102790 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f063043c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0628112110 con 0x7f0628106f10 2024-09-19T09:42:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f062e1d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0628101de0 0x7f0628198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f062e1d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0628101de0 0x7f0628198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56862/0 (socket says 172.21.15.42:56862) 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.228+0000 7f062e1d8640 1 -- 172.21.15.42:0/2036414743 learned_addr learned my addr 172.21.15.42:0/2036414743 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f062d9d7640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0628102790 0x7f06281989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f062e9d9640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0628106f10 0x7f062819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f062e1d8640 1 -- 172.21.15.42:0/2036414743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0628106f10 msgr2=0x7f062819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f062e1d8640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0628106f10 0x7f062819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f062e1d8640 1 -- 172.21.15.42:0/2036414743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0628102790 msgr2=0x7f06281989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f062e1d8640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0628102790 0x7f06281989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f062e1d8640 1 -- 172.21.15.42:0/2036414743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062819d420 con 0x7f0628101de0 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f062e1d8640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0628101de0 0x7f0628198470 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f062400d950 tx=0x7f062400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f061f7fe640 1 -- 172.21.15.42:0/2036414743 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624017070 con 0x7f0628101de0 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f061f7fe640 1 -- 172.21.15.42:0/2036414743 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f062400de80 con 0x7f0628101de0 2024-09-19T09:42:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f063043c640 1 -- 172.21.15.42:0/2036414743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062819d710 con 0x7f0628101de0 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f061f7fe640 1 -- 172.21.15.42:0/2036414743 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062400f620 con 0x7f0628101de0 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.229+0000 7f063043c640 1 -- 172.21.15.42:0/2036414743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06281a4ff0 con 0x7f0628101de0 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.231+0000 7f061f7fe640 1 -- 172.21.15.42:0/2036414743 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f0624009c30 con 0x7f0628101de0 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f0632815740 1 Processor -- start 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f0632815740 1 -- start start 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f0632815740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b34a0 0x55814a6b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f0632815740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b3dc0 0x55814a6be140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f0632815740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f0632815740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55814a6192e0 con 0x55814a6be680 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f0632815740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55814a5c0ce0 con 0x55814a6b3dc0 2024-09-19T09:42:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f0632815740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55814a6152a0 con 0x55814a6b34a0 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f061f7fe640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06140a32c0 0x7f06140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f062d9d7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f062d9d7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6c0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56874/0 (socket says 172.21.15.42:56874) 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f062d9d7640 1 -- 172.21.15.42:0/146963411 learned_addr learned my addr 172.21.15.42:0/146963411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f062e9d9640 1 --2- 172.21.15.42:0/146963411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b34a0 0x55814a6b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f062e9d9640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06140a32c0 0x7f06140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.232+0000 7f061f7fe640 1 -- 172.21.15.42:0/2036414743 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f06240cf560 con 0x7f0628101de0 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f062e1d8640 1 --2- 172.21.15.42:0/146963411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b3dc0 0x55814a6be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f062d9d7640 1 -- 172.21.15.42:0/146963411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b34a0 msgr2=0x55814a6b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f062d9d7640 1 --2- 172.21.15.42:0/146963411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b34a0 0x55814a6b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f062d9d7640 1 -- 172.21.15.42:0/146963411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b3dc0 msgr2=0x55814a6be140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f062d9d7640 1 --2- 172.21.15.42:0/146963411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b3dc0 0x55814a6be140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f062d9d7640 1 -- 172.21.15.42:0/146963411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814a5a5440 con 0x55814a6be680 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f062e1d8640 1 --2- 172.21.15.42:0/146963411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b3dc0 0x55814a6be140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f062d9d7640 1 --2- 172.21.15.42:0/146963411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6c0a70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0618009a40 tx=0x7f0618009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3373c7b41ea98e1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f062e9d9640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06140a32c0 0x7f06140a5780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0620031f80 tx=0x7f06200095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f061cdea640 1 -- 172.21.15.42:0/146963411 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0618017070 con 0x55814a6be680 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f061cdea640 1 -- 172.21.15.42:0/146963411 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0618013470 con 0x55814a6be680 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.233+0000 7f061cdea640 1 -- 172.21.15.42:0/146963411 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0618012610 con 0x55814a6be680 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 -- 172.21.15.42:0/146963411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 msgr2=0x55814a6c0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 --2- 172.21.15.42:0/146963411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6c0a70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0618009a40 tx=0x7f0618009f00 comp rx=0 tx=0).stop 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 -- 172.21.15.42:0/146963411 shutdown_connections 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 --2- 172.21.15.42:0/146963411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6c0a70 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 --2- 172.21.15.42:0/146963411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b3dc0 0x55814a6be140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 --2- 172.21.15.42:0/146963411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b34a0 0x55814a6b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 -- 172.21.15.42:0/146963411 >> 172.21.15.42:0/146963411 conn(0x55814a6afa30 msgr2=0x55814a6afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 -- 172.21.15.42:0/146963411 shutdown_connections 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 -- 172.21.15.42:0/146963411 wait complete. 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 -- start start 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.234+0000 7f0632815740 1 Processor -- start 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f0632815740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b34a0 0x55814a6bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f0632815740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 0x55814a6bb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f0632815740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6bb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f0632815740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55814a6c1250 con 0x55814a6be680 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f0632815740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55814a5d4050 con 0x55814a6b34a0 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f0632815740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55814a6c13d0 con 0x55814a6b3dc0 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f0632815740 10 client.0 _ll_register_callbacks cb 0x55814a614160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062e9d9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6bb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062d9d7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 0x55814a6bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062e9d9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6bb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56890/0 (socket says 172.21.15.42:56890) 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062e9d9640 1 -- 172.21.15.42:0/1496080781 learned_addr learned my addr 172.21.15.42:0/1496080781 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062e1d8640 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b34a0 0x55814a6bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062e9d9640 1 -- 172.21.15.42:0/1496080781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 msgr2=0x55814a6bb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062e9d9640 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 0x55814a6bb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062e9d9640 1 -- 172.21.15.42:0/1496080781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b34a0 msgr2=0x55814a6bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062e9d9640 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b34a0 0x55814a6bdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062e9d9640 1 -- 172.21.15.42:0/1496080781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55814a38a3c0 con 0x55814a6be680 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062d9d7640 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 0x55814a6bb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f062e9d9640 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6bb6f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0620009ca0 tx=0x7f062002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db31c6afd52c11c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.235+0000 7f0611ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0611ffb640 1 -- 172.21.15.42:0/1496080781 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062004e070 con 0x55814a6be680 2024-09-19T09:42:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0611ffb640 1 -- 172.21.15.42:0/1496080781 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0620003970 con 0x55814a6be680 2024-09-19T09:42:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0632815740 1 -- 172.21.15.42:0/1496080781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0618013470 con 0x55814a6be680 2024-09-19T09:42:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0611ffb640 1 -- 172.21.15.42:0/1496080781 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0620003bb0 con 0x55814a6be680 2024-09-19T09:42:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0632815740 10 client.16626 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0632815740 1 -- 172.21.15.42:0/1496080781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55814a6ccad0 con 0x55814a6be680 2024-09-19T09:42:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0611ffb640 1 -- 172.21.15.42:0/1496080781 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0618013470 con 0x55814a6be680 2024-09-19T09:42:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0611ffb640 1 -- 172.21.15.42:0/1496080781 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f06200305c0 con 0x55814a6be680 2024-09-19T09:42:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0632815740 10 client.16626 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0632815740 10 client.16626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0632815740 20 client.16626 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0632815740 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55814a6cdfe0 0x55814a6d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0632815740 4 client.16626 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.236+0000 7f0632815740 1 -- 172.21.15.42:0/1496080781 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55814a626850 con 0x55814a6cdfe0 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.237+0000 7f062e1d8640 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55814a6cdfe0 0x55814a6d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.237+0000 7f062e1d8640 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55814a6cdfe0 0x55814a6d0460 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53bf0665f57f67fc server_cookie=6eb6acf4fb5117a1 in_seq=0 out_seq=0 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.237+0000 7f0611ffb640 10 client.16626 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0611ffb640 1 -- 172.21.15.42:0/1496080781 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55814a626850 con 0x55814a6cdfe0 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0611ffb640 10 client.16626 handle_command_reply: tid=0 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 client.16626 shutdown 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 -- 172.21.15.42:0/1496080781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 msgr2=0x55814a6bb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6bb6f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0620009ca0 tx=0x7f062002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 -- 172.21.15.42:0/1496080781 shutdown_connections 2024-09-19T09:42:38.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55814a6cdfe0 0x55814a6d0460 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6be680 0x55814a6bb6f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 0x55814a6bb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0611ffb640 0 client.16626 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:38.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 --2- 172.21.15.42:0/1496080781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6b34a0 0x55814a6bdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 -- 172.21.15.42:0/1496080781 >> 172.21.15.42:0/1496080781 conn(0x55814a6afa30 msgr2=0x55814a6b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 -- 172.21.15.42:0/1496080781 shutdown_connections 2024-09-19T09:42:38.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 1 -- 172.21.15.42:0/1496080781 wait complete. 2024-09-19T09:42:38.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.238+0000 7f0632815740 20 client.16626 trim_cache size 0 max 16384 2024-09-19T09:42:38.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.255+0000 7f0632815740 1 Processor -- start 2024-09-19T09:42:38.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.255+0000 7f0632815740 1 -- start start 2024-09-19T09:42:38.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f0632815740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b34a0 0x55814a6ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f0632815740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 0x55814a6b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f0632815740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6be680 0x55814a6d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f0632815740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f06281ad6e0 con 0x55814a6b34a0 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f0632815740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f06281af4c0 con 0x55814a6be680 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f0632815740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f06281ade70 con 0x55814a6b3dc0 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e1d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b34a0 0x55814a6ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e1d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b34a0 0x55814a6ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56904/0 (socket says 172.21.15.42:56904) 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e1d8640 1 -- 172.21.15.42:0/98980324 learned_addr learned my addr 172.21.15.42:0/98980324 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062d9d7640 1 --2- 172.21.15.42:0/98980324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 0x55814a6b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e9d9640 1 --2- 172.21.15.42:0/98980324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6be680 0x55814a6d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e1d8640 1 -- 172.21.15.42:0/98980324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 msgr2=0x55814a6b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e1d8640 1 --2- 172.21.15.42:0/98980324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 0x55814a6b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e1d8640 1 -- 172.21.15.42:0/98980324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6be680 msgr2=0x55814a6d5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e1d8640 1 --2- 172.21.15.42:0/98980324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6be680 0x55814a6d5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e1d8640 1 -- 172.21.15.42:0/98980324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814a6af860 con 0x55814a6b34a0 2024-09-19T09:42:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e9d9640 1 --2- 172.21.15.42:0/98980324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6be680 0x55814a6d5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.256+0000 7f062e1d8640 1 --2- 172.21.15.42:0/98980324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b34a0 0x55814a6ca4b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0624010cc0 tx=0x7f06240ccf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b177d6ba1f8802fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.257+0000 7f0613fff640 1 -- 172.21.15.42:0/98980324 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624020040 con 0x55814a6b34a0 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.257+0000 7f0613fff640 1 -- 172.21.15.42:0/98980324 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06240b3070 con 0x55814a6b34a0 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.257+0000 7f0613fff640 1 -- 172.21.15.42:0/98980324 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06240cf0e0 con 0x55814a6b34a0 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.257+0000 7f0632815740 1 -- 172.21.15.42:0/98980324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b34a0 msgr2=0x55814a6ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.257+0000 7f0632815740 1 --2- 172.21.15.42:0/98980324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b34a0 0x55814a6ca4b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0624010cc0 tx=0x7f06240ccf10 comp rx=0 tx=0).stop 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.257+0000 7f0632815740 1 -- 172.21.15.42:0/98980324 shutdown_connections 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.257+0000 7f0632815740 1 --2- 172.21.15.42:0/98980324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6be680 0x55814a6d5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.257+0000 7f0632815740 1 --2- 172.21.15.42:0/98980324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b3dc0 0x55814a6b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.257+0000 7f0632815740 1 --2- 172.21.15.42:0/98980324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b34a0 0x55814a6ca4b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.257+0000 7f0632815740 1 -- 172.21.15.42:0/98980324 >> 172.21.15.42:0/98980324 conn(0x55814a6afa30 msgr2=0x55814a6b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 1 -- 172.21.15.42:0/98980324 shutdown_connections 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 1 -- 172.21.15.42:0/98980324 wait complete. 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 1 -- start start 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 1 Processor -- start 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b34a0 0x55814a6c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b3dc0 0x55814a6c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6be680 0x55814a6c2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f06281aed60 con 0x55814a6b3dc0 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f06281ae600 con 0x55814a6be680 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f06281ab6c0 con 0x55814a6b34a0 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f0632815740 10 client.0 _ll_register_callbacks cb 0x7f0620009960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f062d9d7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b3dc0 0x55814a6c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f062d9d7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b3dc0 0x55814a6c1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56914/0 (socket says 172.21.15.42:56914) 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f062d9d7640 1 -- 172.21.15.42:0/109383291 learned_addr learned my addr 172.21.15.42:0/109383291 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:38.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.258+0000 7f062e1d8640 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b34a0 0x55814a6c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f062d9d7640 1 -- 172.21.15.42:0/109383291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b34a0 msgr2=0x55814a6c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f062d9d7640 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b34a0 0x55814a6c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f062d9d7640 1 -- 172.21.15.42:0/109383291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6be680 msgr2=0x55814a6c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f062d9d7640 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6be680 0x55814a6c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f062d9d7640 1 -- 172.21.15.42:0/109383291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55814a6c29c0 con 0x55814a6b3dc0 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f062d9d7640 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b3dc0 0x55814a6c1ec0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0618013f10 tx=0x7f0618013e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce318514716d596b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f0611ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f0611ffb640 1 -- 172.21.15.42:0/109383291 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061802b060 con 0x55814a6b3dc0 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f0632815740 1 -- 172.21.15.42:0/109383291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06240b3070 con 0x55814a6b3dc0 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f0611ffb640 1 -- 172.21.15.42:0/109383291 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f06180139f0 con 0x55814a6b3dc0 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f0611ffb640 1 -- 172.21.15.42:0/109383291 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0618017040 con 0x55814a6b3dc0 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f0632815740 10 client.16632 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:38.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f0632815740 1 -- 172.21.15.42:0/109383291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55814a738a50 con 0x55814a6b3dc0 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.259+0000 7f0611ffb640 1 -- 172.21.15.42:0/109383291 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06240b3070 con 0x55814a6b3dc0 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.260+0000 7f0611ffb640 1 -- 172.21.15.42:0/109383291 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f0618031490 con 0x55814a6b3dc0 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.260+0000 7f0632815740 10 client.16632 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.260+0000 7f0632815740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.260+0000 7f0632815740 20 client.16632 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.260+0000 7f0632815740 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55814a738ef0 0x55814a73b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.260+0000 7f0632815740 4 client.16632 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.260+0000 7f0632815740 1 -- 172.21.15.42:0/109383291 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55814a620d60 con 0x55814a738ef0 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.260+0000 7f062e1d8640 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55814a738ef0 0x55814a73b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.260+0000 7f062e1d8640 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55814a738ef0 0x55814a73b310 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fac73910efce0549 server_cookie=22c44eb981085515 in_seq=0 out_seq=0 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.260+0000 7f0611ffb640 10 client.16632 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0611ffb640 1 -- 172.21.15.42:0/109383291 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55814a620d60 con 0x55814a738ef0 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0611ffb640 10 client.16632 handle_command_reply: tid=0 2024-09-19T09:42:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 client.16632 shutdown 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 -- 172.21.15.42:0/109383291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b3dc0 msgr2=0x55814a6c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b3dc0 0x55814a6c1ec0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0618013f10 tx=0x7f0618013e40 comp rx=0 tx=0).stop 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 -- 172.21.15.42:0/109383291 shutdown_connections 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55814a738ef0 0x55814a73b310 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55814a6be680 0x55814a6c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55814a6b3dc0 0x55814a6c1ec0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0611ffb640 0 client.16632 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 --2- 172.21.15.42:0/109383291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55814a6b34a0 0x55814a6c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 -- 172.21.15.42:0/109383291 >> 172.21.15.42:0/109383291 conn(0x55814a6afa30 msgr2=0x55814a6b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 -- 172.21.15.42:0/109383291 shutdown_connections 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 1 -- 172.21.15.42:0/109383291 wait complete. 2024-09-19T09:42:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.261+0000 7f0632815740 20 client.16632 trim_cache size 0 max 16384 2024-09-19T09:42:38.275 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:42:38.275 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-19T09:42:38.275 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-09-19T09:42:38.275 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 -- 172.21.15.42:0/2036414743 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06140a32c0 msgr2=0x7f06140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06140a32c0 0x7f06140a5780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0620031f80 tx=0x7f06200095c0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 -- 172.21.15.42:0/2036414743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0628101de0 msgr2=0x7f0628198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0628101de0 0x7f0628198470 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f062400d950 tx=0x7f062400dd50 comp rx=0 tx=0).stop 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 -- 172.21.15.42:0/2036414743 shutdown_connections 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f06140a32c0 0x7f06140a5780 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0628106f10 0x7f062819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0628102790 0x7f06281989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 --2- 172.21.15.42:0/2036414743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0628101de0 0x7f0628198470 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 -- 172.21.15.42:0/2036414743 >> 172.21.15.42:0/2036414743 conn(0x7f06280fd8c0 msgr2=0x7f06280fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 -- 172.21.15.42:0/2036414743 shutdown_connections 2024-09-19T09:42:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:38.262+0000 7f063043c640 1 -- 172.21.15.42:0/2036414743 wait complete. 2024-09-19T09:42:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:38 smithi042 ceph-mon[31223]: pgmap v436: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 389 op/s 2024-09-19T09:42:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:38 smithi171 ceph-mon[35803]: pgmap v436: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 389 op/s 2024-09-19T09:42:38.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:38 smithi136 ceph-mon[34840]: pgmap v436: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 389 op/s 2024-09-19T09:42:39.006 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:42:39.007 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:42:39.266 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:39.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 -- 172.21.15.42:0/3381745242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704102ef0 msgr2=0x7f370410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:39.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 --2- 172.21.15.42:0/3381745242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704102ef0 0x7f370410da40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009ca0 tx=0x7f36fc02a950 comp rx=0 tx=0).stop 2024-09-19T09:42:39.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 -- 172.21.15.42:0/3381745242 shutdown_connections 2024-09-19T09:42:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 --2- 172.21.15.42:0/3381745242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704102ef0 0x7f370410da40 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 --2- 172.21.15.42:0/3381745242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3704102570 0x7f37041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 --2- 172.21.15.42:0/3381745242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704100e20 0x7f3704101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 -- 172.21.15.42:0/3381745242 >> 172.21.15.42:0/3381745242 conn(0x7f37040fc7d0 msgr2=0x7f37040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 -- 172.21.15.42:0/3381745242 shutdown_connections 2024-09-19T09:42:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 -- 172.21.15.42:0/3381745242 wait complete. 2024-09-19T09:42:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 Processor -- start 2024-09-19T09:42:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.657+0000 7f370a967640 1 -- start start 2024-09-19T09:42:39.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f370a967640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:39.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f370a967640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704102570 0x7f37040fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:39.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f370a967640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3704102ef0 0x7f37040fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:39.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f370a967640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3704110f80 con 0x7f3704100e20 2024-09-19T09:42:39.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f370a967640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3704110e00 con 0x7f3704102ef0 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f370a967640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3704111100 con 0x7f3704102570 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f3703fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f3703fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56936/0 (socket says 172.21.15.42:56936) 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f3703fff640 1 -- 172.21.15.42:0/2304777082 learned_addr learned my addr 172.21.15.42:0/2304777082 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f3708f04640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3704102ef0 0x7f37040fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f37037fe640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704102570 0x7f37040fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f3703fff640 1 -- 172.21.15.42:0/2304777082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704102570 msgr2=0x7f37040fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f3703fff640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704102570 0x7f37040fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f3703fff640 1 -- 172.21.15.42:0/2304777082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3704102ef0 msgr2=0x7f37040fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f3703fff640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3704102ef0 0x7f37040fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f3703fff640 1 -- 172.21.15.42:0/2304777082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37041a6890 con 0x7f3704100e20 2024-09-19T09:42:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.658+0000 7f3708f04640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3704102ef0 0x7f37040fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.659+0000 7f3703fff640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f36f400c920 tx=0x7f36f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.659+0000 7f37017fa640 1 -- 172.21.15.42:0/2304777082 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4007c70 con 0x7f3704100e20 2024-09-19T09:42:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.659+0000 7f37017fa640 1 -- 172.21.15.42:0/2304777082 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f4007e10 con 0x7f3704100e20 2024-09-19T09:42:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.659+0000 7f370a967640 1 -- 172.21.15.42:0/2304777082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37041a6b80 con 0x7f3704100e20 2024-09-19T09:42:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.659+0000 7f37017fa640 1 -- 172.21.15.42:0/2304777082 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4018890 con 0x7f3704100e20 2024-09-19T09:42:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.659+0000 7f370a967640 1 -- 172.21.15.42:0/2304777082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37041a70c0 con 0x7f3704100e20 2024-09-19T09:42:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.660+0000 7f370a967640 1 -- 172.21.15.42:0/2304777082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3704101200 con 0x7f3704100e20 2024-09-19T09:42:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.661+0000 7f37017fa640 1 -- 172.21.15.42:0/2304777082 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f36f4018a70 con 0x7f3704100e20 2024-09-19T09:42:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.662+0000 7f37017fa640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36ec0a3240 0x7f36ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.662+0000 7f37017fa640 1 -- 172.21.15.42:0/2304777082 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f36f40cfb90 con 0x7f3704100e20 2024-09-19T09:42:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.662+0000 7f37037fe640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36ec0a3240 0x7f36ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.663+0000 7f37037fe640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36ec0a3240 0x7f36ec0a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36f8005d90 tx=0x7f36f8005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.666+0000 7f37017fa640 1 -- 172.21.15.42:0/2304777082 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f36f4014030 con 0x7f3704100e20 2024-09-19T09:42:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.877+0000 7f370a967640 1 -- 172.21.15.42:0/2304777082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37040fe1b0 con 0x7f3704100e20 2024-09-19T09:42:39.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.878+0000 7f37017fa640 1 -- 172.21.15.42:0/2304777082 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+12010 (secure 0 0 0) 0x7f36f400de20 con 0x7f3704100e20 2024-09-19T09:42:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:42:39.880 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":38,"btime":"2024-09-19T09:42:32:397781+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:42:31.429090+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:42:39.881 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 38 2024-09-19T09:42:39.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.880+0000 7f370a967640 1 -- 172.21.15.42:0/2304777082 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36ec0a3240 msgr2=0x7f36ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:39.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.880+0000 7f370a967640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36ec0a3240 0x7f36ec0a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36f8005d90 tx=0x7f36f8005d20 comp rx=0 tx=0).stop 2024-09-19T09:42:39.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.880+0000 7f370a967640 1 -- 172.21.15.42:0/2304777082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704100e20 msgr2=0x7f37040fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:39.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.880+0000 7f370a967640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f36f400c920 tx=0x7f36f400cde0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.881+0000 7f370a967640 1 -- 172.21.15.42:0/2304777082 shutdown_connections 2024-09-19T09:42:39.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.881+0000 7f370a967640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36ec0a3240 0x7f36ec0a5700 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.881+0000 7f370a967640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3704102ef0 0x7f37040fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.881+0000 7f370a967640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704102570 0x7f37040fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.881+0000 7f370a967640 1 --2- 172.21.15.42:0/2304777082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.881+0000 7f370a967640 1 -- 172.21.15.42:0/2304777082 >> 172.21.15.42:0/2304777082 conn(0x7f37040fc7d0 msgr2=0x7f370406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:39.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.881+0000 7f370a967640 1 -- 172.21.15.42:0/2304777082 shutdown_connections 2024-09-19T09:42:39.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:39.881+0000 7f370a967640 1 -- 172.21.15.42:0/2304777082 wait complete. 2024-09-19T09:42:40.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:40 smithi042 ceph-mon[31223]: pgmap v437: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 734 KiB/s wr, 285 op/s 2024-09-19T09:42:40.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:40 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2304777082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:40.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:40 smithi171 ceph-mon[35803]: pgmap v437: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 734 KiB/s wr, 285 op/s 2024-09-19T09:42:40.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:40 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2304777082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:40.877 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:42:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:40 smithi136 ceph-mon[34840]: pgmap v437: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 734 KiB/s wr, 285 op/s 2024-09-19T09:42:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:40 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2304777082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:41.143 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:41.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.632+0000 7fee78d00640 1 -- 172.21.15.42:0/838420635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee74106f10 msgr2=0x7fee7410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.632+0000 7fee78d00640 1 --2- 172.21.15.42:0/838420635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee74106f10 0x7fee7410ea90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009ca0 tx=0x7fee6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.632+0000 7fee78d00640 1 -- 172.21.15.42:0/838420635 shutdown_connections 2024-09-19T09:42:41.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.632+0000 7fee78d00640 1 --2- 172.21.15.42:0/838420635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee74106f10 0x7fee7410ea90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.632+0000 7fee78d00640 1 --2- 172.21.15.42:0/838420635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee74102790 0x7fee741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.632+0000 7fee78d00640 1 --2- 172.21.15.42:0/838420635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee74101de0 0x7fee741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.632+0000 7fee78d00640 1 -- 172.21.15.42:0/838420635 >> 172.21.15.42:0/838420635 conn(0x7fee740fd8c0 msgr2=0x7fee740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.632+0000 7fee78d00640 1 -- 172.21.15.42:0/838420635 shutdown_connections 2024-09-19T09:42:41.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.632+0000 7fee78d00640 1 -- 172.21.15.42:0/838420635 wait complete. 2024-09-19T09:42:41.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.633+0000 7fee78d00640 1 Processor -- start 2024-09-19T09:42:41.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.633+0000 7fee78d00640 1 -- start start 2024-09-19T09:42:41.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.633+0000 7fee78d00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee74101de0 0x7fee740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.633+0000 7fee78d00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee74102790 0x7fee74074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.633+0000 7fee78d00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee74106f10 0x7fee74074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.633+0000 7fee78d00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fee74111f70 con 0x7fee74102790 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.633+0000 7fee78d00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fee74111df0 con 0x7fee74101de0 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.633+0000 7fee78d00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fee741120f0 con 0x7fee74106f10 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee71d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee74102790 0x7fee74074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee71d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee74102790 0x7fee74074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44536/0 (socket says 172.21.15.42:44536) 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee71d9b640 1 -- 172.21.15.42:0/571472774 learned_addr learned my addr 172.21.15.42:0/571472774 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee72d9d640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee74106f10 0x7fee74074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee7259c640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee74101de0 0x7fee740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee71d9b640 1 -- 172.21.15.42:0/571472774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee74106f10 msgr2=0x7fee74074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee71d9b640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee74106f10 0x7fee74074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee71d9b640 1 -- 172.21.15.42:0/571472774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee74101de0 msgr2=0x7fee740744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee71d9b640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee74101de0 0x7fee740744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee71d9b640 1 -- 172.21.15.42:0/571472774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee741a68b0 con 0x7fee74102790 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee71d9b640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee74102790 0x7fee74074a30 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fee6800d950 tx=0x7fee6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee637fe640 1 -- 172.21.15.42:0/571472774 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68017030 con 0x7fee74102790 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee637fe640 1 -- 172.21.15.42:0/571472774 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee68004020 con 0x7fee74102790 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee78d00640 1 -- 172.21.15.42:0/571472774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee741a6ba0 con 0x7fee74102790 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee637fe640 1 -- 172.21.15.42:0/571472774 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee680047a0 con 0x7fee74102790 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.634+0000 7fee78d00640 1 -- 172.21.15.42:0/571472774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee741a70e0 con 0x7fee74102790 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.637+0000 7fee637fe640 1 -- 172.21.15.42:0/571472774 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fee680041d0 con 0x7fee74102790 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.637+0000 7fee7b0d9740 1 Processor -- start 2024-09-19T09:42:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.637+0000 7fee7b0d9740 1 -- start start 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfafb40 0x55b55dfae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfaea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfbb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b55df142f0 con 0x55b55dfae5d0 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b55debbcf0 con 0x55b55dfafb40 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b55df102b0 con 0x55b55dfb9370 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfaea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfaea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44544/0 (socket says 172.21.15.42:44544) 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7259c640 1 -- 172.21.15.42:0/3175547614 learned_addr learned my addr 172.21.15.42:0/3175547614 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee637fe640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fee5c0a3240 0x7fee5c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee72d9d640 1 --2- 172.21.15.42:0/3175547614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfafb40 0x55b55dfae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee71d9b640 1 --2- 172.21.15.42:0/3175547614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfbb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee72d9d640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fee5c0a3240 0x7fee5c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7259c640 1 -- 172.21.15.42:0/3175547614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 msgr2=0x55b55dfbb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7259c640 1 --2- 172.21.15.42:0/3175547614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfbb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7259c640 1 -- 172.21.15.42:0/3175547614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfafb40 msgr2=0x55b55dfae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7259c640 1 --2- 172.21.15.42:0/3175547614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfafb40 0x55b55dfae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee7259c640 1 -- 172.21.15.42:0/3175547614 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b55dea03a0 con 0x55b55dfae5d0 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.638+0000 7fee637fe640 1 -- 172.21.15.42:0/571472774 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fee680cf230 con 0x7fee74102790 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.639+0000 7fee7259c640 1 --2- 172.21.15.42:0/3175547614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfaea10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fee6400bd10 tx=0x7fee640107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ae29346b6f18da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.639+0000 7fee72d9d640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fee5c0a3240 0x7fee5c0a5700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fee6c004af0 tx=0x7fee6c004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.639+0000 7fee60ff9640 1 -- 172.21.15.42:0/3175547614 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64004030 con 0x55b55dfae5d0 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.639+0000 7fee60ff9640 1 -- 172.21.15.42:0/3175547614 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee640041d0 con 0x55b55dfae5d0 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.639+0000 7fee60ff9640 1 -- 172.21.15.42:0/3175547614 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee640117e0 con 0x55b55dfae5d0 2024-09-19T09:42:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.639+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3175547614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 msgr2=0x55b55dfaea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.639+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3175547614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfaea10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fee6400bd10 tx=0x7fee640107a0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3175547614 shutdown_connections 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3175547614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfbb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3175547614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfaea10 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3175547614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfafb40 0x55b55dfae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3175547614 >> 172.21.15.42:0/3175547614 conn(0x55b55df77310 msgr2=0x55b55dfaac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3175547614 shutdown_connections 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3175547614 wait complete. 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 -- start start 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 Processor -- start 2024-09-19T09:42:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfb8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfafb40 0x55b55dfb5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfb64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b55dfbc070 con 0x55b55dfae5d0 2024-09-19T09:42:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b55decf060 con 0x55b55dfafb40 2024-09-19T09:42:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b55dfbc1f0 con 0x55b55dfb9370 2024-09-19T09:42:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7b0d9740 10 client.0 _ll_register_callbacks cb 0x55b55dc228c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.640+0000 7fee7259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfb8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.720 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:42:41.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfb8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44560/0 (socket says 172.21.15.42:44560) 2024-09-19T09:42:41.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7259c640 1 -- 172.21.15.42:0/3100245904 learned_addr learned my addr 172.21.15.42:0/3100245904 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:41.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee71d9b640 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfafb40 0x55b55dfb5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee72d9d640 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfb64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7259c640 1 -- 172.21.15.42:0/3100245904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 msgr2=0x55b55dfb64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7259c640 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfb64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7259c640 1 -- 172.21.15.42:0/3100245904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfafb40 msgr2=0x55b55dfb5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7259c640 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfafb40 0x55b55dfb5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7259c640 1 -- 172.21.15.42:0/3100245904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b55dc853c0 con 0x55b55dfae5d0 2024-09-19T09:42:41.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee72d9d640 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfb64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:41.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7259c640 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfb8cd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fee64003f30 tx=0x7fee6400ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990529955fc7ee38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:41.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee59ffb640 1 -- 172.21.15.42:0/3100245904 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64029060 con 0x55b55dfae5d0 2024-09-19T09:42:41.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee59ffb640 1 -- 172.21.15.42:0/3100245904 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fee640035f0 con 0x55b55dfae5d0 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3100245904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee640041d0 con 0x55b55dfae5d0 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee59ffb640 1 -- 172.21.15.42:0/3100245904 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fee640037f0 con 0x55b55dfae5d0 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7b0d9740 10 client.16650 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.641+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3100245904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b55dfc7ae0 con 0x55b55dfae5d0 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.642+0000 7fee59ffb640 1 -- 172.21.15.42:0/3100245904 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee640041d0 con 0x55b55dfae5d0 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.642+0000 7fee59ffb640 1 -- 172.21.15.42:0/3100245904 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fee64004920 con 0x55b55dfae5d0 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.642+0000 7fee7b0d9740 10 client.16650 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.642+0000 7fee7b0d9740 10 client.16650 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.642+0000 7fee7b0d9740 20 client.16650 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.642+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b55dfc8ee0 0x55b55dfcb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.642+0000 7fee7b0d9740 4 client.16650 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.642+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3100245904 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b55df21860 con 0x55b55dfc8ee0 2024-09-19T09:42:41.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.642+0000 7fee71d9b640 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b55dfc8ee0 0x55b55dfcb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.643+0000 7fee71d9b640 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b55dfc8ee0 0x55b55dfcb2d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=efbee8077deeb0b9 server_cookie=80416dd20e1e83ce in_seq=0 out_seq=0 2024-09-19T09:42:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.643+0000 7fee59ffb640 10 client.16650 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:42:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.643+0000 7fee59ffb640 1 -- 172.21.15.42:0/3100245904 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b55df21860 con 0x55b55dfc8ee0 2024-09-19T09:42:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.643+0000 7fee59ffb640 10 client.16650 handle_command_reply: tid=0 2024-09-19T09:42:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.643+0000 7fee7b0d9740 1 client.16650 shutdown 2024-09-19T09:42:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3100245904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 msgr2=0x55b55dfb8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfb8cd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fee64003f30 tx=0x7fee6400ba20 comp rx=0 tx=0).stop 2024-09-19T09:42:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3100245904 shutdown_connections 2024-09-19T09:42:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b55dfc8ee0 0x55b55dfcb2d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfb64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfafb40 0x55b55dfb5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3100245904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfb8cd0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee59ffb640 0 client.16650 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3100245904 >> 172.21.15.42:0/3100245904 conn(0x55b55df77310 msgr2=0x55b55dfb0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3100245904 shutdown_connections 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3100245904 wait complete. 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.644+0000 7fee7b0d9740 20 client.16650 trim_cache size 0 max 16384 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee7b0d9740 1 Processor -- start 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee7b0d9740 1 -- start start 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfae5d0 0x55b55dfc5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfafb40 0x55b55dfb4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfd0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fee741af870 con 0x55b55dfafb40 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fee741b1650 con 0x55b55dfae5d0 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fee741b0000 con 0x55b55dfb9370 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee71d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfafb40 0x55b55dfb4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee71d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfafb40 0x55b55dfb4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44568/0 (socket says 172.21.15.42:44568) 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.657+0000 7fee71d9b640 1 -- 172.21.15.42:0/1378942463 learned_addr learned my addr 172.21.15.42:0/1378942463 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee72d9d640 1 --2- 172.21.15.42:0/1378942463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfd0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee71d9b640 1 -- 172.21.15.42:0/1378942463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 msgr2=0x55b55dfd0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee71d9b640 1 --2- 172.21.15.42:0/1378942463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfd0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee71d9b640 1 -- 172.21.15.42:0/1378942463 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfae5d0 msgr2=0x55b55dfc5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee71d9b640 1 --2- 172.21.15.42:0/1378942463 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfae5d0 0x55b55dfc5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee71d9b640 1 -- 172.21.15.42:0/1378942463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b55dfb4510 con 0x55b55dfafb40 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee71d9b640 1 --2- 172.21.15.42:0/1378942463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfafb40 0x55b55dfb4fa0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fee68004770 tx=0x7fee6806d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8cf5a26072e324 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee5bfff640 1 -- 172.21.15.42:0/1378942463 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee680ce070 con 0x55b55dfafb40 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee5bfff640 1 -- 172.21.15.42:0/1378942463 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee6809bed0 con 0x55b55dfafb40 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee5bfff640 1 -- 172.21.15.42:0/1378942463 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68097e40 con 0x55b55dfafb40 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee7b0d9740 1 -- 172.21.15.42:0/1378942463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfafb40 msgr2=0x55b55dfb4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.658+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/1378942463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfafb40 0x55b55dfb4fa0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fee68004770 tx=0x7fee6806d5a0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 -- 172.21.15.42:0/1378942463 shutdown_connections 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/1378942463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfb9370 0x55b55dfd0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/1378942463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfafb40 0x55b55dfb4fa0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/1378942463 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfae5d0 0x55b55dfc5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 -- 172.21.15.42:0/1378942463 >> 172.21.15.42:0/1378942463 conn(0x55b55df77310 msgr2=0x55b55dfb4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 -- 172.21.15.42:0/1378942463 shutdown_connections 2024-09-19T09:42:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 -- 172.21.15.42:0/1378942463 wait complete. 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 -- start start 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 Processor -- start 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfc18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfafb40 0x55b55dfc1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfb9370 0x55b55dfb2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fee741b0ef0 con 0x55b55dfae5d0 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fee741b0790 con 0x55b55dfb9370 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fee741ad850 con 0x55b55dfafb40 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7b0d9740 10 client.0 _ll_register_callbacks cb 0x7fee6400bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfc18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfc18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44584/0 (socket says 172.21.15.42:44584) 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.659+0000 7fee7259c640 1 -- 172.21.15.42:0/3796616311 learned_addr learned my addr 172.21.15.42:0/3796616311 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee71d9b640 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfafb40 0x55b55dfc1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee72d9d640 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfb9370 0x55b55dfb2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee7259c640 1 -- 172.21.15.42:0/3796616311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfafb40 msgr2=0x55b55dfc1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee7259c640 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfafb40 0x55b55dfc1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee7259c640 1 -- 172.21.15.42:0/3796616311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfb9370 msgr2=0x55b55dfb2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee7259c640 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfb9370 0x55b55dfb2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee7259c640 1 -- 172.21.15.42:0/3796616311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b55dfb34a0 con 0x55b55dfae5d0 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee7259c640 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfc18d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fee6400b5e0 tx=0x7fee64010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488c1c692b0b425d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee59ffb640 1 -- 172.21.15.42:0/3796616311 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64029070 con 0x55b55dfae5d0 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee59ffb640 1 -- 172.21.15.42:0/3796616311 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fee640035f0 con 0x55b55dfae5d0 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3796616311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee6809bed0 con 0x55b55dfae5d0 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee59ffb640 1 -- 172.21.15.42:0/3796616311 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fee6400b8e0 con 0x55b55dfae5d0 2024-09-19T09:42:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee7b0d9740 10 client.16656 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3796616311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b55e033630 con 0x55b55dfae5d0 2024-09-19T09:42:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.660+0000 7fee59ffb640 1 -- 172.21.15.42:0/3796616311 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee6809bed0 con 0x55b55dfae5d0 2024-09-19T09:42:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.661+0000 7fee59ffb640 1 -- 172.21.15.42:0/3796616311 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fee64036060 con 0x55b55dfae5d0 2024-09-19T09:42:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.661+0000 7fee7b0d9740 10 client.16656 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.661+0000 7fee7b0d9740 10 client.16656 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:42:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.661+0000 7fee7b0d9740 20 client.16656 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.661+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b55e033d60 0x55b55e036180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.661+0000 7fee7b0d9740 4 client.16656 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:42:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.661+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3796616311 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b55df1bd70 con 0x55b55e033d60 2024-09-19T09:42:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.661+0000 7fee71d9b640 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b55e033d60 0x55b55e036180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.661+0000 7fee71d9b640 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b55e033d60 0x55b55e036180 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=133d2f93df08d22b server_cookie=21c92915b42c86ab in_seq=0 out_seq=0 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.661+0000 7fee59ffb640 10 client.16656 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee59ffb640 1 -- 172.21.15.42:0/3796616311 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b55df1bd70 con 0x55b55e033d60 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee59ffb640 10 client.16656 handle_command_reply: tid=0 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 client.16656 shutdown 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3796616311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 msgr2=0x55b55dfc18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfc18d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fee6400b5e0 tx=0x7fee64010dd0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3796616311 shutdown_connections 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x55b55e033d60 0x55b55e036180 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b55dfb9370 0x55b55dfb2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee59ffb640 0 client.16656 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b55dfafb40 0x55b55dfc1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 --2- 172.21.15.42:0/3796616311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b55dfae5d0 0x55b55dfc18d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3796616311 >> 172.21.15.42:0/3796616311 conn(0x55b55df77310 msgr2=0x55b55dfb50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3796616311 shutdown_connections 2024-09-19T09:42:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 1 -- 172.21.15.42:0/3796616311 wait complete. 2024-09-19T09:42:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee7b0d9740 20 client.16656 trim_cache size 0 max 16384 2024-09-19T09:42:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee78d00640 1 -- 172.21.15.42:0/571472774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fee5c0a3240 msgr2=0x7fee5c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee78d00640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fee5c0a3240 0x7fee5c0a5700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fee6c004af0 tx=0x7fee6c004a80 comp rx=0 tx=0).stop 2024-09-19T09:42:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee78d00640 1 -- 172.21.15.42:0/571472774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee74102790 msgr2=0x7fee74074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee78d00640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee74102790 0x7fee74074a30 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fee6800d950 tx=0x7fee6800de10 comp rx=0 tx=0).stop 2024-09-19T09:42:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee78d00640 1 -- 172.21.15.42:0/571472774 shutdown_connections 2024-09-19T09:42:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee78d00640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fee5c0a3240 0x7fee5c0a5700 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee78d00640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee74106f10 0x7fee74074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee78d00640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee74102790 0x7fee74074a30 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee78d00640 1 --2- 172.21.15.42:0/571472774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee74101de0 0x7fee740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.662+0000 7fee78d00640 1 -- 172.21.15.42:0/571472774 >> 172.21.15.42:0/571472774 conn(0x7fee740fd8c0 msgr2=0x7fee740feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.663+0000 7fee78d00640 1 -- 172.21.15.42:0/571472774 shutdown_connections 2024-09-19T09:42:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:41.663+0000 7fee78d00640 1 -- 172.21.15.42:0/571472774 wait complete. 2024-09-19T09:42:41.843 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:42:42.537 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:42 smithi042 ceph-mon[31223]: pgmap v438: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 611 KiB/s wr, 232 op/s 2024-09-19T09:42:42.539 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:42:42.642 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:42.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:42 smithi171 ceph-mon[35803]: pgmap v438: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 611 KiB/s wr, 232 op/s 2024-09-19T09:42:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:42 smithi136 ceph-mon[34840]: pgmap v438: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 611 KiB/s wr, 232 op/s 2024-09-19T09:42:43.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.110+0000 7f0163538640 1 -- 172.21.15.42:0/1134996466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f015c101420 msgr2=0x7f015c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.110+0000 7f0163538640 1 --2- 172.21.15.42:0/1134996466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f015c101420 0x7f015c10d950 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0154009cd0 tx=0x7f015402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.110+0000 7f0163538640 1 -- 172.21.15.42:0/1134996466 shutdown_connections 2024-09-19T09:42:43.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.110+0000 7f0163538640 1 --2- 172.21.15.42:0/1134996466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f015c101420 0x7f015c10d950 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.110+0000 7f0163538640 1 --2- 172.21.15.42:0/1134996466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f015c100a80 0x7f015c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.110+0000 7f0163538640 1 --2- 172.21.15.42:0/1134996466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c106a80 0x7f015c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.110+0000 7f0163538640 1 -- 172.21.15.42:0/1134996466 >> 172.21.15.42:0/1134996466 conn(0x7f015c0fc7a0 msgr2=0x7f015c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.110+0000 7f0163538640 1 -- 172.21.15.42:0/1134996466 shutdown_connections 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.110+0000 7f0163538640 1 -- 172.21.15.42:0/1134996466 wait complete. 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0163538640 1 Processor -- start 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0163538640 1 -- start start 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0163538640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c100a80 0x7f015c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0163538640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f015c101420 0x7f015c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0163538640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f015c106a80 0x7f015c1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0163538640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f015c110e80 con 0x7f015c106a80 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0163538640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f015c110d00 con 0x7f015c100a80 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0163538640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f015c111000 con 0x7f015c101420 2024-09-19T09:42:43.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0161ad5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f015c106a80 0x7f015c1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0161ad5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f015c106a80 0x7f015c1a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44596/0 (socket says 172.21.15.42:44596) 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0161ad5640 1 -- 172.21.15.42:0/3873372377 learned_addr learned my addr 172.21.15.42:0/3873372377 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.111+0000 7f0160ad3640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f015c101420 0x7f015c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f01612d4640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c100a80 0x7f015c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f0161ad5640 1 -- 172.21.15.42:0/3873372377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f015c101420 msgr2=0x7f015c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f0161ad5640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f015c101420 0x7f015c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f0161ad5640 1 -- 172.21.15.42:0/3873372377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c100a80 msgr2=0x7f015c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f0161ad5640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c100a80 0x7f015c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f0161ad5640 1 -- 172.21.15.42:0/3873372377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c1a4870 con 0x7f015c106a80 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f0161ad5640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f015c106a80 0x7f015c1a4330 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0154005cc0 tx=0x7f0154003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f01527fc640 1 -- 172.21.15.42:0/3873372377 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154004040 con 0x7f015c106a80 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f01527fc640 1 -- 172.21.15.42:0/3873372377 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01540046c0 con 0x7f015c106a80 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f0163538640 1 -- 172.21.15.42:0/3873372377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015c1a4a40 con 0x7f015c106a80 2024-09-19T09:42:43.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f01527fc640 1 -- 172.21.15.42:0/3873372377 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154046480 con 0x7f015c106a80 2024-09-19T09:42:43.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.112+0000 7f0163538640 1 -- 172.21.15.42:0/3873372377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f015c1a4ef0 con 0x7f015c106a80 2024-09-19T09:42:43.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.113+0000 7f0163538640 1 -- 172.21.15.42:0/3873372377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f015c100ee0 con 0x7f015c106a80 2024-09-19T09:42:43.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.114+0000 7f01527fc640 1 -- 172.21.15.42:0/3873372377 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f01540305a0 con 0x7f015c106a80 2024-09-19T09:42:43.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.115+0000 7f01527fc640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01480a3240 0x7f01480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.115+0000 7f01612d4640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01480a3240 0x7f01480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.115+0000 7f01527fc640 1 -- 172.21.15.42:0/3873372377 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f015402e030 con 0x7f015c106a80 2024-09-19T09:42:43.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.115+0000 7f01612d4640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01480a3240 0x7f01480a5700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0158005e00 tx=0x7f0158005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:43.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.118+0000 7f01527fc640 1 -- 172.21.15.42:0/3873372377 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f015404b060 con 0x7f015c106a80 2024-09-19T09:42:43.174 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:43.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.335+0000 7f0163538640 1 -- 172.21.15.42:0/3873372377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f015c109010 con 0x7f015c106a80 2024-09-19T09:42:43.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.336+0000 7f01527fc640 1 -- 172.21.15.42:0/3873372377 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+12010 (secure 0 0 0) 0x7f01540bdd60 con 0x7f015c106a80 2024-09-19T09:42:43.338 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:42:43.338 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":38,"btime":"2024-09-19T09:42:32:397781+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:42:31.429090+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:42:43.339 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 38 2024-09-19T09:42:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 -- 172.21.15.42:0/3873372377 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01480a3240 msgr2=0x7f01480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01480a3240 0x7f01480a5700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0158005e00 tx=0x7f0158005c50 comp rx=0 tx=0).stop 2024-09-19T09:42:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 -- 172.21.15.42:0/3873372377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f015c106a80 msgr2=0x7f015c1a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f015c106a80 0x7f015c1a4330 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0154005cc0 tx=0x7f0154003970 comp rx=0 tx=0).stop 2024-09-19T09:42:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 -- 172.21.15.42:0/3873372377 shutdown_connections 2024-09-19T09:42:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01480a3240 0x7f01480a5700 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f015c106a80 0x7f015c1a4330 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f015c101420 0x7f015c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 --2- 172.21.15.42:0/3873372377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f015c100a80 0x7f015c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 -- 172.21.15.42:0/3873372377 >> 172.21.15.42:0/3873372377 conn(0x7f015c0fc7a0 msgr2=0x7f015c0fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:43.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 -- 172.21.15.42:0/3873372377 shutdown_connections 2024-09-19T09:42:43.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.339+0000 7f0163538640 1 -- 172.21.15.42:0/3873372377 wait complete. 2024-09-19T09:42:43.658 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:43 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3873372377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:43.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.741+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3565664909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67d4102ef0 msgr2=0x7f67d410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.741+0000 7f67d9f6c640 1 --2- 172.21.15.42:0/3565664909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67d4102ef0 0x7f67d410da40 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009ca0 tx=0x7f67cc02a950 comp rx=0 tx=0).stop 2024-09-19T09:42:43.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.741+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3565664909 shutdown_connections 2024-09-19T09:42:43.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.741+0000 7f67d9f6c640 1 --2- 172.21.15.42:0/3565664909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67d4102ef0 0x7f67d410da40 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.741+0000 7f67d9f6c640 1 --2- 172.21.15.42:0/3565664909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d4102570 0x7f67d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.741+0000 7f67d9f6c640 1 --2- 172.21.15.42:0/3565664909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67d4100e20 0x7f67d4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.741+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3565664909 >> 172.21.15.42:0/3565664909 conn(0x7f67d40fc7d0 msgr2=0x7f67d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.741+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3565664909 shutdown_connections 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.741+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3565664909 wait complete. 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.741+0000 7f67d9f6c640 1 Processor -- start 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d9f6c640 1 -- start start 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d9f6c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67d4100e20 0x7f67d4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d9f6c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d4102570 0x7f67d4198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d9f6c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67d4102ef0 0x7f67d419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d9f6c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f67d4110fa0 con 0x7f67d4102ef0 2024-09-19T09:42:43.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d9f6c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f67d4110e20 con 0x7f67d4102570 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d9f6c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f67d4111120 con 0x7f67d4100e20 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67d4102ef0 0x7f67d419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67d4102ef0 0x7f67d419ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44604/0 (socket says 172.21.15.42:44604) 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d3fff640 1 -- 172.21.15.42:0/3969442299 learned_addr learned my addr 172.21.15.42:0/3969442299 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d37fe640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67d4100e20 0x7f67d4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d4102570 0x7f67d4198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d3fff640 1 -- 172.21.15.42:0/3969442299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67d4100e20 msgr2=0x7f67d4198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d3fff640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67d4100e20 0x7f67d4198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d3fff640 1 -- 172.21.15.42:0/3969442299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d4102570 msgr2=0x7f67d4198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d3fff640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d4102570 0x7f67d4198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d3fff640 1 -- 172.21.15.42:0/3969442299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d419d540 con 0x7f67d4102ef0 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d4102570 0x7f67d4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:43.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d37fe640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67d4100e20 0x7f67d4198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.742+0000 7f67d3fff640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67d4102ef0 0x7f67d419ce60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f67cc006010 tx=0x7f67cc02f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.743+0000 7f67d0ff9640 1 -- 172.21.15.42:0/3969442299 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc034040 con 0x7f67d4102ef0 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.743+0000 7f67d0ff9640 1 -- 172.21.15.42:0/3969442299 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67cc003e00 con 0x7f67d4102ef0 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.743+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3969442299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d419d7d0 con 0x7f67d4102ef0 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.743+0000 7f67d0ff9640 1 -- 172.21.15.42:0/3969442299 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc045480 con 0x7f67d4102ef0 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.743+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3969442299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d41a5110 con 0x7f67d4102ef0 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.745+0000 7f67d0ff9640 1 -- 172.21.15.42:0/3969442299 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f67cc037020 con 0x7f67d4102ef0 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.745+0000 7f67dc345740 1 Processor -- start 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.745+0000 7f67dc345740 1 -- start start 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67dc345740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d84f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67dc345740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d84f5d0 0x55993d84fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67dc345740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 0x55993d85c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67dc345740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55993d7b52f0 con 0x55993d850b40 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67dc345740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55993d75ccf0 con 0x55993d85a370 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67dc345740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55993d7b12b0 con 0x55993d84f5d0 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d84f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d84f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44606/0 (socket says 172.21.15.42:44606) 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d37fe640 1 --2- 172.21.15.42:0/3063515066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d84f5d0 0x55993d84fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d2ffd640 1 -- 172.21.15.42:0/3063515066 learned_addr learned my addr 172.21.15.42:0/3063515066 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d0ff9640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f67bc0a3240 0x7f67bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d3fff640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f67bc0a3240 0x7f67bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3063515066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 0x55993d85c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d2ffd640 1 -- 172.21.15.42:0/3063515066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d84f5d0 msgr2=0x55993d84fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3063515066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d84f5d0 0x55993d84fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d2ffd640 1 -- 172.21.15.42:0/3063515066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 msgr2=0x55993d85c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:43.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3063515066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 0x55993d85c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d0ff9640 1 -- 172.21.15.42:0/3969442299 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f67cc0f0b60 con 0x7f67d4102ef0 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d2ffd640 1 -- 172.21.15.42:0/3063515066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993d7413a0 con 0x55993d850b40 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.746+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3063515066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d84f090 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f67c800bd80 tx=0x7f67c800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6fed818ae49ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67b9ffb640 1 -- 172.21.15.42:0/3063515066 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8012650 con 0x55993d850b40 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67d3fff640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f67bc0a3240 0x7f67bc0a5700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0bce60 tx=0x7f67cc0042c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67b9ffb640 1 -- 172.21.15.42:0/3063515066 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67c8012cd0 con 0x55993d850b40 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67b9ffb640 1 -- 172.21.15.42:0/3063515066 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c800fd80 con 0x55993d850b40 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67dc345740 1 -- 172.21.15.42:0/3063515066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 msgr2=0x55993d84f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67dc345740 1 --2- 172.21.15.42:0/3063515066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d84f090 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f67c800bd80 tx=0x7f67c800b7c0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67dc345740 1 -- 172.21.15.42:0/3063515066 shutdown_connections 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67dc345740 1 --2- 172.21.15.42:0/3063515066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 0x55993d85c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67dc345740 1 --2- 172.21.15.42:0/3063515066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d84f5d0 0x55993d84fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67dc345740 1 --2- 172.21.15.42:0/3063515066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d84f090 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67dc345740 1 -- 172.21.15.42:0/3063515066 >> 172.21.15.42:0/3063515066 conn(0x55993d818310 msgr2=0x55993d84bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67dc345740 1 -- 172.21.15.42:0/3063515066 shutdown_connections 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.747+0000 7f67dc345740 1 -- 172.21.15.42:0/3063515066 wait complete. 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.748+0000 7f67dc345740 1 -- start start 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.748+0000 7f67dc345740 1 Processor -- start 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.748+0000 7f67dc345740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d84f5d0 0x55993d859e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.748+0000 7f67dc345740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d850b40 0x55993d8570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.748+0000 7f67dc345740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d85a370 0x55993d857860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.748+0000 7f67dc345740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55993d85d070 con 0x55993d84f5d0 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.748+0000 7f67dc345740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55993d770060 con 0x55993d850b40 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.748+0000 7f67dc345740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55993d85d1f0 con 0x55993d85a370 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.748+0000 7f67dc345740 10 client.0 _ll_register_callbacks cb 0x55993d4c38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d84f5d0 0x55993d859e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d84f5d0 0x55993d859e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44610/0 (socket says 172.21.15.42:44610) 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d2ffd640 1 -- 172.21.15.42:0/868836088 learned_addr learned my addr 172.21.15.42:0/868836088 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d37fe640 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d850b40 0x55993d8570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d85a370 0x55993d857860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d2ffd640 1 -- 172.21.15.42:0/868836088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d85a370 msgr2=0x55993d857860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d85a370 0x55993d857860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d2ffd640 1 -- 172.21.15.42:0/868836088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d850b40 msgr2=0x55993d8570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d850b40 0x55993d8570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d2ffd640 1 -- 172.21.15.42:0/868836088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55993d5263c0 con 0x55993d84f5d0 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d84f5d0 0x55993d859e20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f67c800b310 tx=0x7f67c800bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180c70afd142fd32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67b2ffd640 1 -- 172.21.15.42:0/868836088 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c802b060 con 0x55993d84f5d0 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67b2ffd640 1 -- 172.21.15.42:0/868836088 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f67c8012a70 con 0x55993d84f5d0 2024-09-19T09:42:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.749+0000 7f67dc345740 1 -- 172.21.15.42:0/868836088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67c8012cd0 con 0x55993d84f5d0 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67b2ffd640 1 -- 172.21.15.42:0/868836088 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f67c800f420 con 0x55993d84f5d0 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67dc345740 10 client.16674 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67dc345740 1 -- 172.21.15.42:0/868836088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55993d868be0 con 0x55993d84f5d0 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67b2ffd640 1 -- 172.21.15.42:0/868836088 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67c8012cd0 con 0x55993d84f5d0 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67b2ffd640 1 -- 172.21.15.42:0/868836088 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f67c80303b0 con 0x55993d84f5d0 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67dc345740 10 client.16674 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67dc345740 10 client.16674 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67dc345740 20 client.16674 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67dc345740 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55993d869f30 0x55993d86c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67dc345740 4 client.16674 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67dc345740 1 -- 172.21.15.42:0/868836088 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55993d7c2860 con 0x55993d869f30 2024-09-19T09:42:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.750+0000 7f67d37fe640 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55993d869f30 0x55993d86c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.751+0000 7f67b2ffd640 10 client.16674 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.751+0000 7f67d37fe640 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55993d869f30 0x55993d86c320 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9a44e7d1da8de27d server_cookie=75fdd48e7f261df7 in_seq=0 out_seq=0 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67b2ffd640 1 -- 172.21.15.42:0/868836088 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55993d7c2860 con 0x55993d869f30 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67b2ffd640 10 client.16674 handle_command_reply: tid=0 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 client.16674 shutdown 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 -- 172.21.15.42:0/868836088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d84f5d0 msgr2=0x55993d859e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d84f5d0 0x55993d859e20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f67c800b310 tx=0x7f67c800bfb0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 -- 172.21.15.42:0/868836088 shutdown_connections 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55993d869f30 0x55993d86c320 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d85a370 0x55993d857860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d850b40 0x55993d8570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 --2- 172.21.15.42:0/868836088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d84f5d0 0x55993d859e20 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 -- 172.21.15.42:0/868836088 >> 172.21.15.42:0/868836088 conn(0x55993d818310 msgr2=0x55993d851960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:43.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67b2ffd640 0 client.16674 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:42:43.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 -- 172.21.15.42:0/868836088 shutdown_connections 2024-09-19T09:42:43.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 1 -- 172.21.15.42:0/868836088 wait complete. 2024-09-19T09:42:43.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.752+0000 7f67dc345740 20 client.16674 trim_cache size 0 max 16384 2024-09-19T09:42:43.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.765+0000 7f67dc345740 1 Processor -- start 2024-09-19T09:42:43.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.765+0000 7f67dc345740 1 -- start start 2024-09-19T09:42:43.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.765+0000 7f67dc345740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d84f5d0 0x55993d846c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.765+0000 7f67dc345740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d850b40 0x55993d84ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.765+0000 7f67dc345740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d85a370 0x55993d851820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.765+0000 7f67dc345740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f67d41ad5b0 con 0x55993d85a370 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.765+0000 7f67dc345740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f67d41af390 con 0x55993d84f5d0 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.765+0000 7f67dc345740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f67d41add40 con 0x55993d850b40 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67d2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d85a370 0x55993d851820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67d2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d85a370 0x55993d851820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44618/0 (socket says 172.21.15.42:44618) 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67d2ffd640 1 -- 172.21.15.42:0/1399856588 learned_addr learned my addr 172.21.15.42:0/1399856588 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/1399856588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d84f5d0 0x55993d846c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67d2ffd640 1 -- 172.21.15.42:0/1399856588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d850b40 msgr2=0x55993d84ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/1399856588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d850b40 0x55993d84ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67d2ffd640 1 -- 172.21.15.42:0/1399856588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d84f5d0 msgr2=0x55993d846c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:43.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/1399856588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d84f5d0 0x55993d846c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67d2ffd640 1 -- 172.21.15.42:0/1399856588 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993d856080 con 0x55993d85a370 2024-09-19T09:42:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/1399856588 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d85a370 0x55993d851820 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f67c800bd80 tx=0x7f67c800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08d0893d42b4b22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67b97fa640 1 -- 172.21.15.42:0/1399856588 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c802b040 con 0x55993d85a370 2024-09-19T09:42:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67b97fa640 1 -- 172.21.15.42:0/1399856588 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67c800f5c0 con 0x55993d85a370 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.766+0000 7f67b97fa640 1 -- 172.21.15.42:0/1399856588 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c80309a0 con 0x55993d85a370 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 -- 172.21.15.42:0/1399856588 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d85a370 msgr2=0x55993d851820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 --2- 172.21.15.42:0/1399856588 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d85a370 0x55993d851820 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f67c800bd80 tx=0x7f67c800b7c0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 -- 172.21.15.42:0/1399856588 shutdown_connections 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 --2- 172.21.15.42:0/1399856588 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d85a370 0x55993d851820 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 --2- 172.21.15.42:0/1399856588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d850b40 0x55993d84ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 --2- 172.21.15.42:0/1399856588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d84f5d0 0x55993d846c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 -- 172.21.15.42:0/1399856588 >> 172.21.15.42:0/1399856588 conn(0x55993d818310 msgr2=0x55993d851110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 -- 172.21.15.42:0/1399856588 shutdown_connections 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 -- 172.21.15.42:0/1399856588 wait complete. 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 -- start start 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.767+0000 7f67dc345740 1 Processor -- start 2024-09-19T09:42:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67dc345740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d84f5d0 0x55993d862990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67dc345740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d85dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67dc345740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 0x55993d85e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67dc345740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f67d41aec30 con 0x55993d850b40 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67dc345740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f67d41ae4d0 con 0x55993d85a370 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67dc345740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f67d41ab590 con 0x55993d84f5d0 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67dc345740 10 client.0 _ll_register_callbacks cb 0x7f67c40071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d85dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d85dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44628/0 (socket says 172.21.15.42:44628) 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d37fe640 1 -- 172.21.15.42:0/3632187786 learned_addr learned my addr 172.21.15.42:0/3632187786 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d84f5d0 0x55993d862990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 0x55993d85e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d37fe640 1 -- 172.21.15.42:0/3632187786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d84f5d0 msgr2=0x55993d862990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d37fe640 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d84f5d0 0x55993d862990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d37fe640 1 -- 172.21.15.42:0/3632187786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 msgr2=0x55993d85e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d37fe640 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 0x55993d85e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d37fe640 1 -- 172.21.15.42:0/3632187786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55993d857bd0 con 0x55993d850b40 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 0x55993d85e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67d37fe640 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d85dcc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55993d856960 tx=0x7f67c4016800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e09436b6c2de009 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.768+0000 7f67b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67b2ffd640 1 -- 172.21.15.42:0/3632187786 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c401c250 con 0x55993d850b40 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67b2ffd640 1 -- 172.21.15.42:0/3632187786 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f67c400f040 con 0x55993d850b40 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67dc345740 1 -- 172.21.15.42:0/3632187786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67c800f5c0 con 0x55993d850b40 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67b2ffd640 1 -- 172.21.15.42:0/3632187786 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f67c402c050 con 0x55993d850b40 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67dc345740 10 client.16680 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67dc345740 1 -- 172.21.15.42:0/3632187786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55993d8d4610 con 0x55993d850b40 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67b2ffd640 1 -- 172.21.15.42:0/3632187786 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67c800f5c0 con 0x55993d850b40 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67b2ffd640 1 -- 172.21.15.42:0/3632187786 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f67c4024650 con 0x55993d850b40 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67dc345740 10 client.16680 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67dc345740 10 client.16680 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67dc345740 20 client.16680 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67dc345740 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55993d8d4e60 0x55993d8d7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67dc345740 4 client.16680 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67dc345740 1 -- 172.21.15.42:0/3632187786 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55993d7bcd70 con 0x55993d8d4e60 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.769+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55993d8d4e60 0x55993d8d7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67d2ffd640 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55993d8d4e60 0x55993d8d7280 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d33cbdb8a4a7a9ff server_cookie=fbc94a89c957fe4c in_seq=0 out_seq=0 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67b2ffd640 10 client.16680 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67b2ffd640 1 -- 172.21.15.42:0/3632187786 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55993d7bcd70 con 0x55993d8d4e60 2024-09-19T09:42:43.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67b2ffd640 10 client.16680 handle_command_reply: tid=0 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 client.16680 shutdown 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 -- 172.21.15.42:0/3632187786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 msgr2=0x55993d85dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d85dcc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55993d856960 tx=0x7f67c4016800 comp rx=0 tx=0).stop 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 -- 172.21.15.42:0/3632187786 shutdown_connections 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x55993d8d4e60 0x55993d8d7280 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55993d85a370 0x55993d85e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55993d850b40 0x55993d85dcc0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67b2ffd640 0 client.16680 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 --2- 172.21.15.42:0/3632187786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55993d84f5d0 0x55993d862990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 -- 172.21.15.42:0/3632187786 >> 172.21.15.42:0/3632187786 conn(0x55993d818310 msgr2=0x55993d858930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 -- 172.21.15.42:0/3632187786 shutdown_connections 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.770+0000 7f67dc345740 1 -- 172.21.15.42:0/3632187786 wait complete. 2024-09-19T09:42:43.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67dc345740 20 client.16680 trim_cache size 0 max 16384 2024-09-19T09:42:43.778 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:42:43.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3969442299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f67bc0a3240 msgr2=0x7f67bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f67bc0a3240 0x7f67bc0a5700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0bce60 tx=0x7f67cc0042c0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3969442299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67d4102ef0 msgr2=0x7f67d419ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:43.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67d4102ef0 0x7f67d419ce60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f67cc006010 tx=0x7f67cc02f6f0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3969442299 shutdown_connections 2024-09-19T09:42:43.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f67bc0a3240 0x7f67bc0a5700 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67d4102ef0 0x7f67d419ce60 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d4102570 0x7f67d4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 --2- 172.21.15.42:0/3969442299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67d4100e20 0x7f67d4198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:43.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3969442299 >> 172.21.15.42:0/3969442299 conn(0x7f67d40fc7d0 msgr2=0x7f67d406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:43.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3969442299 shutdown_connections 2024-09-19T09:42:43.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:43.771+0000 7f67d9f6c640 1 -- 172.21.15.42:0/3969442299 wait complete. 2024-09-19T09:42:43.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:43 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3873372377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:43 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3873372377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:44.497 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id 41d56c9e --release --await' 2024-09-19T09:42:44.497 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id 41d56c9e --release --await 2024-09-19T09:42:44.574 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:44 smithi042 ceph-mon[31223]: pgmap v439: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 185 KiB/s wr, 108 op/s 2024-09-19T09:42:44.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:44 smithi171 ceph-mon[35803]: pgmap v439: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 185 KiB/s wr, 108 op/s 2024-09-19T09:42:45.063 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:44 smithi136 ceph-mon[34840]: pgmap v439: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 185 KiB/s wr, 108 op/s 2024-09-19T09:42:45.064 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:42:45.065 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:46.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.609+0000 7f4020d1a640 1 -- 172.21.15.42:0/4100384101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f401c101420 msgr2=0x7f401c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.609+0000 7f4020d1a640 1 --2- 172.21.15.42:0/4100384101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f401c101420 0x7f401c10d950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4014009930 tx=0x7f401402a420 comp rx=0 tx=0).stop 2024-09-19T09:42:46.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.609+0000 7f4020d1a640 1 -- 172.21.15.42:0/4100384101 shutdown_connections 2024-09-19T09:42:46.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.609+0000 7f4020d1a640 1 --2- 172.21.15.42:0/4100384101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f401c101420 0x7f401c10d950 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.609+0000 7f4020d1a640 1 --2- 172.21.15.42:0/4100384101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f401c100a80 0x7f401c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.609+0000 7f4020d1a640 1 --2- 172.21.15.42:0/4100384101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c106a80 0x7f401c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.609+0000 7f4020d1a640 1 -- 172.21.15.42:0/4100384101 >> 172.21.15.42:0/4100384101 conn(0x7f401c0fc7a0 msgr2=0x7f401c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.609+0000 7f4020d1a640 1 -- 172.21.15.42:0/4100384101 shutdown_connections 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.609+0000 7f4020d1a640 1 -- 172.21.15.42:0/4100384101 wait complete. 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4020d1a640 1 Processor -- start 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4020d1a640 1 -- start start 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4020d1a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c100a80 0x7f401c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4020d1a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f401c101420 0x7f401c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4020d1a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f401c106a80 0x7f401c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4020d1a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f401c110e80 con 0x7f401c101420 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4020d1a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f401c110d00 con 0x7f401c106a80 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4020d1a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f401c111000 con 0x7f401c100a80 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4019d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f401c101420 0x7f401c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4019d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f401c101420 0x7f401c198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44644/0 (socket says 172.21.15.42:44644) 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4019d9b640 1 -- 172.21.15.42:0/3061059342 learned_addr learned my addr 172.21.15.42:0/3061059342 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:46.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f401a59c640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c100a80 0x7f401c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f401ad9d640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f401c106a80 0x7f401c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4019d9b640 1 -- 172.21.15.42:0/3061059342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c100a80 msgr2=0x7f401c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4019d9b640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c100a80 0x7f401c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4019d9b640 1 -- 172.21.15.42:0/3061059342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f401c106a80 msgr2=0x7f401c19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4019d9b640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f401c106a80 0x7f401c19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f4019d9b640 1 -- 172.21.15.42:0/3061059342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401c19d470 con 0x7f401c101420 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.610+0000 7f401ad9d640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f401c106a80 0x7f401c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.611+0000 7f4019d9b640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f401c101420 0x7f401c198a00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f401000ebc0 tx=0x7f401000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.611+0000 7f400b7fe640 1 -- 172.21.15.42:0/3061059342 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010010630 con 0x7f401c101420 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.611+0000 7f400b7fe640 1 -- 172.21.15.42:0/3061059342 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4010010cb0 con 0x7f401c101420 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.611+0000 7f4020d1a640 1 -- 172.21.15.42:0/3061059342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401c19d760 con 0x7f401c101420 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.611+0000 7f400b7fe640 1 -- 172.21.15.42:0/3061059342 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010018bd0 con 0x7f401c101420 2024-09-19T09:42:46.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.611+0000 7f4020d1a640 1 -- 172.21.15.42:0/3061059342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f401c1a5040 con 0x7f401c101420 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.613+0000 7f400b7fe640 1 -- 172.21.15.42:0/3061059342 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f40100107d0 con 0x7f401c101420 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.613+0000 7f40230f3740 1 Processor -- start 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f40230f3740 1 -- start start 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f40230f3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513e0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f40230f3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0980 0x55b0513ead00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f40230f3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513eb240 0x55b0513ed630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f40230f3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b051345620 con 0x55b0513e0980 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f40230f3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b0512ece50 con 0x55b0513e0060 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f40230f3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b0513415e0 con 0x55b0513eb240 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f401a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0980 0x55b0513ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f401a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0980 0x55b0513ead00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44648/0 (socket says 172.21.15.42:44648) 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f401a59c640 1 -- 172.21.15.42:0/2884037394 learned_addr learned my addr 172.21.15.42:0/2884037394 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f4019d9b640 1 --2- 172.21.15.42:0/2884037394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513eb240 0x55b0513ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f400b7fe640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40040a3240 0x7f40040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.050 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:42:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 38, 2024-09-19T09:42:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 24506, 2024-09-19T09:42:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 16, 2024-09-19T09:42:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": { 2024-09-19T09:42:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "41d56c9e": { 2024-09-19T09:42:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 16, 2024-09-19T09:42:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "age_ref": 0.0, 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "timeout": 90.0, 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "expiration": 136.6, 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "members": { 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "file:/": { 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "excluded": false, 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "state": { 2024-09-19T09:42:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RELEASED", 2024-09-19T09:42:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0 2024-09-19T09:42:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:46.052 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:42:46.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f401ad9d640 1 --2- 172.21.15.42:0/2884037394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513e0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f401a59c640 1 -- 172.21.15.42:0/2884037394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513eb240 msgr2=0x55b0513ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f401a59c640 1 --2- 172.21.15.42:0/2884037394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513eb240 0x55b0513ed630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f401ad9d640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40040a3240 0x7f40040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f401a59c640 1 -- 172.21.15.42:0/2884037394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 msgr2=0x55b0513e0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f401a59c640 1 --2- 172.21.15.42:0/2884037394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513e0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.614+0000 7f401a59c640 1 -- 172.21.15.42:0/2884037394 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0512ddd40 con 0x55b0513e0980 2024-09-19T09:42:46.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.615+0000 7f400b7fe640 1 -- 172.21.15.42:0/3061059342 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f40100d0000 con 0x7f401c101420 2024-09-19T09:42:46.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.615+0000 7f401a59c640 1 --2- 172.21.15.42:0/2884037394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0980 0x55b0513ead00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f400c00b710 tx=0x7f400c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5020f5f00d8cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.615+0000 7f401ad9d640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40040a3240 0x7f40040a5700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4014031550 tx=0x7f4014009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.615+0000 7f4008ff9640 1 -- 172.21.15.42:0/2884037394 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c003bd0 con 0x55b0513e0980 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.615+0000 7f4008ff9640 1 -- 172.21.15.42:0/2884037394 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f400c015070 con 0x55b0513e0980 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.615+0000 7f4008ff9640 1 -- 172.21.15.42:0/2884037394 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c004e60 con 0x55b0513e0980 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 -- 172.21.15.42:0/2884037394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0980 msgr2=0x55b0513ead00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 --2- 172.21.15.42:0/2884037394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0980 0x55b0513ead00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f400c00b710 tx=0x7f400c004610 comp rx=0 tx=0).stop 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 -- 172.21.15.42:0/2884037394 shutdown_connections 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 --2- 172.21.15.42:0/2884037394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513eb240 0x55b0513ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 --2- 172.21.15.42:0/2884037394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0980 0x55b0513ead00 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 --2- 172.21.15.42:0/2884037394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513e0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 -- 172.21.15.42:0/2884037394 >> 172.21.15.42:0/2884037394 conn(0x55b0513dc5f0 msgr2=0x55b0513dc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 -- 172.21.15.42:0/2884037394 shutdown_connections 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 -- 172.21.15.42:0/2884037394 wait complete. 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 -- start start 2024-09-19T09:42:46.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 Processor -- start 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0060 0x55b0513e8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b0513e8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513eb240 0x55b0513e8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b0513ede10 con 0x55b0513e0060 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b0512cdf10 con 0x55b0513eb240 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.616+0000 7f40230f3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b0513edf90 con 0x55b0513e0980 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f40230f3740 10 client.0 _ll_register_callbacks cb 0x55b0512f1db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f401a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0060 0x55b0513e8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f401a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0060 0x55b0513e8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44660/0 (socket says 172.21.15.42:44660) 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f401a59c640 1 -- 172.21.15.42:0/57244908 learned_addr learned my addr 172.21.15.42:0/57244908 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f401ad9d640 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513eb240 0x55b0513e8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f4019d9b640 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b0513e8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f401a59c640 1 -- 172.21.15.42:0/57244908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 msgr2=0x55b0513e8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f401a59c640 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b0513e8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f401a59c640 1 -- 172.21.15.42:0/57244908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513eb240 msgr2=0x55b0513e8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f401a59c640 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513eb240 0x55b0513e8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f401a59c640 1 -- 172.21.15.42:0/57244908 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b051054580 con 0x55b0513e0060 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f401a59c640 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0060 0x55b0513e8120 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f400c0039c0 tx=0x7f400c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158f30f30170d702 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f4001ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f4001ffb640 1 -- 172.21.15.42:0/57244908 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c028060 con 0x55b0513e0060 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f4001ffb640 1 -- 172.21.15.42:0/57244908 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f400c011440 con 0x55b0513e0060 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.617+0000 7f40230f3740 1 -- 172.21.15.42:0/57244908 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f400c015070 con 0x55b0513e0060 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f4001ffb640 1 -- 172.21.15.42:0/57244908 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f400c011640 con 0x55b0513e0060 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f40230f3740 10 client.16692 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f40230f3740 1 -- 172.21.15.42:0/57244908 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b05111e960 con 0x55b0513e0060 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f4001ffb640 1 -- 172.21.15.42:0/57244908 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f400c015070 con 0x55b0513e0060 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f4001ffb640 1 -- 172.21.15.42:0/57244908 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f400c022070 con 0x55b0513e0060 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f40230f3740 10 client.16692 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:46.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f40230f3740 10 client.16692 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f40230f3740 20 client.16692 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f40230f3740 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b0513ff220 0x55b051401610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f40230f3740 4 client.16692 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f40230f3740 1 -- 172.21.15.42:0/57244908 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b051352b90 con 0x55b0513ff220 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.618+0000 7f4019d9b640 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b0513ff220 0x55b051401610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.619+0000 7f4019d9b640 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b0513ff220 0x55b051401610 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2dd4f2dd380e67e server_cookie=eee2a8b689ddef6d in_seq=0 out_seq=0 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.619+0000 7f4001ffb640 10 client.16692 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.619+0000 7f4001ffb640 1 -- 172.21.15.42:0/57244908 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b051352b90 con 0x55b0513ff220 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.619+0000 7f4001ffb640 10 client.16692 handle_command_reply: tid=0 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.619+0000 7f40230f3740 1 client.16692 shutdown 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 1 -- 172.21.15.42:0/57244908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0060 msgr2=0x55b0513e8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0060 0x55b0513e8120 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f400c0039c0 tx=0x7f400c0042e0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 1 -- 172.21.15.42:0/57244908 shutdown_connections 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b0513ff220 0x55b051401610 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513eb240 0x55b0513e8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f4001ffb640 0 client.16692 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b0513e8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 1 --2- 172.21.15.42:0/57244908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513e0060 0x55b0513e8120 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 1 -- 172.21.15.42:0/57244908 >> 172.21.15.42:0/57244908 conn(0x55b0513dc5f0 msgr2=0x55b0513e2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 1 -- 172.21.15.42:0/57244908 shutdown_connections 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 1 -- 172.21.15.42:0/57244908 wait complete. 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.620+0000 7f40230f3740 20 client.16692 trim_cache size 0 max 16384 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f40230f3740 1 Processor -- start 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f40230f3740 1 -- start start 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f40230f3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f40230f3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b051406c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f40230f3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b0514071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f40230f3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1ab410 con 0x55b0513eb240 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f40230f3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1ad1f0 con 0x55b0513e0060 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f40230f3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1abba0 con 0x55b0513e0980 2024-09-19T09:42:46.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f401ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b0514071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f401ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b0514071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44662/0 (socket says 172.21.15.42:44662) 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f401ad9d640 1 -- 172.21.15.42:0/1282717365 learned_addr learned my addr 172.21.15.42:0/1282717365 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f4019d9b640 1 --2- 172.21.15.42:0/1282717365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b051406c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.637+0000 7f401a59c640 1 --2- 172.21.15.42:0/1282717365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.638+0000 7f401ad9d640 1 -- 172.21.15.42:0/1282717365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 msgr2=0x55b051406c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.638+0000 7f401ad9d640 1 --2- 172.21.15.42:0/1282717365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b051406c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.638+0000 7f401ad9d640 1 -- 172.21.15.42:0/1282717365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 msgr2=0x55b0513e2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.638+0000 7f401ad9d640 1 --2- 172.21.15.42:0/1282717365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513e2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.638+0000 7f401ad9d640 1 -- 172.21.15.42:0/1282717365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0513dfde0 con 0x55b0513eb240 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.638+0000 7f401a59c640 1 --2- 172.21.15.42:0/1282717365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513e2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.638+0000 7f401ad9d640 1 --2- 172.21.15.42:0/1282717365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b0514071b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4014009930 tx=0x7f4014039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3041ae83910d85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.638+0000 7f4003fff640 1 -- 172.21.15.42:0/1282717365 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014035040 con 0x55b0513eb240 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.638+0000 7f4003fff640 1 -- 172.21.15.42:0/1282717365 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4014003d90 con 0x55b0513eb240 2024-09-19T09:42:46.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.638+0000 7f4003fff640 1 -- 172.21.15.42:0/1282717365 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401403d3f0 con 0x55b0513eb240 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 -- 172.21.15.42:0/1282717365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 msgr2=0x55b0514071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 --2- 172.21.15.42:0/1282717365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b0514071b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4014009930 tx=0x7f4014039000 comp rx=0 tx=0).stop 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 -- 172.21.15.42:0/1282717365 shutdown_connections 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 --2- 172.21.15.42:0/1282717365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b0514071b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 --2- 172.21.15.42:0/1282717365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b051406c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 --2- 172.21.15.42:0/1282717365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513e2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 -- 172.21.15.42:0/1282717365 >> 172.21.15.42:0/1282717365 conn(0x55b0513dc5f0 msgr2=0x55b0513ea1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 -- 172.21.15.42:0/1282717365 shutdown_connections 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 -- 172.21.15.42:0/1282717365 wait complete. 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 -- start start 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 Processor -- start 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.639+0000 7f40230f3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b0513f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f40230f3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b051468c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f40230f3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1aca90 con 0x55b0513eb240 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f40230f3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1ac330 con 0x55b0513e0060 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f40230f3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1a93f0 con 0x55b0513e0980 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f40230f3740 10 client.0 _ll_register_callbacks cb 0x7f400c004510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f401ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b051468c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f401ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b051468c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44674/0 (socket says 172.21.15.42:44674) 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f401ad9d640 1 -- 172.21.15.42:0/617432753 learned_addr learned my addr 172.21.15.42:0/617432753 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f4019d9b640 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b0513f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f401a59c640 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f401ad9d640 1 -- 172.21.15.42:0/617432753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 msgr2=0x55b0513f3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f401ad9d640 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b0513f3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f401ad9d640 1 -- 172.21.15.42:0/617432753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 msgr2=0x55b0513f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f401ad9d640 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f401ad9d640 1 -- 172.21.15.42:0/617432753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b051469180 con 0x55b0513eb240 2024-09-19T09:42:46.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f401ad9d640 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b051468c40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f401402a940 tx=0x7f4014009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8b25be688bc253 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f4001ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f4001ffb640 1 -- 172.21.15.42:0/617432753 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014035040 con 0x55b0513eb240 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f4001ffb640 1 -- 172.21.15.42:0/617432753 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4014003ac0 con 0x55b0513eb240 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f40230f3740 1 -- 172.21.15.42:0/617432753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4014003d90 con 0x55b0513eb240 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f4001ffb640 1 -- 172.21.15.42:0/617432753 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f401404a840 con 0x55b0513eb240 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f40230f3740 10 client.16698 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.640+0000 7f40230f3740 1 -- 172.21.15.42:0/617432753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b05146a3d0 con 0x55b0513eb240 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.641+0000 7f4001ffb640 1 -- 172.21.15.42:0/617432753 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4014003d90 con 0x55b0513eb240 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.641+0000 7f4001ffb640 1 -- 172.21.15.42:0/617432753 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f401403a040 con 0x55b0513eb240 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.641+0000 7f40230f3740 10 client.16698 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.641+0000 7f40230f3740 10 client.16698 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.641+0000 7f40230f3740 20 client.16698 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.641+0000 7f40230f3740 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b05146aa90 0x55b05146ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.641+0000 7f40230f3740 4 client.16698 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "41d56c9e", "release": true, "await": true}] 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.641+0000 7f40230f3740 1 -- 172.21.15.42:0/617432753 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "quiesce db", "set_id": "41d56c9e", "release": true, "await": true}) -- 0x55b05134d0a0 con 0x55b05146aa90 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.641+0000 7f401a59c640 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b05146aa90 0x55b05146ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.642+0000 7f4001ffb640 10 client.16698 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.642+0000 7f401a59c640 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b05146aa90 0x55b05146ce80 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3fb137a418ebad7 server_cookie=da6420865d99aae2 in_seq=0 out_seq=0 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f4001ffb640 1 -- 172.21.15.42:0/617432753 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b05134d0a0 con 0x55b05146aa90 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f4001ffb640 10 client.16698 handle_command_reply: tid=0 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 client.16698 shutdown 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 -- 172.21.15.42:0/617432753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 msgr2=0x55b051468c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b051468c40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f401402a940 tx=0x7f4014009590 comp rx=0 tx=0).stop 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 -- 172.21.15.42:0/617432753 shutdown_connections 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55b05146aa90 0x55b05146ce80 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0513eb240 0x55b051468c40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b0513e0980 0x55b0513f3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f4001ffb640 0 client.16698 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 --2- 172.21.15.42:0/617432753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b0513e0060 0x55b0513f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 -- 172.21.15.42:0/617432753 >> 172.21.15.42:0/617432753 conn(0x55b0513dc5f0 msgr2=0x55b0513daf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 -- 172.21.15.42:0/617432753 shutdown_connections 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 1 -- 172.21.15.42:0/617432753 wait complete. 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.745+0000 7f40230f3740 20 client.16698 trim_cache size 0 max 16384 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 -- 172.21.15.42:0/3061059342 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40040a3240 msgr2=0x7f40040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40040a3240 0x7f40040a5700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4014031550 tx=0x7f4014009260 comp rx=0 tx=0).stop 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 -- 172.21.15.42:0/3061059342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f401c101420 msgr2=0x7f401c198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f401c101420 0x7f401c198a00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f401000ebc0 tx=0x7f401000c6a0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 -- 172.21.15.42:0/3061059342 shutdown_connections 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f40040a3240 0x7f40040a5700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f401c106a80 0x7f401c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f401c101420 0x7f401c198a00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 --2- 172.21.15.42:0/3061059342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f401c100a80 0x7f401c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 -- 172.21.15.42:0/3061059342 >> 172.21.15.42:0/3061059342 conn(0x7f401c0fc7a0 msgr2=0x7f401c06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 -- 172.21.15.42:0/3061059342 shutdown_connections 2024-09-19T09:42:46.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:45.746+0000 7f4020d1a640 1 -- 172.21.15.42:0/3061059342 wait complete. 2024-09-19T09:42:46.351 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:46.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:46 smithi042 ceph-mon[31223]: pgmap v440: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 21 KiB/s wr, 30 op/s 2024-09-19T09:42:46.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.813+0000 7f43c51f0640 1 -- 172.21.15.42:0/452216340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0102570 msgr2=0x7f43c01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.813+0000 7f43c51f0640 1 --2- 172.21.15.42:0/452216340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0102570 0x7f43c01029b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009900 tx=0x7f43b402a480 comp rx=0 tx=0).stop 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.814+0000 7f43c51f0640 1 -- 172.21.15.42:0/452216340 shutdown_connections 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.814+0000 7f43c51f0640 1 --2- 172.21.15.42:0/452216340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c0102ef0 0x7f43c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.814+0000 7f43c51f0640 1 --2- 172.21.15.42:0/452216340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0102570 0x7f43c01029b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.814+0000 7f43c51f0640 1 --2- 172.21.15.42:0/452216340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c0100e20 0x7f43c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.814+0000 7f43c51f0640 1 -- 172.21.15.42:0/452216340 >> 172.21.15.42:0/452216340 conn(0x7f43c00fc7d0 msgr2=0x7f43c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.814+0000 7f43c51f0640 1 -- 172.21.15.42:0/452216340 shutdown_connections 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.814+0000 7f43c51f0640 1 -- 172.21.15.42:0/452216340 wait complete. 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.814+0000 7f43c51f0640 1 Processor -- start 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43c51f0640 1 -- start start 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43c51f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0100e20 0x7f43c01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43c51f0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c0102570 0x7f43c0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43c51f0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c0102ef0 0x7f43c019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43c51f0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f43c0110f80 con 0x7f43c0100e20 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43c51f0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f43c0110e00 con 0x7f43c0102ef0 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43c51f0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f43c0111100 con 0x7f43c0102570 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43bed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0100e20 0x7f43c01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43bed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0100e20 0x7f43c01984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44696/0 (socket says 172.21.15.42:44696) 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43bed9d640 1 -- 172.21.15.42:0/1536956019 learned_addr learned my addr 172.21.15.42:0/1536956019 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43be59c640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c0102570 0x7f43c0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43bf59e640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c0102ef0 0x7f43c019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43bed9d640 1 -- 172.21.15.42:0/1536956019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c0102570 msgr2=0x7f43c0198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43bed9d640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c0102570 0x7f43c0198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43bed9d640 1 -- 172.21.15.42:0/1536956019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c0102ef0 msgr2=0x7f43c019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43bed9d640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c0102ef0 0x7f43c019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43bed9d640 1 -- 172.21.15.42:0/1536956019 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c019d490 con 0x7f43c0100e20 2024-09-19T09:42:46.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.815+0000 7f43bed9d640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0100e20 0x7f43c01984e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f43b000e9f0 tx=0x7f43b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.816+0000 7f43a7fff640 1 -- 172.21.15.42:0/1536956019 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b000cd80 con 0x7f43c0100e20 2024-09-19T09:42:46.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.816+0000 7f43a7fff640 1 -- 172.21.15.42:0/1536956019 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43b0010910 con 0x7f43c0100e20 2024-09-19T09:42:46.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.816+0000 7f43c51f0640 1 -- 172.21.15.42:0/1536956019 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c019d780 con 0x7f43c0100e20 2024-09-19T09:42:46.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.816+0000 7f43a7fff640 1 -- 172.21.15.42:0/1536956019 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0018990 con 0x7f43c0100e20 2024-09-19T09:42:46.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.816+0000 7f43c51f0640 1 -- 172.21.15.42:0/1536956019 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c01a5060 con 0x7f43c0100e20 2024-09-19T09:42:46.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.819+0000 7f43a7fff640 1 -- 172.21.15.42:0/1536956019 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f43b0010ac0 con 0x7f43c0100e20 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.819+0000 7f43c75c9740 1 Processor -- start 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.819+0000 7f43c75c9740 1 -- start start 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.819+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f219090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.819+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f219a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.819+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f228780 0x557c6f22ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.819+0000 7f43c75c9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557c6f17f2f0 con 0x557c6f21ab40 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.819+0000 7f43c75c9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557c6f126cf0 con 0x557c6f2195d0 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.819+0000 7f43c75c9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557c6f17b2b0 con 0x557c6f228780 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bed9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f219a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bf59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f219090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bf59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f219090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44710/0 (socket says 172.21.15.42:44710) 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bf59e640 1 -- 172.21.15.42:0/2853529494 learned_addr learned my addr 172.21.15.42:0/2853529494 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43be59c640 1 --2- 172.21.15.42:0/2853529494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f228780 0x557c6f22ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bf59e640 1 -- 172.21.15.42:0/2853529494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f228780 msgr2=0x557c6f22ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bf59e640 1 --2- 172.21.15.42:0/2853529494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f228780 0x557c6f22ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bf59e640 1 -- 172.21.15.42:0/2853529494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 msgr2=0x557c6f219a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bf59e640 1 --2- 172.21.15.42:0/2853529494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f219a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bf59e640 1 -- 172.21.15.42:0/2853529494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6f10b3a0 con 0x557c6f21ab40 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43a7fff640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f43a80a32c0 0x7f43a80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bed9d640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f43a80a32c0 0x7f43a80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43bf59e640 1 --2- 172.21.15.42:0/2853529494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f219090 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f43b80039f0 tx=0x7f43b8003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ae7ba44db6ac02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43a7fff640 1 -- 172.21.15.42:0/1536956019 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f43b00cfba0 con 0x7f43c0100e20 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.820+0000 7f43a57fa640 1 -- 172.21.15.42:0/2853529494 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b801a470 con 0x557c6f21ab40 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43a57fa640 1 -- 172.21.15.42:0/2853529494 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43b8015070 con 0x557c6f21ab40 2024-09-19T09:42:46.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43a57fa640 1 -- 172.21.15.42:0/2853529494 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8010900 con 0x557c6f21ab40 2024-09-19T09:42:46.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43c75c9740 1 -- 172.21.15.42:0/2853529494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 msgr2=0x557c6f219090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43bed9d640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f43a80a32c0 0x7f43a80a5780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f43b0098c20 tx=0x7f43b00d3670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43c75c9740 1 --2- 172.21.15.42:0/2853529494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f219090 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f43b80039f0 tx=0x7f43b8003eb0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43c75c9740 1 -- 172.21.15.42:0/2853529494 shutdown_connections 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43c75c9740 1 --2- 172.21.15.42:0/2853529494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f228780 0x557c6f22ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43c75c9740 1 --2- 172.21.15.42:0/2853529494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f219a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43c75c9740 1 --2- 172.21.15.42:0/2853529494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f219090 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43c75c9740 1 -- 172.21.15.42:0/2853529494 >> 172.21.15.42:0/2853529494 conn(0x557c6f1e2310 msgr2=0x557c6f215c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43c75c9740 1 -- 172.21.15.42:0/2853529494 shutdown_connections 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.821+0000 7f43c75c9740 1 -- 172.21.15.42:0/2853529494 wait complete. 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43c75c9740 1 -- start start 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43c75c9740 1 Processor -- start 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f2281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f225460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f228780 0x557c6f225bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43c75c9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557c6f22b480 con 0x557c6f21ab40 2024-09-19T09:42:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43c75c9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557c6f13a060 con 0x557c6f2195d0 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43c75c9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557c6f22b600 con 0x557c6f228780 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43c75c9740 10 client.0 _ll_register_callbacks cb 0x557c6ee8d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43bf59e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f2281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43be59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f225460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43bf59e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f2281b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:45024/0 (socket says 172.21.15.42:45024) 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43bf59e640 1 -- 172.21.15.42:0/3044407861 learned_addr learned my addr 172.21.15.42:0/3044407861 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.822+0000 7f43bf59e640 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f228780 0x557c6f225bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43bf59e640 1 -- 172.21.15.42:0/3044407861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f228780 msgr2=0x557c6f225bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43bf59e640 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f228780 0x557c6f225bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43bf59e640 1 -- 172.21.15.42:0/3044407861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 msgr2=0x557c6f225460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43bf59e640 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f225460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43bf59e640 1 -- 172.21.15.42:0/3044407861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6eef03c0 con 0x557c6f2195d0 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43be59c640 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f225460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43bf59e640 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f2281b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f43b80105e0 tx=0x7f43b80104e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded3d5754f7a4985 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43a2ff5640 1 -- 172.21.15.42:0/3044407861 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8023040 con 0x557c6f2195d0 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43a2ff5640 1 -- 172.21.15.42:0/3044407861 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f43b80119b0 con 0x557c6f2195d0 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43c75c9740 1 -- 172.21.15.42:0/3044407861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43b8015070 con 0x557c6f2195d0 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43a2ff5640 1 -- 172.21.15.42:0/3044407861 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f43b8030070 con 0x557c6f2195d0 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43c75c9740 10 client.26114 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.823+0000 7f43c75c9740 1 -- 172.21.15.42:0/3044407861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557c6f236f60 con 0x557c6f2195d0 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43a2ff5640 1 -- 172.21.15.42:0/3044407861 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43b8015070 con 0x557c6f2195d0 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43a2ff5640 1 -- 172.21.15.42:0/3044407861 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f43b802c540 con 0x557c6f2195d0 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43c75c9740 10 client.26114 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43c75c9740 10 client.26114 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43c75c9740 20 client.26114 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43c75c9740 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x557c6f238310 0x557c6f23a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43c75c9740 4 client.26114 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43c75c9740 1 -- 172.21.15.42:0/3044407861 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c6f18c860 con 0x557c6f238310 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43be59c640 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x557c6f238310 0x557c6f23a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43be59c640 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x557c6f238310 0x557c6f23a700 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ef037a05de89de0 server_cookie=56d2e5d70494d4ce in_seq=0 out_seq=0 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.824+0000 7f43a2ff5640 10 client.26114 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43a2ff5640 1 -- 172.21.15.42:0/3044407861 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c6f18c860 con 0x557c6f238310 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43a2ff5640 10 client.26114 handle_command_reply: tid=0 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 client.26114 shutdown 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 -- 172.21.15.42:0/3044407861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 msgr2=0x557c6f2281b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f2281b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f43b80105e0 tx=0x7f43b80104e0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 -- 172.21.15.42:0/3044407861 shutdown_connections 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x557c6f238310 0x557c6f23a700 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f228780 0x557c6f225bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f21ab40 0x557c6f225460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43a2ff5640 0 client.26114 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:42:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 --2- 172.21.15.42:0/3044407861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f2281b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 -- 172.21.15.42:0/3044407861 >> 172.21.15.42:0/3044407861 conn(0x557c6f1e2310 msgr2=0x557c6f21b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 -- 172.21.15.42:0/3044407861 shutdown_connections 2024-09-19T09:42:46.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.825+0000 7f43c75c9740 1 -- 172.21.15.42:0/3044407861 wait complete. 2024-09-19T09:42:46.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.826+0000 7f43c75c9740 20 client.26114 trim_cache size 0 max 16384 2024-09-19T09:42:46.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.839+0000 7f43c75c9740 1 Processor -- start 2024-09-19T09:42:46.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.839+0000 7f43c75c9740 1 -- start start 2024-09-19T09:42:46.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f2195d0 0x557c6f23fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f21ab40 0x557c6f240400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 0x557c6f2226c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43c75c9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f43c01ab400 con 0x557c6f228780 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43c75c9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f43c01ad1e0 con 0x557c6f21ab40 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43c75c9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f43c01abb90 con 0x557c6f2195d0 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43bf59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 0x557c6f2226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43bf59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 0x557c6f2226c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44734/0 (socket says 172.21.15.42:44734) 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43bf59e640 1 -- 172.21.15.42:0/1367373856 learned_addr learned my addr 172.21.15.42:0/1367373856 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43bf59e640 1 --2- 172.21.15.42:0/1367373856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f2195d0 0x557c6f23fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43be59c640 1 --2- 172.21.15.42:0/1367373856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f21ab40 0x557c6f240400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43bf59e640 1 -- 172.21.15.42:0/1367373856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f2195d0 msgr2=0x557c6f23fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43bf59e640 1 --2- 172.21.15.42:0/1367373856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f2195d0 0x557c6f23fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43bf59e640 1 -- 172.21.15.42:0/1367373856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f21ab40 msgr2=0x557c6f240400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43bf59e640 1 --2- 172.21.15.42:0/1367373856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f21ab40 0x557c6f240400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43bf59e640 1 -- 172.21.15.42:0/1367373856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6f225f60 con 0x557c6f228780 2024-09-19T09:42:46.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43bf59e640 1 --2- 172.21.15.42:0/1367373856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 0x557c6f2226c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009b60 tx=0x7f43b8005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7502ea7ed0d885fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43a4ff9640 1 -- 172.21.15.42:0/1367373856 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8004410 con 0x557c6f228780 2024-09-19T09:42:46.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43a4ff9640 1 -- 172.21.15.42:0/1367373856 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43b8015070 con 0x557c6f228780 2024-09-19T09:42:46.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.840+0000 7f43a4ff9640 1 -- 172.21.15.42:0/1367373856 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b802c780 con 0x557c6f228780 2024-09-19T09:42:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.841+0000 7f43c75c9740 1 -- 172.21.15.42:0/1367373856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 msgr2=0x557c6f2226c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.841+0000 7f43c75c9740 1 --2- 172.21.15.42:0/1367373856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 0x557c6f2226c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009b60 tx=0x7f43b8005f10 comp rx=0 tx=0).stop 2024-09-19T09:42:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.841+0000 7f43c75c9740 1 -- 172.21.15.42:0/1367373856 shutdown_connections 2024-09-19T09:42:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.841+0000 7f43c75c9740 1 --2- 172.21.15.42:0/1367373856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 0x557c6f2226c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.841+0000 7f43c75c9740 1 --2- 172.21.15.42:0/1367373856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f21ab40 0x557c6f240400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.841+0000 7f43c75c9740 1 --2- 172.21.15.42:0/1367373856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f2195d0 0x557c6f23fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.841+0000 7f43c75c9740 1 -- 172.21.15.42:0/1367373856 >> 172.21.15.42:0/1367373856 conn(0x557c6f1e2310 msgr2=0x557c6f220720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.841+0000 7f43c75c9740 1 -- 172.21.15.42:0/1367373856 shutdown_connections 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.841+0000 7f43c75c9740 1 -- 172.21.15.42:0/1367373856 wait complete. 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.841+0000 7f43c75c9740 1 -- start start 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43c75c9740 1 Processor -- start 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f22b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f21ab40 0x557c6f22bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43c75c9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 0x557c6f2a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43c75c9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f43c01aca80 con 0x557c6f228780 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43c75c9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f43c01ac320 con 0x557c6f2195d0 2024-09-19T09:42:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43c75c9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f43c01a93e0 con 0x557c6f21ab40 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43c75c9740 10 client.0 _ll_register_callbacks cb 0x7f43b00d3540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43bf59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 0x557c6f2a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43bf59e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f22b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43be59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f21ab40 0x557c6f22bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43bf59e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f22b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:45042/0 (socket says 172.21.15.42:45042) 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43bf59e640 1 -- 172.21.15.42:0/951491852 learned_addr learned my addr 172.21.15.42:0/951491852 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43bf59e640 1 -- 172.21.15.42:0/951491852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f21ab40 msgr2=0x557c6f22bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43bf59e640 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f21ab40 0x557c6f22bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43bf59e640 1 -- 172.21.15.42:0/951491852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 msgr2=0x557c6f2a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43bf59e640 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 0x557c6f2a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43bf59e640 1 -- 172.21.15.42:0/951491852 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6f2a13c0 con 0x557c6f2195d0 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.842+0000 7f43be59c640 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f21ab40 0x557c6f22bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43bf59e640 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f22b9c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f43b80039f0 tx=0x7f43b8000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1239eab0e7d6be83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43a2ff5640 1 -- 172.21.15.42:0/951491852 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b802ccf0 con 0x557c6f2195d0 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43c75c9740 1 -- 172.21.15.42:0/951491852 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43b8015070 con 0x557c6f2195d0 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43a2ff5640 1 -- 172.21.15.42:0/951491852 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f43b802c700 con 0x557c6f2195d0 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43a2ff5640 1 -- 172.21.15.42:0/951491852 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f43b804a030 con 0x557c6f2195d0 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43c75c9740 10 client.26120 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43c75c9740 1 -- 172.21.15.42:0/951491852 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557c6f2a25b0 con 0x557c6f2195d0 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43a2ff5640 1 -- 172.21.15.42:0/951491852 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43b8015070 con 0x557c6f2195d0 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43a2ff5640 1 -- 172.21.15.42:0/951491852 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f43b801a7a0 con 0x557c6f2195d0 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43c75c9740 10 client.26120 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43c75c9740 10 client.26120 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43c75c9740 20 client.26120 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43c75c9740 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x557c6f2a2bc0 0x557c6f2a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43c75c9740 4 client.26120 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:42:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.843+0000 7f43c75c9740 1 -- 172.21.15.42:0/951491852 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c6f186d70 con 0x557c6f2a2bc0 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.844+0000 7f43be59c640 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x557c6f2a2bc0 0x557c6f2a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.844+0000 7f43be59c640 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x557c6f2a2bc0 0x557c6f2a4fe0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=19d2a97fc3a1db24 server_cookie=3aec6415ff8cf019 in_seq=0 out_seq=0 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.844+0000 7f43a2ff5640 10 client.26120 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43a2ff5640 1 -- 172.21.15.42:0/951491852 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c6f186d70 con 0x557c6f2a2bc0 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43a2ff5640 10 client.26120 handle_command_reply: tid=0 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 client.26120 shutdown 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 -- 172.21.15.42:0/951491852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 msgr2=0x557c6f22b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f22b9c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f43b80039f0 tx=0x7f43b8000f40 comp rx=0 tx=0).stop 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 -- 172.21.15.42:0/951491852 shutdown_connections 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x557c6f2a2bc0 0x557c6f2a4fe0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557c6f228780 0x557c6f2a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557c6f21ab40 0x557c6f22bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43a2ff5640 0 client.26120 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 --2- 172.21.15.42:0/951491852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c6f2195d0 0x557c6f22b9c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 -- 172.21.15.42:0/951491852 >> 172.21.15.42:0/951491852 conn(0x557c6f1e2310 msgr2=0x557c6f223d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 -- 172.21.15.42:0/951491852 shutdown_connections 2024-09-19T09:42:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 1 -- 172.21.15.42:0/951491852 wait complete. 2024-09-19T09:42:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.845+0000 7f43c75c9740 20 client.26120 trim_cache size 0 max 16384 2024-09-19T09:42:46.852 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 -- 172.21.15.42:0/1536956019 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f43a80a32c0 msgr2=0x7f43a80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f43a80a32c0 0x7f43a80a5780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f43b0098c20 tx=0x7f43b00d3670 comp rx=0 tx=0).stop 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 -- 172.21.15.42:0/1536956019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0100e20 msgr2=0x7f43c01984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0100e20 0x7f43c01984e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f43b000e9f0 tx=0x7f43b000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 -- 172.21.15.42:0/1536956019 shutdown_connections 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f43a80a32c0 0x7f43a80a5780 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43c0102ef0 0x7f43c019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c0102570 0x7f43c0198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 --2- 172.21.15.42:0/1536956019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0100e20 0x7f43c01984e0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 -- 172.21.15.42:0/1536956019 >> 172.21.15.42:0/1536956019 conn(0x7f43c00fc7d0 msgr2=0x7f43c006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 -- 172.21.15.42:0/1536956019 shutdown_connections 2024-09-19T09:42:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:46.846+0000 7f43c51f0640 1 -- 172.21.15.42:0/1536956019 wait complete. 2024-09-19T09:42:46.854 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:46 smithi171 ceph-mon[35803]: pgmap v440: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 21 KiB/s wr, 30 op/s 2024-09-19T09:42:46.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:46 smithi136 ceph-mon[34840]: pgmap v440: 97 pgs: 97 active+clean; 146 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 21 KiB/s wr, 30 op/s 2024-09-19T09:42:47.617 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '41d56c9e', total seconds elapsed: 22.4 2024-09-19T09:42:48.341 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:42:48.626 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:48.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:48 smithi042 ceph-mon[31223]: pgmap v441: 97 pgs: 97 active+clean; 147 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 28 op/s 2024-09-19T09:42:48.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:48 smithi171 ceph-mon[35803]: pgmap v441: 97 pgs: 97 active+clean; 147 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 28 op/s 2024-09-19T09:42:48.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:48 smithi136 ceph-mon[34840]: pgmap v441: 97 pgs: 97 active+clean; 147 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 28 op/s 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.132+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2089757547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7e0102ef0 msgr2=0x7fb7e010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.132+0000 7fb7e7ac6640 1 --2- 172.21.15.42:0/2089757547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7e0102ef0 0x7fb7e010da40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8009ca0 tx=0x7fb7d802a950 comp rx=0 tx=0).stop 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.132+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2089757547 shutdown_connections 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.132+0000 7fb7e7ac6640 1 --2- 172.21.15.42:0/2089757547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7e0102ef0 0x7fb7e010da40 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.132+0000 7fb7e7ac6640 1 --2- 172.21.15.42:0/2089757547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7e0102570 0x7fb7e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.132+0000 7fb7e7ac6640 1 --2- 172.21.15.42:0/2089757547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7e0100e20 0x7fb7e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.132+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2089757547 >> 172.21.15.42:0/2089757547 conn(0x7fb7e00fc7d0 msgr2=0x7fb7e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.132+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2089757547 shutdown_connections 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.132+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2089757547 wait complete. 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.133+0000 7fb7e7ac6640 1 Processor -- start 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.133+0000 7fb7e7ac6640 1 -- start start 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.133+0000 7fb7e7ac6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7e0100e20 0x7fb7e0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.133+0000 7fb7e7ac6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7e0102570 0x7fb7e0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.133+0000 7fb7e7ac6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7e0102ef0 0x7fb7e019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.133+0000 7fb7e7ac6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e0112090 con 0x7fb7e0102ef0 2024-09-19T09:42:49.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.133+0000 7fb7e7ac6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e0111f10 con 0x7fb7e0100e20 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.133+0000 7fb7e7ac6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e0112210 con 0x7fb7e0102570 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.133+0000 7fb7e6063640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7e0102ef0 0x7fb7e019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e5862640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7e0100e20 0x7fb7e0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e6063640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7e0102ef0 0x7fb7e019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44752/0 (socket says 172.21.15.42:44752) 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e6063640 1 -- 172.21.15.42:0/2544580901 learned_addr learned my addr 172.21.15.42:0/2544580901 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e5862640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7e0100e20 0x7fb7e0198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:45066/0 (socket says 172.21.15.42:45066) 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e5061640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7e0102570 0x7fb7e0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e6063640 1 -- 172.21.15.42:0/2544580901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7e0102570 msgr2=0x7fb7e0198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e6063640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7e0102570 0x7fb7e0198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e6063640 1 -- 172.21.15.42:0/2544580901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7e0100e20 msgr2=0x7fb7e0198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e6063640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7e0100e20 0x7fb7e0198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e6063640 1 -- 172.21.15.42:0/2544580901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e019d4c0 con 0x7fb7e0102ef0 2024-09-19T09:42:49.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e5061640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7e0102570 0x7fb7e0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:49.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e5862640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7e0100e20 0x7fb7e0198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:49.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e6063640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7e0102ef0 0x7fb7e019cde0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8004af0 tx=0x7fb7d802f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7d6ffd640 1 -- 172.21.15.42:0/2544580901 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8034040 con 0x7fb7e0102ef0 2024-09-19T09:42:49.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7d6ffd640 1 -- 172.21.15.42:0/2544580901 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7d8030920 con 0x7fb7e0102ef0 2024-09-19T09:42:49.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2544580901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e019d750 con 0x7fb7e0102ef0 2024-09-19T09:42:49.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.134+0000 7fb7d6ffd640 1 -- 172.21.15.42:0/2544580901 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8004630 con 0x7fb7e0102ef0 2024-09-19T09:42:49.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.135+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2544580901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e01a5090 con 0x7fb7e0102ef0 2024-09-19T09:42:49.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.137+0000 7fb7d6ffd640 1 -- 172.21.15.42:0/2544580901 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb7d8037020 con 0x7fb7e0102ef0 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.137+0000 7fb7e9e9f740 1 Processor -- start 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e9e9f740 1 -- start start 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7d6ffd640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7cc0a3240 0x7fb7cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e5061640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7cc0a3240 0x7fb7cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7d6ffd640 1 -- 172.21.15.42:0/2544580901 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb7d80f06f0 con 0x7fb7e0102ef0 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 0x5647dc546090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc5465d0 0x5647dc546a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc551370 0x5647dc553760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5647dc4ac2f0 con 0x5647dc5465d0 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5647dc453cf0 con 0x5647dc547b40 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5647dc4a82b0 con 0x5647dc551370 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e5061640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc5465d0 0x5647dc546a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e5862640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 0x5647dc546090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e5862640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 0x5647dc546090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:45076/0 (socket says 172.21.15.42:45076) 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e6063640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc551370 0x5647dc553760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e5862640 1 -- 172.21.15.42:0/2299165569 learned_addr learned my addr 172.21.15.42:0/2299165569 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e5862640 1 -- 172.21.15.42:0/2299165569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc551370 msgr2=0x5647dc553760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e5862640 1 --2- 172.21.15.42:0/2299165569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc551370 0x5647dc553760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e5862640 1 -- 172.21.15.42:0/2299165569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc5465d0 msgr2=0x5647dc546a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e5862640 1 --2- 172.21.15.42:0/2299165569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc5465d0 0x5647dc546a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.138+0000 7fb7e5862640 1 -- 172.21.15.42:0/2299165569 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647dc4383a0 con 0x5647dc547b40 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.139+0000 7fb7e5862640 1 --2- 172.21.15.42:0/2299165569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 0x5647dc546090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0115f0 tx=0x7fb7dc011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d7dc14fe047379f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.139+0000 7fb7e5061640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7cc0a3240 0x7fb7cc0a5700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5647dc543ac0 tx=0x7fb7d0009c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.139+0000 7fb7cbfff640 1 -- 172.21.15.42:0/2299165569 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc01e070 con 0x5647dc547b40 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.139+0000 7fb7cbfff640 1 -- 172.21.15.42:0/2299165569 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7dc00fb20 con 0x5647dc547b40 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.139+0000 7fb7cbfff640 1 -- 172.21.15.42:0/2299165569 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc019bf0 con 0x5647dc547b40 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/2299165569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 msgr2=0x5647dc546090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/2299165569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 0x5647dc546090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0115f0 tx=0x7fb7dc011ab0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/2299165569 shutdown_connections 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/2299165569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc551370 0x5647dc553760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/2299165569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc5465d0 0x5647dc546a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/2299165569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 0x5647dc546090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/2299165569 >> 172.21.15.42:0/2299165569 conn(0x5647dc50f310 msgr2=0x5647dc542c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/2299165569 shutdown_connections 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/2299165569 wait complete. 2024-09-19T09:42:49.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 -- start start 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.140+0000 7fb7e9e9f740 1 Processor -- start 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc550cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc547b40 0x5647dc54dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc54e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5647dc554070 con 0x5647dc551370 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5647dc467060 con 0x5647dc5465d0 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5647dc5541f0 con 0x5647dc547b40 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e9e9f740 10 client.0 _ll_register_callbacks cb 0x5647dc1ba8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e6063640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc54e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e5862640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc550cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e6063640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc54e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44778/0 (socket says 172.21.15.42:44778) 2024-09-19T09:42:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e6063640 1 -- 172.21.15.42:0/3274693359 learned_addr learned my addr 172.21.15.42:0/3274693359 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e5862640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc550cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:45088/0 (socket says 172.21.15.42:45088) 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e5061640 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc547b40 0x5647dc54dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e5862640 1 -- 172.21.15.42:0/3274693359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc547b40 msgr2=0x5647dc54dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e5862640 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc547b40 0x5647dc54dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e5862640 1 -- 172.21.15.42:0/3274693359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 msgr2=0x5647dc54e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e5862640 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc54e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.141+0000 7fb7e5862640 1 -- 172.21.15.42:0/3274693359 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647dc21d3c0 con 0x5647dc5465d0 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7e5862640 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc550cd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc01c040 tx=0x7fb7dc00f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75436007df9f9ad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3274693359 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc029060 con 0x5647dc5465d0 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3274693359 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7dc00fb20 con 0x5647dc5465d0 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3274693359 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb7dc004040 con 0x5647dc5465d0 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3274693359 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb7dc01e040 con 0x5647dc5465d0 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7e9e9f740 10 client.26132 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3274693359 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5647dc55fac0 con 0x5647dc5465d0 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3274693359 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7dc00fb20 con 0x5647dc5465d0 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3274693359 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fb7dc0035f0 con 0x5647dc5465d0 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7e9e9f740 10 client.26132 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7e9e9f740 10 client.26132 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7e9e9f740 20 client.26132 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5647dc560e70 0x5647dc563260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7e9e9f740 4 client.26132 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.142+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3274693359 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647dc4b9860 con 0x5647dc560e70 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.143+0000 7fb7e5061640 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5647dc560e70 0x5647dc563260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.143+0000 7fb7e5061640 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5647dc560e70 0x5647dc563260 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eb3c66a2e7fed78c server_cookie=7e7b281a1520f125 in_seq=0 out_seq=0 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.143+0000 7fb7c97fa640 10 client.26132 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3274693359 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647dc4b9860 con 0x5647dc560e70 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7c97fa640 10 client.26132 handle_command_reply: tid=0 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 client.26132 shutdown 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3274693359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 msgr2=0x5647dc550cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc550cd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc01c040 tx=0x7fb7dc00f8d0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3274693359 shutdown_connections 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5647dc560e70 0x5647dc563260 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc54e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc547b40 0x5647dc54dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7c97fa640 0 client.26132 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3274693359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc550cd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3274693359 >> 172.21.15.42:0/3274693359 conn(0x5647dc50f310 msgr2=0x5647dc548930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3274693359 shutdown_connections 2024-09-19T09:42:49.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3274693359 wait complete. 2024-09-19T09:42:49.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.144+0000 7fb7e9e9f740 20 client.26132 trim_cache size 0 max 16384 2024-09-19T09:42:49.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.157+0000 7fb7e9e9f740 1 Processor -- start 2024-09-19T09:42:49.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e9e9f740 1 -- start start 2024-09-19T09:42:49.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc545e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc547b40 0x5647dc549120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc551370 0x5647dc549660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e01ad620 con 0x5647dc547b40 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e01af400 con 0x5647dc5465d0 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e01addb0 con 0x5647dc551370 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5061640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc547b40 0x5647dc549120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5862640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc545e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5061640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc547b40 0x5647dc549120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44790/0 (socket says 172.21.15.42:44790) 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5862640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc545e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:45096/0 (socket says 172.21.15.42:45096) 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5061640 1 -- 172.21.15.42:0/704145630 learned_addr learned my addr 172.21.15.42:0/704145630 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e6063640 1 --2- 172.21.15.42:0/704145630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc551370 0x5647dc549660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5061640 1 -- 172.21.15.42:0/704145630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc551370 msgr2=0x5647dc549660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5061640 1 --2- 172.21.15.42:0/704145630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc551370 0x5647dc549660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5061640 1 -- 172.21.15.42:0/704145630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 msgr2=0x5647dc545e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5061640 1 --2- 172.21.15.42:0/704145630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc545e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5061640 1 -- 172.21.15.42:0/704145630 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647dc54cf80 con 0x5647dc547b40 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.158+0000 7fb7e5061640 1 --2- 172.21.15.42:0/704145630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc547b40 0x5647dc549120 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0012040 tx=0x7fb7d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108000764541b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7cb7fe640 1 -- 172.21.15.42:0/704145630 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0004390 con 0x5647dc547b40 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7cb7fe640 1 -- 172.21.15.42:0/704145630 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7d002e070 con 0x5647dc547b40 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7cb7fe640 1 -- 172.21.15.42:0/704145630 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0028410 con 0x5647dc547b40 2024-09-19T09:42:49.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/704145630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc547b40 msgr2=0x5647dc549120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/704145630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc547b40 0x5647dc549120 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0012040 tx=0x7fb7d0004730 comp rx=0 tx=0).stop 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/704145630 shutdown_connections 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/704145630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc551370 0x5647dc549660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/704145630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc547b40 0x5647dc549120 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/704145630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc5465d0 0x5647dc545e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/704145630 >> 172.21.15.42:0/704145630 conn(0x5647dc50f310 msgr2=0x5647dc541d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/704145630 shutdown_connections 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.159+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/704145630 wait complete. 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e9e9f740 1 -- start start 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e9e9f740 1 Processor -- start 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc5465d0 0x5647dc555230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 0x5647dc555770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e9e9f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc555cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e01aeca0 con 0x5647dc551370 2024-09-19T09:42:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e01ae540 con 0x5647dc547b40 2024-09-19T09:42:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e9e9f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e01ab600 con 0x5647dc5465d0 2024-09-19T09:42:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e9e9f740 10 client.0 _ll_register_callbacks cb 0x7fb7dc01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e6063640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc555cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e6063640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc555cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44800/0 (socket says 172.21.15.42:44800) 2024-09-19T09:42:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.160+0000 7fb7e6063640 1 -- 172.21.15.42:0/3925442828 learned_addr learned my addr 172.21.15.42:0/3925442828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e5061640 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 0x5647dc555770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e5862640 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc5465d0 0x5647dc555230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e6063640 1 -- 172.21.15.42:0/3925442828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc5465d0 msgr2=0x5647dc555230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e6063640 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc5465d0 0x5647dc555230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e6063640 1 -- 172.21.15.42:0/3925442828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 msgr2=0x5647dc555770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e6063640 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 0x5647dc555770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e6063640 1 -- 172.21.15.42:0/3925442828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647dc5ceec0 con 0x5647dc551370 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e6063640 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc555cb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80bcbd0 tx=0x7fb7d802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4978e5969a6fb2f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3925442828 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80d9020 con 0x5647dc551370 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3925442828 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb7d80bcef0 con 0x5647dc551370 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3925442828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7d002e070 con 0x5647dc551370 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3925442828 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb7d80c1040 con 0x5647dc551370 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e9e9f740 10 client.16734 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.161+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3925442828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5647dc5d0200 con 0x5647dc551370 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.162+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3925442828 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7d002e070 con 0x5647dc551370 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.162+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3925442828 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fb7d804d030 con 0x5647dc551370 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.162+0000 7fb7e9e9f740 10 client.16734 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.162+0000 7fb7e9e9f740 10 client.16734 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.162+0000 7fb7e9e9f740 20 client.16734 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.162+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5647dc560e70 0x5647dc5d29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.162+0000 7fb7e9e9f740 4 client.16734 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.162+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3925442828 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5647dc4b3d70 con 0x5647dc560e70 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.163+0000 7fb7e5862640 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5647dc560e70 0x5647dc5d29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.163+0000 7fb7c97fa640 10 client.16734 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:42:49.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.163+0000 7fb7e5862640 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5647dc560e70 0x5647dc5d29a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d166c0599c24cda7 server_cookie=a1a55985d69de416 in_seq=0 out_seq=0 2024-09-19T09:42:49.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.163+0000 7fb7c97fa640 1 -- 172.21.15.42:0/3925442828 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5647dc4b3d70 con 0x5647dc560e70 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.163+0000 7fb7c97fa640 10 client.16734 handle_command_reply: tid=0 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.163+0000 7fb7e9e9f740 1 client.16734 shutdown 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3925442828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 msgr2=0x5647dc555cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc555cb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80bcbd0 tx=0x7fb7d802a950 comp rx=0 tx=0).stop 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3925442828 shutdown_connections 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5647dc560e70 0x5647dc5d29a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647dc551370 0x5647dc555cb0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5647dc547b40 0x5647dc555770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 1 --2- 172.21.15.42:0/3925442828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5647dc5465d0 0x5647dc555230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3925442828 >> 172.21.15.42:0/3925442828 conn(0x5647dc50f310 msgr2=0x5647dc54f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7c97fa640 0 client.16734 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3925442828 shutdown_connections 2024-09-19T09:42:49.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 1 -- 172.21.15.42:0/3925442828 wait complete. 2024-09-19T09:42:49.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.164+0000 7fb7e9e9f740 20 client.16734 trim_cache size 0 max 16384 2024-09-19T09:42:49.172 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:42:49.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.165+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2544580901 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7cc0a3240 msgr2=0x7fb7cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.165+0000 7fb7e7ac6640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7cc0a3240 0x7fb7cc0a5700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5647dc543ac0 tx=0x7fb7d0009c20 comp rx=0 tx=0).stop 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.165+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2544580901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7e0102ef0 msgr2=0x7fb7e019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.165+0000 7fb7e7ac6640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7e0102ef0 0x7fb7e019cde0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8004af0 tx=0x7fb7d802f3a0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.165+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2544580901 shutdown_connections 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.165+0000 7fb7e7ac6640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb7cc0a3240 0x7fb7cc0a5700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.165+0000 7fb7e7ac6640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7e0102ef0 0x7fb7e019cde0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.165+0000 7fb7e7ac6640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7e0102570 0x7fb7e0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.165+0000 7fb7e7ac6640 1 --2- 172.21.15.42:0/2544580901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7e0100e20 0x7fb7e0198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.165+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2544580901 >> 172.21.15.42:0/2544580901 conn(0x7fb7e00fc7d0 msgr2=0x7fb7e0106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.166+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2544580901 shutdown_connections 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:49.166+0000 7fb7e7ac6640 1 -- 172.21.15.42:0/2544580901 wait complete. 2024-09-19T09:42:49.958 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:42:50.223 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:50.617 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:50 smithi042 ceph-mon[31223]: pgmap v442: 97 pgs: 97 active+clean; 147 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 145 KiB/s wr, 37 op/s 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.706+0000 7f4b621b1640 1 -- 172.21.15.42:0/1671716659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c100e20 msgr2=0x7f4b5c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.706+0000 7f4b621b1640 1 --2- 172.21.15.42:0/1671716659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c100e20 0x7f4b5c101200 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c009900 tx=0x7f4b4c02a480 comp rx=0 tx=0).stop 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.706+0000 7f4b621b1640 1 -- 172.21.15.42:0/1671716659 shutdown_connections 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.706+0000 7f4b621b1640 1 --2- 172.21.15.42:0/1671716659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c102ef0 0x7f4b5c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.706+0000 7f4b621b1640 1 --2- 172.21.15.42:0/1671716659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c102570 0x7f4b5c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.706+0000 7f4b621b1640 1 --2- 172.21.15.42:0/1671716659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c100e20 0x7f4b5c101200 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.706+0000 7f4b621b1640 1 -- 172.21.15.42:0/1671716659 >> 172.21.15.42:0/1671716659 conn(0x7f4b5c0fc7d0 msgr2=0x7f4b5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.706+0000 7f4b621b1640 1 -- 172.21.15.42:0/1671716659 shutdown_connections 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.706+0000 7f4b621b1640 1 -- 172.21.15.42:0/1671716659 wait complete. 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b621b1640 1 Processor -- start 2024-09-19T09:42:50.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b621b1640 1 -- start start 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b621b1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c100e20 0x7f4b5c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b621b1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c102570 0x7f4b5c1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b621b1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c102ef0 0x7f4b5c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b621b1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c110f80 con 0x7f4b5c100e20 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b621b1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c110e00 con 0x7f4b5c102570 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b621b1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c111100 con 0x7f4b5c102ef0 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b5b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c100e20 0x7f4b5c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b5b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c100e20 0x7f4b5c197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41130/0 (socket says 172.21.15.42:41130) 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b5b7fe640 1 -- 172.21.15.42:0/2071189753 learned_addr learned my addr 172.21.15.42:0/2071189753 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b5affd640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c102570 0x7f4b5c1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.707+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c102ef0 0x7f4b5c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b5b7fe640 1 -- 172.21.15.42:0/2071189753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c102ef0 msgr2=0x7f4b5c19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b5b7fe640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c102ef0 0x7f4b5c19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b5b7fe640 1 -- 172.21.15.42:0/2071189753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c102570 msgr2=0x7f4b5c1979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b5b7fe640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c102570 0x7f4b5c1979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b5b7fe640 1 -- 172.21.15.42:0/2071189753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c19c410 con 0x7f4b5c100e20 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b5b7fe640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c100e20 0x7f4b5c197460 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c006010 tx=0x7f4b4c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b58ff9640 1 -- 172.21.15.42:0/2071189753 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c03f070 con 0x7f4b5c100e20 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b58ff9640 1 -- 172.21.15.42:0/2071189753 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b4c031c30 con 0x7f4b5c100e20 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b58ff9640 1 -- 172.21.15.42:0/2071189753 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c035030 con 0x7f4b5c100e20 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b621b1640 1 -- 172.21.15.42:0/2071189753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5c19c6a0 con 0x7f4b5c100e20 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.708+0000 7f4b621b1640 1 -- 172.21.15.42:0/2071189753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5c19cb30 con 0x7f4b5c100e20 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b6458a740 1 Processor -- start 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b6458a740 1 -- start start 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4caeb40 0x55a4a4cad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4cba580 0x55a4a4cbc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b6458a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4c132f0 con 0x55a4a4cad5d0 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b6458a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4bbacf0 con 0x55a4a4caeb40 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b6458a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4c0f2b0 con 0x55a4a4cba580 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b5bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4caeb40 0x55a4a4cad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b5bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4caeb40 0x55a4a4cad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:49118/0 (socket says 172.21.15.42:49118) 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b58ff9640 1 -- 172.21.15.42:0/2071189753 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f4b4c042070 con 0x7f4b5c100e20 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b5bfff640 1 -- 172.21.15.42:0/4192287431 learned_addr learned my addr 172.21.15.42:0/4192287431 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.711+0000 7f4b5affd640 1 --2- 172.21.15.42:0/4192287431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4cba580 0x55a4a4cbc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b5bfff640 1 -- 172.21.15.42:0/4192287431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4cba580 msgr2=0x55a4a4cbc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/4192287431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4cba580 0x55a4a4cbc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b5b7fe640 1 --2- 172.21.15.42:0/4192287431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b5bfff640 1 -- 172.21.15.42:0/4192287431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 msgr2=0x55a4a4cada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/4192287431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b5bfff640 1 -- 172.21.15.42:0/4192287431 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a4b9f3a0 con 0x55a4a4caeb40 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b5b7fe640 1 --2- 172.21.15.42:0/4192287431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/4192287431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4caeb40 0x55a4a4cad090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009f50 tx=0x7f4b540118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1de2bb23a94fb05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b41ffb640 1 -- 172.21.15.42:0/4192287431 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b54004d20 con 0x55a4a4caeb40 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b41ffb640 1 -- 172.21.15.42:0/4192287431 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b54004050 con 0x55a4a4caeb40 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b41ffb640 1 -- 172.21.15.42:0/4192287431 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b54005240 con 0x55a4a4caeb40 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.712+0000 7f4b58ff9640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b440a3240 0x7f4b440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b5b7fe640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b440a3240 0x7f4b440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b58ff9640 1 -- 172.21.15.42:0/2071189753 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4b4c0efff0 con 0x7f4b5c100e20 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b6458a740 1 -- 172.21.15.42:0/4192287431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4caeb40 msgr2=0x55a4a4cad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b5b7fe640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b440a3240 0x7f4b440a5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0eda70 tx=0x7f4b4c02a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b6458a740 1 --2- 172.21.15.42:0/4192287431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4caeb40 0x55a4a4cad090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009f50 tx=0x7f4b540118d0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b6458a740 1 -- 172.21.15.42:0/4192287431 shutdown_connections 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b6458a740 1 --2- 172.21.15.42:0/4192287431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4cba580 0x55a4a4cbc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b6458a740 1 --2- 172.21.15.42:0/4192287431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b6458a740 1 --2- 172.21.15.42:0/4192287431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4caeb40 0x55a4a4cad090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b6458a740 1 -- 172.21.15.42:0/4192287431 >> 172.21.15.42:0/4192287431 conn(0x55a4a4c76310 msgr2=0x55a4a4ca9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b6458a740 1 -- 172.21.15.42:0/4192287431 shutdown_connections 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.713+0000 7f4b6458a740 1 -- 172.21.15.42:0/4192287431 wait complete. 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b6458a740 1 -- start start 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b6458a740 1 Processor -- start 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cb9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cb71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cba580 0x55a4a4cb7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b6458a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4cbd280 con 0x55a4a4cba580 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b6458a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4bce060 con 0x55a4a4cad5d0 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b6458a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4cbd400 con 0x55a4a4caeb40 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b6458a740 10 client.0 _ll_register_callbacks cb 0x55a4a49218c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b5bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cb9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b5bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cb9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:49120/0 (socket says 172.21.15.42:49120) 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b5bfff640 1 -- 172.21.15.42:0/3700725476 learned_addr learned my addr 172.21.15.42:0/3700725476 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cba580 0x55a4a4cb7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.714+0000 7f4b5affd640 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cb71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b5bfff640 1 -- 172.21.15.42:0/3700725476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 msgr2=0x55a4a4cb71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cb71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b5bfff640 1 -- 172.21.15.42:0/3700725476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cba580 msgr2=0x55a4a4cb7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cba580 0x55a4a4cb7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b5bfff640 1 -- 172.21.15.42:0/3700725476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a49843c0 con 0x55a4a4cad5d0 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cb9ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009250 tx=0x7f4b54005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=326a4f1e79383154 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b3affd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b3affd640 1 -- 172.21.15.42:0/3700725476 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b54004c50 con 0x55a4a4cad5d0 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b3affd640 1 -- 172.21.15.42:0/3700725476 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4b54004df0 con 0x55a4a4cad5d0 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b6458a740 1 -- 172.21.15.42:0/3700725476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b54004050 con 0x55a4a4cad5d0 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b3affd640 1 -- 172.21.15.42:0/3700725476 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4b54028450 con 0x55a4a4cad5d0 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b6458a740 10 client.26150 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.715+0000 7f4b6458a740 1 -- 172.21.15.42:0/3700725476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a4a4cc8c40 con 0x55a4a4cad5d0 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b3affd640 1 -- 172.21.15.42:0/3700725476 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b54004050 con 0x55a4a4cad5d0 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b3affd640 1 -- 172.21.15.42:0/3700725476 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f4b5400f5a0 con 0x55a4a4cad5d0 2024-09-19T09:42:50.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b6458a740 10 client.26150 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b6458a740 10 client.26150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b6458a740 20 client.26150 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b6458a740 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a4a4cca040 0x55a4a4ccc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b6458a740 4 client.26150 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b6458a740 1 -- 172.21.15.42:0/3700725476 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4a4c20860 con 0x55a4a4cca040 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b5affd640 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a4a4cca040 0x55a4a4ccc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b5affd640 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a4a4cca040 0x55a4a4ccc430 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba4343ce4329e3a server_cookie=5d7a4ab599962118 in_seq=0 out_seq=0 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.716+0000 7f4b3affd640 10 client.26150 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b3affd640 1 -- 172.21.15.42:0/3700725476 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4a4c20860 con 0x55a4a4cca040 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b3affd640 10 client.26150 handle_command_reply: tid=0 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b6458a740 1 client.26150 shutdown 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b6458a740 1 -- 172.21.15.42:0/3700725476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 msgr2=0x55a4a4cb9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b6458a740 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cb9ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009250 tx=0x7f4b54005bd0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b6458a740 1 -- 172.21.15.42:0/3700725476 shutdown_connections 2024-09-19T09:42:50.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b6458a740 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a4a4cca040 0x55a4a4ccc430 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b6458a740 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cba580 0x55a4a4cb7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b6458a740 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cb71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b6458a740 1 --2- 172.21.15.42:0/3700725476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cb9ef0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b3affd640 0 client.26150 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b6458a740 1 -- 172.21.15.42:0/3700725476 >> 172.21.15.42:0/3700725476 conn(0x55a4a4c76310 msgr2=0x55a4a4caf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.717+0000 7f4b6458a740 1 -- 172.21.15.42:0/3700725476 shutdown_connections 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.718+0000 7f4b6458a740 1 -- 172.21.15.42:0/3700725476 wait complete. 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.718+0000 7f4b6458a740 20 client.26150 trim_cache size 0 max 16384 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.731+0000 7f4b6458a740 1 Processor -- start 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.731+0000 7f4b6458a740 1 -- start start 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cb6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cc2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cba580 0x55a4a4cc2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b6458a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1ab480 con 0x55a4a4cba580 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b6458a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1ad260 con 0x55a4a4cad5d0 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b6458a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1abc10 con 0x55a4a4caeb40 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5affd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cc2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cba580 0x55a4a4cc2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5affd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cc2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:36820/0 (socket says 172.21.15.42:36820) 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5affd640 1 -- 172.21.15.42:0/723034467 learned_addr learned my addr 172.21.15.42:0/723034467 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/723034467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cb6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5affd640 1 -- 172.21.15.42:0/723034467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 msgr2=0x55a4a4cb6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5affd640 1 --2- 172.21.15.42:0/723034467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cb6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5affd640 1 -- 172.21.15.42:0/723034467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cba580 msgr2=0x55a4a4cc2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5affd640 1 --2- 172.21.15.42:0/723034467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cba580 0x55a4a4cc2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5affd640 1 -- 172.21.15.42:0/723034467 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a4cb61a0 con 0x55a4a4caeb40 2024-09-19T09:42:50.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b5affd640 1 --2- 172.21.15.42:0/723034467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cc2a70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55a4a4cae070 tx=0x7f4b50005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2c2ba0ab180e145 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b417fa640 1 -- 172.21.15.42:0/723034467 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50003e00 con 0x55a4a4caeb40 2024-09-19T09:42:50.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b417fa640 1 -- 172.21.15.42:0/723034467 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b50010910 con 0x55a4a4caeb40 2024-09-19T09:42:50.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.732+0000 7f4b417fa640 1 -- 172.21.15.42:0/723034467 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5001ea90 con 0x55a4a4caeb40 2024-09-19T09:42:50.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.733+0000 7f4b6458a740 1 -- 172.21.15.42:0/723034467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 msgr2=0x55a4a4cc2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.733+0000 7f4b6458a740 1 --2- 172.21.15.42:0/723034467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cc2a70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55a4a4cae070 tx=0x7f4b50005f90 comp rx=0 tx=0).stop 2024-09-19T09:42:50.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.733+0000 7f4b6458a740 1 -- 172.21.15.42:0/723034467 shutdown_connections 2024-09-19T09:42:50.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.733+0000 7f4b6458a740 1 --2- 172.21.15.42:0/723034467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cba580 0x55a4a4cc2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.733+0000 7f4b6458a740 1 --2- 172.21.15.42:0/723034467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cc2a70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.733+0000 7f4b6458a740 1 --2- 172.21.15.42:0/723034467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cad5d0 0x55a4a4cb6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.733+0000 7f4b6458a740 1 -- 172.21.15.42:0/723034467 >> 172.21.15.42:0/723034467 conn(0x55a4a4c76310 msgr2=0x55a4a4cb1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.733+0000 7f4b6458a740 1 -- 172.21.15.42:0/723034467 shutdown_connections 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.733+0000 7f4b6458a740 1 -- 172.21.15.42:0/723034467 wait complete. 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.733+0000 7f4b6458a740 1 -- start start 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b6458a740 1 Processor -- start 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4caf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cafc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b6458a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cba580 0x55a4a4cb0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b6458a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1acb00 con 0x55a4a4cad5d0 2024-09-19T09:42:50.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b6458a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1ac3a0 con 0x55a4a4cba580 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b6458a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1a9460 con 0x55a4a4caeb40 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b6458a740 10 client.0 _ll_register_callbacks cb 0x7f4b50009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b5bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4caf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b5bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4caf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41180/0 (socket says 172.21.15.42:41180) 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b5bfff640 1 -- 172.21.15.42:0/1374483603 learned_addr learned my addr 172.21.15.42:0/1374483603 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b5affd640 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cafc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cba580 0x55a4a4cb0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b5bfff640 1 -- 172.21.15.42:0/1374483603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 msgr2=0x55a4a4cafc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cafc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b5bfff640 1 -- 172.21.15.42:0/1374483603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cba580 msgr2=0x55a4a4cb0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cba580 0x55a4a4cb0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.734+0000 7f4b5bfff640 1 -- 172.21.15.42:0/1374483603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a4cb7b70 con 0x55a4a4cad5d0 2024-09-19T09:42:50.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b5bfff640 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4caf6d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4b54002230 tx=0x7f4b540118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186c6145051ac7a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b3affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b3affd640 1 -- 172.21.15.42:0/1374483603 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5400f480 con 0x55a4a4cad5d0 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b3affd640 1 -- 172.21.15.42:0/1374483603 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f4b5400f620 con 0x55a4a4cad5d0 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b6458a740 1 -- 172.21.15.42:0/1374483603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b50010910 con 0x55a4a4cad5d0 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b3affd640 1 -- 172.21.15.42:0/1374483603 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4b54047070 con 0x55a4a4cad5d0 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b6458a740 10 client.16749 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b6458a740 1 -- 172.21.15.42:0/1374483603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a4a4d36fa0 con 0x55a4a4cad5d0 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b3affd640 1 -- 172.21.15.42:0/1374483603 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b50010910 con 0x55a4a4cad5d0 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b3affd640 1 -- 172.21.15.42:0/1374483603 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f4b54028b90 con 0x55a4a4cad5d0 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b6458a740 10 client.16749 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b6458a740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b6458a740 20 client.16749 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:50.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b6458a740 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a4a4d376f0 0x55a4a4d39b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b6458a740 4 client.16749 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.735+0000 7f4b6458a740 1 -- 172.21.15.42:0/1374483603 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4a4c1ad70 con 0x55a4a4d376f0 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b5affd640 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a4a4d376f0 0x55a4a4d39b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b3affd640 10 client.16749 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b5affd640 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a4a4d376f0 0x55a4a4d39b10 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfffc2f2e0b38560 server_cookie=288bff635c2a35c in_seq=0 out_seq=0 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b3affd640 1 -- 172.21.15.42:0/1374483603 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4a4c1ad70 con 0x55a4a4d376f0 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b3affd640 10 client.16749 handle_command_reply: tid=0 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b6458a740 1 client.16749 shutdown 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b6458a740 1 -- 172.21.15.42:0/1374483603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 msgr2=0x55a4a4caf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b6458a740 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4caf6d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4b54002230 tx=0x7f4b540118d0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b6458a740 1 -- 172.21.15.42:0/1374483603 shutdown_connections 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b6458a740 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55a4a4d376f0 0x55a4a4d39b10 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b6458a740 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4a4cba580 0x55a4a4cb0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b6458a740 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4a4caeb40 0x55a4a4cafc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b3affd640 0 client.16749 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:50.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b6458a740 1 --2- 172.21.15.42:0/1374483603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a4a4cad5d0 0x55a4a4caf6d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.736+0000 7f4b6458a740 1 -- 172.21.15.42:0/1374483603 >> 172.21.15.42:0/1374483603 conn(0x55a4a4c76310 msgr2=0x55a4a4cc5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b6458a740 1 -- 172.21.15.42:0/1374483603 shutdown_connections 2024-09-19T09:42:50.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b6458a740 1 -- 172.21.15.42:0/1374483603 wait complete. 2024-09-19T09:42:50.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b6458a740 20 client.16749 trim_cache size 0 max 16384 2024-09-19T09:42:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 -- 172.21.15.42:0/2071189753 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b440a3240 msgr2=0x7f4b440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b440a3240 0x7f4b440a5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0eda70 tx=0x7f4b4c02a480 comp rx=0 tx=0).stop 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 -- 172.21.15.42:0/2071189753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c100e20 msgr2=0x7f4b5c197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c100e20 0x7f4b5c197460 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c006010 tx=0x7f4b4c003c10 comp rx=0 tx=0).stop 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 -- 172.21.15.42:0/2071189753 shutdown_connections 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f4b440a3240 0x7f4b440a5700 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b5c102ef0 0x7f4b5c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b5c102570 0x7f4b5c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 --2- 172.21.15.42:0/2071189753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b5c100e20 0x7f4b5c197460 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 -- 172.21.15.42:0/2071189753 >> 172.21.15.42:0/2071189753 conn(0x7f4b5c0fc7d0 msgr2=0x7f4b5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 -- 172.21.15.42:0/2071189753 shutdown_connections 2024-09-19T09:42:50.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:50.737+0000 7f4b621b1640 1 -- 172.21.15.42:0/2071189753 wait complete. 2024-09-19T09:42:50.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:50 smithi171 ceph-mon[35803]: pgmap v442: 97 pgs: 97 active+clean; 147 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 145 KiB/s wr, 37 op/s 2024-09-19T09:42:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:50 smithi136 ceph-mon[34840]: pgmap v442: 97 pgs: 97 active+clean; 147 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 145 KiB/s wr, 37 op/s 2024-09-19T09:42:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.923+0000 7fdf5613a640 1 -- 172.21.15.42:0/3369231622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf501025f0 msgr2=0x7fdf50108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.923+0000 7fdf5613a640 1 --2- 172.21.15.42:0/3369231622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf501025f0 0x7fdf50108e80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009ca0 tx=0x7fdf4802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.923+0000 7fdf5613a640 1 -- 172.21.15.42:0/3369231622 shutdown_connections 2024-09-19T09:42:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.923+0000 7fdf5613a640 1 --2- 172.21.15.42:0/3369231622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf501025f0 0x7fdf50108e80 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.923+0000 7fdf5613a640 1 --2- 172.21.15.42:0/3369231622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf50101c30 0x7fdf501020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.923+0000 7fdf5613a640 1 --2- 172.21.15.42:0/3369231622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf50100a40 0x7fdf50100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.923+0000 7fdf5613a640 1 -- 172.21.15.42:0/3369231622 >> 172.21.15.42:0/3369231622 conn(0x7fdf500fc1e0 msgr2=0x7fdf500fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.923+0000 7fdf5613a640 1 -- 172.21.15.42:0/3369231622 shutdown_connections 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.923+0000 7fdf5613a640 1 -- 172.21.15.42:0/3369231622 wait complete. 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf5613a640 1 Processor -- start 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf5613a640 1 -- start start 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf5613a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf50100a40 0x7fdf50197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf5613a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf50101c30 0x7fdf50198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf5613a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf501025f0 0x7fdf5019f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf5613a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5010d7d0 con 0x7fdf501025f0 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf5613a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5010d650 con 0x7fdf50101c30 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf5613a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5010d950 con 0x7fdf50100a40 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf4ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf501025f0 0x7fdf5019f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf4ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf501025f0 0x7fdf5019f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41206/0 (socket says 172.21.15.42:41206) 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf4ffff640 1 -- 172.21.15.42:0/3794929 learned_addr learned my addr 172.21.15.42:0/3794929 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf47fff640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf50101c30 0x7fdf50198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf4f7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf50100a40 0x7fdf50197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf4ffff640 1 -- 172.21.15.42:0/3794929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf50100a40 msgr2=0x7fdf50197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf4ffff640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf50100a40 0x7fdf50197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf4ffff640 1 -- 172.21.15.42:0/3794929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf50101c30 msgr2=0x7fdf50198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf4ffff640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf50101c30 0x7fdf50198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf4ffff640 1 -- 172.21.15.42:0/3794929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5019f9d0 con 0x7fdf501025f0 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.924+0000 7fdf47fff640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf50101c30 0x7fdf50198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.925+0000 7fdf4ffff640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf501025f0 0x7fdf5019f330 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fdf48031ae0 tx=0x7fdf48031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.925+0000 7fdf4d7fa640 1 -- 172.21.15.42:0/3794929 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48003c30 con 0x7fdf501025f0 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.925+0000 7fdf5613a640 1 -- 172.21.15.42:0/3794929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5019fc60 con 0x7fdf501025f0 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.925+0000 7fdf4d7fa640 1 -- 172.21.15.42:0/3794929 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf48003dd0 con 0x7fdf501025f0 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.925+0000 7fdf4d7fa640 1 -- 172.21.15.42:0/3794929 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4802fcb0 con 0x7fdf501025f0 2024-09-19T09:42:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.925+0000 7fdf5613a640 1 -- 172.21.15.42:0/3794929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf501a01b0 con 0x7fdf501025f0 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.927+0000 7fdf58ed4740 1 Processor -- start 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.927+0000 7fdf4d7fa640 1 -- 172.21.15.42:0/3794929 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fdf48004050 con 0x7fdf501025f0 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.927+0000 7fdf58ed4740 1 -- start start 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.927+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd06f0 0x555942bd51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd5780 0x555942bd7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555942b2f2f0 con 0x555942bcfdb0 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555942ad7270 con 0x555942bd5780 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x555942b2b2b0 con 0x555942bd06f0 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41216/0 (socket says 172.21.15.42:41216) 2024-09-19T09:42:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf47fff640 1 -- 172.21.15.42:0/268458045 learned_addr learned my addr 172.21.15.42:0/268458045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf47fff640 1 --2- 172.21.15.42:0/268458045 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd5780 0x555942bd7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf4f7fe640 1 --2- 172.21.15.42:0/268458045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd06f0 0x555942bd51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf47fff640 1 -- 172.21.15.42:0/268458045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd06f0 msgr2=0x555942bd51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf47fff640 1 --2- 172.21.15.42:0/268458045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd06f0 0x555942bd51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf47fff640 1 -- 172.21.15.42:0/268458045 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd5780 msgr2=0x555942bd7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf47fff640 1 --2- 172.21.15.42:0/268458045 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd5780 0x555942bd7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf47fff640 1 -- 172.21.15.42:0/268458045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555942ad6340 con 0x555942bcfdb0 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf4d7fa640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdf3c0a32f0 0x7fdf3c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf4f7fe640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdf3c0a32f0 0x7fdf3c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf47fff640 1 --2- 172.21.15.42:0/268458045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd01b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fdf38013c30 tx=0x7fdf38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826250adffb6ad95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf4d7fa640 1 -- 172.21.15.42:0/3794929 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fdf480f0c10 con 0x7fdf501025f0 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf45ffb640 1 -- 172.21.15.42:0/268458045 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38013de0 con 0x555942bcfdb0 2024-09-19T09:42:50.937 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf45ffb640 1 -- 172.21.15.42:0/268458045 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf38013170 con 0x555942bcfdb0 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.928+0000 7fdf45ffb640 1 -- 172.21.15.42:0/268458045 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38010db0 con 0x555942bcfdb0 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf58ed4740 1 -- 172.21.15.42:0/268458045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 msgr2=0x555942bd01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/268458045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd01b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fdf38013c30 tx=0x7fdf38009b50 comp rx=0 tx=0).stop 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf4f7fe640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdf3c0a32f0 0x7fdf3c0a57b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x555942bd1120 tx=0x7fdf4000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf58ed4740 1 -- 172.21.15.42:0/268458045 shutdown_connections 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/268458045 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd5780 0x555942bd7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/268458045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd06f0 0x555942bd51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/268458045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd01b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf58ed4740 1 -- 172.21.15.42:0/268458045 >> 172.21.15.42:0/268458045 conn(0x555942bc7010 msgr2=0x555942bc7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf58ed4740 1 -- 172.21.15.42:0/268458045 shutdown_connections 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf58ed4740 1 -- 172.21.15.42:0/268458045 wait complete. 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.929+0000 7fdf58ed4740 1 -- start start 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf58ed4740 1 Processor -- start 2024-09-19T09:42:50.938 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd06f0 0x555942bda4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 0x555942be1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555942bd86f0 con 0x555942bcfdb0 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555942ab8290 con 0x555942bd06f0 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x555942bd8870 con 0x555942bd5780 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf58ed4740 10 client.0 _ll_register_callbacks cb 0x555942ae9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf4f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf4f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41226/0 (socket says 172.21.15.42:41226) 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf4f7fe640 1 -- 172.21.15.42:0/2168097826 learned_addr learned my addr 172.21.15.42:0/2168097826 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf47fff640 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd06f0 0x555942bda4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf4ffff640 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 0x555942be1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf4f7fe640 1 -- 172.21.15.42:0/2168097826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 msgr2=0x555942be1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.939 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf4f7fe640 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 0x555942be1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf4f7fe640 1 -- 172.21.15.42:0/2168097826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd06f0 msgr2=0x555942bda4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf4f7fe640 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd06f0 0x555942bda4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf4f7fe640 1 -- 172.21.15.42:0/2168097826 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555942842210 con 0x555942bcfdb0 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.930+0000 7fdf4ffff640 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 0x555942be1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf4f7fe640 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd9fa0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fdf40003ea0 tx=0x7fdf400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6806bcf904a7bded server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf2effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf2effd640 1 -- 172.21.15.42:0/2168097826 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4001b660 con 0x555942bcfdb0 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf2effd640 1 -- 172.21.15.42:0/2168097826 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fdf4001b800 con 0x555942bcfdb0 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf58ed4740 1 -- 172.21.15.42:0/2168097826 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf38013170 con 0x555942bcfdb0 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf2effd640 1 -- 172.21.15.42:0/2168097826 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fdf4001ba00 con 0x555942bcfdb0 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf58ed4740 10 client.16761 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf58ed4740 1 -- 172.21.15.42:0/2168097826 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55594290e620 con 0x555942bcfdb0 2024-09-19T09:42:50.940 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf2effd640 1 -- 172.21.15.42:0/2168097826 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf38013170 con 0x555942bcfdb0 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf2effd640 1 -- 172.21.15.42:0/2168097826 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fdf40024070 con 0x555942bcfdb0 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf58ed4740 10 client.16761 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf58ed4740 10 client.16761 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf58ed4740 20 client.16761 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555942be5d80 0x555942be8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf58ed4740 4 client.16761 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.931+0000 7fdf58ed4740 1 -- 172.21.15.42:0/2168097826 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555942b3ca20 con 0x555942be5d80 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.932+0000 7fdf47fff640 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555942be5d80 0x555942be8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.932+0000 7fdf47fff640 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555942be5d80 0x555942be8200 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=803baec59bb1e4ab server_cookie=c432d29d387a921f in_seq=0 out_seq=0 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.932+0000 7fdf2effd640 10 client.16761 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf2effd640 1 -- 172.21.15.42:0/2168097826 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555942b3ca20 con 0x555942be5d80 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf2effd640 10 client.16761 handle_command_reply: tid=0 2024-09-19T09:42:50.941 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 client.16761 shutdown 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 -- 172.21.15.42:0/2168097826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 msgr2=0x555942bd9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd9fa0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fdf40003ea0 tx=0x7fdf400046c0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 -- 172.21.15.42:0/2168097826 shutdown_connections 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555942be5d80 0x555942be8200 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 0x555942be1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd06f0 0x555942bda4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf2effd640 0 client.16761 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/2168097826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bcfdb0 0x555942bd9fa0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 -- 172.21.15.42:0/2168097826 >> 172.21.15.42:0/2168097826 conn(0x555942bc7010 msgr2=0x555942bc8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 -- 172.21.15.42:0/2168097826 shutdown_connections 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 1 -- 172.21.15.42:0/2168097826 wait complete. 2024-09-19T09:42:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.933+0000 7fdf58ed4740 20 client.16761 trim_cache size 0 max 16384 2024-09-19T09:42:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf58ed4740 1 Processor -- start 2024-09-19T09:42:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf58ed4740 1 -- start start 2024-09-19T09:42:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bcfdb0 0x555942bc60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd06f0 0x555942be14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 0x555942bc8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a6ef0 con 0x555942bd06f0 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a8cd0 con 0x555942bcfdb0 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a7680 con 0x555942bd5780 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd06f0 0x555942be14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd06f0 0x555942be14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41240/0 (socket says 172.21.15.42:41240) 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf47fff640 1 -- 172.21.15.42:0/442041034 learned_addr learned my addr 172.21.15.42:0/442041034 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf4f7fe640 1 --2- 172.21.15.42:0/442041034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bcfdb0 0x555942bc60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf4ffff640 1 --2- 172.21.15.42:0/442041034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 0x555942bc8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf47fff640 1 -- 172.21.15.42:0/442041034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 msgr2=0x555942bc8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf47fff640 1 --2- 172.21.15.42:0/442041034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 0x555942bc8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf47fff640 1 -- 172.21.15.42:0/442041034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bcfdb0 msgr2=0x555942bc60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf47fff640 1 --2- 172.21.15.42:0/442041034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bcfdb0 0x555942bc60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf47fff640 1 -- 172.21.15.42:0/442041034 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555942bd9ae0 con 0x555942bd06f0 2024-09-19T09:42:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.948+0000 7fdf47fff640 1 --2- 172.21.15.42:0/442041034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd06f0 0x555942be14e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009730 tx=0x7fdf38005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204e83ba841b27d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf457fa640 1 -- 172.21.15.42:0/442041034 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38013170 con 0x555942bd06f0 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf457fa640 1 -- 172.21.15.42:0/442041034 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf38009bc0 con 0x555942bd06f0 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf457fa640 1 -- 172.21.15.42:0/442041034 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38010de0 con 0x555942bd06f0 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf58ed4740 1 -- 172.21.15.42:0/442041034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd06f0 msgr2=0x555942be14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/442041034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd06f0 0x555942be14e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009730 tx=0x7fdf38005850 comp rx=0 tx=0).stop 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf58ed4740 1 -- 172.21.15.42:0/442041034 shutdown_connections 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/442041034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bd5780 0x555942bc8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/442041034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd06f0 0x555942be14e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/442041034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bcfdb0 0x555942bc60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf58ed4740 1 -- 172.21.15.42:0/442041034 >> 172.21.15.42:0/442041034 conn(0x555942bc7010 msgr2=0x555942bc59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf58ed4740 1 -- 172.21.15.42:0/442041034 shutdown_connections 2024-09-19T09:42:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.949+0000 7fdf58ed4740 1 -- 172.21.15.42:0/442041034 wait complete. 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf58ed4740 1 -- start start 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf58ed4740 1 Processor -- start 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bcfdb0 0x555942bde8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd06f0 0x555942bdee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf58ed4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd5780 0x555942bdfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a8570 con 0x555942bd5780 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a7e10 con 0x555942bd06f0 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf58ed4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a4ed0 con 0x555942bcfdb0 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf58ed4740 10 client.0 _ll_register_callbacks cb 0x7fdf4000b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf4ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd5780 0x555942bdfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf4ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd5780 0x555942bdfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41256/0 (socket says 172.21.15.42:41256) 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf4ffff640 1 -- 172.21.15.42:0/1304246486 learned_addr learned my addr 172.21.15.42:0/1304246486 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf4f7fe640 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bcfdb0 0x555942bde8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf47fff640 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd06f0 0x555942bdee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf4ffff640 1 -- 172.21.15.42:0/1304246486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bcfdb0 msgr2=0x555942bde8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf4ffff640 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bcfdb0 0x555942bde8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf4ffff640 1 -- 172.21.15.42:0/1304246486 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd06f0 msgr2=0x555942bdee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf4ffff640 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd06f0 0x555942bdee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.950+0000 7fdf4ffff640 1 -- 172.21.15.42:0/1304246486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555942be0450 con 0x555942bd5780 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf4ffff640 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd5780 0x555942bdfe40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fdf480ee6f0 tx=0x7fdf480bcc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e641f3f4ceea607f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf2effd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf2effd640 1 -- 172.21.15.42:0/1304246486 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf480d5070 con 0x555942bd5780 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf2effd640 1 -- 172.21.15.42:0/1304246486 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fdf480bb630 con 0x555942bd5780 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf58ed4740 1 -- 172.21.15.42:0/1304246486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf38009bc0 con 0x555942bd5780 2024-09-19T09:42:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf2effd640 1 -- 172.21.15.42:0/1304246486 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fdf480bd330 con 0x555942bd5780 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf58ed4740 10 client.16767 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf58ed4740 1 -- 172.21.15.42:0/1304246486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x555942be1830 con 0x555942bd5780 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf2effd640 1 -- 172.21.15.42:0/1304246486 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf38009bc0 con 0x555942bd5780 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf2effd640 1 -- 172.21.15.42:0/1304246486 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fdf480c5b10 con 0x555942bd5780 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf58ed4740 10 client.16767 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf58ed4740 10 client.16767 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf58ed4740 20 client.16767 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555942c51300 0x555942c53720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf58ed4740 4 client.16767 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf58ed4740 1 -- 172.21.15.42:0/1304246486 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555942b36d70 con 0x555942c51300 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.951+0000 7fdf4f7fe640 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555942c51300 0x555942c53720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.952+0000 7fdf2effd640 10 client.16767 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.952+0000 7fdf4f7fe640 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555942c51300 0x555942c53720 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83ec842b2a02884b server_cookie=1aa70ae5aedd357a in_seq=0 out_seq=0 2024-09-19T09:42:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.961+0000 7fdf2effd640 1 -- 172.21.15.42:0/1304246486 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555942b36d70 con 0x555942c51300 2024-09-19T09:42:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.961+0000 7fdf2effd640 10 client.16767 handle_command_reply: tid=0 2024-09-19T09:42:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.961+0000 7fdf58ed4740 1 client.16767 shutdown 2024-09-19T09:42:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 1 -- 172.21.15.42:0/1304246486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd5780 msgr2=0x555942bdfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd5780 0x555942bdfe40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fdf480ee6f0 tx=0x7fdf480bcc90 comp rx=0 tx=0).stop 2024-09-19T09:42:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 1 -- 172.21.15.42:0/1304246486 shutdown_connections 2024-09-19T09:42:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x555942c51300 0x555942c53720 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555942bd5780 0x555942bdfe40 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555942bd06f0 0x555942bdee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf2effd640 0 client.16767 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 1 --2- 172.21.15.42:0/1304246486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555942bcfdb0 0x555942bde8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 1 -- 172.21.15.42:0/1304246486 >> 172.21.15.42:0/1304246486 conn(0x555942bc7010 msgr2=0x555942bc61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 1 -- 172.21.15.42:0/1304246486 shutdown_connections 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 1 -- 172.21.15.42:0/1304246486 wait complete. 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf58ed4740 20 client.16767 trim_cache size 0 max 16384 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:{ 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "message": "", 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout: "return_code": 0 2024-09-19T09:42:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stdout:} 2024-09-19T09:42:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf5613a640 1 -- 172.21.15.42:0/3794929 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdf3c0a32f0 msgr2=0x7fdf3c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf5613a640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdf3c0a32f0 0x7fdf3c0a57b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x555942bd1120 tx=0x7fdf4000b410 comp rx=0 tx=0).stop 2024-09-19T09:42:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf5613a640 1 -- 172.21.15.42:0/3794929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf501025f0 msgr2=0x7fdf5019f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.962+0000 7fdf5613a640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf501025f0 0x7fdf5019f330 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fdf48031ae0 tx=0x7fdf48031ee0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.963+0000 7fdf5613a640 1 -- 172.21.15.42:0/3794929 shutdown_connections 2024-09-19T09:42:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.963+0000 7fdf5613a640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fdf3c0a32f0 0x7fdf3c0a57b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.963+0000 7fdf5613a640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf501025f0 0x7fdf5019f330 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.963+0000 7fdf5613a640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf50101c30 0x7fdf50198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.963+0000 7fdf5613a640 1 --2- 172.21.15.42:0/3794929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf50100a40 0x7fdf50197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.963+0000 7fdf5613a640 1 -- 172.21.15.42:0/3794929 >> 172.21.15.42:0/3794929 conn(0x7fdf500fc1e0 msgr2=0x7fdf50105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.963+0000 7fdf5613a640 1 -- 172.21.15.42:0/3794929 shutdown_connections 2024-09-19T09:42:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi042.front.sepia.ceph.com.smithi042.stderr:2024-09-19T09:42:50.963+0000 7fdf5613a640 1 -- 172.21.15.42:0/3794929 wait complete. 2024-09-19T09:42:52.643 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:42:52.643 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:42:52.678 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-19T09:42:52.678 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T09:42:52.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:52 smithi042 ceph-mon[31223]: pgmap v443: 97 pgs: 97 active+clean; 145 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 146 KiB/s wr, 75 op/s 2024-09-19T09:42:52.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:52 smithi171 ceph-mon[35803]: pgmap v443: 97 pgs: 97 active+clean; 145 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 146 KiB/s wr, 75 op/s 2024-09-19T09:42:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:52 smithi136 ceph-mon[34840]: pgmap v443: 97 pgs: 97 active+clean; 145 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 146 KiB/s wr, 75 op/s 2024-09-19T09:42:52.915 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:53.048 DEBUG:teuthology.parallel:result is None 2024-09-19T09:42:53.048 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:42:53.089 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:42:53.089 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T09:42:53.101 INFO:tasks.quiescer:joining Quiescers 2024-09-19T09:42:53.101 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T09:42:53.101 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:42:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.419+0000 7f36746ee640 1 -- 172.21.15.42:0/1506619205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f366c1036e0 msgr2=0x7f366c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.419+0000 7f36746ee640 1 --2- 172.21.15.42:0/1506619205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f366c1036e0 0x7f366c107b90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3660009930 tx=0x7f366002a420 comp rx=0 tx=0).stop 2024-09-19T09:42:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.419+0000 7f36746ee640 1 -- 172.21.15.42:0/1506619205 shutdown_connections 2024-09-19T09:42:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.419+0000 7f36746ee640 1 --2- 172.21.15.42:0/1506619205 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f366c1082a0 0x7f366c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.419+0000 7f36746ee640 1 --2- 172.21.15.42:0/1506619205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f366c1036e0 0x7f366c107b90 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.419+0000 7f36746ee640 1 --2- 172.21.15.42:0/1506619205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f366c102d30 0x7f366c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.419+0000 7f36746ee640 1 -- 172.21.15.42:0/1506619205 >> 172.21.15.42:0/1506619205 conn(0x7f366c0fc7d0 msgr2=0x7f366c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.419+0000 7f36746ee640 1 -- 172.21.15.42:0/1506619205 shutdown_connections 2024-09-19T09:42:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.419+0000 7f36746ee640 1 -- 172.21.15.42:0/1506619205 wait complete. 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f36746ee640 1 Processor -- start 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f36746ee640 1 -- start start 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f36746ee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f366c102d30 0x7f366c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f36746ee640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f366c1036e0 0x7f366c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f36746ee640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f366c1082a0 0x7f366c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f36746ee640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f366c112060 con 0x7f366c102d30 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f36746ee640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f366c111ee0 con 0x7f366c1036e0 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f36746ee640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f366c1121e0 con 0x7f366c1082a0 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f367248a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f366c102d30 0x7f366c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f367248a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f366c102d30 0x7f366c1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41284/0 (socket says 172.21.15.42:41284) 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f367248a640 1 -- 172.21.15.42:0/1090043970 learned_addr learned my addr 172.21.15.42:0/1090043970 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f3672c8b640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f366c1082a0 0x7f366c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f3671c89640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f366c1036e0 0x7f366c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f367248a640 1 -- 172.21.15.42:0/1090043970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f366c1082a0 msgr2=0x7f366c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f367248a640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f366c1082a0 0x7f366c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f367248a640 1 -- 172.21.15.42:0/1090043970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f366c1036e0 msgr2=0x7f366c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f367248a640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f366c1036e0 0x7f366c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f367248a640 1 -- 172.21.15.42:0/1090043970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c19d570 con 0x7f366c102d30 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.420+0000 7f3672c8b640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f366c1082a0 0x7f366c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.421+0000 7f367248a640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f366c102d30 0x7f366c1985c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f366800eab0 tx=0x7f366800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.421+0000 7f365f7fe640 1 -- 172.21.15.42:0/1090043970 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366800ce40 con 0x7f366c102d30 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.421+0000 7f365f7fe640 1 -- 172.21.15.42:0/1090043970 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3668011950 con 0x7f366c102d30 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.421+0000 7f36746ee640 1 -- 172.21.15.42:0/1090043970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366c19d860 con 0x7f366c102d30 2024-09-19T09:42:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.421+0000 7f365f7fe640 1 -- 172.21.15.42:0/1090043970 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668010ae0 con 0x7f366c102d30 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.421+0000 7f36746ee640 1 -- 172.21.15.42:0/1090043970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366c1a5140 con 0x7f366c102d30 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.423+0000 7f365f7fe640 1 -- 172.21.15.42:0/1090043970 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3668011b00 con 0x7f366c102d30 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.423+0000 7f3676ac7740 1 Processor -- start 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.423+0000 7f3676ac7740 1 -- start start 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab73e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 0x55d31ab82c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 0x55d31ab85540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3676ac7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d31aad9280 con 0x55d31ab73a40 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3676ac7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d31aa80b10 con 0x55d31ab74360 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3676ac7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d31aad5240 con 0x55d31ab83150 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3672c8b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab73e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f365f7fe640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36580a3240 0x7f36580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3672c8b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab73e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41296/0 (socket says 172.21.15.42:41296) 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3672c8b640 1 -- 172.21.15.42:0/746835218 learned_addr learned my addr 172.21.15.42:0/746835218 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f367248a640 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 0x55d31ab82c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3671c89640 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 0x55d31ab85540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3672c8b640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36580a3240 0x7f36580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f365f7fe640 1 -- 172.21.15.42:0/1090043970 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f36680d0120 con 0x7f366c102d30 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3672c8b640 1 -- 172.21.15.42:0/746835218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 msgr2=0x55d31ab85540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3672c8b640 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 0x55d31ab85540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3672c8b640 1 -- 172.21.15.42:0/746835218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 msgr2=0x55d31ab82c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3672c8b640 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 0x55d31ab82c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3672c8b640 1 -- 172.21.15.42:0/746835218 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31aa8d1f0 con 0x55d31ab73a40 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3671c89640 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 0x55d31ab85540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:53.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f367248a640 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 0x55d31ab82c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.424+0000 7f3672c8b640 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab73e20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3664009f30 tx=0x7f36640148a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e12540eb28d30f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f365cff9640 1 -- 172.21.15.42:0/746835218 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664022070 con 0x55d31ab73a40 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f365cff9640 1 -- 172.21.15.42:0/746835218 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36640129f0 con 0x55d31ab73a40 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f365cff9640 1 -- 172.21.15.42:0/746835218 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366401c7d0 con 0x55d31ab73a40 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f3676ac7740 1 -- 172.21.15.42:0/746835218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 msgr2=0x55d31ab73e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f3672c8b640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36580a3240 0x7f36580a5700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f366401f000 tx=0x7f366401a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f3676ac7740 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab73e20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3664009f30 tx=0x7f36640148a0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f3676ac7740 1 -- 172.21.15.42:0/746835218 shutdown_connections 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f3676ac7740 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 0x55d31ab85540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f3676ac7740 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 0x55d31ab82c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f3676ac7740 1 --2- 172.21.15.42:0/746835218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab73e20 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.425+0000 7f3676ac7740 1 -- 172.21.15.42:0/746835218 >> 172.21.15.42:0/746835218 conn(0x55d31ab700f0 msgr2=0x55d31ab704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:53.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 1 -- 172.21.15.42:0/746835218 shutdown_connections 2024-09-19T09:42:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 1 -- 172.21.15.42:0/746835218 wait complete. 2024-09-19T09:42:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 1 -- start start 2024-09-19T09:42:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 1 Processor -- start 2024-09-19T09:42:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab800d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 0x55d31ab80610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab83150 0x55d31ab80b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d31ab85d20 con 0x55d31ab73a40 2024-09-19T09:42:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d31aa93f10 con 0x55d31ab83150 2024-09-19T09:42:53.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d31ab85ea0 con 0x55d31ab74360 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.426+0000 7f3676ac7740 10 client.0 _ll_register_callbacks cb 0x55d31aa5ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f367248a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab800d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f367248a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab800d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41308/0 (socket says 172.21.15.42:41308) 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f367248a640 1 -- 172.21.15.42:0/406750691 learned_addr learned my addr 172.21.15.42:0/406750691 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f3672c8b640 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab83150 0x55d31ab80b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f3671c89640 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 0x55d31ab80610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f367248a640 1 -- 172.21.15.42:0/406750691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 msgr2=0x55d31ab80610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f367248a640 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 0x55d31ab80610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f367248a640 1 -- 172.21.15.42:0/406750691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab83150 msgr2=0x55d31ab80b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f367248a640 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab83150 0x55d31ab80b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f367248a640 1 -- 172.21.15.42:0/406750691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d31a84a6a0 con 0x55d31ab73a40 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f3671c89640 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 0x55d31ab80610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f367248a640 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab800d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f36680a4e60 tx=0x7f366801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7b973f5a219280 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f3655ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f3655ffb640 1 -- 172.21.15.42:0/406750691 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366809c080 con 0x55d31ab73a40 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f3655ffb640 1 -- 172.21.15.42:0/406750691 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f366801ec60 con 0x55d31ab73a40 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f3676ac7740 1 -- 172.21.15.42:0/406750691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36640129f0 con 0x55d31ab73a40 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f3655ffb640 1 -- 172.21.15.42:0/406750691 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f36680204b0 con 0x55d31ab73a40 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f3676ac7740 10 client.16779 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.427+0000 7f3676ac7740 1 -- 172.21.15.42:0/406750691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d31ab91a60 con 0x55d31ab73a40 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.428+0000 7f3655ffb640 1 -- 172.21.15.42:0/406750691 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36640129f0 con 0x55d31ab73a40 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.428+0000 7f3655ffb640 1 -- 172.21.15.42:0/406750691 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f366800f040 con 0x55d31ab73a40 2024-09-19T09:42:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.428+0000 7f3676ac7740 10 client.16779 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.428+0000 7f3676ac7740 10 client.16779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.428+0000 7f3676ac7740 20 client.16779 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.428+0000 7f3676ac7740 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d31ab92f10 0x55d31ab953a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.428+0000 7f3676ac7740 4 client.16779 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.428+0000 7f3676ac7740 1 -- 172.21.15.42:0/406750691 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d31aae67f0 con 0x55d31ab92f10 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.428+0000 7f3671c89640 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d31ab92f10 0x55d31ab953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3671c89640 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d31ab92f10 0x55d31ab953a0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e7378dc643a2620 server_cookie=cfefe678de4befc2 in_seq=0 out_seq=0 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3655ffb640 10 client.16779 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3655ffb640 1 -- 172.21.15.42:0/406750691 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d31aae67f0 con 0x55d31ab92f10 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3655ffb640 10 client.16779 handle_command_reply: tid=0 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 client.16779 shutdown 2024-09-19T09:42:53.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 -- 172.21.15.42:0/406750691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 msgr2=0x55d31ab800d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab800d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f36680a4e60 tx=0x7f366801ebf0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 -- 172.21.15.42:0/406750691 shutdown_connections 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d31ab92f10 0x55d31ab953a0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab83150 0x55d31ab80b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3655ffb640 0 client.16779 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 0x55d31ab80610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 --2- 172.21.15.42:0/406750691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab800d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 -- 172.21.15.42:0/406750691 >> 172.21.15.42:0/406750691 conn(0x55d31ab700f0 msgr2=0x55d31ab75e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 -- 172.21.15.42:0/406750691 shutdown_connections 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.429+0000 7f3676ac7740 1 -- 172.21.15.42:0/406750691 wait complete. 2024-09-19T09:42:53.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.430+0000 7f3676ac7740 20 client.16779 trim_cache size 0 max 16384 2024-09-19T09:42:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3676ac7740 1 Processor -- start 2024-09-19T09:42:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3676ac7740 1 -- start start 2024-09-19T09:42:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab73a40 0x55d31ab9ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 0x55d31ab9b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab83150 0x55d31ab7d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3676ac7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f366c1ab4d0 con 0x55d31ab83150 2024-09-19T09:42:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3676ac7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f366c1ad2b0 con 0x55d31ab73a40 2024-09-19T09:42:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3676ac7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f366c1abc60 con 0x55d31ab74360 2024-09-19T09:42:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3672c8b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab83150 0x55d31ab7d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3672c8b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab83150 0x55d31ab7d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41318/0 (socket says 172.21.15.42:41318) 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3672c8b640 1 -- 172.21.15.42:0/3504453901 learned_addr learned my addr 172.21.15.42:0/3504453901 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f367248a640 1 --2- 172.21.15.42:0/3504453901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab73a40 0x55d31ab9ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.449+0000 7f3671c89640 1 --2- 172.21.15.42:0/3504453901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 0x55d31ab9b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.450+0000 7f3672c8b640 1 -- 172.21.15.42:0/3504453901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 msgr2=0x55d31ab9b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.450+0000 7f3672c8b640 1 --2- 172.21.15.42:0/3504453901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 0x55d31ab9b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.450+0000 7f3672c8b640 1 -- 172.21.15.42:0/3504453901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab73a40 msgr2=0x55d31ab9ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.450+0000 7f3672c8b640 1 --2- 172.21.15.42:0/3504453901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab73a40 0x55d31ab9ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.450+0000 7f3672c8b640 1 -- 172.21.15.42:0/3504453901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31ab7e620 con 0x55d31ab83150 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.450+0000 7f3672c8b640 1 --2- 172.21.15.42:0/3504453901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab83150 0x55d31ab7d330 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f366401c4e0 tx=0x7f3664027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cace917c5440e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.450+0000 7f3657fff640 1 -- 172.21.15.42:0/3504453901 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664032020 con 0x55d31ab83150 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.450+0000 7f3657fff640 1 -- 172.21.15.42:0/3504453901 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3664009820 con 0x55d31ab83150 2024-09-19T09:42:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.450+0000 7f3657fff640 1 -- 172.21.15.42:0/3504453901 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664022040 con 0x55d31ab83150 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 -- 172.21.15.42:0/3504453901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab83150 msgr2=0x55d31ab7d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 --2- 172.21.15.42:0/3504453901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab83150 0x55d31ab7d330 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f366401c4e0 tx=0x7f3664027000 comp rx=0 tx=0).stop 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 -- 172.21.15.42:0/3504453901 shutdown_connections 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 --2- 172.21.15.42:0/3504453901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab83150 0x55d31ab7d330 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 --2- 172.21.15.42:0/3504453901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab74360 0x55d31ab9b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 --2- 172.21.15.42:0/3504453901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab73a40 0x55d31ab9ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 -- 172.21.15.42:0/3504453901 >> 172.21.15.42:0/3504453901 conn(0x55d31ab700f0 msgr2=0x55d31ab75dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 -- 172.21.15.42:0/3504453901 shutdown_connections 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 -- 172.21.15.42:0/3504453901 wait complete. 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 -- start start 2024-09-19T09:42:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.451+0000 7f3676ac7740 1 Processor -- start 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab87700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 0x55d31ab87c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3676ac7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 0x55d31abf6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3676ac7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f366c1acb50 con 0x55d31ab73a40 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3676ac7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f366c1ac3f0 con 0x55d31ab74360 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3676ac7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f366c1a94b0 con 0x55d31ab83150 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3676ac7740 10 client.0 _ll_register_callbacks cb 0x7f3668098300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f367248a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab87700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f367248a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab87700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41324/0 (socket says 172.21.15.42:41324) 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f367248a640 1 -- 172.21.15.42:0/1917833729 learned_addr learned my addr 172.21.15.42:0/1917833729 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3671c89640 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 0x55d31ab87c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3672c8b640 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 0x55d31abf6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f367248a640 1 -- 172.21.15.42:0/1917833729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 msgr2=0x55d31abf6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f367248a640 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 0x55d31abf6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f367248a640 1 -- 172.21.15.42:0/1917833729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 msgr2=0x55d31ab87c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f367248a640 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 0x55d31ab87c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f367248a640 1 -- 172.21.15.42:0/1917833729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d31abf7250 con 0x55d31ab73a40 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3671c89640 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 0x55d31ab87c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f367248a640 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab87700 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f366809a9d0 tx=0x7f3668010540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b675ebf415d6d8e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3655ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3655ffb640 1 -- 172.21.15.42:0/1917833729 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36680204c0 con 0x55d31ab73a40 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3655ffb640 1 -- 172.21.15.42:0/1917833729 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f366801d120 con 0x55d31ab73a40 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.452+0000 7f3676ac7740 1 -- 172.21.15.42:0/1917833729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3664009820 con 0x55d31ab73a40 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3655ffb640 1 -- 172.21.15.42:0/1917833729 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3668067070 con 0x55d31ab73a40 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3676ac7740 10 client.16785 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3676ac7740 1 -- 172.21.15.42:0/1917833729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d31abf7250 con 0x55d31ab73a40 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3655ffb640 1 -- 172.21.15.42:0/1917833729 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f366809ce20 con 0x55d31ab73a40 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3655ffb640 1 -- 172.21.15.42:0/1917833729 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f3668051b40 con 0x55d31ab73a40 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3676ac7740 10 client.16785 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3676ac7740 10 client.16785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3676ac7740 20 client.16785 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3676ac7740 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d31abfeaa0 0x55d31ac00ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3676ac7740 4 client.16785 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3676ac7740 1 -- 172.21.15.42:0/1917833729 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f3664009820 con 0x55d31abfeaa0 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.453+0000 7f3671c89640 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d31abfeaa0 0x55d31ac00ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.454+0000 7f3671c89640 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d31abfeaa0 0x55d31ac00ec0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6fb8286f8828f17 server_cookie=12675773b39fb66a in_seq=0 out_seq=0 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.454+0000 7f3655ffb640 10 client.16785 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.454+0000 7f3655ffb640 1 -- 172.21.15.42:0/1917833729 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f3664009820 con 0x55d31abfeaa0 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.454+0000 7f3655ffb640 10 client.16785 handle_command_reply: tid=0 2024-09-19T09:42:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.454+0000 7f3676ac7740 1 client.16785 shutdown 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 1 -- 172.21.15.42:0/1917833729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 msgr2=0x55d31ab87700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab87700 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f366809a9d0 tx=0x7f3668010540 comp rx=0 tx=0).stop 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 1 -- 172.21.15.42:0/1917833729 shutdown_connections 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55d31abfeaa0 0x55d31ac00ec0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d31ab83150 0x55d31abf6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31ab74360 0x55d31ab87c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 1 --2- 172.21.15.42:0/1917833729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d31ab73a40 0x55d31ab87700 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 1 -- 172.21.15.42:0/1917833729 >> 172.21.15.42:0/1917833729 conn(0x55d31ab700f0 msgr2=0x55d31ab755a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3655ffb640 0 client.16785 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 1 -- 172.21.15.42:0/1917833729 shutdown_connections 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 1 -- 172.21.15.42:0/1917833729 wait complete. 2024-09-19T09:42:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.455+0000 7f3676ac7740 20 client.16785 trim_cache size 0 max 16384 2024-09-19T09:42:53.467 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:42:53.467 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-19T09:42:53.467 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "32baa15d-afad-4f0c-a809-36fb0ab67080", 2024-09-19T09:42:53.467 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-19T09:42:53.467 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:42:53.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 -- 172.21.15.42:0/1090043970 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36580a3240 msgr2=0x7f36580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36580a3240 0x7f36580a5700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f366401f000 tx=0x7f366401a000 comp rx=0 tx=0).stop 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 -- 172.21.15.42:0/1090043970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f366c102d30 msgr2=0x7f366c1985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f366c102d30 0x7f366c1985c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f366800eab0 tx=0x7f366800ef70 comp rx=0 tx=0).stop 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 -- 172.21.15.42:0/1090043970 shutdown_connections 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f36580a3240 0x7f36580a5700 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f366c1082a0 0x7f366c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f366c1036e0 0x7f366c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 --2- 172.21.15.42:0/1090043970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f366c102d30 0x7f366c1985c0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 -- 172.21.15.42:0/1090043970 >> 172.21.15.42:0/1090043970 conn(0x7f366c0fc7d0 msgr2=0x7f366c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 -- 172.21.15.42:0/1090043970 shutdown_connections 2024-09-19T09:42:53.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:53.456+0000 7f36746ee640 1 -- 172.21.15.42:0/1090043970 wait complete. 2024-09-19T09:42:54.212 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:42:54.233 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:54.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:54 smithi042 ceph-mon[31223]: pgmap v444: 97 pgs: 97 active+clean; 145 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 305 KiB/s wr, 106 op/s 2024-09-19T09:42:54.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:54 smithi042 ceph-mon[31223]: scrub queued for path: / 2024-09-19T09:42:54.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:54 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:54.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:54 smithi042 ceph-mon[31223]: scrub summary: active paths [/] 2024-09-19T09:42:54.643 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:54 smithi042 ceph-mon[31223]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:54.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.722+0000 7f48d4aef640 1 -- 172.21.15.42:0/1991442446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48d0069f00 msgr2=0x7f48d0100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:54.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.722+0000 7f48d4aef640 1 --2- 172.21.15.42:0/1991442446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48d0069f00 0x7f48d0100460 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009900 tx=0x7f48c002a410 comp rx=0 tx=0).stop 2024-09-19T09:42:54.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.723+0000 7f48d4aef640 1 -- 172.21.15.42:0/1991442446 shutdown_connections 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.723+0000 7f48d4aef640 1 --2- 172.21.15.42:0/1991442446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48d0104e60 0x7f48d0105310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.723+0000 7f48d4aef640 1 --2- 172.21.15.42:0/1991442446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d006a370 0x7f48d01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.723+0000 7f48d4aef640 1 --2- 172.21.15.42:0/1991442446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48d0069f00 0x7f48d0100460 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.723+0000 7f48d4aef640 1 -- 172.21.15.42:0/1991442446 >> 172.21.15.42:0/1991442446 conn(0x7f48d00fbee0 msgr2=0x7f48d00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.723+0000 7f48d4aef640 1 -- 172.21.15.42:0/1991442446 shutdown_connections 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.723+0000 7f48d4aef640 1 -- 172.21.15.42:0/1991442446 wait complete. 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.723+0000 7f48d4aef640 1 Processor -- start 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.723+0000 7f48d4aef640 1 -- start start 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48d4aef640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d0069f00 0x7f48d0197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48d4aef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48d006a370 0x7f48d0197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48d4aef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48d0104e60 0x7f48d019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48d4aef640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0110ee0 con 0x7f48d0104e60 2024-09-19T09:42:54.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48d4aef640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0110d60 con 0x7f48d0069f00 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48d4aef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0111060 con 0x7f48d006a370 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48ced9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48d0104e60 0x7f48d019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48ced9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48d0104e60 0x7f48d019bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41334/0 (socket says 172.21.15.42:41334) 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48ced9d640 1 -- 172.21.15.42:0/2347372738 learned_addr learned my addr 172.21.15.42:0/2347372738 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48cdd9b640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48d006a370 0x7f48d0197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48ce59c640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d0069f00 0x7f48d0197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48ced9d640 1 -- 172.21.15.42:0/2347372738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48d006a370 msgr2=0x7f48d0197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48ced9d640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48d006a370 0x7f48d0197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48ced9d640 1 -- 172.21.15.42:0/2347372738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d0069f00 msgr2=0x7f48d0197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48ced9d640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d0069f00 0x7f48d0197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48ced9d640 1 -- 172.21.15.42:0/2347372738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d019c2b0 con 0x7f48d0104e60 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48ced9d640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48d0104e60 0x7f48d019bbd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009fd0 tx=0x7f48c800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48bf7fe640 1 -- 172.21.15.42:0/2347372738 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8017070 con 0x7f48d0104e60 2024-09-19T09:42:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48bf7fe640 1 -- 172.21.15.42:0/2347372738 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48c8003e50 con 0x7f48d0104e60 2024-09-19T09:42:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48d4aef640 1 -- 172.21.15.42:0/2347372738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d019c5a0 con 0x7f48d0104e60 2024-09-19T09:42:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.724+0000 7f48bf7fe640 1 -- 172.21.15.42:0/2347372738 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c80106c0 con 0x7f48d0104e60 2024-09-19T09:42:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.725+0000 7f48d4aef640 1 -- 172.21.15.42:0/2347372738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d01a3e80 con 0x7f48d0104e60 2024-09-19T09:42:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.725+0000 7f48d4aef640 1 -- 172.21.15.42:0/2347372738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d0105310 con 0x7f48d0104e60 2024-09-19T09:42:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.727+0000 7f48bf7fe640 1 -- 172.21.15.42:0/2347372738 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f48c8003970 con 0x7f48d0104e60 2024-09-19T09:42:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.727+0000 7f48bf7fe640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48b80a3240 0x7f48b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.727+0000 7f48ce59c640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48b80a3240 0x7f48b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.727+0000 7f48bf7fe640 1 -- 172.21.15.42:0/2347372738 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f48c80cf5b0 con 0x7f48d0104e60 2024-09-19T09:42:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.728+0000 7f48ce59c640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48b80a3240 0x7f48b80a5700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f48c0000c00 tx=0x7f48c0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.731+0000 7f48bf7fe640 1 -- 172.21.15.42:0/2347372738 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48c809bc60 con 0x7f48d0104e60 2024-09-19T09:42:54.790 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:54.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:54 smithi171 ceph-mon[35803]: pgmap v444: 97 pgs: 97 active+clean; 145 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 305 KiB/s wr, 106 op/s 2024-09-19T09:42:54.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:54 smithi171 ceph-mon[35803]: scrub queued for path: / 2024-09-19T09:42:54.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:54 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:54.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:54 smithi171 ceph-mon[35803]: scrub summary: active paths [/] 2024-09-19T09:42:54.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:54 smithi171 ceph-mon[35803]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:54 smithi136 ceph-mon[34840]: pgmap v444: 97 pgs: 97 active+clean; 145 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 305 KiB/s wr, 106 op/s 2024-09-19T09:42:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:54 smithi136 ceph-mon[34840]: scrub queued for path: / 2024-09-19T09:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:54 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:54 smithi136 ceph-mon[34840]: scrub summary: active paths [/] 2024-09-19T09:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:54 smithi136 ceph-mon[34840]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:54.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.952+0000 7f48d4aef640 1 -- 172.21.15.42:0/2347372738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48d01a40b0 con 0x7f48d0104e60 2024-09-19T09:42:54.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.953+0000 7f48bf7fe640 1 -- 172.21.15.42:0/2347372738 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+12010 (secure 0 0 0) 0x7f48c809ff60 con 0x7f48d0104e60 2024-09-19T09:42:54.955 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:42:54.955 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":38,"btime":"2024-09-19T09:42:32:397781+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:42:31.429090+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:42:54.955 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 38 2024-09-19T09:42:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 -- 172.21.15.42:0/2347372738 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48b80a3240 msgr2=0x7f48b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48b80a3240 0x7f48b80a5700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f48c0000c00 tx=0x7f48c0005b50 comp rx=0 tx=0).stop 2024-09-19T09:42:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 -- 172.21.15.42:0/2347372738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48d0104e60 msgr2=0x7f48d019bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48d0104e60 0x7f48d019bbd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009fd0 tx=0x7f48c800b260 comp rx=0 tx=0).stop 2024-09-19T09:42:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 -- 172.21.15.42:0/2347372738 shutdown_connections 2024-09-19T09:42:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f48b80a3240 0x7f48b80a5700 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48d0104e60 0x7f48d019bbd0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48d006a370 0x7f48d0197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 --2- 172.21.15.42:0/2347372738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d0069f00 0x7f48d0197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 -- 172.21.15.42:0/2347372738 >> 172.21.15.42:0/2347372738 conn(0x7f48d00fbee0 msgr2=0x7f48d0103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 -- 172.21.15.42:0/2347372738 shutdown_connections 2024-09-19T09:42:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:54.955+0000 7f48d4aef640 1 -- 172.21.15.42:0/2347372738 wait complete. 2024-09-19T09:42:55.675 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:55 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2347372738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:55.705 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --cancel --all' 2024-09-19T09:42:55.705 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --cancel --all 2024-09-19T09:42:55.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:55 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2347372738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:55.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:55 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2347372738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:55.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.877+0000 7fa803634640 1 -- 172.21.15.42:0/864970160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc105560 msgr2=0x7fa7fc10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.877+0000 7fa803634640 1 --2- 172.21.15.42:0/864970160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc105560 0x7fa7fc10d0e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009ca0 tx=0x7fa7f402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.877+0000 7fa803634640 1 -- 172.21.15.42:0/864970160 shutdown_connections 2024-09-19T09:42:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.877+0000 7fa803634640 1 --2- 172.21.15.42:0/864970160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc105560 0x7fa7fc10d0e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.877+0000 7fa803634640 1 --2- 172.21.15.42:0/864970160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc100de0 0x7fa7fc104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.877+0000 7fa803634640 1 --2- 172.21.15.42:0/864970160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc100430 0x7fa7fc100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.877+0000 7fa803634640 1 -- 172.21.15.42:0/864970160 >> 172.21.15.42:0/864970160 conn(0x7fa7fc077230 msgr2=0x7fa7fc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.877+0000 7fa803634640 1 -- 172.21.15.42:0/864970160 shutdown_connections 2024-09-19T09:42:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.877+0000 7fa803634640 1 -- 172.21.15.42:0/864970160 wait complete. 2024-09-19T09:42:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.878+0000 7fa803634640 1 Processor -- start 2024-09-19T09:42:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.878+0000 7fa803634640 1 -- start start 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa803634640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc100430 0x7fa7fc10e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa803634640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc100de0 0x7fa7fc10ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa803634640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc105560 0x7fa7fc10f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa803634640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc111f60 con 0x7fa7fc105560 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa803634640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc111de0 con 0x7fa7fc100430 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa803634640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1120e0 con 0x7fa7fc100de0 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa801bd1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc105560 0x7fa7fc10f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa801bd1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc105560 0x7fa7fc10f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41358/0 (socket says 172.21.15.42:41358) 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa801bd1640 1 -- 172.21.15.42:0/1985732599 learned_addr learned my addr 172.21.15.42:0/1985732599 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa8013d0640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc100430 0x7fa7fc10e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa800bcf640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc100de0 0x7fa7fc10ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa801bd1640 1 -- 172.21.15.42:0/1985732599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc100de0 msgr2=0x7fa7fc10ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa801bd1640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc100de0 0x7fa7fc10ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa801bd1640 1 -- 172.21.15.42:0/1985732599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc100430 msgr2=0x7fa7fc10e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa801bd1640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc100430 0x7fa7fc10e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa801bd1640 1 -- 172.21.15.42:0/1985732599 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc1a6870 con 0x7fa7fc105560 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.879+0000 7fa801bd1640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc105560 0x7fa7fc10f280 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4031a60 tx=0x7fa7f4031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.880+0000 7fa7f27fc640 1 -- 172.21.15.42:0/1985732599 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4003b70 con 0x7fa7fc105560 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.880+0000 7fa7f27fc640 1 -- 172.21.15.42:0/1985732599 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7f4003d10 con 0x7fa7fc105560 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.880+0000 7fa803634640 1 -- 172.21.15.42:0/1985732599 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7fc1a6b00 con 0x7fa7fc105560 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.880+0000 7fa7f27fc640 1 -- 172.21.15.42:0/1985732599 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4004770 con 0x7fa7fc105560 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.880+0000 7fa803634640 1 -- 172.21.15.42:0/1985732599 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7fc1a7090 con 0x7fa7fc105560 2024-09-19T09:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.882+0000 7fa7f27fc640 1 -- 172.21.15.42:0/1985732599 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa7f402f790 con 0x7fa7fc105560 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa805a0d740 1 Processor -- start 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa805a0d740 1 -- start start 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 0x5573e5d74880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d81a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa805a0d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5573e5cda2e0 con 0x5573e5d7f680 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa805a0d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5573e5c81ce0 con 0x5573e5d744a0 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa805a0d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5573e5cd62a0 con 0x5573e5d74dc0 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa800bcf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d81a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa7f27fc640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a32c0 0x7fa7e80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa800bcf640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 0x5573e5d74880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa8013d0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa800bcf640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 0x5573e5d74880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.42:49308/0 (socket says 172.21.15.42:49308) 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa8013d0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:37002/0 (socket says 172.21.15.42:37002) 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa800bcf640 1 -- 172.21.15.42:0/1290029342 learned_addr learned my addr 172.21.15.42:0/1290029342 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa7f27fc640 1 -- 172.21.15.42:0/1985732599 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa7f40f0c40 con 0x7fa7fc105560 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.883+0000 7fa801bd1640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a32c0 0x7fa7e80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa8013d0640 1 -- 172.21.15.42:0/1290029342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 msgr2=0x5573e5d74880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa8013d0640 1 --2- 172.21.15.42:0/1290029342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 0x5573e5d74880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa8013d0640 1 -- 172.21.15.42:0/1290029342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 msgr2=0x5573e5d81a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa8013d0640 1 --2- 172.21.15.42:0/1290029342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d81a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa8013d0640 1 -- 172.21.15.42:0/1290029342 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573e5c66440 con 0x5573e5d74dc0 2024-09-19T09:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa800bcf640 1 --2- 172.21.15.42:0/1290029342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d81a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa8013d0640 1 --2- 172.21.15.42:0/1290029342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7f140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80099a0 tx=0x7fa7f8009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ec8ed79779a9552 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa801bd1640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a32c0 0x7fa7e80a5780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009430 tx=0x7fa7f4033040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa7e77fe640 1 -- 172.21.15.42:0/1290029342 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8017070 con 0x5573e5d74dc0 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa7e77fe640 1 -- 172.21.15.42:0/1290029342 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7f8013470 con 0x5573e5d74dc0 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.884+0000 7fa7e77fe640 1 -- 172.21.15.42:0/1290029342 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8012630 con 0x5573e5d74dc0 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.885+0000 7fa805a0d740 1 -- 172.21.15.42:0/1290029342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 msgr2=0x5573e5d7f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.885+0000 7fa805a0d740 1 --2- 172.21.15.42:0/1290029342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7f140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80099a0 tx=0x7fa7f8009e60 comp rx=0 tx=0).stop 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.885+0000 7fa805a0d740 1 -- 172.21.15.42:0/1290029342 shutdown_connections 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.885+0000 7fa805a0d740 1 --2- 172.21.15.42:0/1290029342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d81a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.885+0000 7fa805a0d740 1 --2- 172.21.15.42:0/1290029342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7f140 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.885+0000 7fa805a0d740 1 --2- 172.21.15.42:0/1290029342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 0x5573e5d74880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.885+0000 7fa805a0d740 1 -- 172.21.15.42:0/1290029342 >> 172.21.15.42:0/1290029342 conn(0x5573e5d70a30 msgr2=0x5573e5d70e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.885+0000 7fa805a0d740 1 -- 172.21.15.42:0/1290029342 shutdown_connections 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.885+0000 7fa805a0d740 1 -- 172.21.15.42:0/1290029342 wait complete. 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa805a0d740 1 -- start start 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa805a0d740 1 Processor -- start 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 0x5573e5d7ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d7c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa805a0d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5573e5d82250 con 0x5573e5d7f680 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa805a0d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5573e5c95050 con 0x5573e5d744a0 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa805a0d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5573e5d823d0 con 0x5573e5d74dc0 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa805a0d740 10 client.0 _ll_register_callbacks cb 0x5573e5cd5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa800bcf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d7c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa800bcf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d7c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41382/0 (socket says 172.21.15.42:41382) 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.886+0000 7fa800bcf640 1 -- 172.21.15.42:0/1560082197 learned_addr learned my addr 172.21.15.42:0/1560082197 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa8013d0640 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa800bcf640 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 0x5573e5d7ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa8013d0640 1 -- 172.21.15.42:0/1560082197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 msgr2=0x5573e5d7ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa8013d0640 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 0x5573e5d7ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa8013d0640 1 -- 172.21.15.42:0/1560082197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 msgr2=0x5573e5d7c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa8013d0640 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d7c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa8013d0640 1 -- 172.21.15.42:0/1560082197 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573e5a4b3c0 con 0x5573e5d74dc0 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa800bcf640 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d7c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa8013d0640 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7c140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8004810 tx=0x7fa7f8006e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd2295d35ed4951 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa7e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/1560082197 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8017050 con 0x5573e5d74dc0 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/1560082197 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa7f801c450 con 0x5573e5d74dc0 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.887+0000 7fa805a0d740 1 -- 172.21.15.42:0/1560082197 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7f8013470 con 0x5573e5d74dc0 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/1560082197 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa7f801c650 con 0x5573e5d74dc0 2024-09-19T09:42:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa805a0d740 10 client.26119 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa805a0d740 1 -- 172.21.15.42:0/1560082197 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5573e5d8db40 con 0x5573e5d74dc0 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/1560082197 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7f8013470 con 0x5573e5d74dc0 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/1560082197 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fa7f8031820 con 0x5573e5d74dc0 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa805a0d740 10 client.26119 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa805a0d740 10 client.26119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa805a0d740 20 client.26119 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa805a0d740 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5573e5d8ef50 0x5573e5d91340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa805a0d740 4 client.26119 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa805a0d740 1 -- 172.21.15.42:0/1560082197 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573e5ce7850 con 0x5573e5d8ef50 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.888+0000 7fa800bcf640 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5573e5d8ef50 0x5573e5d91340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.889+0000 7fa7e4ff9640 10 client.26119 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.889+0000 7fa800bcf640 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5573e5d8ef50 0x5573e5d91340 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf4da2ba86b98c7a server_cookie=9a2efb7f1c495b0e in_seq=0 out_seq=0 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.889+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/1560082197 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573e5ce7850 con 0x5573e5d8ef50 2024-09-19T09:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.889+0000 7fa7e4ff9640 10 client.26119 handle_command_reply: tid=0 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.889+0000 7fa805a0d740 1 client.26119 shutdown 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 1 -- 172.21.15.42:0/1560082197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 msgr2=0x5573e5d7c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7c140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8004810 tx=0x7fa7f8006e40 comp rx=0 tx=0).stop 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 1 -- 172.21.15.42:0/1560082197 shutdown_connections 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5573e5d8ef50 0x5573e5d91340 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d7c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d7c140 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa7e4ff9640 0 client.26119 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 1 --2- 172.21.15.42:0/1560082197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d744a0 0x5573e5d7ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 1 -- 172.21.15.42:0/1560082197 >> 172.21.15.42:0/1560082197 conn(0x5573e5d70a30 msgr2=0x5573e5d76710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 1 -- 172.21.15.42:0/1560082197 shutdown_connections 2024-09-19T09:42:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 1 -- 172.21.15.42:0/1560082197 wait complete. 2024-09-19T09:42:55.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.890+0000 7fa805a0d740 20 client.26119 trim_cache size 0 max 16384 2024-09-19T09:42:55.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.927+0000 7fa805a0d740 1 Processor -- start 2024-09-19T09:42:55.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.927+0000 7fa805a0d740 1 -- start start 2024-09-19T09:42:55.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d744a0 0x5573e5d8b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d96a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d7f680 0x5573e5d96f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa805a0d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1af740 con 0x5573e5d744a0 2024-09-19T09:42:55.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa805a0d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1b1520 con 0x5573e5d7f680 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa805a0d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1afed0 con 0x5573e5d74dc0 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa800bcf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d744a0 0x5573e5d8b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa800bcf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d744a0 0x5573e5d8b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41388/0 (socket says 172.21.15.42:41388) 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa800bcf640 1 -- 172.21.15.42:0/3920624489 learned_addr learned my addr 172.21.15.42:0/3920624489 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa8013d0640 1 --2- 172.21.15.42:0/3920624489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d96a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa800bcf640 1 --2- 172.21.15.42:0/3920624489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d7f680 0x5573e5d96f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa800bcf640 1 -- 172.21.15.42:0/3920624489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 msgr2=0x5573e5d96a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa800bcf640 1 --2- 172.21.15.42:0/3920624489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d96a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa800bcf640 1 -- 172.21.15.42:0/3920624489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d7f680 msgr2=0x5573e5d96f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa800bcf640 1 --2- 172.21.15.42:0/3920624489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d7f680 0x5573e5d96f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa800bcf640 1 -- 172.21.15.42:0/3920624489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573e5d70860 con 0x5573e5d744a0 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.928+0000 7fa800bcf640 1 --2- 172.21.15.42:0/3920624489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d744a0 0x5573e5d8b510 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x5573e5d91970 tx=0x7fa7ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9b0569969854e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.929+0000 7fa7e6ffd640 1 -- 172.21.15.42:0/3920624489 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec005020 con 0x5573e5d744a0 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.929+0000 7fa7e6ffd640 1 -- 172.21.15.42:0/3920624489 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ec0047a0 con 0x5573e5d744a0 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.929+0000 7fa7e6ffd640 1 -- 172.21.15.42:0/3920624489 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec003830 con 0x5573e5d744a0 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.929+0000 7fa805a0d740 1 -- 172.21.15.42:0/3920624489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d744a0 msgr2=0x5573e5d8b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.929+0000 7fa805a0d740 1 --2- 172.21.15.42:0/3920624489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d744a0 0x5573e5d8b510 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x5573e5d91970 tx=0x7fa7ec004730 comp rx=0 tx=0).stop 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.929+0000 7fa805a0d740 1 -- 172.21.15.42:0/3920624489 shutdown_connections 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.929+0000 7fa805a0d740 1 --2- 172.21.15.42:0/3920624489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d7f680 0x5573e5d96f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.930+0000 7fa805a0d740 1 --2- 172.21.15.42:0/3920624489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d74dc0 0x5573e5d96a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.930+0000 7fa805a0d740 1 --2- 172.21.15.42:0/3920624489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d744a0 0x5573e5d8b510 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.930+0000 7fa805a0d740 1 -- 172.21.15.42:0/3920624489 >> 172.21.15.42:0/3920624489 conn(0x5573e5d70a30 msgr2=0x5573e5d7b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.930+0000 7fa805a0d740 1 -- 172.21.15.42:0/3920624489 shutdown_connections 2024-09-19T09:42:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.930+0000 7fa805a0d740 1 -- 172.21.15.42:0/3920624489 wait complete. 2024-09-19T09:42:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.930+0000 7fa805a0d740 1 -- start start 2024-09-19T09:42:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.930+0000 7fa805a0d740 1 Processor -- start 2024-09-19T09:42:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d744a0 0x5573e5d87fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d74dc0 0x5573e5d83320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa805a0d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d83ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa805a0d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1b0dc0 con 0x5573e5d7f680 2024-09-19T09:42:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa805a0d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1b0660 con 0x5573e5d74dc0 2024-09-19T09:42:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa805a0d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1ad720 con 0x5573e5d744a0 2024-09-19T09:42:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa800bcf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d744a0 0x5573e5d87fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa800bcf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d744a0 0x5573e5d87fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:37020/0 (socket says 172.21.15.42:37020) 2024-09-19T09:42:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa800bcf640 1 -- 172.21.15.42:0/441644995 learned_addr learned my addr 172.21.15.42:0/441644995 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa805a0d740 10 client.0 _ll_register_callbacks cb 0x7fa7ec00dab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa800bcf640 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d83ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa8013d0640 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d74dc0 0x5573e5d83320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa800bcf640 1 -- 172.21.15.42:0/441644995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d744a0 msgr2=0x5573e5d87fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa800bcf640 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d744a0 0x5573e5d87fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa800bcf640 1 -- 172.21.15.42:0/441644995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d74dc0 msgr2=0x5573e5d83320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa800bcf640 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d74dc0 0x5573e5d83320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa800bcf640 1 -- 172.21.15.42:0/441644995 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573e5df89d0 con 0x5573e5d7f680 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.931+0000 7fa8013d0640 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d74dc0 0x5573e5d83320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.932+0000 7fa800bcf640 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d83ab0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec005ee0 tx=0x7fa7ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b2c63fb9238680 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.932+0000 7fa7e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.932+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/441644995 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec004dd0 con 0x5573e5d7f680 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.932+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/441644995 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa7ec005000 con 0x5573e5d7f680 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.932+0000 7fa805a0d740 1 -- 172.21.15.42:0/441644995 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7ec0047a0 con 0x5573e5d7f680 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.932+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/441644995 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa7ec042050 con 0x5573e5d7f680 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.932+0000 7fa805a0d740 10 client.16809 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.932+0000 7fa805a0d740 1 -- 172.21.15.42:0/441644995 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5573e5df9ba0 con 0x5573e5d7f680 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.932+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/441644995 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ec0047a0 con 0x5573e5d7f680 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.933+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/441644995 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fa7ec03a020 con 0x5573e5d7f680 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.933+0000 7fa805a0d740 10 client.16809 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.933+0000 7fa805a0d740 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.933+0000 7fa805a0d740 20 client.16809 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.933+0000 7fa805a0d740 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5573e5dfa230 0x5573e5dfc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.933+0000 7fa805a0d740 4 client.16809 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.933+0000 7fa805a0d740 1 -- 172.21.15.42:0/441644995 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5573e5ce1d60 con 0x5573e5dfa230 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.933+0000 7fa8013d0640 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5573e5dfa230 0x5573e5dfc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.933+0000 7fa7e4ff9640 10 client.16809 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.933+0000 7fa8013d0640 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5573e5dfa230 0x5573e5dfc650 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d521a5c9d39a606 server_cookie=61f4b20b07d8c4e7 in_seq=0 out_seq=0 2024-09-19T09:42:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa7e4ff9640 1 -- 172.21.15.42:0/441644995 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5573e5ce1d60 con 0x5573e5dfa230 2024-09-19T09:42:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa7e4ff9640 10 client.16809 handle_command_reply: tid=0 2024-09-19T09:42:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 client.16809 shutdown 2024-09-19T09:42:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 -- 172.21.15.42:0/441644995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 msgr2=0x5573e5d83ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d83ab0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec005ee0 tx=0x7fa7ec000bc0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 -- 172.21.15.42:0/441644995 shutdown_connections 2024-09-19T09:42:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5573e5dfa230 0x5573e5dfc650 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5573e5d7f680 0x5573e5d83ab0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573e5d74dc0 0x5573e5d83320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa7e4ff9640 0 client.16809 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 --2- 172.21.15.42:0/441644995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5573e5d744a0 0x5573e5d87fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 -- 172.21.15.42:0/441644995 >> 172.21.15.42:0/441644995 conn(0x5573e5d70a30 msgr2=0x5573e5d7d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:55.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 -- 172.21.15.42:0/441644995 shutdown_connections 2024-09-19T09:42:55.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 1 -- 172.21.15.42:0/441644995 wait complete. 2024-09-19T09:42:55.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.934+0000 7fa805a0d740 20 client.16809 trim_cache size 0 max 16384 2024-09-19T09:42:55.951 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:42:55.951 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:42:55.951 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-19T09:42:55.951 INFO:teuthology.orchestra.run.smithi042.stdout: "32baa15d-afad-4f0c-a809-36fb0ab67080": { 2024-09-19T09:42:55.952 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-19T09:42:55.952 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "32baa15d-afad-4f0c-a809-36fb0ab67080", 2024-09-19T09:42:55.952 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-09-19T09:42:55.952 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:55.952 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:42:55.952 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:42:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 -- 172.21.15.42:0/1985732599 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a32c0 msgr2=0x7fa7e80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a32c0 0x7fa7e80a5780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009430 tx=0x7fa7f4033040 comp rx=0 tx=0).stop 2024-09-19T09:42:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 -- 172.21.15.42:0/1985732599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc105560 msgr2=0x7fa7fc10f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc105560 0x7fa7fc10f280 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4031a60 tx=0x7fa7f4031a90 comp rx=0 tx=0).stop 2024-09-19T09:42:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 -- 172.21.15.42:0/1985732599 shutdown_connections 2024-09-19T09:42:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa7e80a32c0 0x7fa7e80a5780 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7fc105560 0x7fa7fc10f280 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc100de0 0x7fa7fc10ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 --2- 172.21.15.42:0/1985732599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7fc100430 0x7fa7fc10e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 -- 172.21.15.42:0/1985732599 >> 172.21.15.42:0/1985732599 conn(0x7fa7fc077230 msgr2=0x7fa7fc103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 -- 172.21.15.42:0/1985732599 shutdown_connections 2024-09-19T09:42:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:55.935+0000 7fa803634640 1 -- 172.21.15.42:0/1985732599 wait complete. 2024-09-19T09:42:56.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:56 smithi042 ceph-mon[31223]: pgmap v445: 97 pgs: 97 active+clean; 148 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 792 KiB/s wr, 163 op/s 2024-09-19T09:42:56.693 INFO:tasks.cephfs.filesystem:scrub status for tag:32baa15d-afad-4f0c-a809-36fb0ab67080 - {'path': '/', 'tag': '32baa15d-afad-4f0c-a809-36fb0ab67080', 'options': 'recursive,force'} 2024-09-19T09:42:56.790 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:56.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:56 smithi171 ceph-mon[35803]: pgmap v445: 97 pgs: 97 active+clean; 148 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 792 KiB/s wr, 163 op/s 2024-09-19T09:42:56.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:56 smithi136 ceph-mon[34840]: pgmap v445: 97 pgs: 97 active+clean; 148 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 792 KiB/s wr, 163 op/s 2024-09-19T09:42:57.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.270+0000 7f0194910640 1 -- 172.21.15.42:0/1827970561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0190102de0 msgr2=0x7f01901031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:57.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.270+0000 7f0194910640 1 --2- 172.21.15.42:0/1827970561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0190102de0 0x7f01901031c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0180009900 tx=0x7f018002a480 comp rx=0 tx=0).stop 2024-09-19T09:42:57.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.270+0000 7f0194910640 1 -- 172.21.15.42:0/1827970561 shutdown_connections 2024-09-19T09:42:57.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.270+0000 7f0194910640 1 --2- 172.21.15.42:0/1827970561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f019010c180 0x7f019010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.270+0000 7f0194910640 1 --2- 172.21.15.42:0/1827970561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0190103700 0x7f019010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.270+0000 7f0194910640 1 --2- 172.21.15.42:0/1827970561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0190102de0 0x7f01901031c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.270+0000 7f0194910640 1 -- 172.21.15.42:0/1827970561 >> 172.21.15.42:0/1827970561 conn(0x7f01900fc7a0 msgr2=0x7f01900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:57.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.270+0000 7f0194910640 1 -- 172.21.15.42:0/1827970561 shutdown_connections 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.270+0000 7f0194910640 1 -- 172.21.15.42:0/1827970561 wait complete. 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f0194910640 1 Processor -- start 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f0194910640 1 -- start start 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f0194910640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0190102de0 0x7f0190100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f0194910640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0190103700 0x7f0190100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f0194910640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f019010c180 0x7f01901014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f0194910640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0190112030 con 0x7f0190102de0 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f0194910640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0190111eb0 con 0x7f0190103700 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f0194910640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f01901121b0 con 0x7f019010c180 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f018e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0190102de0 0x7f0190100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f018e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0190102de0 0x7f0190100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41424/0 (socket says 172.21.15.42:41424) 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f018e59c640 1 -- 172.21.15.42:0/898084942 learned_addr learned my addr 172.21.15.42:0/898084942 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:57.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.271+0000 7f018dd9b640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0190103700 0x7f0190100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f018ed9d640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f019010c180 0x7f01901014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f018e59c640 1 -- 172.21.15.42:0/898084942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f019010c180 msgr2=0x7f01901014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f018e59c640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f019010c180 0x7f01901014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f018e59c640 1 -- 172.21.15.42:0/898084942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0190103700 msgr2=0x7f0190100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f018e59c640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0190103700 0x7f0190100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f018e59c640 1 -- 172.21.15.42:0/898084942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01901a6a90 con 0x7f0190102de0 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f018e59c640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0190102de0 0x7f0190100a40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0180005ab0 tx=0x7f01800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f017f7fe640 1 -- 172.21.15.42:0/898084942 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018003f030 con 0x7f0190102de0 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f017f7fe640 1 -- 172.21.15.42:0/898084942 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0180003ce0 con 0x7f0190102de0 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f0194910640 1 -- 172.21.15.42:0/898084942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01901a6d20 con 0x7f0190102de0 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f017f7fe640 1 -- 172.21.15.42:0/898084942 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180035070 con 0x7f0190102de0 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.272+0000 7f0194910640 1 -- 172.21.15.42:0/898084942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01901a71b0 con 0x7f0190102de0 2024-09-19T09:42:57.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.274+0000 7f017f7fe640 1 -- 172.21.15.42:0/898084942 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f0180042030 con 0x7f0190102de0 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f0196ce9740 1 Processor -- start 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f0196ce9740 1 -- start start 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x55976777dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55976777e320 0x5597677886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559767788be0 0x55976778afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f0196ce9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5597676e2200 con 0x55976777da00 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f0196ce9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559767688dc0 con 0x55976777e320 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f0196ce9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5597676de1c0 con 0x559767788be0 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f017f7fe640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01780a3240 0x7f01780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f018ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x55976777dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f018ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x55976777dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41434/0 (socket says 172.21.15.42:41434) 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f018ed9d640 1 -- 172.21.15.42:0/3411848285 learned_addr learned my addr 172.21.15.42:0/3411848285 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:57.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f018ed9d640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01780a3240 0x7f01780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f017f7fe640 1 -- 172.21.15.42:0/898084942 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f01800f02f0 con 0x7f0190102de0 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f018e59c640 1 --2- 172.21.15.42:0/3411848285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55976777e320 0x5597677886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.275+0000 7f018dd9b640 1 --2- 172.21.15.42:0/3411848285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559767788be0 0x55976778afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.276+0000 7f018ed9d640 1 -- 172.21.15.42:0/3411848285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559767788be0 msgr2=0x55976778afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.276+0000 7f018ed9d640 1 --2- 172.21.15.42:0/3411848285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559767788be0 0x55976778afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.276+0000 7f018ed9d640 1 -- 172.21.15.42:0/3411848285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55976777e320 msgr2=0x5597677886a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.276+0000 7f018ed9d640 1 --2- 172.21.15.42:0/3411848285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55976777e320 0x5597677886a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.276+0000 7f018ed9d640 1 -- 172.21.15.42:0/3411848285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559767453620 con 0x55976777da00 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.276+0000 7f018ed9d640 1 --2- 172.21.15.42:0/3411848285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x55976777dde0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f018800aa20 tx=0x7f018800aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5823300b7c7d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.276+0000 7f017cff9640 1 -- 172.21.15.42:0/3411848285 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0188013040 con 0x55976777da00 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.276+0000 7f017cff9640 1 -- 172.21.15.42:0/3411848285 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01880183f0 con 0x55976777da00 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.276+0000 7f017cff9640 1 -- 172.21.15.42:0/3411848285 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018801f600 con 0x55976777da00 2024-09-19T09:42:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 -- 172.21.15.42:0/3411848285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 msgr2=0x55976777dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f018ed9d640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01780a3240 0x7f01780a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f018801e000 tx=0x7f018801b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3411848285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x55976777dde0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f018800aa20 tx=0x7f018800aee0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 -- 172.21.15.42:0/3411848285 shutdown_connections 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3411848285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559767788be0 0x55976778afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3411848285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55976777e320 0x5597677886a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3411848285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x55976777dde0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 -- 172.21.15.42:0/3411848285 >> 172.21.15.42:0/3411848285 conn(0x559767779f90 msgr2=0x55976777a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 -- 172.21.15.42:0/3411848285 shutdown_connections 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 -- 172.21.15.42:0/3411848285 wait complete. 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 -- start start 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.277+0000 7f0196ce9740 1 Processor -- start 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x559767788480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x559767785730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767788be0 0x559767785c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0196ce9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55976778b7b0 con 0x55976777da00 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0196ce9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55976767cc50 con 0x559767788be0 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0196ce9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55976778b930 con 0x55976777e320 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0196ce9740 10 client.0 _ll_register_callbacks cb 0x55976768eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x559767788480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x559767788480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41440/0 (socket says 172.21.15.42:41440) 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018e59c640 1 -- 172.21.15.42:0/3587576913 learned_addr learned my addr 172.21.15.42:0/3587576913 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018dd9b640 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x559767785730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018ed9d640 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767788be0 0x559767785c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018e59c640 1 -- 172.21.15.42:0/3587576913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 msgr2=0x559767785730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018e59c640 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x559767785730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018e59c640 1 -- 172.21.15.42:0/3587576913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767788be0 msgr2=0x559767785c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:57.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018e59c640 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767788be0 0x559767785c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018e59c640 1 -- 172.21.15.42:0/3587576913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559767786470 con 0x55976777da00 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018dd9b640 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x559767785730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f018e59c640 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x559767788480 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f01800ede20 tx=0x7f01800bc430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b0b668c66fe316 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0175ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0175ffb640 1 -- 172.21.15.42:0/3587576913 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180049040 con 0x55976777da00 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0175ffb640 1 -- 172.21.15.42:0/3587576913 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f018003bd70 con 0x55976777da00 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.278+0000 7f0196ce9740 1 -- 172.21.15.42:0/3587576913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01880183f0 con 0x55976777da00 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0175ffb640 1 -- 172.21.15.42:0/3587576913 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f01800a70c0 con 0x55976777da00 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0196ce9740 10 client.16821 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0196ce9740 1 -- 172.21.15.42:0/3587576913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5597677972a0 con 0x55976777da00 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0175ffb640 1 -- 172.21.15.42:0/3587576913 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01880183f0 con 0x55976777da00 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0175ffb640 1 -- 172.21.15.42:0/3587576913 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f01800b8f60 con 0x55976777da00 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0196ce9740 10 client.16821 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0196ce9740 10 client.16821 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:42:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0196ce9740 20 client.16821 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559767798700 0x55976779ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0196ce9740 4 client.16821 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f0196ce9740 1 -- 172.21.15.42:0/3587576913 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597676ef770 con 0x559767798700 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.279+0000 7f018dd9b640 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559767798700 0x55976779ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.280+0000 7f018dd9b640 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559767798700 0x55976779ab60 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fcacafcf67f8cfd server_cookie=91b695150d133814 in_seq=0 out_seq=0 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.280+0000 7f0175ffb640 10 client.16821 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.280+0000 7f0175ffb640 1 -- 172.21.15.42:0/3587576913 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597676ef770 con 0x559767798700 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.280+0000 7f0175ffb640 10 client.16821 handle_command_reply: tid=0 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 client.16821 shutdown 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 -- 172.21.15.42:0/3587576913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 msgr2=0x559767788480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x559767788480 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f01800ede20 tx=0x7f01800bc430 comp rx=0 tx=0).stop 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 -- 172.21.15.42:0/3587576913 shutdown_connections 2024-09-19T09:42:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559767798700 0x55976779ab60 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767788be0 0x559767785c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0175ffb640 0 client.16821 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x559767785730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3587576913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x559767788480 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 -- 172.21.15.42:0/3587576913 >> 172.21.15.42:0/3587576913 conn(0x559767779f90 msgr2=0x5597677791d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 -- 172.21.15.42:0/3587576913 shutdown_connections 2024-09-19T09:42:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 1 -- 172.21.15.42:0/3587576913 wait complete. 2024-09-19T09:42:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.281+0000 7f0196ce9740 20 client.16821 trim_cache size 0 max 16384 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f0196ce9740 1 Processor -- start 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f0196ce9740 1 -- start start 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767779f90 0x559767794a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x5597677a0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x5597677a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f0196ce9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f01901af8d0 con 0x55976777da00 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f0196ce9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f01901b16b0 con 0x559767779f90 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f0196ce9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f01901b0060 con 0x55976777e320 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x5597677a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018dd9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x5597677a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41454/0 (socket says 172.21.15.42:41454) 2024-09-19T09:42:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018dd9b640 1 -- 172.21.15.42:0/458095855 learned_addr learned my addr 172.21.15.42:0/458095855 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018e59c640 1 --2- 172.21.15.42:0/458095855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767779f90 0x559767794a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018ed9d640 1 --2- 172.21.15.42:0/458095855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x5597677a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018dd9b640 1 -- 172.21.15.42:0/458095855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 msgr2=0x5597677a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018dd9b640 1 --2- 172.21.15.42:0/458095855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x5597677a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018dd9b640 1 -- 172.21.15.42:0/458095855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767779f90 msgr2=0x559767794a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018dd9b640 1 --2- 172.21.15.42:0/458095855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767779f90 0x559767794a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018dd9b640 1 -- 172.21.15.42:0/458095855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559767779dc0 con 0x55976777da00 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018e59c640 1 --2- 172.21.15.42:0/458095855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767779f90 0x559767794a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.298+0000 7f018dd9b640 1 --2- 172.21.15.42:0/458095855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x5597677a0430 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0184006e10 tx=0x7f0184008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823f3ad80165db95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0177fff640 1 -- 172.21.15.42:0/458095855 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018400bca0 con 0x55976777da00 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0177fff640 1 -- 172.21.15.42:0/458095855 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f018400be40 con 0x55976777da00 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0177fff640 1 -- 172.21.15.42:0/458095855 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018401c4b0 con 0x55976777da00 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0196ce9740 1 -- 172.21.15.42:0/458095855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 msgr2=0x5597677a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0196ce9740 1 --2- 172.21.15.42:0/458095855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x5597677a0430 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0184006e10 tx=0x7f0184008040 comp rx=0 tx=0).stop 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0196ce9740 1 -- 172.21.15.42:0/458095855 shutdown_connections 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0196ce9740 1 --2- 172.21.15.42:0/458095855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x5597677a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0196ce9740 1 --2- 172.21.15.42:0/458095855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55976777da00 0x5597677a0430 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0196ce9740 1 --2- 172.21.15.42:0/458095855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559767779f90 0x559767794a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0196ce9740 1 -- 172.21.15.42:0/458095855 >> 172.21.15.42:0/458095855 conn(0x559767775520 msgr2=0x559767780db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0196ce9740 1 -- 172.21.15.42:0/458095855 shutdown_connections 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.299+0000 7f0196ce9740 1 -- 172.21.15.42:0/458095855 wait complete. 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f0196ce9740 1 -- start start 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f0196ce9740 1 Processor -- start 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559767779f90 0x55976778d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55976777da00 0x55976778d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f0196ce9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x559767802400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f0196ce9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f01901b0f50 con 0x559767779f90 2024-09-19T09:42:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f0196ce9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f01901b07f0 con 0x55976777da00 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f0196ce9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f01901ad8b0 con 0x55976777e320 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f0196ce9740 10 client.0 _ll_register_callbacks cb 0x7f01800b8b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f018e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559767779f90 0x55976778d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f018e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559767779f90 0x55976778d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41460/0 (socket says 172.21.15.42:41460) 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f018e59c640 1 -- 172.21.15.42:0/3606858404 learned_addr learned my addr 172.21.15.42:0/3606858404 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f018ed9d640 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x559767802400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f018dd9b640 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55976777da00 0x55976778d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f018e59c640 1 -- 172.21.15.42:0/3606858404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 msgr2=0x559767802400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f018e59c640 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x559767802400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.300+0000 7f018e59c640 1 -- 172.21.15.42:0/3606858404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55976777da00 msgr2=0x55976778d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f018e59c640 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55976777da00 0x55976778d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f018e59c640 1 -- 172.21.15.42:0/3606858404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597678029f0 con 0x559767779f90 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f018e59c640 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559767779f90 0x55976778d0b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0180003fd0 tx=0x7f01800bae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3666c3745392d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0175ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0175ffb640 1 -- 172.21.15.42:0/3606858404 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180086060 con 0x559767779f90 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0175ffb640 1 -- 172.21.15.42:0/3606858404 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f01800c50d0 con 0x559767779f90 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0196ce9740 1 -- 172.21.15.42:0/3606858404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597676e9c80 con 0x559767779f90 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0175ffb640 1 -- 172.21.15.42:0/3606858404 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0180049070 con 0x559767779f90 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0196ce9740 10 client.16827 fetch_fsmap learned FSMap version 38 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0196ce9740 1 -- 172.21.15.42:0/3606858404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559767803cf0 con 0x559767779f90 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0175ffb640 1 -- 172.21.15.42:0/3606858404 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5597676e9c80 con 0x559767779f90 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0175ffb640 1 -- 172.21.15.42:0/3606858404 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f01800bbd40 con 0x559767779f90 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0196ce9740 10 client.16827 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.301+0000 7f0196ce9740 10 client.16827 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.302+0000 7f0196ce9740 20 client.16827 populate_metadata read hostname 'smithi042' 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.302+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559767788be0 0x559767806300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.302+0000 7f0196ce9740 4 client.16827 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.302+0000 7f0196ce9740 1 -- 172.21.15.42:0/3606858404 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5597676661e0 con 0x559767788be0 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.302+0000 7f018dd9b640 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559767788be0 0x559767806300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.302+0000 7f018dd9b640 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559767788be0 0x559767806300 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8773075b043e30d server_cookie=228e5f6457f865a6 in_seq=0 out_seq=0 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.302+0000 7f0175ffb640 10 client.16827 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0175ffb640 1 -- 172.21.15.42:0/3606858404 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5597676661e0 con 0x559767788be0 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0175ffb640 10 client.16827 handle_command_reply: tid=0 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 client.16827 shutdown 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 -- 172.21.15.42:0/3606858404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559767779f90 msgr2=0x55976778d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559767779f90 0x55976778d0b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0180003fd0 tx=0x7f01800bae00 comp rx=0 tx=0).stop 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 -- 172.21.15.42:0/3606858404 shutdown_connections 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x559767788be0 0x559767806300 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55976777e320 0x559767802400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55976777da00 0x55976778d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0175ffb640 0 client.16827 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:42:57.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 --2- 172.21.15.42:0/3606858404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559767779f90 0x55976778d0b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 -- 172.21.15.42:0/3606858404 >> 172.21.15.42:0/3606858404 conn(0x559767775520 msgr2=0x559767780db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:57.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 -- 172.21.15.42:0/3606858404 shutdown_connections 2024-09-19T09:42:57.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 1 -- 172.21.15.42:0/3606858404 wait complete. 2024-09-19T09:42:57.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0196ce9740 20 client.16827 trim_cache size 0 max 16384 2024-09-19T09:42:57.314 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:42:57.314 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 38, 2024-09-19T09:42:57.314 INFO:teuthology.orchestra.run.smithi042.stdout: "leader": 24506, 2024-09-19T09:42:57.314 INFO:teuthology.orchestra.run.smithi042.stdout: "set_version": 16, 2024-09-19T09:42:57.314 INFO:teuthology.orchestra.run.smithi042.stdout: "sets": {} 2024-09-19T09:42:57.315 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:42:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0194910640 1 -- 172.21.15.42:0/898084942 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01780a3240 msgr2=0x7f01780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0194910640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01780a3240 0x7f01780a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f018801e000 tx=0x7f018801b000 comp rx=0 tx=0).stop 2024-09-19T09:42:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0194910640 1 -- 172.21.15.42:0/898084942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0190102de0 msgr2=0x7f0190100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.303+0000 7f0194910640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0190102de0 0x7f0190100a40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0180005ab0 tx=0x7f01800042f0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.304+0000 7f0194910640 1 -- 172.21.15.42:0/898084942 shutdown_connections 2024-09-19T09:42:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.304+0000 7f0194910640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f01780a3240 0x7f01780a5700 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.304+0000 7f0194910640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f019010c180 0x7f01901014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.304+0000 7f0194910640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0190103700 0x7f0190100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.304+0000 7f0194910640 1 --2- 172.21.15.42:0/898084942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0190102de0 0x7f0190100a40 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.304+0000 7f0194910640 1 -- 172.21.15.42:0/898084942 >> 172.21.15.42:0/898084942 conn(0x7f01900fc7a0 msgr2=0x7f01900fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.304+0000 7f0194910640 1 -- 172.21.15.42:0/898084942 shutdown_connections 2024-09-19T09:42:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:42:57.304+0000 7f0194910640 1 -- 172.21.15.42:0/898084942 wait complete. 2024-09-19T09:42:57.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:57 smithi171 ceph-mon[35803]: scrub summary: idle 2024-09-19T09:42:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:57 smithi136 ceph-mon[34840]: scrub summary: idle 2024-09-19T09:42:57.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:57 smithi042 ceph-mon[31223]: scrub summary: idle 2024-09-19T09:42:57.988 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T09:42:57.989 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T09:42:57.999 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi042.front.sepia.ceph.com 2024-09-19T09:42:58.008 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T09:42:58.017 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T09:42:58.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:42:58 smithi136 ceph-mon[34840]: pgmap v446: 97 pgs: 97 active+clean; 143 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 800 KiB/s wr, 220 op/s 2024-09-19T09:42:58.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:42:58 smithi171 ceph-mon[35803]: pgmap v446: 97 pgs: 97 active+clean; 143 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 800 KiB/s wr, 220 op/s 2024-09-19T09:42:58.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:42:58 smithi042 ceph-mon[31223]: pgmap v446: 97 pgs: 97 active+clean; 143 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 800 KiB/s wr, 220 op/s 2024-09-19T09:43:00.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:00 smithi171 ceph-mon[35803]: pgmap v447: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 751 KiB/s wr, 226 op/s 2024-09-19T09:43:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:00 smithi136 ceph-mon[34840]: pgmap v447: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 751 KiB/s wr, 226 op/s 2024-09-19T09:43:00.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:00 smithi042 ceph-mon[31223]: pgmap v447: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 751 KiB/s wr, 226 op/s 2024-09-19T09:43:02.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:02 smithi171 ceph-mon[35803]: pgmap v448: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 674 KiB/s wr, 209 op/s 2024-09-19T09:43:02.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:02 smithi136 ceph-mon[34840]: pgmap v448: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 674 KiB/s wr, 209 op/s 2024-09-19T09:43:02.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:02 smithi042 ceph-mon[31223]: pgmap v448: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 674 KiB/s wr, 209 op/s 2024-09-19T09:43:04.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:04 smithi171 ceph-mon[35803]: pgmap v449: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 669 KiB/s wr, 168 op/s 2024-09-19T09:43:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:04 smithi136 ceph-mon[34840]: pgmap v449: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 669 KiB/s wr, 168 op/s 2024-09-19T09:43:04.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:04 smithi042 ceph-mon[31223]: pgmap v449: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 669 KiB/s wr, 168 op/s 2024-09-19T09:43:06.757 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:06 smithi042 ceph-mon[31223]: pgmap v450: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 509 KiB/s wr, 135 op/s 2024-09-19T09:43:06.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:06 smithi171 ceph-mon[35803]: pgmap v450: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 509 KiB/s wr, 135 op/s 2024-09-19T09:43:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:06 smithi136 ceph-mon[34840]: pgmap v450: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 509 KiB/s wr, 135 op/s 2024-09-19T09:43:08.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:08 smithi171 ceph-mon[35803]: pgmap v451: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 76 op/s 2024-09-19T09:43:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:08 smithi136 ceph-mon[34840]: pgmap v451: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 76 op/s 2024-09-19T09:43:08.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:08 smithi042 ceph-mon[31223]: pgmap v451: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 76 op/s 2024-09-19T09:43:10.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:10 smithi171 ceph-mon[35803]: pgmap v452: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-19T09:43:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:10 smithi136 ceph-mon[34840]: pgmap v452: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-19T09:43:10.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:10 smithi042 ceph-mon[31223]: pgmap v452: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-19T09:43:12.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:12 smithi171 ceph-mon[35803]: pgmap v453: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:43:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:12 smithi136 ceph-mon[34840]: pgmap v453: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:43:12.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:12 smithi042 ceph-mon[31223]: pgmap v453: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:43:14.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:14 smithi171 ceph-mon[35803]: pgmap v454: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-19T09:43:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:14 smithi136 ceph-mon[34840]: pgmap v454: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-19T09:43:14.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:14 smithi042 ceph-mon[31223]: pgmap v454: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-19T09:43:16.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:16 smithi171 ceph-mon[35803]: pgmap v455: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:43:16.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:16 smithi136 ceph-mon[34840]: pgmap v455: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:43:16.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:16 smithi042 ceph-mon[31223]: pgmap v455: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:43:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:18 smithi171 ceph-mon[35803]: pgmap v456: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:18 smithi136 ceph-mon[34840]: pgmap v456: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:18.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:18 smithi042 ceph-mon[31223]: pgmap v456: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:20.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:20 smithi171 ceph-mon[35803]: pgmap v457: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:43:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:20 smithi136 ceph-mon[34840]: pgmap v457: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:43:20.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:20 smithi042 ceph-mon[31223]: pgmap v457: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:43:21.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:21 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:21 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:21.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:21 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:22 smithi171 ceph-mon[35803]: pgmap v458: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:22 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:22 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:22.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:22 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:43:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:22 smithi136 ceph-mon[34840]: pgmap v458: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:22 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:22 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:22.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:22 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:43:22.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:22 smithi042 ceph-mon[31223]: pgmap v458: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:22.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:22 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:22.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:22 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:22.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:22 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' 2024-09-19T09:43:24.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:24 smithi171 ceph-mon[35803]: pgmap v459: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:24 smithi136 ceph-mon[34840]: pgmap v459: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:24.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:24 smithi042 ceph-mon[31223]: pgmap v459: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:26.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:43:26.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:26 smithi171 ceph-mon[35803]: pgmap v460: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-19T09:43:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:26 smithi136 ceph-mon[34840]: pgmap v460: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-19T09:43:26.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:26 smithi042 ceph-mon[31223]: pgmap v460: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-19T09:43:26.968 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.445+0000 7fab37929640 1 -- 172.21.15.42:0/2651184616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab30101440 msgr2=0x7fab3010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.445+0000 7fab37929640 1 --2- 172.21.15.42:0/2651184616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab30101440 0x7fab3010df30 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fab20009900 tx=0x7fab2002a410 comp rx=0 tx=0).stop 2024-09-19T09:43:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.446+0000 7fab37929640 1 -- 172.21.15.42:0/2651184616 shutdown_connections 2024-09-19T09:43:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.446+0000 7fab37929640 1 --2- 172.21.15.42:0/2651184616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab3010e500 0x7fab30110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.446+0000 7fab37929640 1 --2- 172.21.15.42:0/2651184616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab30101440 0x7fab3010df30 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.446+0000 7fab37929640 1 --2- 172.21.15.42:0/2651184616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab30100b20 0x7fab30100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.446+0000 7fab37929640 1 -- 172.21.15.42:0/2651184616 >> 172.21.15.42:0/2651184616 conn(0x7fab300fc7d0 msgr2=0x7fab300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.446+0000 7fab37929640 1 -- 172.21.15.42:0/2651184616 shutdown_connections 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.446+0000 7fab37929640 1 -- 172.21.15.42:0/2651184616 wait complete. 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.446+0000 7fab37929640 1 Processor -- start 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.446+0000 7fab37929640 1 -- start start 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab37929640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab30100b20 0x7fab3019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab37929640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab30101440 0x7fab3019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab37929640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3010e500 0x7fab3019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab37929640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab30114250 con 0x7fab3010e500 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab37929640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fab301140d0 con 0x7fab30100b20 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab37929640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fab301143d0 con 0x7fab30101440 2024-09-19T09:43:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab35ec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3010e500 0x7fab3019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab35ec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3010e500 0x7fab3019efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51812/0 (socket says 172.21.15.42:51812) 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab35ec6640 1 -- 172.21.15.42:0/1416344709 learned_addr learned my addr 172.21.15.42:0/1416344709 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab34ec4640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab30101440 0x7fab3019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab356c5640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab30100b20 0x7fab3019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab35ec6640 1 -- 172.21.15.42:0/1416344709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab30101440 msgr2=0x7fab3019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab35ec6640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab30101440 0x7fab3019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab35ec6640 1 -- 172.21.15.42:0/1416344709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab30100b20 msgr2=0x7fab3019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab35ec6640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab30100b20 0x7fab3019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab35ec6640 1 -- 172.21.15.42:0/1416344709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3019f6a0 con 0x7fab3010e500 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab34ec4640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab30101440 0x7fab3019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.447+0000 7fab35ec6640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3010e500 0x7fab3019efc0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fab2800ccb0 tx=0x7fab2800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.448+0000 7fab267fc640 1 -- 172.21.15.42:0/1416344709 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2800f450 con 0x7fab3010e500 2024-09-19T09:43:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.448+0000 7fab267fc640 1 -- 172.21.15.42:0/1416344709 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2800fad0 con 0x7fab3010e500 2024-09-19T09:43:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.448+0000 7fab37929640 1 -- 172.21.15.42:0/1416344709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3019f990 con 0x7fab3010e500 2024-09-19T09:43:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.448+0000 7fab267fc640 1 -- 172.21.15.42:0/1416344709 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28018bf0 con 0x7fab3010e500 2024-09-19T09:43:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.448+0000 7fab37929640 1 -- 172.21.15.42:0/1416344709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab301a7270 con 0x7fab3010e500 2024-09-19T09:43:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab39d02740 1 Processor -- start 2024-09-19T09:43:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab267fc640 1 -- 172.21.15.42:0/1416344709 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fab2800f5f0 con 0x7fab3010e500 2024-09-19T09:43:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab39d02740 1 -- start start 2024-09-19T09:43:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab39d02740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0c0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab39d02740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab39d02740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab39d02740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef0f0262e0 con 0x55ef0f0cb680 2024-09-19T09:43:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab39d02740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ef0efcdce0 con 0x55ef0f0c04a0 2024-09-19T09:43:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab39d02740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ef0f0222a0 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab34ec4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab34ec4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51824/0 (socket says 172.21.15.42:51824) 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab34ec4640 1 -- 172.21.15.42:0/3095810125 learned_addr learned my addr 172.21.15.42:0/3095810125 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.451+0000 7fab34ec4640 1 --2- 172.21.15.42:0/3095810125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab356c5640 1 --2- 172.21.15.42:0/3095810125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab267fc640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab1c0a3240 0x7fab1c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab34ec4640 1 -- 172.21.15.42:0/3095810125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c0dc0 msgr2=0x55ef0f0cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab34ec4640 1 --2- 172.21.15.42:0/3095810125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab34ec4640 1 -- 172.21.15.42:0/3095810125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 msgr2=0x55ef0f0c0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab34ec4640 1 --2- 172.21.15.42:0/3095810125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0c0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab34ec4640 1 -- 172.21.15.42:0/3095810125 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef0efb2440 con 0x55ef0f0cb680 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab35ec6640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab1c0a3240 0x7fab1c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab34ec4640 1 --2- 172.21.15.42:0/3095810125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0cda70 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fab20009900 tx=0x7fab20031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a157fb72a9344f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab267fc640 1 -- 172.21.15.42:0/1416344709 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fab280d0000 con 0x7fab3010e500 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab1b7fe640 1 -- 172.21.15.42:0/3095810125 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20035040 con 0x55ef0f0cb680 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab1b7fe640 1 -- 172.21.15.42:0/3095810125 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab200319f0 con 0x55ef0f0cb680 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.452+0000 7fab1b7fe640 1 -- 172.21.15.42:0/3095810125 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20004a00 con 0x55ef0f0cb680 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.453+0000 7fab39d02740 1 -- 172.21.15.42:0/3095810125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 msgr2=0x55ef0f0cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.453+0000 7fab39d02740 1 --2- 172.21.15.42:0/3095810125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0cda70 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fab20009900 tx=0x7fab20031400 comp rx=0 tx=0).stop 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.453+0000 7fab35ec6640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab1c0a3240 0x7fab1c0a5700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fab2809c630 tx=0x7fab28091b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.453+0000 7fab39d02740 1 -- 172.21.15.42:0/3095810125 shutdown_connections 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.453+0000 7fab39d02740 1 --2- 172.21.15.42:0/3095810125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0cda70 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.453+0000 7fab39d02740 1 --2- 172.21.15.42:0/3095810125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.453+0000 7fab39d02740 1 --2- 172.21.15.42:0/3095810125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0c0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.453+0000 7fab39d02740 1 -- 172.21.15.42:0/3095810125 >> 172.21.15.42:0/3095810125 conn(0x55ef0f0bca30 msgr2=0x55ef0f0bce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.453+0000 7fab39d02740 1 -- 172.21.15.42:0/3095810125 shutdown_connections 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.453+0000 7fab39d02740 1 -- 172.21.15.42:0/3095810125 wait complete. 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab39d02740 1 -- start start 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab39d02740 1 Processor -- start 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab39d02740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab39d02740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab39d02740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab39d02740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef0f0ce250 con 0x55ef0f0cb680 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab39d02740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ef0efe1050 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab39d02740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ef0f0ce3d0 con 0x55ef0f0c04a0 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab39d02740 10 client.0 _ll_register_callbacks cb 0x55ef0f021160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab34ec4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab34ec4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51828/0 (socket says 172.21.15.42:51828) 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab34ec4640 1 -- 172.21.15.42:0/953612555 learned_addr learned my addr 172.21.15.42:0/953612555 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.454+0000 7fab34ec4640 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab356c5640 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab34ec4640 1 -- 172.21.15.42:0/953612555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c04a0 msgr2=0x55ef0f0cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab34ec4640 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab34ec4640 1 -- 172.21.15.42:0/953612555 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 msgr2=0x55ef0f0c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab34ec4640 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab34ec4640 1 -- 172.21.15.42:0/953612555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef0ed973c0 con 0x55ef0f0cb680 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab356c5640 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab34ec4640 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0c8840 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fab20004590 tx=0x7fab20004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c37f9d52d0891f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab18ff9640 1 -- 172.21.15.42:0/953612555 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20035040 con 0x55ef0f0cb680 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab18ff9640 1 -- 172.21.15.42:0/953612555 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fab20004c70 con 0x55ef0f0cb680 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab39d02740 1 -- 172.21.15.42:0/953612555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab200319f0 con 0x55ef0f0cb680 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab18ff9640 1 -- 172.21.15.42:0/953612555 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fab20004e70 con 0x55ef0f0cb680 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab39d02740 10 client.16839 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.455+0000 7fab39d02740 1 -- 172.21.15.42:0/953612555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ef0f0d9c40 con 0x55ef0f0cb680 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.456+0000 7fab18ff9640 1 -- 172.21.15.42:0/953612555 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab200319f0 con 0x55ef0f0cb680 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.456+0000 7fab18ff9640 1 -- 172.21.15.42:0/953612555 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fab2003a040 con 0x55ef0f0cb680 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.456+0000 7fab39d02740 10 client.16839 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.456+0000 7fab39d02740 10 client.16839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.456+0000 7fab39d02740 20 client.16839 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.456+0000 7fab39d02740 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ef0f0daf90 0x55ef0f0dd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.456+0000 7fab39d02740 4 client.16839 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.456+0000 7fab39d02740 1 -- 172.21.15.42:0/953612555 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef0f033850 con 0x55ef0f0daf90 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.456+0000 7fab356c5640 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ef0f0daf90 0x55ef0f0dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.457+0000 7fab356c5640 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ef0f0daf90 0x55ef0f0dd380 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bc8b052ba3ed5bd server_cookie=9e16165a7fd5335c in_seq=0 out_seq=0 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.457+0000 7fab18ff9640 10 client.16839 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab18ff9640 1 -- 172.21.15.42:0/953612555 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef0f033850 con 0x55ef0f0daf90 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab18ff9640 10 client.16839 handle_command_reply: tid=0 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 client.16839 shutdown 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 -- 172.21.15.42:0/953612555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 msgr2=0x55ef0f0c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0c8840 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fab20004590 tx=0x7fab20004490 comp rx=0 tx=0).stop 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 -- 172.21.15.42:0/953612555 shutdown_connections 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ef0f0daf90 0x55ef0f0dd380 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0c8840 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab18ff9640 0 client.16839 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:43:27.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 --2- 172.21.15.42:0/953612555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 -- 172.21.15.42:0/953612555 >> 172.21.15.42:0/953612555 conn(0x55ef0f0bca30 msgr2=0x55ef0f0c2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:27.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 -- 172.21.15.42:0/953612555 shutdown_connections 2024-09-19T09:43:27.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 1 -- 172.21.15.42:0/953612555 wait complete. 2024-09-19T09:43:27.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.458+0000 7fab39d02740 20 client.16839 trim_cache size 0 max 16384 2024-09-19T09:43:27.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab39d02740 1 Processor -- start 2024-09-19T09:43:27.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab39d02740 1 -- start start 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab39d02740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0d74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab39d02740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab39d02740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab39d02740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab301af740 con 0x55ef0f0cb680 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab39d02740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fab301b1520 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab39d02740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fab301afed0 con 0x55ef0f0c04a0 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab34ec4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab34ec4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51836/0 (socket says 172.21.15.42:51836) 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab34ec4640 1 -- 172.21.15.42:0/1199037406 learned_addr learned my addr 172.21.15.42:0/1199037406 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab34ec4640 1 --2- 172.21.15.42:0/1199037406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0d74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.476+0000 7fab356c5640 1 --2- 172.21.15.42:0/1199037406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.477+0000 7fab34ec4640 1 -- 172.21.15.42:0/1199037406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c04a0 msgr2=0x55ef0f0d74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:27.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.477+0000 7fab34ec4640 1 --2- 172.21.15.42:0/1199037406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0d74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.477+0000 7fab34ec4640 1 -- 172.21.15.42:0/1199037406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 msgr2=0x55ef0f0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.477+0000 7fab34ec4640 1 --2- 172.21.15.42:0/1199037406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.477+0000 7fab34ec4640 1 -- 172.21.15.42:0/1199037406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef0f0c7270 con 0x55ef0f0cb680 2024-09-19T09:43:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.477+0000 7fab34ec4640 1 --2- 172.21.15.42:0/1199037406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0ca230 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fab20031610 tx=0x7fab20031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc46a50a12e3e972 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:27.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.477+0000 7fab1affd640 1 -- 172.21.15.42:0/1199037406 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20005d50 con 0x55ef0f0cb680 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.477+0000 7fab1affd640 1 -- 172.21.15.42:0/1199037406 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab20058760 con 0x55ef0f0cb680 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.477+0000 7fab1affd640 1 -- 172.21.15.42:0/1199037406 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20004a70 con 0x55ef0f0cb680 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 -- 172.21.15.42:0/1199037406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 msgr2=0x55ef0f0ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 --2- 172.21.15.42:0/1199037406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0ca230 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fab20031610 tx=0x7fab20031400 comp rx=0 tx=0).stop 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 -- 172.21.15.42:0/1199037406 shutdown_connections 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 --2- 172.21.15.42:0/1199037406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0cb680 0x55ef0f0ca230 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 --2- 172.21.15.42:0/1199037406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 --2- 172.21.15.42:0/1199037406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0d74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 -- 172.21.15.42:0/1199037406 >> 172.21.15.42:0/1199037406 conn(0x55ef0f0bca30 msgr2=0x55ef0f0c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 -- 172.21.15.42:0/1199037406 shutdown_connections 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 -- 172.21.15.42:0/1199037406 wait complete. 2024-09-19T09:43:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 -- start start 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.478+0000 7fab39d02740 1 Processor -- start 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab39d02740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0d3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab39d02740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab39d02740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0cb680 0x55ef0f0c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab39d02740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab301b0dc0 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab39d02740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fab301b0660 con 0x55ef0f0c04a0 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab39d02740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fab301ad720 con 0x55ef0f0cb680 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab39d02740 10 client.0 _ll_register_callbacks cb 0x7fab20032ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab356c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab356c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51846/0 (socket says 172.21.15.42:51846) 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab356c5640 1 -- 172.21.15.42:0/766350816 learned_addr learned my addr 172.21.15.42:0/766350816 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab34ec4640 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0cb680 0x55ef0f0c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab34ec4640 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0d3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab356c5640 1 -- 172.21.15.42:0/766350816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0cb680 msgr2=0x55ef0f0c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab356c5640 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0cb680 0x55ef0f0c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab356c5640 1 -- 172.21.15.42:0/766350816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 msgr2=0x55ef0f0d3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab356c5640 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0d3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab356c5640 1 -- 172.21.15.42:0/766350816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef0f0c5d60 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.479+0000 7fab34ec4640 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0d3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab356c5640 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c4ff0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00cb00 tx=0x7fab2c01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caedf8946f013912 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab18ff9640 1 -- 172.21.15.42:0/766350816 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c010d70 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab18ff9640 1 -- 172.21.15.42:0/766350816 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fab2c004020 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab39d02740 1 -- 172.21.15.42:0/766350816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab20058760 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab18ff9640 1 -- 172.21.15.42:0/766350816 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fab2c004240 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab39d02740 10 client.16845 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab39d02740 1 -- 172.21.15.42:0/766350816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ef0f145a40 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab18ff9640 1 -- 172.21.15.42:0/766350816 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab20058760 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab18ff9640 1 -- 172.21.15.42:0/766350816 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fab2c004960 con 0x55ef0f0c0dc0 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab39d02740 10 client.16845 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab39d02740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab39d02740 20 client.16845 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab39d02740 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ef0f146280 0x55ef0f1486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab39d02740 4 client.16845 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.480+0000 7fab39d02740 1 -- 172.21.15.42:0/766350816 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ef0f02dd60 con 0x55ef0f146280 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.481+0000 7fab34ec4640 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ef0f146280 0x55ef0f1486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.481+0000 7fab34ec4640 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ef0f146280 0x55ef0f1486a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc7836d57ed2ef52 server_cookie=a56bb0b1ec8ee053 in_seq=0 out_seq=0 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.481+0000 7fab18ff9640 10 client.16845 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:43:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.481+0000 7fab18ff9640 1 -- 172.21.15.42:0/766350816 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ef0f02dd60 con 0x55ef0f146280 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.481+0000 7fab18ff9640 10 client.16845 handle_command_reply: tid=0 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.481+0000 7fab39d02740 1 client.16845 shutdown 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.481+0000 7fab39d02740 1 -- 172.21.15.42:0/766350816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0c0dc0 msgr2=0x55ef0f0c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.481+0000 7fab39d02740 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c4ff0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00cb00 tx=0x7fab2c01ca40 comp rx=0 tx=0).stop 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.481+0000 7fab39d02740 1 -- 172.21.15.42:0/766350816 shutdown_connections 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.481+0000 7fab39d02740 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x55ef0f146280 0x55ef0f1486a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab39d02740 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ef0f0cb680 0x55ef0f0c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab39d02740 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef0f0c0dc0 0x55ef0f0c4ff0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab39d02740 1 --2- 172.21.15.42:0/766350816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef0f0c04a0 0x55ef0f0d3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab39d02740 1 -- 172.21.15.42:0/766350816 >> 172.21.15.42:0/766350816 conn(0x55ef0f0bca30 msgr2=0x55ef0f0bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab18ff9640 0 client.16845 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab39d02740 1 -- 172.21.15.42:0/766350816 shutdown_connections 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab39d02740 1 -- 172.21.15.42:0/766350816 wait complete. 2024-09-19T09:43:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab39d02740 20 client.16845 trim_cache size 0 max 16384 2024-09-19T09:43:27.489 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:43:27.489 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-19T09:43:27.489 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-09-19T09:43:27.489 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:43:27.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab37929640 1 -- 172.21.15.42:0/1416344709 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab1c0a3240 msgr2=0x7fab1c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab37929640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab1c0a3240 0x7fab1c0a5700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fab2809c630 tx=0x7fab28091b80 comp rx=0 tx=0).stop 2024-09-19T09:43:27.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab37929640 1 -- 172.21.15.42:0/1416344709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3010e500 msgr2=0x7fab3019efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab37929640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3010e500 0x7fab3019efc0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fab2800ccb0 tx=0x7fab2800a620 comp rx=0 tx=0).stop 2024-09-19T09:43:27.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab37929640 1 -- 172.21.15.42:0/1416344709 shutdown_connections 2024-09-19T09:43:27.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab37929640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fab1c0a3240 0x7fab1c0a5700 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab37929640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3010e500 0x7fab3019efc0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab37929640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab30101440 0x7fab3019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab37929640 1 --2- 172.21.15.42:0/1416344709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab30100b20 0x7fab3019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.482+0000 7fab37929640 1 -- 172.21.15.42:0/1416344709 >> 172.21.15.42:0/1416344709 conn(0x7fab300fc7d0 msgr2=0x7fab300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:27.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.483+0000 7fab37929640 1 -- 172.21.15.42:0/1416344709 shutdown_connections 2024-09-19T09:43:27.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:27.483+0000 7fab37929640 1 -- 172.21.15.42:0/1416344709 wait complete. 2024-09-19T09:43:28.252 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:43:28.253 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:43:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:28.772 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:28 smithi042 ceph-mon[31223]: pgmap v461: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:28.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:28 smithi171 ceph-mon[35803]: pgmap v461: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:28.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:28 smithi136 ceph-mon[34840]: pgmap v461: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:28.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.967+0000 7fbcd2766640 1 -- 172.21.15.42:0/575677830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbccc100a60 msgr2=0x7fbccc100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.967+0000 7fbcd2766640 1 --2- 172.21.15.42:0/575677830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbccc100a60 0x7fbccc100ec0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009930 tx=0x7fbcb402a420 comp rx=0 tx=0).stop 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.967+0000 7fbcd2766640 1 -- 172.21.15.42:0/575677830 shutdown_connections 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.967+0000 7fbcd2766640 1 --2- 172.21.15.42:0/575677830 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbccc101400 0x7fbccc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.967+0000 7fbcd2766640 1 --2- 172.21.15.42:0/575677830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbccc100a60 0x7fbccc100ec0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.967+0000 7fbcd2766640 1 --2- 172.21.15.42:0/575677830 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbccc106a60 0x7fbccc106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.967+0000 7fbcd2766640 1 -- 172.21.15.42:0/575677830 >> 172.21.15.42:0/575677830 conn(0x7fbccc0fc780 msgr2=0x7fbccc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.967+0000 7fbcd2766640 1 -- 172.21.15.42:0/575677830 shutdown_connections 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.967+0000 7fbcd2766640 1 -- 172.21.15.42:0/575677830 wait complete. 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcd2766640 1 Processor -- start 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcd2766640 1 -- start start 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcd2766640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbccc100a60 0x7fbccc1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:28.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcd2766640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbccc101400 0x7fbccc1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcd2766640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbccc106a60 0x7fbccc1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcd2766640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc110e60 con 0x7fbccc101400 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcd2766640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc110ce0 con 0x7fbccc100a60 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcd2766640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc110fe0 con 0x7fbccc106a60 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcc3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbccc101400 0x7fbccc1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcc3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbccc101400 0x7fbccc1997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51860/0 (socket says 172.21.15.42:51860) 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.968+0000 7fbcc3fff640 1 -- 172.21.15.42:0/3664631296 learned_addr learned my addr 172.21.15.42:0/3664631296 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbccbfff640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbccc100a60 0x7fbccc1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcd0d03640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbccc106a60 0x7fbccc1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcc3fff640 1 -- 172.21.15.42:0/3664631296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbccc106a60 msgr2=0x7fbccc1a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcc3fff640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbccc106a60 0x7fbccc1a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcc3fff640 1 -- 172.21.15.42:0/3664631296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbccc100a60 msgr2=0x7fbccc1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:28.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcc3fff640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbccc100a60 0x7fbccc1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:28.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcc3fff640 1 -- 172.21.15.42:0/3664631296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc1a4870 con 0x7fbccc101400 2024-09-19T09:43:28.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcc3fff640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbccc101400 0x7fbccc1997f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009230 tx=0x7fbcb4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcc9ffb640 1 -- 172.21.15.42:0/3664631296 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb403f030 con 0x7fbccc101400 2024-09-19T09:43:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcd2766640 1 -- 172.21.15.42:0/3664631296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbccc1a4a40 con 0x7fbccc101400 2024-09-19T09:43:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcc9ffb640 1 -- 172.21.15.42:0/3664631296 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcb4003ad0 con 0x7fbccc101400 2024-09-19T09:43:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcc9ffb640 1 -- 172.21.15.42:0/3664631296 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4035070 con 0x7fbccc101400 2024-09-19T09:43:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.969+0000 7fbcd2766640 1 -- 172.21.15.42:0/3664631296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbccc1a4ef0 con 0x7fbccc101400 2024-09-19T09:43:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.970+0000 7fbcd2766640 1 -- 172.21.15.42:0/3664631296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbccc100ec0 con 0x7fbccc101400 2024-09-19T09:43:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.971+0000 7fbcc9ffb640 1 -- 172.21.15.42:0/3664631296 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fbcb4042030 con 0x7fbccc101400 2024-09-19T09:43:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.972+0000 7fbcc9ffb640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcb80a3240 0x7fbcb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.972+0000 7fbccbfff640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcb80a3240 0x7fbcb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.972+0000 7fbcc9ffb640 1 -- 172.21.15.42:0/3664631296 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fbcb40efad0 con 0x7fbccc101400 2024-09-19T09:43:28.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.973+0000 7fbccbfff640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcb80a3240 0x7fbcb80a5700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00bb60 tx=0x7fbcbc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:28.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:28.977+0000 7fbcc9ffb640 1 -- 172.21.15.42:0/3664631296 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbcb40bc7d0 con 0x7fbccc101400 2024-09-19T09:43:29.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.188+0000 7fbcd2766640 1 -- 172.21.15.42:0/3664631296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbccc108fd0 con 0x7fbccc101400 2024-09-19T09:43:29.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.189+0000 7fbcc9ffb640 1 -- 172.21.15.42:0/3664631296 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+12010 (secure 0 0 0) 0x7fbcb40bc0d0 con 0x7fbccc101400 2024-09-19T09:43:29.191 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:43:29.191 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":38,"btime":"2024-09-19T09:42:32:397781+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:42:31.429090+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24454,24506,24466,24473,24478]},"id":1}]} 2024-09-19T09:43:29.191 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 38 2024-09-19T09:43:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 -- 172.21.15.42:0/3664631296 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcb80a3240 msgr2=0x7fbcb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcb80a3240 0x7fbcb80a5700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00bb60 tx=0x7fbcbc00b390 comp rx=0 tx=0).stop 2024-09-19T09:43:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 -- 172.21.15.42:0/3664631296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbccc101400 msgr2=0x7fbccc1997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbccc101400 0x7fbccc1997f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009230 tx=0x7fbcb4004270 comp rx=0 tx=0).stop 2024-09-19T09:43:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 -- 172.21.15.42:0/3664631296 shutdown_connections 2024-09-19T09:43:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fbcb80a3240 0x7fbcb80a5700 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbccc106a60 0x7fbccc1a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbccc101400 0x7fbccc1997f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 --2- 172.21.15.42:0/3664631296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbccc100a60 0x7fbccc1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:29.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 -- 172.21.15.42:0/3664631296 >> 172.21.15.42:0/3664631296 conn(0x7fbccc0fc780 msgr2=0x7fbccc0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:29.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 -- 172.21.15.42:0/3664631296 shutdown_connections 2024-09-19T09:43:29.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:29.191+0000 7fbcd2766640 1 -- 172.21.15.42:0/3664631296 wait complete. 2024-09-19T09:43:29.849 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:29 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3664631296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:43:29.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:29 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3664631296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:43:29.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:29 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3664631296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:43:29.907 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:43:30.170 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:30.576 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:30 smithi042 ceph-mon[31223]: pgmap v462: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-19T09:43:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.659+0000 7f314f267640 1 -- 172.21.15.42:0/3036194770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148100e20 msgr2=0x7f3148101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.659+0000 7f314f267640 1 --2- 172.21.15.42:0/3036194770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148100e20 0x7f3148101200 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3138009ca0 tx=0x7f313802a950 comp rx=0 tx=0).stop 2024-09-19T09:43:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.659+0000 7f314f267640 1 -- 172.21.15.42:0/3036194770 shutdown_connections 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.659+0000 7f314f267640 1 --2- 172.21.15.42:0/3036194770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3148102ef0 0x7f314810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.659+0000 7f314f267640 1 --2- 172.21.15.42:0/3036194770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3148102570 0x7f31481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.659+0000 7f314f267640 1 --2- 172.21.15.42:0/3036194770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148100e20 0x7f3148101200 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.659+0000 7f314f267640 1 -- 172.21.15.42:0/3036194770 >> 172.21.15.42:0/3036194770 conn(0x7f31480fc7d0 msgr2=0x7f31480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.659+0000 7f314f267640 1 -- 172.21.15.42:0/3036194770 shutdown_connections 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.659+0000 7f314f267640 1 -- 172.21.15.42:0/3036194770 wait complete. 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314f267640 1 Processor -- start 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314f267640 1 -- start start 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314f267640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3148100e20 0x7f3148198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314f267640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3148102570 0x7f3148198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314f267640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148102ef0 0x7f314819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314f267640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3148110f80 con 0x7f3148102ef0 2024-09-19T09:43:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314f267640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3148110e00 con 0x7f3148100e20 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314f267640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3148111100 con 0x7f3148102570 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314d804640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148102ef0 0x7f314819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314d804640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148102ef0 0x7f314819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38316/0 (socket says 172.21.15.42:38316) 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.660+0000 7f314d804640 1 -- 172.21.15.42:0/1978936591 learned_addr learned my addr 172.21.15.42:0/1978936591 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314d003640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3148100e20 0x7f3148198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314c802640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3148102570 0x7f3148198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314d804640 1 -- 172.21.15.42:0/1978936591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3148102570 msgr2=0x7f3148198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314d804640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3148102570 0x7f3148198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314d804640 1 -- 172.21.15.42:0/1978936591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3148100e20 msgr2=0x7f3148198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314d804640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3148100e20 0x7f3148198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314d804640 1 -- 172.21.15.42:0/1978936591 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314819d4b0 con 0x7f3148102ef0 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314c802640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3148102570 0x7f3148198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314d804640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148102ef0 0x7f314819cdd0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f314000d750 tx=0x7f314000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f31467fc640 1 -- 172.21.15.42:0/1978936591 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140017070 con 0x7f3148102ef0 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f31467fc640 1 -- 172.21.15.42:0/1978936591 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3140005500 con 0x7f3148102ef0 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314f267640 1 -- 172.21.15.42:0/1978936591 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314819d7a0 con 0x7f3148102ef0 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f31467fc640 1 -- 172.21.15.42:0/1978936591 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140004d90 con 0x7f3148102ef0 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.661+0000 7f314f267640 1 -- 172.21.15.42:0/1978936591 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31481a5080 con 0x7f3148102ef0 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.664+0000 7f31467fc640 1 -- 172.21.15.42:0/1978936591 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3140004f30 con 0x7f3148102ef0 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.664+0000 7f3151640740 1 Processor -- start 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.664+0000 7f3151640740 1 -- start start 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.664+0000 7f3151640740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f3151640740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1aa5d0 0x564efd1aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f3151640740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f3151640740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564efd1102f0 con 0x564efd1abb40 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f3151640740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564efd0b7cf0 con 0x564efd1b5370 2024-09-19T09:43:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f3151640740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564efd10c2b0 con 0x564efd1aa5d0 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314c802640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314c802640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1aa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38320/0 (socket says 172.21.15.42:38320) 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314c802640 1 -- 172.21.15.42:0/2133560396 learned_addr learned my addr 172.21.15.42:0/2133560396 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314d003640 1 --2- 172.21.15.42:0/2133560396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1aa5d0 0x564efd1aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314c802640 1 --2- 172.21.15.42:0/2133560396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314c802640 1 -- 172.21.15.42:0/2133560396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1aa5d0 msgr2=0x564efd1aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314c802640 1 --2- 172.21.15.42:0/2133560396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1aa5d0 0x564efd1aaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314c802640 1 -- 172.21.15.42:0/2133560396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 msgr2=0x564efd1b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314c802640 1 --2- 172.21.15.42:0/2133560396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314c802640 1 -- 172.21.15.42:0/2133560396 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564efd09c3a0 con 0x564efd1abb40 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f31467fc640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31300a3240 0x7f31300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f314d003640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31300a3240 0x7f31300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.665+0000 7f31467fc640 1 -- 172.21.15.42:0/1978936591 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f31400cf370 con 0x7f3148102ef0 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.666+0000 7f314c802640 1 --2- 172.21.15.42:0/2133560396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1aa090 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f313c013630 tx=0x7f313c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f09c4e258ac43a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.666+0000 7f314d003640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31300a3240 0x7f31300a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3138004ad0 tx=0x7f3138004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.666+0000 7f312f7fe640 1 -- 172.21.15.42:0/2133560396 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c019030 con 0x564efd1abb40 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.666+0000 7f312f7fe640 1 -- 172.21.15.42:0/2133560396 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f313c005500 con 0x564efd1abb40 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.666+0000 7f312f7fe640 1 -- 172.21.15.42:0/2133560396 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c0117a0 con 0x564efd1abb40 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 -- 172.21.15.42:0/2133560396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 msgr2=0x564efd1aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 --2- 172.21.15.42:0/2133560396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1aa090 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f313c013630 tx=0x7f313c00b760 comp rx=0 tx=0).stop 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 -- 172.21.15.42:0/2133560396 shutdown_connections 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 --2- 172.21.15.42:0/2133560396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 --2- 172.21.15.42:0/2133560396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1aa5d0 0x564efd1aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 --2- 172.21.15.42:0/2133560396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1aa090 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 -- 172.21.15.42:0/2133560396 >> 172.21.15.42:0/2133560396 conn(0x564efd173310 msgr2=0x564efd1a6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:30.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 -- 172.21.15.42:0/2133560396 shutdown_connections 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 -- 172.21.15.42:0/2133560396 wait complete. 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 -- start start 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.667+0000 7f3151640740 1 Processor -- start 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f3151640740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1aa5d0 0x564efd1b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f3151640740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f3151640740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f3151640740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564efd1b8070 con 0x564efd1abb40 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f3151640740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564efd0cb060 con 0x564efd1b5370 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f3151640740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564efd1b81f0 con 0x564efd1aa5d0 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f3151640740 10 client.0 _ll_register_callbacks cb 0x564efce1e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314c802640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314c802640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38326/0 (socket says 172.21.15.42:38326) 2024-09-19T09:43:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314c802640 1 -- 172.21.15.42:0/2475845552 learned_addr learned my addr 172.21.15.42:0/2475845552 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314d003640 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1aa5d0 0x564efd1b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314d804640 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314c802640 1 -- 172.21.15.42:0/2475845552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1aa5d0 msgr2=0x564efd1b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314c802640 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1aa5d0 0x564efd1b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314c802640 1 -- 172.21.15.42:0/2475845552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 msgr2=0x564efd1b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314c802640 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314c802640 1 -- 172.21.15.42:0/2475845552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564efce813c0 con 0x564efd1abb40 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314d804640 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f314c802640 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1b1fe0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f313c004b80 tx=0x7f313c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedeec153f431649 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.668+0000 7f312cff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f312cff9640 1 -- 172.21.15.42:0/2475845552 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c02b060 con 0x564efd1abb40 2024-09-19T09:43:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f312cff9640 1 -- 172.21.15.42:0/2475845552 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f313c005000 con 0x564efd1abb40 2024-09-19T09:43:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f3151640740 1 -- 172.21.15.42:0/2475845552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f313c005500 con 0x564efd1abb40 2024-09-19T09:43:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f312cff9640 1 -- 172.21.15.42:0/2475845552 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f313c019040 con 0x564efd1abb40 2024-09-19T09:43:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f3151640740 10 client.16863 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f3151640740 1 -- 172.21.15.42:0/2475845552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x564efd1c3ad0 con 0x564efd1abb40 2024-09-19T09:43:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f312cff9640 1 -- 172.21.15.42:0/2475845552 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f313c005500 con 0x564efd1abb40 2024-09-19T09:43:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f312cff9640 1 -- 172.21.15.42:0/2475845552 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f313c01e460 con 0x564efd1abb40 2024-09-19T09:43:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f3151640740 10 client.16863 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f3151640740 10 client.16863 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:43:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f3151640740 20 client.16863 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f3151640740 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x564efd1c4f30 0x564efd1c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f3151640740 4 client.16863 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.669+0000 7f3151640740 1 -- 172.21.15.42:0/2475845552 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564efd11d860 con 0x564efd1c4f30 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.670+0000 7f314d003640 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x564efd1c4f30 0x564efd1c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.670+0000 7f314d003640 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x564efd1c4f30 0x564efd1c7320 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=99d605c4fcd3a1b server_cookie=f3bbcc148dbb4792 in_seq=0 out_seq=0 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.670+0000 7f312cff9640 10 client.16863 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f312cff9640 1 -- 172.21.15.42:0/2475845552 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564efd11d860 con 0x564efd1c4f30 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f312cff9640 10 client.16863 handle_command_reply: tid=0 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 client.16863 shutdown 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 -- 172.21.15.42:0/2475845552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 msgr2=0x564efd1b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1b1fe0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f313c004b80 tx=0x7f313c004bb0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 -- 172.21.15.42:0/2475845552 shutdown_connections 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x564efd1c4f30 0x564efd1c7320 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1abb40 0x564efd1b1fe0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 --2- 172.21.15.42:0/2475845552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1aa5d0 0x564efd1b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f312cff9640 0 client.16863 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:43:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 -- 172.21.15.42:0/2475845552 >> 172.21.15.42:0/2475845552 conn(0x564efd173310 msgr2=0x564efd1ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 -- 172.21.15.42:0/2475845552 shutdown_connections 2024-09-19T09:43:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 1 -- 172.21.15.42:0/2475845552 wait complete. 2024-09-19T09:43:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.671+0000 7f3151640740 20 client.16863 trim_cache size 0 max 16384 2024-09-19T09:43:30.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.684+0000 7f3151640740 1 Processor -- start 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.684+0000 7f3151640740 1 -- start start 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.684+0000 7f3151640740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1c1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.684+0000 7f3151640740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 0x564efd1b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.684+0000 7f3151640740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.684+0000 7f3151640740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31481ad5d0 con 0x564efd1aa5d0 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.684+0000 7f3151640740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f31481af3b0 con 0x564efd1b5370 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.684+0000 7f3151640740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f31481add60 con 0x564efd1abb40 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.684+0000 7f314d003640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314d003640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1c1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38336/0 (socket says 172.21.15.42:38336) 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314d003640 1 -- 172.21.15.42:0/3773738504 learned_addr learned my addr 172.21.15.42:0/3773738504 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314c802640 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 0x564efd1b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314d003640 1 -- 172.21.15.42:0/3773738504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 msgr2=0x564efd1b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:30.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314d003640 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 0x564efd1b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314d003640 1 -- 172.21.15.42:0/3773738504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 msgr2=0x564efd1cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:30.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314d804640 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314d003640 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314d003640 1 -- 172.21.15.42:0/3773738504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564efd1a7960 con 0x564efd1aa5d0 2024-09-19T09:43:30.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314c802640 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 0x564efd1b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:43:30.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314d804640 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:43:30.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f314d003640 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1c1310 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3138009ca0 tx=0x7f3138042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e947fe20c5ddd851 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:30.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f312effd640 1 -- 172.21.15.42:0/3773738504 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3138034040 con 0x564efd1aa5d0 2024-09-19T09:43:30.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f312effd640 1 -- 172.21.15.42:0/3773738504 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3138003df0 con 0x564efd1aa5d0 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.685+0000 7f312effd640 1 -- 172.21.15.42:0/3773738504 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31380539a0 con 0x564efd1aa5d0 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 -- 172.21.15.42:0/3773738504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 msgr2=0x564efd1c1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1c1310 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3138009ca0 tx=0x7f3138042000 comp rx=0 tx=0).stop 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 -- 172.21.15.42:0/3773738504 shutdown_connections 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 0x564efd1b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 --2- 172.21.15.42:0/3773738504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1c1310 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 -- 172.21.15.42:0/3773738504 >> 172.21.15.42:0/3773738504 conn(0x564efd173310 msgr2=0x564efd1b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 -- 172.21.15.42:0/3773738504 shutdown_connections 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 -- 172.21.15.42:0/3773738504 wait complete. 2024-09-19T09:43:30.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 -- start start 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.686+0000 7f3151640740 1 Processor -- start 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f3151640740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1bd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f3151640740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 0x564efd1bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f3151640740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f3151640740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31481aec50 con 0x564efd1aa5d0 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f3151640740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f31481ae4f0 con 0x564efd1b5370 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f3151640740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f31481ab5b0 con 0x564efd1abb40 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f3151640740 10 client.0 _ll_register_callbacks cb 0x7f3138009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314d003640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1bd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314d003640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1bd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38350/0 (socket says 172.21.15.42:38350) 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314d003640 1 -- 172.21.15.42:0/1896365809 learned_addr learned my addr 172.21.15.42:0/1896365809 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:30.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314c802640 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 0x564efd1bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314d804640 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314d003640 1 -- 172.21.15.42:0/1896365809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 msgr2=0x564efd1bddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314d003640 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 0x564efd1bddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314d003640 1 -- 172.21.15.42:0/1896365809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 msgr2=0x564efd1b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314d003640 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314d003640 1 -- 172.21.15.42:0/1896365809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564efd1b9620 con 0x564efd1aa5d0 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.687+0000 7f314d804640 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f314d003640 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1bd870 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f313802fca0 tx=0x7f313802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea3275cd8516cbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f312cff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f312cff9640 1 -- 172.21.15.42:0/1896365809 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3138060020 con 0x564efd1aa5d0 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f312cff9640 1 -- 172.21.15.42:0/1896365809 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3138053b70 con 0x564efd1aa5d0 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f3151640740 1 -- 172.21.15.42:0/1896365809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3138003df0 con 0x564efd1aa5d0 2024-09-19T09:43:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f312cff9640 1 -- 172.21.15.42:0/1896365809 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f313806b050 con 0x564efd1aa5d0 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f3151640740 10 client.16869 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f3151640740 1 -- 172.21.15.42:0/1896365809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x564efd2339b0 con 0x564efd1aa5d0 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f312cff9640 1 -- 172.21.15.42:0/1896365809 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3138003df0 con 0x564efd1aa5d0 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f312cff9640 1 -- 172.21.15.42:0/1896365809 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f313805c6e0 con 0x564efd1aa5d0 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f3151640740 10 client.16869 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f3151640740 10 client.16869 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f3151640740 20 client.16869 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f3151640740 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x564efd234180 0x564efd2365a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f3151640740 4 client.16869 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.688+0000 7f3151640740 1 -- 172.21.15.42:0/1896365809 --> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564efd117d70 con 0x564efd234180 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f314c802640 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x564efd234180 0x564efd2365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f314c802640 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x564efd234180 0x564efd2365a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e7a7dccc5c85f6b9 server_cookie=a61212b940d0cc03 in_seq=0 out_seq=0 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f312cff9640 10 client.16869 ms_handle_connect on v2:172.21.15.171:6834/3609400567 2024-09-19T09:43:30.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f312cff9640 1 -- 172.21.15.42:0/1896365809 <== mds.4 v2:172.21.15.171:6834/3609400567 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564efd117d70 con 0x564efd234180 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f312cff9640 10 client.16869 handle_command_reply: tid=0 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f3151640740 1 client.16869 shutdown 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f3151640740 1 -- 172.21.15.42:0/1896365809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 msgr2=0x564efd1bd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f3151640740 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1bd870 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f313802fca0 tx=0x7f313802a950 comp rx=0 tx=0).stop 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f3151640740 1 -- 172.21.15.42:0/1896365809 shutdown_connections 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f3151640740 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.171:6834/3609400567,v1:172.21.15.171:6835/3609400567] conn(0x564efd234180 0x564efd2365a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f3151640740 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564efd1b5370 0x564efd1b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f3151640740 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564efd1abb40 0x564efd1bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f3151640740 1 --2- 172.21.15.42:0/1896365809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564efd1aa5d0 0x564efd1bd870 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f3151640740 1 -- 172.21.15.42:0/1896365809 >> 172.21.15.42:0/1896365809 conn(0x564efd173310 msgr2=0x564efd1b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.689+0000 7f312cff9640 0 client.16869 ms_handle_reset on v2:172.21.15.171:6834/3609400567 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f3151640740 1 -- 172.21.15.42:0/1896365809 shutdown_connections 2024-09-19T09:43:30.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f3151640740 1 -- 172.21.15.42:0/1896365809 wait complete. 2024-09-19T09:43:30.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f3151640740 20 client.16869 trim_cache size 0 max 16384 2024-09-19T09:43:30.709 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 -- 172.21.15.42:0/1978936591 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31300a3240 msgr2=0x7f31300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31300a3240 0x7f31300a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3138004ad0 tx=0x7f3138004a60 comp rx=0 tx=0).stop 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 -- 172.21.15.42:0/1978936591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148102ef0 msgr2=0x7f314819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148102ef0 0x7f314819cdd0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f314000d750 tx=0x7f314000dc10 comp rx=0 tx=0).stop 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 -- 172.21.15.42:0/1978936591 shutdown_connections 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f31300a3240 0x7f31300a5700 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148102ef0 0x7f314819cdd0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3148102570 0x7f3148198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 --2- 172.21.15.42:0/1978936591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3148100e20 0x7f3148198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 -- 172.21.15.42:0/1978936591 >> 172.21.15.42:0/1978936591 conn(0x7f31480fc7d0 msgr2=0x7f3148105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 -- 172.21.15.42:0/1978936591 shutdown_connections 2024-09-19T09:43:30.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:30.690+0000 7f314f267640 1 -- 172.21.15.42:0/1978936591 wait complete. 2024-09-19T09:43:30.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:30 smithi171 ceph-mon[35803]: pgmap v462: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-19T09:43:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:30 smithi136 ceph-mon[34840]: pgmap v462: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-19T09:43:31.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:43:31.783 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:32.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.225+0000 7f8117d0a640 1 -- 172.21.15.42:0/2519295903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81101008d0 msgr2=0x7f8110100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.225+0000 7f8117d0a640 1 --2- 172.21.15.42:0/2519295903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81101008d0 0x7f8110100cb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f810c009900 tx=0x7f810c02a410 comp rx=0 tx=0).stop 2024-09-19T09:43:32.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.225+0000 7f8117d0a640 1 -- 172.21.15.42:0/2519295903 shutdown_connections 2024-09-19T09:43:32.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.225+0000 7f8117d0a640 1 --2- 172.21.15.42:0/2519295903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f811010e480 0x7f8110110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.225+0000 7f8117d0a640 1 --2- 172.21.15.42:0/2519295903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8110101280 0x7f811010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.225+0000 7f8117d0a640 1 --2- 172.21.15.42:0/2519295903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81101008d0 0x7f8110100cb0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.225+0000 7f8117d0a640 1 -- 172.21.15.42:0/2519295903 >> 172.21.15.42:0/2519295903 conn(0x7f81100fc7a0 msgr2=0x7f81100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.225+0000 7f8117d0a640 1 -- 172.21.15.42:0/2519295903 shutdown_connections 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.225+0000 7f8117d0a640 1 -- 172.21.15.42:0/2519295903 wait complete. 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f8117d0a640 1 Processor -- start 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f8117d0a640 1 -- start start 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f8117d0a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81101008d0 0x7f811019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f8117d0a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8110101280 0x7f811019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f8117d0a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f811010e480 0x7f811019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f8117d0a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f81101141b0 con 0x7f811010e480 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f8117d0a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8110114030 con 0x7f81101008d0 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f8117d0a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8110114330 con 0x7f8110101280 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f81162a7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f811010e480 0x7f811019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f81162a7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f811010e480 0x7f811019efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38380/0 (socket says 172.21.15.42:38380) 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f81162a7640 1 -- 172.21.15.42:0/861692894 learned_addr learned my addr 172.21.15.42:0/861692894 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f8115aa6640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81101008d0 0x7f811019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.226+0000 7f81152a5640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8110101280 0x7f811019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f81162a7640 1 -- 172.21.15.42:0/861692894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8110101280 msgr2=0x7f811019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f81162a7640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8110101280 0x7f811019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f81162a7640 1 -- 172.21.15.42:0/861692894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81101008d0 msgr2=0x7f811019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f81162a7640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81101008d0 0x7f811019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f81162a7640 1 -- 172.21.15.42:0/861692894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811019f6a0 con 0x7f811010e480 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f8115aa6640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81101008d0 0x7f811019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f81152a5640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8110101280 0x7f811019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f81162a7640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f811010e480 0x7f811019efc0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f810800cce0 tx=0x7f810800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f8106ffd640 1 -- 172.21.15.42:0/861692894 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810800f450 con 0x7f811010e480 2024-09-19T09:43:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f8106ffd640 1 -- 172.21.15.42:0/861692894 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f810800fad0 con 0x7f811010e480 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f8117d0a640 1 -- 172.21.15.42:0/861692894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811019f990 con 0x7f811010e480 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f8106ffd640 1 -- 172.21.15.42:0/861692894 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108018bd0 con 0x7f811010e480 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.227+0000 7f8117d0a640 1 -- 172.21.15.42:0/861692894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81101a7270 con 0x7f811010e480 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.229+0000 7f8106ffd640 1 -- 172.21.15.42:0/861692894 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f810800fc80 con 0x7f811010e480 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f811a0e3740 1 Processor -- start 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f811a0e3740 1 -- start start 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aaab40 0x557154aa9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154aa9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154ab4370 0x557154ab6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f811a0e3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557154a0f2f0 con 0x557154aa95d0 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f811a0e3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5571549b6cf0 con 0x557154ab4370 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f811a0e3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557154a0b2b0 con 0x557154aaab40 2024-09-19T09:43:32.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f8106ffd640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80fc0a3240 0x7f80fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f8115aa6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154aa9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f8115aa6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154aa9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38382/0 (socket says 172.21.15.42:38382) 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f8115aa6640 1 -- 172.21.15.42:0/1981769733 learned_addr learned my addr 172.21.15.42:0/1981769733 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f81162a7640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80fc0a3240 0x7f80fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.230+0000 7f81152a5640 1 --2- 172.21.15.42:0/1981769733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aaab40 0x557154aa9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f81152a5640 1 --2- 172.21.15.42:0/1981769733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154ab4370 0x557154ab6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f8106ffd640 1 -- 172.21.15.42:0/861692894 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f81080d0100 con 0x7f811010e480 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f8115aa6640 1 -- 172.21.15.42:0/1981769733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aaab40 msgr2=0x557154aa9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f8115aa6640 1 --2- 172.21.15.42:0/1981769733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aaab40 0x557154aa9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f8115aa6640 1 -- 172.21.15.42:0/1981769733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154ab4370 msgr2=0x557154ab6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f8115aa6640 1 --2- 172.21.15.42:0/1981769733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154ab4370 0x557154ab6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f8115aa6640 1 -- 172.21.15.42:0/1981769733 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715499b3a0 con 0x557154aa95d0 2024-09-19T09:43:32.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f81152a5640 1 --2- 172.21.15.42:0/1981769733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154ab4370 0x557154ab6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f8115aa6640 1 --2- 172.21.15.42:0/1981769733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154aa9a10 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f810c009900 tx=0x7f810c0316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b3a461070cea11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f81162a7640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80fc0a3240 0x7f80fc0a5700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f81080137c0 tx=0x7f81080674d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f80fbfff640 1 -- 172.21.15.42:0/1981769733 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c03f070 con 0x557154aa95d0 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f80fbfff640 1 -- 172.21.15.42:0/1981769733 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f810c0035f0 con 0x557154aa95d0 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.231+0000 7f80fbfff640 1 -- 172.21.15.42:0/1981769733 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c035070 con 0x557154aa95d0 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 -- 172.21.15.42:0/1981769733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 msgr2=0x557154aa9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 --2- 172.21.15.42:0/1981769733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154aa9a10 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f810c009900 tx=0x7f810c0316e0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 -- 172.21.15.42:0/1981769733 shutdown_connections 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 --2- 172.21.15.42:0/1981769733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154ab4370 0x557154ab6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 --2- 172.21.15.42:0/1981769733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154aa9a10 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 --2- 172.21.15.42:0/1981769733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aaab40 0x557154aa9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 -- 172.21.15.42:0/1981769733 >> 172.21.15.42:0/1981769733 conn(0x557154a72310 msgr2=0x557154aa5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 -- 172.21.15.42:0/1981769733 shutdown_connections 2024-09-19T09:43:32.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 -- 172.21.15.42:0/1981769733 wait complete. 2024-09-19T09:43:32.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 -- start start 2024-09-19T09:43:32.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.232+0000 7f811a0e3740 1 Processor -- start 2024-09-19T09:43:32.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154ab3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aaab40 0x557154ab1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154ab4370 0x557154ab1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f811a0e3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557154ab7010 con 0x557154aa95d0 2024-09-19T09:43:32.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f811a0e3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5571549ca060 con 0x557154ab4370 2024-09-19T09:43:32.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f811a0e3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557154ab7190 con 0x557154aaab40 2024-09-19T09:43:32.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f811a0e3740 10 client.0 _ll_register_callbacks cb 0x55715471d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f81152a5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154ab3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f81152a5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154ab3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38392/0 (socket says 172.21.15.42:38392) 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f81152a5640 1 -- 172.21.15.42:0/4245623698 learned_addr learned my addr 172.21.15.42:0/4245623698 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f8115aa6640 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aaab40 0x557154ab1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f81152a5640 1 -- 172.21.15.42:0/4245623698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aaab40 msgr2=0x557154ab1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f81152a5640 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aaab40 0x557154ab1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f81152a5640 1 -- 172.21.15.42:0/4245623698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154ab4370 msgr2=0x557154ab1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f81152a5640 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154ab4370 0x557154ab1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f81152a5640 1 -- 172.21.15.42:0/4245623698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571547803c0 con 0x557154aa95d0 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f81152a5640 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154ab3d80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8100012800 tx=0x7f8100012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d44559a8d90867c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.233+0000 7f80f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f80f97fa640 1 -- 172.21.15.42:0/4245623698 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810000fc50 con 0x557154aa95d0 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f80f97fa640 1 -- 172.21.15.42:0/4245623698 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f810000fdf0 con 0x557154aa95d0 2024-09-19T09:43:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f811a0e3740 1 -- 172.21.15.42:0/4245623698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f810c0035f0 con 0x557154aa95d0 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f80f97fa640 1 -- 172.21.15.42:0/4245623698 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8100023070 con 0x557154aa95d0 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f811a0e3740 10 client.16881 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f811a0e3740 1 -- 172.21.15.42:0/4245623698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557154ac2b40 con 0x557154aa95d0 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f80f97fa640 1 -- 172.21.15.42:0/4245623698 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f810c0035f0 con 0x557154aa95d0 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f80f97fa640 1 -- 172.21.15.42:0/4245623698 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f81000274d0 con 0x557154aa95d0 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f811a0e3740 10 client.16881 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f811a0e3740 10 client.16881 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f811a0e3740 20 client.16881 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f811a0e3740 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x557154ac4000 0x557154ac6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f811a0e3740 4 client.16881 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:32.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.234+0000 7f811a0e3740 1 -- 172.21.15.42:0/4245623698 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557154a1c860 con 0x557154ac4000 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.235+0000 7f8115aa6640 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x557154ac4000 0x557154ac6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.235+0000 7f80f97fa640 10 client.16881 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.235+0000 7f8115aa6640 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x557154ac4000 0x557154ac6410 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=574c321939aae804 server_cookie=468d63583eb60e67 in_seq=0 out_seq=0 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f80f97fa640 1 -- 172.21.15.42:0/4245623698 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557154a1c860 con 0x557154ac4000 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f80f97fa640 10 client.16881 handle_command_reply: tid=0 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 client.16881 shutdown 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 -- 172.21.15.42:0/4245623698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 msgr2=0x557154ab3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154ab3d80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8100012800 tx=0x7f8100012cc0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 -- 172.21.15.42:0/4245623698 shutdown_connections 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x557154ac4000 0x557154ac6410 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154ab4370 0x557154ab1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aaab40 0x557154ab1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f80f97fa640 0 client.16881 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 --2- 172.21.15.42:0/4245623698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aa95d0 0x557154ab3d80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 -- 172.21.15.42:0/4245623698 >> 172.21.15.42:0/4245623698 conn(0x557154a72310 msgr2=0x557154aab960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 -- 172.21.15.42:0/4245623698 shutdown_connections 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 1 -- 172.21.15.42:0/4245623698 wait complete. 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.236+0000 7f811a0e3740 20 client.16881 trim_cache size 0 max 16384 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f811a0e3740 1 Processor -- start 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f811a0e3740 1 -- start start 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aa95d0 0x557154aaff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aaab40 0x557154ac02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154ab4370 0x557154aab820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f811a0e3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f81101af790 con 0x557154aaab40 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f811a0e3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f81101b1570 con 0x557154aa95d0 2024-09-19T09:43:32.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f811a0e3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81101aff20 con 0x557154ab4370 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f8115aa6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aaab40 0x557154ac02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f8115aa6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aaab40 0x557154ac02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38398/0 (socket says 172.21.15.42:38398) 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f8115aa6640 1 -- 172.21.15.42:0/2627955538 learned_addr learned my addr 172.21.15.42:0/2627955538 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.249+0000 7f81152a5640 1 --2- 172.21.15.42:0/2627955538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aa95d0 0x557154aaff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f8115aa6640 1 -- 172.21.15.42:0/2627955538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154ab4370 msgr2=0x557154aab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f8115aa6640 1 --2- 172.21.15.42:0/2627955538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154ab4370 0x557154aab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f8115aa6640 1 -- 172.21.15.42:0/2627955538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aa95d0 msgr2=0x557154aaff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f8115aa6640 1 --2- 172.21.15.42:0/2627955538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aa95d0 0x557154aaff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f8115aa6640 1 -- 172.21.15.42:0/2627955538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557154ab1fd0 con 0x557154aaab40 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f81152a5640 1 --2- 172.21.15.42:0/2627955538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aa95d0 0x557154aaff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f8115aa6640 1 --2- 172.21.15.42:0/2627955538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aaab40 0x557154ac02b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x557154aa6ac0 tx=0x7f810c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f4e835bfa12906 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f80fb7fe640 1 -- 172.21.15.42:0/2627955538 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c035040 con 0x557154aaab40 2024-09-19T09:43:32.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f80fb7fe640 1 -- 172.21.15.42:0/2627955538 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f810c0319f0 con 0x557154aaab40 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f80fb7fe640 1 -- 172.21.15.42:0/2627955538 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c03f040 con 0x557154aaab40 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.250+0000 7f811a0e3740 1 -- 172.21.15.42:0/2627955538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aaab40 msgr2=0x557154ac02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 --2- 172.21.15.42:0/2627955538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aaab40 0x557154ac02b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x557154aa6ac0 tx=0x7f810c02a410 comp rx=0 tx=0).stop 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 -- 172.21.15.42:0/2627955538 shutdown_connections 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 --2- 172.21.15.42:0/2627955538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154ab4370 0x557154aab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 --2- 172.21.15.42:0/2627955538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154aaab40 0x557154ac02b0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 --2- 172.21.15.42:0/2627955538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aa95d0 0x557154aaff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 -- 172.21.15.42:0/2627955538 >> 172.21.15.42:0/2627955538 conn(0x557154a72310 msgr2=0x557154aab110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 -- 172.21.15.42:0/2627955538 shutdown_connections 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 -- 172.21.15.42:0/2627955538 wait complete. 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 -- start start 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 Processor -- start 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aa95d0 0x557154aae060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aaab40 0x557154aae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154ab4370 0x557154aaeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f81101b0e10 con 0x557154ab4370 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f81101b06b0 con 0x557154aaab40 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81101ad770 con 0x557154aa95d0 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.251+0000 7f811a0e3740 10 client.0 _ll_register_callbacks cb 0x7f8100012410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f81152a5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154ab4370 0x557154aaeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f81152a5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154ab4370 0x557154aaeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38412/0 (socket says 172.21.15.42:38412) 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f81152a5640 1 -- 172.21.15.42:0/3207269503 learned_addr learned my addr 172.21.15.42:0/3207269503 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f8115aa6640 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aaab40 0x557154aae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f81152a5640 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aa95d0 0x557154aae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f81152a5640 1 -- 172.21.15.42:0/3207269503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aa95d0 msgr2=0x557154aae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f81152a5640 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aa95d0 0x557154aae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f81152a5640 1 -- 172.21.15.42:0/3207269503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aaab40 msgr2=0x557154aae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f81152a5640 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aaab40 0x557154aae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f81152a5640 1 -- 172.21.15.42:0/3207269503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557154aa54f0 con 0x557154ab4370 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f8115aa6640 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aaab40 0x557154aae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f81152a5640 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154ab4370 0x557154aaeae0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x557154aaf290 tx=0x7f8100014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0dabca88dc88b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f80f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f80f97fa640 1 -- 172.21.15.42:0/3207269503 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100027b10 con 0x557154ab4370 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f80f97fa640 1 -- 172.21.15.42:0/3207269503 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8100027cb0 con 0x557154ab4370 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f811a0e3740 1 -- 172.21.15.42:0/3207269503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f810c0319f0 con 0x557154ab4370 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f80f97fa640 1 -- 172.21.15.42:0/3207269503 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f81000273d0 con 0x557154ab4370 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f811a0e3740 10 client.16887 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.252+0000 7f811a0e3740 1 -- 172.21.15.42:0/3207269503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557154b2ed80 con 0x557154ab4370 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.253+0000 7f80f97fa640 1 -- 172.21.15.42:0/3207269503 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f810c0319f0 con 0x557154ab4370 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.253+0000 7f80f97fa640 1 -- 172.21.15.42:0/3207269503 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f81000289e0 con 0x557154ab4370 2024-09-19T09:43:32.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.253+0000 7f811a0e3740 10 client.16887 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.253+0000 7f811a0e3740 10 client.16887 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.253+0000 7f811a0e3740 20 client.16887 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.253+0000 7f811a0e3740 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x557154b2f530 0x557154b31950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.253+0000 7f811a0e3740 4 client.16887 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.253+0000 7f811a0e3740 1 -- 172.21.15.42:0/3207269503 --> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557154a16d70 con 0x557154b2f530 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.253+0000 7f8115aa6640 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x557154b2f530 0x557154b31950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f8115aa6640 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x557154b2f530 0x557154b31950 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5e8bb63d52a58ddb server_cookie=c73ef73150b4e407 in_seq=0 out_seq=0 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f80f97fa640 10 client.16887 ms_handle_connect on v2:172.21.15.171:6836/512338141 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f80f97fa640 1 -- 172.21.15.42:0/3207269503 <== mds.3 v2:172.21.15.171:6836/512338141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557154a16d70 con 0x557154b2f530 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f80f97fa640 10 client.16887 handle_command_reply: tid=0 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 client.16887 shutdown 2024-09-19T09:43:32.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 -- 172.21.15.42:0/3207269503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154ab4370 msgr2=0x557154aaeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154ab4370 0x557154aaeae0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x557154aaf290 tx=0x7f8100014040 comp rx=0 tx=0).stop 2024-09-19T09:43:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 -- 172.21.15.42:0/3207269503 shutdown_connections 2024-09-19T09:43:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.171:6836/512338141,v1:172.21.15.171:6837/512338141] conn(0x557154b2f530 0x557154b31950 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557154ab4370 0x557154aaeae0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557154aaab40 0x557154aae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 --2- 172.21.15.42:0/3207269503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557154aa95d0 0x557154aae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f80f97fa640 0 client.16887 ms_handle_reset on v2:172.21.15.171:6836/512338141 2024-09-19T09:43:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 -- 172.21.15.42:0/3207269503 >> 172.21.15.42:0/3207269503 conn(0x557154a72310 msgr2=0x557154aa4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 -- 172.21.15.42:0/3207269503 shutdown_connections 2024-09-19T09:43:32.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 1 -- 172.21.15.42:0/3207269503 wait complete. 2024-09-19T09:43:32.304 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:43:32.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.254+0000 7f811a0e3740 20 client.16887 trim_cache size 0 max 16384 2024-09-19T09:43:32.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 -- 172.21.15.42:0/861692894 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80fc0a3240 msgr2=0x7f80fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80fc0a3240 0x7f80fc0a5700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f81080137c0 tx=0x7f81080674d0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 -- 172.21.15.42:0/861692894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f811010e480 msgr2=0x7f811019efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:32.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f811010e480 0x7f811019efc0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f810800cce0 tx=0x7f810800a620 comp rx=0 tx=0).stop 2024-09-19T09:43:32.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 -- 172.21.15.42:0/861692894 shutdown_connections 2024-09-19T09:43:32.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f80fc0a3240 0x7f80fc0a5700 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f811010e480 0x7f811019efc0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8110101280 0x7f811019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 --2- 172.21.15.42:0/861692894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81101008d0 0x7f811019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:32.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 -- 172.21.15.42:0/861692894 >> 172.21.15.42:0/861692894 conn(0x7f81100fc7a0 msgr2=0x7f81100feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:32.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 -- 172.21.15.42:0/861692894 shutdown_connections 2024-09-19T09:43:32.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:32.255+0000 7f8117d0a640 1 -- 172.21.15.42:0/861692894 wait complete. 2024-09-19T09:43:32.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:32 smithi171 ceph-mon[35803]: pgmap v463: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:32 smithi136 ceph-mon[34840]: pgmap v463: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:32.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:32 smithi042 ceph-mon[31223]: pgmap v463: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:33.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:43:33.358 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.793+0000 7fc440dba640 1 -- 172.21.15.42:0/938678181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc43c103660 msgr2=0x7fc43c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.793+0000 7fc440dba640 1 --2- 172.21.15.42:0/938678181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc43c103660 0x7fc43c10bb50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc424009900 tx=0x7fc42402a480 comp rx=0 tx=0).stop 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.793+0000 7fc440dba640 1 -- 172.21.15.42:0/938678181 shutdown_connections 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.793+0000 7fc440dba640 1 --2- 172.21.15.42:0/938678181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc43c10c170 0x7fc43c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.793+0000 7fc440dba640 1 --2- 172.21.15.42:0/938678181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc43c103660 0x7fc43c10bb50 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.793+0000 7fc440dba640 1 --2- 172.21.15.42:0/938678181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc43c102d40 0x7fc43c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.793+0000 7fc440dba640 1 -- 172.21.15.42:0/938678181 >> 172.21.15.42:0/938678181 conn(0x7fc43c0fc7a0 msgr2=0x7fc43c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.793+0000 7fc440dba640 1 -- 172.21.15.42:0/938678181 shutdown_connections 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.793+0000 7fc440dba640 1 -- 172.21.15.42:0/938678181 wait complete. 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.794+0000 7fc440dba640 1 Processor -- start 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.794+0000 7fc440dba640 1 -- start start 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.794+0000 7fc440dba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc43c102d40 0x7fc43c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.794+0000 7fc440dba640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc43c103660 0x7fc43c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.794+0000 7fc440dba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc43c10c170 0x7fc43c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.794+0000 7fc440dba640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c111f70 con 0x7fc43c102d40 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.794+0000 7fc440dba640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c111df0 con 0x7fc43c103660 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.794+0000 7fc440dba640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c1120f0 con 0x7fc43c10c170 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc43a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc43c102d40 0x7fc43c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc43a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc43c102d40 0x7fc43c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38430/0 (socket says 172.21.15.42:38430) 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc43a59c640 1 -- 172.21.15.42:0/2110499212 learned_addr learned my addr 172.21.15.42:0/2110499212 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc439d9b640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc43c103660 0x7fc43c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc43c10c170 0x7fc43c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc43a59c640 1 -- 172.21.15.42:0/2110499212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc43c10c170 msgr2=0x7fc43c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc43a59c640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc43c10c170 0x7fc43c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc43a59c640 1 -- 172.21.15.42:0/2110499212 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc43c103660 msgr2=0x7fc43c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc43a59c640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc43c103660 0x7fc43c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc43a59c640 1 -- 172.21.15.42:0/2110499212 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c19d420 con 0x7fc43c102d40 2024-09-19T09:43:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc43a59c640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc43c102d40 0x7fc43c198470 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00eab0 tx=0x7fc42c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc4337fe640 1 -- 172.21.15.42:0/2110499212 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00ce40 con 0x7fc43c102d40 2024-09-19T09:43:33.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc4337fe640 1 -- 172.21.15.42:0/2110499212 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc42c011950 con 0x7fc43c102d40 2024-09-19T09:43:33.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc440dba640 1 -- 172.21.15.42:0/2110499212 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43c19d710 con 0x7fc43c102d40 2024-09-19T09:43:33.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc4337fe640 1 -- 172.21.15.42:0/2110499212 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c010ae0 con 0x7fc43c102d40 2024-09-19T09:43:33.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.795+0000 7fc440dba640 1 -- 172.21.15.42:0/2110499212 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc43c1008d0 con 0x7fc43c102d40 2024-09-19T09:43:33.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.798+0000 7fc4337fe640 1 -- 172.21.15.42:0/2110499212 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fc42c011b00 con 0x7fc43c102d40 2024-09-19T09:43:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.798+0000 7fc443193740 1 Processor -- start 2024-09-19T09:43:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.798+0000 7fc443193740 1 -- start start 2024-09-19T09:43:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.798+0000 7fc443193740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f4b40 0x5603192f3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.798+0000 7fc443193740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 0x5603192f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.798+0000 7fc443193740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 0x560319300760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc443193740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5603192592f0 con 0x5603192f4b40 2024-09-19T09:43:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc443193740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560319200cf0 con 0x5603192fe370 2024-09-19T09:43:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc443193740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5603192552b0 con 0x5603192f35d0 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f4b40 0x5603192f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f4b40 0x5603192f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38432/0 (socket says 172.21.15.42:38432) 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43ad9d640 1 -- 172.21.15.42:0/2353148863 learned_addr learned my addr 172.21.15.42:0/2353148863 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43a59c640 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 0x5603192f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc439d9b640 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 0x560319300760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc4337fe640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc4280a32c0 0x7fc4280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43ad9d640 1 -- 172.21.15.42:0/2353148863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 msgr2=0x5603192f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 0x5603192f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43ad9d640 1 -- 172.21.15.42:0/2353148863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 msgr2=0x560319300760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 0x560319300760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43ad9d640 1 -- 172.21.15.42:0/2353148863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603191e53a0 con 0x5603192f4b40 2024-09-19T09:43:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43a59c640 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 0x5603192f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc439d9b640 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 0x560319300760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc4337fe640 1 -- 172.21.15.42:0/2110499212 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc42c0cff50 con 0x7fc43c102d40 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc4280a32c0 0x7fc4280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.799+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f4b40 0x5603192f3090 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc43400b780 tx=0x7fc43400bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77f1e0a57217c12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc430ff9640 1 -- 172.21.15.42:0/2353148863 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434024070 con 0x5603192f4b40 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc430ff9640 1 -- 172.21.15.42:0/2353148863 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc43401e960 con 0x5603192f4b40 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc430ff9640 1 -- 172.21.15.42:0/2353148863 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434011860 con 0x5603192f4b40 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc443193740 1 -- 172.21.15.42:0/2353148863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f4b40 msgr2=0x5603192f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc4280a32c0 0x7fc4280a5780 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc434021000 tx=0x7fc43401e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc443193740 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f4b40 0x5603192f3090 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc43400b780 tx=0x7fc43400bc40 comp rx=0 tx=0).stop 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc443193740 1 -- 172.21.15.42:0/2353148863 shutdown_connections 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc443193740 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 0x560319300760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc443193740 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 0x5603192f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc443193740 1 --2- 172.21.15.42:0/2353148863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f4b40 0x5603192f3090 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.800+0000 7fc443193740 1 -- 172.21.15.42:0/2353148863 >> 172.21.15.42:0/2353148863 conn(0x5603192bc310 msgr2=0x5603192efc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 1 -- 172.21.15.42:0/2353148863 shutdown_connections 2024-09-19T09:43:33.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 1 -- 172.21.15.42:0/2353148863 wait complete. 2024-09-19T09:43:33.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 1 -- start start 2024-09-19T09:43:33.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 1 Processor -- start 2024-09-19T09:43:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f35d0 0x5603192fdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 0x5603192fb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 0x5603192fb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560319301070 con 0x5603192f35d0 2024-09-19T09:43:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560319214060 con 0x5603192fe370 2024-09-19T09:43:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5603193011f0 con 0x5603192f4b40 2024-09-19T09:43:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc443193740 10 client.0 _ll_register_callbacks cb 0x560318f678c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.801+0000 7fc43a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f35d0 0x5603192fdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc43a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f35d0 0x5603192fdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38448/0 (socket says 172.21.15.42:38448) 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc43a59c640 1 -- 172.21.15.42:0/2671336265 learned_addr learned my addr 172.21.15.42:0/2671336265 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 0x5603192fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc439d9b640 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 0x5603192fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc43a59c640 1 -- 172.21.15.42:0/2671336265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 msgr2=0x5603192fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc43a59c640 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 0x5603192fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc43a59c640 1 -- 172.21.15.42:0/2671336265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 msgr2=0x5603192fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc43a59c640 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 0x5603192fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc43a59c640 1 -- 172.21.15.42:0/2671336265 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560318fca3c0 con 0x5603192f35d0 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc439d9b640 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 0x5603192fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc43a59c640 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f35d0 0x5603192fdd80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc42c098ec0 tx=0x7fc42c010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3414a5c19fff27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc421ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc421ffb640 1 -- 172.21.15.42:0/2671336265 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c098790 con 0x5603192f35d0 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc421ffb640 1 -- 172.21.15.42:0/2671336265 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc42c09c750 con 0x5603192f35d0 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc443193740 1 -- 172.21.15.42:0/2671336265 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc43401e960 con 0x5603192f35d0 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc421ffb640 1 -- 172.21.15.42:0/2671336265 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc42c09cbf0 con 0x5603192f35d0 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc443193740 10 client.16899 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.802+0000 7fc443193740 1 -- 172.21.15.42:0/2671336265 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56031930cbf0 con 0x5603192f35d0 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.803+0000 7fc421ffb640 1 -- 172.21.15.42:0/2671336265 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc43401e960 con 0x5603192f35d0 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.803+0000 7fc421ffb640 1 -- 172.21.15.42:0/2671336265 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fc42c00f040 con 0x5603192f35d0 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.803+0000 7fc443193740 10 client.16899 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.803+0000 7fc443193740 10 client.16899 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.803+0000 7fc443193740 20 client.16899 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.803+0000 7fc443193740 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56031930e0b0 0x5603193104a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.803+0000 7fc443193740 4 client.16899 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.803+0000 7fc443193740 1 -- 172.21.15.42:0/2671336265 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560319266860 con 0x56031930e0b0 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.803+0000 7fc439d9b640 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56031930e0b0 0x5603193104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.804+0000 7fc439d9b640 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56031930e0b0 0x5603193104a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6dd37809758f4825 server_cookie=de9724122f2959a9 in_seq=0 out_seq=0 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.804+0000 7fc421ffb640 10 client.16899 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.804+0000 7fc421ffb640 1 -- 172.21.15.42:0/2671336265 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560319266860 con 0x56031930e0b0 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.804+0000 7fc421ffb640 10 client.16899 handle_command_reply: tid=0 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.804+0000 7fc443193740 1 client.16899 shutdown 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 1 -- 172.21.15.42:0/2671336265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f35d0 msgr2=0x5603192fdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f35d0 0x5603192fdd80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc42c098ec0 tx=0x7fc42c010490 comp rx=0 tx=0).stop 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 1 -- 172.21.15.42:0/2671336265 shutdown_connections 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x56031930e0b0 0x5603193104a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192fe370 0x5603192fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 0x5603192fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 1 --2- 172.21.15.42:0/2671336265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192f35d0 0x5603192fdd80 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 1 -- 172.21.15.42:0/2671336265 >> 172.21.15.42:0/2671336265 conn(0x5603192bc310 msgr2=0x5603192f5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc421ffb640 0 client.16899 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:43:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 1 -- 172.21.15.42:0/2671336265 shutdown_connections 2024-09-19T09:43:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 1 -- 172.21.15.42:0/2671336265 wait complete. 2024-09-19T09:43:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.805+0000 7fc443193740 20 client.16899 trim_cache size 0 max 16384 2024-09-19T09:43:33.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc443193740 1 Processor -- start 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc443193740 1 -- start start 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc443193740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 0x5603192efe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc443193740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192f4b40 0x56031930a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc443193740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x5603192f6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc443193740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c1af8e0 con 0x5603192fe370 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc443193740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c1b16c0 con 0x5603192f4b40 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc443193740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c1b0070 con 0x5603192f35d0 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc43ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x5603192f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc43ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x5603192f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38462/0 (socket says 172.21.15.42:38462) 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc43ad9d640 1 -- 172.21.15.42:0/3953204922 learned_addr learned my addr 172.21.15.42:0/3953204922 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc43a59c640 1 --2- 172.21.15.42:0/3953204922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 0x5603192efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc439d9b640 1 --2- 172.21.15.42:0/3953204922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192f4b40 0x56031930a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc43ad9d640 1 -- 172.21.15.42:0/3953204922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 msgr2=0x5603192efe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/3953204922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 0x5603192efe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc43ad9d640 1 -- 172.21.15.42:0/3953204922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192f4b40 msgr2=0x56031930a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/3953204922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192f4b40 0x56031930a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.818+0000 7fc43ad9d640 1 -- 172.21.15.42:0/3953204922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603192f32d0 con 0x5603192fe370 2024-09-19T09:43:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/3953204922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x5603192f6120 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc43400bf00 tx=0x7fc434011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cccc173fa2f9ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc423fff640 1 -- 172.21.15.42:0/3953204922 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434024040 con 0x5603192fe370 2024-09-19T09:43:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc423fff640 1 -- 172.21.15.42:0/3953204922 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc434005510 con 0x5603192fe370 2024-09-19T09:43:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc423fff640 1 -- 172.21.15.42:0/3953204922 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4340117d0 con 0x5603192fe370 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc443193740 1 -- 172.21.15.42:0/3953204922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 msgr2=0x5603192f6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc443193740 1 --2- 172.21.15.42:0/3953204922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x5603192f6120 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc43400bf00 tx=0x7fc434011440 comp rx=0 tx=0).stop 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc443193740 1 -- 172.21.15.42:0/3953204922 shutdown_connections 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc443193740 1 --2- 172.21.15.42:0/3953204922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x5603192f6120 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc443193740 1 --2- 172.21.15.42:0/3953204922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192f4b40 0x56031930a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc443193740 1 --2- 172.21.15.42:0/3953204922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f35d0 0x5603192efe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.819+0000 7fc443193740 1 -- 172.21.15.42:0/3953204922 >> 172.21.15.42:0/3953204922 conn(0x5603192bc310 msgr2=0x5603192ef700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 1 -- 172.21.15.42:0/3953204922 shutdown_connections 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 1 -- 172.21.15.42:0/3953204922 wait complete. 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 1 -- start start 2024-09-19T09:43:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 1 Processor -- start 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192f35d0 0x5603193710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 0x5603193715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x560319301a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c1b0f60 con 0x5603192fe370 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c1b0800 con 0x5603192f35d0 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c1ad8c0 con 0x5603192f4b40 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc443193740 10 client.0 _ll_register_callbacks cb 0x7fc42c011e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc43ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x560319301a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc43ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x560319301a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38476/0 (socket says 172.21.15.42:38476) 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc43ad9d640 1 -- 172.21.15.42:0/1650083299 learned_addr learned my addr 172.21.15.42:0/1650083299 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc43a59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192f35d0 0x5603193710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.820+0000 7fc439d9b640 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 0x5603193715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc43ad9d640 1 -- 172.21.15.42:0/1650083299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 msgr2=0x5603193715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 0x5603193715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc43ad9d640 1 -- 172.21.15.42:0/1650083299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192f35d0 msgr2=0x5603193710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192f35d0 0x5603193710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc43ad9d640 1 -- 172.21.15.42:0/1650083299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603192f0960 con 0x5603192fe370 2024-09-19T09:43:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc43ad9d640 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x560319301a20 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc434003da0 tx=0x7fc43400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4a8758e4d11f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc421ffb640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc421ffb640 1 -- 172.21.15.42:0/1650083299 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434036060 con 0x5603192fe370 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc421ffb640 1 -- 172.21.15.42:0/1650083299 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc434011540 con 0x5603192fe370 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc443193740 1 -- 172.21.15.42:0/1650083299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc434005510 con 0x5603192fe370 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc421ffb640 1 -- 172.21.15.42:0/1650083299 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc434024030 con 0x5603192fe370 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc443193740 10 client.16905 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc443193740 1 -- 172.21.15.42:0/1650083299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x560319378660 con 0x5603192fe370 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.821+0000 7fc421ffb640 1 -- 172.21.15.42:0/1650083299 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc434005510 con 0x5603192fe370 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.822+0000 7fc421ffb640 1 -- 172.21.15.42:0/1650083299 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7fc43401ece0 con 0x5603192fe370 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.822+0000 7fc443193740 10 client.16905 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.822+0000 7fc443193740 10 client.16905 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.822+0000 7fc443193740 20 client.16905 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.822+0000 7fc443193740 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x560319378bb0 0x56031937afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.822+0000 7fc443193740 4 client.16905 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:43:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.822+0000 7fc443193740 1 -- 172.21.15.42:0/1650083299 --> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560319260d70 con 0x560319378bb0 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.822+0000 7fc43a59c640 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x560319378bb0 0x56031937afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.822+0000 7fc43a59c640 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x560319378bb0 0x56031937afd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c8a39f1fb9e0211 server_cookie=3f5aa5a6b2f91b8f in_seq=0 out_seq=0 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.822+0000 7fc421ffb640 10 client.16905 ms_handle_connect on v2:172.21.15.136:6836/2776197166 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc421ffb640 1 -- 172.21.15.42:0/1650083299 <== mds.2 v2:172.21.15.136:6836/2776197166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560319260d70 con 0x560319378bb0 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc421ffb640 10 client.16905 handle_command_reply: tid=0 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 client.16905 shutdown 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 -- 172.21.15.42:0/1650083299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 msgr2=0x560319301a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x560319301a20 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc434003da0 tx=0x7fc43400be90 comp rx=0 tx=0).stop 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 -- 172.21.15.42:0/1650083299 shutdown_connections 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.136:6836/2776197166,v1:172.21.15.136:6837/2776197166] conn(0x560319378bb0 0x56031937afd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5603192fe370 0x560319301a20 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603192f4b40 0x5603193715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 --2- 172.21.15.42:0/1650083299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5603192f35d0 0x5603193710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 -- 172.21.15.42:0/1650083299 >> 172.21.15.42:0/1650083299 conn(0x5603192bc310 msgr2=0x5603192fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc421ffb640 0 client.16905 ms_handle_reset on v2:172.21.15.136:6836/2776197166 2024-09-19T09:43:33.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 -- 172.21.15.42:0/1650083299 shutdown_connections 2024-09-19T09:43:33.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 1 -- 172.21.15.42:0/1650083299 wait complete. 2024-09-19T09:43:33.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.823+0000 7fc443193740 20 client.16905 trim_cache size 0 max 16384 2024-09-19T09:43:33.831 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:43:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 -- 172.21.15.42:0/2110499212 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc4280a32c0 msgr2=0x7fc4280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc4280a32c0 0x7fc4280a5780 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc434021000 tx=0x7fc43401e000 comp rx=0 tx=0).stop 2024-09-19T09:43:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 -- 172.21.15.42:0/2110499212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc43c102d40 msgr2=0x7fc43c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc43c102d40 0x7fc43c198470 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00eab0 tx=0x7fc42c00ef70 comp rx=0 tx=0).stop 2024-09-19T09:43:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 -- 172.21.15.42:0/2110499212 shutdown_connections 2024-09-19T09:43:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fc4280a32c0 0x7fc4280a5780 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc43c10c170 0x7fc43c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc43c103660 0x7fc43c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 --2- 172.21.15.42:0/2110499212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc43c102d40 0x7fc43c198470 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 -- 172.21.15.42:0/2110499212 >> 172.21.15.42:0/2110499212 conn(0x7fc43c0fc7a0 msgr2=0x7fc43c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 -- 172.21.15.42:0/2110499212 shutdown_connections 2024-09-19T09:43:33.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:33.824+0000 7fc440dba640 1 -- 172.21.15.42:0/2110499212 wait complete. 2024-09-19T09:43:34.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:43:34.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:34 smithi171 ceph-mon[35803]: pgmap v464: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:34.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:34 smithi136 ceph-mon[34840]: pgmap v464: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:34.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:34 smithi042 ceph-mon[31223]: pgmap v464: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:43:35.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.394+0000 7f9adfa4e640 1 -- 172.21.15.42:0/2532358235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad81036c0 msgr2=0x7f9ad810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:35.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.394+0000 7f9adfa4e640 1 --2- 172.21.15.42:0/2532358235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad81036c0 0x7f9ad810bbb0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009900 tx=0x7f9ac802a480 comp rx=0 tx=0).stop 2024-09-19T09:43:35.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.394+0000 7f9adfa4e640 1 -- 172.21.15.42:0/2532358235 shutdown_connections 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.394+0000 7f9adfa4e640 1 --2- 172.21.15.42:0/2532358235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad810c180 0x7f9ad810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.394+0000 7f9adfa4e640 1 --2- 172.21.15.42:0/2532358235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad81036c0 0x7f9ad810bbb0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.394+0000 7f9adfa4e640 1 --2- 172.21.15.42:0/2532358235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad8102da0 0x7f9ad8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.394+0000 7f9adfa4e640 1 -- 172.21.15.42:0/2532358235 >> 172.21.15.42:0/2532358235 conn(0x7f9ad80fc7a0 msgr2=0x7f9ad80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.394+0000 7f9adfa4e640 1 -- 172.21.15.42:0/2532358235 shutdown_connections 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.394+0000 7f9adfa4e640 1 -- 172.21.15.42:0/2532358235 wait complete. 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9adfa4e640 1 Processor -- start 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9adfa4e640 1 -- start start 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9adfa4e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad8102da0 0x7f9ad819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9adfa4e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad81036c0 0x7f9ad819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9adfa4e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad810c180 0x7f9ad819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9adfa4e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad8111f60 con 0x7f9ad810c180 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9adfa4e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad8111de0 con 0x7f9ad81036c0 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9adfa4e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad81120e0 con 0x7f9ad8102da0 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9addfeb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad810c180 0x7f9ad819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9addfeb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad810c180 0x7f9ad819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38488/0 (socket says 172.21.15.42:38488) 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9addfeb640 1 -- 172.21.15.42:0/1159996561 learned_addr learned my addr 172.21.15.42:0/1159996561 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.395+0000 7f9add7ea640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad8102da0 0x7f9ad819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad81036c0 0x7f9ad819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9addfeb640 1 -- 172.21.15.42:0/1159996561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad8102da0 msgr2=0x7f9ad819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9addfeb640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad8102da0 0x7f9ad819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9addfeb640 1 -- 172.21.15.42:0/1159996561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad81036c0 msgr2=0x7f9ad819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9addfeb640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad81036c0 0x7f9ad819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9addfeb640 1 -- 172.21.15.42:0/1159996561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad819f610 con 0x7f9ad810c180 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad81036c0 0x7f9ad819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:43:35.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9addfeb640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad810c180 0x7f9ad819ef30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000eaa0 tx=0x7f9ad000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9ace7fc640 1 -- 172.21.15.42:0/1159996561 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000cdb0 con 0x7f9ad810c180 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9ace7fc640 1 -- 172.21.15.42:0/1159996561 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ad0005020 con 0x7f9ad810c180 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9adfa4e640 1 -- 172.21.15.42:0/1159996561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad819f900 con 0x7f9ad810c180 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9ace7fc640 1 -- 172.21.15.42:0/1159996561 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00116b0 con 0x7f9ad810c180 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.396+0000 7f9adfa4e640 1 -- 172.21.15.42:0/1159996561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad81a71e0 con 0x7f9ad810c180 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.398+0000 7f9ace7fc640 1 -- 172.21.15.42:0/1159996561 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9ad0005560 con 0x7f9ad810c180 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9ae1e27740 1 Processor -- start 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9ae1e27740 1 -- start start 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5559f95362f0 con 0x5559f95db370 2024-09-19T09:43:35.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5559f94ddcf0 con 0x5559f95d1b40 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5559f95322b0 con 0x5559f95d05d0 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9ace7fc640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac40a3240 0x7f9ac40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9adcfe9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9adcfe9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95dd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38496/0 (socket says 172.21.15.42:38496) 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9adcfe9640 1 -- 172.21.15.42:0/2674086898 learned_addr learned my addr 172.21.15.42:0/2674086898 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/2674086898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9addfeb640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac40a3240 0x7f9ac40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.399+0000 7f9add7ea640 1 --2- 172.21.15.42:0/2674086898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9ace7fc640 1 -- 172.21.15.42:0/1159996561 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f9ad00cfbc0 con 0x7f9ad810c180 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9adcfe9640 1 -- 172.21.15.42:0/2674086898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 msgr2=0x5559f95d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/2674086898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9adcfe9640 1 -- 172.21.15.42:0/2674086898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 msgr2=0x5559f95d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:35.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/2674086898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9adcfe9640 1 -- 172.21.15.42:0/2674086898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559f94c23a0 con 0x5559f95db370 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9addfeb640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac40a3240 0x7f9ac40a5700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0098b90 tx=0x7f9ad00916a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/2674086898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95dd760 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80057c0 tx=0x7f9ac8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104dd1bc88d3f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9ac37fe640 1 -- 172.21.15.42:0/2674086898 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8045070 con 0x5559f95db370 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9ac37fe640 1 -- 172.21.15.42:0/2674086898 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ac80035f0 con 0x5559f95db370 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.400+0000 7f9ac37fe640 1 -- 172.21.15.42:0/2674086898 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8035040 con 0x5559f95db370 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 -- 172.21.15.42:0/2674086898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 msgr2=0x5559f95dd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/2674086898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95dd760 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80057c0 tx=0x7f9ac8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 -- 172.21.15.42:0/2674086898 shutdown_connections 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/2674086898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95dd760 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/2674086898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/2674086898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 -- 172.21.15.42:0/2674086898 >> 172.21.15.42:0/2674086898 conn(0x5559f9599310 msgr2=0x5559f95ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 -- 172.21.15.42:0/2674086898 shutdown_connections 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 -- 172.21.15.42:0/2674086898 wait complete. 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 -- start start 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.401+0000 7f9ae1e27740 1 Processor -- start 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95dad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95d8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95d8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5559f95de010 con 0x5559f95db370 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5559f94f1060 con 0x5559f95d1b40 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5559f95de190 con 0x5559f95d05d0 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9ae1e27740 10 client.0 _ll_register_callbacks cb 0x5559f92448c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9adcfe9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95d8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9adcfe9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95d8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38504/0 (socket says 172.21.15.42:38504) 2024-09-19T09:43:35.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9adcfe9640 1 -- 172.21.15.42:0/1876881354 learned_addr learned my addr 172.21.15.42:0/1876881354 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9add7ea640 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95d8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95dad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9adcfe9640 1 -- 172.21.15.42:0/1876881354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 msgr2=0x5559f95dad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95dad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9adcfe9640 1 -- 172.21.15.42:0/1876881354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 msgr2=0x5559f95d8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95d8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.402+0000 7f9adcfe9640 1 -- 172.21.15.42:0/1876881354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559f92a73c0 con 0x5559f95db370 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95d8610 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8005c40 tx=0x7f9ac802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef7b434d4d1e9cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ac0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/1876881354 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac804e020 con 0x5559f95db370 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ae1e27740 1 -- 172.21.15.42:0/1876881354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ac80035f0 con 0x5559f95db370 2024-09-19T09:43:35.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/1876881354 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f9ac8003bb0 con 0x5559f95db370 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/1876881354 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f9ac8042070 con 0x5559f95db370 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ae1e27740 10 client.16917 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ae1e27740 1 -- 172.21.15.42:0/1876881354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5559f95e9ab0 con 0x5559f95db370 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/1876881354 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ac80035f0 con 0x5559f95db370 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/1876881354 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f9ac803a040 con 0x5559f95db370 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ae1e27740 10 client.16917 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ae1e27740 10 client.16917 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ae1e27740 20 client.16917 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5559f95eae00 0x5559f95ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ae1e27740 4 client.16917 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.403+0000 7f9ae1e27740 1 -- 172.21.15.42:0/1876881354 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559f9543860 con 0x5559f95eae00 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.404+0000 7f9add7ea640 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5559f95eae00 0x5559f95ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.404+0000 7f9add7ea640 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5559f95eae00 0x5559f95ed1f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=38fe9d2144024df2 server_cookie=e8bfbf5c665d671e in_seq=0 out_seq=0 2024-09-19T09:43:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.404+0000 7f9ac0ff9640 10 client.16917 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/1876881354 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559f9543860 con 0x5559f95eae00 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ac0ff9640 10 client.16917 handle_command_reply: tid=0 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 client.16917 shutdown 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 -- 172.21.15.42:0/1876881354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 msgr2=0x5559f95d8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95d8610 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8005c40 tx=0x7f9ac802a480 comp rx=0 tx=0).stop 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 -- 172.21.15.42:0/1876881354 shutdown_connections 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5559f95eae00 0x5559f95ed1f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95d8610 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95d8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/1876881354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95dad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 -- 172.21.15.42:0/1876881354 >> 172.21.15.42:0/1876881354 conn(0x5559f9599310 msgr2=0x5559f95d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ac0ff9640 0 client.16917 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:43:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 -- 172.21.15.42:0/1876881354 shutdown_connections 2024-09-19T09:43:35.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 1 -- 172.21.15.42:0/1876881354 wait complete. 2024-09-19T09:43:35.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.405+0000 7f9ae1e27740 20 client.16917 trim_cache size 0 max 16384 2024-09-19T09:43:35.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.418+0000 7f9ae1e27740 1 Processor -- start 2024-09-19T09:43:35.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.418+0000 7f9ae1e27740 1 -- start start 2024-09-19T09:43:35.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.418+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95d05d0 0x5559f95d7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.418+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95efe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.418+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95db370 0x5559f95f0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.418+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad81af910 con 0x5559f95d05d0 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad81b16f0 con 0x5559f95d1b40 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad81b00a0 con 0x5559f95db370 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9adcfe9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95d05d0 0x5559f95d7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9adcfe9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95d05d0 0x5559f95d7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38508/0 (socket says 172.21.15.42:38508) 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9adcfe9640 1 -- 172.21.15.42:0/4047933333 learned_addr learned my addr 172.21.15.42:0/4047933333 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/4047933333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95db370 0x5559f95f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9add7ea640 1 --2- 172.21.15.42:0/4047933333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9adcfe9640 1 -- 172.21.15.42:0/4047933333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95db370 msgr2=0x5559f95f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/4047933333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95db370 0x5559f95f0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9adcfe9640 1 -- 172.21.15.42:0/4047933333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 msgr2=0x5559f95efe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/4047933333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95efe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9adcfe9640 1 -- 172.21.15.42:0/4047933333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559f95da990 con 0x5559f95d05d0 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/4047933333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95d05d0 0x5559f95d7020 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9ac804a600 tx=0x7f9ac80317d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c87797af2556a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9ac2ffd640 1 -- 172.21.15.42:0/4047933333 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac804e040 con 0x5559f95d05d0 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9ac2ffd640 1 -- 172.21.15.42:0/4047933333 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ac80035f0 con 0x5559f95d05d0 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.419+0000 7f9ac2ffd640 1 -- 172.21.15.42:0/4047933333 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8035040 con 0x5559f95d05d0 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.420+0000 7f9ae1e27740 1 -- 172.21.15.42:0/4047933333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95d05d0 msgr2=0x5559f95d7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.420+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/4047933333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95d05d0 0x5559f95d7020 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9ac804a600 tx=0x7f9ac80317d0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.420+0000 7f9ae1e27740 1 -- 172.21.15.42:0/4047933333 shutdown_connections 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.420+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/4047933333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95db370 0x5559f95f0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.420+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/4047933333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95efe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.420+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/4047933333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95d05d0 0x5559f95d7020 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.420+0000 7f9ae1e27740 1 -- 172.21.15.42:0/4047933333 >> 172.21.15.42:0/4047933333 conn(0x5559f9599310 msgr2=0x5559f95d6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.420+0000 7f9ae1e27740 1 -- 172.21.15.42:0/4047933333 shutdown_connections 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.420+0000 7f9ae1e27740 1 -- 172.21.15.42:0/4047933333 wait complete. 2024-09-19T09:43:35.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9ae1e27740 1 -- start start 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9ae1e27740 1 Processor -- start 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95f0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9ae1e27740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95eddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad81b0f90 con 0x5559f95db370 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad81b0830 con 0x5559f95d1b40 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9ae1e27740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad81ad8f0 con 0x5559f95d05d0 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9ae1e27740 10 client.0 _ll_register_callbacks cb 0x7f9ac8032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9adcfe9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95eddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9adcfe9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95eddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38514/0 (socket says 172.21.15.42:38514) 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9adcfe9640 1 -- 172.21.15.42:0/511564668 learned_addr learned my addr 172.21.15.42:0/511564668 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.421+0000 7f9add7ea640 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9adcfe9640 1 -- 172.21.15.42:0/511564668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 msgr2=0x5559f95f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9adcfe9640 1 -- 172.21.15.42:0/511564668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 msgr2=0x5559f95ed8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95ed8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9adcfe9640 1 -- 172.21.15.42:0/511564668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559f95ee5f0 con 0x5559f95db370 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9add7ea640 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95ed8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9adcfe9640 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95eddf0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f9ac803ef40 tx=0x7f9ac8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b508ccee556c0f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9ac0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/511564668 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8069060 con 0x5559f95db370 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/511564668 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f9ac804add0 con 0x5559f95db370 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9ae1e27740 1 -- 172.21.15.42:0/511564668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ac80035f0 con 0x5559f95db370 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/511564668 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f9ac8035070 con 0x5559f95db370 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9ae1e27740 10 client.16923 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:35.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.422+0000 7f9ae1e27740 1 -- 172.21.15.42:0/511564668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5559f9655710 con 0x5559f95db370 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.423+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/511564668 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ac80035f0 con 0x5559f95db370 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.423+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/511564668 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f9ac803a030 con 0x5559f95db370 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.423+0000 7f9ae1e27740 10 client.16923 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.423+0000 7f9ae1e27740 10 client.16923 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.423+0000 7f9ae1e27740 20 client.16923 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.423+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5559f9655d70 0x5559f9658190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.423+0000 7f9ae1e27740 4 client.16923 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.423+0000 7f9ae1e27740 1 -- 172.21.15.42:0/511564668 --> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5559f953dd70 con 0x5559f9655d70 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.423+0000 7f9add7ea640 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5559f9655d70 0x5559f9658190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9add7ea640 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5559f9655d70 0x5559f9658190 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a03e3ab02a1b35c server_cookie=1e0ade0bbec4b3f0 in_seq=0 out_seq=0 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ac0ff9640 10 client.16923 ms_handle_connect on v2:172.21.15.171:6838/3148784527 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ac0ff9640 1 -- 172.21.15.42:0/511564668 <== mds.1 v2:172.21.15.171:6838/3148784527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5559f953dd70 con 0x5559f9655d70 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ac0ff9640 10 client.16923 handle_command_reply: tid=0 2024-09-19T09:43:35.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 client.16923 shutdown 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 -- 172.21.15.42:0/511564668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 msgr2=0x5559f95eddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95eddf0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f9ac803ef40 tx=0x7f9ac8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 -- 172.21.15.42:0/511564668 shutdown_connections 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.171:6838/3148784527,v1:172.21.15.171:6839/3148784527] conn(0x5559f9655d70 0x5559f9658190 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559f95db370 0x5559f95eddf0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559f95d1b40 0x5559f95ed8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 --2- 172.21.15.42:0/511564668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5559f95d05d0 0x5559f95f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 -- 172.21.15.42:0/511564668 >> 172.21.15.42:0/511564668 conn(0x5559f9599310 msgr2=0x5559f95d7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ac0ff9640 0 client.16923 ms_handle_reset on v2:172.21.15.171:6838/3148784527 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 -- 172.21.15.42:0/511564668 shutdown_connections 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 1 -- 172.21.15.42:0/511564668 wait complete. 2024-09-19T09:43:35.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.424+0000 7f9ae1e27740 20 client.16923 trim_cache size 0 max 16384 2024-09-19T09:43:35.433 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:43:35.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 -- 172.21.15.42:0/1159996561 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac40a3240 msgr2=0x7f9ac40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac40a3240 0x7f9ac40a5700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0098b90 tx=0x7f9ad00916a0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 -- 172.21.15.42:0/1159996561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad810c180 msgr2=0x7f9ad819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad810c180 0x7f9ad819ef30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000eaa0 tx=0x7f9ad000ef60 comp rx=0 tx=0).stop 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 -- 172.21.15.42:0/1159996561 shutdown_connections 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9ac40a3240 0x7f9ac40a5700 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ad810c180 0x7f9ad819ef30 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad81036c0 0x7f9ad819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 --2- 172.21.15.42:0/1159996561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad8102da0 0x7f9ad819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 -- 172.21.15.42:0/1159996561 >> 172.21.15.42:0/1159996561 conn(0x7f9ad80fc7a0 msgr2=0x7f9ad8101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 -- 172.21.15.42:0/1159996561 shutdown_connections 2024-09-19T09:43:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:35.425+0000 7f9adfa4e640 1 -- 172.21.15.42:0/1159996561 wait complete. 2024-09-19T09:43:36.257 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:43:36.515 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:36.715 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:36 smithi042 ceph-mon[31223]: pgmap v465: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:43:36.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:36 smithi171 ceph-mon[35803]: pgmap v465: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:43:36.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:36 smithi136 ceph-mon[34840]: pgmap v465: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.936+0000 7f33bde6f640 1 -- 172.21.15.42:0/370510452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33b8106a80 msgr2=0x7f33b8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.936+0000 7f33bde6f640 1 --2- 172.21.15.42:0/370510452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33b8106a80 0x7f33b8106e60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009930 tx=0x7f33a802a420 comp rx=0 tx=0).stop 2024-09-19T09:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.936+0000 7f33bde6f640 1 -- 172.21.15.42:0/370510452 shutdown_connections 2024-09-19T09:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.936+0000 7f33bde6f640 1 --2- 172.21.15.42:0/370510452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33b8101420 0x7f33b810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.936+0000 7f33bde6f640 1 --2- 172.21.15.42:0/370510452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33b8100a80 0x7f33b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.936+0000 7f33bde6f640 1 --2- 172.21.15.42:0/370510452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33b8106a80 0x7f33b8106e60 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.936+0000 7f33bde6f640 1 -- 172.21.15.42:0/370510452 >> 172.21.15.42:0/370510452 conn(0x7f33b80fc780 msgr2=0x7f33b80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.936+0000 7f33bde6f640 1 -- 172.21.15.42:0/370510452 shutdown_connections 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.936+0000 7f33bde6f640 1 -- 172.21.15.42:0/370510452 wait complete. 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33bde6f640 1 Processor -- start 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33bde6f640 1 -- start start 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33bde6f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33b8100a80 0x7f33b81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33bde6f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33b8101420 0x7f33b8199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33bde6f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33b8106a80 0x7f33b81a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33bde6f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f33b8110ea0 con 0x7f33b8106a80 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33bde6f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f33b8110d20 con 0x7f33b8101420 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33bde6f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f33b8111020 con 0x7f33b8100a80 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33b7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33b8106a80 0x7f33b81a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33b7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33b8106a80 0x7f33b81a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38540/0 (socket says 172.21.15.42:38540) 2024-09-19T09:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33b7fff640 1 -- 172.21.15.42:0/4040732911 learned_addr learned my addr 172.21.15.42:0/4040732911 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.937+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33b8101420 0x7f33b8199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b77fe640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33b8100a80 0x7f33b81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b7fff640 1 -- 172.21.15.42:0/4040732911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33b8100a80 msgr2=0x7f33b81993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b7fff640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33b8100a80 0x7f33b81993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b7fff640 1 -- 172.21.15.42:0/4040732911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33b8101420 msgr2=0x7f33b8199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b7fff640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33b8101420 0x7f33b8199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b7fff640 1 -- 172.21.15.42:0/4040732911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b81a4990 con 0x7f33b8106a80 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33b8101420 0x7f33b8199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b77fe640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33b8100a80 0x7f33b81993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b7fff640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33b8106a80 0x7f33b81a4450 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f33b000eaa0 tx=0x7f33b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b4ff9640 1 -- 172.21.15.42:0/4040732911 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b000cdb0 con 0x7f33b8106a80 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b4ff9640 1 -- 172.21.15.42:0/4040732911 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33b0005020 con 0x7f33b8106a80 2024-09-19T09:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33bde6f640 1 -- 172.21.15.42:0/4040732911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b81a4b60 con 0x7f33b8106a80 2024-09-19T09:43:36.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33b4ff9640 1 -- 172.21.15.42:0/4040732911 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b00116b0 con 0x7f33b8106a80 2024-09-19T09:43:36.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.938+0000 7f33bde6f640 1 -- 172.21.15.42:0/4040732911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b81a5020 con 0x7f33b8106a80 2024-09-19T09:43:36.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.940+0000 7f33b4ff9640 1 -- 172.21.15.42:0/4040732911 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f33b0005560 con 0x7f33b8106a80 2024-09-19T09:43:36.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33c0248740 1 Processor -- start 2024-09-19T09:43:36.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33c0248740 1 -- start start 2024-09-19T09:43:36.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33c0248740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda09090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33c0248740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda095d0 0x5630bda09a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33c0248740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda16760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33c0248740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5630bd96f2f0 con 0x5630bda14370 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33c0248740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5630bd916cf0 con 0x5630bda095d0 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33c0248740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5630bd96b2b0 con 0x5630bda0ab40 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda16760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda16760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38544/0 (socket says 172.21.15.42:38544) 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33b6ffd640 1 -- 172.21.15.42:0/3602115058 learned_addr learned my addr 172.21.15.42:0/3602115058 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33b4ff9640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f33a00a3240 0x7f33a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/3602115058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda09090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33b77fe640 1 --2- 172.21.15.42:0/3602115058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda095d0 0x5630bda09a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.941+0000 7f33b7fff640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f33a00a3240 0x7f33a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f33b6ffd640 1 -- 172.21.15.42:0/3602115058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 msgr2=0x5630bda09090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/3602115058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda09090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f33b6ffd640 1 -- 172.21.15.42:0/3602115058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda095d0 msgr2=0x5630bda09a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/3602115058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda095d0 0x5630bda09a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f33b6ffd640 1 -- 172.21.15.42:0/3602115058 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630bd8fb3a0 con 0x5630bda14370 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f33b4ff9640 1 -- 172.21.15.42:0/4040732911 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f33b00cfc30 con 0x7f33b8106a80 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/3602115058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda16760 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f33ac007ec0 tx=0x7f33ac007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c00b0a5d2a45d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f33b7fff640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f33a00a3240 0x7f33a00a5700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f33b0098690 tx=0x7f33b0096c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f339dffb640 1 -- 172.21.15.42:0/3602115058 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac01c070 con 0x5630bda14370 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f339dffb640 1 -- 172.21.15.42:0/3602115058 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ac010040 con 0x5630bda14370 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.942+0000 7f339dffb640 1 -- 172.21.15.42:0/3602115058 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0146b0 con 0x5630bda14370 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 -- 172.21.15.42:0/3602115058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 msgr2=0x5630bda16760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 --2- 172.21.15.42:0/3602115058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda16760 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f33ac007ec0 tx=0x7f33ac007420 comp rx=0 tx=0).stop 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 -- 172.21.15.42:0/3602115058 shutdown_connections 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 --2- 172.21.15.42:0/3602115058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda16760 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 --2- 172.21.15.42:0/3602115058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda095d0 0x5630bda09a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 --2- 172.21.15.42:0/3602115058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda09090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 -- 172.21.15.42:0/3602115058 >> 172.21.15.42:0/3602115058 conn(0x5630bd9d2310 msgr2=0x5630bda05c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 -- 172.21.15.42:0/3602115058 shutdown_connections 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 -- 172.21.15.42:0/3602115058 wait complete. 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 -- start start 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.943+0000 7f33c0248740 1 Processor -- start 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33c0248740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda095d0 0x5630bda13d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33c0248740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda11010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33c0248740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda11600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33c0248740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5630bda17070 con 0x5630bda14370 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33c0248740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5630bd92a060 con 0x5630bda095d0 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33c0248740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5630bda171f0 con 0x5630bda0ab40 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33c0248740 10 client.0 _ll_register_callbacks cb 0x5630bd67d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:36.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda11600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda11600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38560/0 (socket says 172.21.15.42:38560) 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33b6ffd640 1 -- 172.21.15.42:0/1539434042 learned_addr learned my addr 172.21.15.42:0/1539434042 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33b77fe640 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda11010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda095d0 0x5630bda13d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33b6ffd640 1 -- 172.21.15.42:0/1539434042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 msgr2=0x5630bda11010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda11010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33b6ffd640 1 -- 172.21.15.42:0/1539434042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda095d0 msgr2=0x5630bda13d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda095d0 0x5630bda13d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.944+0000 7f33b6ffd640 1 -- 172.21.15.42:0/1539434042 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630bd6e03c0 con 0x5630bda14370 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda11600 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00ffa0 tx=0x7f33ac0143b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c4822cf16b5e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f3396ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f3396ffd640 1 -- 172.21.15.42:0/1539434042 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac01c040 con 0x5630bda14370 2024-09-19T09:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f3396ffd640 1 -- 172.21.15.42:0/1539434042 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f33ac017ae0 con 0x5630bda14370 2024-09-19T09:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f33c0248740 1 -- 172.21.15.42:0/1539434042 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33ac010040 con 0x5630bda14370 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f3396ffd640 1 -- 172.21.15.42:0/1539434042 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f33ac0059c0 con 0x5630bda14370 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f33c0248740 10 client.16935 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f33c0248740 1 -- 172.21.15.42:0/1539434042 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5630bda22b40 con 0x5630bda14370 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f3396ffd640 1 -- 172.21.15.42:0/1539434042 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ac010040 con 0x5630bda14370 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f3396ffd640 1 -- 172.21.15.42:0/1539434042 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f33ac022070 con 0x5630bda14370 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f33c0248740 10 client.16935 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f33c0248740 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f33c0248740 20 client.16935 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.945+0000 7f33c0248740 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5630bda23ef0 0x5630bda262e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.946+0000 7f33c0248740 4 client.16935 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.946+0000 7f33c0248740 1 -- 172.21.15.42:0/1539434042 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630bd97c860 con 0x5630bda23ef0 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.946+0000 7f33b77fe640 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5630bda23ef0 0x5630bda262e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.946+0000 7f3396ffd640 10 client.16935 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.946+0000 7f33b77fe640 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5630bda23ef0 0x5630bda262e0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1285ceaa536f5170 server_cookie=621b36244893bf48 in_seq=0 out_seq=0 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f3396ffd640 1 -- 172.21.15.42:0/1539434042 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630bd97c860 con 0x5630bda23ef0 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f3396ffd640 10 client.16935 handle_command_reply: tid=0 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f33c0248740 1 client.16935 shutdown 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f33c0248740 1 -- 172.21.15.42:0/1539434042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 msgr2=0x5630bda11600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f33c0248740 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda11600 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00ffa0 tx=0x7f33ac0143b0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f33c0248740 1 -- 172.21.15.42:0/1539434042 shutdown_connections 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f33c0248740 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5630bda23ef0 0x5630bda262e0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f33c0248740 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda11600 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f33c0248740 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda11010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f3396ffd640 0 client.16935 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f33c0248740 1 --2- 172.21.15.42:0/1539434042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda095d0 0x5630bda13d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.947+0000 7f33c0248740 1 -- 172.21.15.42:0/1539434042 >> 172.21.15.42:0/1539434042 conn(0x5630bd9d2310 msgr2=0x5630bda0b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.948+0000 7f33c0248740 1 -- 172.21.15.42:0/1539434042 shutdown_connections 2024-09-19T09:43:36.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.948+0000 7f33c0248740 1 -- 172.21.15.42:0/1539434042 wait complete. 2024-09-19T09:43:36.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.948+0000 7f33c0248740 20 client.16935 trim_cache size 0 max 16384 2024-09-19T09:43:36.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.960+0000 7f33c0248740 1 Processor -- start 2024-09-19T09:43:36.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.960+0000 7f33c0248740 1 -- start start 2024-09-19T09:43:36.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33c0248740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda095d0 0x5630bda20340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33c0248740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda2ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33c0248740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda14370 0x5630bda2bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33c0248740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f33b81ad790 con 0x5630bda095d0 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33c0248740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f33b81af570 con 0x5630bda14370 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33c0248740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f33b81adf20 con 0x5630bda0ab40 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda095d0 0x5630bda20340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda095d0 0x5630bda20340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38572/0 (socket says 172.21.15.42:38572) 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33b6ffd640 1 -- 172.21.15.42:0/4165439993 learned_addr learned my addr 172.21.15.42:0/4165439993 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33b6ffd640 1 -- 172.21.15.42:0/4165439993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 msgr2=0x5630bda2ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33b77fe640 1 --2- 172.21.15.42:0/4165439993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda2ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/4165439993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda2ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33b6ffd640 1 -- 172.21.15.42:0/4165439993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda14370 msgr2=0x5630bda2bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/4165439993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda14370 0x5630bda2bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33b6ffd640 1 -- 172.21.15.42:0/4165439993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630bda140d0 con 0x5630bda095d0 2024-09-19T09:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.961+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/4165439993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda095d0 0x5630bda20340 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f33ac01a040 tx=0x7f33ac017770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927bdc89b9aabfb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f339d7fa640 1 -- 172.21.15.42:0/4165439993 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac01c040 con 0x5630bda095d0 2024-09-19T09:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f339d7fa640 1 -- 172.21.15.42:0/4165439993 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ac014e20 con 0x5630bda095d0 2024-09-19T09:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f339d7fa640 1 -- 172.21.15.42:0/4165439993 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac014740 con 0x5630bda095d0 2024-09-19T09:43:36.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f33c0248740 1 -- 172.21.15.42:0/4165439993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda095d0 msgr2=0x5630bda20340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f33c0248740 1 --2- 172.21.15.42:0/4165439993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda095d0 0x5630bda20340 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f33ac01a040 tx=0x7f33ac017770 comp rx=0 tx=0).stop 2024-09-19T09:43:36.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f33c0248740 1 -- 172.21.15.42:0/4165439993 shutdown_connections 2024-09-19T09:43:36.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f33c0248740 1 --2- 172.21.15.42:0/4165439993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda14370 0x5630bda2bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f33c0248740 1 --2- 172.21.15.42:0/4165439993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda0ab40 0x5630bda2ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f33c0248740 1 --2- 172.21.15.42:0/4165439993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda095d0 0x5630bda20340 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f33c0248740 1 -- 172.21.15.42:0/4165439993 >> 172.21.15.42:0/4165439993 conn(0x5630bd9d2310 msgr2=0x5630bda10100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f33c0248740 1 -- 172.21.15.42:0/4165439993 shutdown_connections 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.962+0000 7f33c0248740 1 -- 172.21.15.42:0/4165439993 wait complete. 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33c0248740 1 -- start start 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33c0248740 1 Processor -- start 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33c0248740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda095d0 0x5630bda182c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33c0248740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda0ab40 0x5630bda18800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33c0248740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda18d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33c0248740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f33b81aee10 con 0x5630bda14370 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33c0248740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f33b81ae6b0 con 0x5630bda0ab40 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33c0248740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f33b81ab770 con 0x5630bda095d0 2024-09-19T09:43:36.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33c0248740 10 client.0 _ll_register_callbacks cb 0x7f33ac01a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda18d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33b6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda18d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38584/0 (socket says 172.21.15.42:38584) 2024-09-19T09:43:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33b6ffd640 1 -- 172.21.15.42:0/2040108125 learned_addr learned my addr 172.21.15.42:0/2040108125 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33b77fe640 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda0ab40 0x5630bda18800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.963+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda095d0 0x5630bda182c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f33b6ffd640 1 -- 172.21.15.42:0/2040108125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda095d0 msgr2=0x5630bda182c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda095d0 0x5630bda182c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f33b6ffd640 1 -- 172.21.15.42:0/2040108125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda0ab40 msgr2=0x5630bda18800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda0ab40 0x5630bda18800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f33b6ffd640 1 -- 172.21.15.42:0/2040108125 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630bda8dad0 con 0x5630bda14370 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f33b6ffd640 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda18d40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f33ac010fb0 tx=0x7f33ac014fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff8bdf8271d8631 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f3396ffd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f3396ffd640 1 -- 172.21.15.42:0/2040108125 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00f9e0 con 0x5630bda14370 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f3396ffd640 1 -- 172.21.15.42:0/2040108125 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f33ac007120 con 0x5630bda14370 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f33c0248740 1 -- 172.21.15.42:0/2040108125 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33ac014e20 con 0x5630bda14370 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f3396ffd640 1 -- 172.21.15.42:0/2040108125 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f33ac04d050 con 0x5630bda14370 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f33c0248740 10 client.16941 fetch_fsmap learned FSMap version 38 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.964+0000 7f33c0248740 1 -- 172.21.15.42:0/2040108125 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5630bda8edb0 con 0x5630bda14370 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.965+0000 7f3396ffd640 1 -- 172.21.15.42:0/2040108125 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ac014e20 con 0x5630bda14370 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.965+0000 7f3396ffd640 1 -- 172.21.15.42:0/2040108125 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 38) ==== 8434+0+0 (secure 0 0 0) 0x7f33ac022040 con 0x5630bda14370 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.965+0000 7f33c0248740 10 client.16941 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.965+0000 7f33c0248740 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.965+0000 7f33c0248740 20 client.16941 populate_metadata read hostname 'smithi042' 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.965+0000 7f33c0248740 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5630bda8f410 0x5630bda91800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.965+0000 7f33c0248740 4 client.16941 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.965+0000 7f33c0248740 1 -- 172.21.15.42:0/2040108125 --> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630bd976d70 con 0x5630bda8f410 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.965+0000 7f33b77fe640 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5630bda8f410 0x5630bda91800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f3396ffd640 10 client.16941 ms_handle_connect on v2:172.21.15.136:6838/2003809688 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33b77fe640 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5630bda8f410 0x5630bda91800 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c41cae3f5d90932 server_cookie=512a14e07eda443f in_seq=0 out_seq=0 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f3396ffd640 1 -- 172.21.15.42:0/2040108125 <== mds.0 v2:172.21.15.136:6838/2003809688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630bd976d70 con 0x5630bda8f410 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f3396ffd640 10 client.16941 handle_command_reply: tid=0 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 client.16941 shutdown 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 -- 172.21.15.42:0/2040108125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 msgr2=0x5630bda18d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda18d40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f33ac010fb0 tx=0x7f33ac014fd0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 -- 172.21.15.42:0/2040108125 shutdown_connections 2024-09-19T09:43:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.136:6838/2003809688,v1:172.21.15.136:6839/2003809688] conn(0x5630bda8f410 0x5630bda91800 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5630bda14370 0x5630bda18d40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630bda0ab40 0x5630bda18800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 --2- 172.21.15.42:0/2040108125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630bda095d0 0x5630bda182c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 -- 172.21.15.42:0/2040108125 >> 172.21.15.42:0/2040108125 conn(0x5630bd9d2310 msgr2=0x5630bda12870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f3396ffd640 0 client.16941 ms_handle_reset on v2:172.21.15.136:6838/2003809688 2024-09-19T09:43:36.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 -- 172.21.15.42:0/2040108125 shutdown_connections 2024-09-19T09:43:36.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 1 -- 172.21.15.42:0/2040108125 wait complete. 2024-09-19T09:43:36.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.966+0000 7f33c0248740 20 client.16941 trim_cache size 0 max 16384 2024-09-19T09:43:36.973 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-19T09:43:36.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 -- 172.21.15.42:0/4040732911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f33a00a3240 msgr2=0x7f33a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f33a00a3240 0x7f33a00a5700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f33b0098690 tx=0x7f33b0096c60 comp rx=0 tx=0).stop 2024-09-19T09:43:36.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 -- 172.21.15.42:0/4040732911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33b8106a80 msgr2=0x7f33b81a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33b8106a80 0x7f33b81a4450 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f33b000eaa0 tx=0x7f33b000ef60 comp rx=0 tx=0).stop 2024-09-19T09:43:36.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 -- 172.21.15.42:0/4040732911 shutdown_connections 2024-09-19T09:43:36.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f33a00a3240 0x7f33a00a5700 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33b8106a80 0x7f33b81a4450 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33b8101420 0x7f33b8199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 --2- 172.21.15.42:0/4040732911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33b8100a80 0x7f33b81993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 -- 172.21.15.42:0/4040732911 >> 172.21.15.42:0/4040732911 conn(0x7f33b80fc780 msgr2=0x7f33b80fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 -- 172.21.15.42:0/4040732911 shutdown_connections 2024-09-19T09:43:36.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:36.967+0000 7f33bde6f640 1 -- 172.21.15.42:0/4040732911 wait complete. 2024-09-19T09:43:37.767 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T09:43:37.768 INFO:tasks.fwd_scrub:done joining 2024-09-19T09:43:37.768 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T09:43:37.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:43:37.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.889+0000 7fd86759e640 1 -- 172.21.15.42:0/3047714236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8681076b0 msgr2=0x7fd868109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:37.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.889+0000 7fd86759e640 1 --2- 172.21.15.42:0/3047714236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8681076b0 0x7fd868109ac0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd860009ca0 tx=0x7fd86002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:43:37.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.890+0000 7fd86759e640 1 -- 172.21.15.42:0/3047714236 shutdown_connections 2024-09-19T09:43:37.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.890+0000 7fd86759e640 1 --2- 172.21.15.42:0/3047714236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8681076b0 0x7fd868109ac0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:37.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.890+0000 7fd86759e640 1 --2- 172.21.15.42:0/3047714236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd868104d80 0x7fd868107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:37.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.890+0000 7fd86759e640 1 --2- 172.21.15.42:0/3047714236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd868102450 0x7fd868104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:37.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.890+0000 7fd86759e640 1 -- 172.21.15.42:0/3047714236 >> 172.21.15.42:0/3047714236 conn(0x7fd8680fbfb0 msgr2=0x7fd8680fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:37.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.890+0000 7fd86759e640 1 -- 172.21.15.42:0/3047714236 shutdown_connections 2024-09-19T09:43:37.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.890+0000 7fd86759e640 1 -- 172.21.15.42:0/3047714236 wait complete. 2024-09-19T09:43:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.890+0000 7fd86759e640 1 Processor -- start 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.890+0000 7fd86759e640 1 -- start start 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd86759e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd868102450 0x7fd868101dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd86759e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd868104d80 0x7fd868100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd86759e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8681076b0 0x7fd868100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd86759e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd86810d680 con 0x7fd868104d80 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd86759e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd86810d500 con 0x7fd8681076b0 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd86759e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd86810d800 con 0x7fd868102450 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd865d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd868104d80 0x7fd868100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd865d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd868104d80 0x7fd868100400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38598/0 (socket says 172.21.15.42:38598) 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd865d9b640 1 -- 172.21.15.42:0/724041780 learned_addr learned my addr 172.21.15.42:0/724041780 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd86659c640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd868102450 0x7fd868101dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd866d9d640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8681076b0 0x7fd868100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd865d9b640 1 -- 172.21.15.42:0/724041780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd868102450 msgr2=0x7fd868101dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd865d9b640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd868102450 0x7fd868101dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd865d9b640 1 -- 172.21.15.42:0/724041780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8681076b0 msgr2=0x7fd868100940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd865d9b640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8681076b0 0x7fd868100940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd865d9b640 1 -- 172.21.15.42:0/724041780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8681011d0 con 0x7fd868104d80 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd865d9b640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd868104d80 0x7fd868100400 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00d740 tx=0x7fd85c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd8577fe640 1 -- 172.21.15.42:0/724041780 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85c017070 con 0x7fd868104d80 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd8577fe640 1 -- 172.21.15.42:0/724041780 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd85c009820 con 0x7fd868104d80 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd86759e640 1 -- 172.21.15.42:0/724041780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8681a1dc0 con 0x7fd868104d80 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.891+0000 7fd8577fe640 1 -- 172.21.15.42:0/724041780 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85c004e00 con 0x7fd868104d80 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.892+0000 7fd86759e640 1 -- 172.21.15.42:0/724041780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8681a2230 con 0x7fd868104d80 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.892+0000 7fd86759e640 1 -- 172.21.15.42:0/724041780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8680fdaa0 con 0x7fd868104d80 2024-09-19T09:43:37.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.894+0000 7fd8577fe640 1 -- 172.21.15.42:0/724041780 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd85c0099d0 con 0x7fd868104d80 2024-09-19T09:43:37.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.894+0000 7fd8577fe640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8500a3250 0x7fd8500a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:37.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.894+0000 7fd86659c640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8500a3250 0x7fd8500a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:37.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.895+0000 7fd8577fe640 1 -- 172.21.15.42:0/724041780 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd85c0cf2e0 con 0x7fd868104d80 2024-09-19T09:43:37.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.895+0000 7fd86659c640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8500a3250 0x7fd8500a5710 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd85800abe0 tx=0x7fd85800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:37.899+0000 7fd8577fe640 1 -- 172.21.15.42:0/724041780 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd85c09bfe0 con 0x7fd868104d80 2024-09-19T09:43:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.078+0000 7fd86759e640 1 -- 172.21.15.42:0/724041780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd868062e90 con 0x7fd868104d80 2024-09-19T09:43:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.080+0000 7fd8577fe640 1 -- 172.21.15.42:0/724041780 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22852 (secure 0 0 0) 0x7fd85c09b8e0 con 0x7fd868104d80 2024-09-19T09:43:38.082 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:43:38.082 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:28.010101+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:43:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 -- 172.21.15.42:0/724041780 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8500a3250 msgr2=0x7fd8500a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8500a3250 0x7fd8500a5710 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd85800abe0 tx=0x7fd85800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 -- 172.21.15.42:0/724041780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd868104d80 msgr2=0x7fd868100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd868104d80 0x7fd868100400 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00d740 tx=0x7fd85c00db40 comp rx=0 tx=0).stop 2024-09-19T09:43:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 -- 172.21.15.42:0/724041780 shutdown_connections 2024-09-19T09:43:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fd8500a3250 0x7fd8500a5710 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8681076b0 0x7fd868100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd868104d80 0x7fd868100400 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 --2- 172.21.15.42:0/724041780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd868102450 0x7fd868101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 -- 172.21.15.42:0/724041780 >> 172.21.15.42:0/724041780 conn(0x7fd8680fbfb0 msgr2=0x7fd868102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 -- 172.21.15.42:0/724041780 shutdown_connections 2024-09-19T09:43:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.082+0000 7fd86759e640 1 -- 172.21.15.42:0/724041780 wait complete. 2024-09-19T09:43:38.095 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:32:44.950596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:37:07.882800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:37:09.916139+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:43:38.096 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:43:38.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.200+0000 7f9d4025e640 1 -- 172.21.15.42:0/3680077894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d38102d00 msgr2=0x7f9d38103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.200+0000 7f9d4025e640 1 --2- 172.21.15.42:0/3680077894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d38102d00 0x7f9d38103180 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009900 tx=0x7f9d3402a410 comp rx=0 tx=0).stop 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.200+0000 7f9d4025e640 1 -- 172.21.15.42:0/3680077894 shutdown_connections 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.200+0000 7f9d4025e640 1 --2- 172.21.15.42:0/3680077894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d381036c0 0x7f9d38109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.200+0000 7f9d4025e640 1 --2- 172.21.15.42:0/3680077894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d38102d00 0x7f9d38103180 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.200+0000 7f9d4025e640 1 --2- 172.21.15.42:0/3680077894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d38101b10 0x7f9d38101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.200+0000 7f9d4025e640 1 -- 172.21.15.42:0/3680077894 >> 172.21.15.42:0/3680077894 conn(0x7f9d380fd2b0 msgr2=0x7f9d380ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.201+0000 7f9d4025e640 1 -- 172.21.15.42:0/3680077894 shutdown_connections 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.201+0000 7f9d4025e640 1 -- 172.21.15.42:0/3680077894 wait complete. 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.201+0000 7f9d4025e640 1 Processor -- start 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.201+0000 7f9d4025e640 1 -- start start 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.201+0000 7f9d4025e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d38101b10 0x7f9d38197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.201+0000 7f9d4025e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d38102d00 0x7f9d381982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.201+0000 7f9d4025e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d381036c0 0x7f9d3819f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.201+0000 7f9d4025e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3810d770 con 0x7f9d38102d00 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.201+0000 7f9d4025e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3810d5f0 con 0x7f9d381036c0 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.201+0000 7f9d4025e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3810d8f0 con 0x7f9d38101b10 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3d7f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d38102d00 0x7f9d381982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3d7f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d38102d00 0x7f9d381982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38616/0 (socket says 172.21.15.42:38616) 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3d7f9640 1 -- 172.21.15.42:0/1094040027 learned_addr learned my addr 172.21.15.42:0/1094040027 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3dffa640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d38101b10 0x7f9d38197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3e7fb640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d381036c0 0x7f9d3819f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3d7f9640 1 -- 172.21.15.42:0/1094040027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d38101b10 msgr2=0x7f9d38197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3d7f9640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d38101b10 0x7f9d38197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3d7f9640 1 -- 172.21.15.42:0/1094040027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d381036c0 msgr2=0x7f9d3819f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3d7f9640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d381036c0 0x7f9d3819f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3d7f9640 1 -- 172.21.15.42:0/1094040027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3819f990 con 0x7f9d38102d00 2024-09-19T09:43:38.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d3d7f9640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d38102d00 0x7f9d381982b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009230 tx=0x7f9d34004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:38.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d2effd640 1 -- 172.21.15.42:0/1094040027 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3403f030 con 0x7f9d38102d00 2024-09-19T09:43:38.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d2effd640 1 -- 172.21.15.42:0/1094040027 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d34003ce0 con 0x7f9d38102d00 2024-09-19T09:43:38.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d4025e640 1 -- 172.21.15.42:0/1094040027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3819fc20 con 0x7f9d38102d00 2024-09-19T09:43:38.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d2effd640 1 -- 172.21.15.42:0/1094040027 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34035070 con 0x7f9d38102d00 2024-09-19T09:43:38.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.202+0000 7f9d4025e640 1 -- 172.21.15.42:0/1094040027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d381a0110 con 0x7f9d38102d00 2024-09-19T09:43:38.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.203+0000 7f9d4025e640 1 -- 172.21.15.42:0/1094040027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d38108e30 con 0x7f9d38102d00 2024-09-19T09:43:38.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.204+0000 7f9d2effd640 1 -- 172.21.15.42:0/1094040027 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9d34042030 con 0x7f9d38102d00 2024-09-19T09:43:38.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.205+0000 7f9d2effd640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d240a3250 0x7f9d240a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.205+0000 7f9d3dffa640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d240a3250 0x7f9d240a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.205+0000 7f9d2effd640 1 -- 172.21.15.42:0/1094040027 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f9d340f0100 con 0x7f9d38102d00 2024-09-19T09:43:38.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.206+0000 7f9d3dffa640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d240a3250 0x7f9d240a5710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9d38102b60 tx=0x7f9d28005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:38.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.209+0000 7f9d2effd640 1 -- 172.21.15.42:0/1094040027 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d340bcda0 con 0x7f9d38102d00 2024-09-19T09:43:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.388+0000 7f9d4025e640 1 -- 172.21.15.42:0/1094040027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9d38062df0 con 0x7f9d38102d00 2024-09-19T09:43:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.388+0000 7f9d2effd640 1 -- 172.21.15.42:0/1094040027 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f9d340bc6a0 con 0x7f9d38102d00 2024-09-19T09:43:38.390 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-19T09:43:38.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 -- 172.21.15.42:0/1094040027 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d240a3250 msgr2=0x7f9d240a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d240a3250 0x7f9d240a5710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9d38102b60 tx=0x7f9d28005f90 comp rx=0 tx=0).stop 2024-09-19T09:43:38.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 -- 172.21.15.42:0/1094040027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d38102d00 msgr2=0x7f9d381982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d38102d00 0x7f9d381982b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009230 tx=0x7f9d34004430 comp rx=0 tx=0).stop 2024-09-19T09:43:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 -- 172.21.15.42:0/1094040027 shutdown_connections 2024-09-19T09:43:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f9d240a3250 0x7f9d240a5710 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d381036c0 0x7f9d3819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d38102d00 0x7f9d381982b0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 --2- 172.21.15.42:0/1094040027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d38101b10 0x7f9d38197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 -- 172.21.15.42:0/1094040027 >> 172.21.15.42:0/1094040027 conn(0x7f9d380fd2b0 msgr2=0x7f9d38106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.390+0000 7f9d4025e640 1 -- 172.21.15.42:0/1094040027 shutdown_connections 2024-09-19T09:43:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.391+0000 7f9d4025e640 1 -- 172.21.15.42:0/1094040027 wait complete. 2024-09-19T09:43:38.403 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:43:38.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.508+0000 7fa051123640 1 -- 172.21.15.42:0/3696527253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa04c100a30 msgr2=0x7fa04c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.508+0000 7fa051123640 1 --2- 172.21.15.42:0/3696527253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa04c100a30 0x7fa04c100e30 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009900 tx=0x7fa03c02a410 comp rx=0 tx=0).stop 2024-09-19T09:43:38.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.508+0000 7fa051123640 1 -- 172.21.15.42:0/3696527253 shutdown_connections 2024-09-19T09:43:38.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.508+0000 7fa051123640 1 --2- 172.21.15.42:0/3696527253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa04c1025e0 0x7fa04c108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.508+0000 7fa051123640 1 --2- 172.21.15.42:0/3696527253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa04c101c20 0x7fa04c1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.508+0000 7fa051123640 1 --2- 172.21.15.42:0/3696527253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa04c100a30 0x7fa04c100e30 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.508+0000 7fa051123640 1 -- 172.21.15.42:0/3696527253 >> 172.21.15.42:0/3696527253 conn(0x7fa04c0fc1b0 msgr2=0x7fa04c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:38.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.508+0000 7fa051123640 1 -- 172.21.15.42:0/3696527253 shutdown_connections 2024-09-19T09:43:38.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.508+0000 7fa051123640 1 -- 172.21.15.42:0/3696527253 wait complete. 2024-09-19T09:43:38.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.509+0000 7fa051123640 1 Processor -- start 2024-09-19T09:43:38.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.509+0000 7fa051123640 1 -- start start 2024-09-19T09:43:38.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.509+0000 7fa051123640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa04c100a30 0x7fa04c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.509+0000 7fa051123640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa04c101c20 0x7fa04c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.509+0000 7fa051123640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa04c1025e0 0x7fa04c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa051123640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c10c6b0 con 0x7fa04c101c20 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa051123640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c10c530 con 0x7fa04c1025e0 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa051123640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c10c830 con 0x7fa04c100a30 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa04c101c20 0x7fa04c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa04c101c20 0x7fa04c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38638/0 (socket says 172.21.15.42:38638) 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04a59c640 1 -- 172.21.15.42:0/1490627594 learned_addr learned my addr 172.21.15.42:0/1490627594 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04b59e640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa04c1025e0 0x7fa04c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04ad9d640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa04c100a30 0x7fa04c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04a59c640 1 -- 172.21.15.42:0/1490627594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa04c100a30 msgr2=0x7fa04c197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04a59c640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa04c100a30 0x7fa04c197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04a59c640 1 -- 172.21.15.42:0/1490627594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa04c1025e0 msgr2=0x7fa04c19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04a59c640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa04c1025e0 0x7fa04c19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04a59c640 1 -- 172.21.15.42:0/1490627594 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04c19fb40 con 0x7fa04c101c20 2024-09-19T09:43:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa04a59c640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa04c101c20 0x7fa04c198460 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa04000d950 tx=0x7fa04000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa033fff640 1 -- 172.21.15.42:0/1490627594 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040017070 con 0x7fa04c101c20 2024-09-19T09:43:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa033fff640 1 -- 172.21.15.42:0/1490627594 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa040009c30 con 0x7fa04c101c20 2024-09-19T09:43:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa051123640 1 -- 172.21.15.42:0/1490627594 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04c19fe30 con 0x7fa04c101c20 2024-09-19T09:43:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa033fff640 1 -- 172.21.15.42:0/1490627594 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04000f6b0 con 0x7fa04c101c20 2024-09-19T09:43:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.510+0000 7fa051123640 1 -- 172.21.15.42:0/1490627594 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa04c1a02f0 con 0x7fa04c101c20 2024-09-19T09:43:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.511+0000 7fa051123640 1 -- 172.21.15.42:0/1490627594 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa04c1a0520 con 0x7fa04c101c20 2024-09-19T09:43:38.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.513+0000 7fa033fff640 1 -- 172.21.15.42:0/1490627594 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa0400109d0 con 0x7fa04c101c20 2024-09-19T09:43:38.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.514+0000 7fa033fff640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0340a3250 0x7fa0340a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.514+0000 7fa04ad9d640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0340a3250 0x7fa0340a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.514+0000 7fa033fff640 1 -- 172.21.15.42:0/1490627594 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa0400cf4c0 con 0x7fa04c101c20 2024-09-19T09:43:38.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.515+0000 7fa04ad9d640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0340a3250 0x7fa0340a5710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009230 tx=0x7fa03c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:38.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.517+0000 7fa033fff640 1 -- 172.21.15.42:0/1490627594 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa040009de0 con 0x7fa04c101c20 2024-09-19T09:43:38.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.693+0000 7fa051123640 1 -- 172.21.15.42:0/1490627594 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa04c1a06f0 con 0x7fa04c101c20 2024-09-19T09:43:38.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.694+0000 7fa033fff640 1 -- 172.21.15.42:0/1490627594 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7fa04009bb10 con 0x7fa04c101c20 2024-09-19T09:43:38.696 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 -- 172.21.15.42:0/1490627594 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0340a3250 msgr2=0x7fa0340a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0340a3250 0x7fa0340a5710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009230 tx=0x7fa03c0315b0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 -- 172.21.15.42:0/1490627594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa04c101c20 msgr2=0x7fa04c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa04c101c20 0x7fa04c198460 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa04000d950 tx=0x7fa04000de10 comp rx=0 tx=0).stop 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 -- 172.21.15.42:0/1490627594 shutdown_connections 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fa0340a3250 0x7fa0340a5710 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa04c1025e0 0x7fa04c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa04c101c20 0x7fa04c198460 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 --2- 172.21.15.42:0/1490627594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa04c100a30 0x7fa04c197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 -- 172.21.15.42:0/1490627594 >> 172.21.15.42:0/1490627594 conn(0x7fa04c0fc1b0 msgr2=0x7fa04c06a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:38.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 -- 172.21.15.42:0/1490627594 shutdown_connections 2024-09-19T09:43:38.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.696+0000 7fa051123640 1 -- 172.21.15.42:0/1490627594 wait complete. 2024-09-19T09:43:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:38 smithi042 ceph-mon[31223]: pgmap v466: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:38.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:38 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/724041780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:43:38.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:38 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1094040027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:43:38.709 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:43:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 -- 172.21.15.42:0/4253452447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84a8101bf0 msgr2=0x7f84a8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 --2- 172.21.15.42:0/4253452447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84a8101bf0 0x7f84a8102070 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8498009900 tx=0x7f849802a410 comp rx=0 tx=0).stop 2024-09-19T09:43:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 -- 172.21.15.42:0/4253452447 shutdown_connections 2024-09-19T09:43:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 --2- 172.21.15.42:0/4253452447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84a81025b0 0x7f84a8108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 --2- 172.21.15.42:0/4253452447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84a8101bf0 0x7f84a8102070 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 --2- 172.21.15.42:0/4253452447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84a8100a00 0x7f84a8100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 -- 172.21.15.42:0/4253452447 >> 172.21.15.42:0/4253452447 conn(0x7f84a80fc140 msgr2=0x7f84a80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 -- 172.21.15.42:0/4253452447 shutdown_connections 2024-09-19T09:43:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 -- 172.21.15.42:0/4253452447 wait complete. 2024-09-19T09:43:38.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 Processor -- start 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.814+0000 7f84b06d0640 1 -- start start 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84b06d0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84a8100a00 0x7f84a8104990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84b06d0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84a8101bf0 0x7f84a8102fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84b06d0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84a81025b0 0x7f84a8103510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84b06d0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84a810c680 con 0x7f84a8101bf0 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84b06d0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f84a810c500 con 0x7f84a8100a00 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84b06d0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f84a810c800 con 0x7f84a81025b0 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84adc6b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84a8101bf0 0x7f84a8102fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84adc6b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84a8101bf0 0x7f84a8102fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38654/0 (socket says 172.21.15.42:38654) 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84adc6b640 1 -- 172.21.15.42:0/2888427672 learned_addr learned my addr 172.21.15.42:0/2888427672 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84ae46c640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84a8100a00 0x7f84a8104990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84aec6d640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84a81025b0 0x7f84a8103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84adc6b640 1 -- 172.21.15.42:0/2888427672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84a81025b0 msgr2=0x7f84a8103510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84adc6b640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84a81025b0 0x7f84a8103510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84adc6b640 1 -- 172.21.15.42:0/2888427672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84a8100a00 msgr2=0x7f84a8104990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84adc6b640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84a8100a00 0x7f84a8104990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84adc6b640 1 -- 172.21.15.42:0/2888427672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a8103da0 con 0x7f84a8101bf0 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84aec6d640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84a81025b0 0x7f84a8103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84ae46c640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84a8100a00 0x7f84a8104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84adc6b640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84a8101bf0 0x7f84a8102fd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f8498009230 tx=0x7f8498004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f849f7fe640 1 -- 172.21.15.42:0/2888427672 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849803f030 con 0x7f84a8101bf0 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f849f7fe640 1 -- 172.21.15.42:0/2888427672 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8498003ce0 con 0x7f84a8101bf0 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84b06d0640 1 -- 172.21.15.42:0/2888427672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a81a1f20 con 0x7f84a8101bf0 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f849f7fe640 1 -- 172.21.15.42:0/2888427672 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8498035070 con 0x7f84a8101bf0 2024-09-19T09:43:38.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.815+0000 7f84b06d0640 1 -- 172.21.15.42:0/2888427672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a81a2380 con 0x7f84a8101bf0 2024-09-19T09:43:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.816+0000 7f84b06d0640 1 -- 172.21.15.42:0/2888427672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a81a2610 con 0x7f84a8101bf0 2024-09-19T09:43:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.818+0000 7f849f7fe640 1 -- 172.21.15.42:0/2888427672 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8498042030 con 0x7f84a8101bf0 2024-09-19T09:43:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.818+0000 7f849f7fe640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84940a3250 0x7f84940a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.818+0000 7f84ae46c640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84940a3250 0x7f84940a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.818+0000 7f849f7fe640 1 -- 172.21.15.42:0/2888427672 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f84980f0350 con 0x7f84a8101bf0 2024-09-19T09:43:38.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.819+0000 7f84ae46c640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84940a3250 0x7f84940a5710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f84a4005d00 tx=0x7f84a4005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:38.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.821+0000 7f849f7fe640 1 -- 172.21.15.42:0/2888427672 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84980bd050 con 0x7f84a8101bf0 2024-09-19T09:43:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:38 smithi171 ceph-mon[35803]: pgmap v466: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:38 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/724041780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:43:38.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:38 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1094040027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:43:38.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:38 smithi136 ceph-mon[34840]: pgmap v466: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:38.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:38 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/724041780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:43:38.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:38 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1094040027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:43:38.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.997+0000 7f84b06d0640 1 -- 172.21.15.42:0/2888427672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f84a81a2900 con 0x7f84a8101bf0 2024-09-19T09:43:38.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.997+0000 7f849f7fe640 1 -- 172.21.15.42:0/2888427672 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7f84980bc950 con 0x7f84a8101bf0 2024-09-19T09:43:38.999 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-09-19T09:43:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 -- 172.21.15.42:0/2888427672 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84940a3250 msgr2=0x7f84940a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84940a3250 0x7f84940a5710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f84a4005d00 tx=0x7f84a4005c90 comp rx=0 tx=0).stop 2024-09-19T09:43:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 -- 172.21.15.42:0/2888427672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84a8101bf0 msgr2=0x7f84a8102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84a8101bf0 0x7f84a8102fd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f8498009230 tx=0x7f8498004360 comp rx=0 tx=0).stop 2024-09-19T09:43:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 -- 172.21.15.42:0/2888427672 shutdown_connections 2024-09-19T09:43:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84940a3250 0x7f84940a5710 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84a81025b0 0x7f84a8103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84a8101bf0 0x7f84a8102fd0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 --2- 172.21.15.42:0/2888427672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84a8100a00 0x7f84a8104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 -- 172.21.15.42:0/2888427672 >> 172.21.15.42:0/2888427672 conn(0x7f84a80fc140 msgr2=0x7f84a80693b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:39.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 -- 172.21.15.42:0/2888427672 shutdown_connections 2024-09-19T09:43:39.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:38.999+0000 7f84b06d0640 1 -- 172.21.15.42:0/2888427672 wait complete. 2024-09-19T09:43:39.011 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T09:43:39.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 -- 172.21.15.42:0/3957805991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360104ee0 msgr2=0x7f93601072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 --2- 172.21.15.42:0/3957805991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360104ee0 0x7f93601072d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9350009900 tx=0x7f935002a410 comp rx=0 tx=0).stop 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 -- 172.21.15.42:0/3957805991 shutdown_connections 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 --2- 172.21.15.42:0/3957805991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9360107810 0x7f9360109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 --2- 172.21.15.42:0/3957805991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360104ee0 0x7f93601072d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 --2- 172.21.15.42:0/3957805991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93601025b0 0x7f93601049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 -- 172.21.15.42:0/3957805991 >> 172.21.15.42:0/3957805991 conn(0x7f93600fc1b0 msgr2=0x7f93600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 -- 172.21.15.42:0/3957805991 shutdown_connections 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 -- 172.21.15.42:0/3957805991 wait complete. 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 Processor -- start 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.113+0000 7f9367cd0640 1 -- start start 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9367cd0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93601025b0 0x7f9360101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:39.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9367cd0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360104ee0 0x7f9360100560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9367cd0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9360107810 0x7f9360100aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9367cd0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f936010d7e0 con 0x7f9360104ee0 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9367cd0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f936010d660 con 0x7f93601025b0 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9367cd0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f936010d960 con 0x7f9360107810 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f936526b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360104ee0 0x7f9360100560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f936526b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360104ee0 0x7f9360100560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38670/0 (socket says 172.21.15.42:38670) 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f936526b640 1 -- 172.21.15.42:0/3814499572 learned_addr learned my addr 172.21.15.42:0/3814499572 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f936626d640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9360107810 0x7f9360100aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9365a6c640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93601025b0 0x7f9360101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f936526b640 1 -- 172.21.15.42:0/3814499572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9360107810 msgr2=0x7f9360100aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f936526b640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9360107810 0x7f9360100aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f936526b640 1 -- 172.21.15.42:0/3814499572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93601025b0 msgr2=0x7f9360101f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f936526b640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93601025b0 0x7f9360101f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f936526b640 1 -- 172.21.15.42:0/3814499572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9360101330 con 0x7f9360104ee0 2024-09-19T09:43:39.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9365a6c640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93601025b0 0x7f9360101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:39.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f936526b640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360104ee0 0x7f9360100560 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9350031610 tx=0x7f93500043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:39.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9356ffd640 1 -- 172.21.15.42:0/3814499572 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935003f030 con 0x7f9360104ee0 2024-09-19T09:43:39.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9356ffd640 1 -- 172.21.15.42:0/3814499572 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9350003ce0 con 0x7f9360104ee0 2024-09-19T09:43:39.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.114+0000 7f9367cd0640 1 -- 172.21.15.42:0/3814499572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93601a1fb0 con 0x7f9360104ee0 2024-09-19T09:43:39.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.115+0000 7f9356ffd640 1 -- 172.21.15.42:0/3814499572 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350035070 con 0x7f9360104ee0 2024-09-19T09:43:39.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.115+0000 7f9367cd0640 1 -- 172.21.15.42:0/3814499572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93601a2410 con 0x7f9360104ee0 2024-09-19T09:43:39.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.116+0000 7f9367cd0640 1 -- 172.21.15.42:0/3814499572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93600fdca0 con 0x7f9360104ee0 2024-09-19T09:43:39.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.117+0000 7f9356ffd640 1 -- 172.21.15.42:0/3814499572 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9350042030 con 0x7f9360104ee0 2024-09-19T09:43:39.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.117+0000 7f9356ffd640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f934c0a3250 0x7f934c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:39.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.117+0000 7f9365a6c640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f934c0a3250 0x7f934c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:39.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.117+0000 7f9356ffd640 1 -- 172.21.15.42:0/3814499572 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f93500efe60 con 0x7f9360104ee0 2024-09-19T09:43:39.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.118+0000 7f9365a6c640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f934c0a3250 0x7f934c0a5710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f935c0058c0 tx=0x7f935c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:39.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.121+0000 7f9356ffd640 1 -- 172.21.15.42:0/3814499572 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f93500bcb60 con 0x7f9360104ee0 2024-09-19T09:43:39.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.350+0000 7f9367cd0640 1 -- 172.21.15.42:0/3814499572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f9360062ef0 con 0x7f9360104ee0 2024-09-19T09:43:39.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.358+0000 7f9356ffd640 1 -- 172.21.15.42:0/3814499572 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+742334 (secure 0 0 0) 0x7f93500bc460 con 0x7f9360104ee0 2024-09-19T09:43:39.370 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:43:39.370 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:43:39.370 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 20, 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: "active_gid": 14150, 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: "active_name": "x", 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: "active_addrs": { 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6800", 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 117232266 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-09-19T09:43:39.371 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6801", 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 117232266 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: "active_addr": "172.21.15.42:6801/117232266", 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: "active_change": "2024-09-19T09:30:26.412429+0000", 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: "available": true, 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: "standbys": [ 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: "gid": 24109, 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "z", 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:43:39.372 INFO:teuthology.orchestra.run.smithi042.stdout: "available_modules": [ 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "alerts", 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.377 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.378 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_destination": { 2024-09-19T09:43:39.379 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_destination", 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_from_name": { 2024-09-19T09:43:39.380 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_from_name", 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "Ceph", 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email From: name", 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_host": { 2024-09-19T09:43:39.381 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_host", 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP server", 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_password": { 2024-09-19T09:43:39.382 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_password", 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Password to authenticate with", 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_port": { 2024-09-19T09:43:39.383 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_port", 2024-09-19T09:43:39.384 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.384 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.384 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.384 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "465", 2024-09-19T09:43:39.385 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.385 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.385 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.385 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP port", 2024-09-19T09:43:39.385 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.385 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.385 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.385 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_sender": { 2024-09-19T09:43:39.385 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_sender", 2024-09-19T09:43:39.386 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.386 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.386 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.386 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.386 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.386 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.386 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.386 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:43:39.386 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.386 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_ssl": { 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_ssl", 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:43:39.387 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.388 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.388 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.388 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_user": { 2024-09-19T09:43:39.388 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_user", 2024-09-19T09:43:39.388 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.388 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.388 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.388 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "User to authenticate as", 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "balancer", 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.389 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "active": { 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "active", 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.390 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_time": { 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_time", 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0000", 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:43:39.391 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_weekday": { 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_weekday", 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:43:39.392 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_max_iterations": { 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "25", 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "250", 2024-09-19T09:43:39.393 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_metrics": { 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_metrics", 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.394 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_step": { 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_step", 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.5", 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0.001", 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "0.999", 2024-09-19T09:43:39.395 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "end_time": { 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_time", 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2359", 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.396 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "end_weekday": { 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_weekday", 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-09-19T09:43:39.397 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.398 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:43:39.398 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:43:39.398 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.398 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.398 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.398 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.398 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.398 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.398 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.399 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.400 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.402 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.403 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.403 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.403 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.403 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.403 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.403 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.403 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.403 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.403 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.403 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.404 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.404 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.404 INFO:teuthology.orchestra.run.smithi042.stdout: "min_score": { 2024-09-19T09:43:39.404 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_score", 2024-09-19T09:43:39.404 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.404 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.404 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.404 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-09-19T09:43:39.405 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "upmap", 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-compat", 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "none", 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "read", 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap", 2024-09-19T09:43:39.406 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap-read" 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Balancer mode", 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_ids": { 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_ids", 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.407 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.408 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.408 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.408 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:43:39.408 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.408 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.408 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.408 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:39.408 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:39.408 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_deviation": { 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_deviation", 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.409 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_optimizations": { 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:39.410 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.411 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm", 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_down_multiplier": { 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_down_multiplier", 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:43:39.412 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_refresh_rate": { 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_refresh_rate", 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "20", 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:43:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_starting_port": { 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_starting_port", 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4721", 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_ptrace": { 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_ptrace", 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_interval": { 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_interval", 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.7", 2024-09-19T09:43:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm_log_destination": { 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm_log_destination", 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "file", 2024-09-19T09:43:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "file,syslog", 2024-09-19T09:43:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "syslog" 2024-09-19T09:43:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:43:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "cgroups_split": { 2024-09-19T09:43:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cgroups_split", 2024-09-19T09:43:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "config_checks_enabled": { 2024-09-19T09:43:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_checks_enabled", 2024-09-19T09:43:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "config_dashboard": { 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_dashboard", 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_alertmanager": { 2024-09-19T09:43:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_alertmanager", 2024-09-19T09:43:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:43:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_base": { 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_base", 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:43:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_elasticsearch": { 2024-09-19T09:43:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:43:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:43:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "elasticsearch container image", 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_grafana": { 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_grafana", 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:43:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_haproxy": { 2024-09-19T09:43:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_haproxy", 2024-09-19T09:43:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "HAproxy container image", 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_agent": { 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:43:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:43:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_collector": { 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:43:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_query": { 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger query container image", 2024-09-19T09:43:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_keepalived": { 2024-09-19T09:43:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_keepalived", 2024-09-19T09:43:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:43:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Keepalived container image", 2024-09-19T09:43:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_loki": { 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_loki", 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Loki container image", 2024-09-19T09:43:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_node_exporter": { 2024-09-19T09:43:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_node_exporter", 2024-09-19T09:43:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_nvmeof": { 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_nvmeof", 2024-09-19T09:43:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Nvme-of container image", 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_prometheus": { 2024-09-19T09:43:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_prometheus", 2024-09-19T09:43:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:43:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_promtail": { 2024-09-19T09:43:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_promtail", 2024-09-19T09:43:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:43:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Promtail container image", 2024-09-19T09:43:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_samba": { 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_samba", 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_snmp_gateway": { 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "container_init": { 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_init", 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "daemon_cache_timeout": { 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "900", 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "default_registry": { 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_registry", 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io", 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "device_cache_timeout": { 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_cache_timeout", 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1800", 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "device_enhanced_scan": { 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_enhanced_scan", 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:43:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "facts_cache_timeout": { 2024-09-19T09:43:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "facts_cache_timeout", 2024-09-19T09:43:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:43:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "grafana_dashboards_path": { 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "host_check_interval": { 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "host_check_interval", 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:43:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "hw_monitoring": { 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hw_monitoring", 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:43:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "inventory_list_all": { 2024-09-19T09:43:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "inventory_list_all", 2024-09-19T09:43:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "log_refresh_metadata": { 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_refresh_metadata", 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:43:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "*", 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "max_count_per_host": { 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_count_per_host", 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd_draining_count": { 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_osd_draining_count", 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "migration_current": { 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "migration_current", 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "internal - do not modify", 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "root", 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm-package", 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "root" 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "oob_default_addr": { 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "oob_default_addr", 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "169.254.1.1", 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "prometheus_alerts_path": { 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_insecure": { 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_insecure", 2024-09-19T09:43:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_password": { 2024-09-19T09:43:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_password", 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_url": { 2024-09-19T09:43:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_url", 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_username": { 2024-09-19T09:43:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_username", 2024-09-19T09:43:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "secure_monitoring_stack": { 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "service_discovery_port": { 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "service_discovery_port", 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8765", 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "ssh_config_file": { 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssh_config_file", 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "use_agent": { 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_agent", 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "use_repo_digest": { 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_repo_digest", 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_failed_host_check": { 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_daemons": { 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_hosts": { 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crash", 2024-09-19T09:43:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "retain_interval": { 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retain_interval", 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "31536000", 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_recent_interval": { 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_recent_interval", 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1209600", 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dashboard", 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:43:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:43:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:43:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:43:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:43:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-09-19T09:43:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:43:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:43:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_URL": { 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:43:39.527 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.528 INFO:teuthology.orchestra.run.smithi042.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.529 INFO:teuthology.orchestra.run.smithi042.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.532 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.534 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.535 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.536 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.537 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.538 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.539 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.540 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.541 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.542 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.543 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8", 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.544 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "45", 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.545 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.546 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.547 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:43:39.548 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:43:39.549 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.550 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.550 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.550 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:39.550 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.550 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.550 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.550 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.550 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.550 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.551 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.553 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.553 INFO:teuthology.orchestra.run.smithi042.stdout: "cross_origin_url": { 2024-09-19T09:43:39.553 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cross_origin_url", 2024-09-19T09:43:39.553 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.553 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.553 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.553 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.553 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "crt_file": { 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crt_file", 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.554 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "debug": { 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "debug", 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.555 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.556 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.556 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.556 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.556 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.556 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:43:39.556 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.556 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.556 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.556 INFO:teuthology.orchestra.run.smithi042.stdout: "jwt_token_ttl": { 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "jwt_token_ttl", 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "28800", 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.558 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-09-19T09:43:39.558 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-09-19T09:43:39.558 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.558 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.558 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.558 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.558 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.559 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.560 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.560 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.560 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.560 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.560 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.560 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.560 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.560 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.560 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.560 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.561 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.562 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.563 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.564 INFO:teuthology.orchestra.run.smithi042.stdout: "motd": { 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "motd", 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "The message of the day", 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.566 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.567 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8080", 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.568 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.569 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl_server_port": { 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl_server_port", 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8443", 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.570 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "redirect", 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.571 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect" 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.572 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "url_prefix": { 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url_prefix", 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.573 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.574 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_monitoring": { 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_monitoring", 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "monitor device health metrics", 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.575 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.576 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.577 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.578 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.580 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "mark_out_threshold": { 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mark_out_threshold", 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2419200", 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.581 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": { 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_name", 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "device_health_metrics", 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.582 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "retention_period": { 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retention_period", 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15552000", 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.583 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_frequency": { 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_frequency", 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-09-19T09:43:39.584 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "self_heal": { 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "self_heal", 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.585 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.586 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_threshold": { 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_threshold", 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.587 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7257600", 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.588 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "diskprediction_local", 2024-09-19T09:43:39.589 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.589 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.589 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.589 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.589 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.589 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.589 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.589 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.589 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.589 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.590 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.591 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.592 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.593 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "predict_interval": { 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predict_interval", 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.594 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "predictor_model": { 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predictor_model", 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.595 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "prophetstor", 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.596 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "influx", 2024-09-19T09:43:39.597 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": false, 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "batch_size": { 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "batch_size", 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5000", 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:43:39.598 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "database": { 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "database", 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "ceph", 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.599 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": { 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hostname", 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.600 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "30", 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "5", 2024-09-19T09:43:39.601 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.602 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.603 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.605 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.606 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "password": { 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "password", 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "port": { 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "port", 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.608 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8086", 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server port", 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "false", 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "threads": { 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threads", 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "32", 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "username": { 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "username", 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "verify_ssl": { 2024-09-19T09:43:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "verify_ssl", 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "true", 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.614 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.614 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "insights", 2024-09-19T09:43:39.614 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.614 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.614 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.614 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.614 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.614 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.615 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.616 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.617 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.618 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.619 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "iostat", 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.622 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.623 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.624 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.625 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.626 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "k8sevents", 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_event_retention_days": { 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7", 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:43:39.627 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "config_check_secs": { 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_check_secs", 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "10", 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.628 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.629 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.630 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.631 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.632 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.633 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "localpool", 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "failure_domain": { 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "failure_domain", 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "host", 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.635 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.636 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.637 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.638 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.640 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": { 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_size", 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.641 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "num_rep": { 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "num_rep", 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3", 2024-09-19T09:43:39.642 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": { 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_num", 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.643 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "128", 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "prefix": { 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prefix", 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.644 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "subtree": { 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "subtree", 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.645 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "rack", 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mds_autoscaler", 2024-09-19T09:43:39.646 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.647 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.648 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.649 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.650 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.652 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirroring", 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.653 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.654 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.656 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.658 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "nfs", 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.659 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.660 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.661 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.662 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.664 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: "fail_fs": { 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "fail_fs", 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.665 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.670 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator": { 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.671 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rook", 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "test_orchestrator" 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Orchestrator backend", 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.672 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_perf_query", 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.673 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.674 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.675 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.676 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.677 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_support", 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.679 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.680 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.681 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.682 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.683 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_autoscaler", 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.684 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.685 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.686 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.687 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.688 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.689 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.689 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.689 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.689 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.689 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.689 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.689 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.689 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "threshold": { 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threshold", 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-09-19T09:43:39.691 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1.0", 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "scaling threshold", 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "progress", 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.692 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_pg_recovery_event": { 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.693 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.694 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.696 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.697 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.698 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.699 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "max_completed_events": { 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_completed_events", 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "50", 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:43:39.700 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.701 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus", 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: "cache": { 2024-09-19T09:43:39.702 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cache", 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "exclude_perf_counters": { 2024-09-19T09:43:39.703 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "exclude_perf_counters", 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.704 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.705 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.706 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.707 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.708 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.709 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools": { 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools", 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.710 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "300", 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.711 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_interval": { 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_interval", 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15.0", 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.712 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.713 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:43:39.714 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.714 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.714 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.714 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-09-19T09:43:39.714 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-09-19T09:43:39.714 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.714 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.714 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.714 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "9283", 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "stale_cache_strategy": { 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stale_cache_strategy", 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.715 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "log", 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-09-19T09:43:39.716 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "default", 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "default", 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "error" 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.718 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.719 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.720 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.720 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.720 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.720 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.720 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.720 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.720 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.720 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.721 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.722 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.723 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.724 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_snap_create": { 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.725 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.726 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "trash_purge_schedule": { 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "trash_purge_schedule", 2024-09-19T09:43:39.727 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "restful", 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_auth": { 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_auth", 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.729 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.730 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.731 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.731 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.731 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.731 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.731 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.731 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.731 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.731 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.732 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.733 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.734 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.735 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.736 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.737 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.738 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rgw", 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.739 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.742 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.743 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.744 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rook", 2024-09-19T09:43:39.745 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.746 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.747 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.748 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.749 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.750 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "storage_class": { 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "storage_class", 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "local", 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.751 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "selftest", 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.752 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.753 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.754 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.755 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.756 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.757 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "roption1": { 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption1", 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.758 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "roption2": { 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption2", 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "xyz", 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.759 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption1": { 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption1", 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.760 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption2": { 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption2", 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.761 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption3": { 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption3", 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.762 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption4": { 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption4", 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.763 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption5": { 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption5", 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.764 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption6": { 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption6", 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption7": { 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption7", 2024-09-19T09:43:39.766 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "42", 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "testkey": { 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testkey", 2024-09-19T09:43:39.767 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "testlkey": { 2024-09-19T09:43:39.768 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testlkey", 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "testnewline": { 2024-09-19T09:43:39.769 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testnewline", 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.770 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_m_granularity": { 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_m_granularity", 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.771 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "dump_on_update": { 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dump_on_update", 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.772 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.773 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.774 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.775 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.775 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.775 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.775 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.775 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.775 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.775 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.775 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.775 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.776 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.776 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.776 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.776 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.776 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.776 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.776 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.776 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.776 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.777 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.778 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stats", 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.779 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.780 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.781 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.782 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.783 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.784 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "status", 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.785 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.788 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.790 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telegraf", 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: "address": { 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "address", 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.792 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15", 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.793 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.794 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.795 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telemetry", 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_basic": { 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_basic", 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.799 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_crash": { 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_crash", 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.800 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_device": { 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_device", 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.801 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_ident": { 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_ident", 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.802 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_perf": { 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_perf", 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.803 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "contact": { 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "contact", 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.804 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "description": { 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "description", 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.805 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "device_url": { 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_url", 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.806 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.807 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.808 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "24", 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "8", 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "last_opt_revision": { 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "last_opt_revision", 2024-09-19T09:43:39.809 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1", 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard": { 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard", 2024-09-19T09:43:39.810 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard_description": { 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard_description", 2024-09-19T09:43:39.811 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.812 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.813 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.814 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.814 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.814 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.814 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.814 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.814 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.814 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.814 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.815 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.816 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.817 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "organization": { 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "organization", 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.818 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "proxy": { 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "proxy", 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.819 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.820 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.820 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.820 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.820 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.820 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.820 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.820 INFO:teuthology.orchestra.run.smithi042.stdout: "url": { 2024-09-19T09:43:39.820 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url", 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.821 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "test_orchestrator", 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.822 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.823 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.824 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.825 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.826 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.830 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.831 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.832 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.832 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.832 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.832 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.832 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.832 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.832 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_clones": { 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_clones", 2024-09-19T09:43:39.833 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4", 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.834 INFO:teuthology.orchestra.run.smithi042.stdout: "periodic_async_work": { 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "periodic_async_work", 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Periodically check for async work", 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.835 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_delay": { 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.836 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.837 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix", 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: "discovery_interval": { 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "discovery_interval", 2024-09-19T09:43:39.838 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "100", 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "identifier": { 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "identifier", 2024-09-19T09:43:39.839 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.840 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.840 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.840 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.840 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.840 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.840 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.840 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.840 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.840 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.841 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.841 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:39.841 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:39.841 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.841 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.841 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.841 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:39.841 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.841 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.843 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.843 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.843 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.843 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.843 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.843 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.843 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.843 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.844 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.845 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.846 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.846 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.846 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.846 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.847 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.848 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_host": { 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_host", 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.849 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_port": { 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_port", 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.850 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.851 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10051", 2024-09-19T09:43:39.851 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.851 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.851 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.851 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.851 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.851 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.851 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.852 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_sender": { 2024-09-19T09:43:39.852 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_sender", 2024-09-19T09:43:39.852 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.852 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.852 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.852 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:43:39.852 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.852 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.853 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.853 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.853 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.853 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.853 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.853 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.853 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.853 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.853 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-19T09:43:39.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.856 INFO:teuthology.orchestra.run.smithi042.stdout: "gid": 24116, 2024-09-19T09:43:39.856 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "y", 2024-09-19T09:43:39.856 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:43:39.856 INFO:teuthology.orchestra.run.smithi042.stdout: "available_modules": [ 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "alerts", 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.857 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.860 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.861 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.862 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.862 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.862 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.862 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.862 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.862 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.862 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.862 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.863 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_destination": { 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_destination", 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.864 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_from_name": { 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_from_name", 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "Ceph", 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email From: name", 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.865 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_host": { 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_host", 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP server", 2024-09-19T09:43:39.866 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_password": { 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_password", 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Password to authenticate with", 2024-09-19T09:43:39.867 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_port": { 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_port", 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "465", 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP port", 2024-09-19T09:43:39.868 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_sender": { 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_sender", 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.869 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_ssl": { 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_ssl", 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.870 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_user": { 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_user", 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.871 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "User to authenticate as", 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "balancer", 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.872 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "active": { 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "active", 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_time": { 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_time", 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0000", 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.874 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_weekday": { 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_weekday", 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.875 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_max_iterations": { 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "25", 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "250", 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.876 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_metrics": { 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_metrics", 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:43:39.877 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_step": { 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_step", 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.5", 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0.001", 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "0.999", 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:43:39.878 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "end_time": { 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_time", 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2359", 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:43:39.879 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "end_weekday": { 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_weekday", 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:43:39.880 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:43:39.881 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.881 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.881 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.882 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.883 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.884 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.884 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.884 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.884 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.884 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.884 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.884 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.884 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.884 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.885 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.886 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.887 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.887 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.887 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.887 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.887 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.887 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.887 INFO:teuthology.orchestra.run.smithi042.stdout: "min_score": { 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_score", 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.888 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.889 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.889 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-09-19T09:43:39.889 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-09-19T09:43:39.889 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.889 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.889 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.889 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "upmap", 2024-09-19T09:43:39.890 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.890 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.890 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.890 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-compat", 2024-09-19T09:43:39.890 INFO:teuthology.orchestra.run.smithi042.stdout: "none", 2024-09-19T09:43:39.890 INFO:teuthology.orchestra.run.smithi042.stdout: "read", 2024-09-19T09:43:39.890 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap", 2024-09-19T09:43:39.891 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap-read" 2024-09-19T09:43:39.891 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.891 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Balancer mode", 2024-09-19T09:43:39.891 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.891 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.891 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.891 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_ids": { 2024-09-19T09:43:39.891 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_ids", 2024-09-19T09:43:39.891 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.892 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.893 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_deviation": { 2024-09-19T09:43:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_deviation", 2024-09-19T09:43:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_optimizations": { 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.895 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm", 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.896 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.897 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_down_multiplier": { 2024-09-19T09:43:39.897 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_down_multiplier", 2024-09-19T09:43:39.897 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.897 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.897 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.897 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-09-19T09:43:39.897 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.897 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.897 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_refresh_rate": { 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_refresh_rate", 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "20", 2024-09-19T09:43:39.898 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_starting_port": { 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_starting_port", 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4721", 2024-09-19T09:43:39.899 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_ptrace": { 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_ptrace", 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.900 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.901 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.901 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.901 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.901 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.901 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.901 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:43:39.901 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:43:39.901 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_interval": { 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_interval", 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.902 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.7", 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:43:39.903 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm_log_destination": { 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm_log_destination", 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.904 INFO:teuthology.orchestra.run.smithi042.stdout: "file", 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "file,syslog", 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "syslog" 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "cgroups_split": { 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cgroups_split", 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.905 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "config_checks_enabled": { 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_checks_enabled", 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.906 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.907 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.907 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.907 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.907 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:43:39.907 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.907 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.907 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.907 INFO:teuthology.orchestra.run.smithi042.stdout: "config_dashboard": { 2024-09-19T09:43:39.908 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_dashboard", 2024-09-19T09:43:39.908 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.908 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.908 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.908 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_alertmanager": { 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_alertmanager", 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_base": { 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_base", 2024-09-19T09:43:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.911 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.911 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.911 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:43:39.911 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.911 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.911 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.911 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_elasticsearch": { 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.912 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "elasticsearch container image", 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_grafana": { 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_grafana", 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:43:39.913 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.914 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.914 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.914 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:39.914 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.914 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.914 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.914 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_haproxy": { 2024-09-19T09:43:39.914 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_haproxy", 2024-09-19T09:43:39.914 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "HAproxy container image", 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_agent": { 2024-09-19T09:43:39.915 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.916 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_collector": { 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.918 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_query": { 2024-09-19T09:43:39.918 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:43:39.918 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.918 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.918 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.918 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:43:39.918 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.918 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.919 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.919 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger query container image", 2024-09-19T09:43:39.919 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.919 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.919 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.919 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_keepalived": { 2024-09-19T09:43:39.919 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_keepalived", 2024-09-19T09:43:39.919 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.919 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:43:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Keepalived container image", 2024-09-19T09:43:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_loki": { 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_loki", 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Loki container image", 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_node_exporter": { 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_node_exporter", 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.924 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.924 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.924 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_nvmeof": { 2024-09-19T09:43:39.924 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_nvmeof", 2024-09-19T09:43:39.924 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.924 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.924 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.924 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Nvme-of container image", 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_prometheus": { 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_prometheus", 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.925 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_promtail": { 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_promtail", 2024-09-19T09:43:39.926 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Promtail container image", 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_samba": { 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_samba", 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.928 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.929 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.929 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_snmp_gateway": { 2024-09-19T09:43:39.929 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:43:39.929 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.929 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.929 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.929 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:43:39.929 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.929 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: "container_init": { 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_init", 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.930 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.931 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.931 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.931 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.931 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.931 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:43:39.931 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.931 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.931 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.931 INFO:teuthology.orchestra.run.smithi042.stdout: "daemon_cache_timeout": { 2024-09-19T09:43:39.932 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:43:39.932 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.932 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.932 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.932 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:39.932 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.932 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.932 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.932 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:43:39.932 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "900", 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.933 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.934 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.934 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:43:39.934 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.934 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.934 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.934 INFO:teuthology.orchestra.run.smithi042.stdout: "default_registry": { 2024-09-19T09:43:39.934 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_registry", 2024-09-19T09:43:39.934 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.934 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.935 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.935 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io", 2024-09-19T09:43:39.935 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.935 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.935 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.935 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:43:39.935 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.935 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.935 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.936 INFO:teuthology.orchestra.run.smithi042.stdout: "device_cache_timeout": { 2024-09-19T09:43:39.936 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_cache_timeout", 2024-09-19T09:43:39.936 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.936 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.936 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.936 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1800", 2024-09-19T09:43:39.936 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.936 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "device_enhanced_scan": { 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_enhanced_scan", 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.937 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "facts_cache_timeout": { 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "facts_cache_timeout", 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.938 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "grafana_dashboards_path": { 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.939 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "host_check_interval": { 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "host_check_interval", 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.940 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "hw_monitoring": { 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hw_monitoring", 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.941 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "inventory_list_all": { 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "inventory_list_all", 2024-09-19T09:43:39.942 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:43:39.943 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.945 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "log_refresh_metadata": { 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_refresh_metadata", 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.946 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.947 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.948 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.951 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "*", 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.952 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "max_count_per_host": { 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_count_per_host", 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.953 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd_draining_count": { 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_osd_draining_count", 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.954 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "migration_current": { 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "migration_current", 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "internal - do not modify", 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.955 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "root", 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm-package", 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: "root" 2024-09-19T09:43:39.956 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "oob_default_addr": { 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "oob_default_addr", 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "169.254.1.1", 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.957 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "prometheus_alerts_path": { 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.958 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_insecure": { 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_insecure", 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.959 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_password": { 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_password", 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.960 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_url": { 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_url", 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.961 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_username": { 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_username", 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.962 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "secure_monitoring_stack": { 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:43:39.963 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "service_discovery_port": { 2024-09-19T09:43:39.964 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "service_discovery_port", 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8765", 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.965 INFO:teuthology.orchestra.run.smithi042.stdout: "ssh_config_file": { 2024-09-19T09:43:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssh_config_file", 2024-09-19T09:43:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.966 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "use_agent": { 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_agent", 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.967 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.968 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.968 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.968 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.968 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:43:39.968 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.968 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.968 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.968 INFO:teuthology.orchestra.run.smithi042.stdout: "use_repo_digest": { 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_repo_digest", 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.969 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_failed_host_check": { 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.970 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:43:39.971 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.971 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.971 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.971 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_daemons": { 2024-09-19T09:43:39.971 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:43:39.971 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.971 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.972 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.972 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.972 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.972 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.972 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.972 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:43:39.972 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.972 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.972 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_hosts": { 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.973 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:43:39.974 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.974 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.974 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.974 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.974 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.975 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crash", 2024-09-19T09:43:39.975 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.975 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.975 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.975 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:39.975 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:39.975 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.976 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.976 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.976 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.976 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.976 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.976 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.976 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.976 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.977 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.977 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.977 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.978 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.978 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.978 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.978 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.978 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.978 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.979 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:39.980 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:39.981 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:39.981 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:39.981 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:39.981 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:39.981 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.981 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.981 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.981 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.982 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: "retain_interval": { 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retain_interval", 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "31536000", 2024-09-19T09:43:39.984 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_recent_interval": { 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_recent_interval", 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1209600", 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:39.986 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dashboard", 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.987 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.988 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.989 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.990 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.991 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.992 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:43:39.993 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.994 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:43:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:43:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.995 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:43:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:43:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.996 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.997 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:39.998 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:39.999 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.000 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.001 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.002 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.003 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_URL": { 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.004 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.005 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.006 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:43:40.007 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:43:40.008 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:43:40.009 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.010 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.011 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.012 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:43:40.013 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:43:40.013 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.013 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.013 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.013 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.013 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.013 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.013 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.013 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.013 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.014 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.015 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.015 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.015 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:43:40.015 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:43:40.015 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.015 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.015 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.015 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.015 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.016 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.017 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.018 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.019 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.020 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:43:40.021 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:43:40.022 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:43:40.023 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8", 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:43:40.024 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "45", 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.027 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.028 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.029 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.030 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.031 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.032 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "cross_origin_url": { 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cross_origin_url", 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.033 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "crt_file": { 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crt_file", 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.034 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "debug": { 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "debug", 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.035 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "jwt_token_ttl": { 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "jwt_token_ttl", 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "28800", 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.036 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.038 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.040 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.041 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.042 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "motd": { 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "motd", 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.043 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "The message of the day", 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.044 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.045 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8080", 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.047 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl_server_port": { 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl_server_port", 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.048 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8443", 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-09-19T09:43:40.049 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "redirect", 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect" 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.050 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.051 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "url_prefix": { 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url_prefix", 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_monitoring": { 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_monitoring", 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.053 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "monitor device health metrics", 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.055 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.056 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.057 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.058 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "mark_out_threshold": { 2024-09-19T09:43:40.059 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mark_out_threshold", 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2419200", 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": { 2024-09-19T09:43:40.060 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_name", 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "device_health_metrics", 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "retention_period": { 2024-09-19T09:43:40.061 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retention_period", 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15552000", 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_frequency": { 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_frequency", 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:43:40.064 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "self_heal": { 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "self_heal", 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.065 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.066 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_threshold": { 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_threshold", 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7257600", 2024-09-19T09:43:40.067 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "diskprediction_local", 2024-09-19T09:43:40.068 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.069 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.070 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.071 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.072 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "predict_interval": { 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predict_interval", 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "predictor_model": { 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predictor_model", 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "prophetstor", 2024-09-19T09:43:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.076 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "influx", 2024-09-19T09:43:40.077 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": false, 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "batch_size": { 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "batch_size", 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5000", 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.078 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "database": { 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "database", 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "ceph", 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.079 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": { 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hostname", 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.080 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "30", 2024-09-19T09:43:40.081 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "5", 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.082 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.083 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.084 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.085 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.086 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "password": { 2024-09-19T09:43:40.087 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "password", 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "port": { 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "port", 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8086", 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server port", 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "false", 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.090 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "threads": { 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threads", 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "32", 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.091 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "username": { 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "username", 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:43:40.092 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "verify_ssl": { 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "verify_ssl", 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "true", 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "insights", 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.094 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.095 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.096 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.097 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.098 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.099 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "iostat", 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.100 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.101 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.102 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.103 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.104 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "k8sevents", 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_event_retention_days": { 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7", 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.106 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "config_check_secs": { 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_check_secs", 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "10", 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.107 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.108 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.111 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.112 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "localpool", 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.113 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "failure_domain": { 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "failure_domain", 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "host", 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:43:40.114 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.115 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.116 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.118 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.119 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": { 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_size", 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:43:40.120 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:43:40.121 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.121 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.121 INFO:teuthology.orchestra.run.smithi042.stdout: "num_rep": { 2024-09-19T09:43:40.121 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "num_rep", 2024-09-19T09:43:40.121 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.121 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.121 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.121 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3", 2024-09-19T09:43:40.121 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": { 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_num", 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "128", 2024-09-19T09:43:40.122 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "prefix": { 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prefix", 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.123 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "subtree": { 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "subtree", 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.124 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "rack", 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mds_autoscaler", 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.125 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.126 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.127 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.128 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.129 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.130 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirroring", 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.131 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.132 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.133 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.134 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.135 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.136 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "nfs", 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.137 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.138 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.139 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.140 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.141 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: "fail_fs": { 2024-09-19T09:43:40.142 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "fail_fs", 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.143 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.144 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.145 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.146 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.147 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator": { 2024-09-19T09:43:40.148 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "rook", 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "test_orchestrator" 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Orchestrator backend", 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.149 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_perf_query", 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.150 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.151 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.152 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.153 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.154 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.155 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_support", 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.156 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.157 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.159 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.160 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_autoscaler", 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.161 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.162 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.163 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.164 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.167 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "threshold": { 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threshold", 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1.0", 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "scaling threshold", 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.168 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "progress", 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_pg_recovery_event": { 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.169 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.170 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.171 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.172 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.173 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.174 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.175 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "max_completed_events": { 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_completed_events", 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "50", 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.177 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:43:40.178 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus", 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: "cache": { 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cache", 2024-09-19T09:43:40.179 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "exclude_perf_counters": { 2024-09-19T09:43:40.180 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "exclude_perf_counters", 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.181 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.182 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.183 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.184 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.185 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.186 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools": { 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools", 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.187 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "300", 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.188 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_interval": { 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_interval", 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15.0", 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.189 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.190 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "9283", 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.191 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "stale_cache_strategy": { 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stale_cache_strategy", 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "log", 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.192 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "default", 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.193 INFO:teuthology.orchestra.run.smithi042.stdout: "default", 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "error" 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-09-19T09:43:40.194 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.196 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.197 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.198 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.199 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.200 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_snap_create": { 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.201 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.202 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "trash_purge_schedule": { 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "trash_purge_schedule", 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.203 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "restful", 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_auth": { 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_auth", 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.204 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.205 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.206 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.207 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.208 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.209 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.210 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.213 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rgw", 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.214 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.215 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.216 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.217 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.218 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:43:40.219 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rook", 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.221 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.222 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.223 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.224 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.225 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "storage_class": { 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "storage_class", 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.226 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "local", 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "selftest", 2024-09-19T09:43:40.227 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.228 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.229 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.230 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.231 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.232 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "roption1": { 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption1", 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.233 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "roption2": { 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption2", 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "xyz", 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.234 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption1": { 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption1", 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.235 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption2": { 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption2", 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.236 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption3": { 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption3", 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.237 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption4": { 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption4", 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.238 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption5": { 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption5", 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.239 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption6": { 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption6", 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.240 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption7": { 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption7", 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.241 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "42", 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "testkey": { 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testkey", 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.242 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "testlkey": { 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testlkey", 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.243 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "testnewline": { 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testnewline", 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.245 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_m_granularity": { 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_m_granularity", 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.246 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "dump_on_update": { 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dump_on_update", 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:43:40.247 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.248 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.249 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.251 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.252 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stats", 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.253 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.254 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.255 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.256 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.257 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.258 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "status", 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.259 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.261 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.263 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telegraf", 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "address": { 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "address", 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.265 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.266 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.266 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15", 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.268 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.270 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.271 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.272 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.273 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telemetry", 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.274 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_basic": { 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_basic", 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.275 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_crash": { 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_crash", 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.276 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_device": { 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_device", 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.277 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_ident": { 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_ident", 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.278 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_perf": { 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_perf", 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:43:40.279 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "contact": { 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "contact", 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.280 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "description": { 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "description", 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.281 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "device_url": { 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_url", 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.282 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.283 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "24", 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "8", 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.284 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "last_opt_revision": { 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "last_opt_revision", 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1", 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.285 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard": { 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard", 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.286 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard_description": { 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard_description", 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.287 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.288 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.289 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.291 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.292 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "organization": { 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "organization", 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.293 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "proxy": { 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "proxy", 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.294 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "url": { 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url", 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.295 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "test_orchestrator", 2024-09-19T09:43:40.296 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.297 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.298 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.299 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.300 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.301 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.303 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.305 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.306 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_clones": { 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_clones", 2024-09-19T09:43:40.307 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4", 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.308 INFO:teuthology.orchestra.run.smithi042.stdout: "periodic_async_work": { 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "periodic_async_work", 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Periodically check for async work", 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.309 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_delay": { 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.310 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.311 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix", 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "discovery_interval": { 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "discovery_interval", 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "100", 2024-09-19T09:43:40.312 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "identifier": { 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "identifier", 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.313 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:40.314 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.315 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.316 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.317 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.318 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.319 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_host": { 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_host", 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.320 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_port": { 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_port", 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.321 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10051", 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_sender": { 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_sender", 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.322 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.323 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: "modules": [ 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: "dashboard", 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: "iostat", 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: "nfs", 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: "restful" 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: "available_modules": [ 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "alerts", 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.328 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_destination": { 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_destination", 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.331 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_from_name": { 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_from_name", 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "Ceph", 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.332 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email From: name", 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_host": { 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_host", 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.333 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP server", 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_password": { 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_password", 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.334 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Password to authenticate with", 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_port": { 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_port", 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "465", 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.335 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP port", 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_sender": { 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_sender", 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_ssl": { 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_ssl", 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.337 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_user": { 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_user", 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.338 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "User to authenticate as", 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "balancer", 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.339 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "active": { 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "active", 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.340 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_time": { 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_time", 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0000", 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.341 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_weekday": { 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_weekday", 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.342 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_max_iterations": { 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "25", 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "250", 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.343 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_metrics": { 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_metrics", 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:43:40.344 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_step": { 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_step", 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.5", 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0.001", 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "0.999", 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:43:40.345 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "end_time": { 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_time", 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2359", 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:43:40.346 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "end_weekday": { 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_weekday", 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:43:40.347 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.348 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.349 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.350 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.351 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.352 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "min_score": { 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_score", 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.353 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "upmap", 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.354 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-compat", 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "none", 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "read", 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap", 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap-read" 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Balancer mode", 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_ids": { 2024-09-19T09:43:40.355 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_ids", 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:40.356 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.357 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_deviation": { 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_deviation", 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.358 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_optimizations": { 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.359 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm", 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_down_multiplier": { 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_down_multiplier", 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-09-19T09:43:40.360 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_refresh_rate": { 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_refresh_rate", 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.361 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "20", 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_starting_port": { 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_starting_port", 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.362 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4721", 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_ptrace": { 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_ptrace", 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.363 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_interval": { 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_interval", 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.364 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.7", 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm_log_destination": { 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm_log_destination", 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.366 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "file", 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "file,syslog", 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "syslog" 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "cgroups_split": { 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cgroups_split", 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "config_checks_enabled": { 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_checks_enabled", 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "config_dashboard": { 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_dashboard", 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.370 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_alertmanager": { 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_alertmanager", 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_base": { 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_base", 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:43:40.372 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_elasticsearch": { 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "elasticsearch container image", 2024-09-19T09:43:40.373 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_grafana": { 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_grafana", 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:40.374 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_haproxy": { 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_haproxy", 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "HAproxy container image", 2024-09-19T09:43:40.375 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_agent": { 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.376 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_collector": { 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.377 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_query": { 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.378 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger query container image", 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_keepalived": { 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_keepalived", 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.379 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Keepalived container image", 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_loki": { 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_loki", 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.380 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Loki container image", 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_node_exporter": { 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_node_exporter", 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_nvmeof": { 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_nvmeof", 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Nvme-of container image", 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_prometheus": { 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_prometheus", 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_promtail": { 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_promtail", 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:43:40.384 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Promtail container image", 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_samba": { 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_samba", 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.385 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_snmp_gateway": { 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.386 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "container_init": { 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_init", 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.387 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "daemon_cache_timeout": { 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.388 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.389 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "900", 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "default_registry": { 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_registry", 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.390 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io", 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "device_cache_timeout": { 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_cache_timeout", 2024-09-19T09:43:40.391 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1800", 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "device_enhanced_scan": { 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_enhanced_scan", 2024-09-19T09:43:40.392 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "facts_cache_timeout": { 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "facts_cache_timeout", 2024-09-19T09:43:40.393 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "grafana_dashboards_path": { 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:43:40.394 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "host_check_interval": { 2024-09-19T09:43:40.395 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "host_check_interval", 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "hw_monitoring": { 2024-09-19T09:43:40.396 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hw_monitoring", 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "inventory_list_all": { 2024-09-19T09:43:40.397 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "inventory_list_all", 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.398 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.399 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "log_refresh_metadata": { 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_refresh_metadata", 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.400 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.401 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.402 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.403 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.404 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.405 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "*", 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "max_count_per_host": { 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_count_per_host", 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:43:40.407 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd_draining_count": { 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_osd_draining_count", 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:43:40.408 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "migration_current": { 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "migration_current", 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "internal - do not modify", 2024-09-19T09:43:40.409 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "root", 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm-package", 2024-09-19T09:43:40.410 INFO:teuthology.orchestra.run.smithi042.stdout: "root" 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "oob_default_addr": { 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "oob_default_addr", 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "169.254.1.1", 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.411 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "prometheus_alerts_path": { 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:43:40.412 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_insecure": { 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_insecure", 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.413 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_password": { 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_password", 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.414 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_url": { 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_url", 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.415 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_username": { 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_username", 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.416 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "secure_monitoring_stack": { 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.417 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "service_discovery_port": { 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "service_discovery_port", 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8765", 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "ssh_config_file": { 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssh_config_file", 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.419 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "use_agent": { 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_agent", 2024-09-19T09:43:40.420 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "use_repo_digest": { 2024-09-19T09:43:40.421 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_repo_digest", 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.423 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_failed_host_check": { 2024-09-19T09:43:40.423 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:43:40.423 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.423 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.423 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.423 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.423 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.423 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.424 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.424 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:43:40.424 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.424 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.424 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.424 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_daemons": { 2024-09-19T09:43:40.424 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:43:40.424 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.425 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_hosts": { 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.426 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crash", 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.427 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.428 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.429 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.430 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.431 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "retain_interval": { 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retain_interval", 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.432 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "31536000", 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_recent_interval": { 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_recent_interval", 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.433 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1209600", 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.434 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dashboard", 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.436 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.437 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.438 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.439 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.440 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.441 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.442 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.443 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.444 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.448 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.449 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.450 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_URL": { 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.451 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.453 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.454 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:43:40.455 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:43:40.456 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:43:40.457 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:43:40.458 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:43:40.459 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:43:40.460 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:43:40.461 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:43:40.462 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:43:40.463 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:43:40.464 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.465 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.466 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.468 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.469 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.470 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:43:40.470 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:43:40.470 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.470 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.470 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.470 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8", 2024-09-19T09:43:40.470 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.470 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "45", 2024-09-19T09:43:40.472 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.473 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.474 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.475 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.476 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.477 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.478 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "cross_origin_url": { 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cross_origin_url", 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.480 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "crt_file": { 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crt_file", 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.481 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "debug": { 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "debug", 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.482 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "jwt_token_ttl": { 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "jwt_token_ttl", 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.483 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "28800", 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-09-19T09:43:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.486 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.487 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.488 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.489 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.490 INFO:teuthology.orchestra.run.smithi042.stdout: "motd": { 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "motd", 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "The message of the day", 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.491 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8080", 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.494 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.495 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl_server_port": { 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl_server_port", 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8443", 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.496 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "redirect", 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect" 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.497 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.498 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "url_prefix": { 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url_prefix", 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.499 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.500 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_monitoring": { 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_monitoring", 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "monitor device health metrics", 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.501 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.502 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.503 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.504 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.505 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.506 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "mark_out_threshold": { 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mark_out_threshold", 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2419200", 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.507 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": { 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_name", 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "device_health_metrics", 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.508 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "retention_period": { 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retention_period", 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15552000", 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.509 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_frequency": { 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_frequency", 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.510 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "self_heal": { 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "self_heal", 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.511 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.512 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_threshold": { 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_threshold", 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7257600", 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.513 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "diskprediction_local", 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.514 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.515 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.516 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.517 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.517 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.517 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.517 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.517 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.517 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.517 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.517 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.517 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.518 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.519 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "predict_interval": { 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predict_interval", 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.520 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "predictor_model": { 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predictor_model", 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "prophetstor", 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.521 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.522 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "influx", 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": false, 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "batch_size": { 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "batch_size", 2024-09-19T09:43:40.523 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5000", 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "database": { 2024-09-19T09:43:40.524 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "database", 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "ceph", 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.525 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": { 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hostname", 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.526 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "30", 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "5", 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.527 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.528 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.529 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.530 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "password": { 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "password", 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "port": { 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "port", 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8086", 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server port", 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.534 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "false", 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.535 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "threads": { 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threads", 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "32", 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.536 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "username": { 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "username", 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.537 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "verify_ssl": { 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "verify_ssl", 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "true", 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.538 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "insights", 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.539 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.541 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.542 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.543 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.544 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "iostat", 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.545 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.546 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.547 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.548 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.549 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "k8sevents", 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_event_retention_days": { 2024-09-19T09:43:40.550 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7", 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.551 INFO:teuthology.orchestra.run.smithi042.stdout: "config_check_secs": { 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_check_secs", 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "10", 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.553 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.554 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.555 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.556 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.557 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "localpool", 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: "failure_domain": { 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "failure_domain", 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.558 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "host", 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.559 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.560 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.561 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.562 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.563 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": { 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_size", 2024-09-19T09:43:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "num_rep": { 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "num_rep", 2024-09-19T09:43:40.565 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3", 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": { 2024-09-19T09:43:40.566 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_num", 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "128", 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.567 INFO:teuthology.orchestra.run.smithi042.stdout: "prefix": { 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prefix", 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "subtree": { 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "subtree", 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "rack", 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.569 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mds_autoscaler", 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.570 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.571 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.572 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.574 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirroring", 2024-09-19T09:43:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.576 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.577 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.578 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.579 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.580 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "nfs", 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.581 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.582 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.583 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.584 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.585 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "fail_fs": { 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "fail_fs", 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.587 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.588 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.591 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.592 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator": { 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.593 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: "rook", 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: "test_orchestrator" 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Orchestrator backend", 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.594 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_perf_query", 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.595 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.596 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.597 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.598 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.599 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_support", 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.600 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.601 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.602 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.603 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.604 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.605 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_autoscaler", 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.606 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.607 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.608 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.609 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.610 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:40.611 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "threshold": { 2024-09-19T09:43:40.612 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threshold", 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1.0", 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "scaling threshold", 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "progress", 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_pg_recovery_event": { 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.614 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.615 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.616 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.619 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.620 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "max_completed_events": { 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_completed_events", 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.621 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "50", 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.622 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus", 2024-09-19T09:43:40.623 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "cache": { 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cache", 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.624 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "exclude_perf_counters": { 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "exclude_perf_counters", 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:43:40.625 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.626 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.627 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.628 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.629 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.630 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools": { 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools", 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "300", 2024-09-19T09:43:40.632 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_interval": { 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_interval", 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15.0", 2024-09-19T09:43:40.633 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-09-19T09:43:40.634 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "9283", 2024-09-19T09:43:40.635 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "stale_cache_strategy": { 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stale_cache_strategy", 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "log", 2024-09-19T09:43:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "default", 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "default", 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "error" 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-09-19T09:43:40.638 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.640 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.641 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.642 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.643 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.644 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_snap_create": { 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:43:40.645 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:43:40.646 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "trash_purge_schedule": { 2024-09-19T09:43:40.647 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "trash_purge_schedule", 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "restful", 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_auth": { 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_auth", 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.649 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.650 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.651 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.652 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.653 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.654 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.655 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.656 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.657 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rgw", 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.658 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.659 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.661 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.662 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.663 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.664 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rook", 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.665 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.666 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.667 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.668 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.669 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "storage_class": { 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "storage_class", 2024-09-19T09:43:40.670 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "local", 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "selftest", 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.676 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.677 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.678 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.679 INFO:teuthology.orchestra.run.smithi042.stdout: "roption1": { 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption1", 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "roption2": { 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption2", 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "xyz", 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.681 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption1": { 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption1", 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.682 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption2": { 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption2", 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.683 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption3": { 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption3", 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.684 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption4": { 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption4", 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.685 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption5": { 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption5", 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.686 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption6": { 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption6", 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.687 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption7": { 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption7", 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "42", 2024-09-19T09:43:40.688 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "testkey": { 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testkey", 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.689 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "testlkey": { 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testlkey", 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.690 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "testnewline": { 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testnewline", 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.691 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.692 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_m_granularity": { 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_m_granularity", 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "dump_on_update": { 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dump_on_update", 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.695 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.698 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.699 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stats", 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.700 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.701 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.702 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.703 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.704 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "status", 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.706 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.707 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.709 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.710 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telegraf", 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.711 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "address": { 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "address", 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.712 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15", 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.713 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.714 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.715 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.716 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.717 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.718 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telemetry", 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_basic": { 2024-09-19T09:43:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_basic", 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_crash": { 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_crash", 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_device": { 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_device", 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.722 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_ident": { 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_ident", 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.723 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_perf": { 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_perf", 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: "contact": { 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "contact", 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "description": { 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "description", 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "device_url": { 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_url", 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "24", 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "8", 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "last_opt_revision": { 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "last_opt_revision", 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1", 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard": { 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard", 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard_description": { 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard_description", 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "organization": { 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "organization", 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "proxy": { 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "proxy", 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "url": { 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url", 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "test_orchestrator", 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.744 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.745 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.746 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.747 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.749 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.750 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.751 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_clones": { 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_clones", 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.752 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4", 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "periodic_async_work": { 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "periodic_async_work", 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.753 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Periodically check for async work", 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_delay": { 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.754 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.755 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix", 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "discovery_interval": { 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "discovery_interval", 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "100", 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.757 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "identifier": { 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "identifier", 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.760 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-09-19T09:43:40.761 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-09-19T09:43:40.762 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-09-19T09:43:40.763 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.764 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_host": { 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_host", 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-09-19T09:43:40.765 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_port": { 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_port", 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10051", 2024-09-19T09:43:40.766 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_sender": { 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_sender", 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:43:40.767 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: "services": { 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: "dashboard": "https://172.21.15.42:8443/" 2024-09-19T09:43:40.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "always_on_modules": { 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "octopus": [ 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.769 INFO:teuthology.orchestra.run.smithi042.stdout: "pacific": [ 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "quincy": [ 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-09-19T09:43:40.770 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "reef": [ 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-09-19T09:43:40.771 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "squid": [ 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-09-19T09:43:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: "last_failure_osd_epoch": 3, 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: "active_clients": [ 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-09-19T09:43:40.773 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3093687184 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "libcephsqlite", 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3241260732 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-19T09:43:40.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 49813489 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-19T09:43:40.775 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-09-19T09:43:40.776 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-09-19T09:43:40.776 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 70909531 2024-09-19T09:43:40.776 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.776 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-19T09:43:40.776 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:40.776 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-19T09:43:40.776 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:43:40.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:39 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1490627594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:43:40.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:39 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2888427672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:43:40.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:39 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3814499572' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:43:40.778 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:39 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1490627594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:43:40.778 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:39 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2888427672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:43:40.778 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:39 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3814499572' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:43:40.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.363+0000 7f9367cd0640 1 -- 172.21.15.42:0/3814499572 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f934c0a3250 msgr2=0x7f934c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.363+0000 7f9367cd0640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f934c0a3250 0x7f934c0a5710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f935c0058c0 tx=0x7f935c005850 comp rx=0 tx=0).stop 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.363+0000 7f9367cd0640 1 -- 172.21.15.42:0/3814499572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360104ee0 msgr2=0x7f9360100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.363+0000 7f9367cd0640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360104ee0 0x7f9360100560 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9350031610 tx=0x7f93500043b0 comp rx=0 tx=0).stop 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.364+0000 7f9367cd0640 1 -- 172.21.15.42:0/3814499572 shutdown_connections 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.364+0000 7f9367cd0640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f934c0a3250 0x7f934c0a5710 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.364+0000 7f9367cd0640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9360107810 0x7f9360100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.364+0000 7f9367cd0640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9360104ee0 0x7f9360100560 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.364+0000 7f9367cd0640 1 --2- 172.21.15.42:0/3814499572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93601025b0 0x7f9360101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.364+0000 7f9367cd0640 1 -- 172.21.15.42:0/3814499572 >> 172.21.15.42:0/3814499572 conn(0x7f93600fc1b0 msgr2=0x7f9360102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.364+0000 7f9367cd0640 1 -- 172.21.15.42:0/3814499572 shutdown_connections 2024-09-19T09:43:40.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:43:39.364+0000 7f9367cd0640 1 -- 172.21.15.42:0/3814499572 wait complete. 2024-09-19T09:43:40.785 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T09:43:40.786 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T09:43:40.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:39 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1490627594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:43:40.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:39 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2888427672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:43:40.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:39 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3814499572' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:43:40.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:40 smithi042 ceph-mon[31223]: pgmap v467: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:43:40.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:40 smithi171 ceph-mon[35803]: pgmap v467: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:43:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:40 smithi136 ceph-mon[34840]: pgmap v467: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:43:41.059 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:41.622 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:43:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 383, 2024-09-19T09:43:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 385, 2024-09-19T09:43:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 128835, 2024-09-19T09:43:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 121795, 2024-09-19T09:43:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2024-09-19T09:43:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.040265513, 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.013183097, 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.010189656, 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.011862346, 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 383, 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.023703968, 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000061890 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 285, 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 267, 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 857726, 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 115694, 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.034140803, 2024-09-19T09:43:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.010677317, 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.022854598, 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.005202178, 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 267, 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.016213328, 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000060724 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 820912, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 68880 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 424, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 506, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 2974917, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 359620, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.041677167, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.014788390, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.013364867, 2024-09-19T09:43:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.009731723, 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 504, 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.015998068, 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000031742 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 225424 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1739, 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.043627063, 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000025087 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-09-19T09:43:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 0, 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 0, 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 0, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 0, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 0, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 427, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 0, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 427, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2024-09-19T09:43:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 427, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 1, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-09-19T09:43:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:43:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:43:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 0 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:43:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2024-09-19T09:43:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 0, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 1392, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2024-09-19T09:43:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 0, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 3, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 2, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 4194304, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 7059421, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 7058283, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 1392 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 16, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 506, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 490, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 14, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 193, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 179, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 427, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 898, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 471, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 0, 2024-09-19T09:43:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 0, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 0, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 51492, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 215328 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 0, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 0, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 0, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 0, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-09-19T09:43:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-09-19T09:43:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-09-19T09:43:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-09-19T09:43:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-09-19T09:43:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 1, 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 0, 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 1, 2024-09-19T09:43:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 0, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 0, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 1291, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-19T09:43:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 189664, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 60, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 7688, 2024-09-19T09:43:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 158, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 358201, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 3366, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-09-19T09:43:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 952, 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 21, 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 3, 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 952, 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 952, 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.609984333, 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001691160 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-09-19T09:43:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 952, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 953 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 952, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 952, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 0, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 521, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 0, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 429, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 0, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 0, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-09-19T09:43:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 1, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-09-19T09:43:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-09-19T09:43:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 81, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 2, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 5, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 5, 2024-09-19T09:43:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 0, 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 2, 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 0 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 0, 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "osd-slow-ops": { 2024-09-19T09:43:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 0, 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 0, 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 0, 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-19T09:43:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 1088, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 3853712, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 1088, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 1088, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 3853712, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 952, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 2865122, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 952, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 2865122, 2024-09-19T09:43:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 952, 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 952, 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 952, 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 952, 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-19T09:43:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x5625a5eb6b40": { 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-09-19T09:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:41.670 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:43:42.432 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-19T09:43:42.433 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-19T09:43:42.433 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T09:43:42.433 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T09:43:42.735 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:42.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:42 smithi171 ceph-mon[35803]: pgmap v468: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:42.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:42 smithi042 ceph-mon[31223]: pgmap v468: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:42 smithi136 ceph-mon[34840]: pgmap v468: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:43.260 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:43:43.260 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:43.260 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 121, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 116, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 728224, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 70448, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 0, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.021703417, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.008024613, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.018198997, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 115, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.006297528, 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000054761 2024-09-19T09:43:43.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 728224, 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 70448 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 5, 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 90, 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 3184, 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 94480, 2024-09-19T09:43:43.262 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 3, 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.009338657, 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.005287243, 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.003187371, 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 89, 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.008422771, 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000094637 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:43.263 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 94480 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 0, 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2, 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 0, 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 2, 2024-09-19T09:43:43.264 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 1, 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.000346267, 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.000276065, 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:43.265 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 0, 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:43.266 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:43.267 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 148863, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 28, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:43.269 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 0, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 0, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 928, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 2, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-19T09:43:43.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 122, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 711157, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 122, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 122, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 711157, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:43.271 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:43.272 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:43.272 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:43.272 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:43.272 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:43:43.949 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T09:43:43.949 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T09:43:43.949 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T09:43:43.950 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T09:43:44.206 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:44.654 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:44 smithi042 ceph-mon[31223]: pgmap v469: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:44.667 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:43:44.667 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:44.667 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 382, 2024-09-19T09:43:44.667 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 383, 2024-09-19T09:43:44.667 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 128387, 2024-09-19T09:43:44.667 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 121159, 2024-09-19T09:43:44.667 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.040879290, 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.016884401, 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.009298597, 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.009735357, 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 381, 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.020148264, 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000052882 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.668 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 870, 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 852, 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 4458142, 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 302357, 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-09-19T09:43:44.669 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.070560829, 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.020134560, 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.037006075, 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.016352385, 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 852, 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.029999040, 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000035210 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 821456, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 70160 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 4, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 88, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 1508, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 226565, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 5, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.007525404, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.004626402, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.002042704, 2024-09-19T09:43:44.671 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000089223, 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 86, 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.004847488, 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000056366 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 225600 2024-09-19T09:43:44.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1929, 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.043083248, 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000022334 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.673 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 0, 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 0, 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.674 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 0, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 0, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 0, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 349, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 0, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 349, 2024-09-19T09:43:44.675 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 349, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 1, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 0, 2024-09-19T09:43:44.676 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:43:44.677 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:43:44.678 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 0, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 0, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 0 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 0, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 0, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 0, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 0, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 0, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 0, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-09-19T09:43:44.679 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2024-09-19T09:43:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 0, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 1580, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2024-09-19T09:43:44.681 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 0, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 3, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 2, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 4194304, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 7645266, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 7644128, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.682 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 1580 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 6, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 638, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 632, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 4, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 246, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 242, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 349, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 1034, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 685, 2024-09-19T09:43:44.683 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 0, 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 0, 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 0, 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 51600, 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 215328 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 0, 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 0, 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 0, 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 0, 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-09-19T09:43:44.684 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.686 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-09-19T09:43:44.687 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.688 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-09-19T09:43:44.689 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.689 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.689 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.689 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.691 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.692 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.696 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 3, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 2, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 2, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 0, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 0, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 2305, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:44.697 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:44.698 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:44.699 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 197373, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 54, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-19T09:43:44.700 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 7688, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 158, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-19T09:43:44.701 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 265087, 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 1584, 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 1114, 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 21, 2024-09-19T09:43:44.702 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 3, 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 1114, 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1114, 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.634984071, 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001467669 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1114, 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1115 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 1114, 2024-09-19T09:43:44.703 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 1114, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 667, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 445, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 0, 2024-09-19T09:43:44.704 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 1, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-09-19T09:43:44.705 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-09-19T09:43:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 81, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 2, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 6, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 6, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 0, 2024-09-19T09:43:44.707 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 2, 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 0 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 0, 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "osd-slow-ops": { 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-09-19T09:43:44.708 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 0, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 0, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 0, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 1252, 2024-09-19T09:43:44.709 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 4465407, 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 1252, 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 1252, 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 4465407, 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.710 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 1114, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 3450967, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 1114, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 3450967, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.711 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 1114, 2024-09-19T09:43:44.712 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 1114, 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 1114, 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 1114, 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-19T09:43:44.713 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:44.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x5652d6da6b40": { 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 0, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 0, 2024-09-19T09:43:44.715 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:44.716 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:44.716 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:44.716 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:44.716 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:44.716 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:44.716 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:43:44.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:44 smithi171 ceph-mon[35803]: pgmap v469: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:44.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:44 smithi136 ceph-mon[34840]: pgmap v469: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:45.639 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-19T09:43:45.639 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-19T09:43:45.639 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T09:43:45.639 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T09:43:45.895 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:46.388 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-19T09:43:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 0, 2024-09-19T09:43:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2, 2024-09-19T09:43:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:43:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 0, 2024-09-19T09:43:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-09-19T09:43:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 0, 2024-09-19T09:43:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.001309116, 2024-09-19T09:43:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:43:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.000306555, 2024-09-19T09:43:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:43:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:43:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:43:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 1, 2024-09-19T09:43:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 89, 2024-09-19T09:43:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:43:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 94208, 2024-09-19T09:43:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 3, 2024-09-19T09:43:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-09-19T09:43:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.007045688, 2024-09-19T09:43:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.005096784, 2024-09-19T09:43:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.001075633, 2024-09-19T09:43:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:43:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 87, 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.003557664, 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000040892 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 94208 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 127, 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 120, 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 731792, 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 72176, 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 2, 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 1, 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.022363057, 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.007321454, 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.021015719, 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:43:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 120, 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.010735587, 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000089463 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 731792, 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 72176 2024-09-19T09:43:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 0, 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 148863, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 28, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-19T09:43:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 0, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 0, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 928, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 2, 2024-09-19T09:43:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 124, 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 711417, 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 124, 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 124, 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 711417, 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-19T09:43:46.404 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-19T09:43:46.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:46 smithi171 ceph-mon[35803]: pgmap v470: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:43:46.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:46 smithi136 ceph-mon[34840]: pgmap v470: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:43:46.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:46 smithi042 ceph-mon[31223]: pgmap v470: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:43:47.167 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T09:43:47.167 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T09:43:47.167 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T09:43:47.168 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T09:43:47.428 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:43:47.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:47 smithi136 ceph-mon[34840]: pgmap v471: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:47.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:47 smithi171 ceph-mon[35803]: pgmap v471: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:47.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:47 smithi042 ceph-mon[31223]: pgmap v471: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:47.903 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-19T09:43:47.903 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:47.903 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 3872, 2024-09-19T09:43:47.903 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 4985, 2024-09-19T09:43:47.903 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1304075, 2024-09-19T09:43:47.903 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 7119262, 2024-09-19T09:43:47.903 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 51, 2024-09-19T09:43:47.903 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 5, 2024-09-19T09:43:47.903 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.300939156, 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.104820701, 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.149822695, 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.052717564, 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4981, 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.901581315, 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000181004 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 5542, 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000981156, 2024-09-19T09:43:47.904 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000177 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 61648, 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 30192 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 8499, 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 6232, 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 3334254, 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 2075529, 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 13, 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 6, 2024-09-19T09:43:47.905 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.435823431, 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.183254096, 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.302131229, 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.022247366, 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 6233, 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.946638985, 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000151875 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 12305, 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001678427, 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000136 2024-09-19T09:43:47.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 232400 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 2146, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 1927, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1617185, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 1830895, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 76, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 7, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.183152121, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.060000857, 2024-09-19T09:43:47.907 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.118896968, 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.021769628, 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1926, 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.328532066, 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000170577 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2404, 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000417501, 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000173 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.908 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 896592, 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 95312 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1659, 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.752854114, 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000453799 2024-09-19T09:43:47.909 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1046, 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.063172432, 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000060394 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 1053, 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 1008, 2024-09-19T09:43:47.910 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1008, 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.744874623, 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001731026 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 45, 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 6, 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 2, 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 188, 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-09-19T09:43:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 39, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 15, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 13, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 11, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 17, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 277, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 2, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 2, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 7, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 2099, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 1578, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 39, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 79, 2024-09-19T09:43:47.912 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 2, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 3, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 38, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 12, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 60, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 451, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 486, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 14, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 4, 2024-09-19T09:43:47.913 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 234, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 486, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 87, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 7, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 80, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 399, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 18, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 249, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 671, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 2, 2024-09-19T09:43:47.914 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 532, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 283, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 41, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 849 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 108, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 29, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 1, 2024-09-19T09:43:47.915 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 459, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 455, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 3, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 2, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 4, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 76, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 7, 2024-09-19T09:43:47.916 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 38, 2024-09-19T09:43:47.917 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-09-19T09:43:47.917 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:43:47.917 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-09-19T09:43:47.917 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-09-19T09:43:47.917 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.917 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-09-19T09:43:47.917 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-09-19T09:43:47.917 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 1956, 2024-09-19T09:43:47.917 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 1932, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 1932, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 24, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 37, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 19, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 18, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 18, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 1, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 1, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 1, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 8245474, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 8292075, 2024-09-19T09:43:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 0, 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 453, 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.098486711, 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002424915 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 0 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 42, 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 636, 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 594, 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 37, 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 216, 2024-09-19T09:43:47.919 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 179, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 39, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 1241, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 1202, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 2, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 588, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 586, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 66448, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 231712 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 1816, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 231, 2024-09-19T09:43:47.920 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 1053, 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 26, 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 744, 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 11, 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.033960399, 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.003087309 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 22, 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.026695492, 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001213431 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-09-19T09:43:47.921 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2, 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.034554046, 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.017277023 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 373, 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.144858889, 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000388361 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-09-19T09:43:47.922 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1, 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000125670, 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000125670 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.923 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-09-19T09:43:47.924 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.925 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.925 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.925 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-09-19T09:43:47.925 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 16, 2024-09-19T09:43:47.925 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.024959099, 2024-09-19T09:43:47.925 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001559943 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 5, 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.003964601, 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000792920 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-09-19T09:43:47.926 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1, 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000332362, 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000332362 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 85, 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.061588494, 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000724570 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 12, 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.229752404, 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.019146033 2024-09-19T09:43:47.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 50, 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.475429589, 2024-09-19T09:43:47.928 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.009508591 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-09-19T09:43:47.929 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3, 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.017118463, 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.005706154 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 8, 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.020366870, 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002545858 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2, 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.002320460, 2024-09-19T09:43:47.931 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001160230 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 417, 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.668847785, 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001603951 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:47.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 3, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 2, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 1, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 612, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 612, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 288, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:47.933 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:47.934 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:47.934 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:47.934 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:47.934 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:47.934 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:47.934 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:47.934 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:47.934 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:47.934 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 302524, 2024-09-19T09:43:47.936 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 103, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7688, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 158, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:47.937 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 174734, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 1061, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 2914, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 4827054, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 32, 2024-09-19T09:43:47.938 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 2914, 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2914, 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 30.729293901, 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.010545399 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2914, 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 4151 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 2914, 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 580, 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 2334, 2024-09-19T09:43:47.939 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 107, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 423, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 79, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 525, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 110, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 987, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-09-19T09:43:47.940 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 501, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 852, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 2, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-09-19T09:43:47.941 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-09-19T09:43:47.942 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 81, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 12, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 12, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 0, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 496, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 16, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 53 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-09-19T09:43:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 1, 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 67 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 8, 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 6, 2024-09-19T09:43:47.944 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 475, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 455, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 14513, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 4926018, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 14513, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 14513, 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 4926018, 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:47.946 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 2914, 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 4872905, 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 2914, 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 4872905, 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:47.947 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 2914, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 2914, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 2914, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 2914, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.948 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 455, 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 45955, 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 455, 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:47.949 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 72, 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 45955, 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x55b35a688960": { 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 1956, 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 4097771, 2024-09-19T09:43:47.950 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:47.951 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 1956, 2024-09-19T09:43:47.951 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:47.951 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:47.951 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 453, 2024-09-19T09:43:47.951 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 4097771, 2024-09-19T09:43:47.951 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:47.951 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:47.951 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:47.952 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:47.952 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:47.952 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:47.952 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-19T09:43:48.828 INFO:tasks.check_counter:Daemon mds.b mds.exported=38 2024-09-19T09:43:48.828 INFO:tasks.check_counter:Daemon mds.b mds.imported=60 2024-09-19T09:43:48.828 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T09:43:48.828 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T09:43:49.076 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:43:49.544 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-19T09:43:49.544 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:49.544 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 869, 2024-09-19T09:43:49.544 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 870, 2024-09-19T09:43:49.544 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 4353156, 2024-09-19T09:43:49.544 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 276034, 2024-09-19T09:43:49.544 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 6, 2024-09-19T09:43:49.544 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 2, 2024-09-19T09:43:49.544 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.074661446, 2024-09-19T09:43:49.544 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.028239291, 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.019727263, 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.019890188, 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 868, 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.027947616, 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000032197 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.545 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 146, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 129, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 828136, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 73770, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 4, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 3, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.022753821, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.007977297, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.021364266, 2024-09-19T09:43:49.546 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000088913, 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 128, 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.011520276, 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000090002 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 826480, 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 72432 2024-09-19T09:43:49.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 385, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 471, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 96735, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 350825, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 4, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 3, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.037617949, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.012414996, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.009943976, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.011682441, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 470, 2024-09-19T09:43:49.548 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.018781310, 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000039960 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 229984 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-09-19T09:43:49.549 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2110, 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.054456650, 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000025808 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.550 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 0, 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 0, 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 0, 2024-09-19T09:43:49.551 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-09-19T09:43:49.552 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-09-19T09:43:49.552 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 0, 2024-09-19T09:43:49.552 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-09-19T09:43:49.552 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-09-19T09:43:49.552 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 489, 2024-09-19T09:43:49.552 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 329, 2024-09-19T09:43:49.552 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 160, 2024-09-19T09:43:49.552 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 0, 2024-09-19T09:43:49.552 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 19, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 2, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-09-19T09:43:49.553 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-09-19T09:43:49.554 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 0, 2024-09-19T09:43:49.554 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 0, 2024-09-19T09:43:49.554 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 0, 2024-09-19T09:43:49.554 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 0, 2024-09-19T09:43:49.554 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-09-19T09:43:49.554 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:43:49.554 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-09-19T09:43:49.554 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 4, 2024-09-19T09:43:49.554 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 234, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:43:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 0, 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 0, 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 0 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 0, 2024-09-19T09:43:49.556 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-09-19T09:43:49.557 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 0, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 0, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-09-19T09:43:49.558 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 1956, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 0, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 2, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 19, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 8245474, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 8292075, 2024-09-19T09:43:49.559 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 8288317, 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 1956 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 20, 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 634, 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 614, 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 15, 2024-09-19T09:43:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 229, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 214, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 489, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 1120, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 631, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 0, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 0, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 0, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 50020, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 215328 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 0, 2024-09-19T09:43:49.561 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 0, 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 0, 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 0, 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 0, 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.562 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.563 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.564 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.565 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.566 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-09-19T09:43:49.566 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.566 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.567 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.568 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-09-19T09:43:49.569 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.570 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-09-19T09:43:49.571 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.572 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.572 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.572 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.572 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-09-19T09:43:49.572 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.572 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.572 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.572 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.572 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-09-19T09:43:49.572 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.573 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 3, 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 2, 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 2, 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-09-19T09:43:49.574 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 0, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 0, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 2780, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:49.575 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:49.577 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 189276, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 49, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7688, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 158, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:49.578 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 408438, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 2350, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 1252, 2024-09-19T09:43:49.579 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 26, 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 4, 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 1252, 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1252, 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.512965160, 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001208438 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1252, 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1253 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 1252, 2024-09-19T09:43:49.580 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 1252, 2024-09-19T09:43:49.581 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 0, 2024-09-19T09:43:49.581 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-09-19T09:43:49.581 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-09-19T09:43:49.581 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 764, 2024-09-19T09:43:49.581 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 0, 2024-09-19T09:43:49.581 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 485, 2024-09-19T09:43:49.581 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 0, 2024-09-19T09:43:49.581 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 0, 2024-09-19T09:43:49.581 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-09-19T09:43:49.581 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 2, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:43:49.582 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-09-19T09:43:49.583 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 81, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 5, 2024-09-19T09:43:49.584 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 5, 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 0, 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 0, 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 2, 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 0 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 0, 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-09-19T09:43:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-09-19T09:43:49.586 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.586 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-09-19T09:43:49.586 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-09-19T09:43:49.586 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:43:49.586 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-09-19T09:43:49.586 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 0, 2024-09-19T09:43:49.587 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 0, 2024-09-19T09:43:49.587 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 0, 2024-09-19T09:43:49.587 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-09-19T09:43:49.587 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.587 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:49.587 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:49.587 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-19T09:43:49.587 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:49.587 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 1396, 2024-09-19T09:43:49.587 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 5142134, 2024-09-19T09:43:49.588 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:49.588 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 1396, 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1396, 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 5142134, 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:49.589 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-19T09:43:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 1252, 2024-09-19T09:43:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 4097781, 2024-09-19T09:43:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1252, 2024-09-19T09:43:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 4097781, 2024-09-19T09:43:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 1252, 2024-09-19T09:43:49.591 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 1252, 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1252, 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 1252, 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:49.592 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:49.593 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x55a6798a6b40": { 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-09-19T09:43:49.594 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:49.595 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:49.595 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:49.595 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:49.595 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:49.595 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:49.595 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-19T09:43:49.825 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:49 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:43:49.825 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:49 smithi136 ceph-mon[34840]: pgmap v472: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:43:49.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:49 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:43:49.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:49 smithi042 ceph-mon[31223]: pgmap v472: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:43:50.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:49 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:43:50.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:49 smithi171 ceph-mon[35803]: pgmap v472: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:43:50.329 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T09:43:50.329 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T09:43:50.329 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T09:43:50.329 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T09:43:50.573 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:43:51.056 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-19T09:43:51.056 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:51.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 72614, 2024-09-19T09:43:51.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 132065, 2024-09-19T09:43:51.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 23643422, 2024-09-19T09:43:51.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 128140715, 2024-09-19T09:43:51.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 17, 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 4, 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 4.139527163, 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 1.819754647, 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 6.604460220, 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.310347532, 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 132064, 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 3.253283043, 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000024634 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 162693, 2024-09-19T09:43:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.025004362, 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000153 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 4880, 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 1920 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 18085, 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 20512, 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 5458842, 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 48601986, 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 18, 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 7, 2024-09-19T09:43:51.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 1.297159477, 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.504902554, 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.394525032, 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.355934707, 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 20511, 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.609561563, 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000029718 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 10340, 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001713972, 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000165 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 851072, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 78592 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 19169, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 24064, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 5936187, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 29318981, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 14, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 6, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 1.419716946, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.626368781, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.537029503, 2024-09-19T09:43:51.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.265815913, 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 24062, 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.657908624, 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000027342 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 23141, 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.003687485, 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000159 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 229440 2024-09-19T09:43:51.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 14177, 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 38.103335297, 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002687686 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-09-19T09:43:51.062 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 23485, 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 3.298007688, 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000140430 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 37031, 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 36874, 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 36874, 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 126.587015234, 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.003432961 2024-09-19T09:43:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 157, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 76, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 7, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 2, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 331, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 112, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 62, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 157, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 170, 2024-09-19T09:43:51.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 2051, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 0, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 0, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 11, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 45882, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 44856, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 48, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 61, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 1, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 11, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-09-19T09:43:51.065 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 181, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 1893, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 134, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 204, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 12891, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 4, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 833, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 7867829, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 12891, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:43:51.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 1418, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 1418, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 11473, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 297, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 5726, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 28382, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 235, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 19701, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 13415, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 171, 2024-09-19T09:43:51.067 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 18729 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 70, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 334, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 131, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 12622, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 12407, 2024-09-19T09:43:51.068 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 82, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 6, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 4, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 1991, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 183, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 9, 2024-09-19T09:43:51.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 63913, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 63913, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 82, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-09-19T09:43:51.070 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 82, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 7, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 136456206, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 0, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 6548, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 173.795669574, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.026541794 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 0 2024-09-19T09:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 158, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 14413, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 14255, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 161, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 1914, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 1753, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 331, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 27807, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 27476, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 0, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 15784, 2024-09-19T09:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 15784, 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 145876, 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 223520 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 45166, 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 1690, 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 37031, 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 449, 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 3321, 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 11529, 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 29.531389619, 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002561487 2024-09-19T09:43:51.073 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 128, 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.014570142, 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.007926329 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 225, 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 6.299510281, 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.027997823 2024-09-19T09:43:51.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 6846, 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 4.216211014, 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000615864 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-09-19T09:43:51.076 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1776, 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 12.643293062, 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.007118971 2024-09-19T09:43:51.077 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 494, 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.619144788, 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.003277621 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 50, 2024-09-19T09:43:51.078 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.022565309, 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000451306 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1702, 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 4.142815413, 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002434086 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 486, 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 3.547020882, 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.007298396 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.079 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1866, 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 18.901752338, 2024-09-19T09:43:51.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.010129556 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 238, 2024-09-19T09:43:51.081 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 8.700873724, 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.036558292 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 436, 2024-09-19T09:43:51.083 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 5.074141097, 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.011637938 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 11098, 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 30.873727565, 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002781918 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 3, 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 2, 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 1, 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 19706, 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 19706, 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 1536, 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-09-19T09:43:51.085 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:51.086 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:51.087 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:51.088 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 340242, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 243, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7688, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 158, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:51.089 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 866461, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 23581, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 34142, 2024-09-19T09:43:51.090 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 136256217, 2024-09-19T09:43:51.091 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 33, 2024-09-19T09:43:51.093 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 34142, 2024-09-19T09:43:51.093 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-09-19T09:43:51.093 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 34142, 2024-09-19T09:43:51.093 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 56.299703399, 2024-09-19T09:43:51.093 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001648986 2024-09-19T09:43:51.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-09-19T09:43:51.094 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-09-19T09:43:51.094 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 34142, 2024-09-19T09:43:51.094 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 34393 2024-09-19T09:43:51.094 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 34142, 2024-09-19T09:43:51.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 13200, 2024-09-19T09:43:51.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 20942, 2024-09-19T09:43:51.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 0, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 10, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 309, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 6857, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 187, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 7, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 13433, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-09-19T09:43:51.095 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 12891, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 20, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 278, 2024-09-19T09:43:51.096 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-09-19T09:43:51.097 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 81, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 12, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 12, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 0, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 320, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 0, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 81 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-09-19T09:43:51.098 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 1, 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 1994 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 14, 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 6, 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 13378, 2024-09-19T09:43:51.099 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 12407, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 109864, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 25138290, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 109864, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:51.100 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 109864, 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 25138290, 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:51.101 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 34142, 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 137509364, 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 34142, 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 137509364, 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:51.102 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 34142, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 34142, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 34142, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 34142, 2024-09-19T09:43:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 12407, 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 1253147, 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 12407, 2024-09-19T09:43:51.104 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 309, 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 1253147, 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x562abf72e960": { 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-19T09:43:51.105 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 63913, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 132261902, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 63913, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 6548, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 132261902, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:51.106 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:51.107 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-19T09:43:51.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:51 smithi136 ceph-mon[34840]: pgmap v473: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:51.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:51 smithi042 ceph-mon[31223]: pgmap v473: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:51.973 INFO:tasks.check_counter:Daemon mds.h mds.exported=181 2024-09-19T09:43:51.974 INFO:tasks.check_counter:Daemon mds.h mds.imported=134 2024-09-19T09:43:51.974 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T09:43:51.974 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T09:43:52.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:51 smithi171 ceph-mon[35803]: pgmap v473: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:52.219 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:43:52.700 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-19T09:43:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 537, 2024-09-19T09:43:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 518, 2024-09-19T09:43:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 960864, 2024-09-19T09:43:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 198342, 2024-09-19T09:43:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 5, 2024-09-19T09:43:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 1, 2024-09-19T09:43:52.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.063455129, 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.023605534, 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.032200560, 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.010636193, 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 518, 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.030031372, 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000057975 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 830160, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 74640 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 3, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 93, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 716, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 230586, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 4, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 3, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.005944885, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.003694973, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.001255807, 2024-09-19T09:43:52.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000057622, 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 91, 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.006111960, 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000067164 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 229888 2024-09-19T09:43:52.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 718, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 720, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 5339158, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 228331, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 4, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 3, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.047892320, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.011742232, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.016565091, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.016506827, 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:52.704 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 718, 2024-09-19T09:43:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.019665001, 2024-09-19T09:43:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000027388 2024-09-19T09:43:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.705 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1920, 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.041920132, 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000021833 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:52.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-09-19T09:43:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-19T09:43:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-19T09:43:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.707 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 0, 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 0, 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 0, 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 0, 2024-09-19T09:43:52.708 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 845, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 0, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 845, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 0, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 845, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 0, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 0, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 0, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 1, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 0, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 0, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 0, 2024-09-19T09:43:52.709 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-09-19T09:43:52.710 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:43:52.711 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 0 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 0, 2024-09-19T09:43:52.712 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:43:52.713 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 0, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 0, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 2592, 2024-09-19T09:43:52.714 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 0, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 4, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 2, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 9349917, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 9348779, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.715 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 2592 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 13, 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 957, 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 944, 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 11, 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 246, 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 235, 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 845, 2024-09-19T09:43:52.716 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 1785, 2024-09-19T09:43:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 940, 2024-09-19T09:43:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 0, 2024-09-19T09:43:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 0, 2024-09-19T09:43:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 0, 2024-09-19T09:43:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 50936, 2024-09-19T09:43:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 215328 2024-09-19T09:43:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-09-19T09:43:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 0, 2024-09-19T09:43:52.717 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 0, 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 0, 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 0, 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 0, 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-09-19T09:43:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-09-19T09:43:52.719 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-09-19T09:43:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.722 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-09-19T09:43:52.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.725 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-09-19T09:43:52.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-09-19T09:43:52.728 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.729 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 1, 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 0, 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 1, 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 0, 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 0, 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 1535, 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-09-19T09:43:52.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-09-19T09:43:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:52.731 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:52.732 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:52.733 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:52.734 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 181458, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 52, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7688, 2024-09-19T09:43:52.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 158, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 640720, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 4489, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-09-19T09:43:52.736 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-09-19T09:43:52.737 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 1109, 2024-09-19T09:43:52.737 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 21, 2024-09-19T09:43:52.737 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 3, 2024-09-19T09:43:52.737 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 1109, 2024-09-19T09:43:52.737 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-09-19T09:43:52.737 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1109, 2024-09-19T09:43:52.737 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.584986526, 2024-09-19T09:43:52.737 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000527490 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1109, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1110 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 1109, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 1109, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 0, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 660, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 0, 2024-09-19T09:43:52.738 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 447, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 1, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 0, 2024-09-19T09:43:52.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-09-19T09:43:52.740 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-09-19T09:43:52.741 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 81, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 4, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 4, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 0, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 0, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 2, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 0 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 0, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:43:52.742 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 0, 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 0, 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 0, 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-09-19T09:43:52.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 1254, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 6177515, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 1254, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1254, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 6177515, 2024-09-19T09:43:52.744 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:52.745 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.745 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.745 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.745 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:52.745 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.745 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-09-19T09:43:52.745 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:52.745 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-19T09:43:52.745 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:52.745 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 1109, 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 5155618, 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1109, 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 5155618, 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:52.746 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 1109, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 1109, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1109, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 1109, 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:52.747 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:52.748 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x55fac1a50b40": { 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-19T09:43:52.749 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-19T09:43:52.750 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-19T09:43:53.514 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-19T09:43:53.514 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-19T09:43:53.514 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T09:43:53.515 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T09:43:53.778 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:43:53.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:53 smithi171 ceph-mon[35803]: pgmap v474: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:53 smithi136 ceph-mon[34840]: pgmap v474: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:53.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:53 smithi042 ceph-mon[31223]: pgmap v474: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:54.318 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-09-19T09:43:54.318 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:54.318 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 7148, 2024-09-19T09:43:54.318 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 4690, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 2734656, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 1416008, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 24, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 5, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.360970551, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.132524107, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.285846429, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.010921762, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 4688, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.114168526, 2024-09-19T09:43:54.319 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000024353 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 10842, 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.001559093, 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000143 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 2113, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 3363, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 692018, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 4805356, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 9, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 7, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.149609135, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.064191435, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.080399380, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.013899352, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3362, 2024-09-19T09:43:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.093598646, 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000027840 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3669, 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000602269, 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000164 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 231792 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1473, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1546, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 1304573, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 697058, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 13, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 8, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.118156936, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.047749603, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.076913988, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.008201976, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1545, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.051577311, 2024-09-19T09:43:54.323 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000033383 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2097, 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000411094, 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000196 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 847216, 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 88048 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-09-19T09:43:54.324 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 976, 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.443458993, 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000454363 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-09-19T09:43:54.325 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 848, 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.037842664, 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000044625 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 825, 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 761, 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 761, 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1.646852362, 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002164063 2024-09-19T09:43:54.326 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 64, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 11, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 57, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 19, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 17, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 21, 2024-09-19T09:43:54.327 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 25, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 311, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 0, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 0, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 7, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 1750, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 1246, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 62, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 81, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 3, 2024-09-19T09:43:54.328 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 27, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 24, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 33, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 353, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 240, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 13, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 833, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 7867829, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 240, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-09-19T09:43:54.329 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 6, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 6, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 234, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 29, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 179, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 483, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 3, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 357, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 182, 2024-09-19T09:43:54.330 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 57, 2024-09-19T09:43:54.331 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 637 2024-09-19T09:43:54.331 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.331 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-09-19T09:43:54.331 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-09-19T09:43:54.331 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 0, 2024-09-19T09:43:54.331 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 0, 2024-09-19T09:43:54.331 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 91, 2024-09-19T09:43:54.331 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 43, 2024-09-19T09:43:54.331 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 11, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 343, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 330, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 3, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 1, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 4, 2024-09-19T09:43:54.332 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 43, 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 27, 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 1392, 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-09-19T09:43:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-09-19T09:43:54.334 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 1392, 2024-09-19T09:43:54.334 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-09-19T09:43:54.334 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-09-19T09:43:54.334 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 3, 2024-09-19T09:43:54.334 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-09-19T09:43:54.334 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-09-19T09:43:54.334 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 3, 2024-09-19T09:43:54.334 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 2, 2024-09-19T09:43:54.334 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-09-19T09:43:54.334 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 7059421, 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 0, 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 357, 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.969642006, 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002716084 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 0 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 46, 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 525, 2024-09-19T09:43:54.335 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 479, 2024-09-19T09:43:54.336 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 45, 2024-09-19T09:43:54.336 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 204, 2024-09-19T09:43:54.336 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 159, 2024-09-19T09:43:54.336 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 57, 2024-09-19T09:43:54.336 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 1060, 2024-09-19T09:43:54.336 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 1003, 2024-09-19T09:43:54.336 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 0, 2024-09-19T09:43:54.336 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 421, 2024-09-19T09:43:54.336 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 421, 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 69464, 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 223520 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 1509, 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 236, 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 825, 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 42, 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 644, 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 13, 2024-09-19T09:43:54.337 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.048244672, 2024-09-19T09:43:54.338 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.003711128 2024-09-19T09:43:54.338 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.338 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-09-19T09:43:54.338 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 5, 2024-09-19T09:43:54.338 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.013323233, 2024-09-19T09:43:54.338 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002664646 2024-09-19T09:43:54.338 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.338 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-09-19T09:43:54.338 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.338 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 7, 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.143019791, 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.020431398 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 286, 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.091133179, 2024-09-19T09:43:54.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000318647 2024-09-19T09:43:54.340 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.340 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-09-19T09:43:54.340 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.340 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.340 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.340 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.340 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-09-19T09:43:54.340 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.340 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.340 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.341 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.341 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-09-19T09:43:54.341 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.341 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.341 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.341 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.341 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-09-19T09:43:54.341 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.342 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.342 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.342 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.342 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-09-19T09:43:54.342 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.342 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.342 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.342 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.342 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-09-19T09:43:54.342 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.343 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.343 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.343 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.343 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-09-19T09:43:54.343 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 9, 2024-09-19T09:43:54.344 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.013551190, 2024-09-19T09:43:54.344 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001505687 2024-09-19T09:43:54.344 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.344 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-09-19T09:43:54.344 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3, 2024-09-19T09:43:54.344 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.002406978, 2024-09-19T09:43:54.344 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000802326 2024-09-19T09:43:54.344 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 59, 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.049083197, 2024-09-19T09:43:54.345 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000831918 2024-09-19T09:43:54.346 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.346 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-09-19T09:43:54.346 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 12, 2024-09-19T09:43:54.346 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.316547269, 2024-09-19T09:43:54.346 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.026378939 2024-09-19T09:43:54.346 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.346 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-09-19T09:43:54.346 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.347 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.347 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.347 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.347 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-09-19T09:43:54.347 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.347 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.347 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.347 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.347 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-09-19T09:43:54.347 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 38, 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.334528233, 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.008803374 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.348 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3, 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.002360327, 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000786775 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.349 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.350 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 9, 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.012369143, 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001374349 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 317, 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.620285150, 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001956735 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-09-19T09:43:54.351 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 1, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 0, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 1, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 452, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 452, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 1524, 2024-09-19T09:43:54.352 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:54.353 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:54.354 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 296030, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 118, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:54.355 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 7688, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 158, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-09-19T09:43:54.356 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 207630, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 2611, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 1221, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 2960177, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 33, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 1221, 2024-09-19T09:43:54.357 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1221, 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2.750944099, 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002253025 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1221, 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1313 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 1221, 2024-09-19T09:43:54.358 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 294, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 927, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 0, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 10, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 54, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 411, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 41, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 403, 2024-09-19T09:43:54.359 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 240, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 20, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:43:54.360 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 4, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-09-19T09:43:54.361 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 81, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 2, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 12, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 12, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 93, 2024-09-19T09:43:54.362 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 0, 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 37 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 1, 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 45 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-09-19T09:43:54.363 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 6, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 391, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 330, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 10730, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 3753268, 2024-09-19T09:43:54.364 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 10730, 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 10730, 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 3753268, 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-09-19T09:43:54.365 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 1221, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 2993507, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 1221, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2993507, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.366 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:54.367 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 1221, 2024-09-19T09:43:54.368 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 1221, 2024-09-19T09:43:54.368 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 1221, 2024-09-19T09:43:54.368 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1221, 2024-09-19T09:43:54.368 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:54.368 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.368 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.368 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.368 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:54.368 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.368 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:43:54.369 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:54.369 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-09-19T09:43:54.369 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:54.369 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 330, 2024-09-19T09:43:54.369 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 33330, 2024-09-19T09:43:54.369 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:54.369 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 330, 2024-09-19T09:43:54.369 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:54.370 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:54.370 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 54, 2024-09-19T09:43:54.370 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 33330, 2024-09-19T09:43:54.370 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:54.370 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.370 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.370 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.370 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:54.370 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:54.370 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x564b3efde960": { 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 1392, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 2865117, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 1392, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 357, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2865117, 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:54.371 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:54.372 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:54.372 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:54.372 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:54.372 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:54.372 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-09-19T09:43:55.077 INFO:tasks.check_counter:Daemon mds.c mds.exported=27 2024-09-19T09:43:55.077 INFO:tasks.check_counter:Daemon mds.c mds.imported=33 2024-09-19T09:43:55.077 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T09:43:55.078 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T09:43:55.342 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:43:55.753 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:55 smithi171 ceph-mon[35803]: pgmap v475: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:43:55.860 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 2006, 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1940, 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 1471785, 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 4343867, 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 17, 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 4, 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.159826907, 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.059087766, 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.088266179, 2024-09-19T09:43:55.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.022185285, 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1942, 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.064148865, 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000033032 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1946, 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000335866, 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000172 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 843776, 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 91952 2024-09-19T09:43:55.862 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.863 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:55.863 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 7029, 2024-09-19T09:43:55.863 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 4647, 2024-09-19T09:43:55.863 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 2669441, 2024-09-19T09:43:55.863 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 1572078, 2024-09-19T09:43:55.863 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 13, 2024-09-19T09:43:55.863 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 7, 2024-09-19T09:43:55.863 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.350487985, 2024-09-19T09:43:55.863 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.133129819, 2024-09-19T09:43:55.864 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.286853138, 2024-09-19T09:43:55.864 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.004681782, 2024-09-19T09:43:55.864 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:55.864 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 4645, 2024-09-19T09:43:55.864 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.109083305, 2024-09-19T09:43:55.864 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000023484 2024-09-19T09:43:55.864 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.864 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:55.864 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 11040, 2024-09-19T09:43:55.864 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.001688859, 2024-09-19T09:43:55.865 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000152 2024-09-19T09:43:55.865 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 5120, 2024-09-19T09:43:55.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 235760 2024-09-19T09:43:55.865 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.865 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:55.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1955, 2024-09-19T09:43:55.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 3468, 2024-09-19T09:43:55.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 643193, 2024-09-19T09:43:55.866 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 1977238, 2024-09-19T09:43:55.866 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 19, 2024-09-19T09:43:55.866 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 7, 2024-09-19T09:43:55.866 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.142738206, 2024-09-19T09:43:55.866 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.056223146, 2024-09-19T09:43:55.866 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.089492457, 2024-09-19T09:43:55.866 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.008248549, 2024-09-19T09:43:55.866 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:55.866 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3464, 2024-09-19T09:43:55.866 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.094570990, 2024-09-19T09:43:55.867 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000027301 2024-09-19T09:43:55.867 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.867 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:55.867 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3931, 2024-09-19T09:43:55.867 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000698256, 2024-09-19T09:43:55.867 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000177 2024-09-19T09:43:55.868 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.868 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:43:55.868 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:43:55.868 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.868 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-09-19T09:43:55.868 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-09-19T09:43:55.868 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-09-19T09:43:55.868 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1274, 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.588379746, 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000461836 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 841, 2024-09-19T09:43:55.869 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.035924559, 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000042716 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 997, 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 947, 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 947, 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2.028999188, 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002142554 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-09-19T09:43:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 50, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 11, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 32, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 11, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 6, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 15, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 15, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 446, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 1, 2024-09-19T09:43:55.871 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 1, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 5, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 1863, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 1431, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 42, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 72, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 1, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 1, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 46, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 169, 2024-09-19T09:43:55.872 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 44, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 325, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 251, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 4, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 833, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 7867829, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 251, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 12, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:43:55.873 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 12, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 239, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 9, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 253, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 621, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 15, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 493, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 215, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 38, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 730 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-09-19T09:43:55.874 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 0, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 0, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 80, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 38, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 1, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 344, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 342, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 2, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-09-19T09:43:55.875 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 4, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 73, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 46, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.876 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 1580, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 1580, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 3, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 3, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 2, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-09-19T09:43:55.877 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 7645266, 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 0, 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 471, 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1.328501793, 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002820598 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 0 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 36, 2024-09-19T09:43:55.878 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 624, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 588, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 34, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 238, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 204, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 32, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 1159, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 1127, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 1, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 599, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 598, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 60692, 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 223520 2024-09-19T09:43:55.879 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 1592, 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 214, 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 997, 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 75, 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 630, 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 63, 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.085960693, 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001364455 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-09-19T09:43:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 26, 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.069389296, 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002668819 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 17, 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.040787453, 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002399261 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.881 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 272, 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.090988657, 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000334517 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1, 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000249752, 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000249752 2024-09-19T09:43:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 29, 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.027168036, 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000936828 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-09-19T09:43:55.884 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 26, 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.031014316, 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001192858 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1, 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000300855, 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000300855 2024-09-19T09:43:55.885 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 80, 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.049329818, 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000616622 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 31, 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.209042107, 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.006743293 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.886 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 55, 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.360034507, 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.006546081 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-09-19T09:43:55.887 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.888 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.888 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.888 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.888 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-09-19T09:43:55.888 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.888 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.888 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.888 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 15, 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.073440864, 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.004896057 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-09-19T09:43:55.889 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.890 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 21, 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.018202932, 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000866806 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 310, 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.973089902, 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.003138999 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:43:55.891 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 3, 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 2, 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 1, 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 553, 2024-09-19T09:43:55.892 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 553, 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 274, 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:55.893 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:55.894 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:55.895 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 287228, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 100, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-09-19T09:43:55.896 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 7688, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 158, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 148508, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 742, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-09-19T09:43:55.897 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 1360, 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 3566466, 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 33, 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 1360, 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1360, 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2.881941433, 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002119074 2024-09-19T09:43:55.898 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1360, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1467 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 1360, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 313, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 1047, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 0, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 10, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 62, 2024-09-19T09:43:55.899 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 533, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 50, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 365, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 251, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 20, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:43:55.900 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 18, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-09-19T09:43:55.901 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 81, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 2, 2024-09-19T09:43:55.902 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 12, 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 12, 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 115, 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 0, 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 43 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 1, 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-09-19T09:43:55.903 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 73 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 8, 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 6, 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 353, 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 342, 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.904 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 10986, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 3782754, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 10986, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 10986, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 3782754, 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:55.905 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-09-19T09:43:55.906 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:55.907 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:55.907 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 1360, 2024-09-19T09:43:55.907 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 3601008, 2024-09-19T09:43:55.907 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 1360, 2024-09-19T09:43:55.907 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 3601008, 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-09-19T09:43:55.908 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:55.909 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:55.909 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 1360, 2024-09-19T09:43:55.909 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 1360, 2024-09-19T09:43:55.909 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 1360, 2024-09-19T09:43:55.909 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1360, 2024-09-19T09:43:55.909 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:55.909 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.909 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.910 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.910 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:55.910 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.910 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:43:55.910 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:55.910 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-09-19T09:43:55.910 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:55.911 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 342, 2024-09-19T09:43:55.911 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 34542, 2024-09-19T09:43:55.911 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:55.911 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 342, 2024-09-19T09:43:55.911 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:55.912 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:55.912 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 62, 2024-09-19T09:43:55.912 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 34542, 2024-09-19T09:43:55.912 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:55.912 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.912 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x55afbcdd2960": { 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 1580, 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 3450962, 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 1580, 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:55.913 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:55.914 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 471, 2024-09-19T09:43:55.914 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 3450962, 2024-09-19T09:43:55.914 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:55.914 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:55.914 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:55.914 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:55.914 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:55.914 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:55.914 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-09-19T09:43:55.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:55 smithi042 ceph-mon[31223]: pgmap v475: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:43:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:55 smithi136 ceph-mon[34840]: pgmap v475: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:43:56.688 INFO:tasks.check_counter:Daemon mds.f mds.exported=46 2024-09-19T09:43:56.688 INFO:tasks.check_counter:Daemon mds.f mds.imported=44 2024-09-19T09:43:56.688 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T09:43:56.688 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T09:43:56.941 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:43:57.423 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-09-19T09:43:57.423 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:57.423 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1818, 2024-09-19T09:43:57.423 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1976, 2024-09-19T09:43:57.423 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 574920, 2024-09-19T09:43:57.424 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 5906031, 2024-09-19T09:43:57.424 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 10, 2024-09-19T09:43:57.424 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 5, 2024-09-19T09:43:57.424 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.150433518, 2024-09-19T09:43:57.424 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.059358474, 2024-09-19T09:43:57.424 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.055089783, 2024-09-19T09:43:57.424 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.030420393, 2024-09-19T09:43:57.424 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1975, 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.077792547, 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000039388 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1466, 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000299305, 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000204 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:43:57.425 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.426 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:57.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 3401, 2024-09-19T09:43:57.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 5990, 2024-09-19T09:43:57.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 1106113, 2024-09-19T09:43:57.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 3256920, 2024-09-19T09:43:57.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 13, 2024-09-19T09:43:57.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 7, 2024-09-19T09:43:57.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.223116450, 2024-09-19T09:43:57.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.093069690, 2024-09-19T09:43:57.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.135577583, 2024-09-19T09:43:57.427 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.016096108, 2024-09-19T09:43:57.427 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:57.427 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 5988, 2024-09-19T09:43:57.427 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.132111468, 2024-09-19T09:43:57.427 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000022062 2024-09-19T09:43:57.427 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.427 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:57.427 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 6636, 2024-09-19T09:43:57.427 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.001057575, 2024-09-19T09:43:57.427 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000159 2024-09-19T09:43:57.428 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:43:57.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 231168 2024-09-19T09:43:57.428 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.428 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:57.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 7974, 2024-09-19T09:43:57.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 5854, 2024-09-19T09:43:57.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 4235132, 2024-09-19T09:43:57.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 2005327, 2024-09-19T09:43:57.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 23, 2024-09-19T09:43:57.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 8, 2024-09-19T09:43:57.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.420821028, 2024-09-19T09:43:57.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.156071088, 2024-09-19T09:43:57.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.324983737, 2024-09-19T09:43:57.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.017238473, 2024-09-19T09:43:57.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:57.429 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 5853, 2024-09-19T09:43:57.429 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.144078369, 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000024616 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 11827, 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.001817676, 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000153 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 855952, 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 87264 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.430 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1650, 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.988208539, 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000598914 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:57.431 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.432 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-09-19T09:43:57.432 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-09-19T09:43:57.432 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-09-19T09:43:57.432 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1679, 2024-09-19T09:43:57.432 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.227852079, 2024-09-19T09:43:57.432 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000135707 2024-09-19T09:43:57.432 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:57.432 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.432 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-09-19T09:43:57.432 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 1506, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 1432, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1432, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2.472854529, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001726853 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 74, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 20, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 1, 2024-09-19T09:43:57.433 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 45, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 14, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 18, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 13, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 21, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 325, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 0, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 0, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 5, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 2840, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 2080, 2024-09-19T09:43:57.434 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 68, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 103, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 2, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 38, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 12, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 59, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 777, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 1096, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 13, 2024-09-19T09:43:57.435 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 833, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 7867829, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 1096, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 56, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 56, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 1040, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 17, 2024-09-19T09:43:57.436 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 198, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 1000, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 1, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 491, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 290, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 45, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 1329 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 0, 2024-09-19T09:43:57.437 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 0, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 117, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 22, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 7, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 792, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 783, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 3, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 1, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-09-19T09:43:57.438 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 4, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 27, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 38, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 1, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 2592, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-09-19T09:43:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 2592, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 4, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 4, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 2, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 9349917, 2024-09-19T09:43:57.440 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 0, 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 399, 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1.126753998, 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002823944 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 0 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 40, 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 973, 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 933, 2024-09-19T09:43:57.441 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 38, 2024-09-19T09:43:57.444 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 257, 2024-09-19T09:43:57.444 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 219, 2024-09-19T09:43:57.444 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 45, 2024-09-19T09:43:57.444 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 1950, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 1905, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 0, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 870, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 870, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 71752, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 223520 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 2466, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 195, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 1506, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 43, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 857, 2024-09-19T09:43:57.445 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 14, 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.022042160, 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001574440 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2, 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.008159966, 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.004079983 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.446 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 4, 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.044254123, 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.011063530 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 480, 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.157854145, 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000328862 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.447 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-09-19T09:43:57.448 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.449 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.449 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.449 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.449 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-09-19T09:43:57.449 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.449 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.449 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.449 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.449 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-09-19T09:43:57.449 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.450 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.450 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.450 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.450 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-09-19T09:43:57.450 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 4, 2024-09-19T09:43:57.450 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.008552276, 2024-09-19T09:43:57.450 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002138069 2024-09-19T09:43:57.450 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 8, 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.013492855, 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001686606 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1, 2024-09-19T09:43:57.451 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000870098, 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000870098 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 94, 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.053935402, 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000573780 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 11, 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.209158628, 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.019014420 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.452 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 50, 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.592919087, 2024-09-19T09:43:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.011858381 2024-09-19T09:43:57.454 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.454 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-09-19T09:43:57.454 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.454 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.454 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.454 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.454 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-09-19T09:43:57.454 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.454 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.455 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.455 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.455 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-09-19T09:43:57.455 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1, 2024-09-19T09:43:57.455 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000505561, 2024-09-19T09:43:57.455 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000505561 2024-09-19T09:43:57.455 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.455 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-09-19T09:43:57.455 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.456 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.456 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.456 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.456 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-09-19T09:43:57.456 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.456 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.456 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.456 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.456 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-09-19T09:43:57.456 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.457 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.457 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.457 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.457 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-09-19T09:43:57.457 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.457 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.457 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.457 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.457 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-09-19T09:43:57.457 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 10, 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.027521685, 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002752168 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 753, 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1.333588543, 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001771033 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:43:57.458 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-09-19T09:43:57.459 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.459 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.459 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.459 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:57.459 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.459 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-09-19T09:43:57.459 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-09-19T09:43:57.459 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 1, 2024-09-19T09:43:57.459 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 0, 2024-09-19T09:43:57.459 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 1, 2024-09-19T09:43:57.460 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-09-19T09:43:57.460 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 891, 2024-09-19T09:43:57.460 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 891, 2024-09-19T09:43:57.460 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 272, 2024-09-19T09:43:57.460 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-09-19T09:43:57.460 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.460 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-09-19T09:43:57.460 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:57.460 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:57.460 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:57.461 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:57.461 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:57.461 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:57.461 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:57.461 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:57.461 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:57.461 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:57.461 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:57.461 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:57.461 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:57.462 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:57.462 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:57.462 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:57.462 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:57.462 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:57.462 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:57.462 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:57.462 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:57.462 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:57.463 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:57.463 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:57.463 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:57.463 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:57.463 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:57.463 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:57.463 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:57.463 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:57.463 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:57.463 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 295786, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 113, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:57.464 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 7688, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 158, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 174901, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 1873, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:57.465 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 2614, 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 5512117, 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 33, 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 2614, 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2614, 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 4.089916891, 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001564620 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.466 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2614, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2720 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 2614, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 1172, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 1442, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 0, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 10, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 76, 2024-09-19T09:43:57.467 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 475, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 52, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 1, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 832, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 1096, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 20, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:43:57.468 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 1, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-09-19T09:43:57.469 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-09-19T09:43:57.470 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-09-19T09:43:57.470 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-09-19T09:43:57.470 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-09-19T09:43:57.470 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-09-19T09:43:57.470 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-09-19T09:43:57.470 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-09-19T09:43:57.470 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-09-19T09:43:57.470 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-09-19T09:43:57.471 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-09-19T09:43:57.471 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-09-19T09:43:57.471 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-09-19T09:43:57.471 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 81, 2024-09-19T09:43:57.471 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-09-19T09:43:57.471 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 2, 2024-09-19T09:43:57.471 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 12, 2024-09-19T09:43:57.471 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 12, 2024-09-19T09:43:57.471 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 119, 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 0, 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 38 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 1, 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-09-19T09:43:57.472 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 29 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 14, 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 6, 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 819, 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 783, 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:57.473 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 13189, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 4716784, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 13189, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 13189, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 4716784, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.474 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2614, 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 5591208, 2024-09-19T09:43:57.475 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2614, 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 5591208, 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-09-19T09:43:57.476 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2614, 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 2614, 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2614, 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2614, 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.477 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 783, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 79091, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 783, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 76, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 79091, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.478 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.479 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:57.479 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:57.479 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x5612ddb58960": { 2024-09-19T09:43:57.479 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:57.479 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-09-19T09:43:57.479 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:57.479 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 2592, 2024-09-19T09:43:57.479 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 5155613, 2024-09-19T09:43:57.479 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:57.479 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 2592, 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 399, 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 5155613, 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:57.480 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-09-19T09:43:57.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:57 smithi042 ceph-mon[31223]: pgmap v476: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:58.079 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:57 smithi171 ceph-mon[35803]: pgmap v476: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:57 smithi136 ceph-mon[34840]: pgmap v476: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:43:58.194 INFO:tasks.check_counter:Daemon mds.i mds.exported=38 2024-09-19T09:43:58.194 INFO:tasks.check_counter:Daemon mds.i mds.imported=59 2024-09-19T09:43:58.194 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T09:43:58.194 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T09:43:58.442 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 382, 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 384, 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 42045048, 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 121540, 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 7, 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 3, 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.056536360, 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.009612323, 2024-09-19T09:43:58.931 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.032327718, 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.010640861, 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 382, 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.016541089, 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000043301 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:43:58.932 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 401, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 493, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 58825093, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 359061, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 6, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 5, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.064809368, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.014324402, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.034754113, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.011907867, 2024-09-19T09:43:58.933 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 491, 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.019045919, 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000038790 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 231856 2024-09-19T09:43:58.934 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 742, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 723, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 32612618, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 264176, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 5, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 4, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.098996719, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.027010700, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.056259934, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.018352366, 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:43:58.935 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 723, 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.038539591, 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000053305 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 830704, 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 75920 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.936 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2208, 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.058434765, 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000026465 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.937 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 0, 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 0, 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.938 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 0, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 0, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 14405, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 0, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 14405, 2024-09-19T09:43:58.939 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 14404, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 1, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-09-19T09:43:58.940 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:43:58.941 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 0, 2024-09-19T09:43:58.942 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 0 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 0, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 0, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 0, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 0, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 0, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 0, 2024-09-19T09:43:58.943 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:43:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 0, 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 63913, 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 0, 2024-09-19T09:43:58.945 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 82, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 7, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 136456206, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 136454555, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.946 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 63913 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 144, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 14411, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 14267, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 146, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 1908, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 1762, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 14405, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 27669, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 13264, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 0, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 0, 2024-09-19T09:43:58.947 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 0, 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 88520, 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 215328 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 0, 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 0, 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 0, 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 0, 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 0, 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.948 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.949 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.950 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.951 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.952 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.953 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-09-19T09:43:58.953 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.953 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.953 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-09-19T09:43:58.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.955 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.956 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-09-19T09:43:58.956 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.956 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.956 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.956 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.956 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-09-19T09:43:58.956 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.956 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.956 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.956 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.957 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.958 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:43:58.960 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 3, 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 2, 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 1, 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 0, 2024-09-19T09:43:58.961 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 0, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 1528, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:43:58.962 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:43:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:43:58.964 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 227190, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 197, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 7688, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 158, 2024-09-19T09:43:58.965 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 10698809, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 84351, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-09-19T09:43:58.966 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 1374, 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 21, 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 3, 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 1374, 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1374, 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.958980536, 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000697947 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1374, 2024-09-19T09:43:58.967 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1375 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 1374, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 1374, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 0, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 851, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 0, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 521, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 0, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 0, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-09-19T09:43:58.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 1, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-09-19T09:43:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-09-19T09:43:58.970 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 81, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 2, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 9, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 9, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-09-19T09:43:58.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 0, 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 2, 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 0 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 0, 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 0 2024-09-19T09:43:58.972 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 0, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 0, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 0, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:58.973 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 1521, 2024-09-19T09:43:58.974 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 133335402, 2024-09-19T09:43:58.974 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:58.974 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 1521, 2024-09-19T09:43:58.974 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:58.975 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 1521, 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 133335402, 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-09-19T09:43:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 1374, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 132267959, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 1374, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 132267959, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:58.977 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 1374, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 1374, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 1374, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1374, 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:58.978 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:58.979 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x55768b06eb40": { 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-09-19T09:43:58.980 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:58.981 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-09-19T09:43:58.982 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-09-19T09:43:59.678 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-19T09:43:59.678 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-19T09:43:59.678 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T09:43:59.692 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:43:59.692 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:43:59.692 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:43:59.714 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-19T09:43:59.714 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:43:59.775 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:43:59.937 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:43:59 smithi136 ceph-mon[34840]: pgmap v477: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:43:59.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:43:59 smithi042 ceph-mon[31223]: pgmap v477: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:44:00.083 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:00.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:43:59 smithi171 ceph-mon[35803]: pgmap v477: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:44:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.507+0000 7fe52a050640 1 -- 172.21.15.42:0/4235917754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe524102570 msgr2=0x7fe5241029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.507+0000 7fe52a050640 1 --2- 172.21.15.42:0/4235917754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe524102570 0x7fe5241029b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe518009900 tx=0x7fe51802a480 comp rx=0 tx=0).stop 2024-09-19T09:44:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.507+0000 7fe52a050640 1 -- 172.21.15.42:0/4235917754 shutdown_connections 2024-09-19T09:44:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.507+0000 7fe52a050640 1 --2- 172.21.15.42:0/4235917754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe524102ef0 0x7fe52410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.507+0000 7fe52a050640 1 --2- 172.21.15.42:0/4235917754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe524102570 0x7fe5241029b0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.507+0000 7fe52a050640 1 --2- 172.21.15.42:0/4235917754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe524100e20 0x7fe524101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.507+0000 7fe52a050640 1 -- 172.21.15.42:0/4235917754 >> 172.21.15.42:0/4235917754 conn(0x7fe5240fc7d0 msgr2=0x7fe5240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.507+0000 7fe52a050640 1 -- 172.21.15.42:0/4235917754 shutdown_connections 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.507+0000 7fe52a050640 1 -- 172.21.15.42:0/4235917754 wait complete. 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe52a050640 1 Processor -- start 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe52a050640 1 -- start start 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe52a050640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe524100e20 0x7fe5241a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe52a050640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe524102570 0x7fe5241a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe52a050640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe524102ef0 0x7fe52419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe52a050640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe524110f80 con 0x7fe524102570 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe52a050640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe524110e00 con 0x7fe524100e20 2024-09-19T09:44:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe52a050640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe524111100 con 0x7fe524102ef0 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe522ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe524102570 0x7fe5241a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe522ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe524102570 0x7fe5241a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36852/0 (socket says 172.21.15.42:36852) 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe522ffd640 1 -- 172.21.15.42:0/457728294 learned_addr learned my addr 172.21.15.42:0/457728294 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe5237fe640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe524100e20 0x7fe5241a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.508+0000 7fe523fff640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe524102ef0 0x7fe52419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe5237fe640 1 -- 172.21.15.42:0/457728294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe524102ef0 msgr2=0x7fe52419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe5237fe640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe524102ef0 0x7fe52419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe5237fe640 1 -- 172.21.15.42:0/457728294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe524102570 msgr2=0x7fe5241a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe5237fe640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe524102570 0x7fe5241a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe5237fe640 1 -- 172.21.15.42:0/457728294 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52419acc0 con 0x7fe524100e20 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe522ffd640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe524102570 0x7fe5241a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe5237fe640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe524100e20 0x7fe5241a03d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe51400e9f0 tx=0x7fe51400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe520ff9640 1 -- 172.21.15.42:0/457728294 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51400ccc0 con 0x7fe524100e20 2024-09-19T09:44:00.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe52a050640 1 -- 172.21.15.42:0/457728294 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe52419afb0 con 0x7fe524100e20 2024-09-19T09:44:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe520ff9640 1 -- 172.21.15.42:0/457728294 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe514010910 con 0x7fe524100e20 2024-09-19T09:44:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe520ff9640 1 -- 172.21.15.42:0/457728294 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe514018960 con 0x7fe524100e20 2024-09-19T09:44:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.509+0000 7fe52a050640 1 -- 172.21.15.42:0/457728294 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5241a72a0 con 0x7fe524100e20 2024-09-19T09:44:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.510+0000 7fe52a050640 1 -- 172.21.15.42:0/457728294 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe524101200 con 0x7fe524100e20 2024-09-19T09:44:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.511+0000 7fe520ff9640 1 -- 172.21.15.42:0/457728294 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fe514010ac0 con 0x7fe524100e20 2024-09-19T09:44:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.512+0000 7fe520ff9640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe50c0a3240 0x7fe50c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.512+0000 7fe520ff9640 1 -- 172.21.15.42:0/457728294 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fe5140cfe90 con 0x7fe524100e20 2024-09-19T09:44:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.512+0000 7fe522ffd640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe50c0a3240 0x7fe50c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.513+0000 7fe522ffd640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe50c0a3240 0x7fe50c0a5700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe52410de80 tx=0x7fe518005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:00.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.515+0000 7fe520ff9640 1 -- 172.21.15.42:0/457728294 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe51409c4e0 con 0x7fe524100e20 2024-09-19T09:44:00.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.705+0000 7fe52a050640 1 -- 172.21.15.42:0/457728294 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe5241a7470 con 0x7fe524100e20 2024-09-19T09:44:00.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.705+0000 7fe520ff9640 1 -- 172.21.15.42:0/457728294 <== mon.2 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) ==== 81+0+590 (secure 0 0 0) 0x7fe5140a07e0 con 0x7fe524100e20 2024-09-19T09:44:00.708 INFO:teuthology.orchestra.run.smithi042.stderr:listed 10 entries 2024-09-19T09:44:00.708 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/1318707645 2024-09-20T09:30:26.412318+0000 2024-09-19T09:44:00.708 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/3819076248 2024-09-20T09:30:26.412318+0000 2024-09-19T09:44:00.708 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/203737163 2024-09-20T09:30:26.412318+0000 2024-09-19T09:44:00.708 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/4286810038 2024-09-20T09:30:26.412318+0000 2024-09-19T09:44:00.708 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/203737163 2024-09-20T09:30:26.412318+0000 2024-09-19T09:44:00.708 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/2538224361 2024-09-20T09:30:02.111922+0000 2024-09-19T09:44:00.708 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/2557927084 2024-09-20T09:30:02.111922+0000 2024-09-19T09:44:00.709 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/2557927084 2024-09-20T09:30:02.111922+0000 2024-09-19T09:44:00.709 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/3197478490 2024-09-20T09:30:02.111922+0000 2024-09-19T09:44:00.709 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/4227587843 2024-09-20T09:30:02.111922+0000 2024-09-19T09:44:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 -- 172.21.15.42:0/457728294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe50c0a3240 msgr2=0x7fe50c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe50c0a3240 0x7fe50c0a5700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe52410de80 tx=0x7fe518005a20 comp rx=0 tx=0).stop 2024-09-19T09:44:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 -- 172.21.15.42:0/457728294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe524100e20 msgr2=0x7fe5241a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe524100e20 0x7fe5241a03d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe51400e9f0 tx=0x7fe51400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:44:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 -- 172.21.15.42:0/457728294 shutdown_connections 2024-09-19T09:44:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fe50c0a3240 0x7fe50c0a5700 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe524102ef0 0x7fe52419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe524102570 0x7fe5241a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 --2- 172.21.15.42:0/457728294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe524100e20 0x7fe5241a03d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:00.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 -- 172.21.15.42:0/457728294 >> 172.21.15.42:0/457728294 conn(0x7fe5240fc7d0 msgr2=0x7fe524069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:00.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 -- 172.21.15.42:0/457728294 shutdown_connections 2024-09-19T09:44:00.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:00.708+0000 7fe52a050640 1 -- 172.21.15.42:0/457728294 wait complete. 2024-09-19T09:44:01.508 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:44:01.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:01.508 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:44:01.589 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-19T09:44:01.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:01.589 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:44:01.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:01.649 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-19T09:44:01.694 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:44:01.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:01.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:44:01.740 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:01 smithi042 ceph-mon[31223]: pgmap v478: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:44:01.741 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:01 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/457728294' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:44:01.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:01.748 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-09-19T09:44:01.831 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T09:44:01.900 INFO:tasks.cephadm:Teardown begin 2024-09-19T09:44:01.900 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:44:01.901 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:44:02.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:01 smithi171 ceph-mon[35803]: pgmap v478: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:44:02.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:01 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/457728294' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:44:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:01 smithi136 ceph-mon[34840]: pgmap v478: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:44:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:01 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/457728294' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:44:02.159 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.632+0000 7fb88262c640 1 -- 172.21.15.42:0/2284932574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c106a80 msgr2=0x7fb87c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.632+0000 7fb88262c640 1 --2- 172.21.15.42:0/2284932574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c106a80 0x7fb87c106e60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009930 tx=0x7fb86c02a420 comp rx=0 tx=0).stop 2024-09-19T09:44:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.632+0000 7fb88262c640 1 -- 172.21.15.42:0/2284932574 shutdown_connections 2024-09-19T09:44:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.632+0000 7fb88262c640 1 --2- 172.21.15.42:0/2284932574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c101420 0x7fb87c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.632+0000 7fb88262c640 1 --2- 172.21.15.42:0/2284932574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c100a80 0x7fb87c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.632+0000 7fb88262c640 1 --2- 172.21.15.42:0/2284932574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c106a80 0x7fb87c106e60 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.632+0000 7fb88262c640 1 -- 172.21.15.42:0/2284932574 >> 172.21.15.42:0/2284932574 conn(0x7fb87c0fc7a0 msgr2=0x7fb87c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.632+0000 7fb88262c640 1 -- 172.21.15.42:0/2284932574 shutdown_connections 2024-09-19T09:44:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.632+0000 7fb88262c640 1 -- 172.21.15.42:0/2284932574 wait complete. 2024-09-19T09:44:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb88262c640 1 Processor -- start 2024-09-19T09:44:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb88262c640 1 -- start start 2024-09-19T09:44:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb88262c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c100a80 0x7fb87c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb88262c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c101420 0x7fb87c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb88262c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c106a80 0x7fb87c1a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb88262c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c110e80 con 0x7fb87c101420 2024-09-19T09:44:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb88262c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c110d00 con 0x7fb87c100a80 2024-09-19T09:44:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb88262c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c111000 con 0x7fb87c106a80 2024-09-19T09:44:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb873fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c101420 0x7fb87c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb873fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c101420 0x7fb87c199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36872/0 (socket says 172.21.15.42:36872) 2024-09-19T09:44:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.633+0000 7fb873fff640 1 -- 172.21.15.42:0/986850466 learned_addr learned my addr 172.21.15.42:0/986850466 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:44:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb87bfff640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c100a80 0x7fb87c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb880bc9640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c106a80 0x7fb87c1a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb873fff640 1 -- 172.21.15.42:0/986850466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c106a80 msgr2=0x7fb87c1a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb873fff640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c106a80 0x7fb87c1a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb873fff640 1 -- 172.21.15.42:0/986850466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c100a80 msgr2=0x7fb87c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb873fff640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c100a80 0x7fb87c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb873fff640 1 -- 172.21.15.42:0/986850466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87c1a4890 con 0x7fb87c101420 2024-09-19T09:44:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb87bfff640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c100a80 0x7fb87c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb873fff640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c101420 0x7fb87c199810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb86400d950 tx=0x7fb86400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb879ffb640 1 -- 172.21.15.42:0/986850466 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864017070 con 0x7fb87c101420 2024-09-19T09:44:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb879ffb640 1 -- 172.21.15.42:0/986850466 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb864009c30 con 0x7fb87c101420 2024-09-19T09:44:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb879ffb640 1 -- 172.21.15.42:0/986850466 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86400f6b0 con 0x7fb87c101420 2024-09-19T09:44:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb88262c640 1 -- 172.21.15.42:0/986850466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb87c1a4a60 con 0x7fb87c101420 2024-09-19T09:44:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.634+0000 7fb88262c640 1 -- 172.21.15.42:0/986850466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb87c1a4fa0 con 0x7fb87c101420 2024-09-19T09:44:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.635+0000 7fb88262c640 1 -- 172.21.15.42:0/986850466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb87c100ee0 con 0x7fb87c101420 2024-09-19T09:44:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.636+0000 7fb879ffb640 1 -- 172.21.15.42:0/986850466 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb8640109d0 con 0x7fb87c101420 2024-09-19T09:44:02.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.637+0000 7fb879ffb640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32c0 0x7fb8680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:02.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.637+0000 7fb87bfff640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32c0 0x7fb8680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:02.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.637+0000 7fb879ffb640 1 -- 172.21.15.42:0/986850466 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb8640cf610 con 0x7fb87c101420 2024-09-19T09:44:02.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.638+0000 7fb87bfff640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32c0 0x7fb8680a5780 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb86c000c00 tx=0x7fb86c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:02.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.640+0000 7fb879ffb640 1 -- 172.21.15.42:0/986850466 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb864009de0 con 0x7fb87c101420 2024-09-19T09:44:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.852+0000 7fb88262c640 1 -- 172.21.15.42:0/986850466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb87c06ad80 con 0x7fb87c101420 2024-09-19T09:44:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.853+0000 7fb879ffb640 1 -- 172.21.15.42:0/986850466 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+12006 (secure 0 0 0) 0x7fb87c06ad80 con 0x7fb87c101420 2024-09-19T09:44:02.855 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:44:02.855 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":39,"btime":"2024-09-19T09:43:48:590759+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:43:47.983400+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:44:02.855 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 39 2024-09-19T09:44:02.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 -- 172.21.15.42:0/986850466 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32c0 msgr2=0x7fb8680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:02.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32c0 0x7fb8680a5780 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb86c000c00 tx=0x7fb86c005a20 comp rx=0 tx=0).stop 2024-09-19T09:44:02.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 -- 172.21.15.42:0/986850466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c101420 msgr2=0x7fb87c199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:02.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c101420 0x7fb87c199810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb86400d950 tx=0x7fb86400de10 comp rx=0 tx=0).stop 2024-09-19T09:44:02.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 -- 172.21.15.42:0/986850466 shutdown_connections 2024-09-19T09:44:02.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fb8680a32c0 0x7fb8680a5780 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:02.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c106a80 0x7fb87c1a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:02.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb87c101420 0x7fb87c199810 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:02.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 --2- 172.21.15.42:0/986850466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb87c100a80 0x7fb87c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:02.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 -- 172.21.15.42:0/986850466 >> 172.21.15.42:0/986850466 conn(0x7fb87c0fc7a0 msgr2=0x7fb87c0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:02.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 -- 172.21.15.42:0/986850466 shutdown_connections 2024-09-19T09:44:02.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:02.855+0000 7fb88262c640 1 -- 172.21.15.42:0/986850466 wait complete. 2024-09-19T09:44:03.893 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:44:03.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:03 smithi042 ceph-mon[31223]: pgmap v479: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T09:44:03.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:03 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/986850466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:04.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:03 smithi171 ceph-mon[35803]: pgmap v479: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T09:44:04.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:03 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/986850466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:03 smithi136 ceph-mon[34840]: pgmap v479: 97 pgs: 97 active+clean; 143 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T09:44:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:03 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/986850466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:04.160 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.672+0000 7f89344f9640 1 -- 172.21.15.42:0/3756894866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f892c1036c0 msgr2=0x7f892c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.672+0000 7f89344f9640 1 --2- 172.21.15.42:0/3756894866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f892c1036c0 0x7f892c10bbb0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f891c009900 tx=0x7f891c02a480 comp rx=0 tx=0).stop 2024-09-19T09:44:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.673+0000 7f89344f9640 1 -- 172.21.15.42:0/3756894866 shutdown_connections 2024-09-19T09:44:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.673+0000 7f89344f9640 1 --2- 172.21.15.42:0/3756894866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f892c10c180 0x7f892c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.673+0000 7f89344f9640 1 --2- 172.21.15.42:0/3756894866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f892c1036c0 0x7f892c10bbb0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.673+0000 7f89344f9640 1 --2- 172.21.15.42:0/3756894866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f892c102da0 0x7f892c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.673+0000 7f89344f9640 1 -- 172.21.15.42:0/3756894866 >> 172.21.15.42:0/3756894866 conn(0x7f892c0fc7a0 msgr2=0x7f892c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.673+0000 7f89344f9640 1 -- 172.21.15.42:0/3756894866 shutdown_connections 2024-09-19T09:44:04.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.673+0000 7f89344f9640 1 -- 172.21.15.42:0/3756894866 wait complete. 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.673+0000 7f89344f9640 1 Processor -- start 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.673+0000 7f89344f9640 1 -- start start 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f89344f9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f892c102da0 0x7f892c1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f89344f9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f892c1036c0 0x7f892c1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f89344f9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f892c10c180 0x7f892c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f89344f9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f892c112020 con 0x7f892c10c180 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f89344f9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f892c111ea0 con 0x7f892c102da0 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f89344f9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f892c1121a0 con 0x7f892c1036c0 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8931a94640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f892c1036c0 0x7f892c1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8932295640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f892c102da0 0x7f892c1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8932a96640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f892c10c180 0x7f892c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8931a94640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f892c1036c0 0x7f892c1a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.42:57856/0 (socket says 172.21.15.42:57856) 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8931a94640 1 -- 172.21.15.42:0/3746593977 learned_addr learned my addr 172.21.15.42:0/3746593977 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:44:04.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8932a96640 1 -- 172.21.15.42:0/3746593977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f892c1036c0 msgr2=0x7f892c1a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8932a96640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f892c1036c0 0x7f892c1a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8932a96640 1 -- 172.21.15.42:0/3746593977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f892c102da0 msgr2=0x7f892c1a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8932a96640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f892c102da0 0x7f892c1a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8932a96640 1 -- 172.21.15.42:0/3746593977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c19acf0 con 0x7f892c10c180 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.674+0000 7f8932a96640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f892c10c180 0x7f892c19a5c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f892400be20 tx=0x7f8924009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.677+0000 7f89237fe640 1 -- 172.21.15.42:0/3746593977 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924019070 con 0x7f892c10c180 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.677+0000 7f89237fe640 1 -- 172.21.15.42:0/3746593977 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f892400cd70 con 0x7f892c10c180 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.677+0000 7f89344f9640 1 -- 172.21.15.42:0/3746593977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892c19afe0 con 0x7f892c10c180 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.677+0000 7f89237fe640 1 -- 172.21.15.42:0/3746593977 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89240127f0 con 0x7f892c10c180 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.677+0000 7f89344f9640 1 -- 172.21.15.42:0/3746593977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f892c1a72d0 con 0x7f892c10c180 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.678+0000 7f89344f9640 1 -- 172.21.15.42:0/3746593977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f892c06b010 con 0x7f892c10c180 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.679+0000 7f89237fe640 1 -- 172.21.15.42:0/3746593977 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f892401c070 con 0x7f892c10c180 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.680+0000 7f89237fe640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f89180a32c0 0x7f89180a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.680+0000 7f8932295640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f89180a32c0 0x7f89180a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.680+0000 7f89237fe640 1 -- 172.21.15.42:0/3746593977 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f89240cf070 con 0x7f892c10c180 2024-09-19T09:44:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.680+0000 7f8932295640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f89180a32c0 0x7f89180a5780 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8928009990 tx=0x7f8928009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:04.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.684+0000 7f89237fe640 1 -- 172.21.15.42:0/3746593977 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f892409b6c0 con 0x7f892c10c180 2024-09-19T09:44:04.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.896+0000 7f89344f9640 1 -- 172.21.15.42:0/3746593977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f892c1a7560 con 0x7f892c10c180 2024-09-19T09:44:04.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.897+0000 7f89237fe640 1 -- 172.21.15.42:0/3746593977 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+12006 (secure 0 0 0) 0x7f892409f9c0 con 0x7f892c10c180 2024-09-19T09:44:04.899 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:44:04.899 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":39,"btime":"2024-09-19T09:43:48:590759+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3597931561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3597931561},{"type":"v1","addr":"172.21.15.42:6835","nonce":3597931561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/916691394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":916691394},{"type":"v1","addr":"172.21.15.42:6837","nonce":916691394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:37:11.524843+0000","modified":"2024-09-19T09:43:47.983400+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24478,"mds_2":24473,"mds_3":24466,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6839/3152711275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3152711275},{"type":"v1","addr":"172.21.15.42:6839","nonce":3152711275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6841/649947071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":649947071},{"type":"v1","addr":"172.21.15.42:6841","nonce":649947071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1004485926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1004485926},{"type":"v1","addr":"172.21.15.171:6833","nonce":1004485926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/1364803362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1364803362},{"type":"v1","addr":"172.21.15.136:6833","nonce":1364803362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/3800275147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3800275147},{"type":"v1","addr":"172.21.15.136:6835","nonce":3800275147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.171:6835/3609400567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3609400567},{"type":"v1","addr":"172.21.15.171:6835","nonce":3609400567}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.171:6837/512338141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":512338141},{"type":"v1","addr":"172.21.15.171:6837","nonce":512338141}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6837/2776197166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2776197166},{"type":"v1","addr":"172.21.15.136:6837","nonce":2776197166}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.171:6839/3148784527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3148784527},{"type":"v1","addr":"172.21.15.171:6839","nonce":3148784527}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2003809688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2003809688},{"type":"v1","addr":"172.21.15.136:6839","nonce":2003809688}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24478,24473,24466,24506,24454]},"id":1}]} 2024-09-19T09:44:04.899 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 39 2024-09-19T09:44:04.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 -- 172.21.15.42:0/3746593977 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f89180a32c0 msgr2=0x7f89180a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f89180a32c0 0x7f89180a5780 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8928009990 tx=0x7f8928009110 comp rx=0 tx=0).stop 2024-09-19T09:44:04.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 -- 172.21.15.42:0/3746593977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f892c10c180 msgr2=0x7f892c19a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f892c10c180 0x7f892c19a5c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f892400be20 tx=0x7f8924009ed0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 -- 172.21.15.42:0/3746593977 shutdown_connections 2024-09-19T09:44:04.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f89180a32c0 0x7f89180a5780 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f892c10c180 0x7f892c19a5c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f892c1036c0 0x7f892c1a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 --2- 172.21.15.42:0/3746593977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f892c102da0 0x7f892c1a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 -- 172.21.15.42:0/3746593977 >> 172.21.15.42:0/3746593977 conn(0x7f892c0fc7a0 msgr2=0x7f892c101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:04.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 -- 172.21.15.42:0/3746593977 shutdown_connections 2024-09-19T09:44:04.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:04.899+0000 7f89344f9640 1 -- 172.21.15.42:0/3746593977 wait complete. 2024-09-19T09:44:05.651 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:44:05.910 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:05.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:05 smithi042 ceph-mon[31223]: pgmap v480: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:44:05.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:05 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3746593977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:06.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:05 smithi171 ceph-mon[35803]: pgmap v480: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:44:06.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:05 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3746593977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:05 smithi136 ceph-mon[34840]: pgmap v480: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:44:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:05 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3746593977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:06.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.374+0000 7f65dc887640 1 -- 172.21.15.42:0/3672953907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d8106a80 msgr2=0x7f65d8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:06.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.374+0000 7f65dc887640 1 --2- 172.21.15.42:0/3672953907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d8106a80 0x7f65d8106e60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009930 tx=0x7f65c802a420 comp rx=0 tx=0).stop 2024-09-19T09:44:06.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.374+0000 7f65dc887640 1 -- 172.21.15.42:0/3672953907 shutdown_connections 2024-09-19T09:44:06.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.374+0000 7f65dc887640 1 --2- 172.21.15.42:0/3672953907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65d8101420 0x7f65d810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:06.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.374+0000 7f65dc887640 1 --2- 172.21.15.42:0/3672953907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d8100a80 0x7f65d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.374+0000 7f65dc887640 1 --2- 172.21.15.42:0/3672953907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d8106a80 0x7f65d8106e60 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.374+0000 7f65dc887640 1 -- 172.21.15.42:0/3672953907 >> 172.21.15.42:0/3672953907 conn(0x7f65d80fc7a0 msgr2=0x7f65d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.374+0000 7f65dc887640 1 -- 172.21.15.42:0/3672953907 shutdown_connections 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.374+0000 7f65dc887640 1 -- 172.21.15.42:0/3672953907 wait complete. 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65dc887640 1 Processor -- start 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65dc887640 1 -- start start 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65dc887640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65d8100a80 0x7f65d8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65dc887640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d8101420 0x7f65d8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65dc887640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d8106a80 0x7f65d81a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65dc887640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8110ed0 con 0x7f65d8101420 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65dc887640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8110d50 con 0x7f65d8106a80 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65dc887640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8111050 con 0x7f65d8100a80 2024-09-19T09:44:06.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65d5d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d8101420 0x7f65d8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65d5d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d8101420 0x7f65d8199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36910/0 (socket says 172.21.15.42:36910) 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.375+0000 7f65d5d9b640 1 -- 172.21.15.42:0/84664848 learned_addr learned my addr 172.21.15.42:0/84664848 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65d659c640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65d8100a80 0x7f65d8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65d6d9d640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d8106a80 0x7f65d81a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65d5d9b640 1 -- 172.21.15.42:0/84664848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65d8100a80 msgr2=0x7f65d8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65d5d9b640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65d8100a80 0x7f65d8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65d5d9b640 1 -- 172.21.15.42:0/84664848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d8106a80 msgr2=0x7f65d81a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65d5d9b640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d8106a80 0x7f65d81a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65d5d9b640 1 -- 172.21.15.42:0/84664848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d81a48c0 con 0x7f65d8101420 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65d6d9d640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d8106a80 0x7f65d81a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65d659c640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65d8100a80 0x7f65d8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65d5d9b640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d8101420 0x7f65d8199840 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f65c000d950 tx=0x7f65c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:06.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65cf7fe640 1 -- 172.21.15.42:0/84664848 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0017030 con 0x7f65d8101420 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65cf7fe640 1 -- 172.21.15.42:0/84664848 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65c0004020 con 0x7f65d8101420 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65cf7fe640 1 -- 172.21.15.42:0/84664848 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c00047a0 con 0x7f65d8101420 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65dc887640 1 -- 172.21.15.42:0/84664848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d81a4a90 con 0x7f65d8101420 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.376+0000 7f65dc887640 1 -- 172.21.15.42:0/84664848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d81a4fd0 con 0x7f65d8101420 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.377+0000 7f65dc887640 1 -- 172.21.15.42:0/84664848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d8100ee0 con 0x7f65d8101420 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.379+0000 7f65cf7fe640 1 -- 172.21.15.42:0/84664848 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f65c00041d0 con 0x7f65d8101420 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.380+0000 7f65cf7fe640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f65c40a32c0 0x7f65c40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.380+0000 7f65d659c640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f65c40a32c0 0x7f65c40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.380+0000 7f65cf7fe640 1 -- 172.21.15.42:0/84664848 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f65c00cfa40 con 0x7f65d8101420 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.381+0000 7f65d659c640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f65c40a32c0 0x7f65c40a5780 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006010 tx=0x7f65c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:06.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.383+0000 7f65cf7fe640 1 -- 172.21.15.42:0/84664848 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f65c009c760 con 0x7f65d8101420 2024-09-19T09:44:06.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.563+0000 7f65dc887640 1 -- 172.21.15.42:0/84664848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65d8109050 con 0x7f65d8101420 2024-09-19T09:44:06.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.565+0000 7f65cf7fe640 1 -- 172.21.15.42:0/84664848 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22852 (secure 0 0 0) 0x7f65c009c060 con 0x7f65d8101420 2024-09-19T09:44:06.567 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-19T09:44:06.568 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"fsid":"90ecc87a-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:29:39.579012+0000","modified":"2024-09-19T09:37:28.010101+0000","last_up_change":"2024-09-19T09:36:22.475035+0000","last_in_change":"2024-09-19T09:35:59.891193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:32:44.950596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:37:07.882800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:37:09.916139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"706a099a-50d4-4bf6-aeec-397188b1607e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6803","nonce":2566861265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6805","nonce":2566861265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6809","nonce":2566861265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2566861265},{"type":"v1","addr":"172.21.15.42:6807","nonce":2566861265}]},"public_addr":"172.21.15.42:6803/2566861265","cluster_addr":"172.21.15.42:6805/2566861265","heartbeat_back_addr":"172.21.15.42:6809/2566861265","heartbeat_front_addr":"172.21.15.42:6807/2566861265","state":["exists","up"]},{"osd":1,"uuid":"675db66c-0434-4791-bb50-8c598eefd010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6801","nonce":2317267026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6803","nonce":2317267026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6807","nonce":2317267026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2317267026},{"type":"v1","addr":"172.21.15.136:6805","nonce":2317267026}]},"public_addr":"172.21.15.136:6801/2317267026","cluster_addr":"172.21.15.136:6803/2317267026","heartbeat_back_addr":"172.21.15.136:6807/2317267026","heartbeat_front_addr":"172.21.15.136:6805/2317267026","state":["exists","up"]},{"osd":2,"uuid":"2ca55d67-6869-44ad-b68f-fee2caa72f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6801","nonce":1649199499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6803","nonce":1649199499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6807","nonce":1649199499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1649199499},{"type":"v1","addr":"172.21.15.171:6805","nonce":1649199499}]},"public_addr":"172.21.15.171:6801/1649199499","cluster_addr":"172.21.15.171:6803/1649199499","heartbeat_back_addr":"172.21.15.171:6807/1649199499","heartbeat_front_addr":"172.21.15.171:6805/1649199499","state":["exists","up"]},{"osd":3,"uuid":"31859291-9497-400b-9dec-5ce253a06cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6811","nonce":3782422248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6813","nonce":3782422248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6817","nonce":3782422248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3782422248},{"type":"v1","addr":"172.21.15.42:6815","nonce":3782422248}]},"public_addr":"172.21.15.42:6811/3782422248","cluster_addr":"172.21.15.42:6813/3782422248","heartbeat_back_addr":"172.21.15.42:6817/3782422248","heartbeat_front_addr":"172.21.15.42:6815/3782422248","state":["exists","up"]},{"osd":4,"uuid":"f45ebe54-a9d3-4af4-bf11-99bc0038141d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6809","nonce":1987544741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6811","nonce":1987544741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6815","nonce":1987544741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1987544741},{"type":"v1","addr":"172.21.15.136:6813","nonce":1987544741}]},"public_addr":"172.21.15.136:6809/1987544741","cluster_addr":"172.21.15.136:6811/1987544741","heartbeat_back_addr":"172.21.15.136:6815/1987544741","heartbeat_front_addr":"172.21.15.136:6813/1987544741","state":["exists","up"]},{"osd":5,"uuid":"852fe127-e1d5-4a0e-9f0f-358680473508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6809","nonce":2964439242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6811","nonce":2964439242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6815","nonce":2964439242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2964439242},{"type":"v1","addr":"172.21.15.171:6813","nonce":2964439242}]},"public_addr":"172.21.15.171:6809/2964439242","cluster_addr":"172.21.15.171:6811/2964439242","heartbeat_back_addr":"172.21.15.171:6815/2964439242","heartbeat_front_addr":"172.21.15.171:6813/2964439242","state":["exists","up"]},{"osd":6,"uuid":"cbcb88d8-1ae1-404a-8ac6-d0d313f63f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6819","nonce":1896771810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6821","nonce":1896771810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6825","nonce":1896771810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":1896771810},{"type":"v1","addr":"172.21.15.42:6823","nonce":1896771810}]},"public_addr":"172.21.15.42:6819/1896771810","cluster_addr":"172.21.15.42:6821/1896771810","heartbeat_back_addr":"172.21.15.42:6825/1896771810","heartbeat_front_addr":"172.21.15.42:6823/1896771810","state":["exists","up"]},{"osd":7,"uuid":"9db03bdf-bab4-45b9-98af-9a827cd5f52a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6817","nonce":1586327351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6819","nonce":1586327351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6823","nonce":1586327351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1586327351},{"type":"v1","addr":"172.21.15.136:6821","nonce":1586327351}]},"public_addr":"172.21.15.136:6817/1586327351","cluster_addr":"172.21.15.136:6819/1586327351","heartbeat_back_addr":"172.21.15.136:6823/1586327351","heartbeat_front_addr":"172.21.15.136:6821/1586327351","state":["exists","up"]},{"osd":8,"uuid":"1d24baff-7b48-42e7-8de3-c63bae1df94d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6817","nonce":4167633089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6819","nonce":4167633089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6823","nonce":4167633089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":4167633089},{"type":"v1","addr":"172.21.15.171:6821","nonce":4167633089}]},"public_addr":"172.21.15.171:6817/4167633089","cluster_addr":"172.21.15.171:6819/4167633089","heartbeat_back_addr":"172.21.15.171:6823/4167633089","heartbeat_front_addr":"172.21.15.171:6821/4167633089","state":["exists","up"]},{"osd":9,"uuid":"1eddb8d2-f7b3-4c8c-9fb4-41a23be0e5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6827","nonce":1760632261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6829","nonce":1760632261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6833","nonce":1760632261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1760632261},{"type":"v1","addr":"172.21.15.42:6831","nonce":1760632261}]},"public_addr":"172.21.15.42:6827/1760632261","cluster_addr":"172.21.15.42:6829/1760632261","heartbeat_back_addr":"172.21.15.42:6833/1760632261","heartbeat_front_addr":"172.21.15.42:6831/1760632261","state":["exists","up"]},{"osd":10,"uuid":"39e6662d-70d8-47a8-8cce-822de973672e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6825","nonce":3459426707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6827","nonce":3459426707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6831","nonce":3459426707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3459426707},{"type":"v1","addr":"172.21.15.136:6829","nonce":3459426707}]},"public_addr":"172.21.15.136:6825/3459426707","cluster_addr":"172.21.15.136:6827/3459426707","heartbeat_back_addr":"172.21.15.136:6831/3459426707","heartbeat_front_addr":"172.21.15.136:6829/3459426707","state":["exists","up"]},{"osd":11,"uuid":"bfbb71e1-73ac-4766-9b71-c81701b94a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6825","nonce":2813410869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6827","nonce":2813410869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6831","nonce":2813410869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2813410869},{"type":"v1","addr":"172.21.15.171:6829","nonce":2813410869}]},"public_addr":"172.21.15.171:6825/2813410869","cluster_addr":"172.21.15.171:6827/2813410869","heartbeat_back_addr":"172.21.15.171:6831/2813410869","heartbeat_front_addr":"172.21.15.171:6829/2813410869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:52.639527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:17.815278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:42.666190+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:07.522835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:31.601549+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:55.627078+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:19.867699+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:44.374178+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:08.009799+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:32.895569+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:57.195715+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:36:21.351221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/1318707645":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/3819076248":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6801/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/4286810038":"2024-09-20T09:30:26.412318+0000","172.21.15.42:6800/203737163":"2024-09-20T09:30:26.412318+0000","172.21.15.42:0/2538224361":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6801/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:6800/2557927084":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/3197478490":"2024-09-20T09:30:02.111922+0000","172.21.15.42:0/4227587843":"2024-09-20T09:30:02.111922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 -- 172.21.15.42:0/84664848 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f65c40a32c0 msgr2=0x7f65c40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f65c40a32c0 0x7f65c40a5780 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006010 tx=0x7f65c8005a20 comp rx=0 tx=0).stop 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 -- 172.21.15.42:0/84664848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d8101420 msgr2=0x7f65d8199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d8101420 0x7f65d8199840 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f65c000d950 tx=0x7f65c000de10 comp rx=0 tx=0).stop 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 -- 172.21.15.42:0/84664848 shutdown_connections 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f65c40a32c0 0x7f65c40a5780 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d8106a80 0x7f65d81a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d8101420 0x7f65d8199840 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 --2- 172.21.15.42:0/84664848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65d8100a80 0x7f65d8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 -- 172.21.15.42:0/84664848 >> 172.21.15.42:0/84664848 conn(0x7f65d80fc7a0 msgr2=0x7f65d80fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 -- 172.21.15.42:0/84664848 shutdown_connections 2024-09-19T09:44:06.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:06.568+0000 7f65dc887640 1 -- 172.21.15.42:0/84664848 wait complete. 2024-09-19T09:44:06.939 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:06 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:44:06.939 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:06 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/84664848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:44:07.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:06 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:44:07.098 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:06 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/84664848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:44:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:06 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:44:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:06 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/84664848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:44:07.316 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T09:44:07.580 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:07.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:07 smithi042 ceph-mon[31223]: pgmap v481: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:44:07.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:07 smithi042 ceph-mon[31223]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:44:08.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:07 smithi171 ceph-mon[35803]: pgmap v481: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:44:08.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:07 smithi171 ceph-mon[35803]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:44:08.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.061+0000 7f4a05cd3640 1 -- 172.21.15.42:0/1129466827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a0010c170 msgr2=0x7f4a0010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:08.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.061+0000 7f4a05cd3640 1 --2- 172.21.15.42:0/1129466827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a0010c170 0x7f4a0010e610 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009ca0 tx=0x7f49f802a950 comp rx=0 tx=0).stop 2024-09-19T09:44:08.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.061+0000 7f4a05cd3640 1 -- 172.21.15.42:0/1129466827 shutdown_connections 2024-09-19T09:44:08.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.061+0000 7f4a05cd3640 1 --2- 172.21.15.42:0/1129466827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a0010c170 0x7f4a0010e610 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.061+0000 7f4a05cd3640 1 --2- 172.21.15.42:0/1129466827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a00103660 0x7f4a0010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.061+0000 7f4a05cd3640 1 --2- 172.21.15.42:0/1129466827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a00102d40 0x7f4a00103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.061+0000 7f4a05cd3640 1 -- 172.21.15.42:0/1129466827 >> 172.21.15.42:0/1129466827 conn(0x7f4a000fc7a0 msgr2=0x7f4a000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.061+0000 7f4a05cd3640 1 -- 172.21.15.42:0/1129466827 shutdown_connections 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.061+0000 7f4a05cd3640 1 -- 172.21.15.42:0/1129466827 wait complete. 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f4a05cd3640 1 Processor -- start 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f4a05cd3640 1 -- start start 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f4a05cd3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a00102d40 0x7f4a00198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f4a05cd3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a00103660 0x7f4a00198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f4a05cd3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a0010c170 0x7f4a0019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f4a05cd3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00111f80 con 0x7f4a00103660 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f4a05cd3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00111e00 con 0x7f4a00102d40 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f4a05cd3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00112100 con 0x7f4a0010c170 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f49feffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a00103660 0x7f4a00198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:08.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f49feffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a00103660 0x7f4a00198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36932/0 (socket says 172.21.15.42:36932) 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.062+0000 7f49feffd640 1 -- 172.21.15.42:0/2604309711 learned_addr learned my addr 172.21.15.42:0/2604309711 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49ff7fe640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a00102d40 0x7f4a00198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49fffff640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a0010c170 0x7f4a0019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49feffd640 1 -- 172.21.15.42:0/2604309711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a0010c170 msgr2=0x7f4a0019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49feffd640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a0010c170 0x7f4a0019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49feffd640 1 -- 172.21.15.42:0/2604309711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a00102d40 msgr2=0x7f4a00198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49feffd640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a00102d40 0x7f4a00198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49feffd640 1 -- 172.21.15.42:0/2604309711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0019d2f0 con 0x7f4a00103660 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49feffd640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a00103660 0x7f4a00198880 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f49f400c940 tx=0x7f49f400cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49fcff9640 1 -- 172.21.15.42:0/2604309711 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4004220 con 0x7f4a00103660 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49fcff9640 1 -- 172.21.15.42:0/2604309711 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49f40043c0 con 0x7f4a00103660 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f4a05cd3640 1 -- 172.21.15.42:0/2604309711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0019d5e0 con 0x7f4a00103660 2024-09-19T09:44:08.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f49fcff9640 1 -- 172.21.15.42:0/2604309711 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4005650 con 0x7f4a00103660 2024-09-19T09:44:08.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.063+0000 7f4a05cd3640 1 -- 172.21.15.42:0/2604309711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a001a4ec0 con 0x7f4a00103660 2024-09-19T09:44:08.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.064+0000 7f4a05cd3640 1 -- 172.21.15.42:0/2604309711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a00103120 con 0x7f4a00103660 2024-09-19T09:44:08.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.066+0000 7f49fcff9640 1 -- 172.21.15.42:0/2604309711 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f49f40079b0 con 0x7f4a00103660 2024-09-19T09:44:08.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.066+0000 7f49fcff9640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49e80a3240 0x7f49e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:08.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.066+0000 7f49ff7fe640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49e80a3240 0x7f49e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:08.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.066+0000 7f49fcff9640 1 -- 172.21.15.42:0/2604309711 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f49f40cf450 con 0x7f4a00103660 2024-09-19T09:44:08.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.067+0000 7f49ff7fe640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49e80a3240 0x7f49e80a5700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f49f000abe0 tx=0x7f49f000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:08.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.070+0000 7f49fcff9640 1 -- 172.21.15.42:0/2604309711 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f49f4014030 con 0x7f4a00103660 2024-09-19T09:44:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:07 smithi136 ceph-mon[34840]: pgmap v481: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T09:44:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:07 smithi136 ceph-mon[34840]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:44:08.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.283+0000 7f4a05cd3640 1 -- 172.21.15.42:0/2604309711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4a001a51b0 con 0x7f4a00103660 2024-09-19T09:44:08.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.285+0000 7f49fcff9640 1 -- 172.21.15.42:0/2604309711 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) ==== 161+0+0 (secure 0 0 0) 0x7f49f409c150 con 0x7f4a00103660 2024-09-19T09:44:08.287 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:44:08.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.289+0000 7f4a05cd3640 1 -- 172.21.15.42:0/2604309711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49e80a3240 msgr2=0x7f49e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:08.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.289+0000 7f4a05cd3640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49e80a3240 0x7f49e80a5700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f49f000abe0 tx=0x7f49f000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.289+0000 7f4a05cd3640 1 -- 172.21.15.42:0/2604309711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a00103660 msgr2=0x7f4a00198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:08.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.289+0000 7f4a05cd3640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a00103660 0x7f4a00198880 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f49f400c940 tx=0x7f49f400cd40 comp rx=0 tx=0).stop 2024-09-19T09:44:08.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.289+0000 7f4a05cd3640 1 -- 172.21.15.42:0/2604309711 shutdown_connections 2024-09-19T09:44:08.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.289+0000 7f4a05cd3640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f49e80a3240 0x7f49e80a5700 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.289+0000 7f4a05cd3640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a0010c170 0x7f4a0019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.289+0000 7f4a05cd3640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a00103660 0x7f4a00198880 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.289+0000 7f4a05cd3640 1 --2- 172.21.15.42:0/2604309711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a00102d40 0x7f4a00198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.289+0000 7f4a05cd3640 1 -- 172.21.15.42:0/2604309711 >> 172.21.15.42:0/2604309711 conn(0x7f4a000fc7a0 msgr2=0x7f4a000fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:08.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.290+0000 7f4a05cd3640 1 -- 172.21.15.42:0/2604309711 shutdown_connections 2024-09-19T09:44:08.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:08.290+0000 7f4a05cd3640 1 -- 172.21.15.42:0/2604309711 wait complete. 2024-09-19T09:44:08.597 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l[65719]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:08.597 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l[65719]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:08.597 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-mds[65723]: -- 172.21.15.171:0/1204681540 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a9058cf860 con 0x55a9058ad000 2024-09-19T09:44:08.597 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l[65719]: starting mds.l at 2024-09-19T09:44:08.598 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c[66319]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:08.598 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c[66319]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:08.598 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-mds[66323]: -- 172.21.15.171:0/3732565159 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f9d345860 con 0x558f9d322800 2024-09-19T09:44:08.598 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c[66319]: starting mds.c at 2024-09-19T09:44:08.598 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f[66020]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:08.598 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f[66020]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:08.598 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-mds[66024]: -- 172.21.15.171:0/1770785016 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581f3221860 con 0x5581f31ff000 2024-09-19T09:44:08.599 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f[66020]: starting mds.f at 2024-09-19T09:44:08.599 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i[66618]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:08.599 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i[66618]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:08.599 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-mds[66622]: -- 172.21.15.171:0/3279568485 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b13481860 con 0x557b1345e800 2024-09-19T09:44:08.599 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i[66618]: starting mds.i at 2024-09-19T09:44:08.635 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h[64805]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:08.635 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h[64805]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:08.635 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mds[64809]: -- 172.21.15.136:0/916833688 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5569afdfb860 con 0x5569afdd9000 2024-09-19T09:44:08.636 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h[64805]: starting mds.h at 2024-09-19T09:44:08.636 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k[64187]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:08.636 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k[64187]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:08.636 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mds[64191]: -- 172.21.15.136:0/3575632004 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c70315860 con 0x564c702f2800 2024-09-19T09:44:08.636 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k[64187]: starting mds.k at 2024-09-19T09:44:08.637 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e[64503]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:08.637 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e[64503]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:08.637 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mds[64507]: -- 172.21.15.136:0/620376607 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564eb6f7b860 con 0x564eb6f58800 2024-09-19T09:44:08.637 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e[64503]: starting mds.e at 2024-09-19T09:44:08.637 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b[65116]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:08.637 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b[65116]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:08.638 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mds[65120]: -- 172.21.15.136:0/347471690 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56545d43e680 con 0x56545d413400 2024-09-19T09:44:08.638 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mds[65120]: -- 172.21.15.136:0/347471690 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56545d435860 con 0x56545d413400 2024-09-19T09:44:08.638 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b[65116]: starting mds.b at 2024-09-19T09:44:08.681 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a[31219]: 2024-09-19T09:44:08.284+0000 7f9a5b46e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:44:08.681 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a[72589]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:08.681 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a[72589]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:08.681 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-mds[72606]: -- 172.21.15.42:0/2402991377 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f2f58a7c20 con 0x55f2f5885000 2024-09-19T09:44:08.682 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a[72589]: starting mds.a at 2024-09-19T09:44:08.682 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-g[72255]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:08.682 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-g[72255]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:08.682 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-g[72255]: starting mds.g at 2024-09-19T09:44:08.954 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2604309711' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:44:08.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-mon[31223]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:44:08.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-mon[31223]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:44:08.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2604309711' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:44:08.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-mon[31223]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:44:08.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:08 smithi042 ceph-mon[31223]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:44:09.088 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:44:09.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2604309711' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:44:09.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-mon[35803]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:44:09.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-mon[35803]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:44:09.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2604309711' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:44:09.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-mon[35803]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:44:09.097 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:08 smithi171 ceph-mon[35803]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:44:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2604309711' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:44:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mon[34840]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:44:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mon[34840]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:44:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2604309711' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:44:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mon[34840]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:44:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:08 smithi136 ceph-mon[34840]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:44:09.352 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:09.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.808+0000 7f2293d80640 1 -- 172.21.15.42:0/473878809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f228c074590 msgr2=0x7f228c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:09.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.808+0000 7f2293d80640 1 --2- 172.21.15.42:0/473878809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f228c074590 0x7f228c074970 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f2288009900 tx=0x7f228802a480 comp rx=0 tx=0).stop 2024-09-19T09:44:09.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.808+0000 7f2293d80640 1 -- 172.21.15.42:0/473878809 shutdown_connections 2024-09-19T09:44:09.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.808+0000 7f2293d80640 1 --2- 172.21.15.42:0/473878809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f228c112b90 0x7f228c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:09.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.808+0000 7f2293d80640 1 --2- 172.21.15.42:0/473878809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c074eb0 0x7f228c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:09.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.808+0000 7f2293d80640 1 --2- 172.21.15.42:0/473878809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f228c074590 0x7f228c074970 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:09.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.808+0000 7f2293d80640 1 -- 172.21.15.42:0/473878809 >> 172.21.15.42:0/473878809 conn(0x7f228c0fd8c0 msgr2=0x7f228c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.808+0000 7f2293d80640 1 -- 172.21.15.42:0/473878809 shutdown_connections 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.808+0000 7f2293d80640 1 -- 172.21.15.42:0/473878809 wait complete. 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.809+0000 7f2293d80640 1 Processor -- start 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.809+0000 7f2293d80640 1 -- start start 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.809+0000 7f2293d80640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f228c074590 0x7f228c1a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.809+0000 7f2293d80640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c074eb0 0x7f228c1a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.809+0000 7f2293d80640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f228c112b90 0x7f228c19e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.809+0000 7f2293d80640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1185e0 con 0x7f228c074590 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.809+0000 7f2293d80640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f228c118460 con 0x7f228c074eb0 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.809+0000 7f2293d80640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f228c118760 con 0x7f228c112b90 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.809+0000 7f2291b1c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f228c074590 0x7f228c1a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2291b1c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f228c074590 0x7f228c1a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37018/0 (socket says 172.21.15.42:37018) 2024-09-19T09:44:09.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2291b1c640 1 -- 172.21.15.42:0/1909172331 learned_addr learned my addr 172.21.15.42:0/1909172331 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f229131b640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c074eb0 0x7f228c1a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f229231d640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f228c112b90 0x7f228c19e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2291b1c640 1 -- 172.21.15.42:0/1909172331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f228c112b90 msgr2=0x7f228c19e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2291b1c640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f228c112b90 0x7f228c19e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2291b1c640 1 -- 172.21.15.42:0/1909172331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c074eb0 msgr2=0x7f228c1a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2291b1c640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c074eb0 0x7f228c1a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2291b1c640 1 -- 172.21.15.42:0/1909172331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c19f070 con 0x7f228c074590 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f229231d640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f228c112b90 0x7f228c19e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f229131b640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c074eb0 0x7f228c1a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2291b1c640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f228c074590 0x7f228c1a4780 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2288006010 tx=0x7f22880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2282ffd640 1 -- 172.21.15.42:0/1909172331 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228803f030 con 0x7f228c074590 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2282ffd640 1 -- 172.21.15.42:0/1909172331 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2288003ce0 con 0x7f228c074590 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2282ffd640 1 -- 172.21.15.42:0/1909172331 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288035070 con 0x7f228c074590 2024-09-19T09:44:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2293d80640 1 -- 172.21.15.42:0/1909172331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c19f300 con 0x7f228c074590 2024-09-19T09:44:09.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.810+0000 7f2293d80640 1 -- 172.21.15.42:0/1909172331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c1ab650 con 0x7f228c074590 2024-09-19T09:44:09.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.811+0000 7f2293d80640 1 -- 172.21.15.42:0/1909172331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c074970 con 0x7f228c074590 2024-09-19T09:44:09.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.812+0000 7f2282ffd640 1 -- 172.21.15.42:0/1909172331 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2288042030 con 0x7f228c074590 2024-09-19T09:44:09.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.813+0000 7f2282ffd640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22780a3240 0x7f22780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:09.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.813+0000 7f2282ffd640 1 -- 172.21.15.42:0/1909172331 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8699+0+0 (secure 0 0 0) 0x7f22880efdd0 con 0x7f228c074590 2024-09-19T09:44:09.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.813+0000 7f229131b640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22780a3240 0x7f22780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:09.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.814+0000 7f229131b640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22780a3240 0x7f22780a5700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f227c0058c0 tx=0x7f227c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:09.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:09.818+0000 7f2282ffd640 1 -- 172.21.15.42:0/1909172331 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22880bc980 con 0x7f228c074590 2024-09-19T09:44:10.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.032+0000 7f2293d80640 1 -- 172.21.15.42:0/1909172331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f228c104fd0 con 0x7f228c074590 2024-09-19T09:44:10.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.292+0000 7f2282ffd640 1 -- 172.21.15.42:0/1909172331 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) ==== 104+0+0 (secure 0 0 0) 0x7f22880bc280 con 0x7f228c074590 2024-09-19T09:44:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 -- 172.21.15.42:0/1909172331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22780a3240 msgr2=0x7f22780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22780a3240 0x7f22780a5700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f227c0058c0 tx=0x7f227c005850 comp rx=0 tx=0).stop 2024-09-19T09:44:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 -- 172.21.15.42:0/1909172331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f228c074590 msgr2=0x7f228c1a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f228c074590 0x7f228c1a4780 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2288006010 tx=0x7f22880042f0 comp rx=0 tx=0).stop 2024-09-19T09:44:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 -- 172.21.15.42:0/1909172331 shutdown_connections 2024-09-19T09:44:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f22780a3240 0x7f22780a5700 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f228c112b90 0x7f228c19e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c074eb0 0x7f228c1a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 --2- 172.21.15.42:0/1909172331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f228c074590 0x7f228c1a4780 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 -- 172.21.15.42:0/1909172331 >> 172.21.15.42:0/1909172331 conn(0x7f228c0fd8c0 msgr2=0x7f228c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:10.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 -- 172.21.15.42:0/1909172331 shutdown_connections 2024-09-19T09:44:10.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:10.295+0000 7f2293d80640 1 -- 172.21.15.42:0/1909172331 wait complete. 2024-09-19T09:44:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: pgmap v483: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T09:44:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.136:6833/3120795219,v1:172.21.15.136:6836/3120795219] up:boot 2024-09-19T09:44:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.136:6832/834189515,v1:172.21.15.136:6835/834189515] up:boot 2024-09-19T09:44:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6832/1149564866,v1:172.21.15.171:6834/1149564866] up:boot 2024-09-19T09:44:10.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.136:6834/984499460,v1:172.21.15.136:6837/984499460] up:boot 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6833/1502304964,v1:172.21.15.171:6835/1502304964] up:boot 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.136:6838/1523188521,v1:172.21.15.136:6839/1523188521] up:boot 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.42:6838/3348544879,v1:172.21.15.42:6840/3348544879] up:boot 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.42:6839/678372314,v1:172.21.15.42:6841/678372314] up:boot 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6836/614182690,v1:172.21.15.171:6838/614182690] up:boot 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: mds.? [v2:172.21.15.171:6837/1459036557,v1:172.21.15.171:6839/1459036557] up:boot 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:44:10.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:44:10.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:44:10.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:44:10.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:44:10.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:44:10.599 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:10 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1909172331' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:44:10.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: pgmap v483: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T09:44:10.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.136:6833/3120795219,v1:172.21.15.136:6836/3120795219] up:boot 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.136:6832/834189515,v1:172.21.15.136:6835/834189515] up:boot 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6832/1149564866,v1:172.21.15.171:6834/1149564866] up:boot 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.136:6834/984499460,v1:172.21.15.136:6837/984499460] up:boot 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6833/1502304964,v1:172.21.15.171:6835/1502304964] up:boot 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.136:6838/1523188521,v1:172.21.15.136:6839/1523188521] up:boot 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.42:6838/3348544879,v1:172.21.15.42:6840/3348544879] up:boot 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.42:6839/678372314,v1:172.21.15.42:6841/678372314] up:boot 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6836/614182690,v1:172.21.15.171:6838/614182690] up:boot 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: mds.? [v2:172.21.15.171:6837/1459036557,v1:172.21.15.171:6839/1459036557] up:boot 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:44:10.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:44:10.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:44:10.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:44:10.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:44:10.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:44:10.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:44:10.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:44:10.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:10 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1909172331' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:44:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: pgmap v483: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T09:44:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.136:6833/3120795219,v1:172.21.15.136:6836/3120795219] up:boot 2024-09-19T09:44:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.136:6832/834189515,v1:172.21.15.136:6835/834189515] up:boot 2024-09-19T09:44:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6832/1149564866,v1:172.21.15.171:6834/1149564866] up:boot 2024-09-19T09:44:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.136:6834/984499460,v1:172.21.15.136:6837/984499460] up:boot 2024-09-19T09:44:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6833/1502304964,v1:172.21.15.171:6835/1502304964] up:boot 2024-09-19T09:44:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.136:6838/1523188521,v1:172.21.15.136:6839/1523188521] up:boot 2024-09-19T09:44:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.42:6838/3348544879,v1:172.21.15.42:6840/3348544879] up:boot 2024-09-19T09:44:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.42:6839/678372314,v1:172.21.15.42:6841/678372314] up:boot 2024-09-19T09:44:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6836/614182690,v1:172.21.15.171:6838/614182690] up:boot 2024-09-19T09:44:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: mds.? [v2:172.21.15.171:6837/1459036557,v1:172.21.15.171:6839/1459036557] up:boot 2024-09-19T09:44:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:44:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:44:10.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:44:10.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:44:10.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:44:10.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:44:10.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:44:10.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:44:10.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:44:10.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:44:10.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='mgr.14150 172.21.15.42:0/1282955580' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:44:10.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:10 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1909172331' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:44:10.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:44:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:11.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:11 smithi171 ceph-mon[35803]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:44:11.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:11 smithi171 ceph-mon[35803]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:44:11.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:11 smithi171 ceph-mon[35803]: Cluster is now healthy 2024-09-19T09:44:11.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:11 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/1909172331' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:44:11.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:11 smithi171 ceph-mon[35803]: fsmap 12 up:standby 2024-09-19T09:44:11.601 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:11 smithi042 ceph-mon[31223]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:44:11.601 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:11 smithi042 ceph-mon[31223]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:44:11.601 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:11 smithi042 ceph-mon[31223]: Cluster is now healthy 2024-09-19T09:44:11.602 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:11 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/1909172331' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:44:11.602 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:11 smithi042 ceph-mon[31223]: fsmap 12 up:standby 2024-09-19T09:44:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:11 smithi136 ceph-mon[34840]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:44:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:11 smithi136 ceph-mon[34840]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:44:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:11 smithi136 ceph-mon[34840]: Cluster is now healthy 2024-09-19T09:44:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:11 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/1909172331' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:44:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:11 smithi136 ceph-mon[34840]: fsmap 12 up:standby 2024-09-19T09:44:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.686+0000 7fd0151e4640 1 -- 172.21.15.42:0/3088034435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd010102da0 msgr2=0x7fd010103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.686+0000 7fd0151e4640 1 --2- 172.21.15.42:0/3088034435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd010102da0 0x7fd010103180 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd000009900 tx=0x7fd00002a480 comp rx=0 tx=0).stop 2024-09-19T09:44:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.686+0000 7fd0151e4640 1 -- 172.21.15.42:0/3088034435 shutdown_connections 2024-09-19T09:44:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.686+0000 7fd0151e4640 1 --2- 172.21.15.42:0/3088034435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd01010c180 0x7fd01010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.686+0000 7fd0151e4640 1 --2- 172.21.15.42:0/3088034435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0101036c0 0x7fd01010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.686+0000 7fd0151e4640 1 --2- 172.21.15.42:0/3088034435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd010102da0 0x7fd010103180 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.686+0000 7fd0151e4640 1 -- 172.21.15.42:0/3088034435 >> 172.21.15.42:0/3088034435 conn(0x7fd0100fc7a0 msgr2=0x7fd0100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.686+0000 7fd0151e4640 1 -- 172.21.15.42:0/3088034435 shutdown_connections 2024-09-19T09:44:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.686+0000 7fd0151e4640 1 -- 172.21.15.42:0/3088034435 wait complete. 2024-09-19T09:44:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd0151e4640 1 Processor -- start 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd0151e4640 1 -- start start 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd0151e4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd010102da0 0x7fd010198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd0151e4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0101036c0 0x7fd010198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd0151e4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01010c180 0x7fd01019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd0151e4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd010111f60 con 0x7fd01010c180 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd0151e4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd010111de0 con 0x7fd010102da0 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd0151e4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0101120e0 con 0x7fd0101036c0 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd00f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01010c180 0x7fd01019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd00f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01010c180 0x7fd01019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33426/0 (socket says 172.21.15.42:33426) 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd00f59e640 1 -- 172.21.15.42:0/2020173153 learned_addr learned my addr 172.21.15.42:0/2020173153 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.687+0000 7fd00ed9d640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd010102da0 0x7fd010198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fd00e59c640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0101036c0 0x7fd010198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fd00f59e640 1 -- 172.21.15.42:0/2020173153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0101036c0 msgr2=0x7fd010198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fd00f59e640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0101036c0 0x7fd010198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fd00f59e640 1 -- 172.21.15.42:0/2020173153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd010102da0 msgr2=0x7fd010198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fd00f59e640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd010102da0 0x7fd010198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fd00f59e640 1 -- 172.21.15.42:0/2020173153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01019d400 con 0x7fd01010c180 2024-09-19T09:44:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fd00ed9d640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd010102da0 0x7fd010198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fd00f59e640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01010c180 0x7fd01019cd20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd00800cad0 tx=0x7fd00800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fcff7fff640 1 -- 172.21.15.42:0/2020173153 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00800ae20 con 0x7fd01010c180 2024-09-19T09:44:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fcff7fff640 1 -- 172.21.15.42:0/2020173153 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd008005020 con 0x7fd01010c180 2024-09-19T09:44:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fd0151e4640 1 -- 172.21.15.42:0/2020173153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01019d6f0 con 0x7fd01010c180 2024-09-19T09:44:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fcff7fff640 1 -- 172.21.15.42:0/2020173153 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00800f6f0 con 0x7fd01010c180 2024-09-19T09:44:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.688+0000 7fd0151e4640 1 -- 172.21.15.42:0/2020173153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0101a4fd0 con 0x7fd01010c180 2024-09-19T09:44:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.689+0000 7fd0151e4640 1 -- 172.21.15.42:0/2020173153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd010103180 con 0x7fd01010c180 2024-09-19T09:44:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.690+0000 7fcff7fff640 1 -- 172.21.15.42:0/2020173153 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd0080051d0 con 0x7fd01010c180 2024-09-19T09:44:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.691+0000 7fcff7fff640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcff80a3240 0x7fcff80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.691+0000 7fd00ed9d640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcff80a3240 0x7fcff80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.691+0000 7fcff7fff640 1 -- 172.21.15.42:0/2020173153 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8699+0+0 (secure 0 0 0) 0x7fd0080cfbe0 con 0x7fd01010c180 2024-09-19T09:44:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.692+0000 7fd00ed9d640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcff80a3240 0x7fcff80a5700 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd000005ab0 tx=0x7fd000005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.695+0000 7fcff7fff640 1 -- 172.21.15.42:0/2020173153 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd008014030 con 0x7fd01010c180 2024-09-19T09:44:11.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:11.872+0000 7fd0151e4640 1 -- 172.21.15.42:0/2020173153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd01002d7c0 con 0x7fd01010c180 2024-09-19T09:44:12.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.308+0000 7fcff7fff640 1 -- 172.21.15.42:0/2020173153 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) ==== 181+0+0 (secure 0 0 0) 0x7fd00809c6d0 con 0x7fd01010c180 2024-09-19T09:44:12.311 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:44:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 -- 172.21.15.42:0/2020173153 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcff80a3240 msgr2=0x7fcff80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcff80a3240 0x7fcff80a5700 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd000005ab0 tx=0x7fd000005a20 comp rx=0 tx=0).stop 2024-09-19T09:44:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 -- 172.21.15.42:0/2020173153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01010c180 msgr2=0x7fd01019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01010c180 0x7fd01019cd20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd00800cad0 tx=0x7fd00800cf90 comp rx=0 tx=0).stop 2024-09-19T09:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 -- 172.21.15.42:0/2020173153 shutdown_connections 2024-09-19T09:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7fcff80a3240 0x7fcff80a5700 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01010c180 0x7fd01019cd20 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0101036c0 0x7fd010198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 --2- 172.21.15.42:0/2020173153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd010102da0 0x7fd010198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 -- 172.21.15.42:0/2020173153 >> 172.21.15.42:0/2020173153 conn(0x7fd0100fc7a0 msgr2=0x7fd0100fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 -- 172.21.15.42:0/2020173153 shutdown_connections 2024-09-19T09:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:12.313+0000 7fd0151e4640 1 -- 172.21.15.42:0/2020173153 wait complete. 2024-09-19T09:44:12.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:12 smithi171 ceph-mon[35803]: pgmap v484: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:44:12.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:12 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2020173153' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:44:12.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:12 smithi042 ceph-mon[31223]: pgmap v484: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:44:12.630 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:12 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2020173153' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:44:12.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:12 smithi136 ceph-mon[34840]: pgmap v484: 97 pgs: 97 active+clean; 143 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:44:12.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:12 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2020173153' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:44:13.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:44:13.267 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:13.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:13 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/2020173153' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:44:13.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:13 smithi171 ceph-mon[35803]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:44:13.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:13 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/2020173153' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:44:13.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:13 smithi136 ceph-mon[34840]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:44:13.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:13 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/2020173153' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:44:13.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:13 smithi042 ceph-mon[31223]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:44:13.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.794+0000 7f84298e9640 1 -- 172.21.15.42:0/788778554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84241055b0 msgr2=0x7f842410d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.794+0000 7f84298e9640 1 --2- 172.21.15.42:0/788778554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84241055b0 0x7f842410d130 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f841c009ca0 tx=0x7f841c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.794+0000 7f84298e9640 1 -- 172.21.15.42:0/788778554 shutdown_connections 2024-09-19T09:44:13.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.794+0000 7f84298e9640 1 --2- 172.21.15.42:0/788778554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84241055b0 0x7f842410d130 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.794+0000 7f84298e9640 1 --2- 172.21.15.42:0/788778554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8424100e30 0x7f8424104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.794+0000 7f84298e9640 1 --2- 172.21.15.42:0/788778554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8424100480 0x7f8424100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.794+0000 7f84298e9640 1 -- 172.21.15.42:0/788778554 >> 172.21.15.42:0/788778554 conn(0x7f8424077210 msgr2=0x7f84240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.794+0000 7f84298e9640 1 -- 172.21.15.42:0/788778554 shutdown_connections 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.794+0000 7f84298e9640 1 -- 172.21.15.42:0/788778554 wait complete. 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f84298e9640 1 Processor -- start 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f84298e9640 1 -- start start 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f84298e9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8424100480 0x7f84240fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f84298e9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424100e30 0x7f84240fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f84298e9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84241055b0 0x7f84240fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f84298e9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8424110f60 con 0x7f8424100e30 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f84298e9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8424110de0 con 0x7f84241055b0 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f84298e9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f84241110e0 con 0x7f8424100480 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f841bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424100e30 0x7f84240fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f841bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424100e30 0x7f84240fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33450/0 (socket says 172.21.15.42:33450) 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f841bfff640 1 -- 172.21.15.42:0/3559831685 learned_addr learned my addr 172.21.15.42:0/3559831685 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f8422ffd640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8424100480 0x7f84240fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.795+0000 7f84237fe640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84241055b0 0x7f84240fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f841bfff640 1 -- 172.21.15.42:0/3559831685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8424100480 msgr2=0x7f84240fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f841bfff640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8424100480 0x7f84240fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f841bfff640 1 -- 172.21.15.42:0/3559831685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84241055b0 msgr2=0x7f84240fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f841bfff640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84241055b0 0x7f84240fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f841bfff640 1 -- 172.21.15.42:0/3559831685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84241a6a70 con 0x7f8424100e30 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f8422ffd640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8424100480 0x7f84240fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f84237fe640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84241055b0 0x7f84240fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f841bfff640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424100e30 0x7f84240fcbd0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f840c00b4a0 tx=0x7f840c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f84288e7640 1 -- 172.21.15.42:0/3559831685 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c014070 con 0x7f8424100e30 2024-09-19T09:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f84298e9640 1 -- 172.21.15.42:0/3559831685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84241a6d60 con 0x7f8424100e30 2024-09-19T09:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f84288e7640 1 -- 172.21.15.42:0/3559831685 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f840c010af0 con 0x7f8424100e30 2024-09-19T09:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f84288e7640 1 -- 172.21.15.42:0/3559831685 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c017d10 con 0x7f8424100e30 2024-09-19T09:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.796+0000 7f84298e9640 1 -- 172.21.15.42:0/3559831685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84241a71f0 con 0x7f8424100e30 2024-09-19T09:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.797+0000 7f84298e9640 1 -- 172.21.15.42:0/3559831685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84241008e0 con 0x7f8424100e30 2024-09-19T09:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.798+0000 7f84288e7640 1 -- 172.21.15.42:0/3559831685 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f840c017070 con 0x7f8424100e30 2024-09-19T09:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.799+0000 7f84288e7640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84100a3240 0x7f84100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.799+0000 7f8422ffd640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84100a3240 0x7f84100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.799+0000 7f84288e7640 1 -- 172.21.15.42:0/3559831685 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8116+0+0 (secure 0 0 0) 0x7f840c0ceda0 con 0x7f8424100e30 2024-09-19T09:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.800+0000 7f8422ffd640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84100a3240 0x7f84100a5700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8414009930 tx=0x7f8414008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:13.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.803+0000 7f84288e7640 1 -- 172.21.15.42:0/3559831685 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f840c09bae0 con 0x7f8424100e30 2024-09-19T09:44:13.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:13.980+0000 7f84298e9640 1 -- 172.21.15.42:0/3559831685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8424109270 con 0x7f8424100e30 2024-09-19T09:44:14.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.315+0000 7f84288e7640 1 -- 172.21.15.42:0/3559831685 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) ==== 169+0+0 (secure 0 0 0) 0x7f840c09b3e0 con 0x7f8424100e30 2024-09-19T09:44:14.318 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-19T09:44:14.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.320+0000 7f84298e9640 1 -- 172.21.15.42:0/3559831685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84100a3240 msgr2=0x7f84100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:14.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.320+0000 7f84298e9640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84100a3240 0x7f84100a5700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8414009930 tx=0x7f8414008040 comp rx=0 tx=0).stop 2024-09-19T09:44:14.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.320+0000 7f84298e9640 1 -- 172.21.15.42:0/3559831685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424100e30 msgr2=0x7f84240fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:14.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.320+0000 7f84298e9640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424100e30 0x7f84240fcbd0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f840c00b4a0 tx=0x7f840c00b960 comp rx=0 tx=0).stop 2024-09-19T09:44:14.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.320+0000 7f84298e9640 1 -- 172.21.15.42:0/3559831685 shutdown_connections 2024-09-19T09:44:14.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.320+0000 7f84298e9640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.42:6800/117232266,v1:172.21.15.42:6801/117232266] conn(0x7f84100a3240 0x7f84100a5700 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:14.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.320+0000 7f84298e9640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84241055b0 0x7f84240fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:14.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.320+0000 7f84298e9640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424100e30 0x7f84240fcbd0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:14.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.320+0000 7f84298e9640 1 --2- 172.21.15.42:0/3559831685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8424100480 0x7f84240fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:14.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.320+0000 7f84298e9640 1 -- 172.21.15.42:0/3559831685 >> 172.21.15.42:0/3559831685 conn(0x7f8424077210 msgr2=0x7f842410fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:14.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.321+0000 7f84298e9640 1 -- 172.21.15.42:0/3559831685 shutdown_connections 2024-09-19T09:44:14.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-19T09:44:14.321+0000 7f84298e9640 1 -- 172.21.15.42:0/3559831685 wait complete. 2024-09-19T09:44:14.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:14 smithi171 ceph-mon[35803]: pgmap v486: 65 pgs: 65 active+clean; 577 KiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:44:14.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:14 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3559831685' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:44:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:14 smithi136 ceph-mon[34840]: pgmap v486: 65 pgs: 65 active+clean; 577 KiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:44:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:14 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3559831685' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:44:14.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:14 smithi042 ceph-mon[31223]: pgmap v486: 65 pgs: 65 active+clean; 577 KiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:44:14.640 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:14 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3559831685' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:44:15.004 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:44:15.033 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:44:15.071 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:44:15.109 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T09:44:15.110 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:44:15.128 DEBUG:teuthology.orchestra.run.smithi136:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:44:15.149 DEBUG:teuthology.orchestra.run.smithi171:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:44:15.166 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T09:44:15.166 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T09:44:15.166 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:44:15.330 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:15 smithi042 systemd[1]: Stopping Ceph mon.a for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:15.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:15 smithi171 ceph-mon[35803]: from='client.? 172.21.15.42:0/3559831685' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:44:15.597 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:15 smithi171 ceph-mon[35803]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:44:15.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:15 smithi136 ceph-mon[34840]: from='client.? 172.21.15.42:0/3559831685' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:44:15.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:15 smithi136 ceph-mon[34840]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:44:15.704 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:15 smithi042 ceph-mon[31223]: from='client.? 172.21.15.42:0/3559831685' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:44:15.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:15 smithi042 ceph-mon[31223]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:44:15.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:15 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a[31219]: 2024-09-19T09:44:15.466+0000 7f9a60c79640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:44:15.705 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:15 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a[31219]: 2024-09-19T09:44:15.466+0000 7f9a60c79640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T09:44:16.019 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:15 smithi042 podman[100090]: 2024-09-19 09:44:15.734588402 +0000 UTC m=+0.360915303 container died 40a0eaaef04c925594f01910871152f30e217cc188c9e7db7f4ac56bdbc33397 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:44:16.346 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:16 smithi042 podman[100090]: 2024-09-19 09:44:16.201113709 +0000 UTC m=+0.827440650 container cleanup 40a0eaaef04c925594f01910871152f30e217cc188c9e7db7f4ac56bdbc33397 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T09:44:16.346 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:16 smithi042 bash[100090]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:44:16.607 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 19 09:44:16 smithi042 podman[100102]: 2024-09-19 09:44:16.477922723 +0000 UTC m=+0.739705074 container remove 40a0eaaef04c925594f01910871152f30e217cc188c9e7db7f4ac56bdbc33397 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T09:44:16.612 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T09:44:16.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:44:16.659 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T09:44:16.659 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T09:44:16.659 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.b 2024-09-19T09:44:16.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:16 smithi136 systemd[1]: Stopping Ceph mon.b for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:17.265 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:16 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-b[34836]: 2024-09-19T09:44:16.995+0000 7ffa3f079640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:44:17.265 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:16 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-b[34836]: 2024-09-19T09:44:16.995+0000 7ffa3f079640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:44:17.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:17 smithi136 podman[68230]: 2024-09-19 09:44:17.261268919 +0000 UTC m=+0.408167966 container died c48bd911c510c4a226ff8f429514c3b995107be0f27a7ca7adafe701a6214a93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-19T09:44:17.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:17 smithi136 podman[68230]: 2024-09-19 09:44:17.544928334 +0000 UTC m=+0.691827378 container cleanup c48bd911c510c4a226ff8f429514c3b995107be0f27a7ca7adafe701a6214a93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-b, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:44:17.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:Sep 19 09:44:17 smithi136 bash[68230]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-b 2024-09-19T09:44:17.972 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T09:44:18.021 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:44:18.021 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T09:44:18.021 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T09:44:18.022 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.c 2024-09-19T09:44:18.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:18 smithi171 systemd[1]: Stopping Ceph mon.c for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:18 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-c[35798]: 2024-09-19T09:44:18.409+0000 7fe4852e2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:44:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:18 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-c[35798]: 2024-09-19T09:44:18.409+0000 7fe4852e2640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:44:18.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:18 smithi171 podman[69766]: 2024-09-19 09:44:18.614364595 +0000 UTC m=+0.391069357 container died 2c4e114d3c1e553b28bbee4d5ddc560e430d246d6ef40fd55acd1d3a509948e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:44:19.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:18 smithi171 podman[69766]: 2024-09-19 09:44:18.951229861 +0000 UTC m=+0.727934622 container cleanup 2c4e114d3c1e553b28bbee4d5ddc560e430d246d6ef40fd55acd1d3a509948e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:44:19.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:18 smithi171 bash[69766]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-c 2024-09-19T09:44:19.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 19 09:44:19 smithi171 podman[69778]: 2024-09-19 09:44:19.127770888 +0000 UTC m=+0.508052179 container remove 2c4e114d3c1e553b28bbee4d5ddc560e430d246d6ef40fd55acd1d3a509948e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T09:44:19.382 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T09:44:19.429 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:44:19.429 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T09:44:19.429 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T09:44:19.429 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:44:19.732 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:44:19 smithi042 systemd[1]: Stopping Ceph mgr.x for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:20.068 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:44:19 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:44:19.730+0000 7ffaaedbc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:44:20.068 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:44:19 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x[31444]: 2024-09-19T09:44:19.730+0000 7ffaaedbc640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-19T09:44:20.068 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:44:19 smithi042 podman[100210]: 2024-09-19 09:44:19.761612071 +0000 UTC m=+0.132838639 container died 9fce6cbb9abf6dea84ceaab0ee276dd37a933a276975c9cd0d4573649691134e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T09:44:20.454 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:44:20 smithi042 podman[100210]: 2024-09-19 09:44:20.256725558 +0000 UTC m=+0.627952154 container cleanup 9fce6cbb9abf6dea84ceaab0ee276dd37a933a276975c9cd0d4573649691134e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T09:44:20.455 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Sep 19 09:44:20 smithi042 bash[100210]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-x 2024-09-19T09:44:20.630 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T09:44:20.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:44:20.667 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T09:44:20.667 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T09:44:20.667 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.y 2024-09-19T09:44:20.980 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:44:20 smithi136 systemd[1]: Stopping Ceph mgr.y for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:21.259 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:44:20 smithi136 podman[68353]: 2024-09-19 09:44:20.978917558 +0000 UTC m=+0.116747022 container died 2e09be71da8f4e73ad26a837eae60416d6811424143e3adf3d81ce7fc4b58308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T09:44:21.610 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:44:21 smithi136 podman[68353]: 2024-09-19 09:44:21.357780472 +0000 UTC m=+0.495610011 container cleanup 2e09be71da8f4e73ad26a837eae60416d6811424143e3adf3d81ce7fc4b58308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T09:44:21.610 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Sep 19 09:44:21 smithi136 bash[68353]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-y 2024-09-19T09:44:21.750 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T09:44:21.791 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:44:21.791 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T09:44:21.791 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T09:44:21.791 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.z 2024-09-19T09:44:22.097 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:44:21 smithi171 systemd[1]: Stopping Ceph mgr.z for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:22.531 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:44:22 smithi171 podman[69888]: 2024-09-19 09:44:22.193538837 +0000 UTC m=+0.205603554 container died 363a73a2b2e788b81633fcf65a9ebcc9e9503de26b6df09c67bb1b759ec0f1f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:44:22.847 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:44:22 smithi171 podman[69888]: 2024-09-19 09:44:22.530246059 +0000 UTC m=+0.542310769 container cleanup 363a73a2b2e788b81633fcf65a9ebcc9e9503de26b6df09c67bb1b759ec0f1f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T09:44:22.847 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:44:22 smithi171 bash[69888]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z 2024-09-19T09:44:22.847 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:44:22 smithi171 podman[69899]: 2024-09-19 09:44:22.706639929 +0000 UTC m=+0.507693992 container remove 363a73a2b2e788b81633fcf65a9ebcc9e9503de26b6df09c67bb1b759ec0f1f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mgr-z, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T09:44:22.847 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Sep 19 09:44:22 smithi171 systemd[1]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-19T09:44:22.959 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T09:44:22.994 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:44:22.995 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T09:44:22.995 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T09:44:22.995 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.0 2024-09-19T09:44:23.305 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:23 smithi042 systemd[1]: Stopping Ceph osd.0 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:23.705 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:23 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0[45050]: 2024-09-19T09:44:23.303+0000 7f6849097640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:44:23.705 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:23 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0[45050]: 2024-09-19T09:44:23.303+0000 7f6849097640 -1 osd.0 84 *** Got signal Terminated *** 2024-09-19T09:44:23.705 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:23 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0[45050]: 2024-09-19T09:44:23.303+0000 7f6849097640 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:44:29.137 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:28 smithi042 podman[100332]: 2024-09-19 09:44:28.731434729 +0000 UTC m=+5.532635051 container died 2244289fb6863ccbba32fb449f685ef7faa4a9125d8bd45a1a74bcd15d3d9a64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T09:44:29.389 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:29 smithi042 podman[100332]: 2024-09-19 09:44:29.136352665 +0000 UTC m=+5.937552968 container cleanup 2244289fb6863ccbba32fb449f685ef7faa4a9125d8bd45a1a74bcd15d3d9a64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:44:29.389 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:29 smithi042 bash[100332]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:44:29.705 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:29 smithi042 podman[100349]: 2024-09-19 09:44:29.387859358 +0000 UTC m=+0.651556688 container remove 2244289fb6863ccbba32fb449f685ef7faa4a9125d8bd45a1a74bcd15d3d9a64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:44:29.976 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:29 smithi042 podman[100436]: 2024-09-19 09:44:29.620852483 +0000 UTC m=+0.016070247 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:44:29.976 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:29 smithi042 podman[100436]: 2024-09-19 09:44:29.730493884 +0000 UTC m=+0.125711689 container create 0c2a3b6c65a92bb6965b50a48c5767777e0fa708de085e788b6ce4602c365799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:44:29.976 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:29 smithi042 podman[100436]: 2024-09-19 09:44:29.974431072 +0000 UTC m=+0.369648844 container init 0c2a3b6c65a92bb6965b50a48c5767777e0fa708de085e788b6ce4602c365799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:44:30.455 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:29 smithi042 podman[100436]: 2024-09-19 09:44:29.978501223 +0000 UTC m=+0.373718987 container start 0c2a3b6c65a92bb6965b50a48c5767777e0fa708de085e788b6ce4602c365799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T09:44:30.455 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:30 smithi042 podman[100436]: 2024-09-19 09:44:30.066453786 +0000 UTC m=+0.461671563 container attach 0c2a3b6c65a92bb6965b50a48c5767777e0fa708de085e788b6ce4602c365799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T09:44:30.455 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:30 smithi042 podman[100436]: 2024-09-19 09:44:30.172173308 +0000 UTC m=+0.567391078 container died 0c2a3b6c65a92bb6965b50a48c5767777e0fa708de085e788b6ce4602c365799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T09:44:30.731 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T09:44:30.756 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:30 smithi042 podman[100460]: 2024-09-19 09:44:30.711444899 +0000 UTC m=+0.532793013 container remove 0c2a3b6c65a92bb6965b50a48c5767777e0fa708de085e788b6ce4602c365799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T09:44:30.756 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:30 smithi042 systemd[1]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-19T09:44:30.756 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:30 smithi042 systemd[1]: Stopped Ceph osd.0 for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:44:30.756 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 19 09:44:30 smithi042 systemd[1]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.0.service: Consumed 25.104s CPU time. 2024-09-19T09:44:30.773 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:44:30.773 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T09:44:30.773 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T09:44:30.773 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.1 2024-09-19T09:44:31.071 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:30 smithi136 systemd[1]: Stopping Ceph osd.1 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:31.385 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:31 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1[39366]: 2024-09-19T09:44:31.068+0000 7fe31ff69640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:44:31.385 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:31 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1[39366]: 2024-09-19T09:44:31.068+0000 7fe31ff69640 -1 osd.1 84 *** Got signal Terminated *** 2024-09-19T09:44:31.385 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:31 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1[39366]: 2024-09-19T09:44:31.068+0000 7fe31ff69640 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:44:36.855 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:36 smithi136 podman[68488]: 2024-09-19 09:44:36.588254648 +0000 UTC m=+5.620557875 container died aee66299f4192ac435bfa80e22c4b5e129e87167676046e9ef798dc378a25654 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T09:44:37.135 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:36 smithi136 podman[68488]: 2024-09-19 09:44:36.926642155 +0000 UTC m=+5.958945382 container cleanup aee66299f4192ac435bfa80e22c4b5e129e87167676046e9ef798dc378a25654 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T09:44:37.135 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:36 smithi136 bash[68488]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:44:37.135 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:37 smithi136 podman[68505]: 2024-09-19 09:44:37.077882251 +0000 UTC m=+0.489924544 container remove aee66299f4192ac435bfa80e22c4b5e129e87167676046e9ef798dc378a25654 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:44:37.749 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:37 smithi136 podman[68597]: 2024-09-19 09:44:37.398044327 +0000 UTC m=+0.015868572 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:44:37.749 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:37 smithi136 podman[68597]: 2024-09-19 09:44:37.528689637 +0000 UTC m=+0.146513881 container create 7a3f0640de542635049b25b2b589bb237db07ddb2eaf094dee9194298a3fbfb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T09:44:37.749 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:37 smithi136 podman[68597]: 2024-09-19 09:44:37.747818306 +0000 UTC m=+0.365642549 container init 7a3f0640de542635049b25b2b589bb237db07ddb2eaf094dee9194298a3fbfb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:44:38.135 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:37 smithi136 podman[68597]: 2024-09-19 09:44:37.751313656 +0000 UTC m=+0.369137900 container start 7a3f0640de542635049b25b2b589bb237db07ddb2eaf094dee9194298a3fbfb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T09:44:38.135 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:37 smithi136 podman[68597]: 2024-09-19 09:44:37.864626951 +0000 UTC m=+0.482451210 container attach 7a3f0640de542635049b25b2b589bb237db07ddb2eaf094dee9194298a3fbfb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T09:44:38.135 INFO:journalctl@ceph.osd.1.smithi136.stdout:Sep 19 09:44:37 smithi136 podman[68597]: 2024-09-19 09:44:37.937263096 +0000 UTC m=+0.555087340 container died 7a3f0640de542635049b25b2b589bb237db07ddb2eaf094dee9194298a3fbfb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T09:44:38.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T09:44:38.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:44:38.547 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T09:44:38.547 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T09:44:38.547 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.2 2024-09-19T09:44:38.848 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:38 smithi171 systemd[1]: Stopping Ceph osd.2 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:39.347 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:38 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2[40840]: 2024-09-19T09:44:38.850+0000 7fa59a302640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:44:39.347 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:38 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2[40840]: 2024-09-19T09:44:38.850+0000 7fa59a302640 -1 osd.2 84 *** Got signal Terminated *** 2024-09-19T09:44:39.347 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:38 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2[40840]: 2024-09-19T09:44:38.850+0000 7fa59a302640 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:44:44.701 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:44 smithi171 podman[70026]: 2024-09-19 09:44:44.376379357 +0000 UTC m=+5.626564682 container died b30605ec195abea7824ff43391f18f7f2bd8b0cbbacac8df898a3105a239c9e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:44:44.953 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:44 smithi171 podman[70026]: 2024-09-19 09:44:44.700491725 +0000 UTC m=+5.950677043 container cleanup b30605ec195abea7824ff43391f18f7f2bd8b0cbbacac8df898a3105a239c9e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T09:44:44.953 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:44 smithi171 bash[70026]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:44:45.347 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:44 smithi171 podman[70042]: 2024-09-19 09:44:44.951654266 +0000 UTC m=+0.565372043 container remove b30605ec195abea7824ff43391f18f7f2bd8b0cbbacac8df898a3105a239c9e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:44:45.640 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:45 smithi171 podman[70133]: 2024-09-19 09:44:45.270790621 +0000 UTC m=+0.015854468 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:44:45.640 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:45 smithi171 podman[70133]: 2024-09-19 09:44:45.402357422 +0000 UTC m=+0.147421283 container create fa88100f2e84228062eb0f5aac1cfe0730da7523c715a1d7596e71712c35fc28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:44:45.640 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:45 smithi171 podman[70133]: 2024-09-19 09:44:45.638849178 +0000 UTC m=+0.383913022 container init fa88100f2e84228062eb0f5aac1cfe0730da7523c715a1d7596e71712c35fc28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:44:46.097 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:45 smithi171 podman[70133]: 2024-09-19 09:44:45.642570647 +0000 UTC m=+0.387634482 container start fa88100f2e84228062eb0f5aac1cfe0730da7523c715a1d7596e71712c35fc28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:44:46.097 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:45 smithi171 podman[70133]: 2024-09-19 09:44:45.729810629 +0000 UTC m=+0.474874481 container attach fa88100f2e84228062eb0f5aac1cfe0730da7523c715a1d7596e71712c35fc28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:44:46.097 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:45 smithi171 podman[70133]: 2024-09-19 09:44:45.840433663 +0000 UTC m=+0.585497507 container died fa88100f2e84228062eb0f5aac1cfe0730da7523c715a1d7596e71712c35fc28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T09:44:46.385 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:46 smithi171 podman[70156]: 2024-09-19 09:44:46.366334992 +0000 UTC m=+0.519977221 container remove fa88100f2e84228062eb0f5aac1cfe0730da7523c715a1d7596e71712c35fc28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:44:46.385 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:46 smithi171 systemd[1]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-19T09:44:46.385 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:46 smithi171 systemd[1]: Stopped Ceph osd.2 for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:44:46.385 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 19 09:44:46 smithi171 systemd[1]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.2.service: Consumed 21.217s CPU time. 2024-09-19T09:44:46.386 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T09:44:46.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:44:46.427 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T09:44:46.427 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T09:44:46.427 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.3 2024-09-19T09:44:46.749 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:46 smithi042 systemd[1]: Stopping Ceph osd.3 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:47.031 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:46 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3[51989]: 2024-09-19T09:44:46.746+0000 7fa10c698640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:44:47.031 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:46 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3[51989]: 2024-09-19T09:44:46.746+0000 7fa10c698640 -1 osd.3 84 *** Got signal Terminated *** 2024-09-19T09:44:47.031 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:46 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3[51989]: 2024-09-19T09:44:46.746+0000 7fa10c698640 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:44:50.135 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:49 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:49.664+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:44:51.135 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:50 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:50.677+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:44:51.204 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:51 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3[51989]: 2024-09-19T09:44:51.081+0000 7fa104c95640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.772549+0000 front 2024-09-19T09:44:26.772492+0000 (oldest deadline 2024-09-19T09:44:50.773661+0000) 2024-09-19T09:44:51.209 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:50 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:50.857+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:44:51.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:51 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:51.016+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:44:52.135 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:51 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:51.643+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:44:52.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:51 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:51.851+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:44:52.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:51 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:51.974+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:44:52.499 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:52 smithi042 podman[100540]: 2024-09-19 09:44:52.206458671 +0000 UTC m=+5.579791367 container died 34f14fa53644208cacfe1d2ede746fc9c15c774820e621d1660bfb021e3e5309 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:44:52.621 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:52 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:52.172+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:44:52.886 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:52 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:52.620+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:44:52.897 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:52 smithi042 podman[100540]: 2024-09-19 09:44:52.681083927 +0000 UTC m=+6.054416621 container cleanup 34f14fa53644208cacfe1d2ede746fc9c15c774820e621d1660bfb021e3e5309 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:44:52.898 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:52 smithi042 bash[100540]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:44:53.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:53 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:53.018+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:44:53.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:52 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:52.800+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:44:53.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:52 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:52.893+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:44:53.205 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:52 smithi042 podman[100567]: 2024-09-19 09:44:52.957747045 +0000 UTC m=+0.744963364 container remove 34f14fa53644208cacfe1d2ede746fc9c15c774820e621d1660bfb021e3e5309 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:44:53.545 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:53 smithi042 podman[100652]: 2024-09-19 09:44:53.180497197 +0000 UTC m=+0.016335489 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:44:53.545 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:53 smithi042 podman[100652]: 2024-09-19 09:44:53.283798103 +0000 UTC m=+0.119636443 container create 5694e4cb5fc85a3ceba1d1fb50840e30fa54bb47f0dd8f56c5e393ea00cff62b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:44:53.545 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:53 smithi042 podman[100652]: 2024-09-19 09:44:53.544368547 +0000 UTC m=+0.380206836 container init 5694e4cb5fc85a3ceba1d1fb50840e30fa54bb47f0dd8f56c5e393ea00cff62b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:44:53.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:53 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:53.208+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:44:53.929 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:53 smithi042 podman[100652]: 2024-09-19 09:44:53.548022152 +0000 UTC m=+0.383860431 container start 5694e4cb5fc85a3ceba1d1fb50840e30fa54bb47f0dd8f56c5e393ea00cff62b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:44:53.929 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:53 smithi042 podman[100652]: 2024-09-19 09:44:53.619316068 +0000 UTC m=+0.455154350 container attach 5694e4cb5fc85a3ceba1d1fb50840e30fa54bb47f0dd8f56c5e393ea00cff62b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:44:53.929 INFO:journalctl@ceph.osd.3.smithi042.stdout:Sep 19 09:44:53 smithi042 podman[100652]: 2024-09-19 09:44:53.743718486 +0000 UTC m=+0.579556777 container died 5694e4cb5fc85a3ceba1d1fb50840e30fa54bb47f0dd8f56c5e393ea00cff62b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:44:54.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:53 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:53.822+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:44:54.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:54 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:54.010+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:44:54.134 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:53 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:53.639+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:44:54.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:53 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:53.927+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:44:54.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:44:53 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:44:53.975+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:44:54.420 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T09:44:54.465 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:44:54.466 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T09:44:54.466 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T09:44:54.466 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.4 2024-09-19T09:44:54.493 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:54 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:54.214+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:44:54.770 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:54 smithi136 systemd[1]: Stopping Ceph osd.4 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:44:54.770 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:54 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:54.617+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:44:55.135 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:54 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:54.768+0000 7fa71f5be640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:44:55.135 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:54 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:54.768+0000 7fa71f5be640 -1 osd.4 84 *** Got signal Terminated *** 2024-09-19T09:44:55.135 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:54 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:54.768+0000 7fa71f5be640 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:44:55.347 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:54 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:54.855+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:44:55.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:54 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:54.977+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:44:55.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:44:54 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:44:54.959+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:44:55.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:54 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:54.963+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:44:55.586 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:55 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:55.183+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:44:55.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:55 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:55.584+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:44:56.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:44:55 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:44:55.961+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:44:56.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:55 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:55.933+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:44:56.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:55 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:55.932+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:44:56.347 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:55 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:55.864+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:44:56.550 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:56 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:56.193+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:44:56.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:56 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:56.548+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:44:57.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:56 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:56.826+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:44:57.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:56 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:56.964+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:44:57.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:44:56 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:44:56.970+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:44:57.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:56 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:56.921+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:44:57.529 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:57 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:57.164+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:44:57.529 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:57 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:57.164+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:44:57.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:57 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:57.527+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:44:58.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:57 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:57.955+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:44:58.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:57 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:57.809+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:44:58.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:57 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:57.809+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.968655+0000 front 2024-09-19T09:44:32.968696+0000 (oldest deadline 2024-09-19T09:44:57.668853+0000) 2024-09-19T09:44:58.098 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:44:57 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:44:57.947+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:44:58.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:44:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:44:57.999+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:44:58.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:57 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:57.957+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:44:58.544 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:58 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:58.158+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:44:58.544 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:58 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:58.158+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:44:58.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:58 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:58.543+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:44:59.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:58 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:58.991+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:44:59.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:58 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:58.837+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:44:59.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:58 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:58.837+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.968655+0000 front 2024-09-19T09:44:32.968696+0000 (oldest deadline 2024-09-19T09:44:57.668853+0000) 2024-09-19T09:44:59.097 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:44:58 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:44:58.951+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:44:59.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:44:59 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:44:59.042+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:44:59.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:58 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:58.960+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:44:59.510 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:44:59 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:44:59.278+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:44:59.510 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:59 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:59.195+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:44:59.510 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:44:59 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:44:59.195+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:44:59.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:44:59 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4[45869]: 2024-09-19T09:44:59.508+0000 7fa717bbb640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:28.228234+0000 front 2024-09-19T09:44:28.227985+0000 (oldest deadline 2024-09-19T09:44:48.727969+0000) 2024-09-19T09:45:00.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:59 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:59.813+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:45:00.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:44:59 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:44:59.814+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.968655+0000 front 2024-09-19T09:44:32.968696+0000 (oldest deadline 2024-09-19T09:44:57.668853+0000) 2024-09-19T09:45:00.097 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:44:59 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:44:59.974+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:00.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:59 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:59.983+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:00.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:44:59 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:44:59.983+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:00.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:00.003+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:00.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:00.003+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:00.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:59 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:59.975+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:00.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:44:59 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:44:59.975+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:00.462 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:00 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:00.232+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:00.462 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:00 smithi136 podman[68700]: 2024-09-19 09:45:00.208509111 +0000 UTC m=+5.546955776 container died dfefea5c5620f5a3009760f518719deb7f3785fe280b65fd101864037227b2e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:45:00.462 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:00 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:00.241+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:00.462 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:00 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:00.242+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:00.762 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:00 smithi136 podman[68700]: 2024-09-19 09:45:00.551493182 +0000 UTC m=+5.889939845 container cleanup dfefea5c5620f5a3009760f518719deb7f3785fe280b65fd101864037227b2e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:45:00.762 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:00 smithi136 bash[68700]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:45:01.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:00 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:00.830+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:45:01.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:00 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:00.830+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.968655+0000 front 2024-09-19T09:44:32.968696+0000 (oldest deadline 2024-09-19T09:44:57.668853+0000) 2024-09-19T09:45:01.097 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:00 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:00.974+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:01.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:00 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:00.963+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:01.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:00 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:00.963+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:01.135 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:00 smithi136 podman[68717]: 2024-09-19 09:45:00.760978386 +0000 UTC m=+0.546432988 container remove dfefea5c5620f5a3009760f518719deb7f3785fe280b65fd101864037227b2e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:45:01.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:00.965+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:01.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:00 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:00.965+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:01.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:01 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:01.036+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:01.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:01 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:01.036+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:01.490 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:01 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:01.252+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:01.491 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:01 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:01.228+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:01.491 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:01 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:01.228+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:01.491 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:01 smithi136 podman[68811]: 2024-09-19 09:45:01.10564312 +0000 UTC m=+0.016446471 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:45:01.491 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:01 smithi136 podman[68811]: 2024-09-19 09:45:01.22858307 +0000 UTC m=+0.139386425 container create 1346958e53eea5d2982a86977999696ed60ea4177e410bbfe84907a4fd75aeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:45:01.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:01 smithi136 podman[68811]: 2024-09-19 09:45:01.489519231 +0000 UTC m=+0.400322584 container init 1346958e53eea5d2982a86977999696ed60ea4177e410bbfe84907a4fd75aeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:45:01.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:01 smithi136 podman[68811]: 2024-09-19 09:45:01.493309354 +0000 UTC m=+0.404112715 container start 1346958e53eea5d2982a86977999696ed60ea4177e410bbfe84907a4fd75aeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:45:01.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:01 smithi136 podman[68811]: 2024-09-19 09:45:01.556173923 +0000 UTC m=+0.466977296 container attach 1346958e53eea5d2982a86977999696ed60ea4177e410bbfe84907a4fd75aeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:45:01.886 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:01 smithi136 podman[68811]: 2024-09-19 09:45:01.68888648 +0000 UTC m=+0.599689848 container died 1346958e53eea5d2982a86977999696ed60ea4177e410bbfe84907a4fd75aeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:45:02.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:01 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:01.822+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:45:02.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:01 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:01.822+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.968655+0000 front 2024-09-19T09:44:32.968696+0000 (oldest deadline 2024-09-19T09:44:57.668853+0000) 2024-09-19T09:45:02.097 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:01 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:01.935+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:02.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:02 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:02.011+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:02.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:02 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:02.011+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:02.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T09:45:02.300 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:02 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:02.218+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:02.300 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:02 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:02.234+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:02.300 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:02 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:02.234+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:02.300 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:02 smithi136 podman[68837]: 2024-09-19 09:45:02.209165851 +0000 UTC m=+0.511433246 container remove 1346958e53eea5d2982a86977999696ed60ea4177e410bbfe84907a4fd75aeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:45:02.300 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:02 smithi136 systemd[1]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-19T09:45:02.300 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:02 smithi136 systemd[1]: Stopped Ceph osd.4 for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:45:02.301 INFO:journalctl@ceph.osd.4.smithi136.stdout:Sep 19 09:45:02 smithi136 systemd[1]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.4.service: Consumed 19.795s CPU time. 2024-09-19T09:45:02.315 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:45:02.315 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T09:45:02.315 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T09:45:02.316 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.5 2024-09-19T09:45:02.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:02 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:02.080+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:02.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:02 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:02.080+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:02.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:01 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:01.997+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:02.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:01 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:01.997+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:02.597 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:02 smithi171 systemd[1]: Stopping Ceph osd.5 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:45:02.948 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:02 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:02.619+0000 7f81147ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:45:02.948 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:02 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:02.619+0000 7f81147ce640 -1 osd.5 84 *** Got signal Terminated *** 2024-09-19T09:45:02.948 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:02 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:02.619+0000 7f81147ce640 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:45:02.948 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:02 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:02.843+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:45:02.948 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:02 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:02.843+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.968655+0000 front 2024-09-19T09:44:32.968696+0000 (oldest deadline 2024-09-19T09:44:57.668853+0000) 2024-09-19T09:45:03.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:02 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:02.945+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:03.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:03 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:03.058+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:03.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:03 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:03.058+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:03.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:03 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:03.032+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:03.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:03 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:03.032+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:03.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:03 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:03.002+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:03.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:03 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:03.002+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:03.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:03 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:03.257+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:03.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:03 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:03.191+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:03.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:03 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:03.191+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:04.347 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:03 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:03.882+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:45:04.347 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:03 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:03.882+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.968655+0000 front 2024-09-19T09:44:32.968696+0000 (oldest deadline 2024-09-19T09:44:57.668853+0000) 2024-09-19T09:45:04.348 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:03 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:03.903+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:04.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:04 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:04.088+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:04.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:04 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:04.088+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:04.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:04 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:04.002+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:04.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:04 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:04.002+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:04.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:04 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:04.016+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:04.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:04 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:04.016+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:04.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:04 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:04.280+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:04.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:04 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:04.172+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:04.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:04 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:04.172+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:05.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:04 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:04.838+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:45:05.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:04 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:04.838+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.968655+0000 front 2024-09-19T09:44:32.968696+0000 (oldest deadline 2024-09-19T09:44:57.668853+0000) 2024-09-19T09:45:05.097 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:04 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:04.944+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:05.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:05 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:05.074+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:05.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:05 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:05.074+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:05.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:05 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:05.074+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:05.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:05.000+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:05.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:05.000+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:05.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:05.003+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:05.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:05.003+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:05.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:05.003+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:05.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:05 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:05.325+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:05.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:05 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:05.192+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:05.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:05 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:05.192+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:05.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:05 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:05.192+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:06.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:05 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:05.834+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:45:06.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:05 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:05.834+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.968655+0000 front 2024-09-19T09:44:32.968696+0000 (oldest deadline 2024-09-19T09:44:57.668853+0000) 2024-09-19T09:45:06.097 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:05 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:05.922+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:06.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:06 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:06.060+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:06.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:06 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:06.060+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:06.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:06 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:06.060+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:06.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:05.971+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:06.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:05.971+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:06.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:05.976+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:06.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:05.976+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:06.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:05.976+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:06.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:06 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:06.328+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:06.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:06 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:06.163+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:06.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:06 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:06.163+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:06.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:06 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:06.163+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:07.097 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:06 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:06.912+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:07.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:06 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:06.810+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.967510+0000 front 2024-09-19T09:44:25.967495+0000 (oldest deadline 2024-09-19T09:44:51.867444+0000) 2024-09-19T09:45:07.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:06 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:06.810+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.968655+0000 front 2024-09-19T09:44:32.968696+0000 (oldest deadline 2024-09-19T09:44:57.668853+0000) 2024-09-19T09:45:07.097 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:06 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5[47321]: 2024-09-19T09:45:06.810+0000 7f8110dd3640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.969944+0000 front 2024-09-19T09:44:42.969919+0000 (oldest deadline 2024-09-19T09:45:06.470164+0000) 2024-09-19T09:45:07.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:06.987+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:07.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:06.987+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:07.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:06.985+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:07.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:06.985+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:07.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:06 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:06.985+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:07.597 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:07 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:07.102+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:07.597 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:07 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:07.102+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:07.597 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:07 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:07.102+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:07.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:07 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:07.288+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:07.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:07 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:07.288+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:07.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:07 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:07.174+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:07.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:07 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:07.174+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:07.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:07 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:07.174+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:08.228 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:07 smithi171 podman[70235]: 2024-09-19 09:45:07.958341803 +0000 UTC m=+5.450379654 container died 9e063e7cc04b7630d78b849ac1c08e9ac44715ed6f881afc7ee13810b6bb9f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:45:08.228 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:07 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:07.942+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:08.228 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:08.137+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:08.228 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:08.137+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:08.229 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:08.137+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:08.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:07 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:07.975+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:08.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:07 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:07.975+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:08.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:08.015+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:08.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:08.015+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:08.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:08.015+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:08.561 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:08 smithi171 podman[70235]: 2024-09-19 09:45:08.309463881 +0000 UTC m=+5.801501722 container cleanup 9e063e7cc04b7630d78b849ac1c08e9ac44715ed6f881afc7ee13810b6bb9f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T09:45:08.562 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:08 smithi171 bash[70235]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:45:08.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:08.302+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:08.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:08.302+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:08.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:08.151+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:08.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:08.151+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:08.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:08 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:08.151+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:08.847 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:08 smithi171 podman[70250]: 2024-09-19 09:45:08.560720763 +0000 UTC m=+0.603733069 container remove 9e063e7cc04b7630d78b849ac1c08e9ac44715ed6f881afc7ee13810b6bb9f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T09:45:09.141 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:08.968+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:09.142 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:08 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:08.968+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:09.142 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:08 smithi171 podman[70342]: 2024-09-19 09:45:08.869863987 +0000 UTC m=+0.105442621 container create 52769c88a141ed8cee80dd897eaf99d37d1bb44ab4007d6c4912f3552f93dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T09:45:09.142 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:08 smithi171 podman[70342]: 2024-09-19 09:45:08.780198437 +0000 UTC m=+0.015777073 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:45:09.142 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:09 smithi171 podman[70342]: 2024-09-19 09:45:09.097210195 +0000 UTC m=+0.332788830 container init 52769c88a141ed8cee80dd897eaf99d37d1bb44ab4007d6c4912f3552f93dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:45:09.142 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:09 smithi171 podman[70342]: 2024-09-19 09:45:09.100561237 +0000 UTC m=+0.336139873 container start 52769c88a141ed8cee80dd897eaf99d37d1bb44ab4007d6c4912f3552f93dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:45:09.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:08.998+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:09.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:08 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:08.998+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:09.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:09 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:09.052+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:09.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:09 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:09.052+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:09.456 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:09 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:09.052+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:09.597 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:09 smithi171 podman[70342]: 2024-09-19 09:45:09.163544857 +0000 UTC m=+0.399123513 container attach 52769c88a141ed8cee80dd897eaf99d37d1bb44ab4007d6c4912f3552f93dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:45:09.597 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:09 smithi171 podman[70342]: 2024-09-19 09:45:09.289214252 +0000 UTC m=+0.524792889 container died 52769c88a141ed8cee80dd897eaf99d37d1bb44ab4007d6c4912f3552f93dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T09:45:09.598 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:09 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:09.139+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:09.598 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:09 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:09.139+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:09.598 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:09 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:09.139+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:09.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:09 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:09.323+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:09.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:09 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:09.323+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:09.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:09 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:09.191+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:09.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:09 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:09.191+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:09.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:09 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:09.191+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:09.889 INFO:journalctl@ceph.osd.5.smithi171.stdout:Sep 19 09:45:09 smithi171 podman[70365]: 2024-09-19 09:45:09.866976259 +0000 UTC m=+0.571182804 container remove 52769c88a141ed8cee80dd897eaf99d37d1bb44ab4007d6c4912f3552f93dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:45:09.895 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T09:45:09.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:45:09.933 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T09:45:09.933 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T09:45:09.933 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.6 2024-09-19T09:45:10.165 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:09 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:09.963+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:10.165 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:09 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:09.963+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:10.236 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:10.020+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:10.236 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:10.020+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:10.236 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:10.020+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:10.236 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:09 smithi042 systemd[1]: Stopping Ceph osd.6 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:45:10.236 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:10.002+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:10.236 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:10.002+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:10.236 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:10.002+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.044482+0000 front 2024-09-19T09:44:39.044555+0000 (oldest deadline 2024-09-19T09:45:09.645082+0000) 2024-09-19T09:45:10.236 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:10.233+0000 7f03151c0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:45:10.237 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:10.233+0000 7f03151c0640 -1 osd.6 84 *** Got signal Terminated *** 2024-09-19T09:45:10.237 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:10.233+0000 7f03151c0640 -1 osd.6 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:45:10.597 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:10 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:10.163+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:10.597 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:10 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:10.163+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:10.597 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:10 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:10.163+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:10.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:10 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:10.372+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:10.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:10 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:10.372+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:10.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:10 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:10.156+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:10.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:10 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:10.156+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:10.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:10 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:10.156+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:11.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:11 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:11.154+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:11.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:11 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:11.154+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:11.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:11 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:11.154+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:11.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:10 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:10.956+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:11.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:10 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:10.956+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:11.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:10.994+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:11.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:10.994+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:11.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:10 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:10.994+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.044482+0000 front 2024-09-19T09:44:39.044555+0000 (oldest deadline 2024-09-19T09:45:09.645082+0000) 2024-09-19T09:45:11.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:11 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:11.042+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:11.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:11 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:11.042+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:11.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:11 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:11.042+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:11.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:11 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:11.390+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:11.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:11 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:11.390+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:11.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:11 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:11.191+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:11.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:11 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:11.191+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:11.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:11 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:11.191+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:12.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:11 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:11.948+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:12.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:11 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:11.948+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:12.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:12 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:12.165+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:12.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:12 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:12.165+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:12.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:12 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:12.165+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:12.409 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:12 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:12.154+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:12.409 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:12 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:12.154+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:12.409 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:12 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:12.154+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:12.457 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:11 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:11.969+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:12.457 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:11 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:11.969+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:12.458 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:11 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:11.969+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.044482+0000 front 2024-09-19T09:44:39.044555+0000 (oldest deadline 2024-09-19T09:45:09.645082+0000) 2024-09-19T09:45:12.458 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:12 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:12.047+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:12.458 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:12 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:12.047+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:12.458 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:12 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:12.047+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:12.885 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:12 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:12.407+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:12.885 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:12 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:12.407+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:13.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:12 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:12.942+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:13.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:12 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:12.942+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:13.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:12 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:12.942+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.044482+0000 front 2024-09-19T09:44:39.044555+0000 (oldest deadline 2024-09-19T09:45:09.645082+0000) 2024-09-19T09:45:13.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:13 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:13.024+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:13.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:13 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:13.024+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:13.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:13 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:13.024+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:13.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:12 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:12.956+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:13.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:12 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:12.956+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:13.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:13 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:13.137+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:13.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:13 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:13.137+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:13.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:13 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:13.137+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:13.425 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:13 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:13.154+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:13.426 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:13 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:13.154+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:13.426 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:13 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:13.154+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:13.889 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:13 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:13.423+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:13.889 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:13 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:13.423+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:14.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:14 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:14.016+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:14.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:14 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:14.016+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:14.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:14 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:14.016+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:14.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:13 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:13.904+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:14.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:13 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:13.904+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:14.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:13 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:13.904+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.044482+0000 front 2024-09-19T09:44:39.044555+0000 (oldest deadline 2024-09-19T09:45:09.645082+0000) 2024-09-19T09:45:14.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:13 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:13.904+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.645436+0000 front 2024-09-19T09:44:49.645394+0000 (oldest deadline 2024-09-19T09:45:13.645840+0000) 2024-09-19T09:45:14.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:13 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:13.964+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:14.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:13 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:13.964+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:14.348 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:13 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:13.964+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:14.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:14 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:14.163+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:14.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:14 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:14.163+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:14.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:14 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:14.163+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:14.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:14 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:14.189+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:14.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:14 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:14.189+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:14.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:14 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:14.189+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:14.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:14 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:14.189+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:14.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:14 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:14.437+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:14.636 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:14 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:14.437+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:14.636 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:14 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:14.437+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:51.721391+0000 front 2024-09-19T09:44:51.721373+0000 (oldest deadline 2024-09-19T09:45:14.021416+0000) 2024-09-19T09:45:15.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:14 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:14.907+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.242629+0000 front 2024-09-19T09:44:26.242600+0000 (oldest deadline 2024-09-19T09:44:53.243056+0000) 2024-09-19T09:45:15.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:14 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:14.907+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:33.243865+0000 front 2024-09-19T09:44:33.243676+0000 (oldest deadline 2024-09-19T09:44:59.044029+0000) 2024-09-19T09:45:15.205 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:14 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:14.907+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.044482+0000 front 2024-09-19T09:44:39.044555+0000 (oldest deadline 2024-09-19T09:45:09.645082+0000) 2024-09-19T09:45:15.206 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:14 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6[58944]: 2024-09-19T09:45:14.907+0000 7f03117c5640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.645436+0000 front 2024-09-19T09:44:49.645394+0000 (oldest deadline 2024-09-19T09:45:13.645840+0000) 2024-09-19T09:45:15.206 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:15 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:15.057+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:15.206 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:15 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:15.057+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:15.206 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:15 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:15.057+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:15.207 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:15 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:15.057+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:15.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:15 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:15.172+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:15.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:15 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:15.172+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:15.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:15 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:15.172+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:15.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:14 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:14.951+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:15.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:14 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:14.951+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:15.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:14 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:14.951+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:15.478 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:15 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:15.184+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:15.478 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:15 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:15.184+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:15.479 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:15 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:15.184+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:15.479 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:15 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:15.184+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:15.885 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:15 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:15.476+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:15.885 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:15 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:15.476+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:15.885 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:15 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:15.476+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:51.721391+0000 front 2024-09-19T09:44:51.721373+0000 (oldest deadline 2024-09-19T09:45:14.021416+0000) 2024-09-19T09:45:16.007 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:15 smithi042 podman[100754]: 2024-09-19 09:45:15.709129355 +0000 UTC m=+5.571804552 container died 850481ed1b9eaaa564583acd1ce9fef8a917c242085c29888b453eaa43ce59ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T09:45:16.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:15 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:15.933+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:16.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:15 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:15.933+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:16.348 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:15 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:15.933+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:16.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:16 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:16.140+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:16.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:16 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:16.140+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:16.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:16 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:16.140+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:16.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:16 smithi042 podman[100754]: 2024-09-19 09:45:16.20060721 +0000 UTC m=+6.063282407 container cleanup 850481ed1b9eaaa564583acd1ce9fef8a917c242085c29888b453eaa43ce59ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:45:16.455 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:16 smithi042 bash[100754]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6 2024-09-19T09:45:16.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:16 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:16.030+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:16.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:16 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:16.030+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:16.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:16 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:16.030+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:16.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:16 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:16.030+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:16.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:16 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:16.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:16.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:16 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:16.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:16.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:16 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:16.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:16.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:16 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:16.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:16.636 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:16 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:16.471+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:16.636 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:16 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:16.471+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:16.636 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:16 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:16.471+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:51.721391+0000 front 2024-09-19T09:44:51.721373+0000 (oldest deadline 2024-09-19T09:45:14.021416+0000) 2024-09-19T09:45:16.831 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:16 smithi042 podman[100770]: 2024-09-19 09:45:16.460348492 +0000 UTC m=+0.744168962 container remove 850481ed1b9eaaa564583acd1ce9fef8a917c242085c29888b453eaa43ce59ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:45:17.125 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:16 smithi042 podman[100861]: 2024-09-19 09:45:16.830062898 +0000 UTC m=+0.113973226 container create d7589a8b07530f0745bf707aa8980d3161ec728d8c62009b2c79fd78092b9031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:45:17.125 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:16 smithi042 podman[100861]: 2024-09-19 09:45:16.732928286 +0000 UTC m=+0.016838621 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:45:17.125 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:17 smithi042 podman[100861]: 2024-09-19 09:45:17.040817266 +0000 UTC m=+0.324727604 container init d7589a8b07530f0745bf707aa8980d3161ec728d8c62009b2c79fd78092b9031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:45:17.125 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:17 smithi042 podman[100861]: 2024-09-19 09:45:17.044145027 +0000 UTC m=+0.328055355 container start d7589a8b07530f0745bf707aa8980d3161ec728d8c62009b2c79fd78092b9031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:45:17.125 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:17 smithi042 podman[100861]: 2024-09-19 09:45:17.12395767 +0000 UTC m=+0.407867995 container attach d7589a8b07530f0745bf707aa8980d3161ec728d8c62009b2c79fd78092b9031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T09:45:17.126 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:17 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:17.012+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:17.126 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:17 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:17.012+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:17.126 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:17 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:17.012+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:17.126 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:17 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:17.012+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:17.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:16 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:16.929+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:17.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:16 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:16.929+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:17.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:16 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:16.929+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:17.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:17 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:17.119+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:17.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:17 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:17.119+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:17.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:17 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:17.119+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:17.454 INFO:journalctl@ceph.osd.6.smithi042.stdout:Sep 19 09:45:17 smithi042 podman[100861]: 2024-09-19 09:45:17.238817223 +0000 UTC m=+0.522727554 container died d7589a8b07530f0745bf707aa8980d3161ec728d8c62009b2c79fd78092b9031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:45:17.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:17 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:17.504+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:17.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:17 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:17.504+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:17.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:17 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:17.504+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:51.721391+0000 front 2024-09-19T09:44:51.721373+0000 (oldest deadline 2024-09-19T09:45:14.021416+0000) 2024-09-19T09:45:17.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:17 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:17.270+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:17.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:17 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:17.270+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:17.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:17 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:17.270+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:17.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:17 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:17.270+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:17.935 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T09:45:17.976 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:45:17.976 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T09:45:17.976 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T09:45:17.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.7 2024-09-19T09:45:18.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:17 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:17.967+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:18.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:17 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:17.967+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:18.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:17 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:17.967+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:18.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:17 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:17.967+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:18.268 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:18 smithi136 systemd[1]: Stopping Ceph osd.7 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:45:18.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:17 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:17.924+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:18.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:17 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:17.924+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:18.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:17 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:17.924+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:18.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:18 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:18.079+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:18.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:18 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:18.079+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:18.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:18 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:18.079+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:18.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:18.268+0000 7f4339db9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:45:18.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:18.268+0000 7f4339db9640 -1 osd.7 84 *** Got signal Terminated *** 2024-09-19T09:45:18.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:18.268+0000 7f4339db9640 -1 osd.7 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:45:18.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:18.515+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:18.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:18.515+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:18.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:18.515+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:51.721391+0000 front 2024-09-19T09:44:51.721373+0000 (oldest deadline 2024-09-19T09:45:14.021416+0000) 2024-09-19T09:45:18.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:18.266+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:18.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:18.266+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:18.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:18.266+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:18.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:18 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:18.266+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:19.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:18 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:18.952+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:19.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:18 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:18.952+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:19.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:18 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:18.952+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:19.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:19 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:19.070+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:19.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:19 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:19.070+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:19.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:19 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:19.070+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:19.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:18 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:18.976+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:19.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:18 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:18.976+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:19.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:18 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:18.976+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:19.455 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:18 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:18.976+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:19.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:19 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:19.498+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:19.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:19 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:19.498+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:19.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:19 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:19.498+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:51.721391+0000 front 2024-09-19T09:44:51.721373+0000 (oldest deadline 2024-09-19T09:45:14.021416+0000) 2024-09-19T09:45:19.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:19 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:19.267+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:19.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:19 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:19.267+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:19.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:19 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:19.267+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:19.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:19 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:19.267+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:20.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:19 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:19.940+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:20.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:19 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:19.940+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:20.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:19 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:19.940+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:20.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:19 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:19.940+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:20.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:20 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:20.039+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:20.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:20 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:20.039+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:20.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:20 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:20.039+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:20.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:19 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:19.960+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:20.348 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:19 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:19.960+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:20.348 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:19 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:19.960+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:20.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:20 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:20.521+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:20.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:20 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:20.521+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:20.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:20 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:20.521+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:51.721391+0000 front 2024-09-19T09:44:51.721373+0000 (oldest deadline 2024-09-19T09:45:14.021416+0000) 2024-09-19T09:45:20.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:20 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:20.313+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:20.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:20 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:20.313+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:20.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:20 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:20.313+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:20.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:20 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:20.313+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:21.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:20 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:20.933+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:21.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:20 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:20.933+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:21.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:20 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:20.933+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:21.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:20 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:20.933+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:21.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:21 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:21.011+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:21.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:21 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:21.011+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:21.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:21 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:21.011+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:21.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:20 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:20.990+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:21.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:20 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:20.990+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:21.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:20 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:20.990+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:21.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:21 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:21.501+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:21.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:21 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:21.501+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:21.635 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:21 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:21.501+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:51.721391+0000 front 2024-09-19T09:44:51.721373+0000 (oldest deadline 2024-09-19T09:45:14.021416+0000) 2024-09-19T09:45:21.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:21 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:21.362+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:21.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:21 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:21.362+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:21.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:21 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:21.362+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:21.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:21 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:21.362+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:22.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:21.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:22.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:21.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:22.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:21.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:22.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:21 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:21.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:22.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:22 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:22.023+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:22.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:22 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:22.023+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:22.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:22 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:22.023+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:22.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:21 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:21.953+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:22.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:21 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:21.953+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:22.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:21 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:21.953+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:22.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:22.398+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:22.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:22.398+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:22.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:22.398+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:22.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:22.398+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:22.886 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:22.502+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.017859+0000 front 2024-09-19T09:44:35.017817+0000 (oldest deadline 2024-09-19T09:44:58.517831+0000) 2024-09-19T09:45:22.886 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:22.502+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.119467+0000 front 2024-09-19T09:44:43.119376+0000 (oldest deadline 2024-09-19T09:45:07.219498+0000) 2024-09-19T09:45:22.886 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:22.502+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:51.721391+0000 front 2024-09-19T09:44:51.721373+0000 (oldest deadline 2024-09-19T09:45:14.021416+0000) 2024-09-19T09:45:22.886 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:22 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7[52842]: 2024-09-19T09:45:22.502+0000 7f43363be640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:57.522296+0000 front 2024-09-19T09:44:57.522321+0000 (oldest deadline 2024-09-19T09:45:22.222389+0000) 2024-09-19T09:45:23.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:22 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:22.865+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:23.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:22 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:22.865+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:23.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:22 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:22.865+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:23.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:22 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:22.865+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:23.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:23.072+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:23.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:23.072+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:23.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:23.072+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:23.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:22 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:22.990+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:23.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:22 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:22.990+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:23.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:22 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:22.990+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:23.804 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:23 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:23.414+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:23.804 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:23 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:23.414+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:23.804 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:23 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:23.414+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:23.804 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:23 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:23.414+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:24.070 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:23 smithi136 podman[68918]: 2024-09-19 09:45:23.803223594 +0000 UTC m=+5.638527792 container died 459b45a1273e3b0d7cf47eb102cb3c8fd81d5862eb7d79ccb2241af559cc0387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:45:24.395 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:24.098+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:24.395 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:24.098+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:24.395 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:24.098+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:24.395 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:23 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:23.819+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:24.395 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:23 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:23.819+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:24.396 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:23 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:23.819+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:24.396 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:23 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:23.819+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:24.396 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:23 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:23.819+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:24.396 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:24 smithi136 podman[68918]: 2024-09-19 09:45:24.159530416 +0000 UTC m=+5.994834648 container cleanup 459b45a1273e3b0d7cf47eb102cb3c8fd81d5862eb7d79ccb2241af559cc0387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T09:45:24.396 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:24 smithi136 bash[68918]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7 2024-09-19T09:45:24.396 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:23.951+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:24.396 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:23.951+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:24.396 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:23.951+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:24.396 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:23 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:23.951+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:24.780 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:24 smithi136 podman[68935]: 2024-09-19 09:45:24.460712994 +0000 UTC m=+0.652439062 container remove 459b45a1273e3b0d7cf47eb102cb3c8fd81d5862eb7d79ccb2241af559cc0387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:45:24.781 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:24 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:24.444+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:24.781 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:24 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:24.444+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:24.781 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:24 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:24.444+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:24.781 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:24 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:24.444+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:25.064 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:24 smithi136 podman[69026]: 2024-09-19 09:45:24.682255644 +0000 UTC m=+0.016173940 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:45:25.064 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:24 smithi136 podman[69026]: 2024-09-19 09:45:24.80303876 +0000 UTC m=+0.136957104 container create df23dfc97e6f3078fcde701fd27be7e9ce64b97ed6f110f36f0fa783ecfc79bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T09:45:25.064 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:24 smithi136 podman[69026]: 2024-09-19 09:45:24.988725233 +0000 UTC m=+0.322643532 container init df23dfc97e6f3078fcde701fd27be7e9ce64b97ed6f110f36f0fa783ecfc79bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T09:45:25.065 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:24 smithi136 podman[69026]: 2024-09-19 09:45:24.992492051 +0000 UTC m=+0.326410347 container start df23dfc97e6f3078fcde701fd27be7e9ce64b97ed6f110f36f0fa783ecfc79bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:45:25.065 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:25 smithi136 podman[69026]: 2024-09-19 09:45:25.063374009 +0000 UTC m=+0.397292312 container attach df23dfc97e6f3078fcde701fd27be7e9ce64b97ed6f110f36f0fa783ecfc79bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:45:25.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:24.811+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:25.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:24.811+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:25.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:24.811+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:25.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:24.811+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:25.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:24 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:24.811+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:25.333 INFO:journalctl@ceph.osd.7.smithi136.stdout:Sep 19 09:45:25 smithi136 podman[69026]: 2024-09-19 09:45:25.191561898 +0000 UTC m=+0.525480199 container died df23dfc97e6f3078fcde701fd27be7e9ce64b97ed6f110f36f0fa783ecfc79bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:45:25.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:25 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:25.066+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:25.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:25 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:25.066+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:25.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:25 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:25.066+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:25.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:25 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:25.066+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.919283+0000 front 2024-09-19T09:44:58.919363+0000 (oldest deadline 2024-09-19T09:45:24.819220+0000) 2024-09-19T09:45:25.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:24.903+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:25.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:24.903+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:25.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:24.903+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:25.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:24 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:24.903+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:25.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:25 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:25.436+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:25.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:25 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:25.436+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:25.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:25 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:25.436+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:25.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:25 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:25.436+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:25.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:25 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:25.436+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:25.779 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T09:45:25.817 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:45:25.817 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T09:45:25.818 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T09:45:25.818 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.8 2024-09-19T09:45:26.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:25 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:25.910+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:26.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:25 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:25.910+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:26.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:25 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:25.910+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:26.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:25 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:25.910+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:26.097 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:25 smithi171 systemd[1]: Stopping Ceph osd.8 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:45:26.098 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:26.087+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:26.098 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:26.087+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:26.098 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:26.087+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:26.098 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:26.087+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.919283+0000 front 2024-09-19T09:44:58.919363+0000 (oldest deadline 2024-09-19T09:45:24.819220+0000) 2024-09-19T09:45:26.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:25.778+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:26.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:25.778+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:26.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:25.778+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:26.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:25.778+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:26.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:25 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:25.778+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:26.597 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:26.101+0000 7f822229f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:45:26.597 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:26.101+0000 7f822229f640 -1 osd.8 84 *** Got signal Terminated *** 2024-09-19T09:45:26.597 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:26.101+0000 7f822229f640 -1 osd.8 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:45:26.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:26.449+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:26.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:26.449+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:26.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:26.449+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:26.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:26.449+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:26.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:26 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:26.449+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:27.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:26 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:26.824+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:27.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:26 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:26.824+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:27.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:26 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:26.824+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:27.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:26 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:26.824+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:27.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:26 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:26.824+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:27.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:27.076+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:27.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:27.076+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:27.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:27.076+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:27.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:27.076+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.919283+0000 front 2024-09-19T09:44:58.919363+0000 (oldest deadline 2024-09-19T09:45:24.819220+0000) 2024-09-19T09:45:27.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:26.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:27.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:26.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:27.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:26.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:27.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:26 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:26.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:27.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:27 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:27.482+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:27.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:27 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:27.482+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:27.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:27 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:27.482+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:27.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:27 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:27.482+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:27.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:27 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:27.482+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:28.204 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:27 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:27.861+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:28.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:27 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:27.861+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:28.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:27 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:27.861+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:28.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:27 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:27.861+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:28.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:27 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:27.861+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:28.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:28 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:28.105+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:28.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:28 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:28.105+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:28.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:28 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:28.105+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:28.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:28 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:28.105+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.919283+0000 front 2024-09-19T09:44:58.919363+0000 (oldest deadline 2024-09-19T09:45:24.819220+0000) 2024-09-19T09:45:28.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:27.930+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:28.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:27.930+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:28.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:27.930+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:28.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:27 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:27.930+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:28.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:28 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:28.441+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:28.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:28 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:28.441+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:28.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:28 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:28.441+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:28.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:28 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:28.441+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:28.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:28 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:28.441+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:28.955 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:28 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:28.814+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:28.955 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:28 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:28.814+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:28.955 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:28 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:28.814+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:28.955 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:28 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:28.814+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:28.955 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:28 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:28.814+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:29.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:29.059+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:29.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:29.059+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:29.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:29.059+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:29.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:29.059+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.919283+0000 front 2024-09-19T09:44:58.919363+0000 (oldest deadline 2024-09-19T09:45:24.819220+0000) 2024-09-19T09:45:29.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:28 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:28.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:29.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:28 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:28.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:29.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:28 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:28.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:29.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:28 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:28.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:29.786 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:29.395+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:29.786 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:29.395+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:29.786 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:29.395+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:29.786 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:29.395+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:29.787 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:29 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:29.395+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:30.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:29.781+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:30.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:29.781+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:30.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:29.781+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:30.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:29.781+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:30.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:29 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:29.781+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:30.248 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:30 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:30.090+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:30.248 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:30 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:30.090+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:30.249 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:30 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:30.090+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:30.249 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:30 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:30.090+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.919283+0000 front 2024-09-19T09:44:58.919363+0000 (oldest deadline 2024-09-19T09:45:24.819220+0000) 2024-09-19T09:45:30.249 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:29.940+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:30.249 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:29.940+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:30.249 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:29.940+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:30.249 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:29.940+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:30.249 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:29.940+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:30.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:30 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:30.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:30.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:30 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:30.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:30.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:30 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:30.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:30.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:30 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:30.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:30.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:30 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:30.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:31.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:30 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:30.756+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:31.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:30 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:30.756+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:31.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:30 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:30.756+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:31.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:30 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:30.756+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:31.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:30 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:30.756+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:31.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:30 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:30.756+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:07.587171+0000 front 2024-09-19T09:45:07.587125+0000 (oldest deadline 2024-09-19T09:45:29.887141+0000) 2024-09-19T09:45:31.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:30 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:30.918+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:31.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:30 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:30.918+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:31.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:30 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:30.918+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:31.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:30 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:30.918+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:31.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:30 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:30.918+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:31.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:31 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:31.051+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.515807+0000 front 2024-09-19T09:44:32.515860+0000 (oldest deadline 2024-09-19T09:44:57.215832+0000) 2024-09-19T09:45:31.348 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:31 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:31.051+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:42.516927+0000 front 2024-09-19T09:44:42.516821+0000 (oldest deadline 2024-09-19T09:45:08.416946+0000) 2024-09-19T09:45:31.348 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:31 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:31.051+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.417300+0000 front 2024-09-19T09:44:48.417312+0000 (oldest deadline 2024-09-19T09:45:13.117488+0000) 2024-09-19T09:45:31.348 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:31 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8[54301]: 2024-09-19T09:45:31.051+0000 7f821a89c640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.919283+0000 front 2024-09-19T09:44:58.919363+0000 (oldest deadline 2024-09-19T09:45:24.819220+0000) 2024-09-19T09:45:31.795 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:31 smithi171 podman[70446]: 2024-09-19 09:45:31.597639091 +0000 UTC m=+5.587580227 container died b2bc1edca2a56db0508ada8519a07bb2bc268e5bfd37ac7c2455abc5f0e9a55f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:45:31.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:31 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:31.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:31.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:31 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:31.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:31.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:31 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:31.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:31.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:31 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:31.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:31.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:31 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:31.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:31.885 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:31 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:31.386+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:32.079 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:31 smithi171 podman[70446]: 2024-09-19 09:45:31.876725883 +0000 UTC m=+5.866667009 container cleanup b2bc1edca2a56db0508ada8519a07bb2bc268e5bfd37ac7c2455abc5f0e9a55f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:45:32.079 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:31 smithi171 bash[70446]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8 2024-09-19T09:45:32.079 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:31 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:31.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:32.079 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:31 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:31.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:32.079 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:31 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:31.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:32.080 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:31 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:31.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:32.080 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:31 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:31.892+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:32.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:31 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:31.798+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:32.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:31 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:31.798+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:32.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:31 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:31.798+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:32.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:31 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:31.798+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:32.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:31 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:31.798+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:32.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:31 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:31.798+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:07.587171+0000 front 2024-09-19T09:45:07.587125+0000 (oldest deadline 2024-09-19T09:45:29.887141+0000) 2024-09-19T09:45:32.347 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:32 smithi171 podman[70473]: 2024-09-19 09:45:32.077988038 +0000 UTC m=+0.483436813 container remove b2bc1edca2a56db0508ada8519a07bb2bc268e5bfd37ac7c2455abc5f0e9a55f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:45:32.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:32 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:32.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:32.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:32 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:32.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:32.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:32 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:32.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:32.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:32 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:32.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:32.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:32 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:32.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:32.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:32 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:32.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:32.791 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:32 smithi171 podman[70563]: 2024-09-19 09:45:32.381513304 +0000 UTC m=+0.016175312 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:45:32.791 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:32 smithi171 podman[70563]: 2024-09-19 09:45:32.487234437 +0000 UTC m=+0.121896446 container create 9a96b02eaa2ce230e25fa0510e5217ace67875726ef7401822f6acaa33ec4a66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T09:45:32.791 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:32 smithi171 podman[70563]: 2024-09-19 09:45:32.714907255 +0000 UTC m=+0.349569272 container init 9a96b02eaa2ce230e25fa0510e5217ace67875726ef7401822f6acaa33ec4a66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T09:45:32.791 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:32 smithi171 podman[70563]: 2024-09-19 09:45:32.71862548 +0000 UTC m=+0.353287489 container start 9a96b02eaa2ce230e25fa0510e5217ace67875726ef7401822f6acaa33ec4a66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:45:32.791 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:32 smithi171 podman[70563]: 2024-09-19 09:45:32.789497742 +0000 UTC m=+0.424159751 container attach 9a96b02eaa2ce230e25fa0510e5217ace67875726ef7401822f6acaa33ec4a66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T09:45:33.097 INFO:journalctl@ceph.osd.8.smithi171.stdout:Sep 19 09:45:32 smithi171 podman[70563]: 2024-09-19 09:45:32.911061323 +0000 UTC m=+0.545723332 container died 9a96b02eaa2ce230e25fa0510e5217ace67875726ef7401822f6acaa33ec4a66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:45:33.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:32 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:32.843+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:33.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:32 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:32.843+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:33.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:32 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:32.843+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:33.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:32 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:32.843+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:33.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:32 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:32.843+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:33.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:32 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:32.820+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:33.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:32 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:32.820+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:33.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:32 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:32.820+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:33.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:32 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:32.820+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:33.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:32 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:32.820+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:33.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:32 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:32.820+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:07.587171+0000 front 2024-09-19T09:45:07.587125+0000 (oldest deadline 2024-09-19T09:45:29.887141+0000) 2024-09-19T09:45:33.471 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T09:45:33.510 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:45:33.511 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T09:45:33.511 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T09:45:33.511 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.9 2024-09-19T09:45:33.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:33 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:33.343+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:33.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:33 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:33.343+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:33.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:33 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:33.343+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:33.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:33 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:33.343+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:33.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:33 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:33.343+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:33.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:33 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:33.343+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:33.799 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:33 smithi042 systemd[1]: Stopping Ceph osd.9 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:45:33.799 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:33 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:33.797+0000 7fe94a7e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:45:33.799 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:33 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:33.797+0000 7fe94a7e0640 -1 osd.9 84 *** Got signal Terminated *** 2024-09-19T09:45:33.800 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:33 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:33.797+0000 7fe94a7e0640 -1 osd.9 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:45:34.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:33 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:33.835+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:34.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:33 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:33.835+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:34.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:33 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:33.835+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:34.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:33 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:33.835+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:34.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:33 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:33.835+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:34.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:33 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:33.835+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:07.587171+0000 front 2024-09-19T09:45:07.587125+0000 (oldest deadline 2024-09-19T09:45:29.887141+0000) 2024-09-19T09:45:34.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:33 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:33.876+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:34.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:33 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:33.876+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:34.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:33 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:33.876+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:34.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:33 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:33.876+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:34.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:33 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:33.876+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:34.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:34 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:34.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:34.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:34 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:34.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:34.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:34 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:34.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:34.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:34 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:34.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:34.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:34 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:34.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:34.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:34 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:34.339+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:35.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:34 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:34.813+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:35.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:34 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:34.813+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:35.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:34 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:34.813+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:35.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:34 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:34.813+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:35.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:34 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:34.813+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:35.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:34 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:34.813+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:07.587171+0000 front 2024-09-19T09:45:07.587125+0000 (oldest deadline 2024-09-19T09:45:29.887141+0000) 2024-09-19T09:45:35.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:34 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:34.898+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:35.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:34 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:34.898+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:35.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:34 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:34.898+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:35.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:34 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:34.898+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:35.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:34 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:34.898+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:35.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:35 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:35.364+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:35.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:35 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:35.364+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:35.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:35 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:35.364+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:35.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:35 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:35.364+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:35.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:35 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:35.364+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:35.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:35 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:35.364+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:36.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:35 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:35.838+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:36.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:35 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:35.838+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:36.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:35 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:35.838+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:36.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:35 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:35.838+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:36.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:35 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:35.838+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:36.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:35 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:35.838+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:07.587171+0000 front 2024-09-19T09:45:07.587125+0000 (oldest deadline 2024-09-19T09:45:29.887141+0000) 2024-09-19T09:45:36.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:35 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:35.919+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:36.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:35 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:35.919+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:36.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:35 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:35.919+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:36.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:35 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:35.919+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:36.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:35 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:35.919+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:36.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:36 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:36.331+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:36.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:36 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:36.331+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:36.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:36 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:36.331+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:36.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:36 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:36.331+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:36.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:36 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:36.331+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:36.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:36 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:36.331+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:36.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:36 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:36.331+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:37.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:36 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:36.885+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:37.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:36 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:36.885+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:37.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:36 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:36.885+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:37.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:36 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:36.885+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:37.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:36 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:36.885+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:37.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:36 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:36.885+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:07.587171+0000 front 2024-09-19T09:45:07.587125+0000 (oldest deadline 2024-09-19T09:45:29.887141+0000) 2024-09-19T09:45:37.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:36 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:36.885+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.488453+0000 front 2024-09-19T09:45:14.488483+0000 (oldest deadline 2024-09-19T09:45:36.188435+0000) 2024-09-19T09:45:37.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:36 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:36.901+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:37.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:36 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:36.901+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:37.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:36 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:36.901+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:37.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:36 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:36.901+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:37.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:36 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:36.901+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:37.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:37 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:37.286+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:37.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:37 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:37.286+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:37.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:37 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:37.286+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:37.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:37 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:37.286+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:37.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:37 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:37.286+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:37.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:37 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:37.286+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:37.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:37 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:37.286+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:38.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:37 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:37.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.880786+0000 front 2024-09-19T09:44:26.880885+0000 (oldest deadline 2024-09-19T09:44:50.380906+0000) 2024-09-19T09:45:38.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:37 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:37.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:34.481905+0000 front 2024-09-19T09:44:34.481886+0000 (oldest deadline 2024-09-19T09:44:59.781896+0000) 2024-09-19T09:45:38.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:37 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:37.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.782640+0000 front 2024-09-19T09:44:39.782588+0000 (oldest deadline 2024-09-19T09:45:04.983119+0000) 2024-09-19T09:45:38.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:37 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:37.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:49.584118+0000 front 2024-09-19T09:44:49.584154+0000 (oldest deadline 2024-09-19T09:45:14.284216+0000) 2024-09-19T09:45:38.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:37 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:37.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.485859+0000 front 2024-09-19T09:44:59.485875+0000 (oldest deadline 2024-09-19T09:45:22.886163+0000) 2024-09-19T09:45:38.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:37 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:37.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:07.587171+0000 front 2024-09-19T09:45:07.587125+0000 (oldest deadline 2024-09-19T09:45:29.887141+0000) 2024-09-19T09:45:38.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:37 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9[65507]: 2024-09-19T09:45:37.896+0000 7fe946de5640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.488453+0000 front 2024-09-19T09:45:14.488483+0000 (oldest deadline 2024-09-19T09:45:36.188435+0000) 2024-09-19T09:45:38.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:37 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:37.902+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:38.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:37 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:37.902+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:38.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:37 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:37.902+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:38.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:37 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:37.902+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:38.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:37 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:37.902+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:38.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:38 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:38.250+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:38.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:38 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:38.250+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:38.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:38 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:38.250+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:38.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:38 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:38.250+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:38.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:38 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:38.250+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:38.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:38 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:38.250+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:38.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:38 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:38.250+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:39.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:38 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:38.928+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:39.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:38 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:38.928+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:39.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:38 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:38.928+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:39.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:38 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:38.928+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:39.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:38 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:38.928+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:39.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:38 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:38.928+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:39.408 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:39 smithi042 podman[100975]: 2024-09-19 09:45:39.118359945 +0000 UTC m=+5.407727828 container died c7f8505596a156bfb407a883590f48616f46e3b40214b22bac849297c8b0dfb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:45:39.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:39 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:39.220+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:39.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:39 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:39.220+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:39.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:39 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:39.220+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:39.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:39 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:39.220+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:39.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:39 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:39.220+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:39.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:39 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:39.220+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:39.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:39 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:39.220+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:39.705 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:39 smithi042 podman[100975]: 2024-09-19 09:45:39.59721288 +0000 UTC m=+5.886580760 container cleanup c7f8505596a156bfb407a883590f48616f46e3b40214b22bac849297c8b0dfb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-19T09:45:39.705 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:39 smithi042 bash[100975]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9 2024-09-19T09:45:40.205 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:39 smithi042 podman[100993]: 2024-09-19 09:45:39.882077896 +0000 UTC m=+0.753884455 container remove c7f8505596a156bfb407a883590f48616f46e3b40214b22bac849297c8b0dfb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T09:45:40.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:39 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:39.933+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:40.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:39 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:39.933+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:40.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:39 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:39.933+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:40.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:39 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:39.933+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:40.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:39 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:39.933+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:40.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:39 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:39.933+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:40.511 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:40 smithi042 podman[101083]: 2024-09-19 09:45:40.224588918 +0000 UTC m=+0.110552243 container create 4dd4b68bf6cf133d8151f95ba74cce23881f23e337c2ce2c2bcb1f68cb08d900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T09:45:40.511 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:40 smithi042 podman[101083]: 2024-09-19 09:45:40.130278441 +0000 UTC m=+0.016241720 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:45:40.512 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:40 smithi042 podman[101083]: 2024-09-19 09:45:40.435012978 +0000 UTC m=+0.320976258 container init 4dd4b68bf6cf133d8151f95ba74cce23881f23e337c2ce2c2bcb1f68cb08d900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:45:40.512 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:40 smithi042 podman[101083]: 2024-09-19 09:45:40.438339354 +0000 UTC m=+0.324302629 container start 4dd4b68bf6cf133d8151f95ba74cce23881f23e337c2ce2c2bcb1f68cb08d900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9-deactivate, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:45:40.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:40 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:40.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:40.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:40 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:40.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:40.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:40 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:40.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:40.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:40 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:40.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:40.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:40 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:40.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:40.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:40 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:40.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:40.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:40 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:40.231+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:40.914 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:40 smithi042 podman[101083]: 2024-09-19 09:45:40.509971221 +0000 UTC m=+0.395934501 container attach 4dd4b68bf6cf133d8151f95ba74cce23881f23e337c2ce2c2bcb1f68cb08d900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:45:40.914 INFO:journalctl@ceph.osd.9.smithi042.stdout:Sep 19 09:45:40 smithi042 podman[101083]: 2024-09-19 09:45:40.629377427 +0000 UTC m=+0.515340701 container died 4dd4b68bf6cf133d8151f95ba74cce23881f23e337c2ce2c2bcb1f68cb08d900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:45:41.208 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T09:45:41.251 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:45:41.252 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T09:45:41.252 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T09:45:41.252 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.10 2024-09-19T09:45:41.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:40 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:40.952+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:41.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:40 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:40.952+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:41.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:40 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:40.952+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:41.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:40 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:40.952+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:41.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:40 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:40.952+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:41.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:40 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:40.952+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:41.578 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:41.252+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:41.578 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:41.252+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:41.578 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:41.252+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:41.578 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:41.252+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:41.578 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:41.252+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:41.578 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:41.252+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:41.579 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:41.252+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:41.579 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 systemd[1]: Stopping Ceph osd.10 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:45:41.579 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:41.576+0000 7fb0be22d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:45:41.579 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:41.576+0000 7fb0be22d640 -1 osd.10 84 *** Got signal Terminated *** 2024-09-19T09:45:41.579 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:41 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:41.576+0000 7fb0be22d640 -1 osd.10 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:45:42.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:41 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:41.934+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:42.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:41 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:41.934+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:42.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:41 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:41.934+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:42.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:41 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:41.934+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:42.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:41 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:41.934+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:42.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:41 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:41.934+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:42.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:42 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:42.300+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:42.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:42 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:42.300+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:42.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:42 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:42.300+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:42.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:42 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:42.300+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:42.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:42 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:42.300+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:42.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:42 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:42.300+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:42.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:42 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:42.301+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:43.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:42 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:42.906+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:43.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:42 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:42.906+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:43.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:42 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:42.906+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:43.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:42 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:42.906+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:43.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:42 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:42.906+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:43.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:42 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:42.906+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:43.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:43 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:43.309+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:43.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:43 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:43.309+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:43.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:43 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:43.309+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:43.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:43 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:43.309+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:43.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:43 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:43.309+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:43.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:43 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:43.309+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:43.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:43 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:43.309+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:44.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:43 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:43.863+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:44.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:43 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:43.863+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:44.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:43 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:43.863+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:44.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:43 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:43.863+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:44.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:43 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:43.863+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:44.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:43 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:43.863+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:44.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:44 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:44.275+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:44.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:44 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:44.275+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:44.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:44 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:44.275+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:44.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:44 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:44.275+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:44.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:44 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:44.275+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:44.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:44 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:44.275+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:44.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:44 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:44.275+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:45.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:44 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:44.846+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:45.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:44 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:44.846+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:45.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:44 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:44.846+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:45.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:44 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:44.846+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:45.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:44 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:44.846+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:45.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:44 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:44.846+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:45.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:44 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:44.846+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-09-19T09:45:21.029022+0000 front 2024-09-19T09:45:21.029006+0000 (oldest deadline 2024-09-19T09:45:44.528889+0000) 2024-09-19T09:45:45.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:45 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:45.299+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:45.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:45 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:45.299+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:45.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:45 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:45.299+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:45.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:45 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:45.299+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:45.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:45 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:45.299+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:45.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:45 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:45.300+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:45.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:45 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:45.300+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:46.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:45 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:45.881+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:46.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:45 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:45.881+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:46.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:45 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:45.881+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:46.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:45 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:45.881+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:46.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:45 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:45.881+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:46.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:45 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:45.881+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:46.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:45 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:45.881+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-09-19T09:45:21.029022+0000 front 2024-09-19T09:45:21.029006+0000 (oldest deadline 2024-09-19T09:45:44.528889+0000) 2024-09-19T09:45:46.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:46 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:46.287+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:26.062833+0000 front 2024-09-19T09:44:26.062952+0000 (oldest deadline 2024-09-19T09:44:51.263231+0000) 2024-09-19T09:45:46.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:46 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:46.287+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:32.964234+0000 front 2024-09-19T09:44:32.964263+0000 (oldest deadline 2024-09-19T09:44:57.064502+0000) 2024-09-19T09:45:46.635 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:46 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:46.287+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:39.965547+0000 front 2024-09-19T09:44:39.965436+0000 (oldest deadline 2024-09-19T09:45:04.665631+0000) 2024-09-19T09:45:46.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:46 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:46.287+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-09-19T09:44:48.067185+0000 front 2024-09-19T09:44:48.067356+0000 (oldest deadline 2024-09-19T09:45:13.967070+0000) 2024-09-19T09:45:46.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:46 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:46.287+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:58.667967+0000 front 2024-09-19T09:44:58.667986+0000 (oldest deadline 2024-09-19T09:45:24.568052+0000) 2024-09-19T09:45:46.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:46 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:46.287+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:04.568717+0000 front 2024-09-19T09:45:04.568752+0000 (oldest deadline 2024-09-19T09:45:30.468408+0000) 2024-09-19T09:45:46.636 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:46 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10[59740]: 2024-09-19T09:45:46.287+0000 7fb0ba832640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:10.969308+0000 front 2024-09-19T09:45:10.969387+0000 (oldest deadline 2024-09-19T09:45:36.269227+0000) 2024-09-19T09:45:47.145 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:46 smithi136 podman[69142]: 2024-09-19 09:45:46.892410189 +0000 UTC m=+5.436013926 container died 0a98ec2cba66c638abba96614d31b989638a1ac2b3d021806d62e0de8a2129a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:45:47.145 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:47 smithi136 podman[69142]: 2024-09-19 09:45:47.141631484 +0000 UTC m=+5.685235221 container cleanup 0a98ec2cba66c638abba96614d31b989638a1ac2b3d021806d62e0de8a2129a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T09:45:47.145 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:47 smithi136 bash[69142]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10 2024-09-19T09:45:47.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:46 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:46.859+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:47.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:46 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:46.859+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:47.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:46 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:46.859+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:47.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:46 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:46.859+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:47.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:46 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:46.859+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:47.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:46 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:46.859+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:47.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:46 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:46.859+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-09-19T09:45:21.029022+0000 front 2024-09-19T09:45:21.029006+0000 (oldest deadline 2024-09-19T09:45:44.528889+0000) 2024-09-19T09:45:47.736 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:47 smithi136 podman[69159]: 2024-09-19 09:45:47.409370813 +0000 UTC m=+0.514405157 container remove 0a98ec2cba66c638abba96614d31b989638a1ac2b3d021806d62e0de8a2129a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:45:48.005 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:47 smithi136 podman[69251]: 2024-09-19 09:45:47.73512545 +0000 UTC m=+0.096565531 container create 2d7cbd5d17d17e0a07a9d3d7ef0079f2c0c5592f51f186922aa688a940ae4d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:45:48.005 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:47 smithi136 podman[69251]: 2024-09-19 09:45:47.654433667 +0000 UTC m=+0.015873755 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:45:48.006 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:47 smithi136 podman[69251]: 2024-09-19 09:45:47.929040434 +0000 UTC m=+0.290480516 container init 2d7cbd5d17d17e0a07a9d3d7ef0079f2c0c5592f51f186922aa688a940ae4d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:45:48.006 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:47 smithi136 podman[69251]: 2024-09-19 09:45:47.932246041 +0000 UTC m=+0.293686125 container start 2d7cbd5d17d17e0a07a9d3d7ef0079f2c0c5592f51f186922aa688a940ae4d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T09:45:48.006 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:48 smithi136 podman[69251]: 2024-09-19 09:45:48.0039487 +0000 UTC m=+0.365388797 container attach 2d7cbd5d17d17e0a07a9d3d7ef0079f2c0c5592f51f186922aa688a940ae4d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T09:45:48.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:47 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:47.851+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:48.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:47 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:47.851+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:48.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:47 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:47.851+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:48.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:47 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:47.851+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:48.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:47 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:47.851+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:48.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:47 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:47.851+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:48.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:47 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:47.851+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-09-19T09:45:21.029022+0000 front 2024-09-19T09:45:21.029006+0000 (oldest deadline 2024-09-19T09:45:44.528889+0000) 2024-09-19T09:45:48.385 INFO:journalctl@ceph.osd.10.smithi136.stdout:Sep 19 09:45:48 smithi136 podman[69251]: 2024-09-19 09:45:48.12819592 +0000 UTC m=+0.489636005 container died 2d7cbd5d17d17e0a07a9d3d7ef0079f2c0c5592f51f186922aa688a940ae4d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:45:48.755 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T09:45:48.794 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:45:48.794 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T09:45:48.794 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T09:45:48.795 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.11 2024-09-19T09:45:49.088 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:48 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:48.827+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:49.088 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:48 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:48.827+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:49.088 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:48 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:48.827+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:49.088 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:48 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:48.827+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:49.088 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:48 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:48.827+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:49.088 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:48 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:48.827+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:49.088 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:48 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:48.827+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-09-19T09:45:21.029022+0000 front 2024-09-19T09:45:21.029006+0000 (oldest deadline 2024-09-19T09:45:44.528889+0000) 2024-09-19T09:45:49.089 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:48 smithi171 systemd[1]: Stopping Ceph osd.11 for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:45:49.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:49 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:49.085+0000 7fd0425eb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:45:49.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:49 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:49.085+0000 7fd0425eb640 -1 osd.11 84 *** Got signal Terminated *** 2024-09-19T09:45:49.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:49 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:49.085+0000 7fd0425eb640 -1 osd.11 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:45:50.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:49 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:49.847+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:50.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:49 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:49.847+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:50.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:49 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:49.847+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:50.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:49 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:49.847+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:50.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:49 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:49.847+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:50.347 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:49 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:49.847+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:50.348 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:49 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:49.847+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-09-19T09:45:21.029022+0000 front 2024-09-19T09:45:21.029006+0000 (oldest deadline 2024-09-19T09:45:44.528889+0000) 2024-09-19T09:45:51.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:50 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:50.817+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:51.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:50 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:50.817+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:51.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:50 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:50.817+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:51.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:50 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:50.817+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:51.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:50 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:50.817+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:51.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:50 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:50.817+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:51.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:50 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:50.817+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-09-19T09:45:21.029022+0000 front 2024-09-19T09:45:21.029006+0000 (oldest deadline 2024-09-19T09:45:44.528889+0000) 2024-09-19T09:45:52.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:51 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:51.785+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:52.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:51 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:51.785+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:52.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:51 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:51.785+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:52.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:51 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:51.785+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:52.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:51 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:51.785+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:52.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:51 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:51.785+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:52.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:51 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:51.785+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-09-19T09:45:21.029022+0000 front 2024-09-19T09:45:21.029006+0000 (oldest deadline 2024-09-19T09:45:44.528889+0000) 2024-09-19T09:45:53.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:52 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:52.780+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:53.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:52 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:52.780+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:53.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:52 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:52.780+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:53.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:52 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:52.780+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:53.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:52 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:52.780+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:53.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:52 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:52.780+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:53.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:52 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:52.780+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-09-19T09:45:21.029022+0000 front 2024-09-19T09:45:21.029006+0000 (oldest deadline 2024-09-19T09:45:44.528889+0000) 2024-09-19T09:45:54.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:53 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:53.770+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-09-19T09:44:25.518189+0000 front 2024-09-19T09:44:25.518274+0000 (oldest deadline 2024-09-19T09:44:50.818160+0000) 2024-09-19T09:45:54.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:53 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:53.770+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-09-19T09:44:35.519291+0000 front 2024-09-19T09:44:35.519233+0000 (oldest deadline 2024-09-19T09:44:59.019167+0000) 2024-09-19T09:45:54.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:53 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:53.770+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-09-19T09:44:43.620714+0000 front 2024-09-19T09:44:43.620926+0000 (oldest deadline 2024-09-19T09:45:04.621466+0000) 2024-09-19T09:45:54.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:53 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:53.770+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-09-19T09:44:59.025260+0000 front 2024-09-19T09:44:59.025296+0000 (oldest deadline 2024-09-19T09:45:23.125216+0000) 2024-09-19T09:45:54.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:53 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:53.770+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-09-19T09:45:03.125552+0000 front 2024-09-19T09:45:03.125502+0000 (oldest deadline 2024-09-19T09:45:29.025575+0000) 2024-09-19T09:45:54.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:53 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:53.770+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-09-19T09:45:14.826942+0000 front 2024-09-19T09:45:14.826976+0000 (oldest deadline 2024-09-19T09:45:38.327001+0000) 2024-09-19T09:45:54.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:53 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11[61035]: 2024-09-19T09:45:53.770+0000 7fd03ebf0640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-09-19T09:45:21.029022+0000 front 2024-09-19T09:45:21.029006+0000 (oldest deadline 2024-09-19T09:45:44.528889+0000) 2024-09-19T09:45:54.795 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:54 smithi171 podman[70670]: 2024-09-19 09:45:54.477647275 +0000 UTC m=+5.488881020 container died c2b9e8d0a620d81b346c935d830b36c01b15ce60d088c28a93c1d0fe4780bf4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:45:55.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:54 smithi171 podman[70670]: 2024-09-19 09:45:54.793955263 +0000 UTC m=+5.805189018 container cleanup c2b9e8d0a620d81b346c935d830b36c01b15ce60d088c28a93c1d0fe4780bf4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T09:45:55.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:54 smithi171 bash[70670]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11 2024-09-19T09:45:55.098 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:54 smithi171 podman[70686]: 2024-09-19 09:45:54.986602001 +0000 UTC m=+0.501712740 container remove c2b9e8d0a620d81b346c935d830b36c01b15ce60d088c28a93c1d0fe4780bf4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:45:55.690 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:55 smithi171 podman[70769]: 2024-09-19 09:45:55.412190727 +0000 UTC m=+0.108724496 container create 04790b1b49b4555b920c654ad9396f8f7e490e3dab5d1ef1ad0c77e5da787d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T09:45:55.691 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:55 smithi171 podman[70769]: 2024-09-19 09:45:55.326409835 +0000 UTC m=+0.022943608 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:45:55.691 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:55 smithi171 podman[70769]: 2024-09-19 09:45:55.606414586 +0000 UTC m=+0.302948355 container init 04790b1b49b4555b920c654ad9396f8f7e490e3dab5d1ef1ad0c77e5da787d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T09:45:55.691 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:55 smithi171 podman[70769]: 2024-09-19 09:45:55.60978005 +0000 UTC m=+0.306313820 container start 04790b1b49b4555b920c654ad9396f8f7e490e3dab5d1ef1ad0c77e5da787d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:45:55.691 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:55 smithi171 podman[70769]: 2024-09-19 09:45:55.68935793 +0000 UTC m=+0.385891707 container attach 04790b1b49b4555b920c654ad9396f8f7e490e3dab5d1ef1ad0c77e5da787d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T09:45:56.097 INFO:journalctl@ceph.osd.11.smithi171.stdout:Sep 19 09:45:55 smithi171 podman[70769]: 2024-09-19 09:45:55.794912482 +0000 UTC m=+0.491446252 container died 04790b1b49b4555b920c654ad9396f8f7e490e3dab5d1ef1ad0c77e5da787d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T09:45:56.465 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T09:45:56.503 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:45:56.504 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T09:45:56.504 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T09:45:56.504 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.a 2024-09-19T09:45:56.843 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:45:56 smithi042 systemd[1]: Stopping Ceph mds.a for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:45:57.204 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:45:56 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a[72589]: 2024-09-19T09:45:56.840+0000 7f591a990640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:45:57.205 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:45:56 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a[72589]: 2024-09-19T09:45:56.840+0000 7f591a990640 -1 mds.a *** got signal Terminated *** 2024-09-19T09:46:00.705 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:46:00 smithi042 podman[101198]: 2024-09-19 09:46:00.357535458 +0000 UTC m=+3.642918225 container died 1dc74a60140c9fce22dcf9a19faef85290056b0f2554e036f1a16525c5793f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:46:01.096 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:46:00 smithi042 podman[101198]: 2024-09-19 09:46:00.732294871 +0000 UTC m=+4.017677635 container cleanup 1dc74a60140c9fce22dcf9a19faef85290056b0f2554e036f1a16525c5793f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:46:01.096 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:46:00 smithi042 bash[101198]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a 2024-09-19T09:46:01.097 INFO:journalctl@ceph.mds.a.smithi042.stdout:Sep 19 09:46:00 smithi042 podman[101210]: 2024-09-19 09:46:00.958881778 +0000 UTC m=+0.596395042 container remove 1dc74a60140c9fce22dcf9a19faef85290056b0f2554e036f1a16525c5793f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:46:01.116 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T09:46:01.151 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:01.152 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T09:46:01.152 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T09:46:01.152 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.d 2024-09-19T09:46:01.455 INFO:journalctl@ceph.mds.d.smithi042.stdout:Sep 19 09:46:01 smithi042 systemd[1]: Stopping Ceph mds.d for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:01.955 INFO:journalctl@ceph.mds.d.smithi042.stdout:Sep 19 09:46:01 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-d[71476]: 2024-09-19T09:46:01.488+0000 7fc8f790e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:01.955 INFO:journalctl@ceph.mds.d.smithi042.stdout:Sep 19 09:46:01 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-d[71476]: 2024-09-19T09:46:01.488+0000 7fc8f790e640 -1 mds.d *** got signal Terminated *** 2024-09-19T09:46:04.988 INFO:journalctl@ceph.mds.d.smithi042.stdout:Sep 19 09:46:04 smithi042 podman[101320]: 2024-09-19 09:46:04.721671237 +0000 UTC m=+3.347339155 container died 6c1b1321c6404f6ac6d00789af220220b2a9d43eb9d2c918e29cad88c5c1d2e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:46:05.355 INFO:journalctl@ceph.mds.d.smithi042.stdout:Sep 19 09:46:05 smithi042 podman[101320]: 2024-09-19 09:46:05.111355827 +0000 UTC m=+3.737023742 container cleanup 6c1b1321c6404f6ac6d00789af220220b2a9d43eb9d2c918e29cad88c5c1d2e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-d, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:46:05.355 INFO:journalctl@ceph.mds.d.smithi042.stdout:Sep 19 09:46:05 smithi042 bash[101320]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-d 2024-09-19T09:46:05.492 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T09:46:05.526 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:05.526 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T09:46:05.526 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T09:46:05.526 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.g 2024-09-19T09:46:05.916 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:46:05 smithi042 systemd[1]: Stopping Ceph mds.g for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:06.204 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:46:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-g[72255]: 2024-09-19T09:46:05.914+0000 7f9fc7e37640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:06.205 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:46:05 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-g[72255]: 2024-09-19T09:46:05.914+0000 7f9fc7e37640 -1 mds.g *** got signal Terminated *** 2024-09-19T09:46:08.705 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:46:08 smithi042 podman[101441]: 2024-09-19 09:46:08.368999959 +0000 UTC m=+2.620204654 container died 09904629cc1142539db03ca8935a07ca95b4343889b8ced5f705defef99c12f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:46:09.043 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:46:08 smithi042 podman[101441]: 2024-09-19 09:46:08.781862133 +0000 UTC m=+3.033066872 container cleanup 09904629cc1142539db03ca8935a07ca95b4343889b8ced5f705defef99c12f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T09:46:09.043 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:46:08 smithi042 bash[101441]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-g 2024-09-19T09:46:09.273 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T09:46:09.295 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:46:09 smithi042 podman[101453]: 2024-09-19 09:46:09.041877971 +0000 UTC m=+0.675320019 container remove 09904629cc1142539db03ca8935a07ca95b4343889b8ced5f705defef99c12f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:46:09.295 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:46:09 smithi042 systemd[1]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-19T09:46:09.295 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:46:09 smithi042 systemd[1]: Stopped Ceph mds.g for 90ecc87a-7669-11ef-bceb-c7b262605968. 2024-09-19T09:46:09.296 INFO:journalctl@ceph.mds.g.smithi042.stdout:Sep 19 09:46:09 smithi042 systemd[1]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.g.service: Consumed 1.877s CPU time. 2024-09-19T09:46:09.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:09.307 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T09:46:09.307 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T09:46:09.307 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.j 2024-09-19T09:46:09.654 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:46:09 smithi042 systemd[1]: Stopping Ceph mds.j for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:09.955 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:46:09 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-j[71068]: 2024-09-19T09:46:09.652+0000 7f84bfc0b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:09.955 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:46:09 smithi042 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-j[71068]: 2024-09-19T09:46:09.652+0000 7f84bfc0b640 -1 mds.j *** got signal Terminated *** 2024-09-19T09:46:13.538 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:46:13 smithi042 podman[101560]: 2024-09-19 09:46:13.277383277 +0000 UTC m=+3.748443351 container died 3629a01698098222025b9815d15bc56fabc7d473a42c82fbaa933085d2988617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T09:46:13.922 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:46:13 smithi042 podman[101560]: 2024-09-19 09:46:13.702808561 +0000 UTC m=+4.173868624 container cleanup 3629a01698098222025b9815d15bc56fabc7d473a42c82fbaa933085d2988617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T09:46:13.922 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:46:13 smithi042 bash[101560]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-j 2024-09-19T09:46:14.183 INFO:journalctl@ceph.mds.j.smithi042.stdout:Sep 19 09:46:13 smithi042 podman[101573]: 2024-09-19 09:46:13.920663393 +0000 UTC m=+0.637298478 container remove 3629a01698098222025b9815d15bc56fabc7d473a42c82fbaa933085d2988617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:46:14.187 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T09:46:14.220 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:14.221 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T09:46:14.221 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T09:46:14.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.b 2024-09-19T09:46:14.532 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:46:14 smithi136 systemd[1]: Stopping Ceph mds.b for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:14.885 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:46:14 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b[65116]: 2024-09-19T09:46:14.530+0000 7fdfb36c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:14.885 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:46:14 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b[65116]: 2024-09-19T09:46:14.530+0000 7fdfb36c2640 -1 mds.b *** got signal Terminated *** 2024-09-19T09:46:16.623 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:46:16 smithi136 podman[69354]: 2024-09-19 09:46:16.353882088 +0000 UTC m=+1.933344484 container died 4cc887f8444997cc0a0da998fe4542048135c6372cf9eda6f990e3d1dff161ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:46:16.885 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:46:16 smithi136 podman[69354]: 2024-09-19 09:46:16.70481363 +0000 UTC m=+2.284276014 container cleanup 4cc887f8444997cc0a0da998fe4542048135c6372cf9eda6f990e3d1dff161ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:46:16.885 INFO:journalctl@ceph.mds.b.smithi136.stdout:Sep 19 09:46:16 smithi136 bash[69354]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-b 2024-09-19T09:46:17.130 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T09:46:17.167 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:17.167 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T09:46:17.167 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T09:46:17.167 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.e 2024-09-19T09:46:17.486 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:46:17 smithi136 systemd[1]: Stopping Ceph mds.e for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:17.885 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:46:17 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e[64503]: 2024-09-19T09:46:17.483+0000 7f62a7df2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:17.885 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:46:17 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e[64503]: 2024-09-19T09:46:17.483+0000 7f62a7df2640 -1 mds.e *** got signal Terminated *** 2024-09-19T09:46:20.635 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:46:20 smithi136 podman[69489]: 2024-09-19 09:46:20.353100185 +0000 UTC m=+2.969229797 container died ebc698cbb58691170ed101c50bd18967b7e545cdda0177b1aa8f69b2a9e8c587 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:46:21.092 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:46:20 smithi136 podman[69489]: 2024-09-19 09:46:20.683501066 +0000 UTC m=+3.299630678 container cleanup ebc698cbb58691170ed101c50bd18967b7e545cdda0177b1aa8f69b2a9e8c587 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T09:46:21.093 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:46:20 smithi136 bash[69489]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e 2024-09-19T09:46:21.093 INFO:journalctl@ceph.mds.e.smithi136.stdout:Sep 19 09:46:20 smithi136 podman[69501]: 2024-09-19 09:46:20.876276114 +0000 UTC m=+0.521469946 container remove ebc698cbb58691170ed101c50bd18967b7e545cdda0177b1aa8f69b2a9e8c587 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T09:46:21.117 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T09:46:21.158 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:21.158 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T09:46:21.158 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T09:46:21.159 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.h 2024-09-19T09:46:21.385 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:46:21 smithi136 systemd[1]: Stopping Ceph mds.h for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:21.885 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:46:21 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h[64805]: 2024-09-19T09:46:21.461+0000 7fb3b3cc8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:21.885 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:46:21 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h[64805]: 2024-09-19T09:46:21.461+0000 7fb3b3cc8640 -1 mds.h *** got signal Terminated *** 2024-09-19T09:46:24.621 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:46:24 smithi136 podman[69612]: 2024-09-19 09:46:24.350664177 +0000 UTC m=+2.963981106 container died 3468ae2ee97bfda14e5c4c9965ff3f7bfa1ece01561e1665a1c52d03a2c6eb31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:46:24.885 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:46:24 smithi136 podman[69612]: 2024-09-19 09:46:24.719531756 +0000 UTC m=+3.332848685 container cleanup 3468ae2ee97bfda14e5c4c9965ff3f7bfa1ece01561e1665a1c52d03a2c6eb31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T09:46:24.885 INFO:journalctl@ceph.mds.h.smithi136.stdout:Sep 19 09:46:24 smithi136 bash[69612]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-h 2024-09-19T09:46:25.108 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T09:46:25.141 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:25.141 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T09:46:25.141 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T09:46:25.141 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.k 2024-09-19T09:46:25.385 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:46:25 smithi136 systemd[1]: Stopping Ceph mds.k for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:25.885 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:46:25 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k[64187]: 2024-09-19T09:46:25.489+0000 7f2cc9d1f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:25.885 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:46:25 smithi136 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k[64187]: 2024-09-19T09:46:25.489+0000 7f2cc9d1f640 -1 mds.k *** got signal Terminated *** 2024-09-19T09:46:28.616 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:46:28 smithi136 podman[69733]: 2024-09-19 09:46:28.349863152 +0000 UTC m=+2.987914677 container died f9225b660dddd2a285ede26fab6febe7dac7d2c5ff806286a0d71c796858fb16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T09:46:28.885 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:46:28 smithi136 podman[69733]: 2024-09-19 09:46:28.698027783 +0000 UTC m=+3.336079303 container cleanup f9225b660dddd2a285ede26fab6febe7dac7d2c5ff806286a0d71c796858fb16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T09:46:28.885 INFO:journalctl@ceph.mds.k.smithi136.stdout:Sep 19 09:46:28 smithi136 bash[69733]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-k 2024-09-19T09:46:29.117 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T09:46:29.149 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:29.149 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T09:46:29.149 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T09:46:29.150 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.c 2024-09-19T09:46:29.443 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:46:29 smithi171 systemd[1]: Stopping Ceph mds.c for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:29.763 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:46:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c[66319]: 2024-09-19T09:46:29.441+0000 7f6d328ea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:29.763 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:46:29 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c[66319]: 2024-09-19T09:46:29.441+0000 7f6d328ea640 -1 mds.c *** got signal Terminated *** 2024-09-19T09:46:32.618 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:46:32 smithi171 podman[70871]: 2024-09-19 09:46:32.349105662 +0000 UTC m=+3.005734149 container died fe1c194fe6538a8fdb19e4649f0c2dd20846ac4af273ad823a1e152b9f1ff6e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:46:32.985 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:46:32 smithi171 podman[70871]: 2024-09-19 09:46:32.707950777 +0000 UTC m=+3.364579264 container cleanup fe1c194fe6538a8fdb19e4649f0c2dd20846ac4af273ad823a1e152b9f1ff6e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:46:32.985 INFO:journalctl@ceph.mds.c.smithi171.stdout:Sep 19 09:46:32 smithi171 bash[70871]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-c 2024-09-19T09:46:33.139 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T09:46:33.174 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:33.174 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T09:46:33.174 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T09:46:33.174 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.f 2024-09-19T09:46:33.597 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:46:33 smithi171 systemd[1]: Stopping Ceph mds.f for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:33.597 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:46:33 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f[66020]: 2024-09-19T09:46:33.469+0000 7f4b1da9b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:33.597 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:46:33 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f[66020]: 2024-09-19T09:46:33.469+0000 7f4b1da9b640 -1 mds.f *** got signal Terminated *** 2024-09-19T09:46:36.622 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:46:36 smithi171 podman[71002]: 2024-09-19 09:46:36.369169548 +0000 UTC m=+2.978817952 container died 1a3e427bc622fe3c5836b35d8c30ab697b77db098caf67c90b2846dc45dceab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:46:37.071 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:46:36 smithi171 podman[71002]: 2024-09-19 09:46:36.711310375 +0000 UTC m=+3.320958778 container cleanup 1a3e427bc622fe3c5836b35d8c30ab697b77db098caf67c90b2846dc45dceab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T09:46:37.071 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:46:36 smithi171 bash[71002]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f 2024-09-19T09:46:37.071 INFO:journalctl@ceph.mds.f.smithi171.stdout:Sep 19 09:46:36 smithi171 podman[71013]: 2024-09-19 09:46:36.870958456 +0000 UTC m=+0.497170543 container remove 1a3e427bc622fe3c5836b35d8c30ab697b77db098caf67c90b2846dc45dceab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T09:46:37.092 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T09:46:37.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:37.125 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T09:46:37.125 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T09:46:37.125 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.i 2024-09-19T09:46:37.347 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:46:37 smithi171 systemd[1]: Stopping Ceph mds.i for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:37.847 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:46:37 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i[66618]: 2024-09-19T09:46:37.440+0000 7f2d566b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:37.847 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:46:37 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i[66618]: 2024-09-19T09:46:37.440+0000 7f2d566b8640 -1 mds.i *** got signal Terminated *** 2024-09-19T09:46:40.633 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:46:40 smithi171 podman[71123]: 2024-09-19 09:46:40.372562439 +0000 UTC m=+3.025878361 container died 61a5122301e2aa28d1951f1d0490d0530b8ae05f5eb12670a86262a1357eae88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:46:40.883 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:46:40 smithi171 podman[71123]: 2024-09-19 09:46:40.714961031 +0000 UTC m=+3.368276944 container cleanup 61a5122301e2aa28d1951f1d0490d0530b8ae05f5eb12670a86262a1357eae88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:46:40.884 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:46:40 smithi171 bash[71123]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i 2024-09-19T09:46:41.136 INFO:journalctl@ceph.mds.i.smithi171.stdout:Sep 19 09:46:40 smithi171 podman[71138]: 2024-09-19 09:46:40.882512964 +0000 UTC m=+0.503883866 container remove 61a5122301e2aa28d1951f1d0490d0530b8ae05f5eb12670a86262a1357eae88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:46:41.140 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T09:46:41.172 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:41.173 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T09:46:41.173 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T09:46:41.173 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.l 2024-09-19T09:46:41.494 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:46:41 smithi171 systemd[1]: Stopping Ceph mds.l for 90ecc87a-7669-11ef-bceb-c7b262605968... 2024-09-19T09:46:41.847 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:46:41 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l[65719]: 2024-09-19T09:46:41.492+0000 7fd696923640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:46:41.847 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:46:41 smithi171 ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l[65719]: 2024-09-19T09:46:41.492+0000 7fd696923640 -1 mds.l *** got signal Terminated *** 2024-09-19T09:46:44.611 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:46:44 smithi171 podman[71244]: 2024-09-19 09:46:44.350941168 +0000 UTC m=+2.962082534 container died b5e61c7101ad016750892c2ad55b209951f72c7cef0159afc73666a39dc299de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:46:44.978 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:46:44 smithi171 podman[71244]: 2024-09-19 09:46:44.726588318 +0000 UTC m=+3.337729674 container cleanup b5e61c7101ad016750892c2ad55b209951f72c7cef0159afc73666a39dc299de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:46:44.978 INFO:journalctl@ceph.mds.l.smithi171.stdout:Sep 19 09:46:44 smithi171 bash[71244]: ceph-90ecc87a-7669-11ef-bceb-c7b262605968-mds-l 2024-09-19T09:46:45.140 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-90ecc87a-7669-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T09:46:45.171 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:46:45.172 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T09:46:45.172 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:46:45.385 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:46:48.129 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:46:48.330 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:46:50.864 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:46:51.068 INFO:teuthology.orchestra.run.smithi171.stdout:Deleting cluster with fsid: 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:46:53.420 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:46:53.455 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:46:53.488 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:46:53.515 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T09:46:53.517 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919/remote/smithi042/crash 2024-09-19T09:46:53.518 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:46:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:tar: /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:46:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:46:53.549 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919/remote/smithi136/crash 2024-09-19T09:46:53.550 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:46:53.590 INFO:teuthology.orchestra.run.smithi136.stderr:tar: /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:46:53.590 INFO:teuthology.orchestra.run.smithi136.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:46:53.592 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919/remote/smithi171/crash 2024-09-19T09:46:53.593 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:46:53.648 INFO:teuthology.orchestra.run.smithi171.stderr:tar: /var/lib/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:46:53.648 INFO:teuthology.orchestra.run.smithi171.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:46:53.649 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T09:46:53.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T09:46:53.689 INFO:tasks.cephadm:Compressing logs... 2024-09-19T09:46:53.689 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:46:53.731 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:46:53.733 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:46:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T09:46:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T09:46:53.765 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T09:46:53.765 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:46:53.765 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:46:53.765 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T09:46:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:46:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T09:46:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T09:46:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mon.a.log: 82.1% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:46:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T09:46:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:46:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.6.log: /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:46:53.769 INFO:teuthology.orchestra.run.smithi171.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory 2024-09-19T09:46:53.769 INFO:teuthology.orchestra.run.smithi171.stderr: -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:46:53.769 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:46:53.769 INFO:teuthology.orchestra.run.smithi171.stderr:gzip/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T09:46:53.769 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T09:46:53.769 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:46:53.769 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T09:46:53.769 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T09:46:53.770 INFO:teuthology.orchestra.run.smithi171.stderr: 82.5% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:46:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:gzip/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.11.log: -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T09:46:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:46:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T09:46:53.770 INFO:teuthology.orchestra.run.smithi171.stderr: 90.4% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:46:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.log: 87.0% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:46:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T09:46:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T09:46:53.772 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:46:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T09:46:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:: No such file or directory 2024-09-19T09:46:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.5% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:46:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:46:53.776 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:46:53.776 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T09:46:53.776 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T09:46:53.778 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mgr.y.log: 92.3% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T09:46:53.778 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T09:46:53.778 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.log: 91.0% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:46:53.778 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T09:46:53.779 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.d.log: 87.0% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:46:53.779 INFO:teuthology.orchestra.run.smithi042.stderr: 94.7% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T09:46:53.779 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T09:46:53.781 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.h.log: 87.0% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:46:53.781 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T09:46:53.781 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T09:46:53.781 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T09:46:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.8% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T09:46:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:46:53.788 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T09:46:53.788 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T09:46:53.789 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:46:53.797 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:46:53.804 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:46:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:46:53.823 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:46:53.970 INFO:teuthology.orchestra.run.smithi042.stderr: 93.8% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T09:46:54.008 INFO:teuthology.orchestra.run.smithi042.stderr: 93.5% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T09:46:54.008 INFO:teuthology.orchestra.run.smithi042.stderr: 90.1% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T09:46:54.075 INFO:teuthology.orchestra.run.smithi136.stderr: 94.3% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T09:46:54.104 INFO:teuthology.orchestra.run.smithi136.stderr: 93.7% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T09:46:54.201 INFO:teuthology.orchestra.run.smithi136.stderr: 91.7% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T09:46:54.324 INFO:teuthology.orchestra.run.smithi171.stderr: 91.7% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T09:46:54.452 INFO:teuthology.orchestra.run.smithi042.stderr: 90.5% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T09:46:55.298 INFO:teuthology.orchestra.run.smithi136.stderr: 93.9% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T09:46:55.461 INFO:teuthology.orchestra.run.smithi042.stderr: 93.7% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T09:46:55.505 INFO:teuthology.orchestra.run.smithi136.stderr: 93.7% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T09:46:55.621 INFO:teuthology.orchestra.run.smithi042.stderr: 93.8% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T09:46:55.673 INFO:teuthology.orchestra.run.smithi042.stderr: 93.6% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T09:46:55.707 INFO:teuthology.orchestra.run.smithi171.stderr: 94.0% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T09:46:55.750 INFO:teuthology.orchestra.run.smithi042.stderr: 93.7% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T09:46:55.753 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-19T09:46:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m2.007s 2024-09-19T09:46:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m8.529s 2024-09-19T09:46:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m0.335s 2024-09-19T09:46:55.870 INFO:teuthology.orchestra.run.smithi136.stderr: 93.7% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T09:46:55.954 INFO:teuthology.orchestra.run.smithi171.stderr: 93.6% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T09:46:56.096 INFO:teuthology.orchestra.run.smithi171.stderr: 93.8% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T09:46:56.104 INFO:teuthology.orchestra.run.smithi171.stderr: 93.8% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T09:46:56.106 INFO:teuthology.orchestra.run.smithi171.stderr: 93.8% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T09:46:56.125 INFO:teuthology.orchestra.run.smithi136.stderr: 93.8% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T09:46:56.276 INFO:teuthology.orchestra.run.smithi171.stderr: 93.7% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T09:46:56.365 INFO:teuthology.orchestra.run.smithi136.stderr: 94.0% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T09:46:56.467 INFO:teuthology.orchestra.run.smithi171.stderr: 93.9% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T09:46:57.851 INFO:teuthology.orchestra.run.smithi171.stderr: 95.3% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T09:46:57.853 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-09-19T09:46:57.853 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m4.105s 2024-09-19T09:46:57.853 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m19.817s 2024-09-19T09:46:57.853 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m0.634s 2024-09-19T09:47:41.801 INFO:teuthology.orchestra.run.smithi136.stderr: 93.2% -- replaced with /var/log/ceph/90ecc87a-7669-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T09:47:41.803 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-09-19T09:47:41.803 INFO:teuthology.orchestra.run.smithi136.stderr:real 0m48.054s 2024-09-19T09:47:41.803 INFO:teuthology.orchestra.run.smithi136.stderr:user 0m57.256s 2024-09-19T09:47:41.803 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m1.830s 2024-09-19T09:47:41.803 INFO:tasks.cephadm:Archiving logs... 2024-09-19T09:47:41.804 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919/remote/smithi042/log 2024-09-19T09:47:41.805 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:47:42.965 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919/remote/smithi136/log 2024-09-19T09:47:42.966 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:47:51.653 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919/remote/smithi171/log 2024-09-19T09:47:51.654 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:47:53.755 INFO:tasks.cephadm:Removing cluster... 2024-09-19T09:47:53.755 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 --force 2024-09-19T09:47:53.965 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:47:54.246 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 --force 2024-09-19T09:47:54.450 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:47:54.789 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 90ecc87a-7669-11ef-bceb-c7b262605968 --force 2024-09-19T09:47:54.993 INFO:teuthology.orchestra.run.smithi171.stdout:Deleting cluster with fsid: 90ecc87a-7669-11ef-bceb-c7b262605968 2024-09-19T09:47:55.306 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T09:47:55.307 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:47:55.327 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:47:55.344 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:47:55.360 INFO:tasks.cephadm:Teardown complete 2024-09-19T09:47:55.360 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:47:55.376 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:47:55.376 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:47:55.379 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:47:55.386 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:47:55.488 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:47:55.497 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:47:55.498 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:47:55.501 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:47:55.503 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:47:55.516 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:47:55.516 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:47:55.518 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:47:55.522 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:47:55.522 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-19T09:47:55.522 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 +565us[ +694us] +/- 36ms 2024-09-19T09:47:55.522 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -1902us[-1902us] +/- 70ms 2024-09-19T09:47:55.522 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +927us[+1056us] +/- 60ms 2024-09-19T09:47:55.522 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:47:55.524 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:47:55.524 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-09-19T09:47:55.524 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 +543us[ +630us] +/- 36ms 2024-09-19T09:47:55.524 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -1932us[-1844us] +/- 70ms 2024-09-19T09:47:55.524 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +888us[ +976us] +/- 60ms 2024-09-19T09:47:55.525 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:47:55.525 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:47:55.525 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-09-19T09:47:55.525 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 +519us[ +534us] +/- 36ms 2024-09-19T09:47:55.525 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -1935us[-1919us] +/- 70ms 2024-09-19T09:47:55.525 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +885us[ +901us] +/- 60ms 2024-09-19T09:47:55.525 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:47:55.525 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:47:55.538 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:47:55.539 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:47:55.555 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:47:55.651 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:47:55.719 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:47:55.788 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:47:55.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:47:55.820 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:47:55.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:47:55.849 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:47:55.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:47:55.877 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:47:55.887 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:47:55.898 INFO:teuthology.task.internal:Duration was 1491.506009 seconds 2024-09-19T09:47:55.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:47:55.915 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:47:55.915 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:47:55.918 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:47:55.921 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:47:55.958 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:47:55.958 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:47:55.959 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:47:56.428 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:47:56.428 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-09-19T09:47:56.428 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:47:56.452 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-09-19T09:47:56.452 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:47:56.489 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-09-19T09:47:56.489 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:47:56.514 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:47:56.514 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:47:56.516 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:47:56.532 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:47:56.580 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:47:56.581 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:47:56.587 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:47:56.600 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:47:57.526 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:47:57.538 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:47:57.538 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:47:57.564 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:47:57.592 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:47:57.622 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:47:57.636 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:47:57.639 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:47:57.641 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:47:57.660 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-09-19T09:47:57.664 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-09-19T09:47:57.691 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-09-19T09:47:57.710 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:47:57.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:47:57.729 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:47:57.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:47:57.746 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:47:57.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:47:57.766 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:47:57.777 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:47:57.779 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919/remote/smithi042 2024-09-19T09:47:57.779 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:47:57.837 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919/remote/smithi136 2024-09-19T09:47:57.838 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:47:57.879 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911919/remote/smithi171 2024-09-19T09:47:57.880 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:47:57.920 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:47:57.920 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:47:57.923 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:47:57.925 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:47:57.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:47:57.984 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:47:57.985 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:47:57.997 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:47:57.997 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:47:58.000 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:47:58.002 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:47:58.013 INFO:teuthology.orchestra.run.smithi042.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:47 /home/ubuntu/cephtest 2024-09-19T09:47:58.015 INFO:teuthology.orchestra.run.smithi136.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:47 /home/ubuntu/cephtest 2024-09-19T09:47:58.028 INFO:teuthology.orchestra.run.smithi171.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:47 /home/ubuntu/cephtest 2024-09-19T09:47:58.029 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:47:58.041 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:47:58.067 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} duration: 1491.506008863449 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T09:47:58.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:47:58.152 INFO:teuthology.run:pass